2021-10-20T23:05:22.543 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-20T23:05:22.545 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002 --verbose --description fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --name yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi -- /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/orig.config.yaml 2021-10-20T23:05:22.602 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-10-20T23:05:22.668 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002 branch: wip-yuri5-testing-2021-10-20-0922-octopus description: fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6453002' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri5-testing-2021-10-20-0922-octopus ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 3fb760aae831e6138791851b7921f8f0e05db414 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 3fb760aae831e6138791851b7921f8f0e05db414 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri5-testing-2021-10-20-0922-octopus sha1: 3fb760aae831e6138791851b7921f8f0e05db414 owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 sha1: 3fb760aae831e6138791851b7921f8f0e05db414 sleep_before_teardown: 0 suite: fs suite_branch: wip-yuri5-testing-2021-10-20-0922-octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3fb760aae831e6138791851b7921f8f0e05db414 targets: smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCie0CDk0zxC4RmtTbSWDe9460hatbPL+TafxjoV3vs4KV/I6Osp+XUvMn623QuLIDANVbMrhg/qIfYaIMSsrJ5ByyaryqMmRvnv8idNncn9j1F/YqN86hl8AYKFxJiKpEtMg0G2jW3wy0vCK8Q4E+Y5ipq26D4MQJ5NpFSmtXLDr0L19JNQKRAi9iTXzn0FI0zkPkPhnAlXMEkpnW0OoJrEANz7hkOkEDuCwtiAmXGwk5wofTRGeg53yfwNkSC7UOtUgsjvYAMnnd24lF7PxxHyGiOwhVGQhCy9gRIRVoMk9PW9EApyyPr3Rm1q/T8fIyloS6cKfyZflUAXyJACdVIfZNWnC537JwaDfKxAxTdL9MOYbBLUIThLLhhoAAWqAdVBq3ZsPaDpB+d0v5F5whblLegLAtfpp+IKGQuXkTWjFP5lavixYxWJOb3wyYRkGQ6SIavMQ2NovLT5O54Ho/SyeKsR3j7kFI8mYY2KQ0OjL46u0cRAD+jkKhbO7ZIiv0= smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsD83MSr0Bls2DOXA3npp+oARqw5TJYFobxhAVxNUpLTKB2KPHSGB5JKGM/OVMAfjKNKxt7yYhHsnf078eKoRE4fY+fZz4YKrDHe57pWgPsGa4pfY96sQb91h1jnvUsU+1tFOpWK9jYiCpVYXhF80O45maKRIU0Rqs2zCGRLYxB7X08irBv/Soc2WYewdlEIbt4PID4eAWQ4xjI9VMK6bcYGU46s/L+NHUgu8Z12JSLuHw9dRiXL44ELTsx65pkTu5ZPf/wW8aY45HIZdfj+a0QmEQ+6zMLesWfkH8xcrYwFu2dP5V54X6Nxbc0iUNKlQ+rHXB6XX9phiCXG9AJyTnxgZ9l4/5oTwRwtJ9Lnt6C6Vpb40Gyf3E3TprhQSpow0vVv7ltsolhS05Xh14L1UqN3ZFB/XBFFO3ezuX4V2NaJBry6tD2MELlr5jAPj6+H1N67QKMEYmPMMjUY/BkseLRifbNw2HDS0gIQO73Nyh05v3tgl1jev163PQIo5MCkc= smithi119.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKHeMxSBN9bt7e51nAsCIXzyCfVEzulwvcb79ie/B2AOIg/sVUvd4WRH75f1CSHTPCGXFxRu+IhwAz2FYCuT6Sddg5cS/mWBGFPF/I9lhdddE4H1a6oJZ/eH8qlTVJ6h9kt9FQ7kdC1TkyC/kwyFDOdKZgR8Au5TdkpyjKeYIbTBhE0QUdUfI8NibKqLkwLpvAyl+ksKaNTnXvanBa6YRPwQKBRJHbOAw89eu5NX1qD7Os8Sx0L+LsD7xJKaAcvfzdM/024pDNEZwk6j2lGzaNXG3P2fKsQYGpAJsbAH2trj7ciwLMcglAwLdLTKWD7X0NAAygzZ3kkl2vo83ITatPRYO16tuHD/G0AiqC3Sa8UIJCNjSPFr22WvQzMb/ESJfmrAqokB5c3BdYR9IWMUq8oO3606++7oLEww4TJkZX1Ws8gIclATgXEQgjOl/oAiWVvtVbeMz/sTZXdQOhKfdu/jO6rw1kMgveNNeIpfyplcheyf9A+yn88i/Y06StqY0= smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNfJECBM3sjq99kuedwl6QLJSTeMn177h7ZyehleV/v19KrA6bvNwIJJNkOE0SI8XT7kGcvyh2hPp4P7LSvHSbQJ7G2rJlu8p8hXX/ZYVXjNb08M1pgZ5gL+tC2kaRv3kUAaNIngWmf28tMxl0ZOIikrG7wT17eNydFFdDUn2l9k03uJf4l0zGBD3Aqst2M9TpO0EH8652DM3ujLroWpifIm6bdGKCYDDaSdnvZAfFNAn0dGfwAISRqysD1whxeyRcySOQfTJFkbIRYKHOaUkBcP8xddOezHOJouQ69n79BhpD/yhKFg1V4Hz70RlynlfbNZuZZuTNtFGXlJulCm1jFxuXFDrbIbWaxeEWVeE+ci2gKn7jDHMaTvYO/1eX08TYnb6irGSJZrRrHtzy4PbUzorFzLy+j/UNpTGEU/ks+rWoPNTqF6TNx80RbDsE+SwB8LS+9ap7bYpoAxJWHgxMrmXtWcIhy9PPpRjsC+Ixv2GpmDdGKyxMIKwslUp7cRs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: b35344e81ac507b6cad7c1cae575ce08b9c766f2 timestamp: 2021-10-20_18:49:58 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.6888 2021-10-20T23:05:22.669 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa; will attempt to use it 2021-10-20T23:05:22.670 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks 2021-10-20T23:05:22.670 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-10-20T23:05:22.673 INFO:teuthology.task.internal:Checking packages... 2021-10-20T23:05:22.698 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3fb760aae831e6138791851b7921f8f0e05db414' 2021-10-20T23:05:22.698 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-10-20T23:05:22.699 INFO:teuthology.packaging:ref: None 2021-10-20T23:05:22.699 INFO:teuthology.packaging:tag: None 2021-10-20T23:05:22.699 INFO:teuthology.packaging:branch: wip-yuri5-testing-2021-10-20-0922-octopus 2021-10-20T23:05:22.700 INFO:teuthology.packaging:sha1: 3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:05:22.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri5-testing-2021-10-20-0922-octopus 2021-10-20T23:05:22.970 INFO:teuthology.task.internal:Found packages for ceph version 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:05:22.971 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-10-20T23:05:22.982 INFO:teuthology.task.internal:no buildpackages task found 2021-10-20T23:05:22.983 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-10-20T23:05:23.026 INFO:teuthology.task.internal:Saving configuration 2021-10-20T23:05:23.044 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-10-20T23:05:23.055 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-20T23:05:23.076 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-20 22:58:39.863947', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFNpuK/V/SG+tNwGC3YAR+vpRP9iBqiba0DOvxQLlBDN'} 2021-10-20T23:05:23.109 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-20 22:58:39.863966', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILTl8/6hqybBTlvbJEbxIsJbT7tiLQv4LHRHUGEsDUXM'} 2021-10-20T23:05:23.131 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-20 22:58:39.863984', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOLnvnDoNBdjplhgCY15rZPgj3SxUL9C9mgnBlRGA/ag'} 2021-10-20T23:05:23.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-20 22:58:39.863925', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJnQab+dQD7k3YI7IvK/g6G+Q/Q5NVvLv7PCgzAKh7Ah'} 2021-10-20T23:05:23.159 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-10-20T23:05:23.174 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-10-20T23:05:23.175 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-10-20T23:05:23.175 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['client.0'] 2021-10-20T23:05:23.176 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['client.1'] 2021-10-20T23:05:23.176 INFO:teuthology.run_tasks:Running task console_log... 2021-10-20T23:05:23.377 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f90cccd3d90>, signals=[15]) 2021-10-20T23:05:23.378 INFO:teuthology.run_tasks:Running task internal.connect... 2021-10-20T23:05:23.395 INFO:teuthology.task.internal:Opening connections... 2021-10-20T23:05:23.395 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2021-10-20T23:05:23.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:05:23.453 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2021-10-20T23:05:23.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:05:23.508 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2021-10-20T23:05:23.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:05:23.566 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2021-10-20T23:05:23.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:05:23.624 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-10-20T23:05:23.635 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2021-10-20T23:05:23.643 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2021-10-20T23:05:23.643 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2021-10-20T23:05:23.691 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2021-10-20T23:05:23.692 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-20T23:05:23.692 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2021-10-20T23:05:23.692 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2021-10-20T23:05:23.692 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-20T23:05:23.693 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="20.04" 2021-10-20T23:05:23.693 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-20T23:05:23.693 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-20T23:05:23.694 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-20T23:05:23.694 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-20T23:05:23.695 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=focal 2021-10-20T23:05:23.695 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=focal 2021-10-20T23:05:23.696 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2021-10-20T23:05:23.714 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2021-10-20T23:05:23.721 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2021-10-20T23:05:23.721 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2021-10-20T23:05:23.771 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2021-10-20T23:05:23.772 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-20T23:05:23.772 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2021-10-20T23:05:23.772 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2021-10-20T23:05:23.773 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-20T23:05:23.773 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="20.04" 2021-10-20T23:05:23.773 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-20T23:05:23.773 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-20T23:05:23.774 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-20T23:05:23.774 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-20T23:05:23.775 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=focal 2021-10-20T23:05:23.775 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=focal 2021-10-20T23:05:23.776 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2021-10-20T23:05:23.794 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2021-10-20T23:05:23.803 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2021-10-20T23:05:23.804 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2021-10-20T23:05:23.851 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2021-10-20T23:05:23.851 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-20T23:05:23.852 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2021-10-20T23:05:23.852 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2021-10-20T23:05:23.852 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-20T23:05:23.852 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="20.04" 2021-10-20T23:05:23.853 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-20T23:05:23.853 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-20T23:05:23.853 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-20T23:05:23.853 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-20T23:05:23.853 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=focal 2021-10-20T23:05:23.854 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=focal 2021-10-20T23:05:23.854 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2021-10-20T23:05:23.871 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2021-10-20T23:05:23.882 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2021-10-20T23:05:23.883 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2021-10-20T23:05:23.931 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2021-10-20T23:05:23.932 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-20T23:05:23.932 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2021-10-20T23:05:23.932 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2021-10-20T23:05:23.932 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-20T23:05:23.933 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="20.04" 2021-10-20T23:05:23.933 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-20T23:05:23.933 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-20T23:05:23.933 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-20T23:05:23.934 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-20T23:05:23.934 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=focal 2021-10-20T23:05:23.934 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=focal 2021-10-20T23:05:23.934 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2021-10-20T23:05:23.956 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-10-20T23:05:23.985 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-10-20T23:05:24.001 INFO:teuthology.task.internal:Checking for old test directory... 2021-10-20T23:05:24.002 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2021-10-20T23:05:24.005 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2021-10-20T23:05:24.008 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2021-10-20T23:05:24.011 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2021-10-20T23:05:24.021 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-10-20T23:05:24.031 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-10-20T23:05:24.032 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2021-10-20T23:05:24.051 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2021-10-20T23:05:24.068 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2021-10-20T23:05:24.073 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2021-10-20T23:05:24.098 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-10-20T23:05:24.196 INFO:teuthology.run_tasks:Running task kernel... 2021-10-20T23:05:24.219 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-10-20T23:05:24.219 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-10-20T23:05:24.220 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2021-10-20T23:05:24.234 INFO:teuthology.orchestra.run.smithi012.stdout:5.4.0-88-generic 2021-10-20T23:05:24.234 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.4.0-88-generic 2021-10-20T23:05:24.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2021-10-20T23:05:24.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2021-10-20T23:05:24.450 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-10-20T23:05:24.561 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:05:24.642 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-10-20T23:05:24.782 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [296 kB] 2021-10-20T23:05:24.849 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [935 kB] 2021-10-20T23:05:24.890 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [177 kB] 2021-10-20T23:05:24.893 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,840 B] 2021-10-20T23:05:24.893 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [475 kB] 2021-10-20T23:05:24.904 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [68.3 kB] 2021-10-20T23:05:24.904 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [646 kB] 2021-10-20T23:05:24.922 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [512 kB] 2021-10-20T23:05:24.923 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [106 kB] 2021-10-20T23:05:24.924 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.7 kB] 2021-10-20T23:05:24.979 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-10-20T23:05:25.107 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,294 kB] 2021-10-20T23:05:25.453 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [550 kB] 2021-10-20T23:05:25.476 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [269 kB] 2021-10-20T23:05:25.491 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.4 kB] 2021-10-20T23:05:25.492 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.4 kB] 2021-10-20T23:05:25.492 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [522 kB] 2021-10-20T23:05:25.513 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [74.8 kB] 2021-10-20T23:05:25.536 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-10-20T23:05:25.536 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [642 kB] 2021-10-20T23:05:25.565 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [867 kB] 2021-10-20T23:05:25.598 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [186 kB] 2021-10-20T23:05:25.603 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.3 kB] 2021-10-20T23:05:25.643 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-10-20T23:05:25.644 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-10-20T23:05:25.645 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-10-20T23:05:25.645 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-10-20T23:05:28.963 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 8,065 kB in 2s (5,339 kB/s) 2021-10-20T23:05:30.120 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2021-10-20T23:05:30.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:05:30.207 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2021-10-20T23:05:30.377 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2021-10-20T23:05:30.378 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2021-10-20T23:05:30.530 INFO:teuthology.orchestra.run.smithi012.stdout:The following package was automatically installed and is no longer required: 2021-10-20T23:05:30.531 INFO:teuthology.orchestra.run.smithi012.stdout: libllvm11 2021-10-20T23:05:30.531 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove it. 2021-10-20T23:05:30.532 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2021-10-20T23:05:30.532 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:05:30.532 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-generic linux-image-5.4.0-89-generic 2021-10-20T23:05:30.533 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-5.4.0-89-generic linux-modules-extra-5.4.0-89-generic 2021-10-20T23:05:30.533 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2021-10-20T23:05:30.533 INFO:teuthology.orchestra.run.smithi012.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-10-20T23:05:30.533 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2021-10-20T23:05:30.534 INFO:teuthology.orchestra.run.smithi012.stdout: thermald 2021-10-20T23:05:30.571 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2021-10-20T23:05:30.571 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:05:30.572 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-89-generic linux-modules-5.4.0-89-generic 2021-10-20T23:05:30.572 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-extra-5.4.0-89-generic 2021-10-20T23:05:30.573 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages will be upgraded: 2021-10-20T23:05:30.574 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-generic linux-image-generic 2021-10-20T23:05:30.812 INFO:teuthology.orchestra.run.smithi012.stdout:3 upgraded, 5 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:05:30.812 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 75.6 MB of archives. 2021-10-20T23:05:30.813 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 378 MB of additional disk space will be used. 2021-10-20T23:05:30.813 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-89-generic amd64 5.4.0-89.100 [14.8 MB] 2021-10-20T23:05:32.012 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-89-generic amd64 5.4.0-89.100 [8,990 kB] 2021-10-20T23:05:32.245 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-89-generic amd64 5.4.0-89.100 [39.4 MB] 2021-10-20T23:05:33.605 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.89.93 [1,900 B] 2021-10-20T23:05:33.606 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.89.93 [2,576 B] 2021-10-20T23:05:33.607 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89 all 5.4.0-89.100 [11.0 MB] 2021-10-20T23:05:33.961 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89-generic amd64 5.4.0-89.100 [1,391 kB] 2021-10-20T23:05:34.003 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.89.93 [2,436 B] 2021-10-20T23:05:34.482 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 75.6 MB in 3s (22.1 MB/s) 2021-10-20T23:05:34.659 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-5.4.0-89-generic. 2021-10-20T23:05:36.476 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-10-20T23:05:36.483 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../0-linux-modules-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:05:36.613 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:05:38.605 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-image-5.4.0-89-generic. 2021-10-20T23:05:38.621 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../1-linux-image-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:05:38.717 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:05:39.720 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-89-generic. 2021-10-20T23:05:39.737 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:05:39.767 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:05:44.912 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../3-linux-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:05:45.042 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:05:45.389 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:05:45.528 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:05:45.861 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.4.0-89. 2021-10-20T23:05:45.880 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../5-linux-headers-5.4.0-89_5.4.0-89.100_all.deb ... 2021-10-20T23:05:45.911 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:05:52.961 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.4.0-89-generic. 2021-10-20T23:05:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../6-linux-headers-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:05:53.029 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:05:55.865 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:05:55.991 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:05:56.384 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:05:57.588 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-10-20T23:05:58.724 INFO:teuthology.orchestra.run.smithi012.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:05:58.729 INFO:teuthology.orchestra.run.smithi012.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-89-generic 2021-10-20T23:05:58.890 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:05:59.008 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:05:59.126 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:06:00.335 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-generic (5.4.0.89.93) ... 2021-10-20T23:06:00.486 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-generic (5.4.0.89.93) ... 2021-10-20T23:06:01.429 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-generic (5.4.0.89.93) ... 2021-10-20T23:06:01.580 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:06:01.777 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-10-20T23:06:01.777 INFO:teuthology.orchestra.run.smithi012.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:06:24.425 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-10-20T23:06:24.426 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub' 2021-10-20T23:06:24.433 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:06:24.463 INFO:teuthology.orchestra.run.smithi012.stdout:Generating grub configuration file ... 2021-10-20T23:06:24.824 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:06:24.854 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:06:25.267 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:06:25.279 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:06:25.397 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:06:25.409 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:06:28.076 INFO:teuthology.orchestra.run.smithi012.stdout:done 2021-10-20T23:06:28.482 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2021-10-20T23:06:28.518 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2021-10-20T23:06:28.518 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2021-10-20T23:06:28.518 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2021-10-20T23:06:28.518 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2021-10-20T23:06:28.519 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 18 2021-10-20T23:06:28.519 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:06:28.519 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2021-10-20T23:06:28.519 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2021-10-20T23:06:28.520 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.4.0.89.93 2021-10-20T23:06:28.520 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:06:28.520 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:06:28.520 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2021-10-20T23:06:28.520 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2021-10-20T23:06:28.521 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:06:28.521 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2021-10-20T23:06:28.521 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-89-generic 2021-10-20T23:06:28.522 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2021-10-20T23:06:28.529 INFO:teuthology.orchestra.run.smithi031.stdout:5.4.0-88-generic 2021-10-20T23:06:28.529 INFO:teuthology.task.kernel:Running kernel on smithi031: 5.4.0-88-generic 2021-10-20T23:06:28.530 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get clean 2021-10-20T23:06:28.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2021-10-20T23:06:28.792 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-10-20T23:06:28.903 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:06:28.986 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-10-20T23:06:29.111 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [935 kB] 2021-10-20T23:06:29.215 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [296 kB] 2021-10-20T23:06:29.218 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [177 kB] 2021-10-20T23:06:29.220 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,840 B] 2021-10-20T23:06:29.220 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [475 kB] 2021-10-20T23:06:29.228 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [68.3 kB] 2021-10-20T23:06:29.228 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [512 kB] 2021-10-20T23:06:29.240 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [646 kB] 2021-10-20T23:06:29.249 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [106 kB] 2021-10-20T23:06:29.250 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.7 kB] 2021-10-20T23:06:29.325 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-10-20T23:06:29.455 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,294 kB] 2021-10-20T23:06:29.788 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [550 kB] 2021-10-20T23:06:29.818 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [269 kB] 2021-10-20T23:06:29.820 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.4 kB] 2021-10-20T23:06:29.821 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [522 kB] 2021-10-20T23:06:29.842 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.4 kB] 2021-10-20T23:06:29.843 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [74.8 kB] 2021-10-20T23:06:29.871 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-10-20T23:06:29.871 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [642 kB] 2021-10-20T23:06:29.896 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [867 kB] 2021-10-20T23:06:29.928 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [186 kB] 2021-10-20T23:06:29.931 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.3 kB] 2021-10-20T23:06:29.985 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-10-20T23:06:30.050 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-10-20T23:06:30.051 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-10-20T23:06:30.051 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-10-20T23:06:33.499 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 8,065 kB in 2s (5,349 kB/s) 2021-10-20T23:06:34.947 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2021-10-20T23:06:34.969 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:06:35.043 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2021-10-20T23:06:35.214 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2021-10-20T23:06:35.214 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2021-10-20T23:06:35.371 INFO:teuthology.orchestra.run.smithi031.stdout:The following package was automatically installed and is no longer required: 2021-10-20T23:06:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: libllvm11 2021-10-20T23:06:35.372 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove it. 2021-10-20T23:06:35.372 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2021-10-20T23:06:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: linux-generic linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:06:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-generic linux-image-5.4.0-89-generic 2021-10-20T23:06:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-5.4.0-89-generic linux-modules-extra-5.4.0-89-generic 2021-10-20T23:06:35.374 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2021-10-20T23:06:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-10-20T23:06:35.374 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2021-10-20T23:06:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: thermald 2021-10-20T23:06:35.414 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2021-10-20T23:06:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:06:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-89-generic linux-modules-5.4.0-89-generic 2021-10-20T23:06:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-extra-5.4.0-89-generic 2021-10-20T23:06:35.416 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2021-10-20T23:06:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: linux-generic linux-headers-generic linux-image-generic 2021-10-20T23:06:35.600 INFO:teuthology.orchestra.run.smithi031.stdout:3 upgraded, 5 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:06:35.600 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 75.6 MB of archives. 2021-10-20T23:06:35.600 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 378 MB of additional disk space will be used. 2021-10-20T23:06:35.601 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-89-generic amd64 5.4.0-89.100 [14.8 MB] 2021-10-20T23:06:36.770 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-89-generic amd64 5.4.0-89.100 [8,990 kB] 2021-10-20T23:06:36.978 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-89-generic amd64 5.4.0-89.100 [39.4 MB] 2021-10-20T23:06:38.290 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.89.93 [1,900 B] 2021-10-20T23:06:38.290 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.89.93 [2,576 B] 2021-10-20T23:06:38.293 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89 all 5.4.0-89.100 [11.0 MB] 2021-10-20T23:06:38.573 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89-generic amd64 5.4.0-89.100 [1,391 kB] 2021-10-20T23:06:38.625 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.89.93 [2,436 B] 2021-10-20T23:06:39.058 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 75.6 MB in 3s (23.6 MB/s) 2021-10-20T23:06:39.209 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-modules-5.4.0-89-generic. 2021-10-20T23:06:41.012 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-10-20T23:06:41.019 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../0-linux-modules-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:06:41.153 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:06:43.371 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-image-5.4.0-89-generic. 2021-10-20T23:06:43.389 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../1-linux-image-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:06:43.491 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:06:44.619 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-89-generic. 2021-10-20T23:06:44.637 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:06:44.680 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:06:49.882 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../3-linux-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:06:50.000 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:06:50.352 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:06:50.463 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:06:50.823 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-headers-5.4.0-89. 2021-10-20T23:06:50.840 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../5-linux-headers-5.4.0-89_5.4.0-89.100_all.deb ... 2021-10-20T23:06:50.881 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:06:57.119 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-headers-5.4.0-89-generic. 2021-10-20T23:06:57.145 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../6-linux-headers-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:06:57.185 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:06:59.798 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:06:59.940 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:07:00.300 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:07:01.544 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:07:02.676 INFO:teuthology.orchestra.run.smithi031.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:07:02.676 INFO:teuthology.orchestra.run.smithi031.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-10-20T23:07:02.676 INFO:teuthology.orchestra.run.smithi031.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:07:02.676 INFO:teuthology.orchestra.run.smithi031.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-89-generic 2021-10-20T23:07:02.805 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:07:02.973 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:07:03.784 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:07:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-generic (5.4.0.89.93) ... 2021-10-20T23:07:05.811 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-generic (5.4.0.89.93) ... 2021-10-20T23:07:05.911 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-generic (5.4.0.89.93) ... 2021-10-20T23:07:06.012 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:07:06.208 INFO:teuthology.orchestra.run.smithi031.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-10-20T23:07:06.209 INFO:teuthology.orchestra.run.smithi031.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:07:28.473 INFO:teuthology.orchestra.run.smithi031.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-10-20T23:07:28.474 INFO:teuthology.orchestra.run.smithi031.stdout:Sourcing file `/etc/default/grub' 2021-10-20T23:07:28.486 INFO:teuthology.orchestra.run.smithi031.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:07:28.525 INFO:teuthology.orchestra.run.smithi031.stdout:Generating grub configuration file ... 2021-10-20T23:07:28.919 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:07:28.951 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:07:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:07:29.369 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:07:29.483 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:07:29.495 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:07:31.906 INFO:teuthology.orchestra.run.smithi031.stdout:done 2021-10-20T23:07:32.293 DEBUG:teuthology.orchestra.run.smithi031:> dpkg -s linux-image-generic 2021-10-20T23:07:32.347 INFO:teuthology.orchestra.run.smithi031.stdout:Package: linux-image-generic 2021-10-20T23:07:32.348 INFO:teuthology.orchestra.run.smithi031.stdout:Status: install ok installed 2021-10-20T23:07:32.348 INFO:teuthology.orchestra.run.smithi031.stdout:Priority: optional 2021-10-20T23:07:32.348 INFO:teuthology.orchestra.run.smithi031.stdout:Section: kernel 2021-10-20T23:07:32.348 INFO:teuthology.orchestra.run.smithi031.stdout:Installed-Size: 18 2021-10-20T23:07:32.349 INFO:teuthology.orchestra.run.smithi031.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:07:32.349 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: amd64 2021-10-20T23:07:32.349 INFO:teuthology.orchestra.run.smithi031.stdout:Source: linux-meta 2021-10-20T23:07:32.350 INFO:teuthology.orchestra.run.smithi031.stdout:Version: 5.4.0.89.93 2021-10-20T23:07:32.350 INFO:teuthology.orchestra.run.smithi031.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:07:32.350 INFO:teuthology.orchestra.run.smithi031.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:07:32.350 INFO:teuthology.orchestra.run.smithi031.stdout:Recommends: thermald 2021-10-20T23:07:32.351 INFO:teuthology.orchestra.run.smithi031.stdout:Description: Generic Linux kernel image 2021-10-20T23:07:32.351 INFO:teuthology.orchestra.run.smithi031.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:07:32.351 INFO:teuthology.orchestra.run.smithi031.stdout: available. 2021-10-20T23:07:32.351 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-89-generic 2021-10-20T23:07:32.352 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2021-10-20T23:07:32.360 INFO:teuthology.orchestra.run.smithi119.stdout:5.4.0-88-generic 2021-10-20T23:07:32.360 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.4.0-88-generic 2021-10-20T23:07:32.360 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get clean 2021-10-20T23:07:32.422 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2021-10-20T23:07:32.595 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-10-20T23:07:32.695 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:07:32.785 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-10-20T23:07:32.871 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [296 kB] 2021-10-20T23:07:32.929 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [935 kB] 2021-10-20T23:07:32.964 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [177 kB] 2021-10-20T23:07:32.972 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,840 B] 2021-10-20T23:07:32.972 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [475 kB] 2021-10-20T23:07:32.973 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [68.3 kB] 2021-10-20T23:07:32.974 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [646 kB] 2021-10-20T23:07:32.983 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [512 kB] 2021-10-20T23:07:32.989 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [106 kB] 2021-10-20T23:07:32.989 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.7 kB] 2021-10-20T23:07:33.144 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-10-20T23:07:33.262 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [550 kB] 2021-10-20T23:07:33.500 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,294 kB] 2021-10-20T23:07:33.649 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [269 kB] 2021-10-20T23:07:33.665 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.4 kB] 2021-10-20T23:07:33.665 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.4 kB] 2021-10-20T23:07:33.666 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [522 kB] 2021-10-20T23:07:33.689 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [74.8 kB] 2021-10-20T23:07:33.694 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-10-20T23:07:33.694 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [867 kB] 2021-10-20T23:07:33.735 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [642 kB] 2021-10-20T23:07:33.761 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [186 kB] 2021-10-20T23:07:33.763 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.3 kB] 2021-10-20T23:07:33.815 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-10-20T23:07:33.818 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-10-20T23:07:33.819 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-10-20T23:07:33.820 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-10-20T23:07:37.198 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 8,065 kB in 2s (5,065 kB/s) 2021-10-20T23:07:38.442 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2021-10-20T23:07:38.465 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:07:38.535 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2021-10-20T23:07:38.695 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2021-10-20T23:07:38.696 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2021-10-20T23:07:38.823 INFO:teuthology.orchestra.run.smithi119.stdout:The following package was automatically installed and is no longer required: 2021-10-20T23:07:38.824 INFO:teuthology.orchestra.run.smithi119.stdout: libllvm11 2021-10-20T23:07:38.825 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove it. 2021-10-20T23:07:38.825 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2021-10-20T23:07:38.825 INFO:teuthology.orchestra.run.smithi119.stdout: linux-generic linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:07:38.825 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-generic linux-image-5.4.0-89-generic 2021-10-20T23:07:38.826 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-5.4.0-89-generic linux-modules-extra-5.4.0-89-generic 2021-10-20T23:07:38.826 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2021-10-20T23:07:38.826 INFO:teuthology.orchestra.run.smithi119.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-10-20T23:07:38.827 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2021-10-20T23:07:38.827 INFO:teuthology.orchestra.run.smithi119.stdout: thermald 2021-10-20T23:07:38.894 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2021-10-20T23:07:38.894 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:07:38.894 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-89-generic linux-modules-5.4.0-89-generic 2021-10-20T23:07:38.894 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-extra-5.4.0-89-generic 2021-10-20T23:07:38.895 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2021-10-20T23:07:38.895 INFO:teuthology.orchestra.run.smithi119.stdout: linux-generic linux-headers-generic linux-image-generic 2021-10-20T23:07:39.078 INFO:teuthology.orchestra.run.smithi119.stdout:3 upgraded, 5 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:07:39.078 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 75.6 MB of archives. 2021-10-20T23:07:39.079 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 378 MB of additional disk space will be used. 2021-10-20T23:07:39.079 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-89-generic amd64 5.4.0-89.100 [14.8 MB] 2021-10-20T23:07:40.238 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-89-generic amd64 5.4.0-89.100 [8,990 kB] 2021-10-20T23:07:40.483 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-89-generic amd64 5.4.0-89.100 [39.4 MB] 2021-10-20T23:07:42.206 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.89.93 [1,900 B] 2021-10-20T23:07:42.207 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.89.93 [2,576 B] 2021-10-20T23:07:42.207 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89 all 5.4.0-89.100 [11.0 MB] 2021-10-20T23:07:42.685 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89-generic amd64 5.4.0-89.100 [1,391 kB] 2021-10-20T23:07:42.738 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.89.93 [2,436 B] 2021-10-20T23:07:43.207 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 75.6 MB in 4s (19.7 MB/s) 2021-10-20T23:07:43.425 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-modules-5.4.0-89-generic. 2021-10-20T23:07:45.241 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-10-20T23:07:45.248 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../0-linux-modules-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:07:45.431 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:07:47.512 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-image-5.4.0-89-generic. 2021-10-20T23:07:47.529 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../1-linux-image-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:07:47.634 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:07:48.626 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-89-generic. 2021-10-20T23:07:48.642 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:07:48.718 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:07:54.001 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../3-linux-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:07:54.155 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:07:54.503 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:07:54.637 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:07:55.007 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-headers-5.4.0-89. 2021-10-20T23:07:55.028 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../5-linux-headers-5.4.0-89_5.4.0-89.100_all.deb ... 2021-10-20T23:07:55.067 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:08:01.448 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-headers-5.4.0-89-generic. 2021-10-20T23:08:01.474 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../6-linux-headers-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:08:01.515 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:08:04.230 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:08:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:08:04.756 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:08:05.975 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:08:07.109 INFO:teuthology.orchestra.run.smithi119.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:08:07.109 INFO:teuthology.orchestra.run.smithi119.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-10-20T23:08:07.109 INFO:teuthology.orchestra.run.smithi119.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:08:07.110 INFO:teuthology.orchestra.run.smithi119.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-89-generic 2021-10-20T23:08:08.348 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:08:09.288 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:08:09.388 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:08:10.573 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-generic (5.4.0.89.93) ... 2021-10-20T23:08:10.699 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-generic (5.4.0.89.93) ... 2021-10-20T23:08:10.859 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-generic (5.4.0.89.93) ... 2021-10-20T23:08:10.994 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:08:11.225 INFO:teuthology.orchestra.run.smithi119.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-10-20T23:08:11.226 INFO:teuthology.orchestra.run.smithi119.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:08:33.179 INFO:teuthology.orchestra.run.smithi119.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-10-20T23:08:33.179 INFO:teuthology.orchestra.run.smithi119.stdout:Sourcing file `/etc/default/grub' 2021-10-20T23:08:33.195 INFO:teuthology.orchestra.run.smithi119.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:08:33.218 INFO:teuthology.orchestra.run.smithi119.stdout:Generating grub configuration file ... 2021-10-20T23:08:33.633 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:08:33.676 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:08:34.193 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:08:34.205 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:08:34.328 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:08:34.339 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:08:36.843 INFO:teuthology.orchestra.run.smithi119.stdout:done 2021-10-20T23:08:37.272 DEBUG:teuthology.orchestra.run.smithi119:> dpkg -s linux-image-generic 2021-10-20T23:08:37.308 INFO:teuthology.orchestra.run.smithi119.stdout:Package: linux-image-generic 2021-10-20T23:08:37.308 INFO:teuthology.orchestra.run.smithi119.stdout:Status: install ok installed 2021-10-20T23:08:37.309 INFO:teuthology.orchestra.run.smithi119.stdout:Priority: optional 2021-10-20T23:08:37.309 INFO:teuthology.orchestra.run.smithi119.stdout:Section: kernel 2021-10-20T23:08:37.309 INFO:teuthology.orchestra.run.smithi119.stdout:Installed-Size: 18 2021-10-20T23:08:37.310 INFO:teuthology.orchestra.run.smithi119.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:08:37.310 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: amd64 2021-10-20T23:08:37.310 INFO:teuthology.orchestra.run.smithi119.stdout:Source: linux-meta 2021-10-20T23:08:37.310 INFO:teuthology.orchestra.run.smithi119.stdout:Version: 5.4.0.89.93 2021-10-20T23:08:37.311 INFO:teuthology.orchestra.run.smithi119.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:08:37.311 INFO:teuthology.orchestra.run.smithi119.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:08:37.311 INFO:teuthology.orchestra.run.smithi119.stdout:Recommends: thermald 2021-10-20T23:08:37.311 INFO:teuthology.orchestra.run.smithi119.stdout:Description: Generic Linux kernel image 2021-10-20T23:08:37.311 INFO:teuthology.orchestra.run.smithi119.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:08:37.312 INFO:teuthology.orchestra.run.smithi119.stdout: available. 2021-10-20T23:08:37.312 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-89-generic 2021-10-20T23:08:37.313 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2021-10-20T23:08:37.320 INFO:teuthology.orchestra.run.smithi136.stdout:5.4.0-88-generic 2021-10-20T23:08:37.321 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.4.0-88-generic 2021-10-20T23:08:37.321 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2021-10-20T23:08:37.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2021-10-20T23:08:37.591 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-10-20T23:08:37.711 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:08:37.795 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-10-20T23:08:37.896 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [296 kB] 2021-10-20T23:08:37.969 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [935 kB] 2021-10-20T23:08:38.016 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [177 kB] 2021-10-20T23:08:38.016 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,840 B] 2021-10-20T23:08:38.016 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [475 kB] 2021-10-20T23:08:38.020 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [68.3 kB] 2021-10-20T23:08:38.021 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [646 kB] 2021-10-20T23:08:38.035 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [512 kB] 2021-10-20T23:08:38.044 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [106 kB] 2021-10-20T23:08:38.045 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.7 kB] 2021-10-20T23:08:38.138 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-10-20T23:08:38.271 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [550 kB] 2021-10-20T23:08:38.521 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,294 kB] 2021-10-20T23:08:38.656 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [269 kB] 2021-10-20T23:08:38.672 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.4 kB] 2021-10-20T23:08:38.672 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [522 kB] 2021-10-20T23:08:38.700 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.4 kB] 2021-10-20T23:08:38.700 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [74.8 kB] 2021-10-20T23:08:38.703 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-10-20T23:08:38.703 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [867 kB] 2021-10-20T23:08:38.739 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [642 kB] 2021-10-20T23:08:38.758 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [186 kB] 2021-10-20T23:08:38.763 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.3 kB] 2021-10-20T23:08:38.823 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-10-20T23:08:38.823 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-10-20T23:08:38.825 INFO:teuthology.orchestra.run.smithi136.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-10-20T23:08:38.825 INFO:teuthology.orchestra.run.smithi136.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-10-20T23:08:42.169 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 8,065 kB in 2s (5,088 kB/s) 2021-10-20T23:08:43.364 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-10-20T23:08:43.424 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:08:43.496 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-10-20T23:08:43.665 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-10-20T23:08:43.665 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-10-20T23:08:43.804 INFO:teuthology.orchestra.run.smithi136.stdout:The following package was automatically installed and is no longer required: 2021-10-20T23:08:43.805 INFO:teuthology.orchestra.run.smithi136.stdout: libllvm11 2021-10-20T23:08:43.805 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove it. 2021-10-20T23:08:43.805 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2021-10-20T23:08:43.805 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:08:43.806 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-generic linux-image-5.4.0-89-generic 2021-10-20T23:08:43.806 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-5.4.0-89-generic linux-modules-extra-5.4.0-89-generic 2021-10-20T23:08:43.806 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2021-10-20T23:08:43.807 INFO:teuthology.orchestra.run.smithi136.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-10-20T23:08:43.807 INFO:teuthology.orchestra.run.smithi136.stdout:Recommended packages: 2021-10-20T23:08:43.807 INFO:teuthology.orchestra.run.smithi136.stdout: thermald 2021-10-20T23:08:43.842 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2021-10-20T23:08:43.843 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:08:43.843 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-89-generic linux-modules-5.4.0-89-generic 2021-10-20T23:08:43.843 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-extra-5.4.0-89-generic 2021-10-20T23:08:43.844 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages will be upgraded: 2021-10-20T23:08:43.844 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-generic linux-image-generic 2021-10-20T23:08:44.024 INFO:teuthology.orchestra.run.smithi136.stdout:3 upgraded, 5 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:08:44.025 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 75.6 MB of archives. 2021-10-20T23:08:44.025 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 378 MB of additional disk space will be used. 2021-10-20T23:08:44.025 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-89-generic amd64 5.4.0-89.100 [14.8 MB] 2021-10-20T23:08:45.138 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-89-generic amd64 5.4.0-89.100 [8,990 kB] 2021-10-20T23:08:45.356 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-89-generic amd64 5.4.0-89.100 [39.4 MB] 2021-10-20T23:08:46.729 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.89.93 [1,900 B] 2021-10-20T23:08:46.729 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.89.93 [2,576 B] 2021-10-20T23:08:46.730 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89 all 5.4.0-89.100 [11.0 MB] 2021-10-20T23:08:47.002 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89-generic amd64 5.4.0-89.100 [1,391 kB] 2021-10-20T23:08:47.030 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.89.93 [2,436 B] 2021-10-20T23:08:47.492 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 75.6 MB in 3s (23.8 MB/s) 2021-10-20T23:08:47.683 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-5.4.0-89-generic. 2021-10-20T23:08:49.502 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-10-20T23:08:49.508 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../0-linux-modules-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:08:49.669 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:08:51.738 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-image-5.4.0-89-generic. 2021-10-20T23:08:51.754 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../1-linux-image-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:08:51.846 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:08:52.875 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-89-generic. 2021-10-20T23:08:52.893 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:08:52.934 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:08:58.034 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../3-linux-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:08:58.325 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:08:58.814 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:08:58.976 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:08:59.275 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-5.4.0-89. 2021-10-20T23:08:59.296 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../5-linux-headers-5.4.0-89_5.4.0-89.100_all.deb ... 2021-10-20T23:08:59.361 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:09:05.764 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-5.4.0-89-generic. 2021-10-20T23:09:05.789 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../6-linux-headers-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:09:05.831 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:09:08.456 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:09:08.575 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:09:09.298 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:09:10.498 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:09:11.614 INFO:teuthology.orchestra.run.smithi136.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:09:11.618 INFO:teuthology.orchestra.run.smithi136.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-10-20T23:09:11.618 INFO:teuthology.orchestra.run.smithi136.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:09:11.618 INFO:teuthology.orchestra.run.smithi136.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-89-generic 2021-10-20T23:09:11.783 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:09:11.910 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:09:12.038 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:09:13.281 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-generic (5.4.0.89.93) ... 2021-10-20T23:09:13.407 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-generic (5.4.0.89.93) ... 2021-10-20T23:09:13.533 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-generic (5.4.0.89.93) ... 2021-10-20T23:09:13.693 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:09:13.894 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-10-20T23:09:13.894 INFO:teuthology.orchestra.run.smithi136.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:09:36.062 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-10-20T23:09:36.062 INFO:teuthology.orchestra.run.smithi136.stdout:Sourcing file `/etc/default/grub' 2021-10-20T23:09:36.085 INFO:teuthology.orchestra.run.smithi136.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:09:36.110 INFO:teuthology.orchestra.run.smithi136.stdout:Generating grub configuration file ... 2021-10-20T23:09:36.451 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:09:36.494 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:09:36.853 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:09:36.865 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:09:36.984 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:09:36.996 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:09:39.696 INFO:teuthology.orchestra.run.smithi136.stdout:done 2021-10-20T23:09:40.174 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2021-10-20T23:09:40.200 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2021-10-20T23:09:40.200 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2021-10-20T23:09:40.200 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2021-10-20T23:09:40.201 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2021-10-20T23:09:40.201 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 18 2021-10-20T23:09:40.201 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:09:40.201 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2021-10-20T23:09:40.202 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2021-10-20T23:09:40.202 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 5.4.0.89.93 2021-10-20T23:09:40.202 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:09:40.202 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:09:40.203 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2021-10-20T23:09:40.203 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2021-10-20T23:09:40.203 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:09:40.204 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2021-10-20T23:09:40.204 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-89-generic 2021-10-20T23:09:40.204 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-10-20T23:09:40.205 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-20T23:09:40.205 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-20T23:09:40.205 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-20T23:09:40.205 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-20T23:09:40.206 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-10-20T23:09:40.206 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2021-10-20T23:09:40.206 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2021-10-20T23:09:40.357 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2021-10-20T23:09:40.496 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:09:40.608 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:09:40.690 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:09:40.774 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:09:42.032 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2021-10-20T23:09:42.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:09:42.125 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2021-10-20T23:09:42.279 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2021-10-20T23:09:42.280 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2021-10-20T23:09:42.413 INFO:teuthology.orchestra.run.smithi012.stdout:linux-image-generic is already the newest version (5.4.0.89.93). 2021-10-20T23:09:42.414 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:09:42.414 INFO:teuthology.orchestra.run.smithi012.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:09:42.414 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:09:42.414 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:09:42.415 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:09:42.450 INFO:teuthology.orchestra.run.smithi012.stdout:0 upgraded, 0 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:09:42.451 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2021-10-20T23:09:42.472 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2021-10-20T23:09:42.472 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2021-10-20T23:09:42.473 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2021-10-20T23:09:42.473 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2021-10-20T23:09:42.473 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 18 2021-10-20T23:09:42.473 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:09:42.473 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2021-10-20T23:09:42.474 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2021-10-20T23:09:42.474 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.4.0.89.93 2021-10-20T23:09:42.474 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:09:42.474 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:09:42.475 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2021-10-20T23:09:42.475 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2021-10-20T23:09:42.475 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:09:42.476 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2021-10-20T23:09:42.476 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:09:42.483 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.IeVO9nQHx1 2021-10-20T23:09:42.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub/grub.cfg /tmp/tmp.IeVO9nQHx1 2021-10-20T23:09:42.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.IeVO9nQHx1 2021-10-20T23:09:42.530 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.IeVO9nQHx1 is 10KB 2021-10-20T23:09:42.545 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.IeVO9nQHx1 2021-10-20T23:09:42.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-10-20T23:09:42.613 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:09:42.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-10-20T23:09:42.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-10-20T23:09:42.655 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-89-generic 2021-10-20T23:09:42.656 DEBUG:teuthology.orchestra.run.smithi012:> sudo update-grub 2021-10-20T23:09:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub' 2021-10-20T23:09:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:09:43.925 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2021-10-20T23:09:44.164 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:09:44.175 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:09:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:09:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:09:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:09:44.681 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:09:46.329 INFO:teuthology.orchestra.run.smithi012.stderr:done 2021-10-20T23:09:46.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2021-10-20T23:09:46.333 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-10-20T23:09:46.333 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2021-10-20T23:09:46.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get clean 2021-10-20T23:09:46.470 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2021-10-20T23:09:46.617 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:09:46.729 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:09:46.813 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:09:46.896 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:09:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2021-10-20T23:09:48.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:09:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2021-10-20T23:09:48.401 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2021-10-20T23:09:48.402 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2021-10-20T23:09:48.535 INFO:teuthology.orchestra.run.smithi031.stdout:linux-image-generic is already the newest version (5.4.0.89.93). 2021-10-20T23:09:48.535 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:09:48.535 INFO:teuthology.orchestra.run.smithi031.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:09:48.536 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:09:48.536 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:09:48.536 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:09:48.574 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 0 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:09:48.576 DEBUG:teuthology.orchestra.run.smithi031:> dpkg -s linux-image-generic 2021-10-20T23:09:48.599 INFO:teuthology.orchestra.run.smithi031.stdout:Package: linux-image-generic 2021-10-20T23:09:48.599 INFO:teuthology.orchestra.run.smithi031.stdout:Status: install ok installed 2021-10-20T23:09:48.599 INFO:teuthology.orchestra.run.smithi031.stdout:Priority: optional 2021-10-20T23:09:48.599 INFO:teuthology.orchestra.run.smithi031.stdout:Section: kernel 2021-10-20T23:09:48.600 INFO:teuthology.orchestra.run.smithi031.stdout:Installed-Size: 18 2021-10-20T23:09:48.600 INFO:teuthology.orchestra.run.smithi031.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:09:48.600 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: amd64 2021-10-20T23:09:48.600 INFO:teuthology.orchestra.run.smithi031.stdout:Source: linux-meta 2021-10-20T23:09:48.601 INFO:teuthology.orchestra.run.smithi031.stdout:Version: 5.4.0.89.93 2021-10-20T23:09:48.601 INFO:teuthology.orchestra.run.smithi031.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:09:48.601 INFO:teuthology.orchestra.run.smithi031.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:09:48.601 INFO:teuthology.orchestra.run.smithi031.stdout:Recommends: thermald 2021-10-20T23:09:48.601 INFO:teuthology.orchestra.run.smithi031.stdout:Description: Generic Linux kernel image 2021-10-20T23:09:48.602 INFO:teuthology.orchestra.run.smithi031.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:09:48.602 INFO:teuthology.orchestra.run.smithi031.stdout: available. 2021-10-20T23:09:48.602 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:09:48.608 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.vURtx6hlkg 2021-10-20T23:09:48.609 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vURtx6hlkg 2021-10-20T23:09:48.668 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.vURtx6hlkg 2021-10-20T23:09:48.761 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.vURtx6hlkg is 10KB 2021-10-20T23:09:48.777 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.vURtx6hlkg 2021-10-20T23:09:48.784 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-10-20T23:09:48.843 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:09:48.843 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-10-20T23:09:48.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-10-20T23:09:48.888 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-89-generic 2021-10-20T23:09:48.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo update-grub 2021-10-20T23:09:50.092 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2021-10-20T23:09:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:09:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2021-10-20T23:09:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:09:50.426 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:09:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:09:50.787 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:09:50.881 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:09:50.893 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:09:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:done 2021-10-20T23:09:52.374 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2021-10-20T23:09:52.380 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-10-20T23:09:52.381 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2021-10-20T23:09:52.381 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get clean 2021-10-20T23:09:52.507 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2021-10-20T23:09:52.638 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:09:52.757 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:09:52.839 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:09:52.924 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:09:54.131 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2021-10-20T23:09:54.153 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:09:54.217 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2021-10-20T23:09:54.373 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2021-10-20T23:09:54.375 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2021-10-20T23:09:54.498 INFO:teuthology.orchestra.run.smithi119.stdout:linux-image-generic is already the newest version (5.4.0.89.93). 2021-10-20T23:09:54.498 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:09:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:09:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:09:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:09:54.499 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:09:54.534 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 0 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:09:54.536 DEBUG:teuthology.orchestra.run.smithi119:> dpkg -s linux-image-generic 2021-10-20T23:09:54.557 INFO:teuthology.orchestra.run.smithi119.stdout:Package: linux-image-generic 2021-10-20T23:09:54.557 INFO:teuthology.orchestra.run.smithi119.stdout:Status: install ok installed 2021-10-20T23:09:54.557 INFO:teuthology.orchestra.run.smithi119.stdout:Priority: optional 2021-10-20T23:09:54.558 INFO:teuthology.orchestra.run.smithi119.stdout:Section: kernel 2021-10-20T23:09:54.558 INFO:teuthology.orchestra.run.smithi119.stdout:Installed-Size: 18 2021-10-20T23:09:54.558 INFO:teuthology.orchestra.run.smithi119.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:09:54.558 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: amd64 2021-10-20T23:09:54.559 INFO:teuthology.orchestra.run.smithi119.stdout:Source: linux-meta 2021-10-20T23:09:54.559 INFO:teuthology.orchestra.run.smithi119.stdout:Version: 5.4.0.89.93 2021-10-20T23:09:54.559 INFO:teuthology.orchestra.run.smithi119.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:09:54.559 INFO:teuthology.orchestra.run.smithi119.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:09:54.560 INFO:teuthology.orchestra.run.smithi119.stdout:Recommends: thermald 2021-10-20T23:09:54.560 INFO:teuthology.orchestra.run.smithi119.stdout:Description: Generic Linux kernel image 2021-10-20T23:09:54.560 INFO:teuthology.orchestra.run.smithi119.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:09:54.561 INFO:teuthology.orchestra.run.smithi119.stdout: available. 2021-10-20T23:09:54.561 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2021-10-20T23:09:54.567 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.DMTVujanFE 2021-10-20T23:09:54.569 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub/grub.cfg /tmp/tmp.DMTVujanFE 2021-10-20T23:09:54.581 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.DMTVujanFE 2021-10-20T23:09:54.659 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.DMTVujanFE is 10KB 2021-10-20T23:09:54.674 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.DMTVujanFE 2021-10-20T23:09:54.681 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-10-20T23:09:54.735 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2021-10-20T23:09:54.735 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-10-20T23:09:54.736 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-10-20T23:09:54.787 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-89-generic 2021-10-20T23:09:54.787 DEBUG:teuthology.orchestra.run.smithi119:> sudo update-grub 2021-10-20T23:09:56.080 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2021-10-20T23:09:56.082 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:09:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2021-10-20T23:09:56.400 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:09:56.412 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:09:56.829 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:09:56.841 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:09:56.937 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:09:56.949 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:09:58.411 INFO:teuthology.orchestra.run.smithi119.stderr:done 2021-10-20T23:09:58.412 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2021-10-20T23:09:58.415 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2021-10-20T23:09:58.415 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2021-10-20T23:09:58.415 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2021-10-20T23:09:58.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2021-10-20T23:09:58.682 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:09:58.832 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:09:58.925 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:09:59.036 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:10:00.201 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-10-20T23:10:00.224 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:10:00.291 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-10-20T23:10:00.438 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-10-20T23:10:00.439 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-10-20T23:10:00.563 INFO:teuthology.orchestra.run.smithi136.stdout:linux-image-generic is already the newest version (5.4.0.89.93). 2021-10-20T23:10:00.564 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:10:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:10:00.565 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:10:00.565 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:10:00.566 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:10:00.600 INFO:teuthology.orchestra.run.smithi136.stdout:0 upgraded, 0 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:10:00.603 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2021-10-20T23:10:00.626 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2021-10-20T23:10:00.626 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2021-10-20T23:10:00.626 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2021-10-20T23:10:00.627 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2021-10-20T23:10:00.627 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 18 2021-10-20T23:10:00.627 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:10:00.627 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2021-10-20T23:10:00.628 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2021-10-20T23:10:00.628 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 5.4.0.89.93 2021-10-20T23:10:00.628 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:10:00.628 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:10:00.629 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2021-10-20T23:10:00.629 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2021-10-20T23:10:00.629 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:10:00.629 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2021-10-20T23:10:00.630 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2021-10-20T23:10:00.676 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.K63zdOql5U 2021-10-20T23:10:00.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub/grub.cfg /tmp/tmp.K63zdOql5U 2021-10-20T23:10:00.697 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.K63zdOql5U 2021-10-20T23:10:00.782 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.K63zdOql5U is 10KB 2021-10-20T23:10:00.797 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.K63zdOql5U 2021-10-20T23:10:00.805 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-10-20T23:10:00.862 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-10-20T23:10:00.862 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-10-20T23:10:00.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-10-20T23:10:00.928 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-89-generic 2021-10-20T23:10:00.928 DEBUG:teuthology.orchestra.run.smithi136:> sudo update-grub 2021-10-20T23:10:02.337 INFO:teuthology.orchestra.run.smithi136.stderr:Sourcing file `/etc/default/grub' 2021-10-20T23:10:02.338 INFO:teuthology.orchestra.run.smithi136.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:10:02.345 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2021-10-20T23:10:02.644 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:10:02.656 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:10:03.067 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:10:03.079 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:10:03.174 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:10:03.186 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:10:04.856 INFO:teuthology.orchestra.run.smithi136.stderr:done 2021-10-20T23:10:04.857 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2021-10-20T23:10:34.886 INFO:teuthology.misc:Re-opening connections... 2021-10-20T23:10:34.887 INFO:teuthology.misc:trying to connect to ubuntu@smithi012.front.sepia.ceph.com 2021-10-20T23:10:34.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2021-10-20T23:10:34.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:11:34.951 DEBUG:teuthology.orchestra.remote:timed out 2021-10-20T23:11:34.953 INFO:teuthology.misc:trying to connect to ubuntu@smithi031.front.sepia.ceph.com 2021-10-20T23:11:34.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2021-10-20T23:11:34.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:11:35.251 DEBUG:teuthology.orchestra.run.smithi031:> true 2021-10-20T23:11:35.836 INFO:teuthology.misc:trying to connect to ubuntu@smithi136.front.sepia.ceph.com 2021-10-20T23:11:35.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2021-10-20T23:11:35.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:12:37.874 DEBUG:teuthology.orchestra.remote:timed out 2021-10-20T23:12:37.875 DEBUG:teuthology.misc:waited 122.98821353912354 2021-10-20T23:12:38.877 INFO:teuthology.misc:trying to connect to ubuntu@smithi012.front.sepia.ceph.com 2021-10-20T23:12:38.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2021-10-20T23:12:38.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:12:39.194 DEBUG:teuthology.orchestra.run.smithi012:> true 2021-10-20T23:12:39.754 INFO:teuthology.misc:trying to connect to ubuntu@smithi136.front.sepia.ceph.com 2021-10-20T23:12:39.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2021-10-20T23:12:39.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:12:40.073 DEBUG:teuthology.orchestra.run.smithi136:> true 2021-10-20T23:12:40.651 DEBUG:teuthology.misc:waited 125.76368641853333 2021-10-20T23:12:41.652 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-20T23:12:41.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-20T23:12:41.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:12:41.838 DEBUG:teuthology.orchestra.run.smithi119:> true 2021-10-20T23:12:42.415 DEBUG:teuthology.misc:waited 127.52766299247742 2021-10-20T23:12:43.417 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-10-20T23:12:43.417 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-89-generic"... 2021-10-20T23:12:43.418 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2021-10-20T23:12:43.427 INFO:teuthology.orchestra.run.smithi012.stdout:5.4.0-89-generic 2021-10-20T23:12:43.427 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-89-generic vs 5.4.0-89-generic 2021-10-20T23:12:43.428 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-20T23:12:43.428 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-10-20T23:12:43.428 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-10-20T23:12:43.428 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-89-generic"... 2021-10-20T23:12:43.429 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2021-10-20T23:12:43.439 INFO:teuthology.orchestra.run.smithi031.stdout:5.4.0-89-generic 2021-10-20T23:12:43.440 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-89-generic vs 5.4.0-89-generic 2021-10-20T23:12:43.440 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-20T23:12:43.440 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-10-20T23:12:43.440 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-10-20T23:12:43.441 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-89-generic"... 2021-10-20T23:12:43.441 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2021-10-20T23:12:43.449 INFO:teuthology.orchestra.run.smithi119.stdout:5.4.0-89-generic 2021-10-20T23:12:43.450 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-89-generic vs 5.4.0-89-generic 2021-10-20T23:12:43.450 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-20T23:12:43.450 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-10-20T23:12:43.451 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2021-10-20T23:12:43.451 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-89-generic"... 2021-10-20T23:12:43.451 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2021-10-20T23:12:43.459 INFO:teuthology.orchestra.run.smithi136.stdout:5.4.0-89-generic 2021-10-20T23:12:43.459 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-89-generic vs 5.4.0-89-generic 2021-10-20T23:12:43.459 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-20T23:12:43.460 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-10-20T23:12:44.461 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-10-20T23:12:44.461 DEBUG:teuthology.orchestra.run.smithi012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-20T23:12:44.559 INFO:teuthology.orchestra.run.smithi012.stdout:ttyS1 2021-10-20T23:12:44.589 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-10-20T23:12:44.589 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-20T23:12:44.662 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2021-10-20T23:12:44.688 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-10-20T23:12:44.689 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-20T23:12:44.762 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2021-10-20T23:12:44.794 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-10-20T23:12:44.795 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-20T23:12:44.868 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2021-10-20T23:12:44.891 INFO:teuthology.run_tasks:Running task internal.base... 2021-10-20T23:12:44.900 INFO:teuthology.task.internal:Creating test directory... 2021-10-20T23:12:44.901 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-20T23:12:44.904 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-20T23:12:44.906 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-20T23:12:44.909 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-20T23:12:44.916 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-10-20T23:12:44.942 INFO:teuthology.run_tasks:Running task internal.archive... 2021-10-20T23:12:44.975 INFO:teuthology.task.internal:Creating archive directory... 2021-10-20T23:12:44.975 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-20T23:12:44.978 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-20T23:12:44.980 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-20T23:12:44.983 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-20T23:12:45.012 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-10-20T23:12:45.027 INFO:teuthology.task.internal:Enabling coredump saving... 2021-10-20T23:12:45.028 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-20T23:12:45.041 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-20T23:12:45.044 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-20T23:12:45.046 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-20T23:12:45.063 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:12:45.063 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:12:45.065 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:12:45.073 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:12:45.074 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:12:45.077 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:12:45.090 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:12:45.101 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:12:45.103 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-10-20T23:12:45.115 INFO:teuthology.task.internal:Configuring sudo... 2021-10-20T23:12:45.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-20T23:12:45.118 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-20T23:12:45.121 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-20T23:12:45.124 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-20T23:12:45.155 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-10-20T23:12:45.165 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-10-20T23:12:45.165 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-20T23:12:45.200 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-20T23:12:45.203 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-20T23:12:45.205 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-20T23:12:45.213 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-20T23:12:45.220 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-20T23:12:45.228 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:12:45.228 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-20T23:12:45.256 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-20T23:12:45.264 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-20T23:12:45.271 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:12:45.271 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-20T23:12:45.340 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-20T23:12:45.349 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-20T23:12:45.399 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2021-10-20T23:12:45.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-20T23:12:45.447 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-20T23:12:45.461 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-20T23:12:45.468 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-10-20T23:12:45.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-20T23:12:45.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2021-10-20T23:12:45.544 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2021-10-20T23:12:45.547 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2021-10-20T23:12:45.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2021-10-20T23:12:45.602 INFO:teuthology.run_tasks:Running task internal.timer... 2021-10-20T23:12:45.613 INFO:teuthology.task.internal:Starting timer... 2021-10-20T23:12:45.613 INFO:teuthology.run_tasks:Running task pcp... 2021-10-20T23:12:45.671 INFO:teuthology.run_tasks:Running task selinux... 2021-10-20T23:12:45.703 DEBUG:teuthology.task.selinux:Excluding smithi012: OS 'ubuntu' does not support SELinux 2021-10-20T23:12:45.703 DEBUG:teuthology.task.selinux:Excluding smithi031: OS 'ubuntu' does not support SELinux 2021-10-20T23:12:45.704 DEBUG:teuthology.task.selinux:Excluding smithi119: OS 'ubuntu' does not support SELinux 2021-10-20T23:12:45.705 DEBUG:teuthology.task.selinux:Excluding smithi136: OS 'ubuntu' does not support SELinux 2021-10-20T23:12:45.705 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-10-20T23:12:45.706 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-10-20T23:12:45.706 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-10-20T23:12:45.706 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-10-20T23:12:45.736 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-10-20T23:12:45.742 INFO:teuthology.repo_utils:Fetching master from origin 2021-10-20T23:12:45.777 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-10-20T23:12:45.797 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-10-20T23:12:45.799 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi031.front.sepia.ceph.com,smithi119.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-10-20T23:12:46.169 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-10-20T23:12:47.012 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-10-20T23:12:49.942 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-10-20T23:12:50.048 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:50 +0000 (0:00:00.122) 0:00:00.122 ***** 2021-10-20T23:12:50.059 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:50 +0000 (0:00:00.010) 0:00:00.133 ***** 2021-10-20T23:12:50.072 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:50 +0000 (0:00:00.011) 0:00:00.144 ***** 2021-10-20T23:12:50.081 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:50 +0000 (0:00:00.011) 0:00:00.155 ***** 2021-10-20T23:12:52.229 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-20T23:12:52.230 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi119.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi119.front.sepia.ceph.com] 2021-10-20T23:12:52.282 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:52 +0000 (0:00:02.201) 0:00:02.357 ***** 2021-10-20T23:12:52.295 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi136.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi136.front.sepia.ceph.com] 2021-10-20T23:12:52.307 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi012.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi012.front.sepia.ceph.com] 2021-10-20T23:12:52.356 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi031.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi031.front.sepia.ceph.com] 2021-10-20T23:12:52.386 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:52 +0000 (0:00:00.102) 0:00:02.459 ***** 2021-10-20T23:12:52.418 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:52 +0000 (0:00:00.032) 0:00:02.492 ***** 2021-10-20T23:12:52.448 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:52 +0000 (0:00:00.029) 0:00:02.521 ***** 2021-10-20T23:12:52.506 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:12:52.530 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:52 +0000 (0:00:00.082) 0:00:02.604 ***** 2021-10-20T23:12:52.539 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:12:52.565 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:52 +0000 (0:00:00.034) 0:00:02.639 ***** 2021-10-20T23:12:52.572 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:12:52.613 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:52 +0000 (0:00:00.037) 0:00:02.676 ***** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:12:52.647 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:52 +0000 (0:00:00.045) 0:00:02.722 ***** 2021-10-20T23:12:53.038 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi119.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-20T23:12:53.063 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.415) 0:00:03.137 ***** 2021-10-20T23:12:53.071 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-20T23:12:53.072 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-20T23:12:53.074 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-20T23:12:53.105 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.041) 0:00:03.179 ***** 2021-10-20T23:12:53.129 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.024) 0:00:03.203 ***** 2021-10-20T23:12:53.156 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.027) 0:00:03.230 ***** 2021-10-20T23:12:53.164 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-10-20T23:12:53.166 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:53.193 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.036) 0:00:03.267 ***** 2021-10-20T23:12:53.204 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:53.228 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.034) 0:00:03.302 ***** 2021-10-20T23:12:53.249 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.021) 0:00:03.323 ***** 2021-10-20T23:12:53.257 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:53.282 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.032) 0:00:03.356 ***** 2021-10-20T23:12:53.412 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-10-20T23:12:53.414 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:12:53.415 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:12:53.416 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:12:53.439 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.157) 0:00:03.514 ***** 2021-10-20T23:12:53.461 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.021) 0:00:03.535 ***** 2021-10-20T23:12:53.482 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.020) 0:00:03.556 ***** 2021-10-20T23:12:53.503 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:53 +0000 (0:00:00.020) 0:00:03.577 ***** 2021-10-20T23:12:54.039 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-10-20T23:12:54.041 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-10-20T23:12:54.042 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-10-20T23:12:54.064 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:54 +0000 (0:00:00.561) 0:00:04.138 ***** 2021-10-20T23:12:54.086 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:54 +0000 (0:00:00.021) 0:00:04.160 ***** 2021-10-20T23:12:54.106 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:54 +0000 (0:00:00.020) 0:00:04.180 ***** 2021-10-20T23:12:54.114 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-10-20T23:12:54.140 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:54 +0000 (0:00:00.033) 0:00:04.214 ***** 2021-10-20T23:12:54.522 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-10-20T23:12:54.525 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-10-20T23:12:54.526 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-10-20T23:12:54.548 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-10-20T23:12:54.550 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-10-20T23:12:54.582 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-10-20T23:12:54.584 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-10-20T23:12:54.586 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-10-20T23:12:54.588 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-10-20T23:12:54.686 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-10-20T23:12:54.688 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-20T23:12:54.704 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Wednesday 20 October 2021 23:12:54 +0000 (0:00:00.564) 0:00:04.779 ***** 2021-10-20T23:12:55.405 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] 2021-10-20T23:12:55.444 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] 2021-10-20T23:12:55.468 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] 2021-10-20T23:12:55.481 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] 2021-10-20T23:12:55.507 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Wednesday 20 October 2021 23:12:55 +0000 (0:00:00.801) 0:00:05.580 ***** 2021-10-20T23:12:55.538 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-20T23:12:55.562 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-20T23:12:55.586 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-20T23:12:55.596 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-20T23:12:55.602 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-20T23:12:55.758 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:55 +0000 (0:00:00.252) 0:00:05.833 ***** 2021-10-20T23:12:55.780 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:55 +0000 (0:00:00.021) 0:00:05.854 ***** 2021-10-20T23:12:55.801 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:55 +0000 (0:00:00.020) 0:00:05.875 ***** 2021-10-20T23:12:55.830 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:55 +0000 (0:00:00.028) 0:00:05.904 ***** 2021-10-20T23:12:56.649 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-20T23:12:56.652 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] 2021-10-20T23:12:56.707 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-10-20T23:12:56.711 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:56 +0000 (0:00:00.877) 0:00:06.781 ***** 2021-10-20T23:12:56.726 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] 2021-10-20T23:12:56.737 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] 2021-10-20T23:12:56.748 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] 2021-10-20T23:12:56.828 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:56 +0000 (0:00:00.120) 0:00:06.901 ***** 2021-10-20T23:12:56.853 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:56 +0000 (0:00:00.025) 0:00:06.927 ***** 2021-10-20T23:12:56.879 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:56 +0000 (0:00:00.026) 0:00:06.953 ***** 2021-10-20T23:12:57.320 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-10-20T23:12:57.322 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.166114", "end": "2021-10-20 23:12:57.295534", "rc": 0, "start": "2021-10-20 23:12:57.129420", "stderr": "", "stderr_lines": [], "stdout": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "stdout_lines": ["67bbe4acd25fa11296ed99ae51cddedfa9791439"]} changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.168092", "end": "2021-10-20 23:12:57.296648", "rc": 0, "start": "2021-10-20 23:12:57.128556", "stderr": "", "stderr_lines": [], "stdout": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "stdout_lines": ["67bbe4acd25fa11296ed99ae51cddedfa9791439"]} 2021-10-20T23:12:57.346 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.466) 0:00:07.420 ***** 2021-10-20T23:12:57.371 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.025) 0:00:07.445 ***** 2021-10-20T23:12:57.380 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.177647", "end": "2021-10-20 23:12:57.306830", "rc": 0, "start": "2021-10-20 23:12:57.129183", "stderr": "", "stderr_lines": [], "stdout": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "stdout_lines": ["67bbe4acd25fa11296ed99ae51cddedfa9791439"]} 2021-10-20T23:12:57.381 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.202095", "end": "2021-10-20 23:12:57.347146", "rc": 0, "start": "2021-10-20 23:12:57.145051", "stderr": "", "stderr_lines": [], "stdout": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "stdout_lines": ["67bbe4acd25fa11296ed99ae51cddedfa9791439"]} 2021-10-20T23:12:57.408 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.036) 0:00:07.482 ***** 2021-10-20T23:12:57.435 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.025) 0:00:07.508 ***** 2021-10-20T23:12:57.495 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-10-20T23:12:57.496 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014093", "end": "2021-10-20 23:12:57.198446", "failed_when_result": false, "rc": 0, "start": "2021-10-20 23:12:57.184353", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-10-20T23:12:57.520 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.086) 0:00:07.594 ***** 2021-10-20T23:12:57.527 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016772", "end": "2021-10-20 23:12:57.686084", "failed_when_result": false, "rc": 0, "start": "2021-10-20 23:12:57.669312", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-10-20T23:12:57.559 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.038) 0:00:07.633 ***** 2021-10-20T23:12:57.568 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.019075", "end": "2021-10-20 23:12:57.803179", "failed_when_result": false, "rc": 0, "start": "2021-10-20 23:12:57.784104", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-10-20T23:12:57.570 INFO:teuthology.task.ansible.out: 2021-10-20T23:12:57.598 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.038) 0:00:07.672 ***** 2021-10-20T23:12:57.608 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.021056", "end": "2021-10-20 23:12:57.535796", "failed_when_result": false, "rc": 0, "start": "2021-10-20 23:12:57.514740", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-10-20T23:12:57.637 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.039) 0:00:07.711 ***** 2021-10-20T23:12:57.664 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.026) 0:00:07.738 ***** 2021-10-20T23:12:57.672 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-10-20T23:12:57.673 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:57.702 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.036) 0:00:07.775 ***** 2021-10-20T23:12:57.709 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:57.711 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:57.739 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.037) 0:00:07.812 ***** 2021-10-20T23:12:57.764 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.025) 0:00:07.838 ***** 2021-10-20T23:12:57.783 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:57.808 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.040) 0:00:07.879 ***** 2021-10-20T23:12:57.832 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.026) 0:00:07.905 ***** 2021-10-20T23:12:57.839 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-10-20T23:12:57.843 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:57.869 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.037) 0:00:07.943 ***** 2021-10-20T23:12:57.877 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-10-20T23:12:57.881 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:57.907 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:57 +0000 (0:00:00.036) 0:00:07.979 ***** 2021-10-20T23:12:58.063 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:58.088 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.182) 0:00:08.162 ***** 2021-10-20T23:12:58.095 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-10-20T23:12:58.097 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_users list] ******************************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:58.131 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.042) 0:00:08.205 ***** 2021-10-20T23:12:58.290 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.159) 0:00:08.364 ***** 2021-10-20T23:12:58.297 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-10-20T23:12:58.299 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:58.324 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.033) 0:00:08.398 ***** 2021-10-20T23:12:58.331 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-10-20T23:12:58.333 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:58.358 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.033) 0:00:08.432 ***** 2021-10-20T23:12:58.381 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.022) 0:00:08.455 ***** 2021-10-20T23:12:58.388 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-10-20T23:12:58.389 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_users list] ******************************************* 2021-10-20T23:12:58.389 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:58.415 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.034) 0:00:08.489 ***** 2021-10-20T23:12:58.437 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.021) 0:00:08.511 ***** 2021-10-20T23:12:58.454 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-10-20T23:12:58.456 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:58.480 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.042) 0:00:08.554 ***** 2021-10-20T23:12:58.487 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:58.518 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.036) 0:00:08.590 ***** 2021-10-20T23:12:58.533 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:58.556 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.039) 0:00:08.630 ***** 2021-10-20T23:12:58.562 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-10-20T23:12:58.564 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:12:58.590 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.034) 0:00:08.664 ***** 2021-10-20T23:12:58.629 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-10-20T23:12:58.631 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:12:58.657 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.066) 0:00:08.731 ***** 2021-10-20T23:12:58.674 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-10-20T23:12:58.675 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:12:58.703 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.045) 0:00:08.776 ***** 2021-10-20T23:12:58.719 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:12:58.749 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.046) 0:00:08.823 ***** 2021-10-20T23:12:58.841 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-20T23:12:58.842 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:12:58.868 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:12:58 +0000 (0:00:00.119) 0:00:08.942 ***** 2021-10-20T23:12:58.948 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-10-20T23:12:58.950 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-20T23:12:58.983 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-20T23:12:58.995 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-20T23:12:59.100 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-20T23:12:59.112 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-20T23:12:59.135 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-20T23:12:59.136 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-20T23:12:59.243 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-20T23:12:59.255 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-20T23:12:59.277 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-20T23:12:59.278 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-20T23:12:59.377 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-20T23:12:59.415 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-20T23:12:59.424 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-20T23:12:59.426 INFO:teuthology.task.ansible.out: ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-20T23:12:59.525 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-20T23:12:59.550 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-20T23:12:59.570 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-20T23:12:59.582 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-20T23:12:59.680 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-20T23:12:59.692 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-20T23:12:59.714 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-20T23:12:59.726 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-20T23:12:59.728 INFO:teuthology.task.ansible.out: 2021-10-20T23:12:59.822 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-20T23:12:59.845 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-20T23:12:59.846 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-20T23:12:59.869 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-20T23:12:59.957 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-20T23:12:59.990 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-20T23:12:59.992 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-20T23:13:00.013 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-20T23:13:00.099 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-20T23:13:00.121 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-20T23:13:00.133 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-20T23:13:00.155 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-20T23:13:00.242 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-20T23:13:00.265 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-20T23:13:00.277 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-20T23:13:00.321 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-20T23:13:00.386 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-20T23:13:00.408 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-20T23:13:00.430 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-20T23:13:00.452 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-20T23:13:00.540 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-20T23:13:00.552 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-20T23:13:00.574 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-20T23:13:00.596 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-20T23:13:00.682 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-20T23:13:00.694 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-20T23:13:00.707 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-20T23:13:00.739 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-20T23:13:00.825 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-20T23:13:00.851 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-20T23:13:00.863 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-20T23:13:00.886 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-20T23:13:00.964 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-20T23:13:00.997 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-20T23:13:01.008 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-20T23:13:01.041 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-20T23:13:01.115 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-20T23:13:01.137 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-20T23:13:01.161 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-20T23:13:01.204 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-20T23:13:01.258 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-20T23:13:01.291 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-20T23:13:01.303 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-20T23:13:01.305 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:01.348 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-20T23:13:01.401 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-20T23:13:01.434 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-20T23:13:01.446 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-20T23:13:01.506 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-20T23:13:01.547 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-20T23:13:01.582 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-20T23:13:01.604 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-20T23:13:01.638 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-20T23:13:01.703 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-20T23:13:01.747 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-20T23:13:01.761 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-20T23:13:01.797 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-20T23:13:01.851 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-20T23:13:01.873 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-20T23:13:01.895 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-20T23:13:01.940 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-20T23:13:01.994 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-20T23:13:02.028 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-20T23:13:02.051 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-20T23:13:02.083 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-20T23:13:02.137 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-20T23:13:02.169 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-20T23:13:02.202 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-20T23:13:02.235 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-20T23:13:02.289 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-20T23:13:02.322 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-20T23:13:02.333 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-20T23:13:02.376 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-20T23:13:02.432 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-20T23:13:02.464 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-20T23:13:02.476 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-20T23:13:02.529 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-20T23:13:02.589 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-20T23:13:02.612 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-20T23:13:02.623 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-20T23:13:02.687 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-20T23:13:02.730 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-20T23:13:02.753 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-20T23:13:02.771 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-20T23:13:02.836 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-20T23:13:02.890 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-20T23:13:02.915 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-20T23:13:02.926 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-20T23:13:02.981 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-20T23:13:03.035 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-20T23:13:03.047 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-20T23:13:03.059 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-20T23:13:03.123 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-20T23:13:03.190 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-20T23:13:03.201 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-20T23:13:03.203 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-20T23:13:03.267 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-20T23:13:03.334 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-20T23:13:03.343 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-20T23:13:03.354 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-20T23:13:03.419 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-20T23:13:03.484 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-20T23:13:03.487 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-20T23:13:03.517 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-20T23:13:03.571 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-20T23:13:03.627 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-20T23:13:03.641 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-20T23:13:03.663 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-20T23:13:03.717 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-20T23:13:03.772 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-20T23:13:03.784 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-20T23:13:03.819 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-20T23:13:03.863 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:13:03.931 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:13:03.943 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:13:03.954 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-20T23:13:04.009 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-20T23:13:04.074 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-20T23:13:04.086 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-20T23:13:04.108 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:13:04.162 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-20T23:13:04.227 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-20T23:13:04.228 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-20T23:13:04.251 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-20T23:13:04.306 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-20T23:13:04.375 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-20T23:13:04.385 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-20T23:13:04.396 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-20T23:13:04.452 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-20T23:13:04.523 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-20T23:13:04.535 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-20T23:13:04.547 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-20T23:13:04.603 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-20T23:13:04.680 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-20T23:13:04.693 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-20T23:13:04.704 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-20T23:13:04.749 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-20T23:13:04.827 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-20T23:13:04.843 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-20T23:13:04.863 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-20T23:13:04.897 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-20T23:13:04.988 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-20T23:13:04.998 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-20T23:13:05.010 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-20T23:13:05.042 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:13:05.140 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:13:05.141 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:13:05.153 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-20T23:13:05.198 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-20T23:13:05.286 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-20T23:13:05.303 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-20T23:13:05.315 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:13:05.350 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-20T23:13:05.451 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-20T23:13:05.472 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-20T23:13:05.495 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-20T23:13:05.584 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-20T23:13:05.606 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-20T23:13:05.618 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-20T23:13:05.661 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-20T23:13:05.735 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-20T23:13:05.757 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-20T23:13:05.758 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-20T23:13:05.802 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-20T23:13:05.866 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-20T23:13:05.899 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-20T23:13:05.911 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-20T23:13:05.955 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-20T23:13:06.018 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-20T23:13:06.051 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-20T23:13:06.063 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-20T23:13:06.100 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-20T23:13:06.156 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-20T23:13:06.202 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-20T23:13:06.216 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-20T23:13:06.250 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-20T23:13:06.315 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-20T23:13:06.349 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-20T23:13:06.361 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-20T23:13:06.400 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-20T23:13:06.461 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-20T23:13:06.504 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-20T23:13:06.516 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-20T23:13:06.577 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-20T23:13:06.611 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-20T23:13:06.655 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-20T23:13:06.668 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-20T23:13:06.735 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-20T23:13:06.757 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-20T23:13:06.811 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-20T23:13:06.812 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-20T23:13:06.890 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-20T23:13:06.902 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-20T23:13:06.957 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-20T23:13:06.959 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-20T23:13:07.036 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-20T23:13:07.048 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-20T23:13:07.092 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-20T23:13:07.105 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-20T23:13:07.183 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-20T23:13:07.225 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-20T23:13:07.247 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-20T23:13:07.258 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-20T23:13:07.337 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-20T23:13:07.359 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-20T23:13:07.404 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-20T23:13:07.417 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-20T23:13:07.493 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-20T23:13:07.505 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-20T23:13:07.551 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-20T23:13:07.553 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-20T23:13:07.660 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:13:07.662 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:13:07.694 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:13:07.716 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-20T23:13:07.805 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-20T23:13:07.806 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-20T23:13:07.851 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-20T23:13:07.864 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:13:07.952 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-20T23:13:07.954 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-20T23:13:07.997 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-20T23:13:08.019 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-20T23:13:08.116 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-20T23:13:08.160 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-20T23:13:08.171 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-20T23:13:08.261 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-20T23:13:08.278 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-20T23:13:08.318 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-20T23:13:08.332 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-20T23:13:08.416 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-20T23:13:08.428 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-20T23:13:08.452 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-20T23:13:08.485 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-20T23:13:08.561 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-20T23:13:08.581 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-20T23:13:08.607 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-20T23:13:08.639 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-20T23:13:08.706 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-20T23:13:08.728 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-20T23:13:08.772 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-20T23:13:08.795 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-20T23:13:08.850 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-20T23:13:08.883 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-20T23:13:08.915 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-20T23:13:08.939 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-20T23:13:08.992 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-20T23:13:09.027 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-20T23:13:09.061 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-20T23:13:09.104 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-20T23:13:09.136 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-20T23:13:09.180 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-20T23:13:09.203 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-20T23:13:09.247 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-20T23:13:09.280 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-20T23:13:09.335 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-20T23:13:09.347 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-20T23:13:09.391 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-20T23:13:09.423 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-20T23:13:09.488 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-20T23:13:09.499 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-20T23:13:09.543 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-20T23:13:09.578 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-20T23:13:09.641 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-20T23:13:09.648 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-20T23:13:09.681 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-20T23:13:09.725 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-20T23:13:09.780 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-20T23:13:09.792 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-20T23:13:09.838 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-20T23:13:09.861 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-20T23:13:09.932 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-20T23:13:09.988 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-20T23:13:10.012 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-20T23:13:10.089 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-20T23:13:10.144 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-20T23:13:10.177 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-20T23:13:10.232 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-20T23:13:10.245 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-20T23:13:10.321 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-20T23:13:10.386 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-20T23:13:10.404 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-20T23:13:10.448 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-20T23:13:10.460 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-20T23:13:10.528 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-20T23:13:10.561 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-20T23:13:10.613 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-20T23:13:10.628 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-10-20T23:13:10.681 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-10-20T23:13:10.715 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-10-20T23:13:10.749 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-20T23:13:10.761 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-20T23:13:10.831 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-20T23:13:10.864 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-20T23:13:10.889 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-10-20T23:13:10.911 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-20T23:13:10.913 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:10.978 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-20T23:13:11.013 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-20T23:13:11.037 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-20T23:13:11.059 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-20T23:13:11.128 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-20T23:13:11.163 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-20T23:13:11.197 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-20T23:13:11.208 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-20T23:13:11.284 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-20T23:13:11.306 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-20T23:13:11.340 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-20T23:13:11.362 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-20T23:13:11.428 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-20T23:13:11.451 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-20T23:13:11.496 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-20T23:13:11.518 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-20T23:13:11.583 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-20T23:13:11.603 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-20T23:13:11.637 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-20T23:13:11.670 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-20T23:13:11.728 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-20T23:13:11.750 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-20T23:13:11.796 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-20T23:13:11.829 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-20T23:13:11.871 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-20T23:13:11.904 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-20T23:13:11.937 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-20T23:13:11.971 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-20T23:13:12.014 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-20T23:13:12.048 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-20T23:13:12.081 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-20T23:13:12.115 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-20T23:13:12.168 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-20T23:13:12.201 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-20T23:13:12.234 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-20T23:13:12.257 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-20T23:13:12.313 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-20T23:13:12.338 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-20T23:13:12.380 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-20T23:13:12.403 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-20T23:13:12.468 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-20T23:13:12.479 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-20T23:13:12.524 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-20T23:13:12.547 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-20T23:13:12.612 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-20T23:13:12.636 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-20T23:13:12.671 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-20T23:13:12.695 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-20T23:13:12.759 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-20T23:13:12.782 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-20T23:13:12.823 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-20T23:13:12.840 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-20T23:13:12.908 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-20T23:13:12.923 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-20T23:13:12.965 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-20T23:13:12.987 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:13:13.064 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:13:13.080 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:13:13.115 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-20T23:13:13.137 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-20T23:13:13.213 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-20T23:13:13.238 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-20T23:13:13.258 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:13:13.280 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-20T23:13:13.366 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-20T23:13:13.378 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-20T23:13:13.401 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-20T23:13:13.424 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-20T23:13:13.520 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-20T23:13:13.532 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-20T23:13:13.534 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:13.556 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-20T23:13:13.578 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-20T23:13:13.675 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-20T23:13:13.676 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-20T23:13:13.699 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-20T23:13:13.723 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-20T23:13:13.821 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-20T23:13:13.822 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-20T23:13:13.855 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-20T23:13:13.890 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-20T23:13:13.978 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-20T23:13:14.000 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-20T23:13:14.033 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-20T23:13:14.122 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-20T23:13:14.145 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-20T23:13:14.157 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-20T23:13:14.193 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-20T23:13:14.281 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-20T23:13:14.293 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-20T23:13:14.305 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-20T23:13:14.338 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-20T23:13:14.435 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-20T23:13:14.436 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-20T23:13:14.459 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-20T23:13:14.482 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-20T23:13:14.578 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-20T23:13:14.580 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-20T23:13:14.612 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-20T23:13:14.623 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-20T23:13:14.730 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-20T23:13:14.733 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-20T23:13:14.754 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-20T23:13:14.776 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-20T23:13:14.876 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-20T23:13:14.907 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-20T23:13:14.920 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-20T23:13:15.017 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-20T23:13:15.029 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-20T23:13:15.051 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-20T23:13:15.063 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-20T23:13:15.160 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-20T23:13:15.172 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-20T23:13:15.205 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-20T23:13:15.208 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-20T23:13:15.306 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-20T23:13:15.307 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-20T23:13:15.352 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-20T23:13:15.364 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-20T23:13:15.451 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-20T23:13:15.462 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-20T23:13:15.484 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-20T23:13:15.508 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-20T23:13:15.605 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-20T23:13:15.606 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-20T23:13:15.628 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-20T23:13:15.650 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-20T23:13:15.746 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-20T23:13:15.756 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-20T23:13:15.768 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-20T23:13:15.790 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-20T23:13:15.895 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-20T23:13:15.907 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-20T23:13:15.918 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-20T23:13:15.930 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-20T23:13:16.037 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-20T23:13:16.060 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-20T23:13:16.071 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-20T23:13:16.083 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-20T23:13:16.180 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-20T23:13:16.202 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-20T23:13:16.214 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-20T23:13:16.225 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-20T23:13:16.333 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-20T23:13:16.345 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-20T23:13:16.369 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-20T23:13:16.381 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-20T23:13:16.476 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-20T23:13:16.498 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-20T23:13:16.522 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-20T23:13:16.527 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-20T23:13:16.620 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-20T23:13:16.657 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-20T23:13:16.669 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-20T23:13:16.680 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-20T23:13:16.766 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-20T23:13:16.808 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-20T23:13:16.820 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-20T23:13:16.832 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-20T23:13:16.917 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-20T23:13:16.963 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-20T23:13:16.973 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-20T23:13:16.985 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-20T23:13:17.069 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-20T23:13:17.113 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-20T23:13:17.218 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-20T23:13:17.253 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-20T23:13:17.264 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-20T23:13:17.265 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-20T23:13:17.373 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-20T23:13:17.395 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-20T23:13:17.408 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-20T23:13:17.410 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-10-20T23:13:17.517 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-10-20T23:13:17.553 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-20T23:13:17.593 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-20T23:13:17.674 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-20T23:13:17.709 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-20T23:13:17.753 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-20T23:13:17.829 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-20T23:13:17.851 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-20T23:13:17.852 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-20T23:13:17.887 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-20T23:13:17.974 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-20T23:13:17.994 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-20T23:13:18.017 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-20T23:13:18.041 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-20T23:13:18.127 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-20T23:13:18.150 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-20T23:13:18.152 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-20T23:13:18.184 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-20T23:13:18.270 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-20T23:13:18.292 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-20T23:13:18.293 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-20T23:13:18.325 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-20T23:13:18.422 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-20T23:13:18.446 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-20T23:13:18.468 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-10-20T23:13:18.564 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-10-20T23:13:18.588 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-10-20T23:13:18.590 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-20T23:13:18.616 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-10-20T23:13:18.714 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-10-20T23:13:18.737 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-10-20T23:13:18.738 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-10-20T23:13:18.761 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-10-20T23:13:18.868 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-10-20T23:13:18.890 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-10-20T23:13:18.892 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-10-20T23:13:18.903 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-10-20T23:13:19.021 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-10-20T23:13:19.033 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-10-20T23:13:19.044 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-10-20T23:13:19.055 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-10-20T23:13:19.161 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-10-20T23:13:19.184 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-10-20T23:13:19.195 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-10-20T23:13:19.197 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-10-20T23:13:19.304 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-10-20T23:13:19.326 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-10-20T23:13:19.338 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-10-20T23:13:19.340 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-10-20T23:13:19.456 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-10-20T23:13:19.469 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-10-20T23:13:19.490 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-10-20T23:13:19.491 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-10-20T23:13:19.608 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-10-20T23:13:19.621 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-10-20T23:13:19.632 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-10-20T23:13:19.761 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-10-20T23:13:19.774 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-10-20T23:13:19.903 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-10-20T23:13:19.916 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-10-20T23:13:19.920 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-10-20T23:13:19.922 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-10-20T23:13:20.049 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-10-20T23:13:20.060 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-10-20T23:13:20.061 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-10-20T23:13:20.063 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-10-20T23:13:20.191 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-10-20T23:13:20.203 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-10-20T23:13:20.204 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-10-20T23:13:20.216 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-10-20T23:13:20.342 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-10-20T23:13:20.354 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-10-20T23:13:20.368 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-10-20T23:13:20.371 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-10-20T23:13:20.487 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-10-20T23:13:20.499 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-10-20T23:13:20.500 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-10-20T23:13:20.512 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-10-20T23:13:20.629 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-10-20T23:13:20.652 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-10-20T23:13:20.653 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-10-20T23:13:20.655 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-10-20T23:13:20.781 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-10-20T23:13:20.792 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-10-20T23:13:20.805 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-10-20T23:13:20.921 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-10-20T23:13:20.934 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-10-20T23:13:20.946 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-10-20T23:13:20.947 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-10-20T23:13:21.064 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-10-20T23:13:21.087 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-10-20T23:13:21.090 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-10-20T23:13:21.092 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-10-20T23:13:21.219 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-10-20T23:13:21.230 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-10-20T23:13:21.242 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-10-20T23:13:21.243 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-10-20T23:13:21.359 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-10-20T23:13:21.381 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-10-20T23:13:21.382 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-10-20T23:13:21.384 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-10-20T23:13:21.511 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:21 +0000 (0:00:22.642) 0:00:31.585 ***** 2021-10-20T23:13:21.520 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-10-20T23:13:21.540 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-10-20T23:13:21.542 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-10-20T23:13:21.712 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** TASK [Create all admin users with sudo access.] ******************************** 2021-10-20T23:13:21.714 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-10-20T23:13:21.735 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:21 +0000 (0:00:00.224) 0:00:31.809 ***** 2021-10-20T23:13:21.757 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:21 +0000 (0:00:00.021) 0:00:31.831 ***** 2021-10-20T23:13:21.780 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:21 +0000 (0:00:00.023) 0:00:31.854 ***** 2021-10-20T23:13:21.878 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-10-20T23:13:21.880 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-10-20T23:13:21.881 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-10-20T23:13:21.883 INFO:teuthology.task.ansible.out: EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-10-20T23:13:21.885 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-10-20T23:13:21.886 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-10-20T23:13:21.888 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-10-20T23:13:21.890 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-10-20T23:13:21.892 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a9 2021-10-20T23:13:21.893 INFO:teuthology.task.ansible.out:5579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-20T23:13:21.894 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-10-20T23:13:21.896 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-10-20T23:13:21.897 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-10-20T23:13:21.899 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-10-20T23:13:21.901 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ec 2021-10-20T23:13:21.902 INFO:teuthology.task.ansible.out:f7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f9 2021-10-20T23:13:21.903 INFO:teuthology.task.ansible.out:1e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn" 2021-10-20T23:13:21.904 INFO:teuthology.task.ansible.out:: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-20T23:13:21.933 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:21 +0000 (0:00:00.152) 0:00:32.007 ***** 2021-10-20T23:13:21.958 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:21 +0000 (0:00:00.024) 0:00:32.032 ***** 2021-10-20T23:13:21.986 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:21 +0000 (0:00:00.027) 0:00:32.060 ***** 2021-10-20T23:13:22.013 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:22 +0000 (0:00:00.026) 0:00:32.087 ***** 2021-10-20T23:13:22.026 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-10-20T23:13:22.028 INFO:teuthology.task.ansible.out: EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-10-20T23:13:22.030 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-10-20T23:13:22.031 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-10-20T23:13:22.033 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9eb 2021-10-20T23:13:22.034 INFO:teuthology.task.ansible.out:ba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-10-20T23:13:22.036 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-10-20T23:13:22.038 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-20T23:13:22.039 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-10-20T23:13:22.041 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-10-20T23:13:22.043 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-10-20T23:13:22.045 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-10-20T23:13:22.047 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ec 2021-10-20T23:13:22.049 INFO:teuthology.task.ansible.out:f7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f9 2021-10-20T23:13:22.050 INFO:teuthology.task.ansible.out:1e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn" 2021-10-20T23:13:22.053 INFO:teuthology.task.ansible.out:: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-20T23:13:22.056 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-10-20T23:13:22.058 INFO:teuthology.task.ansible.out: EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-10-20T23:13:22.059 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-10-20T23:13:22.061 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-10-20T23:13:22.063 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9eb 2021-10-20T23:13:22.063 INFO:teuthology.task.ansible.out:ba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-10-20T23:13:22.065 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-10-20T23:13:22.067 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-20T23:13:22.069 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-10-20T23:13:22.070 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-10-20T23:13:22.073 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-10-20T23:13:22.074 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432 2021-10-20T23:13:22.075 INFO:teuthology.task.ansible.out:aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-10-20T23:13:22.076 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ec 2021-10-20T23:13:22.078 INFO:teuthology.task.ansible.out:f7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn" 2021-10-20T23:13:22.080 INFO:teuthology.task.ansible.out:: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} TASK [Create all users without sudo access.] *********************************** 2021-10-20T23:13:22.117 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:22 +0000 (0:00:00.104) 0:00:32.191 ***** 2021-10-20T23:13:22.144 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:22 +0000 (0:00:00.026) 0:00:32.218 ***** 2021-10-20T23:13:22.169 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:22 +0000 (0:00:00.024) 0:00:32.243 ***** 2021-10-20T23:13:22.445 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-10-20T23:13:22.448 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-10-20T23:13:22.449 INFO:teuthology.task.ansible.out: EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-10-20T23:13:22.451 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-10-20T23:13:22.453 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-10-20T23:13:22.455 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-10-20T23:13:22.456 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-10-20T23:13:22.458 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-20T23:13:22.460 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-10-20T23:13:22.461 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-10-20T23:13:22.463 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-10-20T23:13:22.465 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-10-20T23:13:22.466 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ec 2021-10-20T23:13:22.467 INFO:teuthology.task.ansible.out:f7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f9 2021-10-20T23:13:22.472 INFO:teuthology.task.ansible.out:1e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbaluto 2021-10-20T23:13:22.473 INFO:teuthology.task.ansible.out:iu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-20T23:13:22.499 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:22 +0000 (0:00:00.330) 0:00:32.573 ***** 2021-10-20T23:13:22.908 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-10-20T23:13:22.910 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"after": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "attempts": 1, "before": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "changed": false, "remote_url_changed": false} ok: [smithi031.front.sepia.ceph.com] => {"after": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "attempts": 1, "before": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "changed": false, "remote_url_changed": false} 2021-10-20T23:13:22.933 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:22 +0000 (0:00:00.433) 0:00:33.007 ***** 2021-10-20T23:13:22.955 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:22 +0000 (0:00:00.022) 0:00:33.029 ***** 2021-10-20T23:13:22.965 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"after": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "attempts": 1, "before": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "changed": false, "remote_url_changed": false} 2021-10-20T23:13:22.991 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:22 +0000 (0:00:00.035) 0:00:33.065 ***** 2021-10-20T23:13:23.342 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-20T23:13:23.344 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item 2021-10-20T23:13:23.345 INFO:teuthology.task.ansible.out:", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-20T23:13:23.387 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-10-20T23:13:23.389 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"after": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "attempts": 1, "before": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "changed": false, "remote_url_changed": false} 2021-10-20T23:13:23.516 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:23 +0000 (0:00:00.525) 0:00:33.590 ***** 2021-10-20T23:13:23.523 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-20T23:13:23.524 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-20T23:13:23.525 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10O 2021-10-20T23:13:23.527 INFO:teuthology.task.ansible.out:UIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-20T23:13:23.589 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-20T23:13:23.601 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-20T23:13:23.635 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-20T23:13:23.730 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-20T23:13:23.741 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-20T23:13:23.743 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-20T23:13:23.753 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-20T23:13:23.765 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-20T23:13:23.767 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-20T23:13:23.861 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-20T23:13:23.862 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-20T23:13:23.872 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-20T23:13:23.874 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:23.894 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-20T23:13:23.896 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:23.906 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-20T23:13:24.001 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-20T23:13:24.002 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-20T23:13:24.003 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-20T23:13:24.035 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-20T23:13:24.036 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-20T23:13:24.038 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-20T23:13:24.136 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-20T23:13:24.138 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-20T23:13:24.170 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-20T23:13:24.172 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-20T23:13:24.267 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-20T23:13:24.269 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-20T23:13:24.301 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-20T23:13:24.312 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-20T23:13:24.398 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-20T23:13:24.409 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-20T23:13:24.420 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:24.432 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-20T23:13:24.434 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-20T23:13:24.443 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-20T23:13:24.455 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:24.540 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-20T23:13:24.542 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:24.552 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-20T23:13:24.553 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-20T23:13:24.564 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-20T23:13:24.585 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-20T23:13:24.587 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-20T23:13:24.680 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-20T23:13:24.682 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-20T23:13:24.703 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-20T23:13:24.705 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-20T23:13:24.706 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:24.715 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:24.726 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-20T23:13:24.728 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-10-20T23:13:24.738 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:24.750 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:24.813 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-20T23:13:24.815 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-10-20T23:13:24.824 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:24.835 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-20T23:13:24.837 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTW 2021-10-20T23:13:24.839 INFO:teuthology.task.ansible.out:JoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:24.849 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-20T23:13:24.881 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-20T23:13:24.967 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-20T23:13:24.978 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-20T23:13:24.980 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14 2021-10-20T23:13:24.983 INFO:teuthology.task.ansible.out:+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-20T23:13:25.014 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-20T23:13:25.016 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-20T23:13:25.098 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-20T23:13:25.100 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-20T23:13:25.110 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-20T23:13:25.112 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:25.122 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-20T23:13:25.123 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:25.165 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-20T23:13:25.229 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-20T23:13:25.251 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-20T23:13:25.253 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-20T23:13:25.288 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-20T23:13:25.362 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-20T23:13:25.384 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-20T23:13:25.386 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-20T23:13:25.397 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-20T23:13:25.430 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-20T23:13:25.495 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-20T23:13:25.517 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-20T23:13:25.529 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-20T23:13:25.531 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-20T23:13:25.573 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-20T23:13:25.574 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-20T23:13:25.636 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-20T23:13:25.638 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-20T23:13:25.661 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-20T23:13:25.684 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-20T23:13:25.685 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-20T23:13:25.706 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-20T23:13:25.707 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-20T23:13:25.772 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-20T23:13:25.773 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-20T23:13:25.795 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-20T23:13:25.796 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-20T23:13:25.840 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-20T23:13:25.900 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-20T23:13:25.934 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-20T23:13:25.936 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-20T23:13:25.947 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-20T23:13:25.990 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-20T23:13:26.033 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-20T23:13:26.065 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-20T23:13:26.067 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-20T23:13:26.077 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-20T23:13:26.079 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-20T23:13:26.124 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-20T23:13:26.126 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-20T23:13:26.187 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-20T23:13:26.193 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-20T23:13:26.202 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-20T23:13:26.213 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-20T23:13:26.258 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-20T23:13:26.336 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-20T23:13:26.347 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-20T23:13:26.348 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-20T23:13:26.391 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-20T23:13:26.466 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-20T23:13:26.478 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-20T23:13:26.501 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-20T23:13:26.503 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-20T23:13:26.534 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-20T23:13:26.609 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-20T23:13:26.622 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-20T23:13:26.665 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-20T23:13:26.666 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-20T23:13:26.741 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-20T23:13:26.754 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-20T23:13:26.788 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-20T23:13:26.810 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-20T23:13:26.882 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-20T23:13:26.893 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-20T23:13:26.894 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-20T23:13:26.927 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-20T23:13:26.938 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-20T23:13:26.940 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-20T23:13:27.014 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-20T23:13:27.016 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-20T23:13:27.025 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-20T23:13:27.059 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-20T23:13:27.082 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-20T23:13:27.151 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-20T23:13:27.163 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-20T23:13:27.195 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-20T23:13:27.217 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-20T23:13:27.282 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-20T23:13:27.293 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-20T23:13:27.326 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-20T23:13:27.328 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-20T23:13:27.350 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-20T23:13:27.427 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-20T23:13:27.429 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-20T23:13:27.482 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-20T23:13:27.490 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-20T23:13:27.558 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:13:27.571 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-20T23:13:27.615 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-20T23:13:27.627 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:13:27.696 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSi 2021-10-20T23:13:27.698 INFO:teuthology.task.ansible.out:m7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:13:27.756 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-20T23:13:27.758 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-20T23:13:27.834 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-20T23:13:27.846 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-20T23:13:27.891 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-20T23:13:27.892 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-20T23:13:27.977 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-20T23:13:27.989 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-20T23:13:27.991 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-20T23:13:28.032 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:13:28.043 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-20T23:13:28.045 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-20T23:13:28.119 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-20T23:13:28.120 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-20T23:13:28.130 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-20T23:13:28.132 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-20T23:13:28.165 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-20T23:13:28.177 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-20T23:13:28.178 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-20T23:13:28.262 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-20T23:13:28.264 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-20T23:13:28.284 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-20T23:13:28.315 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-20T23:13:28.317 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-20T23:13:28.402 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-20T23:13:28.427 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-20T23:13:28.457 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-20T23:13:28.460 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-20T23:13:28.468 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-20T23:13:28.547 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-20T23:13:28.558 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-20T23:13:28.598 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQSh 2021-10-20T23:13:28.605 INFO:teuthology.task.ansible.out:GhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-20T23:13:28.672 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-20T23:13:28.709 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-20T23:13:28.710 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:13:28.731 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-20T23:13:28.751 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-20T23:13:28.753 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:13:28.826 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-20T23:13:28.828 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:13:28.848 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-20T23:13:28.850 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-20T23:13:28.852 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-20T23:13:28.889 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-20T23:13:28.898 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-20T23:13:28.900 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-20T23:13:28.902 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-20T23:13:28.966 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-20T23:13:28.968 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-20T23:13:28.971 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-20T23:13:28.989 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-20T23:13:29.034 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R 2021-10-20T23:13:29.036 INFO:teuthology.task.ansible.out:1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-20T23:13:29.096 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-20T23:13:29.130 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-20T23:13:29.173 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-20T23:13:29.184 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-20T23:13:29.186 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:13:29.249 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-20T23:13:29.260 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-20T23:13:29.293 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-20T23:13:29.326 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-20T23:13:29.329 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-20T23:13:29.330 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-20T23:13:29.379 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-20T23:13:29.390 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-20T23:13:29.435 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-20T23:13:29.468 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-20T23:13:29.511 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-20T23:13:29.533 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-20T23:13:29.555 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-20T23:13:29.588 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-20T23:13:29.641 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-20T23:13:29.664 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-20T23:13:29.666 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-20T23:13:29.698 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-20T23:13:29.700 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-20T23:13:29.721 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-20T23:13:29.789 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-20T23:13:29.791 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-20T23:13:29.834 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-20T23:13:29.849 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnR 2021-10-20T23:13:29.851 INFO:teuthology.task.ansible.out:BhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-20T23:13:29.943 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-20T23:13:29.980 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-20T23:13:29.982 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-20T23:13:29.991 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-20T23:13:30.078 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-20T23:13:30.121 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-20T23:13:30.123 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_opt 2021-10-20T23:13:30.125 INFO:teuthology.task.ansible.out:ions": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9u 2021-10-20T23:13:30.126 INFO:teuthology.task.ansible.out:qFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} 2021-10-20T23:13:30.210 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-20T23:13:30.212 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-20T23:13:30.253 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-20T23:13:30.265 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-20T23:13:30.278 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-20T23:13:30.344 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-20T23:13:30.391 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-20T23:13:30.432 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-20T23:13:30.491 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-20T23:13:30.536 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-20T23:13:30.538 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-20T23:13:30.546 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-20T23:13:30.548 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-20T23:13:30.579 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-20T23:13:30.581 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-20T23:13:30.634 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-20T23:13:30.636 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-20T23:13:30.668 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-20T23:13:30.679 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-20T23:13:30.722 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-20T23:13:30.778 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-20T23:13:30.810 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-20T23:13:30.812 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-20T23:13:30.856 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-20T23:13:30.913 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-20T23:13:30.946 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-20T23:13:30.957 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-20T23:13:30.990 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-20T23:13:30.992 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-20T23:13:31.048 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-20T23:13:31.081 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:13:31.093 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:13:31.135 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-20T23:13:31.188 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:13:31.221 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-20T23:13:31.232 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-20T23:13:31.275 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-20T23:13:31.320 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-20T23:13:31.367 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-20T23:13:31.369 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-20T23:13:31.412 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-20T23:13:31.456 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-20T23:13:31.501 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "us 2021-10-20T23:13:31.502 INFO:teuthology.task.ansible.out:er": "clacroix", "validate_certs": true} 2021-10-20T23:13:31.554 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:13:31.597 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-20T23:13:31.630 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-20T23:13:31.641 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-20T23:13:31.698 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-20T23:13:31.731 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-20T23:13:31.765 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-20T23:13:31.766 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-20T23:13:31.833 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-20T23:13:31.865 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-20T23:13:31.898 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-20T23:13:31.910 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-20T23:13:31.975 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-20T23:13:31.998 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-20T23:13:32.042 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "vali 2021-10-20T23:13:32.047 INFO:teuthology.task.ansible.out:date_certs": true} 2021-10-20T23:13:32.102 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-20T23:13:32.136 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-20T23:13:32.168 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-20T23:13:32.192 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-20T23:13:32.245 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-20T23:13:32.268 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-20T23:13:32.311 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-20T23:13:32.334 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-20T23:13:32.383 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-20T23:13:32.416 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-20T23:13:32.438 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-20T23:13:32.461 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-20T23:13:32.506 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-20T23:13:32.551 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-20T23:13:32.596 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-20T23:13:32.618 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-20T23:13:32.652 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-20T23:13:32.695 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-20T23:13:32.762 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ 2021-10-20T23:13:32.765 INFO:teuthology.task.ansible.out:2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-20T23:13:32.795 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-20T23:13:32.848 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-20T23:13:32.882 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-20T23:13:32.884 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-20T23:13:32.934 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-20T23:13:32.989 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-20T23:13:33.023 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-20T23:13:33.025 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-20T23:13:33.083 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-20T23:13:33.126 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-20T23:13:33.159 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-20T23:13:33.172 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-20T23:13:33.217 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-20T23:13:33.272 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-20T23:13:33.294 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-20T23:13:33.306 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-20T23:13:33.355 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-20T23:13:33.406 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-20T23:13:33.438 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-20T23:13:33.440 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-20T23:13:33.443 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-20T23:13:33.444 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-20T23:13:33.497 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-20T23:13:33.552 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-20T23:13:33.554 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-20T23:13:33.563 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-20T23:13:33.574 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-20T23:13:33.628 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-20T23:13:33.693 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-20T23:13:33.694 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-20T23:13:33.718 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-20T23:13:33.772 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-20T23:13:33.826 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-20T23:13:33.828 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-20T23:13:33.860 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-20T23:13:33.902 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-20T23:13:33.904 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-20T23:13:33.966 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-20T23:13:33.968 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-20T23:13:34.001 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-20T23:13:34.003 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-20T23:13:34.046 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-20T23:13:34.088 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-20T23:13:34.100 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-20T23:13:34.101 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-20T23:13:34.132 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-20T23:13:34.165 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-20T23:13:34.229 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-20T23:13:34.231 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-20T23:13:34.263 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-20T23:13:34.297 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-20T23:13:34.362 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-20T23:13:34.377 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-20T23:13:34.395 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-20T23:13:34.438 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-20T23:13:34.440 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-20T23:13:34.492 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-20T23:13:34.514 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-20T23:13:34.536 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-20T23:13:34.569 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-20T23:13:34.633 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-20T23:13:34.657 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-20T23:13:34.667 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-20T23:13:34.710 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-20T23:13:34.768 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-20T23:13:34.790 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-20T23:13:34.817 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-20T23:13:34.841 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-20T23:13:34.894 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-20T23:13:34.937 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-20T23:13:34.959 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-20T23:13:34.982 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-20T23:13:35.035 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-20T23:13:35.038 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-20T23:13:35.078 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-20T23:13:35.090 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-20T23:13:35.092 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-20T23:13:35.123 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-20T23:13:35.177 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-20T23:13:35.220 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-20T23:13:35.222 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-20T23:13:35.239 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-20T23:13:35.252 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-20T23:13:35.308 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-20T23:13:35.351 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-20T23:13:35.362 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-20T23:13:35.384 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-20T23:13:35.438 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-20T23:13:35.484 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-20T23:13:35.504 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-20T23:13:35.527 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-20T23:13:35.529 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-20T23:13:35.571 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-20T23:13:35.621 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-20T23:13:35.660 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-20T23:13:35.662 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-20T23:13:35.705 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-20T23:13:35.759 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-20T23:13:35.791 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-20T23:13:35.802 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-20T23:13:35.835 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-20T23:13:35.889 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-20T23:13:35.935 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-20T23:13:35.936 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-20T23:13:35.968 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-20T23:13:35.970 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:13:36.022 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-20T23:13:36.066 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-20T23:13:36.068 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-20T23:13:36.070 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:13:36.100 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-20T23:13:36.153 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-20T23:13:36.156 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:13:36.196 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-20T23:13:36.208 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-20T23:13:36.231 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-20T23:13:36.284 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-20T23:13:36.337 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-20T23:13:36.340 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-20T23:13:36.360 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-20T23:13:36.424 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-20T23:13:36.467 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-20T23:13:36.480 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-20T23:13:36.483 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:13:36.492 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-20T23:13:36.556 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-20T23:13:36.605 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-20T23:13:36.617 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-20T23:13:36.651 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-20T23:13:36.695 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-20T23:13:36.739 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-20T23:13:36.750 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-20T23:13:36.783 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-20T23:13:36.827 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-20T23:13:36.884 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-20T23:13:36.896 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-20T23:13:36.920 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-20T23:13:36.972 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-20T23:13:37.026 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-20T23:13:37.028 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-20T23:13:37.060 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-20T23:13:37.112 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-20T23:13:37.170 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@local 2021-10-20T23:13:37.173 INFO:teuthology.task.ansible.out:host.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-20T23:13:37.191 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-20T23:13:37.246 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-20T23:13:37.301 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-20T23:13:37.302 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-20T23:13:37.324 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-20T23:13:37.377 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-20T23:13:37.431 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-20T23:13:37.454 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_ce 2021-10-20T23:13:37.455 INFO:teuthology.task.ansible.out:rts": true} 2021-10-20T23:13:37.517 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-20T23:13:37.560 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-20T23:13:37.584 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-20T23:13:37.595 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-20T23:13:37.596 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:37.665 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-20T23:13:37.714 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-20T23:13:37.721 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-20T23:13:37.724 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-20T23:13:37.812 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-20T23:13:37.843 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-20T23:13:37.854 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-20T23:13:37.878 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-20T23:13:37.946 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-20T23:13:37.992 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-20T23:13:38.005 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEj 2021-10-20T23:13:38.007 INFO:teuthology.task.ansible.out:dTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-20T23:13:38.090 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-20T23:13:38.123 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-20T23:13:38.134 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-20T23:13:38.146 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-20T23:13:38.232 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-20T23:13:38.255 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-20T23:13:38.267 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-20T23:13:38.269 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-20T23:13:38.358 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-20T23:13:38.390 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-20T23:13:38.402 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-20T23:13:38.404 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-20T23:13:38.498 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-20T23:13:38.536 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-20T23:13:38.538 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe 2021-10-20T23:13:38.540 INFO:teuthology.task.ansible.out:8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-20T23:13:38.630 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-20T23:13:38.676 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67 2021-10-20T23:13:38.680 INFO:teuthology.task.ansible.out:331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": fa 2021-10-20T23:13:38.681 INFO:teuthology.task.ansible.out:lse, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-20T23:13:38.772 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-20T23:13:38.773 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-20T23:13:38.804 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-20T23:13:38.806 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-20T23:13:38.831 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-20T23:13:38.911 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-20T23:13:38.933 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-20T23:13:38.944 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-20T23:13:38.955 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-20T23:13:39.040 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-20T23:13:39.073 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-20T23:13:39.075 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-20T23:13:39.084 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-20T23:13:39.096 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-20T23:13:39.172 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-20T23:13:39.205 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-20T23:13:39.227 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-20T23:13:39.249 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-20T23:13:39.324 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-20T23:13:39.346 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-20T23:13:39.369 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-20T23:13:39.392 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-20T23:13:39.458 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-20T23:13:39.480 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-20T23:13:39.502 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-20T23:13:39.548 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-20T23:13:39.612 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-20T23:13:39.624 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-20T23:13:39.636 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-20T23:13:39.692 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-20T23:13:39.766 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-20T23:13:39.769 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/ 2021-10-20T23:13:39.770 INFO:teuthology.task.ansible.out:L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-20T23:13:39.821 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-20T23:13:39.906 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-20T23:13:39.908 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-20T23:13:39.918 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-20T23:13:39.962 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-20T23:13:40.037 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-20T23:13:40.039 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-20T23:13:40.052 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-20T23:13:40.095 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-20T23:13:40.171 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-20T23:13:40.183 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-20T23:13:40.184 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-20T23:13:40.226 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-20T23:13:40.313 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-20T23:13:40.421 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null 2021-10-20T23:13:40.423 INFO:teuthology.task.ansible.out:, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-20T23:13:40.460 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-20T23:13:40.462 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-20T23:13:40.474 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-20T23:13:40.519 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-20T23:13:40.595 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-20T23:13:40.599 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-20T23:13:40.628 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-20T23:13:40.639 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-20T23:13:40.726 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-20T23:13:40.728 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-20T23:13:40.730 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-20T23:13:40.775 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-20T23:13:40.787 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-20T23:13:40.861 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-20T23:13:40.872 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-20T23:13:40.926 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-20T23:13:40.927 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-20T23:13:41.012 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-20T23:13:41.014 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-20T23:13:41.024 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-20T23:13:41.074 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-20T23:13:41.158 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-20T23:13:41.172 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-20T23:13:41.173 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-20T23:13:41.174 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-20T23:13:41.205 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-20T23:13:41.301 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-20T23:13:41.313 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-20T23:13:41.324 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-20T23:13:41.326 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-20T23:13:41.347 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-20T23:13:41.433 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-20T23:13:41.454 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-20T23:13:41.476 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-20T23:13:41.488 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-20T23:13:41.565 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-20T23:13:41.610 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-20T23:13:41.623 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-20T23:13:41.634 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-20T23:13:41.700 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-20T23:13:41.750 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-20T23:13:41.760 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-20T23:13:41.772 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-20T23:13:41.849 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-20T23:13:41.886 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-20T23:13:41.912 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, " 2021-10-20T23:13:41.914 INFO:teuthology.task.ansible.out:state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-20T23:13:41.974 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-20T23:13:42.042 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-20T23:13:42.051 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-20T23:13:42.076 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-20T23:13:42.108 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-20T23:13:42.173 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-20T23:13:42.185 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-20T23:13:42.208 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-20T23:13:42.240 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-20T23:13:42.304 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-20T23:13:42.340 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-20T23:13:42.352 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-20T23:13:42.386 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-20T23:13:42.439 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-20T23:13:42.477 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-20T23:13:42.479 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-20T23:13:42.524 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-20T23:13:42.578 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-20T23:13:42.611 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-20T23:13:42.612 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-20T23:13:42.656 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-20T23:13:42.721 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-20T23:13:42.743 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-20T23:13:42.744 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-20T23:13:42.787 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-20T23:13:42.852 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-20T23:13:42.889 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AA 2021-10-20T23:13:42.891 INFO:teuthology.task.ansible.out:AAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-20T23:13:42.921 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-20T23:13:42.997 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-20T23:13:43.019 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-20T23:13:43.021 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-20T23:13:43.054 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-20T23:13:43.132 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-20T23:13:43.155 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-20T23:13:43.166 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-20T23:13:43.188 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-20T23:13:43.290 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-20T23:13:43.294 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-20T23:13:43.310 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-20T23:13:43.362 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-20T23:13:43.417 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-20T23:13:43.440 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-20T23:13:43.452 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-20T23:13:43.506 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-20T23:13:43.549 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-20T23:13:43.586 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD 2021-10-20T23:13:43.588 INFO:teuthology.task.ansible.out:0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-20T23:13:43.664 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-20T23:13:43.698 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-20T23:13:43.720 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-20T23:13:43.731 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-20T23:13:43.819 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-20T23:13:43.901 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-20T23:13:43.903 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO 2021-10-20T23:13:43.904 INFO:teuthology.task.ansible.out:6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-20T23:13:43.928 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:43 +0000 (0:00:20.412) 0:00:54.002 ***** 2021-10-20T23:13:44.004 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-20T23:13:44.016 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-20T23:13:44.019 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal key 2021-10-20T23:13:44.021 INFO:teuthology.task.ansible.out:s] ********** skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.031 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.045 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.048 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) 2021-10-20T23:13:44.050 INFO:teuthology.task.ansible.out:=> {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.067 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.087 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-20T23:13:44.125 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-20T23:13:44.127 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.151 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:44 +0000 (0:00:00.222) 0:00:54.225 ***** 2021-10-20T23:13:44.161 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-20T23:13:44.163 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-20T23:13:44.177 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-20T23:13:44.243 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-20T23:13:44.245 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa 2021-10-20T23:13:44.246 INFO:teuthology.task.ansible.out:5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-20T23:13:44.255 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.257 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.268 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.279 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.290 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.292 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.302 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-20T23:13:44.304 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-20T23:13:44.318 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-20T23:13:44.320 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.337 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-20T23:13:44.372 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-20T23:13:44.396 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:44 +0000 (0:00:00.245) 0:00:54.470 ***** 2021-10-20T23:13:44.404 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-20T23:13:44.408 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-20T23:13:44.454 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2021-10-20T23:13:44.456 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.465 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.477 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-20T23:13:44.479 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-20T23:13:44.553 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.555 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166a 2021-10-20T23:13:44.557 INFO:teuthology.task.ansible.out:f59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} ok: [smithi119.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, " 2021-10-20T23:13:44.558 INFO:teuthology.task.ansible.out:keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) = 2021-10-20T23:13:44.560 INFO:teuthology.task.ansible.out:> {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@Work 2021-10-20T23:13:44.561 INFO:teuthology.task.ansible.out:Mini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.590 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:44 +0000 (0:00:00.188) 0:00:54.659 ***** 2021-10-20T23:13:44.593 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.596 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.596 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef 2021-10-20T23:13:44.598 INFO:teuthology.task.ansible.out:168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1c 2021-10-20T23:13:44.600 INFO:teuthology.task.ansible.out:SzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.612 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.614 INFO:teuthology.task.ansible.out: skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.626 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.637 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.639 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.650 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.662 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.673 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.675 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.687 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.689 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.701 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAAD 2021-10-20T23:13:44.703 INFO:teuthology.task.ansible.out:AQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owa 2021-10-20T23:13:44.704 INFO:teuthology.task.ansible.out:sserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050 2021-10-20T23:13:44.706 INFO:teuthology.task.ansible.out:353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.716 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.717 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.719 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.721 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.733 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.735 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.737 INFO:teuthology.task.ansible.out: skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.738 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnK 2021-10-20T23:13:44.739 INFO:teuthology.task.ansible.out:WPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.750 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.752 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.766 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.776 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.778 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.787 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.791 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83e 2021-10-20T23:13:44.794 INFO:teuthology.task.ansible.out:a73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.804 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.806 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.816 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.818 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.831 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.843 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.846 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.859 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_l 2021-10-20T23:13:44.860 INFO:teuthology.task.ansible.out:oop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.871 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.873 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7 2021-10-20T23:13:44.875 INFO:teuthology.task.ansible.out:pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.885 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.887 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'a 2021-10-20T23:13:44.888 INFO:teuthology.task.ansible.out:emerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.899 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.901 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.911 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.913 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.924 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.927 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.937 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.939 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.948 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.949 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.950 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.950 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.961 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.962 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.963 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.963 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.975 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.977 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.979 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:44.979 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.980 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.981 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.992 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:44.996 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9faf 2021-10-20T23:13:44.998 INFO:teuthology.task.ansible.out:cfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.007 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.009 INFO:teuthology.task.ansible.out: skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.009 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.011 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.025 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.033 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.034 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.035 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRV 2021-10-20T23:13:45.037 INFO:teuthology.task.ansible.out:G7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.047 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.051 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", 2021-10-20T23:13:45.053 INFO:teuthology.task.ansible.out: "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'o 2021-10-20T23:13:45.055 INFO:teuthology.task.ansible.out:vpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.086 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.088 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.090 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.090 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.102 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.104 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.104 INFO:teuthology.task.ansible.out:skipping: [smithi031. 2021-10-20T23:13:45.106 INFO:teuthology.task.ansible.out:front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.106 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:45.107 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.118 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.120 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.122 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.122 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.123 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:45.124 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.125 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.127 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.130 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.131 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsriv 2021-10-20T23:13:45.132 INFO:teuthology.task.ansible.out:as@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.143 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.145 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.145 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.156 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.157 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.159 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-20T23:13:45.170 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.171 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv 2021-10-20T23:13:45.173 INFO:teuthology.task.ansible.out: waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngf 2021-10-20T23:13:45.175 INFO:teuthology.task.ansible.out:arnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.185 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.188 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.202 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item" 2021-10-20T23:13:45.205 INFO:teuthology.task.ansible.out:: {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kap 2021-10-20T23:13:45.208 INFO:teuthology.task.ansible.out:andya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.216 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.218 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.220 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.248 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.c 2021-10-20T23:13:45.250 INFO:teuthology.task.ansible.out:om] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": 2021-10-20T23:13:45.252 INFO:teuthology.task.ansible.out: "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': ' 2021-10-20T23:13:45.253 INFO:teuthology.task.ansible.out:adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b6 2021-10-20T23:13:45.255 INFO:teuthology.task.ansible.out:1f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was F 2021-10-20T23:13:45.258 INFO:teuthology.task.ansible.out:alse"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.271 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item= 2021-10-20T23:13:45.274 INFO:teuthology.task.ansible.out:{'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec5 2021-10-20T23:13:45.278 INFO:teuthology.task.ansible.out:70cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.284 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.286 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.287 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.287 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.298 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.300 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhi 2021-10-20T23:13:45.302 INFO:teuthology.task.ansible.out:te@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.314 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.316 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.316 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": 2021-10-20T23:13:45.318 INFO:teuthology.task.ansible.out:"pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.319 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.329 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.331 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.332 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.332 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.332 INFO:teuthology.task.ansible.out:skipping: [smithi012.front 2021-10-20T23:13:45.334 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.345 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.347 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.358 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.359 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.360 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.361 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item" 2021-10-20T23:13:45.362 INFO:teuthology.task.ansible.out:: {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.373 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.374 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.376 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.377 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.377 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjY 2021-10-20T23:13:45.378 INFO:teuthology.task.ansible.out:UD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.393 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front 2021-10-20T23:13:45.395 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.405 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.407 INFO:teuthology.task.ansible.out: skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.407 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.410 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.412 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.413 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia 2021-10-20T23:13:45.415 INFO:teuthology.task.ansible.out:.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.426 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.428 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.429 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.430 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.432 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.432 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.434 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.435 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.437 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.439 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.453 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.455 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.458 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.472 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.477 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.478 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.488 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.490 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.490 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (ite 2021-10-20T23:13:45.492 INFO:teuthology.task.ansible.out:m={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.492 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.505 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, 2021-10-20T23:13:45.507 INFO:teuthology.task.ansible.out:"item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eed 2021-10-20T23:13:45.509 INFO:teuthology.task.ansible.out:d14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.519 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.520 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.521 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.522 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin 2021-10-20T23:13:45.524 INFO:teuthology.task.ansible.out:@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f 2021-10-20T23:13:45.526 INFO:teuthology.task.ansible.out:4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.536 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.538 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.540 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.542 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.543 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.544 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.545 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.545 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.546 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansib 2021-10-20T23:13:45.547 INFO:teuthology.task.ansible.out:le_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.547 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "chang 2021-10-20T23:13:45.551 INFO:teuthology.task.ansible.out:ed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.561 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.563 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.565 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.567 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.578 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.580 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9e 2021-10-20T23:13:45.582 INFO:teuthology.task.ansible.out:Wc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.592 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.594 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.596 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.596 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.598 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.609 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.610 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.630 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.636 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfrit 2021-10-20T23:13:45.639 INFO:teuthology.task.ansible.out:ch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsu 2021-10-20T23:13:45.641 INFO:teuthology.task.ansible.out:selaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.661 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:45 +0000 (0:00:01.075) 0:00:55.735 ***** 2021-10-20T23:13:45.668 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.672 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.682 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.684 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.685 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.685 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ka 2021-10-20T23:13:45.687 INFO:teuthology.task.ansible.out:chau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.687 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.688 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.688 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name' 2021-10-20T23:13:45.690 INFO:teuthology.task.ansible.out:: 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5 2021-10-20T23:13:45.691 INFO:teuthology.task.ansible.out:977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.691 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1 2021-10-20T23:13:45.693 INFO:teuthology.task.ansible.out:a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.703 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.705 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.717 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.718 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.719 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.742 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.744 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgV 2021-10-20T23:13:45.748 INFO:teuthology.task.ansible.out:neOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af1 2021-10-20T23:13:45.749 INFO:teuthology.task.ansible.out:16b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.758 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.760 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.771 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.773 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.774 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83 2021-10-20T23:13:45.776 INFO:teuthology.task.ansible.out:f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.776 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.777 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab233 2021-10-20T23:13:45.778 INFO:teuthology.task.ansible.out:2041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.805 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:45 +0000 (0:00:00.144) 0:00:55.879 ***** 2021-10-20T23:13:45.822 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.867 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": fals 2021-10-20T23:13:45.885 INFO:teuthology.task.ansible.out:e, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pr 2021-10-20T23:13:45.903 INFO:teuthology.task.ansible.out:ashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.930 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:45 +0000 (0:00:00.124) 0:00:56.004 ***** 2021-10-20T23:13:45.944 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.946 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.948 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.950 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.950 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.950 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-10-20T23:13:45.953 INFO:teuthology.task.ansible.out: "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.964 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.965 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.967 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflo 2021-10-20T23:13:45.968 INFO:teuthology.task.ansible.out:res", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.982 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.996 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:45.998 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.009 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.011 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.034 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:46 +0000 (0:00:00.104) 0:00:56.108 ***** 2021-10-20T23:13:46.041 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.043 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.043 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.055 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.056 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.057 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.057 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.058 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.058 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f 2021-10-20T23:13:46.060 INFO:teuthology.task.ansible.out:36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.075 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.077 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.097 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.099 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi119.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-20T23:13:46.099 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.102 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.102 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.129 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:46 +0000 (0:00:00.095) 0:00:56.203 ***** 2021-10-20T23:13:46.138 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.141 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.152 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.164 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.176 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.177 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.188 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.201 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.227 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:46 +0000 (0:00:00.097) 0:00:56.301 ***** 2021-10-20T23:13:46.241 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi119.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7 2021-10-20T23:13:46.248 INFO:teuthology.task.ansible.out:vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.255 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.257 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.267 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi031.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-20T23:13:46.279 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.331 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:46 +0000 (0:00:00.103) 0:00:56.405 ***** 2021-10-20T23:13:46.360 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-10-20T23:13:46.362 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-20T23:13:46.406 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:46.408 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi031.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-20T23:13:46.431 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:46 +0000 (0:00:00.100) 0:00:56.506 ***** 2021-10-20T23:13:46.462 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-20T23:13:46.495 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-20T23:13:46.550 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-20T23:13:46.606 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-20T23:13:46.641 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-20T23:13:46.663 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-20T23:13:46.685 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-20T23:13:46.750 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-20T23:13:46.772 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-20T23:13:46.794 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-20T23:13:46.838 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-20T23:13:46.884 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-20T23:13:46.917 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-20T23:13:46.939 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-20T23:13:46.981 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-20T23:13:47.035 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-20T23:13:47.057 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-20T23:13:47.079 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-20T23:13:47.124 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-20T23:13:47.178 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-20T23:13:47.200 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-20T23:13:47.216 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-20T23:13:47.257 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-20T23:13:47.313 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-20T23:13:47.335 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-20T23:13:47.346 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-20T23:13:47.392 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-20T23:13:47.446 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-20T23:13:47.468 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-20T23:13:47.481 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-20T23:13:47.534 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-20T23:13:47.536 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:47.589 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-20T23:13:47.619 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-20T23:13:47.619 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-20T23:13:47.673 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-20T23:13:47.716 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-20T23:13:47.750 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-20T23:13:47.765 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-20T23:13:47.814 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-20T23:13:47.857 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-20T23:13:47.889 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-20T23:13:47.891 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-20T23:13:47.955 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-20T23:13:47.989 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-20T23:13:48.020 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-20T23:13:48.032 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-20T23:13:48.086 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-20T23:13:48.130 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-20T23:13:48.153 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-20T23:13:48.164 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-20T23:13:48.240 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-20T23:13:48.272 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-20T23:13:48.294 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-20T23:13:48.307 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-20T23:13:48.371 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-20T23:13:48.406 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-20T23:13:48.440 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-20T23:13:48.446 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-20T23:13:48.515 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-20T23:13:48.549 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-20T23:13:48.571 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-20T23:13:48.583 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-20T23:13:48.659 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-20T23:13:48.691 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-20T23:13:48.713 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-20T23:13:48.725 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-20T23:13:48.802 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-20T23:13:48.824 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-20T23:13:48.862 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-20T23:13:48.874 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-20T23:13:48.934 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-20T23:13:48.968 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-20T23:13:49.001 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-20T23:13:49.002 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-20T23:13:49.066 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-20T23:13:49.098 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-20T23:13:49.131 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-20T23:13:49.143 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-20T23:13:49.198 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-20T23:13:49.232 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-20T23:13:49.266 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-20T23:13:49.289 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-20T23:13:49.348 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-20T23:13:49.372 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-20T23:13:49.410 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-20T23:13:49.434 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-20T23:13:49.484 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-20T23:13:49.518 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-20T23:13:49.550 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-20T23:13:49.551 INFO:teuthology.task.ansible.out: 2021-10-20T23:13:49.575 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-20T23:13:49.618 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-20T23:13:49.650 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-20T23:13:49.683 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-20T23:13:49.727 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-20T23:13:49.760 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-20T23:13:49.793 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-20T23:13:49.839 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-20T23:13:49.862 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-20T23:13:49.897 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-20T23:13:49.930 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-20T23:13:49.962 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-20T23:13:49.995 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-20T23:13:50.039 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-20T23:13:50.074 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-20T23:13:50.108 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-20T23:13:50.141 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-20T23:13:50.176 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-20T23:13:50.209 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-20T23:13:50.252 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-20T23:13:50.274 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-20T23:13:50.318 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-20T23:13:50.366 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-20T23:13:50.390 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-20T23:13:50.427 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-20T23:13:50.448 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-20T23:13:50.490 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-20T23:13:50.523 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-20T23:13:50.558 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-20T23:13:50.590 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-20T23:13:50.635 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-20T23:13:50.657 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-20T23:13:50.702 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-20T23:13:50.747 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-20T23:13:50.779 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-20T23:13:50.791 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-20T23:13:50.845 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-20T23:13:50.877 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-20T23:13:50.921 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-20T23:13:50.923 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-20T23:13:50.979 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-20T23:13:51.020 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-20T23:13:51.054 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-20T23:13:51.065 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-20T23:13:51.119 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-20T23:13:51.165 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-20T23:13:51.198 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} ok: [smithi119.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-20T23:13:51.251 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-20T23:13:51.294 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-20T23:13:51.327 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-20T23:13:51.329 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-20T23:13:51.385 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-20T23:13:51.428 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-20T23:13:51.461 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-10-20T23:13:51.473 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-20T23:13:51.527 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-20T23:13:51.570 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-20T23:13:51.603 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-10-20T23:13:51.614 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-20T23:13:51.659 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-20T23:13:51.693 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-10-20T23:13:51.747 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-20T23:13:51.749 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-10-20T23:13:51.804 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-20T23:13:51.838 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-10-20T23:13:51.879 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-10-20T23:13:51.892 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-10-20T23:13:51.947 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-20T23:13:51.980 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-10-20T23:13:52.023 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-10-20T23:13:52.025 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-10-20T23:13:52.079 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-10-20T23:13:52.113 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-10-20T23:13:52.157 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-10-20T23:13:52.158 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-10-20T23:13:52.223 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-10-20T23:13:52.267 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-10-20T23:13:52.299 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-10-20T23:13:52.313 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-20T23:13:52.366 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-10-20T23:13:52.411 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-10-20T23:13:52.433 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-10-20T23:13:52.444 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-20T23:13:52.498 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-10-20T23:13:52.542 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-20T23:13:52.575 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-10-20T23:13:52.586 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-20T23:13:52.640 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-10-20T23:13:52.684 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-20T23:13:52.706 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-20T23:13:52.718 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-20T23:13:52.771 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-10-20T23:13:52.824 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-20T23:13:52.847 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-20T23:13:52.867 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-20T23:13:52.922 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-20T23:13:52.966 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-20T23:13:52.989 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-20T23:13:53.010 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-20T23:13:53.054 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-20T23:13:53.099 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-20T23:13:53.120 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-20T23:13:53.142 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-20T23:13:53.208 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-20T23:13:53.241 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-20T23:13:53.253 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-20T23:13:53.276 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-20T23:13:53.342 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-20T23:13:53.377 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-20T23:13:53.399 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-20T23:13:53.411 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-20T23:13:53.475 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-20T23:13:53.508 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-20T23:13:53.541 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-20T23:13:53.553 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-20T23:13:53.601 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:53 +0000 (0:00:07.168) 0:01:03.674 ***** 2021-10-20T23:13:53.622 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-20T23:13:53.656 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-20T23:13:53.678 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-20T23:13:53.759 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-20T23:13:53.794 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-20T23:13:53.818 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-20T23:13:53.844 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:53 +0000 (0:00:00.243) 0:01:03.918 ***** 2021-10-20T23:13:53.889 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-20T23:13:53.966 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-20T23:13:54.016 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.172) 0:01:04.090 ***** 2021-10-20T23:13:54.027 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-20T23:13:54.160 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-20T23:13:54.213 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.197) 0:01:04.287 ***** 2021-10-20T23:13:54.326 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "checksum": "3c24666d5ec7240db227d39660f0222d26fcd89b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bf918fdf05a6a97e741e5654f2d06e66", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1634771633.9318147-15750-50256538862865/source", "state": "file", "uid": 0} 2021-10-20T23:13:54.352 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.138) 0:01:04.426 ***** 2021-10-20T23:13:54.359 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "checksum": "3c24666d5ec7240db227d39660f0222d26fcd89b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bf918fdf05a6a97e741e5654f2d06e66", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1634771633.68783-15710-168000483186792/source", "state": "file", "uid": 0} 2021-10-20T23:13:54.385 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.032) 0:01:04.459 ***** 2021-10-20T23:13:54.413 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-10-20T23:13:54.415 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => { "msg": "Host smithi031.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-10-20T23:13:54.440 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.054) 0:01:04.514 ***** 2021-10-20T23:13:54.458 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => { "msg": "Host smithi119.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-10-20T23:13:54.484 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.044) 0:01:04.558 ***** 2021-10-20T23:13:54.502 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-10-20T23:13:54.503 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "checksum": "3c24666d5ec7240db227d39660f0222d26fcd89b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bf918fdf05a6a97e741e5654f2d06e66", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1634771634.102585-15769-46966261167016/source", "state": "file", "uid": 0} 2021-10-20T23:13:54.529 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.044) 0:01:04.603 ***** 2021-10-20T23:13:54.536 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-10-20T23:13:54.564 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.034) 0:01:04.638 ***** 2021-10-20T23:13:54.582 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-10-20T23:13:54.609 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.045) 0:01:04.683 ***** 2021-10-20T23:13:54.615 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-10-20T23:13:54.617 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => { "msg": "Host smithi012.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-10-20T23:13:54.642 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.032) 0:01:04.716 ***** 2021-10-20T23:13:54.649 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-10-20T23:13:54.650 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:54.675 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.033) 0:01:04.749 ***** 2021-10-20T23:13:54.682 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-10-20T23:13:54.684 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "checksum": "3c24666d5ec7240db227d39660f0222d26fcd89b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bf918fdf05a6a97e741e5654f2d06e66", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1634771634.2981102-15804-226231096773415/source", "state": "file", "uid": 0} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:54.709 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.034) 0:01:04.784 ***** 2021-10-20T23:13:54.740 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.030) 0:01:04.814 ***** 2021-10-20T23:13:54.749 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-10-20T23:13:54.750 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-10-20T23:13:54.751 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:54.777 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.036) 0:01:04.851 ***** 2021-10-20T23:13:54.800 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.023) 0:01:04.874 ***** 2021-10-20T23:13:54.809 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:54.810 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi136.front.sepia.ceph.com] => { "msg": "Host smithi136.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-10-20T23:13:54.838 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.036) 0:01:04.911 ***** 2021-10-20T23:13:54.861 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.024) 0:01:04.935 ***** 2021-10-20T23:13:54.869 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-10-20T23:13:54.871 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:54.898 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.036) 0:01:04.972 ***** 2021-10-20T23:13:54.924 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.026) 0:01:04.998 ***** 2021-10-20T23:13:54.935 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:54.966 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:54 +0000 (0:00:00.041) 0:01:05.040 ***** 2021-10-20T23:13:54.973 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-10-20T23:13:54.976 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.005 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.038) 0:01:05.079 ***** 2021-10-20T23:13:55.026 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.021) 0:01:05.100 ***** 2021-10-20T23:13:55.033 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-10-20T23:13:55.035 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.060 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.033) 0:01:05.134 ***** 2021-10-20T23:13:55.082 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.022) 0:01:05.156 ***** 2021-10-20T23:13:55.094 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-10-20T23:13:55.096 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.140 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.056) 0:01:05.213 ***** 2021-10-20T23:13:55.152 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-10-20T23:13:55.154 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.183 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.042) 0:01:05.256 ***** 2021-10-20T23:13:55.211 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.029) 0:01:05.285 ***** 2021-10-20T23:13:55.222 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.257 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.044) 0:01:05.329 ***** 2021-10-20T23:13:55.279 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.023) 0:01:05.353 ***** 2021-10-20T23:13:55.286 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-10-20T23:13:55.289 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.315 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.034) 0:01:05.388 ***** 2021-10-20T23:13:55.345 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.030) 0:01:05.419 ***** 2021-10-20T23:13:55.352 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-10-20T23:13:55.354 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.381 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.036) 0:01:05.456 ***** 2021-10-20T23:13:55.404 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.022) 0:01:05.478 ***** 2021-10-20T23:13:55.414 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.441 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.036) 0:01:05.515 ***** 2021-10-20T23:13:55.464 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.023) 0:01:05.538 ***** 2021-10-20T23:13:55.472 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.474 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.501 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.036) 0:01:05.575 ***** 2021-10-20T23:13:55.534 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.031) 0:01:05.606 ***** 2021-10-20T23:13:55.541 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-10-20T23:13:55.542 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.543 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.579 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.047) 0:01:05.654 ***** 2021-10-20T23:13:55.614 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.034) 0:01:05.688 ***** 2021-10-20T23:13:55.622 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-10-20T23:13:55.623 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.651 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.037) 0:01:05.725 ***** 2021-10-20T23:13:55.676 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.025) 0:01:05.750 ***** 2021-10-20T23:13:55.686 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-20T23:13:55.689 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.715 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.038) 0:01:05.789 ***** 2021-10-20T23:13:55.739 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.023) 0:01:05.813 ***** 2021-10-20T23:13:55.747 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-10-20T23:13:55.748 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.774 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.034) 0:01:05.848 ***** 2021-10-20T23:13:55.782 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-20T23:13:55.784 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi119.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.811 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.036) 0:01:05.884 ***** 2021-10-20T23:13:55.831 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.021) 0:01:05.905 ***** 2021-10-20T23:13:55.841 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.867 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.035) 0:01:05.941 ***** 2021-10-20T23:13:55.874 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-20T23:13:55.876 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi012.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:55.901 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.033) 0:01:05.975 ***** 2021-10-20T23:13:55.908 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-10-20T23:13:55.909 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** 2021-10-20T23:13:55.910 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.941 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.040) 0:01:06.015 ***** 2021-10-20T23:13:55.964 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.022) 0:01:06.038 ***** 2021-10-20T23:13:55.972 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:55.974 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-10-20T23:13:55.974 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.001 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:55 +0000 (0:00:00.036) 0:01:06.075 ***** 2021-10-20T23:13:56.027 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.026) 0:01:06.101 ***** 2021-10-20T23:13:56.036 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.065 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.037) 0:01:06.139 ***** 2021-10-20T23:13:56.091 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.024) 0:01:06.164 ***** 2021-10-20T23:13:56.099 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.126 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.035) 0:01:06.200 ***** 2021-10-20T23:13:56.135 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.162 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.035) 0:01:06.235 ***** 2021-10-20T23:13:56.168 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:56.169 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.204 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.042) 0:01:06.278 ***** 2021-10-20T23:13:56.240 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.033) 0:01:06.311 ***** 2021-10-20T23:13:56.247 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.275 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.037) 0:01:06.349 ***** 2021-10-20T23:13:56.285 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-20T23:13:56.287 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.312 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.037) 0:01:06.386 ***** 2021-10-20T23:13:56.351 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.033) 0:01:06.419 ***** 2021-10-20T23:13:56.354 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-10-20T23:13:56.355 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:56.381 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.035) 0:01:06.455 ***** 2021-10-20T23:13:56.392 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:56.426 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.044) 0:01:06.500 ***** 2021-10-20T23:13:56.441 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.478 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.041) 0:01:06.541 ***** 2021-10-20T23:13:56.490 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.023) 0:01:06.564 ***** 2021-10-20T23:13:56.498 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-10-20T23:13:56.500 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.527 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.036) 0:01:06.601 ***** 2021-10-20T23:13:56.534 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.564 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.036) 0:01:06.638 ***** 2021-10-20T23:13:56.572 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-10-20T23:13:56.574 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.599 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.035) 0:01:06.673 ***** 2021-10-20T23:13:56.625 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.025) 0:01:06.699 ***** 2021-10-20T23:13:56.634 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi119.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:56.671 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.046) 0:01:06.745 ***** 2021-10-20T23:13:56.680 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:56.722 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.051) 0:01:06.796 ***** 2021-10-20T23:13:56.738 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.787 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.064) 0:01:06.861 ***** 2021-10-20T23:13:56.799 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-10-20T23:13:56.802 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.838 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.051) 0:01:06.912 ***** 2021-10-20T23:13:56.858 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.896 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.052) 0:01:06.965 ***** 2021-10-20T23:13:56.917 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.025) 0:01:06.991 ***** 2021-10-20T23:13:56.931 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : List CDN releases available to system] ************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:56.956 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.038) 0:01:07.029 ***** 2021-10-20T23:13:56.984 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:56 +0000 (0:00:00.025) 0:01:07.055 ***** 2021-10-20T23:13:56.990 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.019 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.036) 0:01:07.091 ***** 2021-10-20T23:13:57.025 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-10-20T23:13:57.027 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.054 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.036) 0:01:07.128 ***** 2021-10-20T23:13:57.061 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.063 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.095 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.036) 0:01:07.165 ***** 2021-10-20T23:13:57.120 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.025) 0:01:07.190 ***** 2021-10-20T23:13:57.124 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-10-20T23:13:57.126 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.156 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.040) 0:01:07.230 ***** 2021-10-20T23:13:57.165 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-10-20T23:13:57.166 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.220 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.058) 0:01:07.289 ***** 2021-10-20T23:13:57.336 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.360 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.145) 0:01:07.434 ***** 2021-10-20T23:13:57.367 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-10-20T23:13:57.369 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:57.400 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.040) 0:01:07.474 ***** 2021-10-20T23:13:57.411 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.577 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.176) 0:01:07.651 ***** 2021-10-20T23:13:57.589 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-10-20T23:13:57.591 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:57.615 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.038) 0:01:07.690 ***** 2021-10-20T23:13:57.624 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:57.627 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.651 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.034) 0:01:07.724 ***** 2021-10-20T23:13:57.673 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.023) 0:01:07.748 ***** 2021-10-20T23:13:57.680 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-10-20T23:13:57.682 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:57.709 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.035) 0:01:07.783 ***** 2021-10-20T23:13:57.726 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.747 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.037) 0:01:07.821 ***** 2021-10-20T23:13:57.772 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.022) 0:01:07.843 ***** 2021-10-20T23:13:57.788 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.815 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.045) 0:01:07.889 ***** 2021-10-20T23:13:57.823 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.851 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.036) 0:01:07.925 ***** 2021-10-20T23:13:57.858 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-10-20T23:13:57.861 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.886 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.034) 0:01:07.960 ***** 2021-10-20T23:13:57.909 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.023) 0:01:07.983 ***** 2021-10-20T23:13:57.916 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-10-20T23:13:57.918 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.946 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.036) 0:01:08.019 ***** 2021-10-20T23:13:57.955 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.958 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:57.988 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:57 +0000 (0:00:00.043) 0:01:08.063 ***** 2021-10-20T23:13:58.013 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.024) 0:01:08.087 ***** 2021-10-20T23:13:58.022 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.024 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.050 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.037) 0:01:08.125 ***** 2021-10-20T23:13:58.078 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.027) 0:01:08.152 ***** 2021-10-20T23:13:58.085 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-10-20T23:13:58.087 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.121 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.039) 0:01:08.192 ***** 2021-10-20T23:13:58.143 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.024) 0:01:08.217 ***** 2021-10-20T23:13:58.162 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.180 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.037) 0:01:08.254 ***** 2021-10-20T23:13:58.187 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-10-20T23:13:58.189 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:58.218 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.037) 0:01:08.292 ***** 2021-10-20T23:13:58.225 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-10-20T23:13:58.227 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.262 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.036) 0:01:08.328 ***** 2021-10-20T23:13:58.278 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.021) 0:01:08.350 ***** 2021-10-20T23:13:58.284 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.312 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.033) 0:01:08.384 ***** 2021-10-20T23:13:58.317 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-20T23:13:58.318 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.344 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.033) 0:01:08.418 ***** 2021-10-20T23:13:58.351 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-10-20T23:13:58.353 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.384 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.040) 0:01:08.458 ***** 2021-10-20T23:13:58.407 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.022) 0:01:08.481 ***** 2021-10-20T23:13:58.415 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.416 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-10-20T23:13:58.416 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.442 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.035) 0:01:08.517 ***** 2021-10-20T23:13:58.467 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.024) 0:01:08.541 ***** 2021-10-20T23:13:58.473 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-10-20T23:13:58.475 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.502 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.035) 0:01:08.576 ***** 2021-10-20T23:13:58.510 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-10-20T23:13:58.512 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi119.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:58.538 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.034) 0:01:08.611 ***** 2021-10-20T23:13:58.560 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.022) 0:01:08.634 ***** 2021-10-20T23:13:58.567 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-10-20T23:13:58.569 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi012.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:58.598 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.037) 0:01:08.672 ***** 2021-10-20T23:13:58.625 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.027) 0:01:08.699 ***** 2021-10-20T23:13:58.633 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-10-20T23:13:58.635 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.635 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.666 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.040) 0:01:08.740 ***** 2021-10-20T23:13:58.690 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.024) 0:01:08.764 ***** 2021-10-20T23:13:58.712 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.740 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.048) 0:01:08.813 ***** 2021-10-20T23:13:58.749 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.791 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.047) 0:01:08.861 ***** 2021-10-20T23:13:58.810 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.023) 0:01:08.885 ***** 2021-10-20T23:13:58.819 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.846 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.036) 0:01:08.921 ***** 2021-10-20T23:13:58.856 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.894 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.047) 0:01:08.968 ***** 2021-10-20T23:13:58.908 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-10-20T23:13:58.910 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:58.956 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.062) 0:01:09.030 ***** 2021-10-20T23:13:58.990 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:58 +0000 (0:00:00.030) 0:01:09.061 ***** 2021-10-20T23:13:58.998 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.044 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.057) 0:01:09.118 ***** 2021-10-20T23:13:59.081 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.028) 0:01:09.147 ***** 2021-10-20T23:13:59.082 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.084 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.114 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.041) 0:01:09.188 ***** 2021-10-20T23:13:59.140 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.025) 0:01:09.214 ***** 2021-10-20T23:13:59.151 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.177 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.037) 0:01:09.251 ***** 2021-10-20T23:13:59.186 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.187 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.215 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.038) 0:01:09.289 ***** 2021-10-20T23:13:59.222 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-10-20T23:13:59.224 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.225 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:13:59.259 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.043) 0:01:09.333 ***** 2021-10-20T23:13:59.289 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.030) 0:01:09.363 ***** 2021-10-20T23:13:59.312 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-10-20T23:13:59.314 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.314 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.342 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.052) 0:01:09.416 ***** 2021-10-20T23:13:59.373 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.030) 0:01:09.447 ***** 2021-10-20T23:13:59.385 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.421 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.048) 0:01:09.495 ***** 2021-10-20T23:13:59.453 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.031) 0:01:09.527 ***** 2021-10-20T23:13:59.460 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-20T23:13:59.462 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.490 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.036) 0:01:09.563 ***** 2021-10-20T23:13:59.516 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.026) 0:01:09.590 ***** 2021-10-20T23:13:59.536 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-20T23:13:59.537 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.563 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.047) 0:01:09.637 ***** 2021-10-20T23:13:59.628 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:13:59.630 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010347", "end": "2021-10-20 23:13:59.786963", "rc": 0, "start": "2021-10-20 23:13:59.776616", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-20T23:13:59.655 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.091) 0:01:09.729 ***** 2021-10-20T23:13:59.663 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-10-20T23:13:59.664 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.693 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.038) 0:01:09.767 ***** 2021-10-20T23:13:59.709 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012865", "end": "2021-10-20 23:13:59.392273", "rc": 0, "start": "2021-10-20 23:13:59.379408", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-20T23:13:59.736 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.043) 0:01:09.810 ***** 2021-10-20T23:13:59.756 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.765 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.029501", "end": "2021-10-20 23:13:59.975009", "rc": 0, "start": "2021-10-20 23:13:59.945508", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-20T23:13:59.806 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.069) 0:01:09.880 ***** 2021-10-20T23:13:59.834 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.027) 0:01:09.907 ***** 2021-10-20T23:13:59.843 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-10-20T23:13:59.845 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.846 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.873 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.039) 0:01:09.947 ***** 2021-10-20T23:13:59.900 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.025) 0:01:09.973 ***** 2021-10-20T23:13:59.908 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.910 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:13:59.944 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.039) 0:01:10.012 ***** 2021-10-20T23:13:59.968 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:13:59 +0000 (0:00:00.029) 0:01:10.041 ***** 2021-10-20T23:13:59.978 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:00.009 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:00 +0000 (0:00:00.042) 0:01:10.084 ***** 2021-10-20T23:14:00.021 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi136.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:00.053 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:00 +0000 (0:00:00.037) 0:01:10.121 ***** 2021-10-20T23:14:00.067 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:00.092 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:00 +0000 (0:00:00.044) 0:01:10.166 ***** 2021-10-20T23:14:00.166 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-20T23:14:00.168 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:00.198 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:00 +0000 (0:00:00.105) 0:01:10.271 ***** 2021-10-20T23:14:00.427 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015939", "end": "2021-10-20 23:14:00.371306", "rc": 0, "start": "2021-10-20 23:14:00.355367", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-20T23:14:00.455 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:00 +0000 (0:00:00.257) 0:01:10.528 ***** 2021-10-20T23:14:00.534 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:00.564 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:00 +0000 (0:00:00.109) 0:01:10.638 ***** 2021-10-20T23:14:00.575 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:14:00.577 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} ok: [smithi031.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "Can 2021-10-20T23:14:00.578 INFO:teuthology.task.ansible.out:Reload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} ok: [smithi012.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAct 2021-10-20T23:14:00.580 INFO:teuthology.task.ansible.out:ion": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} 2021-10-20T23:14:00.644 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:00.670 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:00 +0000 (0:00:00.106) 0:01:10.745 ***** 2021-10-20T23:14:00.749 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [smithi012.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:00.765 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:00.770 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:00.939 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:00.941 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:00.953 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:01.019 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-10-20T23:14:01.112 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:01.137 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.467) 0:01:11.212 ***** 2021-10-20T23:14:01.146 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:01.156 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:01.200 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.061) 0:01:11.273 ***** 2021-10-20T23:14:01.236 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.029) 0:01:11.303 ***** 2021-10-20T23:14:01.243 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:01.244 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:14:01.245 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.286 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.054) 0:01:11.358 ***** 2021-10-20T23:14:01.305 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.332 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.046) 0:01:11.405 ***** 2021-10-20T23:14:01.356 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.024) 0:01:11.430 ***** 2021-10-20T23:14:01.375 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.402 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.046) 0:01:11.476 ***** 2021-10-20T23:14:01.405 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:01.415 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [smithi136.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:01.425 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-10-20T23:14:01.427 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.461 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.059) 0:01:11.535 ***** 2021-10-20T23:14:01.474 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.498 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.036) 0:01:11.572 ***** 2021-10-20T23:14:01.507 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-10-20T23:14:01.509 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.537 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.038) 0:01:11.611 ***** 2021-10-20T23:14:01.544 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.575 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.038) 0:01:11.649 ***** 2021-10-20T23:14:01.584 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:14:01.585 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:14:01.589 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.618 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.042) 0:01:11.691 ***** 2021-10-20T23:14:01.645 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.026) 0:01:11.718 ***** 2021-10-20T23:14:01.652 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-10-20T23:14:01.654 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.686 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.041) 0:01:11.760 ***** 2021-10-20T23:14:01.715 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.028) 0:01:11.789 ***** 2021-10-20T23:14:01.724 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.762 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.047) 0:01:11.836 ***** 2021-10-20T23:14:01.770 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:14:01.772 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Refresh repos] ************************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.799 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.037) 0:01:11.873 ***** 2021-10-20T23:14:01.822 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.023) 0:01:11.897 ***** 2021-10-20T23:14:01.830 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.864 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.041) 0:01:11.938 ***** 2021-10-20T23:14:01.872 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.900 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.036) 0:01:11.974 ***** 2021-10-20T23:14:01.908 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-10-20T23:14:01.909 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:01.936 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:01 +0000 (0:00:00.036) 0:01:12.010 ***** 2021-10-20T23:14:01.938 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:02.009 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:02.034 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.097) 0:01:12.108 ***** 2021-10-20T23:14:02.103 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-10-20T23:14:02.105 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:02.135 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.100) 0:01:12.209 ***** 2021-10-20T23:14:02.221 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:02.246 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.110) 0:01:12.319 ***** 2021-10-20T23:14:02.273 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-10-20T23:14:02.274 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.228428", "end": "2021-10-20 23:14:02.500501", "rc": 0, "start": "2021-10-20 23:14:02.272073", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:02.301 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.055) 0:01:12.375 ***** 2021-10-20T23:14:02.342 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.335381", "end": "2021-10-20 23:14:02.500379", "rc": 0, "start": "2021-10-20 23:14:02.164998", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:02.368 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.067) 0:01:12.443 ***** 2021-10-20T23:14:02.370 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:02.390 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-10-20T23:14:02.393 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:02.420 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.051) 0:01:12.494 ***** 2021-10-20T23:14:02.439 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:02.467 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.046) 0:01:12.541 ***** 2021-10-20T23:14:02.566 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-10-20T23:14:02.568 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.175362", "end": "2021-10-20 23:14:02.500429", "rc": 0, "start": "2021-10-20 23:14:02.325067", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:02.604 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.136) 0:01:12.678 ***** 2021-10-20T23:14:02.674 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:02.699 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.094) 0:01:12.773 ***** 2021-10-20T23:14:02.727 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-10-20T23:14:02.729 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.120020", "end": "2021-10-20 23:14:02.959601", "rc": 0, "start": "2021-10-20 23:14:02.839581", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:02.757 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.058) 0:01:12.832 ***** 2021-10-20T23:14:02.789 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.114772", "end": "2021-10-20 23:14:02.940746", "rc": 0, "start": "2021-10-20 23:14:02.825974", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:02.818 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.057) 0:01:12.889 ***** 2021-10-20T23:14:02.826 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-10-20T23:14:02.828 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.864112", "end": "2021-10-20 23:14:02.507897", "rc": 0, "start": "2021-10-20 23:14:01.643785", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:02.867 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.045) 0:01:12.935 ***** 2021-10-20T23:14:02.955 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-10-20T23:14:02.957 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:02.999 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:02 +0000 (0:00:00.120) 0:01:13.056 ***** 2021-10-20T23:14:03.041 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.126340", "end": "2021-10-20 23:14:02.956817", "rc": 0, "start": "2021-10-20 23:14:02.830477", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:03.076 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:03 +0000 (0:00:00.092) 0:01:13.149 ***** 2021-10-20T23:14:03.347 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.130580", "end": "2021-10-20 23:14:03.040118", "rc": 0, "start": "2021-10-20 23:14:02.909538", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:03.374 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:03 +0000 (0:00:00.299) 0:01:13.448 ***** 2021-10-20T23:14:06.724 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-10-20T23:14:06.726 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:14:06.760 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:06 +0000 (0:00:03.385) 0:01:16.834 ***** 2021-10-20T23:14:06.844 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:14:06.869 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:06 +0000 (0:00:00.109) 0:01:16.943 ***** 2021-10-20T23:14:06.894 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:14:06.921 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:06 +0000 (0:00:00.051) 0:01:16.995 ***** 2021-10-20T23:14:07.121 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:14:07.148 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:07 +0000 (0:00:00.226) 0:01:17.221 ***** 2021-10-20T23:14:07.502 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-20T23:14:07.504 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:14:07.528 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:07 +0000 (0:00:00.380) 0:01:17.602 ***** 2021-10-20T23:14:07.630 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-10-20T23:14:07.632 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:07.654 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:07 +0000 (0:00:00.125) 0:01:17.728 ***** 2021-10-20T23:14:07.673 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:14:07.699 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:07 +0000 (0:00:00.044) 0:01:17.773 ***** 2021-10-20T23:14:07.706 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:14:07.737 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:07 +0000 (0:00:00.037) 0:01:17.811 ***** 2021-10-20T23:14:07.738 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:07.768 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:07.794 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:07 +0000 (0:00:00.057) 0:01:17.868 ***** 2021-10-20T23:14:07.812 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:07.838 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:07 +0000 (0:00:00.043) 0:01:17.912 ***** 2021-10-20T23:14:07.897 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-20T23:14:07.899 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:14:07.925 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:07 +0000 (0:00:00.086) 0:01:17.999 ***** 2021-10-20T23:14:08.001 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:08.028 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:08 +0000 (0:00:00.103) 0:01:18.103 ***** 2021-10-20T23:14:08.048 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-10-20T23:14:08.050 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-10-20T23:14:08.077 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:08 +0000 (0:00:00.048) 0:01:18.151 ***** 2021-10-20T23:14:08.211 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-10-20T23:14:08.237 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:08 +0000 (0:00:00.159) 0:01:18.311 ***** 2021-10-20T23:14:08.265 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-10-20T23:14:08.292 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:08 +0000 (0:00:00.055) 0:01:18.366 ***** 2021-10-20T23:14:08.454 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-10-20T23:14:08.480 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:08 +0000 (0:00:00.187) 0:01:18.554 ***** 2021-10-20T23:14:08.811 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:14:08.834 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:08 +0000 (0:00:00.354) 0:01:18.908 ***** 2021-10-20T23:14:08.982 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:14:09.009 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:09 +0000 (0:00:00.172) 0:01:19.081 ***** 2021-10-20T23:14:09.035 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:14:09.064 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:09 +0000 (0:00:00.057) 0:01:19.138 ***** 2021-10-20T23:14:09.246 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:14:09.272 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:09 +0000 (0:00:00.208) 0:01:19.346 ***** 2021-10-20T23:14:09.280 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-20T23:14:09.282 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-10-20T23:14:09.429 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-10-20T23:14:09.491 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-10-20T23:14:09.599 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-10-20T23:14:09.714 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-10-20T23:14:09.763 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-10-20T23:14:09.835 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-10-20T23:14:09.924 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-10-20T23:14:09.951 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:09 +0000 (0:00:00.679) 0:01:20.026 ***** 2021-10-20T23:14:10.086 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-10-20T23:14:10.123 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:10 +0000 (0:00:00.170) 0:01:20.196 ***** 2021-10-20T23:14:10.130 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-10-20T23:14:10.134 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-20T23:14:10.136 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:14:10.173 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:10 +0000 (0:00:00.048) 0:01:20.245 ***** 2021-10-20T23:14:10.180 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-20T23:14:10.187 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-10-20T23:14:10.213 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:10 +0000 (0:00:00.042) 0:01:20.287 ***** 2021-10-20T23:14:10.263 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-20T23:14:10.265 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:14:10.295 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:10 +0000 (0:00:00.082) 0:01:20.369 ***** 2021-10-20T23:14:10.358 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:14:10.385 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:10 +0000 (0:00:00.088) 0:01:20.458 ***** 2021-10-20T23:14:10.416 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-20T23:14:10.419 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-10-20T23:14:10.450 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:10 +0000 (0:00:00.065) 0:01:20.524 ***** 2021-10-20T23:14:10.573 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:14:10.574 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-10-20T23:14:10.576 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:10.608 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-20T23:14:10.610 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:14:10.632 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:10 +0000 (0:00:00.181) 0:01:20.706 ***** 2021-10-20T23:14:10.707 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi136.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-10-20T23:14:10.788 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-10-20T23:14:10.870 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-10-20T23:14:11.012 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-10-20T23:14:11.051 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-10-20T23:14:11.138 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-10-20T23:14:11.251 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-10-20T23:14:11.260 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.625) 0:01:21.332 ***** 2021-10-20T23:14:11.354 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:14:11.393 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.128) 0:01:21.460 ***** 2021-10-20T23:14:11.408 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:14:11.410 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-10-20T23:14:11.424 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-10-20T23:14:11.462 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.070) 0:01:21.531 ***** 2021-10-20T23:14:11.481 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:11.518 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.056) 0:01:21.587 ***** 2021-10-20T23:14:11.523 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi031.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-10-20T23:14:11.554 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.040) 0:01:21.628 ***** 2021-10-20T23:14:11.563 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-20T23:14:11.565 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:14:11.603 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.044) 0:01:21.673 ***** 2021-10-20T23:14:11.606 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-10-20T23:14:11.616 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:14:11.637 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.037) 0:01:21.711 ***** 2021-10-20T23:14:11.643 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:11.647 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-20T23:14:11.647 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:14:11.680 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.041) 0:01:21.753 ***** 2021-10-20T23:14:11.697 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-10-20T23:14:11.698 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:11.732 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.050) 0:01:21.803 ***** 2021-10-20T23:14:11.748 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-20T23:14:11.750 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:11.761 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:11.789 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.059) 0:01:21.863 ***** 2021-10-20T23:14:11.799 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi012.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-10-20T23:14:11.801 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-20T23:14:11.801 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:11.801 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:11.802 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:11.832 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.042) 0:01:21.906 ***** 2021-10-20T23:14:11.857 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.024) 0:01:21.931 ***** 2021-10-20T23:14:11.869 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:14:11.897 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.040) 0:01:21.971 ***** 2021-10-20T23:14:11.926 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.028) 0:01:22.000 ***** 2021-10-20T23:14:11.941 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:14:11.967 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:11 +0000 (0:00:00.040) 0:01:22.041 ***** 2021-10-20T23:14:11.976 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.004 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.037) 0:01:22.078 ***** 2021-10-20T23:14:12.030 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.044 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} TASK [common : Include yum_systems vars] *************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi136.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.072 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.067) 0:01:22.146 ***** 2021-10-20T23:14:12.098 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.025) 0:01:22.172 ***** 2021-10-20T23:14:12.107 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.109 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.138 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.040) 0:01:22.212 ***** 2021-10-20T23:14:12.156 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi012.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:14:12.186 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.045) 0:01:22.258 ***** 2021-10-20T23:14:12.204 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-10-20T23:14:12.205 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.233 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.049) 0:01:22.307 ***** 2021-10-20T23:14:12.243 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.268 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.035) 0:01:22.343 ***** 2021-10-20T23:14:12.287 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-20T23:14:12.289 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.299 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.312 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.349 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.080) 0:01:22.424 ***** 2021-10-20T23:14:12.424 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:12.449 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.099) 0:01:22.523 ***** 2021-10-20T23:14:12.775 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-10-20T23:14:12.778 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:14:12.800 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:12 +0000 (0:00:00.351) 0:01:22.874 ***** 2021-10-20T23:14:13.019 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:14:13.045 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:13 +0000 (0:00:00.244) 0:01:23.119 ***** 2021-10-20T23:14:13.053 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:14:13.081 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:13 +0000 (0:00:00.036) 0:01:23.155 ***** 2021-10-20T23:14:13.211 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:14:13.248 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:13 +0000 (0:00:00.165) 0:01:23.321 ***** 2021-10-20T23:14:13.258 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-10-20T23:14:13.260 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-10-20T23:14:13.290 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:13 +0000 (0:00:00.043) 0:01:23.364 ***** 2021-10-20T23:14:13.507 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-10-20T23:14:13.533 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:13 +0000 (0:00:00.242) 0:01:23.608 ***** 2021-10-20T23:14:13.541 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-10-20T23:14:13.568 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:13 +0000 (0:00:00.035) 0:01:23.643 ***** 2021-10-20T23:14:13.673 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-10-20T23:14:13.675 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:13.707 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:13 +0000 (0:00:00.132) 0:01:23.776 ***** 2021-10-20T23:14:13.767 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-10-20T23:14:13.798 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:13 +0000 (0:00:00.095) 0:01:23.871 ***** 2021-10-20T23:14:13.975 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-10-20T23:14:14.016 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.209) 0:01:24.080 ***** 2021-10-20T23:14:14.032 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-10-20T23:14:14.062 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.055) 0:01:24.136 ***** 2021-10-20T23:14:14.070 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-20T23:14:14.072 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-10-20T23:14:14.166 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-10-20T23:14:14.197 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.135) 0:01:24.271 ***** 2021-10-20T23:14:14.212 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi119.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-10-20T23:14:14.241 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.040) 0:01:24.312 ***** 2021-10-20T23:14:14.246 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-10-20T23:14:14.300 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-10-20T23:14:14.314 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:14.347 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.109) 0:01:24.421 ***** 2021-10-20T23:14:14.375 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-20T23:14:14.377 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-10-20T23:14:14.403 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.055) 0:01:24.477 ***** 2021-10-20T23:14:14.421 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-10-20T23:14:14.423 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-10-20T23:14:14.424 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-10-20T23:14:14.425 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:14:14.453 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.050) 0:01:24.527 ***** 2021-10-20T23:14:14.483 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.027) 0:01:24.555 ***** 2021-10-20T23:14:14.489 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-10-20T23:14:14.491 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:14.517 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.036) 0:01:24.591 ***** 2021-10-20T23:14:14.538 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:14.576 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.058) 0:01:24.650 ***** 2021-10-20T23:14:14.583 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-20T23:14:14.585 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-10-20T23:14:14.586 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:14.618 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.039) 0:01:24.689 ***** 2021-10-20T23:14:14.655 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.033) 0:01:24.723 ***** 2021-10-20T23:14:14.660 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:14:14.697 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.044) 0:01:24.767 ***** 2021-10-20T23:14:14.714 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-10-20T23:14:14.716 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:14.740 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.047) 0:01:24.814 ***** 2021-10-20T23:14:14.750 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:14:14.776 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.035) 0:01:24.850 ***** 2021-10-20T23:14:14.782 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-10-20T23:14:14.784 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:14.812 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.036) 0:01:24.886 ***** 2021-10-20T23:14:14.830 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-10-20T23:14:14.831 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:14:14.864 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.052) 0:01:24.938 ***** 2021-10-20T23:14:14.873 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-10-20T23:14:14.875 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:14.882 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:14.912 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.046) 0:01:24.985 ***** 2021-10-20T23:14:14.952 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:14.980 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:14 +0000 (0:00:00.068) 0:01:25.054 ***** 2021-10-20T23:14:15.000 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-10-20T23:14:15.002 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-10-20T23:14:15.028 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.047) 0:01:25.102 ***** 2021-10-20T23:14:15.030 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:15.242 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-10-20T23:14:15.269 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.240) 0:01:25.342 ***** 2021-10-20T23:14:15.313 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:11:31 UTC", "ActiveEnterTimestampMonotonic": "14170052", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target basic.target systemd-tmpfiles-setup.service systemd-journald.socket sysinit.target network.target system.slice time-sync.target local-fs.target -.mount var-run.mount remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:11:31 UTC", "AssertTimestampMonotonic": "14157850", "Before": "getty@tty1.service shutdown.target multi-user.target xdm.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive" 2021-10-20T23:14:15.315 INFO:teuthology.task.ansible.out:, "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:11:31 UTC", "ConditionTimestampMonotonic": "14157850", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "842", "ExecMainStartTimestamp": "Wed 2021-10-20 23:11:31 UTC", "ExecMainStartTimestampMonotonic": "14169848", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-10-20 23:11:31 UTC] ; stop_time=[n/a] ; pid=842 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-10-20 23:11:31 UTC] ; stop_time=[n/a] ; pid=842 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKil 2021-10-20T23:14:15.317 INFO:teuthology.task.ansible.out:lSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:11:31 UTC", "InactiveExitTimestampMonotonic": "14170052", "InvocationID": "05449f75411749daa5c0113bab8f4cb5", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755 2021-10-20T23:14:15.319 INFO:teuthology.task.ansible.out:", "MainPID": "842", "MemoryAccounting": "yes", "MemoryCurrent": "1310720", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:11:31 UTC", "StateChangeTimestampMonotonic": "1 2021-10-20T23:14:15.320 INFO:teuthology.task.ansible.out:4170052", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38331", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:14:15.339 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.070) 0:01:25.412 ***** 2021-10-20T23:14:15.347 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-10-20T23:14:15.349 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-10-20T23:14:15.386 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.047) 0:01:25.460 ***** 2021-10-20T23:14:15.415 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:15.417 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-10-20T23:14:15.445 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.058) 0:01:25.518 ***** 2021-10-20T23:14:15.486 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.041) 0:01:25.560 ***** 2021-10-20T23:14:15.558 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-10-20T23:14:15.561 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:15.586 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.100) 0:01:25.660 ***** 2021-10-20T23:14:15.597 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:11:20 UTC", "ActiveEnterTimestampMonotonic": "17939029", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount network.target remote-fs.target systemd-journald.socket basic.target system.slice local-fs.target time-sync.target var-run.mount sysinit.target nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:11:20 UTC", "AssertTimestampMonotonic": "17929760", "Before": "shutdown.target xdm.service plymouth-quit.service multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive" 2021-10-20T23:14:15.599 INFO:teuthology.task.ansible.out:, "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:11:20 UTC", "ConditionTimestampMonotonic": "17929759", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "858", "ExecMainStartTimestamp": "Wed 2021-10-20 23:11:20 UTC", "ExecMainStartTimestampMonotonic": "17938887", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-10-20 23:11:20 UTC] ; stop_time=[n/a] ; pid=858 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-10-20 23:11:20 UTC] ; stop_time=[n/a] ; pid=858 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKil 2021-10-20T23:14:15.601 INFO:teuthology.task.ansible.out:lSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:11:20 UTC", "InactiveExitTimestampMonotonic": "17939029", "InvocationID": "5bfe9406975d4da8828db97b7a407858", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127797", "LimitNPROCSoft": "127797", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755 2021-10-20T23:14:15.602 INFO:teuthology.task.ansible.out:", "MainPID": "858", "MemoryAccounting": "yes", "MemoryCurrent": "1261568", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:11:20 UTC", "StateChangeTimestampMonotonic": "1 2021-10-20T23:14:15.604 INFO:teuthology.task.ansible.out:7939029", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38339", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:14:15.626 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.039) 0:01:25.699 ***** 2021-10-20T23:14:15.654 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-10-20T23:14:15.656 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-20T23:14:15.658 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:11:40 UTC", "ActiveEnterTimestampMonotonic": "16489499", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-tmpfiles-setup.service remote-fs.target time-sync.target -.mount var-run.mount local-fs.target systemd-journald.socket nss-lookup.target basic.target sysinit.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:11:40 UTC", "AssertTimestampMonotonic": "16473084", "Before": "plymouth-quit.service xdm.service shutdown.target multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:11:40 UTC", "Co 2021-10-20T23:14:15.660 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16473083", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "893", "ExecMainStartTimestamp": "Wed 2021-10-20 23:11:40 UTC", "ExecMainStartTimestampMonotonic": "16489314", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-10-20 23:11:40 UTC] ; stop_time=[n/a] ; pid=893 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-10-20 23:11:40 UTC] ; stop_time=[n/a] ; pid=893 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-10-20T23:14:15.661 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:11:40 UTC", "InactiveExitTimestampMonotonic": "16489499", "InvocationID": "9b7c4ba2dfe54b1ebcfcf1ded62b2a64", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "893", "MemoryAccounting": "yes", "MemoryCurrent": "1257472", "MemoryD 2021-10-20T23:14:15.663 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:11:40 UTC", "StateChangeTimestampMonotonic": "16489499", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-10-20T23:14:15.665 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38331", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:14:15.693 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.067) 0:01:25.767 ***** 2021-10-20T23:14:15.717 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.024) 0:01:25.791 ***** 2021-10-20T23:14:15.725 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:15.753 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.035) 0:01:25.826 ***** 2021-10-20T23:14:15.762 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-20T23:14:15.764 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:11:13 UTC", "ActiveEnterTimestampMonotonic": "17059390", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target var-run.mount system.slice -.mount local-fs.target systemd-tmpfiles-setup.service network.target systemd-journald.socket sysinit.target basic.target time-sync.target remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:11:13 UTC", "AssertTimestampMonotonic": "17057784", "Before": "getty@tty1.service multi-user.target xdm.service shutdown.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:11:13 UTC", "Co 2021-10-20T23:14:15.765 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "17057784", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "846", "ExecMainStartTimestamp": "Wed 2021-10-20 23:11:13 UTC", "ExecMainStartTimestampMonotonic": "17059254", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-10-20 23:11:13 UTC] ; stop_time=[n/a] ; pid=846 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-10-20 23:11:13 UTC] ; stop_time=[n/a] ; pid=846 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-10-20T23:14:15.767 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:11:13 UTC", "InactiveExitTimestampMonotonic": "17059390", "InvocationID": "1b15b8649353404dbace2817d367e81d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127797", "LimitNPROCSoft": "127797", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "846", "MemoryAccounting": "yes", "MemoryCurrent": "1310720", "MemoryD 2021-10-20T23:14:15.769 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:11:13 UTC", "StateChangeTimestampMonotonic": "17059390", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-10-20T23:14:15.772 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38339", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:14:15.772 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:15.801 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.047) 0:01:25.874 ***** 2021-10-20T23:14:15.826 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.025) 0:01:25.900 ***** 2021-10-20T23:14:15.834 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-10-20T23:14:15.835 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:15.870 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.043) 0:01:25.944 ***** 2021-10-20T23:14:15.881 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-10-20T23:14:15.882 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:15.914 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.044) 0:01:25.988 ***** 2021-10-20T23:14:15.926 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:15.959 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.040) 0:01:26.029 ***** 2021-10-20T23:14:15.980 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:15 +0000 (0:00:00.025) 0:01:26.054 ***** 2021-10-20T23:14:15.994 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.019 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.036) 0:01:26.091 ***** 2021-10-20T23:14:16.027 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.056 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.039) 0:01:26.130 ***** 2021-10-20T23:14:16.064 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-10-20T23:14:16.066 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.094 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.037) 0:01:26.167 ***** 2021-10-20T23:14:16.102 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.131 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.036) 0:01:26.205 ***** 2021-10-20T23:14:16.160 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.028) 0:01:26.233 ***** 2021-10-20T23:14:16.169 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-10-20T23:14:16.170 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.172 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.204 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.043) 0:01:26.277 ***** 2021-10-20T23:14:16.233 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.029) 0:01:26.307 ***** 2021-10-20T23:14:16.242 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-10-20T23:14:16.246 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.274 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.040) 0:01:26.347 ***** 2021-10-20T23:14:16.291 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-10-20T23:14:16.293 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.323 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.049) 0:01:26.397 ***** 2021-10-20T23:14:16.350 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.026) 0:01:26.424 ***** 2021-10-20T23:14:16.359 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-10-20T23:14:16.360 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.387 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.036) 0:01:26.461 ***** 2021-10-20T23:14:16.412 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.025) 0:01:26.486 ***** 2021-10-20T23:14:16.424 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.448 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.036) 0:01:26.522 ***** 2021-10-20T23:14:16.457 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.485 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.037) 0:01:26.560 ***** 2021-10-20T23:14:16.492 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-10-20T23:14:16.493 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.493 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-10-20T23:14:16.494 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.547 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.046) 0:01:26.606 ***** 2021-10-20T23:14:16.574 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.039) 0:01:26.645 ***** 2021-10-20T23:14:16.582 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-10-20T23:14:16.583 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.612 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.040) 0:01:26.685 ***** 2021-10-20T23:14:16.634 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.022) 0:01:26.708 ***** 2021-10-20T23:14:16.641 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-10-20T23:14:16.642 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.667 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.033) 0:01:26.741 ***** 2021-10-20T23:14:16.675 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-20T23:14:16.677 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.701 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.034) 0:01:26.775 ***** 2021-10-20T23:14:16.709 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-10-20T23:14:16.710 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.710 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.747 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.045) 0:01:26.821 ***** 2021-10-20T23:14:16.782 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.034) 0:01:26.856 ***** 2021-10-20T23:14:16.790 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-10-20T23:14:16.792 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.824 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.041) 0:01:26.898 ***** 2021-10-20T23:14:16.834 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-10-20T23:14:16.836 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:14:16.838 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.874 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.050) 0:01:26.948 ***** 2021-10-20T23:14:16.905 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.030) 0:01:26.979 ***** 2021-10-20T23:14:16.912 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.914 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.940 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.035) 0:01:27.014 ***** 2021-10-20T23:14:16.962 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.022) 0:01:27.036 ***** 2021-10-20T23:14:16.969 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:16.998 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:16 +0000 (0:00:00.033) 0:01:27.069 ***** 2021-10-20T23:14:17.004 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi119.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-10-20T23:14:17.033 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.037) 0:01:27.107 ***** 2021-10-20T23:14:17.041 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-20T23:14:17.042 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:17.080 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.046) 0:01:27.153 ***** 2021-10-20T23:14:17.189 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:17.221 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.141) 0:01:27.295 ***** 2021-10-20T23:14:17.264 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-20T23:14:17.266 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:17.292 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.070) 0:01:27.366 ***** 2021-10-20T23:14:17.312 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-10-20T23:14:17.314 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-10-20T23:14:17.358 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.060) 0:01:27.426 ***** 2021-10-20T23:14:17.376 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-10-20T23:14:17.378 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:14:17.560 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.207) 0:01:27.634 ***** 2021-10-20T23:14:17.585 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.025) 0:01:27.659 ***** 2021-10-20T23:14:17.594 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:17.595 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi119.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-20T23:14:17.626 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.040) 0:01:27.700 ***** 2021-10-20T23:14:17.656 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.029) 0:01:27.729 ***** 2021-10-20T23:14:17.664 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi012.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-10-20T23:14:17.694 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.037) 0:01:27.767 ***** 2021-10-20T23:14:17.703 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-10-20T23:14:17.746 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.053) 0:01:27.820 ***** 2021-10-20T23:14:17.755 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-10-20T23:14:17.757 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:14:17.787 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.040) 0:01:27.861 ***** 2021-10-20T23:14:17.797 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:14:17.799 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi012.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-10-20T23:14:17.826 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.039) 0:01:27.900 ***** 2021-10-20T23:14:17.828 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:17.854 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.025) 0:01:27.926 ***** 2021-10-20T23:14:17.874 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-10-20T23:14:17.903 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.050) 0:01:27.977 ***** 2021-10-20T23:14:17.913 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-10-20T23:14:17.915 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-10-20T23:14:17.949 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.044) 0:01:28.021 ***** 2021-10-20T23:14:17.955 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi012.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-20T23:14:17.989 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:17 +0000 (0:00:00.041) 0:01:28.063 ***** 2021-10-20T23:14:18.007 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-20T23:14:18.049 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.055) 0:01:28.118 ***** 2021-10-20T23:14:18.056 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-10-20T23:14:18.084 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.038) 0:01:28.157 ***** 2021-10-20T23:14:18.092 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-10-20T23:14:18.095 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-10-20T23:14:18.122 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.038) 0:01:28.195 ***** 2021-10-20T23:14:18.142 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:14:18.170 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.047) 0:01:28.243 ***** 2021-10-20T23:14:18.177 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-10-20T23:14:18.179 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-20T23:14:18.206 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.036) 0:01:28.280 ***** 2021-10-20T23:14:18.216 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:18.243 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.036) 0:01:28.317 ***** 2021-10-20T23:14:18.268 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.024) 0:01:28.342 ***** 2021-10-20T23:14:18.340 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-10-20T23:14:18.341 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:18.365 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.097) 0:01:28.439 ***** 2021-10-20T23:14:18.376 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-10-20T23:14:18.378 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-10-20T23:14:18.405 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.039) 0:01:28.479 ***** 2021-10-20T23:14:18.434 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.026) 0:01:28.505 ***** 2021-10-20T23:14:18.452 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-10-20T23:14:18.483 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.052) 0:01:28.558 ***** 2021-10-20T23:14:18.491 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-10-20T23:14:18.494 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:18.525 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.040) 0:01:28.598 ***** 2021-10-20T23:14:18.553 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:18.589 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.064) 0:01:28.663 ***** 2021-10-20T23:14:18.608 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-10-20T23:14:18.609 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:18.637 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.047) 0:01:28.710 ***** 2021-10-20T23:14:18.663 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.024) 0:01:28.735 ***** 2021-10-20T23:14:18.668 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-10-20T23:14:18.670 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:18.701 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.039) 0:01:28.775 ***** 2021-10-20T23:14:18.725 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.024) 0:01:28.799 ***** 2021-10-20T23:14:18.809 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-10-20T23:14:18.811 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:18.836 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.110) 0:01:28.910 ***** 2021-10-20T23:14:18.853 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-10-20T23:14:18.855 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-10-20T23:14:18.882 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.046) 0:01:28.956 ***** 2021-10-20T23:14:18.911 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-10-20T23:14:18.912 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi031.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-10-20T23:14:18.952 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.069) 0:01:29.026 ***** 2021-10-20T23:14:18.981 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:18 +0000 (0:00:00.028) 0:01:29.054 ***** 2021-10-20T23:14:19.146 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-10-20T23:14:19.173 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:19 +0000 (0:00:00.191) 0:01:29.245 ***** 2021-10-20T23:14:19.200 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-10-20T23:14:19.202 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-10-20T23:14:19.229 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:19 +0000 (0:00:00.058) 0:01:29.304 ***** 2021-10-20T23:14:19.237 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:19.262 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-10-20T23:14:19.264 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi119"}, "changed": false} 2021-10-20T23:14:19.289 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:19 +0000 (0:00:00.059) 0:01:29.363 ***** 2021-10-20T23:14:19.361 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-10-20T23:14:19.363 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-10-20T23:14:19.393 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:19 +0000 (0:00:00.103) 0:01:29.467 ***** 2021-10-20T23:14:19.467 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-10-20T23:14:19.495 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:19 +0000 (0:00:00.102) 0:01:29.569 ***** 2021-10-20T23:14:19.503 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-10-20T23:14:19.504 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi012"}, "changed": false} 2021-10-20T23:14:19.530 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:19 +0000 (0:00:00.034) 0:01:29.604 ***** 2021-10-20T23:14:19.572 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi031"}, "changed": false} 2021-10-20T23:14:19.599 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:19 +0000 (0:00:00.067) 0:01:29.671 ***** 2021-10-20T23:14:19.728 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-10-20T23:14:19.730 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-10-20T23:14:19.755 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:19 +0000 (0:00:00.158) 0:01:29.830 ***** 2021-10-20T23:14:19.848 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi136"}, "changed": false} 2021-10-20T23:14:19.875 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:19 +0000 (0:00:00.119) 0:01:29.949 ***** 2021-10-20T23:14:20.067 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi031.front.sepia.ceph.com", "ansible_hostname": "smithi031", "ansible_nodename": "smithi031"}, "changed": true, "name": "smithi031"} changed: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi012.front.sepia.ceph.com", "ansible_hostname": "smithi012", "ansible_nodename": "smithi012"}, "changed": true, "name": "smithi012"} 2021-10-20T23:14:20.093 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:20 +0000 (0:00:00.218) 0:01:30.167 ***** 2021-10-20T23:14:20.119 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:20 +0000 (0:00:00.025) 0:01:30.193 ***** 2021-10-20T23:14:20.128 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi119.front.sepia.ceph.com", "ansible_hostname": "smithi119", "ansible_nodename": "smithi119"}, "changed": true, "name": "smithi119"} 2021-10-20T23:14:20.158 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:20 +0000 (0:00:00.038) 0:01:30.232 ***** 2021-10-20T23:14:20.316 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi136.front.sepia.ceph.com", "ansible_hostname": "smithi136", "ansible_nodename": "smithi136"}, "changed": true, "name": "smithi136"} 2021-10-20T23:14:20.342 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:20 +0000 (0:00:00.183) 0:01:30.416 ***** 2021-10-20T23:14:20.499 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-10-20T23:14:20.500 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-10-20T23:14:20.527 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:20 +0000 (0:00:00.184) 0:01:30.600 ***** 2021-10-20T23:14:20.556 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-10-20T23:14:20.589 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:20 +0000 (0:00:00.062) 0:01:30.663 ***** 2021-10-20T23:14:20.598 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-10-20T23:14:20.630 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:20 +0000 (0:00:00.039) 0:01:30.702 ***** 2021-10-20T23:14:20.749 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-10-20T23:14:20.783 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:20 +0000 (0:00:00.154) 0:01:30.857 ***** 2021-10-20T23:14:20.956 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-10-20T23:14:20.981 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:20 +0000 (0:00:00.198) 0:01:31.056 ***** 2021-10-20T23:14:21.001 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-10-20T23:14:21.030 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.048) 0:01:31.104 ***** 2021-10-20T23:14:21.052 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-10-20T23:14:21.052 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:21.079 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.049) 0:01:31.153 ***** 2021-10-20T23:14:21.191 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-10-20T23:14:21.219 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.138) 0:01:31.292 ***** 2021-10-20T23:14:21.514 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi012.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-20T23:14:21.539 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.321) 0:01:31.613 ***** 2021-10-20T23:14:21.557 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-20T23:14:21.583 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.043) 0:01:31.657 ***** 2021-10-20T23:14:21.601 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-20T23:14:21.633 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.048) 0:01:31.706 ***** 2021-10-20T23:14:21.645 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:21.669 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.037) 0:01:31.743 ***** 2021-10-20T23:14:21.688 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:21.721 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.049) 0:01:31.793 ***** 2021-10-20T23:14:21.729 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:21.758 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.038) 0:01:31.831 ***** 2021-10-20T23:14:21.766 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-10-20T23:14:21.768 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:21.799 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.039) 0:01:31.871 ***** 2021-10-20T23:14:21.823 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.026) 0:01:31.898 ***** 2021-10-20T23:14:21.832 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:21.834 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:21.860 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.036) 0:01:31.934 ***** 2021-10-20T23:14:21.886 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.026) 0:01:31.960 ***** 2021-10-20T23:14:21.893 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-20T23:14:21.895 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:21.928 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.039) 0:01:31.999 ***** 2021-10-20T23:14:21.935 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:21.967 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.041) 0:01:32.041 ***** 2021-10-20T23:14:21.991 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:21 +0000 (0:00:00.023) 0:01:32.065 ***** 2021-10-20T23:14:21.998 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.000 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:14:22.000 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.027 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.036) 0:01:32.101 ***** 2021-10-20T23:14:22.057 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.028) 0:01:32.130 ***** 2021-10-20T23:14:22.063 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.065 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.090 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.034) 0:01:32.164 ***** 2021-10-20T23:14:22.121 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.031) 0:01:32.195 ***** 2021-10-20T23:14:22.130 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:22.131 INFO:teuthology.task.ansible.out:TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.166 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.044) 0:01:32.240 ***** 2021-10-20T23:14:22.191 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.023) 0:01:32.264 ***** 2021-10-20T23:14:22.197 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-20T23:14:22.199 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.225 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.035) 0:01:32.299 ***** 2021-10-20T23:14:22.249 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.023) 0:01:32.323 ***** 2021-10-20T23:14:22.255 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-10-20T23:14:22.257 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.283 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.034) 0:01:32.358 ***** 2021-10-20T23:14:22.309 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.023) 0:01:32.381 ***** 2021-10-20T23:14:22.316 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-10-20T23:14:22.318 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.345 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.037) 0:01:32.419 ***** 2021-10-20T23:14:22.352 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:14:22.354 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.381 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.036) 0:01:32.455 ***** 2021-10-20T23:14:22.388 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:14:22.390 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.416 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.034) 0:01:32.490 ***** 2021-10-20T23:14:22.442 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.025) 0:01:32.515 ***** 2021-10-20T23:14:22.449 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:14:22.451 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.479 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.036) 0:01:32.552 ***** 2021-10-20T23:14:22.486 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-20T23:14:22.488 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.519 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.041) 0:01:32.594 ***** 2021-10-20T23:14:22.543 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.023) 0:01:32.617 ***** 2021-10-20T23:14:22.552 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:14:22.554 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.581 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.037) 0:01:32.654 ***** 2021-10-20T23:14:22.604 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.023) 0:01:32.678 ***** 2021-10-20T23:14:22.611 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.613 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.638 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.033) 0:01:32.712 ***** 2021-10-20T23:14:22.661 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.023) 0:01:32.735 ***** 2021-10-20T23:14:22.668 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:14:22.669 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.669 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-10-20T23:14:22.669 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.696 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.034) 0:01:32.770 ***** 2021-10-20T23:14:22.720 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.023) 0:01:32.794 ***** 2021-10-20T23:14:22.727 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-10-20T23:14:22.730 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.755 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.035) 0:01:32.830 ***** 2021-10-20T23:14:22.763 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:14:22.765 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.790 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.034) 0:01:32.864 ***** 2021-10-20T23:14:22.797 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-10-20T23:14:22.798 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.825 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.035) 0:01:32.899 ***** 2021-10-20T23:14:22.854 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.029) 0:01:32.928 ***** 2021-10-20T23:14:22.866 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.869 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.902 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.047) 0:01:32.976 ***** 2021-10-20T23:14:22.932 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.029) 0:01:33.005 ***** 2021-10-20T23:14:22.939 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.941 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [smithi119.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:22.969 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:22 +0000 (0:00:00.037) 0:01:33.043 ***** 2021-10-20T23:14:23.010 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.040) 0:01:33.084 ***** 2021-10-20T23:14:23.018 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:23.020 INFO:teuthology.task.ansible.out:TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* TASK [testnode : set_fact] ***************************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.047 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.036) 0:01:33.121 ***** 2021-10-20T23:14:23.070 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.023) 0:01:33.144 ***** 2021-10-20T23:14:23.077 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-20T23:14:23.079 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:23.080 INFO:teuthology.task.ansible.out:TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.107 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.037) 0:01:33.181 ***** 2021-10-20T23:14:23.109 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:23.134 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.026) 0:01:33.208 ***** 2021-10-20T23:14:23.144 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-20T23:14:23.173 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.039) 0:01:33.247 ***** 2021-10-20T23:14:23.190 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.192 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-20T23:14:23.223 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.045) 0:01:33.293 ***** 2021-10-20T23:14:23.241 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.022) 0:01:33.315 ***** 2021-10-20T23:14:23.248 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-20T23:14:23.275 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.034) 0:01:33.349 ***** 2021-10-20T23:14:23.282 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-10-20T23:14:23.315 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.039) 0:01:33.389 ***** 2021-10-20T23:14:23.339 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.023) 0:01:33.413 ***** 2021-10-20T23:14:23.347 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-10-20T23:14:23.349 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-20T23:14:23.375 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.036) 0:01:33.449 ***** 2021-10-20T23:14:23.417 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.041) 0:01:33.491 ***** 2021-10-20T23:14:23.429 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.462 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.045) 0:01:33.536 ***** 2021-10-20T23:14:23.490 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.028) 0:01:33.564 ***** 2021-10-20T23:14:23.498 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-10-20T23:14:23.500 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-20T23:14:23.526 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.036) 0:01:33.601 ***** 2021-10-20T23:14:23.553 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.026) 0:01:33.627 ***** 2021-10-20T23:14:23.560 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-10-20T23:14:23.561 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.590 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.036) 0:01:33.664 ***** 2021-10-20T23:14:23.597 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.599 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.600 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.603 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.629 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.039) 0:01:33.703 ***** 2021-10-20T23:14:23.652 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.022) 0:01:33.726 ***** 2021-10-20T23:14:23.659 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-20T23:14:23.660 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-10-20T23:14:23.661 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.686 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.035) 0:01:33.761 ***** 2021-10-20T23:14:23.721 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.033) 0:01:33.794 ***** 2021-10-20T23:14:23.729 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.758 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.038) 0:01:33.832 ***** 2021-10-20T23:14:23.767 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-10-20T23:14:23.769 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.770 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.797 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.039) 0:01:33.872 ***** 2021-10-20T23:14:23.823 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.025) 0:01:33.897 ***** 2021-10-20T23:14:23.832 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** TASK [testnode : set_fact] ***************************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.860 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.036) 0:01:33.934 ***** 2021-10-20T23:14:23.885 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.025) 0:01:33.959 ***** 2021-10-20T23:14:23.896 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.923 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.037) 0:01:33.997 ***** 2021-10-20T23:14:23.945 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.022) 0:01:34.019 ***** 2021-10-20T23:14:23.953 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-10-20T23:14:23.955 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:23.981 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:23 +0000 (0:00:00.034) 0:01:34.054 ***** 2021-10-20T23:14:23.987 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-10-20T23:14:23.990 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.015 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.034) 0:01:34.088 ***** 2021-10-20T23:14:24.025 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.055 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.041) 0:01:34.129 ***** 2021-10-20T23:14:24.080 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.023) 0:01:34.153 ***** 2021-10-20T23:14:24.086 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-10-20T23:14:24.088 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.122 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.043) 0:01:34.196 ***** 2021-10-20T23:14:24.130 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-10-20T23:14:24.132 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.134 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.160 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.037) 0:01:34.234 ***** 2021-10-20T23:14:24.186 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.026) 0:01:34.260 ***** 2021-10-20T23:14:24.195 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-10-20T23:14:24.197 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.224 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.037) 0:01:34.298 ***** 2021-10-20T23:14:24.226 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:24.248 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.024) 0:01:34.322 ***** 2021-10-20T23:14:24.256 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-10-20T23:14:24.257 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.284 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.035) 0:01:34.358 ***** 2021-10-20T23:14:24.308 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.023) 0:01:34.382 ***** 2021-10-20T23:14:24.315 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-10-20T23:14:24.318 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.344 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.036) 0:01:34.418 ***** 2021-10-20T23:14:24.351 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-10-20T23:14:24.353 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.378 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.034) 0:01:34.453 ***** 2021-10-20T23:14:24.386 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.389 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.413 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.034) 0:01:34.487 ***** 2021-10-20T23:14:24.436 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.022) 0:01:34.510 ***** 2021-10-20T23:14:24.442 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-20T23:14:24.444 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.470 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.034) 0:01:34.545 ***** 2021-10-20T23:14:24.478 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-10-20T23:14:24.480 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.515 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.044) 0:01:34.590 ***** 2021-10-20T23:14:24.524 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-20T23:14:24.525 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.552 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.036) 0:01:34.626 ***** 2021-10-20T23:14:24.578 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.025) 0:01:34.651 ***** 2021-10-20T23:14:24.585 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-20T23:14:24.587 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.613 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.035) 0:01:34.687 ***** 2021-10-20T23:14:24.639 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.026) 0:01:34.713 ***** 2021-10-20T23:14:24.647 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-20T23:14:24.649 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.675 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.035) 0:01:34.749 ***** 2021-10-20T23:14:24.682 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-10-20T23:14:24.684 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.711 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.036) 0:01:34.785 ***** 2021-10-20T23:14:24.733 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.022) 0:01:34.807 ***** 2021-10-20T23:14:24.741 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-20T23:14:24.744 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.770 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.037) 0:01:34.845 ***** 2021-10-20T23:14:24.795 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.024) 0:01:34.869 ***** 2021-10-20T23:14:24.803 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.831 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.035) 0:01:34.905 ***** 2021-10-20T23:14:24.839 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-10-20T23:14:24.841 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.870 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.038) 0:01:34.944 ***** 2021-10-20T23:14:24.902 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.032) 0:01:34.976 ***** 2021-10-20T23:14:24.911 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:24.938 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.036) 0:01:35.013 ***** 2021-10-20T23:14:24.963 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.024) 0:01:35.037 ***** 2021-10-20T23:14:24.972 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.000 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:24 +0000 (0:00:00.037) 0:01:35.074 ***** 2021-10-20T23:14:25.007 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-10-20T23:14:25.009 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.036 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.036) 0:01:35.111 ***** 2021-10-20T23:14:25.060 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.023) 0:01:35.134 ***** 2021-10-20T23:14:25.067 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-20T23:14:25.069 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.095 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.035) 0:01:35.169 ***** 2021-10-20T23:14:25.103 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.130 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.035) 0:01:35.204 ***** 2021-10-20T23:14:25.139 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.140 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.167 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.036) 0:01:35.241 ***** 2021-10-20T23:14:25.190 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.023) 0:01:35.264 ***** 2021-10-20T23:14:25.197 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-10-20T23:14:25.207 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.230 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.040) 0:01:35.305 ***** 2021-10-20T23:14:25.239 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-10-20T23:14:25.241 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.268 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.036) 0:01:35.342 ***** 2021-10-20T23:14:25.301 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.033) 0:01:35.375 ***** 2021-10-20T23:14:25.309 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-20T23:14:25.311 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.312 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-20T23:14:25.313 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.343 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.041) 0:01:35.417 ***** 2021-10-20T23:14:25.371 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.027) 0:01:35.445 ***** 2021-10-20T23:14:25.380 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.406 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.035) 0:01:35.480 ***** 2021-10-20T23:14:25.432 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.026) 0:01:35.506 ***** 2021-10-20T23:14:25.440 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* 2021-10-20T23:14:25.442 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.468 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.035) 0:01:35.542 ***** 2021-10-20T23:14:25.497 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.029) 0:01:35.572 ***** 2021-10-20T23:14:25.505 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-10-20T23:14:25.507 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.535 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.037) 0:01:35.609 ***** 2021-10-20T23:14:25.563 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.026) 0:01:35.635 ***** 2021-10-20T23:14:25.572 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-10-20T23:14:25.574 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.603 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.041) 0:01:35.677 ***** 2021-10-20T23:14:25.629 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.026) 0:01:35.703 ***** 2021-10-20T23:14:25.638 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-10-20T23:14:25.639 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.673 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.042) 0:01:35.746 ***** 2021-10-20T23:14:25.705 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.032) 0:01:35.779 ***** 2021-10-20T23:14:25.720 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.722 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.749 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.043) 0:01:35.823 ***** 2021-10-20T23:14:25.776 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.026) 0:01:35.850 ***** 2021-10-20T23:14:25.784 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-10-20T23:14:25.786 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.813 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.036) 0:01:35.887 ***** 2021-10-20T23:14:25.839 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.025) 0:01:35.912 ***** 2021-10-20T23:14:25.845 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-20T23:14:25.847 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.886 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.048) 0:01:35.961 ***** 2021-10-20T23:14:25.915 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.028) 0:01:35.989 ***** 2021-10-20T23:14:25.922 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.924 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:25.952 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.037) 0:01:36.026 ***** 2021-10-20T23:14:25.981 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:25 +0000 (0:00:00.027) 0:01:36.054 ***** 2021-10-20T23:14:25.989 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.028 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.048) 0:01:36.102 ***** 2021-10-20T23:14:26.043 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.080 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.049) 0:01:36.152 ***** 2021-10-20T23:14:26.110 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.030) 0:01:36.182 ***** 2021-10-20T23:14:26.115 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.151 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.042) 0:01:36.225 ***** 2021-10-20T23:14:26.160 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-10-20T23:14:26.164 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.187 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.036) 0:01:36.262 ***** 2021-10-20T23:14:26.197 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.234 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.046) 0:01:36.308 ***** 2021-10-20T23:14:26.265 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.301 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.067) 0:01:36.375 ***** 2021-10-20T23:14:26.312 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005355", "end": "2021-10-20 23:14:25.982000", "rc": 0, "start": "2021-10-20 23:14:25.976645", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:26.340 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.039) 0:01:36.414 ***** 2021-10-20T23:14:26.349 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-20T23:14:26.351 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.393 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.052) 0:01:36.467 ***** 2021-10-20T23:14:26.406 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-10-20T23:14:26.409 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005423", "end": "2021-10-20 23:14:26.517647", "rc": 0, "start": "2021-10-20 23:14:26.512224", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2021-10-20T23:14:26.458 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.065) 0:01:36.532 ***** 2021-10-20T23:14:26.494 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.036) 0:01:36.568 ***** 2021-10-20T23:14:26.526 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.031) 0:01:36.600 ***** 2021-10-20T23:14:26.535 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-10-20T23:14:26.538 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.564 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.038) 0:01:36.639 ***** 2021-10-20T23:14:26.571 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-20T23:14:26.599 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.034) 0:01:36.673 ***** 2021-10-20T23:14:26.608 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-10-20T23:14:26.610 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.634 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.034) 0:01:36.708 ***** 2021-10-20T23:14:26.642 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-10-20T23:14:26.644 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.678 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.044) 0:01:36.752 ***** 2021-10-20T23:14:26.749 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-10-20T23:14:26.751 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:26.774 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.096) 0:01:36.848 ***** 2021-10-20T23:14:26.824 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-10-20T23:14:26.825 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005419", "end": "2021-10-20 23:14:27.060174", "rc": 0, "start": "2021-10-20 23:14:27.054755", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:26.850 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.075) 0:01:36.924 ***** 2021-10-20T23:14:26.857 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-10-20T23:14:26.859 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** 2021-10-20T23:14:26.859 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-10-20T23:14:26.896 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.045) 0:01:36.970 ***** 2021-10-20T23:14:26.923 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.027) 0:01:36.997 ***** 2021-10-20T23:14:26.930 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-20T23:14:26.957 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.034) 0:01:37.031 ***** 2021-10-20T23:14:26.974 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-10-20T23:14:26.976 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-10-20T23:14:27.004 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:26 +0000 (0:00:00.046) 0:01:37.078 ***** 2021-10-20T23:14:27.033 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:27 +0000 (0:00:00.026) 0:01:37.105 ***** 2021-10-20T23:14:27.038 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-10-20T23:14:27.045 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:27.083 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:27 +0000 (0:00:00.048) 0:01:37.153 ***** 2021-10-20T23:14:27.109 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-10-20T23:14:27.111 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:27.137 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:27 +0000 (0:00:00.058) 0:01:37.212 ***** 2021-10-20T23:14:27.295 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005473", "end": "2021-10-20 23:14:27.240902", "rc": 0, "start": "2021-10-20 23:14:27.235429", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:27.321 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:27 +0000 (0:00:00.183) 0:01:37.395 ***** 2021-10-20T23:14:27.387 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-10-20T23:14:27.394 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-10-20T23:14:27.416 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:27 +0000 (0:00:00.095) 0:01:37.490 ***** 2021-10-20T23:14:27.430 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-20T23:14:27.465 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:27 +0000 (0:00:00.048) 0:01:37.539 ***** 2021-10-20T23:14:27.495 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-10-20T23:14:27.497 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:27.521 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:27 +0000 (0:00:00.056) 0:01:37.595 ***** 2021-10-20T23:14:27.856 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-10-20T23:14:27.887 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:27 +0000 (0:00:00.365) 0:01:37.961 ***** 2021-10-20T23:14:27.962 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-10-20T23:14:27.964 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:28.000 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:27 +0000 (0:00:00.113) 0:01:38.074 ***** 2021-10-20T23:14:28.531 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-10-20T23:14:28.532 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-10-20T23:14:28.576 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-10-20T23:14:28.708 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-10-20T23:14:28.710 INFO:teuthology.task.ansible.out: 2021-10-20T23:14:29.229 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-10-20T23:14:29.610 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-10-20T23:14:29.636 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:29 +0000 (0:00:01.635) 0:01:39.710 ***** 2021-10-20T23:14:29.655 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-10-20T23:14:29.682 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:29 +0000 (0:00:00.045) 0:01:39.756 ***** 2021-10-20T23:14:29.766 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-10-20T23:14:29.794 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:29 +0000 (0:00:00.112) 0:01:39.868 ***** 2021-10-20T23:14:30.301 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-10-20T23:14:30.326 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.532) 0:01:40.400 ***** 2021-10-20T23:14:30.391 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:14:30.416 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.089) 0:01:40.490 ***** 2021-10-20T23:14:30.447 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:14:30.474 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.057) 0:01:40.548 ***** 2021-10-20T23:14:30.505 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-10-20T23:14:30.530 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.055) 0:01:40.604 ***** 2021-10-20T23:14:30.547 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-10-20T23:14:30.549 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} TASK [testnode : Add local apt repos.] ***************************************** 2021-10-20T23:14:30.573 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.043) 0:01:40.647 ***** 2021-10-20T23:14:30.597 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.023) 0:01:40.671 ***** 2021-10-20T23:14:30.698 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.101) 0:01:40.772 ***** 2021-10-20T23:14:30.747 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-10-20T23:14:30.749 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032510", "end": "2021-10-20 23:14:30.724495", "rc": 0, "start": "2021-10-20 23:14:30.691985", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:30.773 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.075) 0:01:40.847 ***** 2021-10-20T23:14:30.791 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031919", "end": "2021-10-20 23:14:30.949885", "rc": 0, "start": "2021-10-20 23:14:30.917966", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:30.818 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.044) 0:01:40.892 ***** 2021-10-20T23:14:30.915 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032862", "end": "2021-10-20 23:14:31.149301", "rc": 0, "start": "2021-10-20 23:14:31.116439", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:30.942 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:30 +0000 (0:00:00.123) 0:01:41.015 ***** 2021-10-20T23:14:31.068 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:14:31.094 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:31 +0000 (0:00:00.152) 0:01:41.168 ***** 2021-10-20T23:14:31.166 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-10-20T23:14:31.196 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:31 +0000 (0:00:00.102) 0:01:41.270 ***** 2021-10-20T23:14:31.408 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030918", "end": "2021-10-20 23:14:31.347954", "rc": 0, "start": "2021-10-20 23:14:31.317036", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:14:31.432 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:31 +0000 (0:00:00.236) 0:01:41.507 ***** 2021-10-20T23:14:33.103 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-10-20T23:14:33.104 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:14:33.128 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:33 +0000 (0:00:01.695) 0:01:43.203 ***** 2021-10-20T23:14:33.152 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:33 +0000 (0:00:00.023) 0:01:43.226 ***** 2021-10-20T23:14:33.171 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:14:33.201 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:33 +0000 (0:00:00.048) 0:01:43.275 ***** 2021-10-20T23:14:33.709 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:14:33.734 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:33 +0000 (0:00:00.533) 0:01:43.808 ***** 2021-10-20T23:14:41.343 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-10-20T23:14:41.344 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-10-20T23:14:41.346 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-10-20T23:14:41.348 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-10-20T23:14:41.369 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:41 +0000 (0:00:07.634) 0:01:51.443 ***** 2021-10-20T23:14:41.431 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-10-20T23:14:41.433 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-10-20T23:14:41.435 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-10-20T23:14:41.461 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:41 +0000 (0:00:00.092) 0:01:51.535 ***** 2021-10-20T23:14:41.534 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-10-20T23:14:41.536 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-10-20T23:14:41.538 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-10-20T23:14:41.562 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:41 +0000 (0:00:00.100) 0:01:51.635 ***** 2021-10-20T23:14:41.988 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-10-20T23:14:41.989 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-10-20T23:14:41.991 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-10-20T23:14:42.013 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:42 +0000 (0:00:00.451) 0:01:52.087 ***** 2021-10-20T23:14:56.596 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:14:56.598 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 2021-10-20T23:14:56.600 INFO:teuthology.task.ansible.out:kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]\nFetched 1519 kB in 1s (1832 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.7) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are 2021-10-20T23:14:56.602 INFO:teuthology.task.ansible.out:no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]", "Fetched 1519 kB in 1s (1832 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 2021-10-20T23:14:56.603 INFO:teuthology.task.ansible.out: 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.7) ...", "Setting up apache2-data (2.4.41-4ubuntu3.7) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.7) ...", "Setting up apache2 (2.4.41-4ubuntu3.7) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-10-20T23:14:56.622 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:56 +0000 (0:00:14.609) 0:02:06.696 ***** 2021-10-20T23:14:56.693 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-10-20T23:14:56.694 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:56.725 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:56 +0000 (0:00:00.103) 0:02:06.799 ***** 2021-10-20T23:14:57.108 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:14:57.110 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 2021-10-20T23:14:57.112 INFO:teuthology.task.ansible.out:kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]\nFetched 1519 kB in 1s (1829 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.7) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are 2021-10-20T23:14:57.114 INFO:teuthology.task.ansible.out:no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]", "Fetched 1519 kB in 1s (1829 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 2021-10-20T23:14:57.116 INFO:teuthology.task.ansible.out: 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.7) ...", "Setting up apache2-data (2.4.41-4ubuntu3.7) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.7) ...", "Setting up apache2 (2.4.41-4ubuntu3.7) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-10-20T23:14:57.138 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:57 +0000 (0:00:00.412) 0:02:07.211 ***** 2021-10-20T23:14:57.178 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 2021-10-20T23:14:57.180 INFO:teuthology.task.ansible.out:kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]\nFetched 1519 kB in 1s (1838 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.7) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are 2021-10-20T23:14:57.182 INFO:teuthology.task.ansible.out:no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]", "Fetched 1519 kB in 1s (1838 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 2021-10-20T23:14:57.184 INFO:teuthology.task.ansible.out: 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.7) ...", "Setting up apache2-data (2.4.41-4ubuntu3.7) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.7) ...", "Setting up apache2 (2.4.41-4ubuntu3.7) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-10-20T23:14:57.209 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:57 +0000 (0:00:00.071) 0:02:07.283 ***** 2021-10-20T23:14:57.217 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:57.254 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:57 +0000 (0:00:00.040) 0:02:07.324 ***** 2021-10-20T23:14:57.303 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:57.331 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:57 +0000 (0:00:00.081) 0:02:07.405 ***** 2021-10-20T23:14:57.795 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:14:57.798 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 2021-10-20T23:14:57.805 INFO:teuthology.task.ansible.out:kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]\nFetched 1519 kB in 1s (1835 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.7) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are 2021-10-20T23:14:57.809 INFO:teuthology.task.ansible.out:no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]", "Fetched 1519 kB in 1s (1835 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 2021-10-20T23:14:57.811 INFO:teuthology.task.ansible.out: 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.7) ...", "Setting up apache2-data (2.4.41-4ubuntu3.7) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.7) ...", "Setting up apache2 (2.4.41-4ubuntu3.7) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-10-20T23:14:57.822 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:57 +0000 (0:00:00.491) 0:02:07.897 ***** 2021-10-20T23:14:57.898 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:14:57.922 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:14:57 +0000 (0:00:00.099) 0:02:07.996 ***** 2021-10-20T23:15:09.028 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-20T23:15:09.029 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-10-20T23:15:09.030 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.8 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-10-20T23:15:09.032 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-10-20T23:15:09.034 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.8 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:15:09.036 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-10-20T23:15:09.056 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:09 +0000 (0:00:11.134) 0:02:19.130 ***** 2021-10-20T23:15:09.077 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-10-20T23:15:09.079 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.9 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-10-20T23:15:09.081 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-10-20T23:15:09.082 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.9 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:15:09.084 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selectin 2021-10-20T23:15:09.085 INFO:teuthology.task.ansible.out:g previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-10-20T23:15:09.113 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:09 +0000 (0:00:00.056) 0:02:19.187 ***** 2021-10-20T23:15:09.486 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-10-20T23:15:09.488 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.9 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-10-20T23:15:09.490 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-10-20T23:15:09.492 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.9 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:15:09.494 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selectin 2021-10-20T23:15:09.494 INFO:teuthology.task.ansible.out:g previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-10-20T23:15:09.520 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:09 +0000 (0:00:00.406) 0:02:19.594 ***** 2021-10-20T23:15:09.780 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-10-20T23:15:09.782 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:15:09.817 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:09 +0000 (0:00:00.296) 0:02:19.891 ***** 2021-10-20T23:15:09.840 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:15:09.866 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:09 +0000 (0:00:00.048) 0:02:19.940 ***** 2021-10-20T23:15:10.261 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:15:10.286 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:10 +0000 (0:00:00.420) 0:02:20.360 ***** 2021-10-20T23:15:10.546 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-10-20T23:15:10.548 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:15:10.572 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:10 +0000 (0:00:00.286) 0:02:20.646 ***** 2021-10-20T23:15:10.581 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:15:10.610 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:10 +0000 (0:00:00.037) 0:02:20.684 ***** 2021-10-20T23:15:10.758 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-10-20T23:15:10.783 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:10 +0000 (0:00:00.173) 0:02:20.857 ***** 2021-10-20T23:15:10.790 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-10-20T23:15:10.792 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-20T23:15:10.793 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-10-20T23:15:10.795 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (12.0 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-10-20T23:15:10.797 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-10-20T23:15:10.798 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (12.0 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:15:10.800 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-10-20T23:15:10.823 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:10 +0000 (0:00:00.038) 0:02:20.896 ***** 2021-10-20T23:15:10.853 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:10 +0000 (0:00:00.031) 0:02:20.927 ***** 2021-10-20T23:15:10.872 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-10-20T23:15:10.873 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:10.901 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:10 +0000 (0:00:00.048) 0:02:20.975 ***** 2021-10-20T23:15:10.931 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:10.958 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:10 +0000 (0:00:00.056) 0:02:21.032 ***** 2021-10-20T23:15:11.009 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-10-20T23:15:11.011 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:15:11.038 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.080) 0:02:21.112 ***** 2021-10-20T23:15:11.090 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-10-20T23:15:11.092 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-10-20T23:15:11.125 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.085) 0:02:21.198 ***** 2021-10-20T23:15:11.146 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-10-20T23:15:11.172 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.048) 0:02:21.246 ***** 2021-10-20T23:15:11.174 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:11.213 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-10-20T23:15:11.241 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.068) 0:02:21.315 ***** 2021-10-20T23:15:11.325 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:11.356 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.115) 0:02:21.430 ***** 2021-10-20T23:15:11.359 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:11.548 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-20T23:15:11.550 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-10-20T23:15:11.578 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.221) 0:02:21.652 ***** 2021-10-20T23:15:11.601 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.022) 0:02:21.675 ***** 2021-10-20T23:15:11.608 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-10-20T23:15:11.612 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-10-20T23:15:11.640 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.038) 0:02:21.714 ***** 2021-10-20T23:15:11.675 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.035) 0:02:21.749 ***** 2021-10-20T23:15:11.824 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-10-20T23:15:11.826 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-20T23:15:11.852 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.176) 0:02:21.926 ***** 2021-10-20T23:15:11.893 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-20T23:15:11.921 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:11 +0000 (0:00:00.069) 0:02:21.995 ***** 2021-10-20T23:15:11.983 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-20T23:15:11.984 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-10-20T23:15:12.011 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.090) 0:02:22.085 ***** 2021-10-20T23:15:12.030 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-10-20T23:15:12.031 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:12.058 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.047) 0:02:22.132 ***** 2021-10-20T23:15:12.098 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:12.125 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.066) 0:02:22.199 ***** 2021-10-20T23:15:12.221 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-10-20T23:15:12.222 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-20T23:15:12.247 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.122) 0:02:22.322 ***** 2021-10-20T23:15:12.373 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-10-20T23:15:12.375 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ActiveEnterTimestampMonotonic": "210848067", "ActiveExitTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ActiveExitTimestampMonotonic": "210759336", "ActiveState": "active", "After": "network.target nss-lookup.target systemd-tmpfiles-setup.service systemd-journald.socket remote-fs.target basic.target -.mount system.slice sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:14:54 UTC", "AssertTimestampMonotonic": "210812337", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ConditionTimestampMonotonic": "210812336", "ConfigurationDirec 2021-10-20T23:15:12.376 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6458", "ExecMainStartTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ExecMainStartTimestampMonotonic": "210848035", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-10-20T23:15:12.378 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:14:54 UTC", "InactiveEnterTimestampMonotonic": "210810974", "InactiveExitTimestamp": "Wed 2021-10-20 23:14:54 UTC", "InactiveExitTimestampMonotonic": "210814593", "InvocationID": "d2cb34a6e56447d5af0e2af43e122126", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6458", "MemoryAccounting": "yes", "MemoryCurrent": "6799360", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-10-20T23:15:12.380 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:14:54 UTC", "StateChangeTimestampMonotonic": "210848067", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-10-20T23:15:12.381 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:15:12.401 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.153) 0:02:22.475 ***** 2021-10-20T23:15:12.409 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-10-20T23:15:12.411 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:15:12.440 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.038) 0:02:22.514 ***** 2021-10-20T23:15:12.448 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-10-20T23:15:12.449 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:12.450 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-10-20T23:15:12.453 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ActiveEnterTimestampMonotonic": "217464264", "ActiveExitTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ActiveExitTimestampMonotonic": "217381146", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service nss-lookup.target systemd-journald.socket remote-fs.target system.slice sysinit.target -.mount network.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:14:54 UTC", "AssertTimestampMonotonic": "217430886", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ConditionTimestampMonotonic": "217430885", "ConfigurationDirec 2021-10-20T23:15:12.454 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6450", "ExecMainStartTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ExecMainStartTimestampMonotonic": "217464238", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-10-20T23:15:12.456 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:14:54 UTC", "InactiveEnterTimestampMonotonic": "217429548", "InactiveExitTimestamp": "Wed 2021-10-20 23:14:54 UTC", "InactiveExitTimestampMonotonic": "217432827", "InvocationID": "a105277031a7436694c0804eb2f09524", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6450", "MemoryAccounting": "yes", "MemoryCurrent": "6918144", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-10-20T23:15:12.460 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:14:54 UTC", "StateChangeTimestampMonotonic": "217464264", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-10-20T23:15:12.521 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.040) 0:02:22.555 ***** Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.032) 0:02:22.588 ***** 2021-10-20T23:15:12.525 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-10-20T23:15:12.527 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:12.555 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.041) 0:02:22.629 ***** 2021-10-20T23:15:12.557 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:12.586 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:12.588 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:12.613 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.057) 0:02:22.687 ***** 2021-10-20T23:15:12.631 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-20T23:15:12.632 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-10-20T23:15:12.660 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.046) 0:02:22.734 ***** 2021-10-20T23:15:12.686 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.024) 0:02:22.758 ***** 2021-10-20T23:15:12.693 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-20T23:15:12.695 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:12.720 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.036) 0:02:22.794 ***** 2021-10-20T23:15:12.738 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-10-20T23:15:12.741 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:12.766 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.045) 0:02:22.840 ***** 2021-10-20T23:15:12.774 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:15:12.776 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:12.805 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.037) 0:02:22.878 ***** 2021-10-20T23:15:12.811 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:12.818 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ActiveEnterTimestampMonotonic": "232899426", "ActiveExitTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ActiveExitTimestampMonotonic": "232816066", "ActiveState": "active", "After": "nss-lookup.target basic.target system.slice remote-fs.target -.mount systemd-tmpfiles-setup.service systemd-journald.socket sysinit.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:14:54 UTC", "AssertTimestampMonotonic": "232867171", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021- 2021-10-20T23:15:12.821 INFO:teuthology.task.ansible.out:10-20 23:14:54 UTC", "ConditionTimestampMonotonic": "232867170", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6359", "ExecMainStartTimestamp": "Wed 2021-10-20 23:14:54 UTC", "ExecMainStartTimestampMonotonic": "232899395", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOR 2021-10-20T23:15:12.823 INFO:teuthology.task.ansible.out:eadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:14:54 UTC", "InactiveEnterTimestampMonotonic": "232865774", "InactiveExitTimestamp": "Wed 2021-10-20 23:14:54 UTC", "InactiveExitTimestampMonotonic": "232869595", "InvocationID": "3cc270f655f34e9dbcdfe380401ecef0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127797", "LimitNPROCSoft": "127797", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6359", "MemoryAccounting": "yes", "MemoryCurrent": "6787072", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit 2021-10-20T23:15:12.825 INFO:teuthology.task.ansible.out:": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:14:54 UTC", "StateChangeTimestampMonotonic": "232899426", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefi 2021-10-20T23:15:12.827 INFO:teuthology.task.ansible.out:x": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38339", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:15:12.849 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.042) 0:02:22.921 ***** 2021-10-20T23:15:12.869 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.022) 0:02:22.943 ***** 2021-10-20T23:15:12.876 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-20T23:15:12.878 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:12.904 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.034) 0:02:22.978 ***** 2021-10-20T23:15:12.921 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-10-20T23:15:12.924 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:12.953 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.048) 0:02:23.026 ***** 2021-10-20T23:15:12.962 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:12.989 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:12 +0000 (0:00:00.036) 0:02:23.063 ***** 2021-10-20T23:15:12.998 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.027 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.037) 0:02:23.100 ***** 2021-10-20T23:15:13.055 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.026) 0:02:23.126 ***** 2021-10-20T23:15:13.060 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-20T23:15:13.062 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.089 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.036) 0:02:23.163 ***** 2021-10-20T23:15:13.101 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.132 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.042) 0:02:23.206 ***** 2021-10-20T23:15:13.140 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.170 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.035) 0:02:23.242 ***** 2021-10-20T23:15:13.175 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:15:13.178 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.207 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.038) 0:02:23.281 ***** 2021-10-20T23:15:13.215 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:15:13.216 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.248 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.041) 0:02:23.322 ***** 2021-10-20T23:15:13.257 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.289 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.040) 0:02:23.362 ***** 2021-10-20T23:15:13.297 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-20T23:15:13.305 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.335 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.047) 0:02:23.409 ***** 2021-10-20T23:15:13.359 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-20T23:15:13.360 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.384 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.048) 0:02:23.458 ***** 2021-10-20T23:15:13.393 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.431 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.045) 0:02:23.504 ***** 2021-10-20T23:15:13.442 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.467 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.035) 0:02:23.540 ***** 2021-10-20T23:15:13.474 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-20T23:15:13.476 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-20T23:15:13.476 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.509 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.038) 0:02:23.579 ***** 2021-10-20T23:15:13.530 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.025) 0:02:23.604 ***** 2021-10-20T23:15:13.539 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:13.541 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.573 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.042) 0:02:23.647 ***** 2021-10-20T23:15:13.585 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.622 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.045) 0:02:23.692 ***** 2021-10-20T23:15:13.626 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:13.627 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.654 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.035) 0:02:23.728 ***** 2021-10-20T23:15:13.662 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.691 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.037) 0:02:23.765 ***** 2021-10-20T23:15:13.702 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.742 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.049) 0:02:23.815 ***** 2021-10-20T23:15:13.754 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi012.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-20T23:15:13.785 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.044) 0:02:23.859 ***** 2021-10-20T23:15:13.810 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.024) 0:02:23.884 ***** 2021-10-20T23:15:13.818 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-20T23:15:13.820 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.857 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.047) 0:02:23.931 ***** 2021-10-20T23:15:13.868 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.916 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.056) 0:02:23.988 ***** 2021-10-20T23:15:13.930 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:13.953 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.037) 0:02:24.026 ***** 2021-10-20T23:15:13.974 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.005 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:13 +0000 (0:00:00.053) 0:02:24.079 ***** 2021-10-20T23:15:14.012 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-10-20T23:15:14.014 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : set_fact] ***************************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.043 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.036) 0:02:24.116 ***** 2021-10-20T23:15:14.068 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.025) 0:02:24.141 ***** 2021-10-20T23:15:14.078 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:15:14.079 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.109 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.040) 0:02:24.182 ***** 2021-10-20T23:15:14.133 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.023) 0:02:24.205 ***** 2021-10-20T23:15:14.154 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.179 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.048) 0:02:24.253 ***** 2021-10-20T23:15:14.186 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:15:14.188 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.217 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.035) 0:02:24.289 ***** 2021-10-20T23:15:14.222 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:15:14.223 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.250 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.035) 0:02:24.325 ***** 2021-10-20T23:15:14.269 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.301 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.045) 0:02:24.370 ***** 2021-10-20T23:15:14.304 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:15:14.305 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.333 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.035) 0:02:24.406 ***** 2021-10-20T23:15:14.339 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:15:14.341 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.388 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.047) 0:02:24.454 ***** 2021-10-20T23:15:14.399 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-10-20T23:15:14.402 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:14:55 UTC", "ActiveEnterTimestampMonotonic": "239189202", "ActiveExitTimestamp": "Wed 2021-10-20 23:14:55 UTC", "ActiveExitTimestampMonotonic": "239099789", "ActiveState": "active", "After": "systemd-journald.socket network.target sysinit.target remote-fs.target nss-lookup.target system.slice systemd-tmpfiles-setup.service basic.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:14:55 UTC", "AssertTimestampMonotonic": "239152223", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:14:55 UTC", "ConditionTimestampMonotonic": "239152222", "ConfigurationDirec 2021-10-20T23:15:14.403 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6370", "ExecMainStartTimestamp": "Wed 2021-10-20 23:14:55 UTC", "ExecMainStartTimestampMonotonic": "239189184", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-10-20T23:15:14.405 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:14:55 UTC", "InactiveEnterTimestampMonotonic": "239150797", "InactiveExitTimestamp": "Wed 2021-10-20 23:14:55 UTC", "InactiveExitTimestampMonotonic": "239154684", "InvocationID": "dcd6ed79f8ac4a14b6b28f4ac6823986", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127797", "LimitNPROCSoft": "127797", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6370", "MemoryAccounting": "yes", "MemoryCurrent": "7106560", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-10-20T23:15:14.406 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:14:55 UTC", "StateChangeTimestampMonotonic": "239189202", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-10-20T23:15:14.411 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38339", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.432 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.052) 0:02:24.506 ***** 2021-10-20T23:15:14.459 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.026) 0:02:24.533 ***** 2021-10-20T23:15:14.468 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.502 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.040) 0:02:24.574 ***** 2021-10-20T23:15:14.523 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.023) 0:02:24.597 ***** 2021-10-20T23:15:14.531 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.533 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.563 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.036) 0:02:24.633 ***** 2021-10-20T23:15:14.587 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.024) 0:02:24.657 ***** 2021-10-20T23:15:14.602 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:15:14.607 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.648 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.063) 0:02:24.721 ***** 2021-10-20T23:15:14.656 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-20T23:15:14.658 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.687 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.038) 0:02:24.760 ***** 2021-10-20T23:15:14.717 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.028) 0:02:24.789 ***** 2021-10-20T23:15:14.748 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.028) 0:02:24.817 ***** 2021-10-20T23:15:14.782 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.794 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.042) 0:02:24.860 ***** 2021-10-20T23:15:14.803 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.830 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.043) 0:02:24.904 ***** 2021-10-20T23:15:14.839 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:15:14.841 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.867 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.037) 0:02:24.941 ***** 2021-10-20T23:15:14.902 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.034) 0:02:24.976 ***** 2021-10-20T23:15:14.914 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.940 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.037) 0:02:25.014 ***** 2021-10-20T23:15:14.948 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-20T23:15:14.950 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:14.978 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:14 +0000 (0:00:00.038) 0:02:25.052 ***** 2021-10-20T23:15:14.985 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:15:14.988 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.017 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.038) 0:02:25.091 ***** 2021-10-20T23:15:15.043 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.025) 0:02:25.116 ***** 2021-10-20T23:15:15.050 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.052 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.079 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.036) 0:02:25.153 ***** 2021-10-20T23:15:15.103 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.023) 0:02:25.177 ***** 2021-10-20T23:15:15.111 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.144 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.041) 0:02:25.218 ***** 2021-10-20T23:15:15.153 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:15:15.154 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.154 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.182 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.037) 0:02:25.256 ***** 2021-10-20T23:15:15.222 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.034) 0:02:25.290 ***** 2021-10-20T23:15:15.224 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:15:15.224 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.251 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.035) 0:02:25.326 ***** 2021-10-20T23:15:15.259 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:15:15.260 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.289 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.037) 0:02:25.363 ***** 2021-10-20T23:15:15.314 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.023) 0:02:25.386 ***** 2021-10-20T23:15:15.319 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:15:15.321 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.347 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.035) 0:02:25.422 ***** 2021-10-20T23:15:15.358 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.384 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.036) 0:02:25.458 ***** 2021-10-20T23:15:15.392 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-20T23:15:15.395 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.427 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.042) 0:02:25.501 ***** 2021-10-20T23:15:15.452 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.025) 0:02:25.526 ***** 2021-10-20T23:15:15.460 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:15:15.462 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.488 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.035) 0:02:25.562 ***** 2021-10-20T23:15:15.518 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.027) 0:02:25.590 ***** 2021-10-20T23:15:15.525 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:15.526 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.528 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.568 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.052) 0:02:25.642 ***** 2021-10-20T23:15:15.594 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.025) 0:02:25.668 ***** 2021-10-20T23:15:15.605 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:15:15.607 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.643 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.049) 0:02:25.717 ***** 2021-10-20T23:15:15.670 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.026) 0:02:25.744 ***** 2021-10-20T23:15:15.679 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-20T23:15:15.681 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.709 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.039) 0:02:25.784 ***** 2021-10-20T23:15:15.736 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.026) 0:02:25.810 ***** 2021-10-20T23:15:15.744 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:15:15.745 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.771 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.035) 0:02:25.845 ***** 2021-10-20T23:15:15.779 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.781 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.810 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.039) 0:02:25.885 ***** 2021-10-20T23:15:15.836 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.025) 0:02:25.910 ***** 2021-10-20T23:15:15.842 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:15:15.843 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.872 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.035) 0:02:25.946 ***** 2021-10-20T23:15:15.896 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.024) 0:02:25.970 ***** 2021-10-20T23:15:15.904 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:15:15.906 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.932 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.036) 0:02:26.006 ***** 2021-10-20T23:15:15.940 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:15:15.942 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.975 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:15 +0000 (0:00:00.043) 0:02:26.049 ***** 2021-10-20T23:15:15.977 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:15.984 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:15.986 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.014 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.039) 0:02:26.089 ***** 2021-10-20T23:15:16.051 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.036) 0:02:26.125 ***** 2021-10-20T23:15:16.060 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.091 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.039) 0:02:26.165 ***** 2021-10-20T23:15:16.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-10-20T23:15:16.101 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.128 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.036) 0:02:26.202 ***** 2021-10-20T23:15:16.154 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.026) 0:02:26.228 ***** 2021-10-20T23:15:16.172 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:15:16.174 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.208 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.054) 0:02:26.283 ***** 2021-10-20T23:15:16.219 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:15:16.221 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.252 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.043) 0:02:26.326 ***** 2021-10-20T23:15:16.261 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-10-20T23:15:16.262 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-10-20T23:15:16.289 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.036) 0:02:26.363 ***** 2021-10-20T23:15:16.296 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:15:16.297 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.323 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.033) 0:02:26.397 ***** 2021-10-20T23:15:16.330 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.358 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.034) 0:02:26.431 ***** 2021-10-20T23:15:16.365 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-10-20T23:15:16.367 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-10-20T23:15:16.399 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.037) 0:02:26.469 ***** 2021-10-20T23:15:16.402 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.431 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.036) 0:02:26.505 ***** 2021-10-20T23:15:16.433 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:16.519 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-20T23:15:16.521 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.543 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.111) 0:02:26.617 ***** 2021-10-20T23:15:16.560 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-10-20T23:15:16.592 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.048) 0:02:26.666 ***** 2021-10-20T23:15:16.621 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.647 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.054) 0:02:26.721 ***** 2021-10-20T23:15:16.676 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-20T23:15:16.678 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-10-20T23:15:16.703 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.056) 0:02:26.777 ***** 2021-10-20T23:15:16.722 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:15:16.724 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.749 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.045) 0:02:26.823 ***** 2021-10-20T23:15:16.782 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-10-20T23:15:16.808 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.058) 0:02:26.882 ***** 2021-10-20T23:15:16.834 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.025) 0:02:26.908 ***** 2021-10-20T23:15:16.840 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:15:16.841 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.872 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.038) 0:02:26.946 ***** 2021-10-20T23:15:16.904 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.929 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.056) 0:02:27.003 ***** 2021-10-20T23:15:16.959 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:15:16.961 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:16.987 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:16 +0000 (0:00:00.057) 0:02:27.061 ***** 2021-10-20T23:15:16.996 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-10-20T23:15:17.034 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.044) 0:02:27.105 ***** 2021-10-20T23:15:17.062 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:17.086 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.054) 0:02:27.160 ***** 2021-10-20T23:15:17.116 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:15:17.118 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:17.143 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.057) 0:02:27.217 ***** 2021-10-20T23:15:17.160 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:15:17.162 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:17.194 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.049) 0:02:27.267 ***** 2021-10-20T23:15:17.215 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-10-20T23:15:17.240 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.047) 0:02:27.314 ***** 2021-10-20T23:15:17.281 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:15:17.283 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:17.311 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.069) 0:02:27.383 ***** 2021-10-20T23:15:17.339 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-20T23:15:17.342 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-10-20T23:15:17.366 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.057) 0:02:27.440 ***** 2021-10-20T23:15:17.384 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:15:17.386 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:17.410 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.044) 0:02:27.485 ***** 2021-10-20T23:15:17.483 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:17.510 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.099) 0:02:27.584 ***** 2021-10-20T23:15:17.560 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-20T23:15:17.562 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-10-20T23:15:17.589 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.079) 0:02:27.663 ***** 2021-10-20T23:15:17.633 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-10-20T23:15:17.635 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-10-20T23:15:17.663 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.073) 0:02:27.737 ***** 2021-10-20T23:15:17.706 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-10-20T23:15:17.708 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-10-20T23:15:17.739 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.073) 0:02:27.811 ***** 2021-10-20T23:15:17.781 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-10-20T23:15:17.810 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:17 +0000 (0:00:00.073) 0:02:27.884 ***** 2021-10-20T23:15:17.991 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-10-20T23:15:18.020 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.209) 0:02:28.094 ***** 2021-10-20T23:15:18.063 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-10-20T23:15:18.090 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.070) 0:02:28.164 ***** 2021-10-20T23:15:18.144 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-20T23:15:18.146 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-10-20T23:15:18.181 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.090) 0:02:28.255 ***** 2021-10-20T23:15:18.223 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-10-20T23:15:18.225 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-10-20T23:15:18.252 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.070) 0:02:28.326 ***** 2021-10-20T23:15:18.260 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:15:18.262 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.287 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.035) 0:02:28.361 ***** 2021-10-20T23:15:18.296 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi119.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:18.327 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.039) 0:02:28.401 ***** 2021-10-20T23:15:18.396 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-10-20T23:15:18.398 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.422 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.095) 0:02:28.496 ***** 2021-10-20T23:15:18.429 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-10-20T23:15:18.431 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-10-20T23:15:18.461 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.037) 0:02:28.534 ***** 2021-10-20T23:15:18.468 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-20T23:15:18.470 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:18.496 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.035) 0:02:28.570 ***** 2021-10-20T23:15:18.503 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.532 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.033) 0:02:28.604 ***** 2021-10-20T23:15:18.572 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.600 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.070) 0:02:28.674 ***** 2021-10-20T23:15:18.608 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-10-20T23:15:18.610 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.637 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.036) 0:02:28.711 ***** 2021-10-20T23:15:18.656 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-20T23:15:18.658 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:18.686 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.046) 0:02:28.758 ***** 2021-10-20T23:15:18.692 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-10-20T23:15:18.693 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.727 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.042) 0:02:28.800 ***** 2021-10-20T23:15:18.736 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-20T23:15:18.740 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.775 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.045) 0:02:28.846 ***** 2021-10-20T23:15:18.797 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.025) 0:02:28.871 ***** 2021-10-20T23:15:18.806 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-10-20T23:15:18.808 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.834 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.036) 0:02:28.908 ***** 2021-10-20T23:15:18.844 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-10-20T23:15:18.846 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.879 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.044) 0:02:28.953 ***** 2021-10-20T23:15:18.885 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-10-20T23:15:18.887 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.916 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.037) 0:02:28.990 ***** 2021-10-20T23:15:18.927 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.952 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.036) 0:02:29.026 ***** 2021-10-20T23:15:18.960 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-10-20T23:15:18.961 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:18.990 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:18 +0000 (0:00:00.037) 0:02:29.064 ***** 2021-10-20T23:15:18.998 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:19.000 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-20T23:15:19.034 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.042) 0:02:29.106 ***** 2021-10-20T23:15:19.044 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-10-20T23:15:19.046 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.071 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.038) 0:02:29.145 ***** 2021-10-20T23:15:19.079 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-10-20T23:15:19.081 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.106 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.035) 0:02:29.180 ***** 2021-10-20T23:15:19.148 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi119.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.174 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.067) 0:02:29.248 ***** 2021-10-20T23:15:19.182 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-10-20T23:15:19.184 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.184 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-10-20T23:15:19.185 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-10-20T23:15:19.186 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi119.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.188 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi119.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.214 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.040) 0:02:29.288 ***** 2021-10-20T23:15:19.218 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:19.224 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:19.225 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-20T23:15:19.227 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi119.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.228 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.228 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.229 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.229 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.264 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.049) 0:02:29.338 ***** 2021-10-20T23:15:19.289 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.024) 0:02:29.363 ***** 2021-10-20T23:15:19.296 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-10-20T23:15:19.298 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.327 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.037) 0:02:29.400 ***** 2021-10-20T23:15:19.377 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-10-20T23:15:19.379 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.389 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.390 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.401 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.403 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.413 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:19.415 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** ok: [smithi136.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-10-20T23:15:19.440 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.113) 0:02:29.513 ***** 2021-10-20T23:15:19.454 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.456 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.457 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.469 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.471 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.503 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.063) 0:02:29.577 ***** 2021-10-20T23:15:19.522 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003997", "end": "2021-10-20 23:15:19.490577", "rc": 0, "start": "2021-10-20 23:15:19.486580", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock"]} 2021-10-20T23:15:19.556 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.051) 0:02:29.629 ***** 2021-10-20T23:15:19.562 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-10-20T23:15:19.563 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.565 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.569 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.593 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi031.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.609 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.619 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.632 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.639 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-10-20T23:15:19.641 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.675 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.120) 0:02:29.750 ***** 2021-10-20T23:15:19.706 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.029) 0:02:29.779 ***** 2021-10-20T23:15:19.733 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.027) 0:02:29.807 ***** 2021-10-20T23:15:19.778 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003576", "end": "2021-10-20 23:15:19.741748", "rc": 0, "start": "2021-10-20 23:15:19.738172", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock"]} 2021-10-20T23:15:19.810 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.076) 0:02:29.883 ***** 2021-10-20T23:15:19.815 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-10-20T23:15:19.817 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.846 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.035) 0:02:29.919 ***** 2021-10-20T23:15:19.865 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-20T23:15:19.866 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:19.923 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.076) 0:02:29.995 ***** 2021-10-20T23:15:19.934 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.977 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:19 +0000 (0:00:00.055) 0:02:30.051 ***** 2021-10-20T23:15:19.990 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-10-20T23:15:19.991 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:19.992 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:19.994 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-10-20T23:15:19.996 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.007115", "end": "2021-10-20 23:15:19.960062", "rc": 0, "start": "2021-10-20 23:15:19.952947", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock"]} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.024 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.046) 0:02:30.098 ***** 2021-10-20T23:15:20.052 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.028) 0:02:30.126 ***** 2021-10-20T23:15:20.079 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.027) 0:02:30.153 ***** 2021-10-20T23:15:20.088 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.119 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.039) 0:02:30.193 ***** 2021-10-20T23:15:20.125 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-10-20T23:15:20.126 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.127 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.153 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.034) 0:02:30.227 ***** 2021-10-20T23:15:20.180 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.026) 0:02:30.254 ***** 2021-10-20T23:15:20.199 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.227 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.047) 0:02:30.301 ***** 2021-10-20T23:15:20.229 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:20.235 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-10-20T23:15:20.237 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.263 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.036) 0:02:30.337 ***** 2021-10-20T23:15:20.271 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-10-20T23:15:20.273 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.301 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.036) 0:02:30.374 ***** 2021-10-20T23:15:20.343 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.367 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.067) 0:02:30.441 ***** 2021-10-20T23:15:20.385 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-10-20T23:15:20.387 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.411 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.043) 0:02:30.485 ***** 2021-10-20T23:15:20.453 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.484 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.072) 0:02:30.558 ***** 2021-10-20T23:15:20.555 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:20.557 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-20T23:15:20.586 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.101) 0:02:30.660 ***** 2021-10-20T23:15:20.669 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-10-20T23:15:20.671 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.681 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.682 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.692 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.694 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.704 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.715 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi012.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.727 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.738 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.740 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.749 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.751 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.761 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.790 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.203) 0:02:30.863 ***** 2021-10-20T23:15:20.797 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-10-20T23:15:20.799 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:15:20.825 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.035) 0:02:30.899 ***** 2021-10-20T23:15:20.906 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:20.908 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:20.938 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.106) 0:02:31.006 ***** 2021-10-20T23:15:20.962 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-10-20T23:15:20.964 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:15:20.990 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:20 +0000 (0:00:00.058) 0:02:31.064 ***** 2021-10-20T23:15:21.041 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:15:21.045 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item={'block_used': 14045278, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049830, 'size_available': 925900103680, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049830, "block_size": 4096, "block_total": 240095108, "block_used": 14045278, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900103680, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-10-20T23:15:21.070 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.078) 0:02:31.143 ***** 2021-10-20T23:15:21.077 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-10-20T23:15:21.078 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003737", "end": "2021-10-20 23:15:21.023324", "rc": 0, "start": "2021-10-20 23:15:21.019587", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock"]} 2021-10-20T23:15:21.080 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:21.110 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.040) 0:02:31.184 ***** 2021-10-20T23:15:21.111 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:21.140 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.030) 0:02:31.214 ***** 2021-10-20T23:15:21.163 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:15:21.194 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.052) 0:02:31.267 ***** 2021-10-20T23:15:21.201 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-10-20T23:15:21.201 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:21.234 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.040) 0:02:31.308 ***** 2021-10-20T23:15:21.247 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:15:21.250 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'block_used': 14045288, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049820, 'size_available': 925900062720, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049820, "block_size": 4096, "block_total": 240095108, "block_used": 14045288, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900062720, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-10-20T23:15:21.290 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.054) 0:02:31.362 ***** 2021-10-20T23:15:21.297 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:21.330 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.041) 0:02:31.403 ***** 2021-10-20T23:15:21.340 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-10-20T23:15:21.341 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:21.368 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.038) 0:02:31.442 ***** 2021-10-20T23:15:21.432 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi031.front.sepia.ceph.com] => (item={'block_used': 14045297, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049811, 'size_available': 925900025856, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187092, 'block_size': 4096, 'inode_available': 60867884}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049811, "block_size": 4096, "block_total": 240095108, "block_used": 14045297, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867884, "inode_total": 61054976, "inode_used": 187092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900025856, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-10-20T23:15:21.461 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.092) 0:02:31.535 ***** 2021-10-20T23:15:21.468 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-10-20T23:15:21.470 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009372", "end": "2021-10-20 23:15:21.430230", "rc": 0, "start": "2021-10-20 23:15:21.420858", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:21.497 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.036) 0:02:31.571 ***** 2021-10-20T23:15:21.520 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.022) 0:02:31.594 ***** 2021-10-20T23:15:21.528 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009490", "end": "2021-10-20 23:15:21.462361", "rc": 0, "start": "2021-10-20 23:15:21.452871", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:21.562 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.042) 0:02:31.636 ***** 2021-10-20T23:15:21.603 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-10-20T23:15:21.605 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'block_used': 14045278, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049830, 'size_available': 925900103680, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049830, "block_size": 4096, "block_total": 240095108, "block_used": 14045278, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900103680, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:21.631 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.068) 0:02:31.705 ***** 2021-10-20T23:15:21.661 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-10-20T23:15:21.662 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009350", "end": "2021-10-20 23:15:21.633241", "rc": 0, "start": "2021-10-20 23:15:21.623891", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:21.664 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi136.front.sepia.ceph.com] => (item={'block_used': 14045288, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049820, 'size_available': 925900062720, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049820, "block_size": 4096, "block_total": 240095108, "block_used": 14045288, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900062720, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:21.691 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.059) 0:02:31.765 ***** 2021-10-20T23:15:21.721 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.029) 0:02:31.794 ***** 2021-10-20T23:15:21.860 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-20T23:15:21.890 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.168) 0:02:31.963 ***** 2021-10-20T23:15:21.938 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-10-20T23:15:21.940 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'block_used': 14045297, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049811, 'size_available': 925900025856, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187092, 'block_size': 4096, 'inode_available': 60867884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049811, "block_size": 4096, "block_total": 240095108, "block_used": 14045297, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867884, "inode_total": 61054976, "inode_used": 187092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900025856, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:21.964 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.075) 0:02:32.038 ***** 2021-10-20T23:15:21.972 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-20T23:15:22.003 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:21 +0000 (0:00:00.038) 0:02:32.077 ***** 2021-10-20T23:15:22.151 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:15:22.153 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:22.208 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-20T23:15:22.362 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:22 +0000 (0:00:00.358) 0:02:32.436 ***** 2021-10-20T23:15:22.369 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:15:22.370 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:15:22.371 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:22.398 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:22 +0000 (0:00:00.036) 0:02:32.473 ***** 2021-10-20T23:15:22.450 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:22.472 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-10-20T23:15:22.474 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:22.496 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:22 +0000 (0:00:00.097) 0:02:32.571 ***** 2021-10-20T23:15:22.580 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi012.front.sepia.ceph.com] => (item={'block_used': 14045275, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049833, 'size_available': 925900115968, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187092, 'block_size': 4096, 'inode_available': 60867884}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049833, "block_size": 4096, "block_total": 240095108, "block_used": 14045275, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867884, "inode_total": 61054976, "inode_used": 187092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900115968, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-10-20T23:15:22.605 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:22 +0000 (0:00:00.108) 0:02:32.679 ***** 2021-10-20T23:15:22.793 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.007885", "end": "2021-10-20 23:15:22.775168", "rc": 0, "start": "2021-10-20 23:15:22.767283", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:22.819 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:22 +0000 (0:00:00.213) 0:02:32.893 ***** 2021-10-20T23:15:22.912 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-10-20T23:15:22.914 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'block_used': 14045275, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049833, 'size_available': 925900115968, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187092, 'block_size': 4096, 'inode_available': 60867884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049833, "block_size": 4096, "block_total": 240095108, "block_used": 14045275, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867884, "inode_total": 61054976, "inode_used": 187092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900115968, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:22.938 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:22 +0000 (0:00:00.118) 0:02:33.012 ***** 2021-10-20T23:15:23.009 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-20T23:15:23.034 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:23 +0000 (0:00:00.094) 0:02:33.107 ***** 2021-10-20T23:15:23.137 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:15:23.138 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:24.032 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5duF8182lwUHYFaWTVr3seu20X1Gu10Yn'], 'uuids': ['bf98d139-37b1-4b9f-ac66-c97bc2e95c38']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.629636", "end": "2021-10-20 23:15:23.996522", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5duF8182lwUHYFaWTVr3seu20X1Gu10Yn"], "labels": [], "masters": [], "uuids": ["bf98d139-37b1-4b9f-ac66-c97bc2e95c38"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:22.366886", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:24.034 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHhwt6GZM0FYDzoyaMKVeuade03lWpwURq'], 'uuids': ['201f2eee-e876-4c06-8361-aafd8dcbc39a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.742410", "end": "2021-10-20 23:15:24.000170", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHhwt6GZM0FYDzoyaMKVeuade03lWpwURq"], "labels": [], "masters": [], "uuids": ["201f2eee-e876-4c06-8361-aafd8dcbc39a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:22.257760", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:24.035 INFO:teuthology.task.ansible.out:skipping: [smithi136.front 2021-10-20T23:15:24.037 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:24.049 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:24.050 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:24.105 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmInbXFsoFBxffqTGjlSB22HeP7suVleeP'], 'uuids': ['7a4d4ab6-544a-43ea-9669-5d47dfe875b2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.515365", "end": "2021-10-20 23:15:24.068809", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmInbXFsoFBxffqTGjlSB22HeP7suVleeP"], "labels": [], "masters": [], "uuids": ["7a4d4ab6-544a-43ea-9669-5d47dfe875b2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:22.553444", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:24.118 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:24.957 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufI6OWlPZe1UpPDp2IWsRYCDJfuAhDWlu4I'], 'uuids': ['f9d29cc9-7cc8-4a78-827e-3474f6420731']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.686664", "end": "2021-10-20 23:15:24.926693", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufI6OWlPZe1UpPDp2IWsRYCDJfuAhDWlu4I"], "labels": [], "masters": [], "uuids": ["f9d29cc9-7cc8-4a78-827e-3474f6420731"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:23.240029", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:24.969 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:24.970 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:25.314 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHqD27VfPvInaCpxXWw0rXF7Nses2Mtvr4'], 'uuids': ['d650f8f7-56ff-46ec-afe4-a07bcf19099a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.141764", "end": "2021-10-20 23:15:25.285937", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHqD27VfPvInaCpxXWw0rXF7Nses2Mtvr4"], "labels": [], "masters": [], "uuids": ["d650f8f7-56ff-46ec-afe4-a07bcf19099a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:24.144173", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:25.332 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5m9JG0TllILPvCcjYM50BT2IbUHEVZmMS'], 'uuids': ['3dd4beb8-1ca3-4dfa-b16d-65edf5397aac']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.148679", "end": "2021-10-20 23:15:25.293751", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5m9JG0TllILPvCcjYM50BT2IbUHEVZmMS"], "labels": [], "masters": [], "uuids": ["3dd4beb8-1ca3-4dfa-b16d-65edf5397aac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:24.145072", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi119.front 2021-10-20T23:15:25.341 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L6V0', 'wwn-0x5000c500918d7b11'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L6V0-part1', 'wwn-0x5000c500918d7b11-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918d7b11', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5L6V0', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L6V0", "wwn-0x5000c500918d7b11"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L6V0-part1", "wwn-0x5000c500918d7b11-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5L6V0", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918d7b11"}}, "skip_reason": "Condition 2021-10-20T23:15:25.349 INFO:teuthology.task.ansible.out:al result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKJ', 'wwn-0x5000c5009293d5e8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKJ-part1', 'wwn-0x5000c5009293d5e8-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293d5e8', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTKJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKJ", "wwn-0x5000c5009293d5e8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKJ-part1", "wwn-0x5000c5009293d5e8-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTKJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": 2021-10-20T23:15:25.350 INFO:teuthology.task.ansible.out:"0x5000c5009293d5e8"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:25.473 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmYfDBSObiNeLWnc8OOvLfvZe85wUZvUZR'], 'uuids': ['9c9c2ba6-8d1e-4fcd-b150-9f7240729203']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.218439", "end": "2021-10-20 23:15:25.437135", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmYfDBSObiNeLWnc8OOvLfvZe85wUZvUZR"], "labels": [], "masters": [], "uuids": ["9c9c2ba6-8d1e-4fcd-b150-9f7240729203"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:24.218696", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi031.front 2021-10-20T23:15:25.475 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW', 'wwn-0x5000c500871a7b41'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1', 'wwn-0x5000c500871a7b41-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a7b41', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQEW', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW", "wwn-0x5000c500871a7b41"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1", "wwn-0x5000c500871a7b41-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQEW", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a7b41"}}, "skip_reason": "Condition 2021-10-20T23:15:25.477 INFO:teuthology.task.ansible.out:al result was False"} 2021-10-20T23:15:26.255 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIjpzdg2x8C1rXa6WfZpDj6m05zyqcpz06'], 'uuids': ['cd933993-d283-4fef-9d43-c2a58c2680ce']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.135466", "end": "2021-10-20 23:15:26.208134", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIjpzdg2x8C1rXa6WfZpDj6m05zyqcpz06"], "labels": [], "masters": [], "uuids": ["cd933993-d283-4fef-9d43-c2a58c2680ce"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:25.072668", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:26.256 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HP5L', 'wwn-0x5000c500871ab419'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HP5L-part1', 'wwn-0x5000c500871ab419-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871ab419', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HP5L', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HP5L", "wwn-0x5000c500871ab419"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HP5L-part1", "wwn-0x5000c500871ab419-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HP5L", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871ab419"}}, 2021-10-20T23:15:26.258 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:15:26.630 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '3907029168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-MwEXvU-yE4e-hN4I-fof2-fQ6J-zhEw-axoDeO', 'nvme-INTEL_SSDPEDMX020T4_CVPD514100122P0SGN', 'nvme-nvme.8086-43565044353134313030313232503053474e-494e54454c205353445045444d583032305434-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMX020T4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '1.82 TB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.166416", "end": "2021-10-20 23:15:26.602106", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-MwEXvU-yE4e-hN4I-fof2-fQ6J-zhEw-axoDeO", "nvme-INTEL_SSDPEDMX020T4_CVPD514100122P0SGN", "nvme-nvme.8086-43565044353134313030313232503053474e-494e54454c205353445045444d583032305434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMX020T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3907029168", "sectorsize": "512", "size": "1.82 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:25.435690", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures des 2021-10-20T23:15:26.632 INFO:teuthology.task.ansible.out:troyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:26.647 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:26.654 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:26.666 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-gNvb9e-bSYV-YWEu-lFNX-SPKN-9nsB-1mAK02', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN', 'nvme-nvme.8086-50484654363230343030593134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.199030", "end": "2021-10-20 23:15:26.625737", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-gNvb9e-bSYV-YWEu-lFNX-SPKN-9nsB-1mAK02", "nvme-INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN", "nvme-nvme.8086-50484654363230343030593134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:25.426707", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-10-20T23:15:26.668 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:26.678 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:26.679 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:26.804 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-FAkmGZ-WUL5-brT7-fG4E-t267-B5cv-aJW7fd', 'nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN', 'nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.191773", "end": "2021-10-20 23:15:26.769022", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-FAkmGZ-WUL5-brT7-fG4E-t267-B5cv-aJW7fd", "nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN", "nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:25.577249", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-10-20T23:15:26.806 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:26.808 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:26.819 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:27.554 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-fOBFwc-m20V-wRN9-Wi8y-wU9j-lURX-q9yjVN', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331005J400BGN', 'nvme-nvme.8086-43564654353333313030354a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.146186", "end": "2021-10-20 23:15:27.517342", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-fOBFwc-m20V-wRN9-Wi8y-wU9j-lURX-q9yjVN", "nvme-INTEL_SSDPEDMD400G4_CVFT5331005J400BGN", "nvme-nvme.8086-43564654353333313030354a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:26.371156", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-10-20T23:15:27.556 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:27.566 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:27.568 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:27.966 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5L8SJ2zJqZUPEOGPsAXM8FKns6BHRib4O'], 'uuids': ['8b7de6f7-41a5-4b46-83f0-7d708a7c1370']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.175418", "end": "2021-10-20 23:15:27.931359", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5L8SJ2zJqZUPEOGPsAXM8FKns6BHRib4O"], "labels": [], "masters": [], "uuids": ["8b7de6f7-41a5-4b46-83f0-7d708a7c1370"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:26.755941", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:27.976 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:27.982 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHF2ZiI16ZSh0F9S1HKgKDrC3sG8GPmBK8'], 'uuids': ['06992bf7-8e26-4853-b015-978f22b8bb70']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.158641", "end": "2021-10-20 23:15:27.947665", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHF2ZiI16ZSh0F9S1HKgKDrC3sG8GPmBK8"], "labels": [], "masters": [], "uuids": ["06992bf7-8e26-4853-b015-978f22b8bb70"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:26.789024", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:27.989 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:28.002 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:28.004 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:28.143 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmloFV6xufFM1Uw5ySsuQDqvYUEg4PDrmF'], 'uuids': ['a6484474-5b8f-4e50-9ebb-c8f8e50a4395']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.189874", "end": "2021-10-20 23:15:28.109523", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmloFV6xufFM1Uw5ySsuQDqvYUEg4PDrmF"], "labels": [], "masters": [], "uuids": ["a6484474-5b8f-4e50-9ebb-c8f8e50a4395"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:26.919649", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:28.146 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:28.158 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:28.880 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIr4vrgofH9srH9ZV5S90Py7ygGA2BCr5E'], 'uuids': ['5e2d7546-625f-4013-a71d-9843e51883fc']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.164315", "end": "2021-10-20 23:15:28.842435", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIr4vrgofH9srH9ZV5S90Py7ygGA2BCr5E"], "labels": [], "masters": [], "uuids": ["5e2d7546-625f-4013-a71d-9843e51883fc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:27.678120", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:28.881 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:28.893 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:29.254 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5dXQ9xYz8uCPVGV7p7qB1gySwkuURYDD3'], 'uuids': ['d014cef8-89e4-4f19-ab96-82160be65581']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.144785", "end": "2021-10-20 23:15:29.225499", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5dXQ9xYz8uCPVGV7p7qB1gySwkuURYDD3"], "labels": [], "masters": [], "uuids": ["d014cef8-89e4-4f19-ab96-82160be65581"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:28.080714", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:29.266 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:29.290 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHQAajFtddiVPEN0NW16Q0tpLTbYIgl2jg'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.151996", "end": "2021-10-20 23:15:29.252134", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHQAajFtddiVPEN0NW16Q0tpLTbYIgl2jg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:28.100138", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:29.302 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:29.550 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmR1wbgbPfw0o7RM6tSpf1hV3cOKA78ZRa'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.257400", "end": "2021-10-20 23:15:29.518606", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmR1wbgbPfw0o7RM6tSpf1hV3cOKA78ZRa"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:28.261206", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:29.563 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:30.185 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIaoFdkGYmY6giYIz8xiufNtXK2B0bvPUC'], 'uuids': ['479c435a-1a62-4d8a-96e1-1362d6c7b5ef']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.160287", "end": "2021-10-20 23:15:30.151558", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIaoFdkGYmY6giYIz8xiufNtXK2B0bvPUC"], "labels": [], "masters": [], "uuids": ["479c435a-1a62-4d8a-96e1-1362d6c7b5ef"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:28.991271", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:30.186 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:30.547 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5SWx7g7zvPeUTIkzcfZfUUByASRgNbHYz'], 'uuids': ['9e6dfc5f-d221-44cf-9400-3fee8a048efc']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.140665", "end": "2021-10-20 23:15:30.509308", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5SWx7g7zvPeUTIkzcfZfUUByASRgNbHYz"], "labels": [], "masters": [], "uuids": ["9e6dfc5f-d221-44cf-9400-3fee8a048efc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:29.368643", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:30.573 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHCPTXRcDdN5kqEcGvf8el14eBXAllR8B2'], 'uuids': ['b0d729ce-989d-4213-93bc-251e7eb42487']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.136301", "end": "2021-10-20 23:15:30.531964", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHCPTXRcDdN5kqEcGvf8el14eBXAllR8B2"], "labels": [], "masters": [], "uuids": ["b0d729ce-989d-4213-93bc-251e7eb42487"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:29.395663", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:30.598 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:30 +0000 (0:00:07.565) 0:02:40.672 ***** 2021-10-20T23:15:30.645 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:30 +0000 (0:00:00.047) 0:02:40.719 ***** 2021-10-20T23:15:30.711 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:15:30.713 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:30.735 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:30.962 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5duF8182lwUHYFaWTVr3seu20X1Gu10Yn'], 'uuids': ['bf98d139-37b1-4b9f-ac66-c97bc2e95c38']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.119784", "end": "2021-10-20 23:15:30.935818", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5duF8182lwUHYFaWTVr3seu20X1Gu10Yn"], "labels": [], "masters": [], "uuids": ["bf98d139-37b1-4b9f-ac66-c97bc2e95c38"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:30.816034", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.11479 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.11479 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:30.974 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:30.976 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmO9MEYhELFyMLkQT0plJuBgmvXQP81j3Z'], 'uuids': ['01f02b5d-a71e-403f-a2df-033bf61c895d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.273609", "end": "2021-10-20 23:15:30.945267", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmO9MEYhELFyMLkQT0plJuBgmvXQP81j3Z"], "labels": [], "masters": [], "uuids": ["01f02b5d-a71e-403f-a2df-033bf61c895d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:29.671658", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now 2021-10-20T23:15:30.977 INFO:teuthology.task.ansible.out:partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:30.999 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:15:31.001 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.026 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:31 +0000 (0:00:00.381) 0:02:41.101 ***** 2021-10-20T23:15:31.060 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHhwt6GZM0FYDzoyaMKVeuade03lWpwURq'], 'uuids': ['201f2eee-e876-4c06-8361-aafd8dcbc39a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.166675", "end": "2021-10-20 23:15:31.014428", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHhwt6GZM0FYDzoyaMKVeuade03lWpwURq"], "labels": [], "masters": [], "uuids": ["201f2eee-e876-4c06-8361-aafd8dcbc39a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:30.847753", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161742 s, 713 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161742 s, 713 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.062 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.072 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.138 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.236 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5m9JG0TllILPvCcjYM50BT2IbUHEVZmMS'], 'uuids': ['3dd4beb8-1ca3-4dfa-b16d-65edf5397aac']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.116500", "end": "2021-10-20 23:15:31.196192", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5m9JG0TllILPvCcjYM50BT2IbUHEVZmMS"], "labels": [], "masters": [], "uuids": ["3dd4beb8-1ca3-4dfa-b16d-65edf5397aac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.079692", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.111531 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.111531 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.244 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKJ', 'wwn-0x5000c5009293d5e8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKJ-part1', 'wwn-0x5000c5009293d5e8-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293d5e8', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTKJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKJ", "wwn-0x5000c5009293d5e8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKJ-part1", "wwn-0x5000c5009293d5e8-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTKJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d5e8"}}, 2021-10-20T23:15:31.246 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.385 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHqD27VfPvInaCpxXWw0rXF7Nses2Mtvr4'], 'uuids': ['d650f8f7-56ff-46ec-afe4-a07bcf19099a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.166808", "end": "2021-10-20 23:15:31.353659", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHqD27VfPvInaCpxXWw0rXF7Nses2Mtvr4"], "labels": [], "masters": [], "uuids": ["d650f8f7-56ff-46ec-afe4-a07bcf19099a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.186851", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161847 s, 713 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161847 s, 713 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.397 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L6V0', 'wwn-0x5000c500918d7b11'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L6V0-part1', 'wwn-0x5000c500918d7b11-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918d7b11', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5L6V0', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L6V0", "wwn-0x5000c500918d7b11"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L6V0-part1", "wwn-0x5000c500918d7b11-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5L6V0", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918d7b11"}}, 2021-10-20T23:15:31.399 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.420 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '3907029168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-MwEXvU-yE4e-hN4I-fof2-fQ6J-zhEw-axoDeO', 'nvme-INTEL_SSDPEDMX020T4_CVPD514100122P0SGN', 'nvme-nvme.8086-43565044353134313030313232503053474e-494e54454c205353445045444d583032305434-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMX020T4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '1.82 TB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.056675", "end": "2021-10-20 23:15:31.388120", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-MwEXvU-yE4e-hN4I-fof2-fQ6J-zhEw-axoDeO", "nvme-INTEL_SSDPEDMX020T4_CVPD514100122P0SGN", "nvme-nvme.8086-43565044353134313030313232503053474e-494e54454c205353445045444d583032305434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMX020T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3907029168", "sectorsize": "512", "size": "1.82 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.331445", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0519533 s, 2.2 GB/s", "stder 2021-10-20T23:15:31.422 INFO:teuthology.task.ansible.out:r_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0519533 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.432 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.434 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmInbXFsoFBxffqTGjlSB22HeP7suVleeP'], 'uuids': ['7a4d4ab6-544a-43ea-9669-5d47dfe875b2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.160790", "end": "2021-10-20 23:15:31.407783", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmInbXFsoFBxffqTGjlSB22HeP7suVleeP"], "labels": [], "masters": [], "uuids": ["7a4d4ab6-544a-43ea-9669-5d47dfe875b2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.246993", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155713 s, 741 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155713 s, 741 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.445 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.446 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.457 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.470 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIceygSO47cWzm58opXaSCiFn2LvAKl1Qw'], 'uuids': ['1e8e3918-e2aa-4422-8a21-74006b4218a1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.141697", "end": "2021-10-20 23:15:31.435733", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIceygSO47cWzm58opXaSCiFn2LvAKl1Qw"], "labels": [], "masters": [], "uuids": ["1e8e3918-e2aa-4422-8a21-74006b4218a1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:30.294036", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now 2021-10-20T23:15:31.472 INFO:teuthology.task.ansible.out:partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:15:31.510 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:31 +0000 (0:00:00.479) 0:02:41.581 ***** 2021-10-20T23:15:31.592 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:15:31.595 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-gNvb9e-bSYV-YWEu-lFNX-SPKN-9nsB-1mAK02', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN', 'nvme-nvme.8086-50484654363230343030593134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.057637", "end": "2021-10-20 23:15:31.565850", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-gNvb9e-bSYV-YWEu-lFNX-SPKN-9nsB-1mAK02", "nvme-INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN", "nvme-nvme.8086-50484654363230343030593134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.508213", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0527218 s, 2.2 GB/s", "std 2021-10-20T23:15:31.598 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0527218 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.609 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.614 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.615 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.703 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5L8SJ2zJqZUPEOGPsAXM8FKns6BHRib4O'], 'uuids': ['8b7de6f7-41a5-4b46-83f0-7d708a7c1370']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.117920", "end": "2021-10-20 23:15:31.668788", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5L8SJ2zJqZUPEOGPsAXM8FKns6BHRib4O"], "labels": [], "masters": [], "uuids": ["8b7de6f7-41a5-4b46-83f0-7d708a7c1370"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.550868", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.113625 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.113625 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.705 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.715 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.748 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmYfDBSObiNeLWnc8OOvLfvZe85wUZvUZR'], 'uuids': ['9c9c2ba6-8d1e-4fcd-b150-9f7240729203']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.161576", "end": "2021-10-20 23:15:31.717620", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmYfDBSObiNeLWnc8OOvLfvZe85wUZvUZR"], "labels": [], "masters": [], "uuids": ["9c9c2ba6-8d1e-4fcd-b150-9f7240729203"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.556044", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15669 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15669 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.760 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW', 'wwn-0x5000c500871a7b41'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1', 'wwn-0x5000c500871a7b41-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a7b41', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQEW', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW", "wwn-0x5000c500871a7b41"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1", "wwn-0x5000c500871a7b41-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQEW", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a7b41"}}, 2021-10-20T23:15:31.762 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.889 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHF2ZiI16ZSh0F9S1HKgKDrC3sG8GPmBK8'], 'uuids': ['06992bf7-8e26-4853-b015-978f22b8bb70']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.148896", "end": "2021-10-20 23:15:31.856259", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHF2ZiI16ZSh0F9S1HKgKDrC3sG8GPmBK8"], "labels": [], "masters": [], "uuids": ["06992bf7-8e26-4853-b015-978f22b8bb70"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.707363", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14443 s, 799 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14443 s, 799 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.901 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufI6OWlPZe1UpPDp2IWsRYCDJfuAhDWlu4I'], 'uuids': ['f9d29cc9-7cc8-4a78-827e-3474f6420731']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.172242", "end": "2021-10-20 23:15:31.869098", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufI6OWlPZe1UpPDp2IWsRYCDJfuAhDWlu4I"], "labels": [], "masters": [], "uuids": ["f9d29cc9-7cc8-4a78-827e-3474f6420731"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.696856", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.167285 s, 690 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.167285 s, 690 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.903 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.914 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.916 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.949 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-FAkmGZ-WUL5-brT7-fG4E-t267-B5cv-aJW7fd', 'nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN', 'nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.058882", "end": "2021-10-20 23:15:31.917381", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-FAkmGZ-WUL5-brT7-fG4E-t267-B5cv-aJW7fd", "nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN", "nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.858499", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0538517 s, 2.1 GB/s", "std 2021-10-20T23:15:31.951 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0538517 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:31.961 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.973 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:31.995 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5dXQ9xYz8uCPVGV7p7qB1gySwkuURYDD3'], 'uuids': ['d014cef8-89e4-4f19-ab96-82160be65581']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.123791", "end": "2021-10-20 23:15:31.956330", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5dXQ9xYz8uCPVGV7p7qB1gySwkuURYDD3"], "labels": [], "masters": [], "uuids": ["d014cef8-89e4-4f19-ab96-82160be65581"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:31.832539", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.119001 s, 969 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.119001 s, 969 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.007 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:32.202 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHQAajFtddiVPEN0NW16Q0tpLTbYIgl2jg'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.151842", "end": "2021-10-20 23:15:32.170420", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHQAajFtddiVPEN0NW16Q0tpLTbYIgl2jg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.018578", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14837 s, 777 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14837 s, 777 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.213 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:32.215 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIjpzdg2x8C1rXa6WfZpDj6m05zyqcpz06'], 'uuids': ['cd933993-d283-4fef-9d43-c2a58c2680ce']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.163963", "end": "2021-10-20 23:15:32.180784", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIjpzdg2x8C1rXa6WfZpDj6m05zyqcpz06"], "labels": [], "masters": [], "uuids": ["cd933993-d283-4fef-9d43-c2a58c2680ce"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.016821", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159052 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159052 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.231 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HP5L', 'wwn-0x5000c500871ab419'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HP5L-part1', 'wwn-0x5000c500871ab419-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871ab419', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HP5L', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HP5L", "wwn-0x5000c500871ab419"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HP5L-part1", "wwn-0x5000c500871ab419-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HP5L", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871ab419"}}, 2021-10-20T23:15:32.234 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:15:32.254 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5SWx7g7zvPeUTIkzcfZfUUByASRgNbHYz'], 'uuids': ['9e6dfc5f-d221-44cf-9400-3fee8a048efc']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.111656", "end": "2021-10-20 23:15:32.214602", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-UuhFKQ5beXdjylhDeMxEVmG2n2ZcG2g5SWx7g7zvPeUTIkzcfZfUUByASRgNbHYz"], "labels": [], "masters": [], "uuids": ["9e6dfc5f-d221-44cf-9400-3fee8a048efc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.102946", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.106792 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.106792 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.270 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmloFV6xufFM1Uw5ySsuQDqvYUEg4PDrmF'], 'uuids': ['a6484474-5b8f-4e50-9ebb-c8f8e50a4395']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.161568", "end": "2021-10-20 23:15:32.227068", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmloFV6xufFM1Uw5ySsuQDqvYUEg4PDrmF"], "labels": [], "masters": [], "uuids": ["a6484474-5b8f-4e50-9ebb-c8f8e50a4395"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.065500", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156713 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156713 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.309 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:32 +0000 (0:00:00.797) 0:02:42.378 ***** 2021-10-20T23:15:32.319 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:32.408 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-fOBFwc-m20V-wRN9-Wi8y-wU9j-lURX-q9yjVN', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331005J400BGN', 'nvme-nvme.8086-43564654353333313030354a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.056285", "end": "2021-10-20 23:15:32.381757", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-fOBFwc-m20V-wRN9-Wi8y-wU9j-lURX-q9yjVN", "nvme-INTEL_SSDPEDMD400G4_CVFT5331005J400BGN", "nvme-nvme.8086-43564654353333313030354a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.325472", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0514327 s, 2.2 GB/s", "std 2021-10-20T23:15:32.410 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0514327 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.422 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:32.433 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:32.518 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHCPTXRcDdN5kqEcGvf8el14eBXAllR8B2'], 'uuids': ['b0d729ce-989d-4213-93bc-251e7eb42487']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.160501", "end": "2021-10-20 23:15:32.483537", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CnAuRyoFiNdJZown3wSlWgJITdaonuuHCPTXRcDdN5kqEcGvf8el14eBXAllR8B2"], "labels": [], "masters": [], "uuids": ["b0d729ce-989d-4213-93bc-251e7eb42487"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.323036", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15727 s, 733 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15727 s, 733 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.565 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:32 +0000 (0:00:00.255) 0:02:42.634 ***** 2021-10-20T23:15:32.619 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmR1wbgbPfw0o7RM6tSpf1hV3cOKA78ZRa'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.166216", "end": "2021-10-20 23:15:32.578405", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmR1wbgbPfw0o7RM6tSpf1hV3cOKA78ZRa"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.412189", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161309 s, 715 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161309 s, 715 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.634 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi136.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.113490", "end": "2021-10-20 23:15:32.538037", "rc": 0, "start": "2021-10-20 23:15:32.424547", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:32.663 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:32 +0000 (0:00:00.103) 0:02:42.738 ***** 2021-10-20T23:15:32.754 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIr4vrgofH9srH9ZV5S90Py7ygGA2BCr5E'], 'uuids': ['5e2d7546-625f-4013-a71d-9843e51883fc']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.161522", "end": "2021-10-20 23:15:32.711489", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIr4vrgofH9srH9ZV5S90Py7ygGA2BCr5E"], "labels": [], "masters": [], "uuids": ["5e2d7546-625f-4013-a71d-9843e51883fc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.549967", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156613 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156613 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.767 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:32.776 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:32.907 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-10-20T23:15:32.909 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.088336", "end": "2021-10-20 23:15:32.874993", "rc": 0, "start": "2021-10-20 23:15:32.786657", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.942 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:32 +0000 (0:00:00.276) 0:02:43.014 ***** 2021-10-20T23:15:32.948 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-10-20T23:15:32.950 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.135048", "end": "2021-10-20 23:15:32.829486", "rc": 0, "start": "2021-10-20 23:15:32.694438", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmO9MEYhELFyMLkQT0plJuBgmvXQP81j3Z'], 'uuids': ['01f02b5d-a71e-403f-a2df-033bf61c895d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.166354", "end": "2021-10-20 23:15:32.904965", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-by7xdhTMySQaLnc1wngSGFkjPsdBaulmO9MEYhELFyMLkQT0plJuBgmvXQP81j3Z"], "labels": [], "masters": [], "uuids": ["01f02b5d-a71e-403f-a2df-033bf61c895d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.738611", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161333 s, 715 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161333 s, 715 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:32.993 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:32 +0000 (0:00:00.052) 0:02:43.067 ***** 2021-10-20T23:15:33.036 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.042) 0:02:43.110 ***** 2021-10-20T23:15:33.046 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-20T23:15:33.130 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.093) 0:02:43.203 ***** 2021-10-20T23:15:33.141 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIaoFdkGYmY6giYIz8xiufNtXK2B0bvPUC'], 'uuids': ['479c435a-1a62-4d8a-96e1-1362d6c7b5ef']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.162815", "end": "2021-10-20 23:15:33.042189", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIaoFdkGYmY6giYIz8xiufNtXK2B0bvPUC"], "labels": [], "masters": [], "uuids": ["479c435a-1a62-4d8a-96e1-1362d6c7b5ef"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:32.879374", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157913 s, 730 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157913 s, 730 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'remov 2021-10-20T23:15:33.143 INFO:teuthology.task.ansible.out:able': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.163 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-10-20T23:15:33.164 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.190 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.061) 0:02:43.264 ***** 2021-10-20T23:15:33.230 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.253 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.063) 0:02:43.327 ***** 2021-10-20T23:15:33.273 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.082694", "end": "2021-10-20 23:15:33.242512", "rc": 0, "start": "2021-10-20 23:15:33.159818", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:33.296 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.043) 0:02:43.371 ***** 2021-10-20T23:15:33.304 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:15:33.305 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.338 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.041) 0:02:43.412 ***** 2021-10-20T23:15:33.347 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-20T23:15:33.349 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi031.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.133711", "end": "2021-10-20 23:15:33.248820", "rc": 0, "start": "2021-10-20 23:15:33.115109", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:33.381 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.043) 0:02:43.456 ***** 2021-10-20T23:15:33.414 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.031) 0:02:43.487 ***** 2021-10-20T23:15:33.423 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.424 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:15:33.425 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIceygSO47cWzm58opXaSCiFn2LvAKl1Qw'], 'uuids': ['1e8e3918-e2aa-4422-8a21-74006b4218a1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.158211", "end": "2021-10-20 23:15:33.373676", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-e01GgDW3znE1xbE1sJsTBnzCQHc9TufIceygSO47cWzm58opXaSCiFn2LvAKl1Qw"], "labels": [], "masters": [], "uuids": ["1e8e3918-e2aa-4422-8a21-74006b4218a1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:15:33.215465", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153268 s, 753 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153268 s, 753 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:33.444 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.469 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.055) 0:02:43.543 ***** 2021-10-20T23:15:33.499 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.029) 0:02:43.573 ***** 2021-10-20T23:15:33.529 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.026) 0:02:43.599 ***** 2021-10-20T23:15:33.545 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-10-20T23:15:33.549 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.571 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.046) 0:02:43.646 ***** 2021-10-20T23:15:33.600 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:15:33.602 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.639 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.067) 0:02:43.713 ***** 2021-10-20T23:15:33.650 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-10-20T23:15:33.652 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.085734", "end": "2021-10-20 23:15:33.581832", "rc": 0, "start": "2021-10-20 23:15:33.496098", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:33.683 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.044) 0:02:43.757 ***** 2021-10-20T23:15:33.695 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:33.697 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.739 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.056) 0:02:43.813 ***** 2021-10-20T23:15:33.773 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.034) 0:02:43.847 ***** 2021-10-20T23:15:33.787 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-20T23:15:33.788 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-10-20T23:15:33.790 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.120267", "end": "2021-10-20 23:15:33.704928", "rc": 0, "start": "2021-10-20 23:15:33.584661", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:33.821 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.048) 0:02:43.895 ***** 2021-10-20T23:15:33.866 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.044) 0:02:43.940 ***** 2021-10-20T23:15:33.878 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:15:33.882 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'block_used': 14045288, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049820, 'size_available': 925900062720, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049820, "block_size": 4096, "block_total": 240095108, "block_used": 14045288, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900062720, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.882 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-10-20T23:15:33.883 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:33.922 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.043) 0:02:43.984 ***** 2021-10-20T23:15:33.935 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.022) 0:02:44.007 ***** 2021-10-20T23:15:33.940 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-10-20T23:15:33.942 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.973 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:33 +0000 (0:00:00.040) 0:02:44.047 ***** 2021-10-20T23:15:33.981 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:15:33.983 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'block_used': 14045278, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049830, 'size_available': 925900103680, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049830, "block_size": 4096, "block_total": 240095108, "block_used": 14045278, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900103680, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:33.983 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.019 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.045) 0:02:44.092 ***** 2021-10-20T23:15:34.050 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.026) 0:02:44.119 ***** 2021-10-20T23:15:34.055 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.055 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-10-20T23:15:34.056 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.078288", "end": "2021-10-20 23:15:34.018019", "rc": 0, "start": "2021-10-20 23:15:33.939731", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:34.060 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.085 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.039) 0:02:44.159 ***** 2021-10-20T23:15:34.107 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.022) 0:02:44.182 ***** 2021-10-20T23:15:34.134 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.023) 0:02:44.206 ***** 2021-10-20T23:15:34.139 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:34.140 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.142 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.181 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.049) 0:02:44.255 ***** 2021-10-20T23:15:34.219 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.037) 0:02:44.293 ***** 2021-10-20T23:15:34.253 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.034) 0:02:44.327 ***** 2021-10-20T23:15:34.261 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.293 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.039) 0:02:44.367 ***** 2021-10-20T23:15:34.325 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.031) 0:02:44.399 ***** 2021-10-20T23:15:34.332 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-10-20T23:15:34.333 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.334 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.362 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.036) 0:02:44.435 ***** 2021-10-20T23:15:34.387 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.025) 0:02:44.461 ***** 2021-10-20T23:15:34.414 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.026) 0:02:44.488 ***** 2021-10-20T23:15:34.421 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:34.423 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.467 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.051) 0:02:44.539 ***** 2021-10-20T23:15:34.503 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.037) 0:02:44.576 ***** 2021-10-20T23:15:34.511 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.536 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.034) 0:02:44.610 ***** 2021-10-20T23:15:34.558 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.021) 0:02:44.632 ***** 2021-10-20T23:15:34.564 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-10-20T23:15:34.566 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.600 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.042) 0:02:44.674 ***** 2021-10-20T23:15:34.624 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.023) 0:02:44.698 ***** 2021-10-20T23:15:34.632 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-10-20T23:15:34.634 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.664 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.037) 0:02:44.735 ***** 2021-10-20T23:15:34.681 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi031.front.sepia.ceph.com] => (item={'block_used': 14045297, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049811, 'size_available': 925900025856, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187092, 'block_size': 4096, 'inode_available': 60867884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049811, "block_size": 4096, "block_total": 240095108, "block_used": 14045297, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867884, "inode_total": 61054976, "inode_used": 187092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900025856, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.683 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi012.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:15:34.712 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.047) 0:02:44.782 ***** 2021-10-20T23:15:34.731 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.022) 0:02:44.805 ***** 2021-10-20T23:15:34.755 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.023) 0:02:44.829 ***** 2021-10-20T23:15:34.766 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set root disk] ************************************************ skipping: [smithi012.front.sepia.ceph.com] => (item={'block_used': 14045275, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049833, 'size_available': 925900115968, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187092, 'block_size': 4096, 'inode_available': 60867884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049833, "block_size": 4096, "block_total": 240095108, "block_used": 14045275, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867884, "inode_total": 61054976, "inode_used": 187092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900115968, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.793 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.037) 0:02:44.866 ***** 2021-10-20T23:15:34.801 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-10-20T23:15:34.803 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.836 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.043) 0:02:44.910 ***** 2021-10-20T23:15:34.875 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.038) 0:02:44.949 ***** 2021-10-20T23:15:34.900 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.025) 0:02:44.974 ***** 2021-10-20T23:15:34.910 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-10-20T23:15:34.912 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:34.941 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.039) 0:02:45.014 ***** 2021-10-20T23:15:34.969 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:34 +0000 (0:00:00.025) 0:02:45.040 ***** 2021-10-20T23:15:34.987 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:35.026 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.059) 0:02:45.100 ***** 2021-10-20T23:15:35.035 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:35.037 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:35.066 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.039) 0:02:45.140 ***** 2021-10-20T23:15:35.074 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:35.103 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.036) 0:02:45.176 ***** 2021-10-20T23:15:35.111 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:35.156 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.046) 0:02:45.223 ***** 2021-10-20T23:15:35.161 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:35.208 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.058) 0:02:45.282 ***** 2021-10-20T23:15:35.224 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:35.263 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.055) 0:02:45.337 ***** 2021-10-20T23:15:35.271 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:35.300 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.036) 0:02:45.374 ***** 2021-10-20T23:15:35.308 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-10-20T23:15:35.311 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:35.338 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.038) 0:02:45.412 ***** 2021-10-20T23:15:35.349 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:35.385 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.040) 0:02:45.453 ***** 2021-10-20T23:15:35.633 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-20T23:15:35.677 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.298) 0:02:45.751 ***** 2021-10-20T23:15:35.689 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-20T23:15:35.720 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.042) 0:02:45.794 ***** 2021-10-20T23:15:35.912 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-20T23:15:35.986 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:35 +0000 (0:00:00.261) 0:02:46.055 ***** 2021-10-20T23:15:35.992 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-20T23:15:36.034 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:36 +0000 (0:00:00.053) 0:02:46.108 ***** 2021-10-20T23:15:36.390 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:15:36.391 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:36.435 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:36.437 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:36.477 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:36.542 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:36.754 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:36.841 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:36.897 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:36.954 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.160 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.256 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.293 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.339 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.533 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.705 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.714 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.762 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.922 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:37.948 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:37 +0000 (0:00:01.912) 0:02:48.021 ***** 2021-10-20T23:15:38.098 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-20T23:15:38.124 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.176) 0:02:48.198 ***** 2021-10-20T23:15:38.132 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:15:38.135 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:38.137 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:38.174 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.050) 0:02:48.248 ***** 2021-10-20T23:15:38.211 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.031) 0:02:48.280 ***** 2021-10-20T23:15:38.219 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:15:38.269 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.063) 0:02:48.343 ***** 2021-10-20T23:15:38.289 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:15:38.291 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.336 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:15:38.338 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-20T23:15:38.377 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.095) 0:02:48.439 ***** 2021-10-20T23:15:38.391 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-20T23:15:38.426 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.060) 0:02:48.500 ***** 2021-10-20T23:15:38.448 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-20T23:15:38.454 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:15:38.456 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.485 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.058) 0:02:48.558 ***** 2021-10-20T23:15:38.562 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.599 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.634 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.681 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.695 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.731 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.739 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:38.791 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.301) 0:02:48.860 ***** 2021-10-20T23:15:38.813 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.826 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.832 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Create filesystems] ******************************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:38.855 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.068) 0:02:48.929 ***** 2021-10-20T23:15:38.890 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.918 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:38 +0000 (0:00:00.061) 0:02:48.990 ***** 2021-10-20T23:15:38.966 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.977 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:15:38.980 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:39.008 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.091) 0:02:49.082 ***** 2021-10-20T23:15:39.041 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:39.068 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.058) 0:02:49.141 ***** 2021-10-20T23:15:39.078 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:39.081 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-10-20T23:15:39.085 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:15:39.115 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.047) 0:02:49.189 ***** 2021-10-20T23:15:39.150 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.034) 0:02:49.223 ***** 2021-10-20T23:15:39.157 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:15:39.158 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi012.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:39.162 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:39.195 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.042) 0:02:49.265 ***** 2021-10-20T23:15:39.216 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.024) 0:02:49.290 ***** 2021-10-20T23:15:39.224 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-10-20T23:15:39.226 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Create filesystems] ******************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:39.255 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.038) 0:02:49.329 ***** 2021-10-20T23:15:39.287 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.031) 0:02:49.360 ***** 2021-10-20T23:15:39.296 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:39.331 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.040) 0:02:49.401 ***** 2021-10-20T23:15:39.350 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:39.392 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.056) 0:02:49.458 ***** 2021-10-20T23:15:39.400 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:15:39.407 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:39.429 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.044) 0:02:49.502 ***** 2021-10-20T23:15:39.471 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.031) 0:02:49.534 ***** 2021-10-20T23:15:39.531 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-20T23:15:39.570 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.105) 0:02:49.639 ***** 2021-10-20T23:15:39.574 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-10-20T23:15:39.576 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:15:39.614 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.046) 0:02:49.686 ***** 2021-10-20T23:15:39.634 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:15:39.635 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:39.669 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.056) 0:02:49.743 ***** 2021-10-20T23:15:39.687 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-20T23:15:39.725 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.054) 0:02:49.798 ***** 2021-10-20T23:15:39.731 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-20T23:15:39.762 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.035) 0:02:49.833 ***** 2021-10-20T23:15:39.808 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi119.front.sepia.ceph.com] => {"changed": true} 2021-10-20T23:15:39.839 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.079) 0:02:49.913 ***** 2021-10-20T23:15:39.860 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true} 2021-10-20T23:15:39.889 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:39 +0000 (0:00:00.049) 0:02:49.962 ***** 2021-10-20T23:15:40.013 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true} 2021-10-20T23:15:40.042 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.153) 0:02:50.115 ***** 2021-10-20T23:15:40.071 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true} 2021-10-20T23:15:40.099 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.058) 0:02:50.173 ***** 2021-10-20T23:15:40.344 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-20T23:15:40.369 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.269) 0:02:50.443 ***** 2021-10-20T23:15:40.378 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-20T23:15:40.411 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.034) 0:02:50.478 ***** 2021-10-20T23:15:40.438 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.034) 0:02:50.512 ***** 2021-10-20T23:15:40.448 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.466 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.482 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.041) 0:02:50.554 ***** 2021-10-20T23:15:40.503 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.023) 0:02:50.577 ***** 2021-10-20T23:15:40.546 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.043) 0:02:50.620 ***** 2021-10-20T23:15:40.556 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.559 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.587 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.040) 0:02:50.661 ***** 2021-10-20T23:15:40.625 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.037) 0:02:50.699 ***** 2021-10-20T23:15:40.658 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.028) 0:02:50.728 ***** 2021-10-20T23:15:40.663 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-10-20T23:15:40.665 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.691 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.037) 0:02:50.765 ***** 2021-10-20T23:15:40.714 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.023) 0:02:50.788 ***** 2021-10-20T23:15:40.739 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.024) 0:02:50.813 ***** 2021-10-20T23:15:40.746 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.747 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.772 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.033) 0:02:50.847 ***** 2021-10-20T23:15:40.797 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.023) 0:02:50.870 ***** 2021-10-20T23:15:40.823 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.024) 0:02:50.894 ***** 2021-10-20T23:15:40.829 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** 2021-10-20T23:15:40.831 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.856 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.033) 0:02:50.928 ***** 2021-10-20T23:15:40.876 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.022) 0:02:50.950 ***** 2021-10-20T23:15:40.883 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-10-20T23:15:40.885 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.929 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.052) 0:02:51.003 ***** 2021-10-20T23:15:40.939 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:40.980 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:40 +0000 (0:00:00.051) 0:02:51.054 ***** 2021-10-20T23:15:40.995 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:41.038 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.058) 0:02:51.112 ***** 2021-10-20T23:15:41.091 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.048) 0:02:51.161 ***** 2021-10-20T23:15:41.108 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:15:41.142 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.054) 0:02:51.216 ***** 2021-10-20T23:15:41.169 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:15:41.213 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.068) 0:02:51.284 ***** 2021-10-20T23:15:41.230 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:15:41.272 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.059) 0:02:51.344 ***** 2021-10-20T23:15:41.335 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-10-20T23:15:41.337 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:15:41.367 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.097) 0:02:51.441 ***** 2021-10-20T23:15:41.387 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-10-20T23:15:41.389 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:15:41.419 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.052) 0:02:51.494 ***** 2021-10-20T23:15:41.452 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.028) 0:02:51.522 ***** 2021-10-20T23:15:41.536 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:15:41.558 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.107) 0:02:51.630 ***** 2021-10-20T23:15:41.705 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-10-20T23:15:41.731 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.175) 0:02:51.805 ***** 2021-10-20T23:15:41.842 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-10-20T23:15:41.881 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.149) 0:02:51.955 ***** 2021-10-20T23:15:41.890 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-10-20T23:15:41.918 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.036) 0:02:51.991 ***** 2021-10-20T23:15:41.952 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-10-20T23:15:41.987 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:41 +0000 (0:00:00.068) 0:02:52.060 ***** 2021-10-20T23:15:42.127 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-10-20T23:15:42.128 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-10-20T23:15:42.159 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:42 +0000 (0:00:00.172) 0:02:52.233 ***** 2021-10-20T23:15:42.258 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-10-20T23:15:42.286 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:42 +0000 (0:00:00.127) 0:02:52.361 ***** 2021-10-20T23:15:42.306 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-10-20T23:15:42.336 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:42 +0000 (0:00:00.049) 0:02:52.410 ***** 2021-10-20T23:15:42.357 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-10-20T23:15:42.384 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:42 +0000 (0:00:00.048) 0:02:52.458 ***** 2021-10-20T23:15:42.859 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-10-20T23:15:42.861 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:15:42.885 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:42 +0000 (0:00:00.499) 0:02:52.958 ***** 2021-10-20T23:15:42.983 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:15:43.012 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.128) 0:02:53.086 ***** 2021-10-20T23:15:43.032 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:15:43.075 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.062) 0:02:53.149 ***** 2021-10-20T23:15:43.086 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:15:43.117 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.041) 0:02:53.191 ***** 2021-10-20T23:15:43.159 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-10-20T23:15:43.161 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.125730", "end": "2021-10-20 23:15:43.128026", "rc": 0, "start": "2021-10-20 23:15:43.002296", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-10-20T23:15:43.195 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.078) 0:02:53.269 ***** 2021-10-20T23:15:43.250 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:43.269 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.072) 0:02:53.341 ***** 2021-10-20T23:15:43.277 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.088563", "end": "2021-10-20 23:15:43.234044", "rc": 0, "start": "2021-10-20 23:15:43.145481", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-10-20T23:15:43.303 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.034) 0:02:53.376 ***** 2021-10-20T23:15:43.316 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:43.345 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.042) 0:02:53.419 ***** 2021-10-20T23:15:43.352 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-10-20T23:15:43.354 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:43.355 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.106088", "end": "2021-10-20 23:15:43.312544", "rc": 0, "start": "2021-10-20 23:15:43.206456", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-10-20T23:15:43.387 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.042) 0:02:53.461 ***** 2021-10-20T23:15:43.420 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.032) 0:02:53.494 ***** 2021-10-20T23:15:43.436 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.107393", "end": "2021-10-20 23:15:43.354281", "rc": 0, "start": "2021-10-20 23:15:43.246888", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:43.462 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.041) 0:02:53.536 ***** 2021-10-20T23:15:43.498 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.028) 0:02:53.565 ***** 2021-10-20T23:15:43.512 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:43.539 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.048) 0:02:53.613 ***** 2021-10-20T23:15:43.541 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:43.561 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:43.599 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.057) 0:02:53.671 ***** 2021-10-20T23:15:43.605 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-10-20T23:15:43.607 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:43.632 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.035) 0:02:53.706 ***** 2021-10-20T23:15:43.641 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:43.676 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:43 +0000 (0:00:00.043) 0:02:53.751 ***** 2021-10-20T23:15:44.052 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-10-20T23:15:44.054 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:15:44.079 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.402) 0:02:54.153 ***** 2021-10-20T23:15:44.108 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:44.157 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.066) 0:02:54.219 ***** 2021-10-20T23:15:44.166 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-10-20T23:15:44.168 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:15:44.193 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.047) 0:02:54.267 ***** 2021-10-20T23:15:44.223 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:44.249 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.055) 0:02:54.322 ***** 2021-10-20T23:15:44.312 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:15:44.341 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.092) 0:02:54.415 ***** 2021-10-20T23:15:44.359 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:15:44.386 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.045) 0:02:54.460 ***** 2021-10-20T23:15:44.395 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:44.430 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.039) 0:02:54.499 ***** 2021-10-20T23:15:44.438 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:44.464 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.038) 0:02:54.538 ***** 2021-10-20T23:15:44.504 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-10-20T23:15:44.507 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-10-20T23:15:44.532 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.067) 0:02:54.606 ***** 2021-10-20T23:15:44.576 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-10-20T23:15:44.581 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:44.603 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.071) 0:02:54.677 ***** 2021-10-20T23:15:44.605 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:44.632 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-10-20T23:15:44.634 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-10-20T23:15:44.663 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.059) 0:02:54.737 ***** 2021-10-20T23:15:44.697 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-10-20T23:15:44.698 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:44.733 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.070) 0:02:54.807 ***** 2021-10-20T23:15:44.831 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-10-20T23:15:44.834 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-10-20T23:15:44.868 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.134) 0:02:54.942 ***** 2021-10-20T23:15:44.882 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:11:13 UTC", "ActiveEnterTimestampMonotonic": "17127081", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target network.target system.slice basic.target -.mount systemd-tmpfiles-setup.service systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:11:13 UTC", "AssertTimestampMonotonic": "16917688", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:11:13 UTC", "ConditionTimestampMonotonic": "16917687", "ConfigurationDirectoryMode 2021-10-20T23:15:44.884 INFO:teuthology.task.ansible.out:": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "829", "ExecMainStartTimestamp": "Wed 2021-10-20 23:11:13 UTC", "ExecMainStartTimestampMonotonic": "17127068", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:11:13 UTC", "InactiveExitTimestampMonotonic": "16918832", "InvocationID": "f598c0597a944f4cb61c3bbba933a5bb", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": " 2021-10-20T23:15:44.886 INFO:teuthology.task.ansible.out:15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127797", "LimitNPROCSoft": "127797", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "829", "MemoryAccounting": "yes", "MemoryCurrent": "3756032", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit" 2021-10-20T23:15:44.891 INFO:teuthology.task.ansible.out:: "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:11:13 UTC", "StateChangeTimestampMonotonic": "17127081", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38339", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "roo 2021-10-20T23:15:44.893 INFO:teuthology.task.ansible.out:t", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-10-20T23:15:44.922 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.053) 0:02:54.996 ***** 2021-10-20T23:15:44.952 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.030) 0:02:55.026 ***** 2021-10-20T23:15:44.962 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-20T23:15:44.963 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-20T23:15:44.965 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:11:20 UTC", "ActiveEnterTimestampMonotonic": "17995654", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-tmpfiles-setup.service sysinit.target system.slice basic.target -.mount systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:11:20 UTC", "AssertTimestampMonotonic": "17777461", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:11:20 UTC", "ConditionTimestampMonotonic": "17777460", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-10-20T23:15:44.967 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "844", "ExecMainStartTimestamp": "Wed 2021-10-20 23:11:20 UTC", "ExecMainStartTimestampMonotonic": "17995638", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:11:20 UTC", "InactiveExitTimestampMonotonic": "17778595", "InvocationID": "4f36620ff20b4a5ea070e44324f85eaf", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-10-20T23:15:44.968 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127797", "LimitNPROCSoft": "127797", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "844", "MemoryAccounting": "yes", "MemoryCurrent": "3383296", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2021-10-20T23:15:44.970 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:11:20 UTC", "StateChangeTimestampMonotonic": "17995654", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38339", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:15:44.992 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:44 +0000 (0:00:00.039) 0:02:55.066 ***** 2021-10-20T23:15:45.016 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.024) 0:02:55.090 ***** 2021-10-20T23:15:45.040 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.024) 0:02:55.114 ***** 2021-10-20T23:15:45.047 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-10-20T23:15:45.049 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} TASK [testnode : set_fact] ***************************************************** ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-20T23:15:45.075 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.034) 0:02:55.149 ***** 2021-10-20T23:15:45.097 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.022) 0:02:55.171 ***** 2021-10-20T23:15:45.119 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.022) 0:02:55.193 ***** 2021-10-20T23:15:45.127 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-10-20T23:15:45.129 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:45.154 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.034) 0:02:55.228 ***** 2021-10-20T23:15:45.161 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:45.164 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-20T23:15:45.211 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.057) 0:02:55.285 ***** 2021-10-20T23:15:45.244 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:45.280 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.069) 0:02:55.354 ***** 2021-10-20T23:15:45.289 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-20T23:15:45.290 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:11:38 UTC", "ActiveEnterTimestampMonotonic": "14182313", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice -.mount sysinit.target basic.target systemd-tmpfiles-setup.service network.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:11:38 UTC", "AssertTimestampMonotonic": "14096828", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:11:38 UTC", "ConditionTimestampMonotonic": "14096827", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-10-20T23:15:45.292 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "827", "ExecMainStartTimestamp": "Wed 2021-10-20 23:11:38 UTC", "ExecMainStartTimestampMonotonic": "14182300", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:11:38 UTC", "InactiveExitTimestampMonotonic": "14097709", "InvocationID": "121a402b0c5f45ca85d03fefba6f5e27", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-10-20T23:15:45.293 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "827", "MemoryAccounting": "yes", "MemoryCurrent": "3522560", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requi 2021-10-20T23:15:45.295 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:11:38 UTC", "StateChangeTimestampMonotonic": "14182313", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:15:45.320 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.039) 0:02:55.394 ***** 2021-10-20T23:15:45.350 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-20T23:15:45.351 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:11:31 UTC", "ActiveEnterTimestampMonotonic": "14227152", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket sysinit.target -.mount network.target systemd-tmpfiles-setup.service system.slice basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:11:31 UTC", "AssertTimestampMonotonic": "14025540", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:11:31 UTC", "ConditionTimestampMonotonic": "14025539", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-10-20T23:15:45.353 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "833", "ExecMainStartTimestamp": "Wed 2021-10-20 23:11:31 UTC", "ExecMainStartTimestampMonotonic": "14227140", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:11:31 UTC", "InactiveExitTimestampMonotonic": "14026624", "InvocationID": "e25d490788974b76ab940ad478f1b6d6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-10-20T23:15:45.355 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "833", "MemoryAccounting": "yes", "MemoryCurrent": "3682304", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2021-10-20T23:15:45.357 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:11:31 UTC", "StateChangeTimestampMonotonic": "14227152", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:15:45.379 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.059) 0:02:55.453 ***** 2021-10-20T23:15:45.403 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.023) 0:02:55.477 ***** 2021-10-20T23:15:45.420 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:45.421 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-20T23:15:45.449 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.043) 0:02:55.521 ***** 2021-10-20T23:15:45.455 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:45.457 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-20T23:15:45.487 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.040) 0:02:55.561 ***** 2021-10-20T23:15:45.496 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-20T23:15:45.536 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.049) 0:02:55.610 ***** 2021-10-20T23:15:45.546 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:45.576 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.037) 0:02:55.648 ***** 2021-10-20T23:15:45.581 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:45.617 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:45 +0000 (0:00:00.044) 0:02:55.692 ***** 2021-10-20T23:15:45.619 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:46.270 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-10-20T23:15:46.272 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:15:46.296 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.678) 0:02:56.370 ***** 2021-10-20T23:15:46.324 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:46.349 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.053) 0:02:56.424 ***** 2021-10-20T23:15:46.410 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:15:46.438 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.088) 0:02:56.512 ***** 2021-10-20T23:15:46.468 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-10-20T23:15:46.470 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:46.498 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.060) 0:02:56.572 ***** 2021-10-20T23:15:46.543 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:15:46.581 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.077) 0:02:56.650 ***** 2021-10-20T23:15:46.617 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:15:46.644 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.068) 0:02:56.718 ***** 2021-10-20T23:15:46.673 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-10-20T23:15:46.675 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:46.700 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.055) 0:02:56.773 ***** 2021-10-20T23:15:46.708 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-10-20T23:15:46.708 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:15:46.710 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:15:46.739 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.039) 0:02:56.812 ***** 2021-10-20T23:15:46.765 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.026) 0:02:56.839 ***** 2021-10-20T23:15:46.812 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:46.841 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.075) 0:02:56.915 ***** 2021-10-20T23:15:46.891 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-10-20T23:15:46.893 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:15:46.929 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:46 +0000 (0:00:00.085) 0:02:57.000 ***** 2021-10-20T23:15:47.053 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:15:47.291 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:47 +0000 (0:00:00.364) 0:02:57.365 ***** 2021-10-20T23:15:47.305 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-10-20T23:15:47.330 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:47 +0000 (0:00:00.039) 0:02:57.404 ***** 2021-10-20T23:15:47.338 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-10-20T23:15:47.370 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:47 +0000 (0:00:00.039) 0:02:57.444 ***** 2021-10-20T23:15:47.604 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-10-20T23:15:47.636 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:47 +0000 (0:00:00.266) 0:02:57.710 ***** 2021-10-20T23:15:47.808 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-10-20T23:15:47.837 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:47 +0000 (0:00:00.200) 0:02:57.911 ***** 2021-10-20T23:15:49.751 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-10-20T23:15:49.752 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-10-20T23:15:49.753 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-10-20T23:15:49.781 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:49 +0000 (0:00:01.943) 0:02:59.855 ***** 2021-10-20T23:15:49.810 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:49 +0000 (0:00:00.028) 0:02:59.884 ***** 2021-10-20T23:15:49.908 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-10-20T23:15:49.936 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:49 +0000 (0:00:00.125) 0:03:00.009 ***** 2021-10-20T23:15:50.061 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-10-20T23:15:50.088 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.152) 0:03:00.162 ***** 2021-10-20T23:15:50.318 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-10-20T23:15:50.320 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false} 2021-10-20T23:15:50.346 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.257) 0:03:00.420 ***** 2021-10-20T23:15:50.377 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-10-20T23:15:50.406 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.059) 0:03:00.480 ***** 2021-10-20T23:15:50.414 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-10-20T23:15:50.416 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false} 2021-10-20T23:15:50.446 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.040) 0:03:00.520 ***** 2021-10-20T23:15:50.454 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false} 2021-10-20T23:15:50.483 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.035) 0:03:00.556 ***** 2021-10-20T23:15:50.488 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-10-20T23:15:50.490 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-10-20T23:15:50.515 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.033) 0:03:00.589 ***** 2021-10-20T23:15:50.523 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-20T23:15:50.552 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.036) 0:03:00.626 ***** 2021-10-20T23:15:50.605 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-20T23:15:50.607 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634771075.8475702, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1634771075.8435702, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1634771075.8435702, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:15:50.634 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.082) 0:03:00.708 ***** 2021-10-20T23:15:50.646 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi136.front.sepia.ceph.com] => {"changed": false} 2021-10-20T23:15:50.678 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.044) 0:03:00.752 ***** 2021-10-20T23:15:50.707 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-10-20T23:15:50.709 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-20T23:15:50.731 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.052) 0:03:00.805 ***** 2021-10-20T23:15:50.738 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-20T23:15:50.740 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634770990.6835804, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1634770990.6795805, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1634770990.6795805, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:15:50.775 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.044) 0:03:00.849 ***** 2021-10-20T23:15:50.785 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634771019.6873934, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1634771019.6833935, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1634771019.6833935, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:15:50.814 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.038) 0:03:00.888 ***** 2021-10-20T23:15:50.921 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-10-20T23:15:50.923 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-10-20T23:15:50.947 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.133) 0:03:01.021 ***** 2021-10-20T23:15:50.961 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634771026.7233746, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1634771026.7193747, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1634771026.7193747, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-10-20T23:15:50.989 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:50 +0000 (0:00:00.042) 0:03:01.064 ***** 2021-10-20T23:15:51.015 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.024) 0:03:01.088 ***** 2021-10-20T23:15:51.023 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-10-20T23:15:51.025 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "msg": ""} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-20T23:15:51.064 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.049) 0:03:01.138 ***** 2021-10-20T23:15:51.088 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.024) 0:03:01.162 ***** 2021-10-20T23:15:51.111 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.023) 0:03:01.185 ***** 2021-10-20T23:15:51.118 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-10-20T23:15:51.120 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.144 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.033) 0:03:01.218 ***** 2021-10-20T23:15:51.151 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.153 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-20T23:15:51.188 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.043) 0:03:01.262 ***** 2021-10-20T23:15:51.222 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.033) 0:03:01.295 ***** 2021-10-20T23:15:51.229 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-10-20T23:15:51.230 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-10-20T23:15:51.255 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.033) 0:03:01.329 ***** 2021-10-20T23:15:51.261 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-10-20T23:15:51.264 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.296 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.041) 0:03:01.370 ***** 2021-10-20T23:15:51.304 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-10-20T23:15:51.306 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-20T23:15:51.339 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.040) 0:03:01.411 ***** 2021-10-20T23:15:51.356 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-10-20T23:15:51.357 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-20T23:15:51.382 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.044) 0:03:01.456 ***** 2021-10-20T23:15:51.390 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.392 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-20T23:15:51.426 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.044) 0:03:01.501 ***** 2021-10-20T23:15:51.457 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.028) 0:03:01.529 ***** 2021-10-20T23:15:51.484 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-20T23:15:51.512 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.056) 0:03:01.586 ***** 2021-10-20T23:15:51.563 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-20T23:15:51.565 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-20T23:15:51.599 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.087) 0:03:01.674 ***** 2021-10-20T23:15:51.619 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-20T23:15:51.644 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.044) 0:03:01.718 ***** 2021-10-20T23:15:51.652 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-20T23:15:51.654 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-20T23:15:51.680 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.035) 0:03:01.754 ***** 2021-10-20T23:15:51.702 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.022) 0:03:01.776 ***** 2021-10-20T23:15:51.709 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-20T23:15:51.710 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.712 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi119.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-20T23:15:51.712 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi012.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.740 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.038) 0:03:01.814 ***** 2021-10-20T23:15:51.763 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.022) 0:03:01.837 ***** 2021-10-20T23:15:51.771 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.773 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.807 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.044) 0:03:01.881 ***** 2021-10-20T23:15:51.817 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.819 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi031.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.819 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.823 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.852 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.044) 0:03:01.926 ***** 2021-10-20T23:15:51.879 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.027) 0:03:01.953 ***** 2021-10-20T23:15:51.891 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi012.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.893 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi012.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.893 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.894 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result 2021-10-20T23:15:51.897 INFO:teuthology.task.ansible.out: was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-20T23:15:51.899 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-20T23:15:51.925 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.045) 0:03:01.999 ***** 2021-10-20T23:15:51.951 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.026) 0:03:02.025 ***** 2021-10-20T23:15:51.958 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-20T23:15:51.961 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi119.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was 2021-10-20T23:15:51.963 INFO:teuthology.task.ansible.out:False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi119.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.964 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.966 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi119.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.968 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:51.991 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:51 +0000 (0:00:00.040) 0:03:02.066 ***** 2021-10-20T23:15:51.999 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.001 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.001 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.029 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.037) 0:03:02.103 ***** 2021-10-20T23:15:52.051 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.022) 0:03:02.125 ***** 2021-10-20T23:15:52.084 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.021) 0:03:02.147 ***** TASK [testnode : set_fact] ***************************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.108 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.034) 0:03:02.182 ***** 2021-10-20T23:15:52.146 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.038) 0:03:02.220 ***** 2021-10-20T23:15:52.154 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-20T23:15:52.155 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.156 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.156 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi136.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.157 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.157 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.158 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-20T23:15:52.158 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => (item={'changed': 2021-10-20T23:15:52.160 INFO:teuthology.task.ansible.out:False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.161 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi136.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.162 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.162 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.164 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.193 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.047) 0:03:02.267 ***** 2021-10-20T23:15:52.224 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.030) 0:03:02.298 ***** 2021-10-20T23:15:52.247 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.023) 0:03:02.321 ***** 2021-10-20T23:15:52.255 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.257 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.284 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.036) 0:03:02.358 ***** 2021-10-20T23:15:52.309 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.025) 0:03:02.383 ***** 2021-10-20T23:15:52.336 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.026) 0:03:02.410 ***** 2021-10-20T23:15:52.343 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-20T23:15:52.344 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.345 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.345 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.347 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.347 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.348 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.350 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-10-20T23:15:52.351 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.378 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.041) 0:03:02.452 ***** 2021-10-20T23:15:52.406 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.027) 0:03:02.479 ***** 2021-10-20T23:15:52.430 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.024) 0:03:02.504 ***** 2021-10-20T23:15:52.438 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-10-20T23:15:52.440 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.470 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.040) 0:03:02.544 ***** 2021-10-20T23:15:52.494 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.023) 0:03:02.568 ***** 2021-10-20T23:15:52.521 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.026) 0:03:02.595 ***** 2021-10-20T23:15:52.527 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:15:52.529 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.558 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.035) 0:03:02.630 ***** 2021-10-20T23:15:52.587 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.031) 0:03:02.661 ***** 2021-10-20T23:15:52.614 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.026) 0:03:02.688 ***** 2021-10-20T23:15:52.622 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.626 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.651 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.036) 0:03:02.725 ***** 2021-10-20T23:15:52.676 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.024) 0:03:02.750 ***** 2021-10-20T23:15:52.701 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.025) 0:03:02.775 ***** 2021-10-20T23:15:52.710 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-10-20T23:15:52.714 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.739 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.037) 0:03:02.813 ***** 2021-10-20T23:15:52.747 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.786 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.046) 0:03:02.860 ***** 2021-10-20T23:15:52.816 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.029) 0:03:02.889 ***** 2021-10-20T23:15:52.822 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.850 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.035) 0:03:02.925 ***** 2021-10-20T23:15:52.858 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:15:52.861 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi012.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010691", "end": "2021-10-20 23:15:52.818801", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-20 23:15:52.808110", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:52.887 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.036) 0:03:02.961 ***** 2021-10-20T23:15:52.914 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.026) 0:03:02.988 ***** 2021-10-20T23:15:52.924 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:52.956 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:52 +0000 (0:00:00.040) 0:03:03.029 ***** 2021-10-20T23:15:52.963 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:15:52.965 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:53.011 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.056) 0:03:03.085 ***** 2021-10-20T23:15:53.018 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-10-20T23:15:53.020 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:53.047 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.036) 0:03:03.121 ***** 2021-10-20T23:15:53.055 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:15:53.056 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006183", "end": "2021-10-20 23:15:52.987056", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-20 23:15:52.980873", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:53.086 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.038) 0:03:03.160 ***** 2021-10-20T23:15:53.088 INFO:teuthology.task.ansible.out: 2021-10-20T23:15:53.094 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:15:53.096 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:53.123 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.036) 0:03:03.197 ***** 2021-10-20T23:15:53.129 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:15:53.131 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010702", "end": "2021-10-20 23:15:53.074623", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-20 23:15:53.063921", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:53.157 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.034) 0:03:03.231 ***** 2021-10-20T23:15:53.166 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:53.196 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.039) 0:03:03.270 ***** 2021-10-20T23:15:53.204 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:15:53.207 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005507", "end": "2021-10-20 23:15:53.152491", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-20 23:15:53.146984", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.228 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:53.253 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.057) 0:03:03.327 ***** 2021-10-20T23:15:53.281 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:15:53.282 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006115", "end": "2021-10-20 23:15:53.247566", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-20 23:15:53.241451", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.356 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010065", "end": "2021-10-20 23:15:53.323474", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-20 23:15:53.313409", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.389 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.029459", "end": "2021-10-20 23:15:53.345086", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-20 23:15:53.315627", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.416 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.162) 0:03:03.490 ***** 2021-10-20T23:15:53.435 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.004467", "end": "2021-10-20 23:15:53.407586", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-20 23:15:53.403119", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.447 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-20T23:15:53.472 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.056) 0:03:03.546 ***** 2021-10-20T23:15:53.483 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi136.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010437", "end": "2021-10-20 23:15:53.423579", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-20 23:15:53.413142", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.502 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-10-20T23:15:53.504 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:53.529 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:15:53.530 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005935", "end": "2021-10-20 23:15:53.483782", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-20 23:15:53.477847", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.617 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006122", "end": "2021-10-20 23:15:53.583841", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-20 23:15:53.577719", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.618 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.023025", "end": "2021-10-20 23:15:53.585750", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-20 23:15:53.562725", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.650 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.178) 0:03:03.724 ***** 2021-10-20T23:15:53.671 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005434", "end": "2021-10-20 23:15:53.642073", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-20 23:15:53.636639", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.682 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-20T23:15:53.708 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.057) 0:03:03.782 ***** 2021-10-20T23:15:53.736 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-10-20T23:15:53.740 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:53.786 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi136.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005540", "end": "2021-10-20 23:15:53.745232", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-20 23:15:53.739692", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.860 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.031091", "end": "2021-10-20 23:15:53.827430", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-20 23:15:53.796339", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.886 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.177) 0:03:03.960 ***** 2021-10-20T23:15:53.916 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-20T23:15:53.943 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.055) 0:03:04.016 ***** 2021-10-20T23:15:53.961 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi136.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.030193", "end": "2021-10-20 23:15:53.927663", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-20 23:15:53.897470", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:15:53.988 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:53 +0000 (0:00:00.045) 0:03:04.062 ***** 2021-10-20T23:15:53.996 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-10-20T23:15:53.997 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:54.022 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-20T23:15:54.067 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:54 +0000 (0:00:00.079) 0:03:04.141 ***** 2021-10-20T23:15:54.095 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-10-20T23:15:54.098 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:54.166 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-10-20T23:15:54.190 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:54 +0000 (0:00:00.123) 0:03:04.264 ***** 2021-10-20T23:15:54.212 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:54 +0000 (0:00:00.022) 0:03:04.287 ***** 2021-10-20T23:15:54.235 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:54 +0000 (0:00:00.022) 0:03:04.309 ***** 2021-10-20T23:15:54.257 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:54 +0000 (0:00:00.021) 0:03:04.330 ***** 2021-10-20T23:15:55.231 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi031.front.sepia.ceph.com] 2021-10-20T23:15:55.245 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] 2021-10-20T23:15:55.293 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] 2021-10-20T23:15:55.323 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:01.066) 0:03:05.397 ***** 2021-10-20T23:15:55.347 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.023) 0:03:05.421 ***** 2021-10-20T23:15:55.374 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:15:55.376 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-10-20T23:15:55.398 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.051) 0:03:05.473 ***** 2021-10-20T23:15:55.427 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.028) 0:03:05.501 ***** 2021-10-20T23:15:55.451 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.023) 0:03:05.525 ***** 2021-10-20T23:15:55.459 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:15:55.462 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:55.487 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.036) 0:03:05.561 ***** 2021-10-20T23:15:55.513 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.025) 0:03:05.587 ***** 2021-10-20T23:15:55.522 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:15:55.524 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-10-20T23:15:55.551 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.038) 0:03:05.625 ***** 2021-10-20T23:15:55.558 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-10-20T23:15:55.560 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-10-20T23:15:55.561 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-10-20T23:15:55.587 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.034) 0:03:05.660 ***** 2021-10-20T23:15:55.618 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.028) 0:03:05.689 ***** 2021-10-20T23:15:55.625 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:15:55.628 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:55.654 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.039) 0:03:05.728 ***** 2021-10-20T23:15:55.694 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-10-20T23:15:55.696 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-10-20T23:15:55.727 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:55 +0000 (0:00:00.073) 0:03:05.801 ***** 2021-10-20T23:15:56.287 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi012.front.sepia.ceph.com] 2021-10-20T23:15:56.339 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:56 +0000 (0:00:00.611) 0:03:06.413 ***** 2021-10-20T23:15:56.368 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:15:56.370 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-10-20T23:15:56.392 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:56 +0000 (0:00:00.053) 0:03:06.466 ***** 2021-10-20T23:15:56.420 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:15:56.422 INFO:teuthology.task.ansible.out:skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:15:56.446 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:56 +0000 (0:00:00.053) 0:03:06.520 ***** 2021-10-20T23:15:56.486 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-10-20T23:15:56.490 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-10-20T23:15:56.511 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:15:56 +0000 (0:00:00.064) 0:03:06.585 ***** 2021-10-20T23:16:12.021 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** changed: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (15.8 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu1~20.04.2) ...\r\nProcessing trig 2021-10-20T23:16:12.024 INFO:teuthology.task.ansible.out:gers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (15.8 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu1~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} changed: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cac 2021-10-20T23:16:12.025 INFO:teuthology.task.ansible.out:he_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (16.7 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu1~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages 2021-10-20T23:16:12.027 INFO:teuthology.task.ansible.out: were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (16.7 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu1~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-10-20T23:16:12.050 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:15.538) 0:03:22.124 ***** 2021-10-20T23:16:12.074 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.023) 0:03:22.148 ***** 2021-10-20T23:16:12.092 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:16:12.116 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.042) 0:03:22.191 ***** 2021-10-20T23:16:12.127 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:16:12.155 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.037) 0:03:22.229 ***** 2021-10-20T23:16:12.162 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:16:12.164 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-10-20T23:16:12.190 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.035) 0:03:22.264 ***** 2021-10-20T23:16:12.207 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-10-20T23:16:12.234 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.044) 0:03:22.308 ***** 2021-10-20T23:16:12.400 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-20T23:16:12.401 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:16:12.454 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:16:12.551 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-10-20T23:16:12.553 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (16.0 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu1~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Bu 2021-10-20T23:16:12.555 INFO:teuthology.task.ansible.out:ilding dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (16.0 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu1~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-10-20T23:16:12.578 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.343) 0:03:22.652 ***** 2021-10-20T23:16:12.587 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-20T23:16:12.589 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:16:12.618 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.040) 0:03:22.692 ***** 2021-10-20T23:16:12.625 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:16:12.627 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:16:12.655 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.035) 0:03:22.728 ***** 2021-10-20T23:16:12.662 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-20T23:16:12.664 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:16:12.695 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.041) 0:03:22.769 ***** 2021-10-20T23:16:12.705 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:16:12.708 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-10-20T23:16:12.740 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:12 +0000 (0:00:00.045) 0:03:22.815 ***** 2021-10-20T23:16:12.957 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi031.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:16:13.067 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** ok: [smithi119.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:16:13.158 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi031.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:16:13.183 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:13 +0000 (0:00:00.441) 0:03:23.256 ***** 2021-10-20T23:16:13.193 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** ok: [smithi136.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:16:13.344 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** changed: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (16.5 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu1~20.04.2) ...\r\nProcessing trig 2021-10-20T23:16:13.346 INFO:teuthology.task.ansible.out:gers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (16.5 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu1~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-10-20T23:16:13.373 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:13 +0000 (0:00:00.190) 0:03:23.447 ***** 2021-10-20T23:16:13.403 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:16:13.440 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:13 +0000 (0:00:00.059) 0:03:23.506 ***** 2021-10-20T23:16:13.472 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-20T23:16:13.474 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:16:13.503 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:13 +0000 (0:00:00.070) 0:03:23.577 ***** 2021-10-20T23:16:13.512 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:16:13.518 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-10-20T23:16:13.542 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:13 +0000 (0:00:00.039) 0:03:23.616 ***** 2021-10-20T23:16:13.605 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-20T23:16:13.607 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:16:13.651 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:13 +0000 (0:00:00.106) 0:03:23.723 ***** 2021-10-20T23:16:13.686 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:16:13.766 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi012.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:16:13.936 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:16:13.977 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:13 +0000 (0:00:00.315) 0:03:24.038 ***** 2021-10-20T23:16:14.093 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-20T23:16:14.095 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:16:14.122 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:14 +0000 (0:00:00.157) 0:03:24.196 ***** 2021-10-20T23:16:14.288 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-10-20T23:16:14.290 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"cache_update_time": 1634771254, "cache_updated": false, "changed": false} 2021-10-20T23:16:14.314 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:14 +0000 (0:00:00.192) 0:03:24.388 ***** 2021-10-20T23:16:14.428 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** ok: [smithi012.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:16:14.442 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1634771319, "cache_updated": false, "changed": false} 2021-10-20T23:16:14.472 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:14 +0000 (0:00:00.158) 0:03:24.546 ***** 2021-10-20T23:16:14.475 INFO:teuthology.task.ansible.out: 2021-10-20T23:16:14.830 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-20T23:16:14.832 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:16:14.859 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:14 +0000 (0:00:00.386) 0:03:24.933 ***** 2021-10-20T23:16:14.920 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-10-20T23:16:14.922 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"cache_update_time": 1634771191, "cache_updated": false, "changed": false} 2021-10-20T23:16:14.950 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:14 +0000 (0:00:00.090) 0:03:25.024 ***** 2021-10-20T23:16:15.632 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"cache_update_time": 1634771125, "cache_updated": false, "changed": false} 2021-10-20T23:16:15.659 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:15 +0000 (0:00:00.709) 0:03:25.733 ***** 2021-10-20T23:16:18.588 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-10-20T23:16:18.590 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-giophm4k\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-giophm4k"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-giophm4k\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5ca7704202b5ffd23bc86d3d8ede9f01f1f3037d7a25fbb609770359d09d4735\n Stored in directory: /tmp/pip-ephem-wheel-cache-a8i2k8px/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-10-20T23:16:18.592 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-giophm4k", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5ca7704202b5ffd23bc86d3d8ede9f01f1f3037d7a25fbb609770359d09d4735", " Stored in directory: /tmp/pip-ephem-wheel-cache-a8i2k8px/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-20T23:16:18.615 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:18 +0000 (0:00:02.955) 0:03:28.688 ***** 2021-10-20T23:16:18.772 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-o61y8qsr\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-o61y8qsr"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-o61y8qsr\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5ca7704202b5ffd23bc86d3d8ede9f01f1f3037d7a25fbb609770359d09d4735\n Stored in directory: /tmp/pip-ephem-wheel-cache-f8idzrv4/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-10-20T23:16:18.776 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-o61y8qsr", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5ca7704202b5ffd23bc86d3d8ede9f01f1f3037d7a25fbb609770359d09d4735", " Stored in directory: /tmp/pip-ephem-wheel-cache-f8idzrv4/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-20T23:16:18.799 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:18 +0000 (0:00:00.184) 0:03:28.873 ***** 2021-10-20T23:16:18.817 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-10-20T23:16:18.820 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634771002.851857, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:16:18.849 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:18 +0000 (0:00:00.050) 0:03:28.924 ***** 2021-10-20T23:16:18.889 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-10-20T23:16:18.891 INFO:teuthology.task.ansible.out:skipping: [smithi119.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:16:18.914 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:18 +0000 (0:00:00.064) 0:03:28.988 ***** 2021-10-20T23:16:19.005 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-10-20T23:16:19.007 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634771009.163858, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:16:19.032 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:19 +0000 (0:00:00.118) 0:03:29.106 ***** 2021-10-20T23:16:19.071 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-10-20T23:16:19.073 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:16:19.096 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:19 +0000 (0:00:00.062) 0:03:29.169 ***** 2021-10-20T23:16:19.207 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-10-20T23:16:19.209 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.095285", "end": "2021-10-20 23:16:19.179196", "rc": 0, "start": "2021-10-20 23:16:19.083911", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:16:19.235 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:19 +0000 (0:00:00.139) 0:03:29.309 ***** 2021-10-20T23:16:19.242 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-10-20T23:16:19.244 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-w3urkfyz\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-w3urkfyz"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-w3urkfyz\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=4be95fc65a0a8d7434112c6e38f6452e7c362875be400eafa7f331f68b1eaa22\n Stored in directory: /tmp/pip-ephem-wheel-cache-dkly4nx4/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-10-20T23:16:19.246 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-w3urkfyz", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=4be95fc65a0a8d7434112c6e38f6452e7c362875be400eafa7f331f68b1eaa22", " Stored in directory: /tmp/pip-ephem-wheel-cache-dkly4nx4/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-20T23:16:19.269 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:19 +0000 (0:00:00.034) 0:03:29.343 ***** 2021-10-20T23:16:19.371 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.083029", "end": "2021-10-20 23:16:19.339770", "rc": 0, "start": "2021-10-20 23:16:19.256741", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:16:19.401 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:19 +0000 (0:00:00.131) 0:03:29.475 ***** 2021-10-20T23:16:19.472 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-10-20T23:16:19.474 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634770980.595858, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:16:19.506 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:19 +0000 (0:00:00.105) 0:03:29.580 ***** 2021-10-20T23:16:19.545 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-10-20T23:16:19.546 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:16:19.570 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:19 +0000 (0:00:00.064) 0:03:29.644 ***** 2021-10-20T23:16:19.844 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.083692", "end": "2021-10-20 23:16:19.818658", "rc": 0, "start": "2021-10-20 23:16:19.734966", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:16:19.870 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:19 +0000 (0:00:00.299) 0:03:29.944 ***** 2021-10-20T23:16:20.057 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-10-20T23:16:20.059 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-_wvzb3ym\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-_wvzb3ym"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-_wvzb3ym\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=69eaf0b5bd0c1596bfde4117a4ade1892262688b6b32ff708f9d0e00c19247b1\n Stored in directory: /tmp/pip-ephem-wheel-cache-jva644jq/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-10-20T23:16:20.061 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-_wvzb3ym", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=69eaf0b5bd0c1596bfde4117a4ade1892262688b6b32ff708f9d0e00c19247b1", " Stored in directory: /tmp/pip-ephem-wheel-cache-jva644jq/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-20T23:16:20.086 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:20 +0000 (0:00:00.216) 0:03:30.160 ***** 2021-10-20T23:16:20.290 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi012.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634771066.091839, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:16:20.315 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:20 +0000 (0:00:00.228) 0:03:30.389 ***** 2021-10-20T23:16:20.367 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ skipping: [smithi012.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:16:20.391 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:20 +0000 (0:00:00.075) 0:03:30.464 ***** 2021-10-20T23:16:20.674 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-10-20T23:16:20.677 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.083156", "end": "2021-10-20 23:16:20.637288", "rc": 0, "start": "2021-10-20 23:16:20.554132", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:16:20.699 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:16:20 +0000 (0:00:00.309) 0:03:30.773 ***** 2021-10-20T23:16:21.116 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-10-20T23:16:21.118 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:16:07 UTC", "ActiveEnterTimestampMonotonic": "290974516", "ActiveExitTimestamp": "Wed 2021-10-20 23:16:06 UTC", "ActiveExitTimestampMonotonic": "289861658", "ActiveState": "active", "After": "network-online.target sysinit.target basic.target systemd-journald.socket firewalld.service containerd.service system.slice docker.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:16:06 UTC", "AssertTimestampMonotonic": "289875236", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:16:06 UTC", "ConditionTimestampMonotonic": "289875235", "ConfigurationDirectoryMode": "0755" 2021-10-20T23:16:21.120 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8250", "ExecMainStartTimestamp": "Wed 2021-10-20 23:16:06 UTC", "ExecMainStartTimestampMonotonic": "289876117", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-10-20T23:16:21.121 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:16:06 UTC", "InactiveEnterTimestampMonotonic": "289868721", "InactiveExitTimestamp": "Wed 2021-10-20 23:16:06 UTC", "InactiveExitTimestampMonotonic": "289877100", "InvocationID": "de62f6c7041d476f9c88fce60169854d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8250", "MemoryAccounting": "yes", "MemoryCurrent": "45547520", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-10-20T23:16:21.123 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:16:07 UTC", "StateChangeTimestampMonotonic": "290974516", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "17", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStart 2021-10-20T23:16:21.123 INFO:teuthology.task.ansible.out:USec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-10-20T23:16:21.125 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:16:21.233 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:16:07 UTC", "ActiveEnterTimestampMonotonic": "283836300", "ActiveExitTimestamp": "Wed 2021-10-20 23:16:06 UTC", "ActiveExitTimestampMonotonic": "282768688", "ActiveState": "active", "After": "network-online.target containerd.service firewalld.service basic.target systemd-journald.socket docker.socket sysinit.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:16:06 UTC", "AssertTimestampMonotonic": "282778513", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:16:06 UTC", "ConditionTimestampMonotonic": "282778512", "ConfigurationDirectoryMode": "0755" 2021-10-20T23:16:21.235 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8285", "ExecMainStartTimestamp": "Wed 2021-10-20 23:16:06 UTC", "ExecMainStartTimestampMonotonic": "282779261", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-10-20T23:16:21.236 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:16:06 UTC", "InactiveEnterTimestampMonotonic": "282772390", "InactiveExitTimestamp": "Wed 2021-10-20 23:16:06 UTC", "InactiveExitTimestampMonotonic": "282780079", "InvocationID": "defdb8d7d28a4e21945a78ad1b739d02", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8285", "MemoryAccounting": "yes", "MemoryCurrent": "45682688", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-10-20T23:16:21.238 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:16:07 UTC", "StateChangeTimestampMonotonic": "283836300", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "17", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-10-20T23:16:21.239 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "ini 2021-10-20T23:16:21.240 INFO:teuthology.task.ansible.out:t", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:16:21.770 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:16:08 UTC", "ActiveEnterTimestampMonotonic": "306319401", "ActiveExitTimestamp": "Wed 2021-10-20 23:16:07 UTC", "ActiveExitTimestampMonotonic": "305156045", "ActiveState": "active", "After": "firewalld.service network-online.target docker.socket sysinit.target systemd-journald.socket basic.target system.slice containerd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:16:07 UTC", "AssertTimestampMonotonic": "305171324", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:16:07 UTC", "ConditionTimestampMonotonic": "305171323", "ConfigurationDirectoryMode": "0755" 2021-10-20T23:16:21.773 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8190", "ExecMainStartTimestamp": "Wed 2021-10-20 23:16:07 UTC", "ExecMainStartTimestampMonotonic": "305172208", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-10-20T23:16:21.774 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:16:07 UTC", "InactiveEnterTimestampMonotonic": "305163870", "InactiveExitTimestamp": "Wed 2021-10-20 23:16:07 UTC", "InactiveExitTimestampMonotonic": "305173146", "InvocationID": "31acdee9c9c045adaa7cd1c137595212", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8190", "MemoryAccounting": "yes", "MemoryCurrent": "45924352", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-10-20T23:16:21.776 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:16:08 UTC", "StateChangeTimestampMonotonic": "306319401", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "17", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-10-20T23:16:21.778 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:16:22.688 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:16:09 UTC", "ActiveEnterTimestampMonotonic": "312881742", "ActiveExitTimestamp": "Wed 2021-10-20 23:16:08 UTC", "ActiveExitTimestampMonotonic": "311695509", "ActiveState": "active", "After": "system.slice docker.socket firewalld.service network-online.target containerd.service sysinit.target systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:16:08 UTC", "AssertTimestampMonotonic": "311708925", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:16:08 UTC", "ConditionTimestampMonotonic": "311708924", "ConfigurationDirectoryMode": "0755" 2021-10-20T23:16:22.690 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8184", "ExecMainStartTimestamp": "Wed 2021-10-20 23:16:08 UTC", "ExecMainStartTimestampMonotonic": "311709965", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-10-20T23:16:22.692 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:16:08 UTC", "InactiveEnterTimestampMonotonic": "311701722", "InactiveExitTimestamp": "Wed 2021-10-20 23:16:08 UTC", "InactiveExitTimestampMonotonic": "311710956", "InvocationID": "16fc8fd2f2e14f1fbb67576eac977c32", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8184", "MemoryAccounting": "yes", "MemoryCurrent": "46505984", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-10-20T23:16:22.694 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:16:09 UTC", "StateChangeTimestampMonotonic": "312881742", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "18", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-10-20T23:16:22.695 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "ini 2021-10-20T23:16:22.696 INFO:teuthology.task.ansible.out:t", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:16:22.774 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-10-20T23:16:22.775 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-10-20T23:16:22.777 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-10-20T23:16:22.778 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-20T23:16:22.793 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Wednesday 20 October 2021 23:16:22 +0000 (0:00:02.093) 0:03:32.867 ***** 2021-10-20T23:16:23.809 INFO:teuthology.task.ansible.out:ok: [smithi012.front.sepia.ceph.com] 2021-10-20T23:16:23.854 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] 2021-10-20T23:16:24.083 INFO:teuthology.task.ansible.out:ok: [smithi119.front.sepia.ceph.com] 2021-10-20T23:16:24.853 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] 2021-10-20T23:16:24.874 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Wednesday 20 October 2021 23:16:24 +0000 (0:00:02.080) 0:03:34.948 ***** 2021-10-20T23:16:25.072 INFO:teuthology.task.ansible.out:changed: [smithi012.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-10-20T23:16:25.095 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-10-20T23:16:25.115 INFO:teuthology.task.ansible.out:changed: [smithi119.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-10-20T23:16:25.148 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-10-20T23:16:25.154 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-10-20T23:16:25.156 INFO:teuthology.task.ansible.out:smithi012.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi031.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi119.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi136.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 Wednesday 20 October 2021 23:16:25 +0000 (0:00:00.281) 0:03:35.229 ***** =============================================================================== 2021-10-20T23:16:25.157 INFO:teuthology.task.ansible.out:Create all admin users with sudo access. ------------------------------- 22.64s users : Update authorized_keys using the keys repo --------------------- 20.41s container-host : Install container packages ---------------------------- 15.54s testnode : Upgrade packages -------------------------------------------- 14.61s testnode : Install packages -------------------------------------------- 11.13s testnode : Ensure packages are not present. ----------------------------- 7.63s testnode : Zap all non-root disks --------------------------------------- 7.57s Remove revoked users ---------------------------------------------------- 7.17s common : Update apt cache ----------------------------------------------- 3.39s container-host : Install registries-conf-ctl ---------------------------- 2.96s Gathering Facts --------------------------------------------------------- 2.20s container-host : Restart docker service --------------------------------- 2.09s Gathering Facts --------------------------------------------------------- 2.08s testnode : Install packages via pip ------------------------------------- 1.94s testnode : Create logical volume(s) ------------------------------------- 1.91s testnode : Update apt cache. -------------------------------------------- 1.70s testnode : Install apt keys ------------------ 2021-10-20T23:16:25.159 INFO:teuthology.task.ansible.out:--------------------------- 1.64s users : Update authorized_keys for each user with literal keys ---------- 1.08s Gathering Facts --------------------------------------------------------- 1.07s Gathering Facts --------------------------------------------------------- 0.88s 2021-10-20T23:16:25.566 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2021-10-20T23:16:25.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2021-10-20T23:16:25.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:16:25.622 DEBUG:teuthology.orchestra.run.smithi012:> true 2021-10-20T23:16:25.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2021-10-20T23:16:25.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:16:25.804 DEBUG:teuthology.orchestra.run.smithi031:> true 2021-10-20T23:16:25.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-20T23:16:25.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:16:25.990 DEBUG:teuthology.orchestra.run.smithi119:> true 2021-10-20T23:16:26.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2021-10-20T23:16:26.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:16:26.165 DEBUG:teuthology.orchestra.run.smithi136:> true 2021-10-20T23:16:26.281 INFO:teuthology.run_tasks:Running task clock... 2021-10-20T23:16:26.295 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-10-20T23:16:26.296 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-20T23:16:26.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-20T23:16:26.333 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-10-20T23:16:26.334 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: Command line: ntpd -gq 2021-10-20T23:16:26.334 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: proto: precision = 0.095 usec (-23) 2021-10-20T23:16:26.336 INFO:teuthology.orchestra.run.smithi012.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:16:26.336 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:16:26.337 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:16:26.337 INFO:teuthology.orchestra.run.smithi012.stderr:restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:16:26.338 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: Listen and drop on 0 v6wildcard [::]:123 2021-10-20T23:16:26.338 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-10-20T23:16:26.339 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: Listen normally on 2 lo 127.0.0.1:123 2021-10-20T23:16:26.339 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: Listen normally on 3 ens1f0 172.21.15.12:123 2021-10-20T23:16:26.339 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: Listen normally on 4 lo [::1]:123 2021-10-20T23:16:26.339 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:25ea%4]:123 2021-10-20T23:16:26.340 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:26 ntpd[9586]: Listening on routing socket on fd #22 for interface updates 2021-10-20T23:16:27.334 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:27 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:27.334 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:27 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:27.334 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:27 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:27 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:27 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:27 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:28.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:28.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:28.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:28.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:28 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:29.334 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:29.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:29.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:29.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:29.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:29.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:29.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:29.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:29.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:29 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:30.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:30.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:30.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:30 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:31.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:31.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:31.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:31.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:31.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:31.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:31.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:31.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:31 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:32.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:32.337 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:32 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:33.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:33.336 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:33.337 INFO:teuthology.orchestra.run.smithi012.stdout:20 Oct 23:16:33 ntpd[9586]: ntpd: time slew +0.002252 s 2021-10-20T23:16:33.337 INFO:teuthology.orchestra.run.smithi012.stdout:ntpd: time slew +0.002252s 2021-10-20T23:16:33.338 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-10-20T23:16:33.339 INFO:teuthology.orchestra.run.smithi012.stderr:20 Oct 23:16:33 ntpd[9586]: can't open /var/log/ntpstats/loopstats.20211020: Permission denied 2021-10-20T23:16:33.405 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2021-10-20T23:16:33.405 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2021-10-20T23:16:33.405 INFO:teuthology.orchestra.run.smithi012.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:33.406 INFO:teuthology.orchestra.run.smithi012.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:33.406 INFO:teuthology.orchestra.run.smithi012.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:33.406 INFO:teuthology.orchestra.run.smithi012.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:33.407 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-20T23:16:33.407 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-20T23:16:33.445 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-10-20T23:16:33.445 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: Command line: ntpd -gq 2021-10-20T23:16:33.446 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: proto: precision = 0.126 usec (-23) 2021-10-20T23:16:33.446 INFO:teuthology.orchestra.run.smithi031.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:16:33.447 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:16:33.448 INFO:teuthology.orchestra.run.smithi031.stderr:restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:16:33.449 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:16:33.449 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: Listen and drop on 0 v6wildcard [::]:123 2021-10-20T23:16:33.449 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-10-20T23:16:33.449 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: Listen normally on 2 lo 127.0.0.1:123 2021-10-20T23:16:33.450 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: Listen normally on 3 ens1f0 172.21.15.31:123 2021-10-20T23:16:33.450 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: Listen normally on 4 lo [::1]:123 2021-10-20T23:16:33.450 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:caba%4]:123 2021-10-20T23:16:33.451 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:33 ntpd[9604]: Listening on routing socket on fd #22 for interface updates 2021-10-20T23:16:34.446 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:34 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:34.446 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:34 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:34.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:34 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:34.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:34 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:34.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:34 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:34.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:34 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:35 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:35 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:35 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:35 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:35 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:35 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:36.446 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:36.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:36.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:36.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:36.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:36.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:36.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:36.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:36.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:36.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:36.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:36.450 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:36 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:37.446 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:37.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:37.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:37.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:37.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:37.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:37.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:37.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:37.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:37.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:37.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:37.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:37 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:38.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:38.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:38.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:38.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:38.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:38.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:38.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:38.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:38.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:38.450 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:38.450 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:38.450 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:38 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:39.446 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:39.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:39.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:39.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:39.447 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:39.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:39.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:39.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:39.448 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:39.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:39.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:39.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:39 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:40.449 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:40.450 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:40.450 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:40.450 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:40.450 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:40.451 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:40.451 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:40.451 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:40.452 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:40.452 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:40.453 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:40.453 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:40.454 INFO:teuthology.orchestra.run.smithi031.stdout:20 Oct 23:16:40 ntpd[9604]: ntpd: time slew +0.001225 s 2021-10-20T23:16:40.454 INFO:teuthology.orchestra.run.smithi031.stdout:ntpd: time slew +0.001225s 2021-10-20T23:16:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-10-20T23:16:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:20 Oct 23:16:40 ntpd[9604]: can't open /var/log/ntpstats/loopstats.20211020: Permission denied 2021-10-20T23:16:40.511 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2021-10-20T23:16:40.512 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2021-10-20T23:16:40.513 INFO:teuthology.orchestra.run.smithi031.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:40.513 INFO:teuthology.orchestra.run.smithi031.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:40.513 INFO:teuthology.orchestra.run.smithi031.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:40.513 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:40.514 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-20T23:16:40.515 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-20T23:16:40.552 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-10-20T23:16:40.553 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: Command line: ntpd -gq 2021-10-20T23:16:40.554 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: proto: precision = 0.271 usec (-22) 2021-10-20T23:16:40.554 INFO:teuthology.orchestra.run.smithi119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:16:40.555 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:16:40.555 INFO:teuthology.orchestra.run.smithi119.stderr:restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:16:40.557 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:16:40.557 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: Listen and drop on 0 v6wildcard [::]:123 2021-10-20T23:16:40.557 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-10-20T23:16:40.558 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: Listen normally on 2 lo 127.0.0.1:123 2021-10-20T23:16:40.558 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: Listen normally on 3 enp3s0f1 172.21.15.119:123 2021-10-20T23:16:40.558 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: Listen normally on 4 lo [::1]:123 2021-10-20T23:16:40.558 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5ef%5]:123 2021-10-20T23:16:40.559 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:40 ntpd[9657]: Listening on routing socket on fd #22 for interface updates 2021-10-20T23:16:41.554 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:41 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:41.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:41 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:41.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:41 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:41.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:41 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:41.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:41 ntpd[9657]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:41.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:41 ntpd[9657]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:42 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:42.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:42 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:42.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:42 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:42.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:42 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:42.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:42 ntpd[9657]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:42.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:42 ntpd[9657]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:43.554 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:43 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:43.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:43 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:43.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:43 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:43.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:43 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:43.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:43 ntpd[9657]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:43.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:43 ntpd[9657]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:44.554 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:44 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:44.554 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:44 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:44.554 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:44 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:44.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:44 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:44.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:44 ntpd[9657]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:44.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:44 ntpd[9657]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:45.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:45.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:45.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:45.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:45.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:45.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:45.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:45.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:45.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:45.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:45.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:45.558 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:45.558 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:45.558 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:45.558 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:45.561 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:45.561 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:45.561 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:45 ntpd[9657]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:46.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:46 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:46.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:46 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:46.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:46 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:46.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:46 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:46.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:46 ntpd[9657]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:46.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:46 ntpd[9657]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:47.555 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:47.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:47.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:47.556 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:47.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:47.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:47.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:47.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:47.557 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:47.558 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:47.558 INFO:teuthology.orchestra.run.smithi119.stdout:20 Oct 23:16:47 ntpd[9657]: ntpd: time slew +0.000236 s 2021-10-20T23:16:47.558 INFO:teuthology.orchestra.run.smithi119.stdout:ntpd: time slew +0.000236s 2021-10-20T23:16:47.559 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-10-20T23:16:47.562 INFO:teuthology.orchestra.run.smithi119.stderr:20 Oct 23:16:47 ntpd[9657]: can't open /var/log/ntpstats/loopstats.20211020: Permission denied 2021-10-20T23:16:47.635 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2021-10-20T23:16:47.635 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2021-10-20T23:16:47.636 INFO:teuthology.orchestra.run.smithi119.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:47.636 INFO:teuthology.orchestra.run.smithi119.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:47.636 INFO:teuthology.orchestra.run.smithi119.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:47.637 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:47.637 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-20T23:16:47.638 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-20T23:16:47.671 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-10-20T23:16:47.671 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: Command line: ntpd -gq 2021-10-20T23:16:47.672 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: proto: precision = 0.043 usec (-24) 2021-10-20T23:16:47.674 INFO:teuthology.orchestra.run.smithi136.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:16:47.675 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:16:47.676 INFO:teuthology.orchestra.run.smithi136.stderr:restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:16:47.677 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:16:47.677 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: Listen and drop on 0 v6wildcard [::]:123 2021-10-20T23:16:47.678 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-10-20T23:16:47.678 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: Listen normally on 2 lo 127.0.0.1:123 2021-10-20T23:16:47.678 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: Listen normally on 3 enp3s0f1 172.21.15.136:123 2021-10-20T23:16:47.678 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: Listen normally on 4 lo [::1]:123 2021-10-20T23:16:47.679 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e43%5]:123 2021-10-20T23:16:47.679 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:47 ntpd[9702]: Listening on routing socket on fd #22 for interface updates 2021-10-20T23:16:48.671 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:48 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:48.671 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:48 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:48.672 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:48 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:48.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:48 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:48.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:48 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:48.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:48 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:49.672 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:49 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:49.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:49 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:49.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:49 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:49.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:49 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:49.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:49 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:49.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:49 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:50.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:50.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:50.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:50.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:50.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:50.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:50.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:50.675 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:50.675 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:50.675 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:50.676 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:50.676 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:50 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:51.672 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:51.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:51.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:51.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:51.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:51.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:51.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:51.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:51.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:51.675 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:51.675 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:51.675 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:51 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:52.672 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:52.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:52.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:52.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:52.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:52.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:52.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:52.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:52.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:52.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:52.675 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:52.675 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:52 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:53.672 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:53.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:53.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:53.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:53.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:53.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:53.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:53.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:53.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:53.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:53.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:53.675 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:53 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:54.672 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:54.672 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:54.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:54.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:54.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:16:54.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:16:54.673 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:16:54.674 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:16:54.677 INFO:teuthology.orchestra.run.smithi136.stdout:20 Oct 23:16:54 ntpd[9702]: ntpd: time slew +0.000652 s 2021-10-20T23:16:54.677 INFO:teuthology.orchestra.run.smithi136.stdout:ntpd: time slew +0.000652s 2021-10-20T23:16:54.678 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-10-20T23:16:54.678 INFO:teuthology.orchestra.run.smithi136.stderr:20 Oct 23:16:54 ntpd[9702]: can't open /var/log/ntpstats/loopstats.20211020: Permission denied 2021-10-20T23:16:54.752 INFO:teuthology.orchestra.run.smithi136.stdout: remote refid st t when poll reach delay offset jitter 2021-10-20T23:16:54.752 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================== 2021-10-20T23:16:54.753 INFO:teuthology.orchestra.run.smithi136.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:54.753 INFO:teuthology.orchestra.run.smithi136.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:54.753 INFO:teuthology.orchestra.run.smithi136.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:54.753 INFO:teuthology.orchestra.run.smithi136.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:16:54.754 INFO:teuthology.run_tasks:Running task install... 2021-10-20T23:16:54.770 DEBUG:teuthology.task.install:project ceph 2021-10-20T23:16:54.771 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}} 2021-10-20T23:16:54.771 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'} 2021-10-20T23:16:54.771 INFO:teuthology.task.install:Using flavor: default 2021-10-20T23:16:54.780 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-10-20T23:16:54.780 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-10-20T23:16:54.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo lsb_release -is 2021-10-20T23:16:54.833 INFO:teuthology.orchestra.run.smithi012.stdout:Ubuntu 2021-10-20T23:16:54.843 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:16:54.845 DEBUG:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2021-10-20T23:16:54.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-key list | grep Ceph 2021-10-20T23:16:54.899 INFO:teuthology.orchestra.run.smithi031.stdout:Ubuntu 2021-10-20T23:16:54.905 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:16:54.905 DEBUG:teuthology.orchestra.run.smithi119:> sudo lsb_release -is 2021-10-20T23:16:54.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-key list | grep Ceph 2021-10-20T23:16:54.951 INFO:teuthology.orchestra.run.smithi012.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-10-20T23:16:54.957 INFO:teuthology.orchestra.run.smithi119.stdout:Ubuntu 2021-10-20T23:16:54.962 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:16:54.962 DEBUG:teuthology.orchestra.run.smithi136:> sudo lsb_release -is 2021-10-20T23:16:54.966 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-key list | grep Ceph 2021-10-20T23:16:55.012 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-10-20T23:16:55.016 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-10-20T23:16:55.016 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph.com (release key) 2021-10-20T23:16:55.018 INFO:teuthology.orchestra.run.smithi136.stdout:Ubuntu 2021-10-20T23:16:55.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo lsb_release -is 2021-10-20T23:16:55.025 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:16:55.025 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-key list | grep Ceph 2021-10-20T23:16:55.058 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-10-20T23:16:55.073 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-10-20T23:16:55.073 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph.com (release key) 2021-10-20T23:16:55.077 INFO:teuthology.orchestra.run.smithi012.stdout:Ubuntu 2021-10-20T23:16:55.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2021-10-20T23:16:55.079 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:16:55.080 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-10-20T23:16:55.080 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-10-20T23:16:55.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:16:55.124 INFO:teuthology.orchestra.run.smithi136.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-10-20T23:16:55.126 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-10-20T23:16:55.127 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph.com (release key) 2021-10-20T23:16:55.128 DEBUG:teuthology.orchestra.run.smithi119:> sudo lsb_release -is 2021-10-20T23:16:55.137 INFO:teuthology.orchestra.run.smithi031.stdout:Ubuntu 2021-10-20T23:16:55.143 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:16:55.143 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-10-20T23:16:55.144 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-10-20T23:16:55.144 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:16:55.185 INFO:teuthology.orchestra.run.smithi119.stdout:Ubuntu 2021-10-20T23:16:55.185 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:16:55.186 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-10-20T23:16:55.187 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-10-20T23:16:55.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:16:55.192 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-10-20T23:16:55.192 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph.com (release key) 2021-10-20T23:16:55.193 DEBUG:teuthology.orchestra.run.smithi136:> sudo lsb_release -is 2021-10-20T23:16:55.243 INFO:teuthology.orchestra.run.smithi136.stdout:Ubuntu 2021-10-20T23:16:55.249 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:16:55.250 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-10-20T23:16:55.250 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-10-20T23:16:55.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:16:55.274 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default/ 2021-10-20T23:16:55.275 INFO:teuthology.task.install.deb:Package version is 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:16:55.384 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default/ 2021-10-20T23:16:55.385 INFO:teuthology.task.install.deb:Package version is 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:16:55.391 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default/ 2021-10-20T23:16:55.392 INFO:teuthology.task.install.deb:Package version is 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:16:55.411 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:16:55.411 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-10-20T23:16:55.444 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2021-10-20T23:16:55.450 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default/ 2021-10-20T23:16:55.451 INFO:teuthology.task.install.deb:Package version is 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:16:55.523 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2021-10-20T23:16:55.524 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-10-20T23:16:55.532 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:16:55.532 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-10-20T23:16:55.540 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2021-10-20T23:16:55.550 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2021-10-20T23:16:55.571 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-10-20T23:16:55.571 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-10-20T23:16:55.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2021-10-20T23:16:55.635 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:16:55.687 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:16:55.693 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal InRelease 2021-10-20T23:16:55.719 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-10-20T23:16:55.730 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:16:55.734 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:16:55.742 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release.gpg 2021-10-20T23:16:55.748 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:16:55.753 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal InRelease 2021-10-20T23:16:55.765 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-10-20T23:16:55.776 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-10-20T23:16:55.795 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal InRelease 2021-10-20T23:16:55.796 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal InRelease 2021-10-20T23:16:55.802 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release.gpg 2021-10-20T23:16:55.806 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:16:55.816 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-10-20T23:16:55.817 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main i386 Packages [3,068 B] 2021-10-20T23:16:55.823 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-10-20T23:16:55.825 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main i386 Packages [3,068 B] 2021-10-20T23:16:55.830 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:16:55.843 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release.gpg 2021-10-20T23:16:55.845 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release.gpg 2021-10-20T23:16:55.850 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:16:55.853 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:16:55.866 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-10-20T23:16:55.868 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main i386 Packages [3,068 B] 2021-10-20T23:16:55.869 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main i386 Packages [3,068 B] 2021-10-20T23:16:55.888 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:16:55.905 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-10-20T23:16:55.913 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:16:55.917 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-10-20T23:16:55.930 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:16:55.935 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:16:55.971 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:16:56.014 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:16:56.017 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:16:56.318 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 26.5 kB in 1s (39.6 kB/s) 2021-10-20T23:16:56.377 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 26.5 kB in 1s (39.8 kB/s) 2021-10-20T23:16:56.381 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 26.5 kB in 1s (42.1 kB/s) 2021-10-20T23:16:56.427 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 26.5 kB in 1s (39.9 kB/s) 2021-10-20T23:16:57.138 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2021-10-20T23:16:57.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-138-g3fb760aa-1focal cephadm=15.2.14-138-g3fb760aa-1focal ceph-mds=15.2.14-138-g3fb760aa-1focal ceph-mgr=15.2.14-138-g3fb760aa-1focal ceph-common=15.2.14-138-g3fb760aa-1focal ceph-fuse=15.2.14-138-g3fb760aa-1focal ceph-test=15.2.14-138-g3fb760aa-1focal radosgw=15.2.14-138-g3fb760aa-1focal python3-rados=15.2.14-138-g3fb760aa-1focal python3-rgw=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal python3-rbd=15.2.14-138-g3fb760aa-1focal libcephfs2=15.2.14-138-g3fb760aa-1focal libcephfs-dev=15.2.14-138-g3fb760aa-1focal librados2=15.2.14-138-g3fb760aa-1focal librbd1=15.2.14-138-g3fb760aa-1focal rbd-fuse=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal cephfs-shell=15.2.14-138-g3fb760aa-1focal 2021-10-20T23:16:57.170 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2021-10-20T23:16:57.193 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-138-g3fb760aa-1focal cephadm=15.2.14-138-g3fb760aa-1focal ceph-mds=15.2.14-138-g3fb760aa-1focal ceph-mgr=15.2.14-138-g3fb760aa-1focal ceph-common=15.2.14-138-g3fb760aa-1focal ceph-fuse=15.2.14-138-g3fb760aa-1focal ceph-test=15.2.14-138-g3fb760aa-1focal radosgw=15.2.14-138-g3fb760aa-1focal python3-rados=15.2.14-138-g3fb760aa-1focal python3-rgw=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal python3-rbd=15.2.14-138-g3fb760aa-1focal libcephfs2=15.2.14-138-g3fb760aa-1focal libcephfs-dev=15.2.14-138-g3fb760aa-1focal librados2=15.2.14-138-g3fb760aa-1focal librbd1=15.2.14-138-g3fb760aa-1focal rbd-fuse=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal cephfs-shell=15.2.14-138-g3fb760aa-1focal 2021-10-20T23:16:57.197 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2021-10-20T23:16:57.219 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-138-g3fb760aa-1focal cephadm=15.2.14-138-g3fb760aa-1focal ceph-mds=15.2.14-138-g3fb760aa-1focal ceph-mgr=15.2.14-138-g3fb760aa-1focal ceph-common=15.2.14-138-g3fb760aa-1focal ceph-fuse=15.2.14-138-g3fb760aa-1focal ceph-test=15.2.14-138-g3fb760aa-1focal radosgw=15.2.14-138-g3fb760aa-1focal python3-rados=15.2.14-138-g3fb760aa-1focal python3-rgw=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal python3-rbd=15.2.14-138-g3fb760aa-1focal libcephfs2=15.2.14-138-g3fb760aa-1focal libcephfs-dev=15.2.14-138-g3fb760aa-1focal librados2=15.2.14-138-g3fb760aa-1focal librbd1=15.2.14-138-g3fb760aa-1focal rbd-fuse=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal cephfs-shell=15.2.14-138-g3fb760aa-1focal 2021-10-20T23:16:57.222 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-10-20T23:16:57.225 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2021-10-20T23:16:57.244 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-138-g3fb760aa-1focal cephadm=15.2.14-138-g3fb760aa-1focal ceph-mds=15.2.14-138-g3fb760aa-1focal ceph-mgr=15.2.14-138-g3fb760aa-1focal ceph-common=15.2.14-138-g3fb760aa-1focal ceph-fuse=15.2.14-138-g3fb760aa-1focal ceph-test=15.2.14-138-g3fb760aa-1focal radosgw=15.2.14-138-g3fb760aa-1focal python3-rados=15.2.14-138-g3fb760aa-1focal python3-rgw=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal python3-rbd=15.2.14-138-g3fb760aa-1focal libcephfs2=15.2.14-138-g3fb760aa-1focal libcephfs-dev=15.2.14-138-g3fb760aa-1focal librados2=15.2.14-138-g3fb760aa-1focal librbd1=15.2.14-138-g3fb760aa-1focal rbd-fuse=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal cephfs-shell=15.2.14-138-g3fb760aa-1focal 2021-10-20T23:16:57.256 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2021-10-20T23:16:57.284 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2021-10-20T23:16:57.316 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-10-20T23:16:57.396 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2021-10-20T23:16:57.397 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2021-10-20T23:16:57.426 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2021-10-20T23:16:57.427 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2021-10-20T23:16:57.455 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2021-10-20T23:16:57.456 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2021-10-20T23:16:57.467 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-10-20T23:16:57.467 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-10-20T23:16:57.547 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:16:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-20T23:16:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:16:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:16:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:16:57.548 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:16:57.548 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2021-10-20T23:16:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-20T23:16:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-20T23:16:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-10-20T23:16:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-10-20T23:16:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-10-20T23:16:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-10-20T23:16:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-10-20T23:16:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-10-20T23:16:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-10-20T23:16:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-10-20T23:16:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-10-20T23:16:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-10-20T23:16:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-10-20T23:16:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-10-20T23:16:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-10-20T23:16:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-10-20T23:16:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-10-20T23:16:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-10-20T23:16:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-10-20T23:16:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet 2021-10-20T23:16:57.556 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2021-10-20T23:16:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-10-20T23:16:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-10-20T23:16:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-10-20T23:16:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-10-20T23:16:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-10-20T23:16:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-10-20T23:16:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-10-20T23:16:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-10-20T23:16:57.558 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2021-10-20T23:16:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: btrfs-tools 2021-10-20T23:16:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:16:57.568 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-20T23:16:57.568 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:16:57.569 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:16:57.571 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:16:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:16:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2021-10-20T23:16:57.572 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-20T23:16:57.572 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-20T23:16:57.572 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-10-20T23:16:57.572 INFO:teuthology.orchestra.run.smithi119.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-10-20T23:16:57.573 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-10-20T23:16:57.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-10-20T23:16:57.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-10-20T23:16:57.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-10-20T23:16:57.574 INFO:teuthology.orchestra.run.smithi119.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-10-20T23:16:57.574 INFO:teuthology.orchestra.run.smithi119.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-10-20T23:16:57.574 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-10-20T23:16:57.575 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-10-20T23:16:57.575 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-10-20T23:16:57.575 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-10-20T23:16:57.575 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-10-20T23:16:57.576 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-10-20T23:16:57.576 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-10-20T23:16:57.576 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-10-20T23:16:57.576 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-10-20T23:16:57.577 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet 2021-10-20T23:16:57.577 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2021-10-20T23:16:57.577 INFO:teuthology.orchestra.run.smithi119.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-10-20T23:16:57.578 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-10-20T23:16:57.578 INFO:teuthology.orchestra.run.smithi119.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-10-20T23:16:57.578 INFO:teuthology.orchestra.run.smithi119.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-10-20T23:16:57.579 INFO:teuthology.orchestra.run.smithi119.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-10-20T23:16:57.580 INFO:teuthology.orchestra.run.smithi119.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-10-20T23:16:57.580 INFO:teuthology.orchestra.run.smithi119.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-10-20T23:16:57.581 INFO:teuthology.orchestra.run.smithi119.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-10-20T23:16:57.581 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2021-10-20T23:16:57.581 INFO:teuthology.orchestra.run.smithi119.stdout: btrfs-tools 2021-10-20T23:16:57.599 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:16:57.599 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-20T23:16:57.599 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:16:57.600 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:16:57.600 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:16:57.600 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:16:57.600 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2021-10-20T23:16:57.601 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-20T23:16:57.601 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-20T23:16:57.601 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-10-20T23:16:57.601 INFO:teuthology.orchestra.run.smithi136.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-10-20T23:16:57.602 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-10-20T23:16:57.602 INFO:teuthology.orchestra.run.smithi136.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-10-20T23:16:57.603 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-10-20T23:16:57.603 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-10-20T23:16:57.603 INFO:teuthology.orchestra.run.smithi136.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-10-20T23:16:57.603 INFO:teuthology.orchestra.run.smithi136.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-10-20T23:16:57.604 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-10-20T23:16:57.604 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-10-20T23:16:57.604 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-10-20T23:16:57.604 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-10-20T23:16:57.604 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-10-20T23:16:57.605 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-10-20T23:16:57.605 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-10-20T23:16:57.605 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-10-20T23:16:57.605 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-10-20T23:16:57.606 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet 2021-10-20T23:16:57.606 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2021-10-20T23:16:57.606 INFO:teuthology.orchestra.run.smithi136.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-10-20T23:16:57.606 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-10-20T23:16:57.606 INFO:teuthology.orchestra.run.smithi136.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-10-20T23:16:57.607 INFO:teuthology.orchestra.run.smithi136.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-10-20T23:16:57.607 INFO:teuthology.orchestra.run.smithi136.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-10-20T23:16:57.607 INFO:teuthology.orchestra.run.smithi136.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-10-20T23:16:57.607 INFO:teuthology.orchestra.run.smithi136.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-10-20T23:16:57.607 INFO:teuthology.orchestra.run.smithi136.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-10-20T23:16:57.608 INFO:teuthology.orchestra.run.smithi136.stdout:Recommended packages: 2021-10-20T23:16:57.608 INFO:teuthology.orchestra.run.smithi136.stdout: btrfs-tools 2021-10-20T23:16:57.610 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:16:57.610 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-20T23:16:57.611 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:16:57.611 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:16:57.611 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:16:57.611 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:16:57.612 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2021-10-20T23:16:57.612 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-20T23:16:57.612 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-20T23:16:57.612 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-10-20T23:16:57.612 INFO:teuthology.orchestra.run.smithi031.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-10-20T23:16:57.613 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-10-20T23:16:57.613 INFO:teuthology.orchestra.run.smithi031.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-10-20T23:16:57.613 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-10-20T23:16:57.613 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-10-20T23:16:57.614 INFO:teuthology.orchestra.run.smithi031.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-10-20T23:16:57.614 INFO:teuthology.orchestra.run.smithi031.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-10-20T23:16:57.614 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-10-20T23:16:57.614 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-10-20T23:16:57.614 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-10-20T23:16:57.615 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-10-20T23:16:57.615 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-10-20T23:16:57.615 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-10-20T23:16:57.615 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-10-20T23:16:57.615 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-10-20T23:16:57.616 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-10-20T23:16:57.616 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet 2021-10-20T23:16:57.616 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2021-10-20T23:16:57.616 INFO:teuthology.orchestra.run.smithi031.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-10-20T23:16:57.617 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-10-20T23:16:57.617 INFO:teuthology.orchestra.run.smithi031.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-10-20T23:16:57.617 INFO:teuthology.orchestra.run.smithi031.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-10-20T23:16:57.617 INFO:teuthology.orchestra.run.smithi031.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-10-20T23:16:57.617 INFO:teuthology.orchestra.run.smithi031.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-10-20T23:16:57.618 INFO:teuthology.orchestra.run.smithi031.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-10-20T23:16:57.618 INFO:teuthology.orchestra.run.smithi031.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-10-20T23:16:57.618 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2021-10-20T23:16:57.619 INFO:teuthology.orchestra.run.smithi031.stdout: btrfs-tools 2021-10-20T23:16:57.655 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2021-10-20T23:16:57.655 INFO:teuthology.orchestra.run.smithi012.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-10-20T23:16:57.655 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-20T23:16:57.656 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-20T23:16:57.656 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-10-20T23:16:57.656 INFO:teuthology.orchestra.run.smithi012.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-10-20T23:16:57.656 INFO:teuthology.orchestra.run.smithi012.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-10-20T23:16:57.657 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-10-20T23:16:57.657 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-10-20T23:16:57.657 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-10-20T23:16:57.657 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-10-20T23:16:57.657 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-10-20T23:16:57.658 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-10-20T23:16:57.658 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-10-20T23:16:57.658 INFO:teuthology.orchestra.run.smithi012.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-10-20T23:16:57.658 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-10-20T23:16:57.659 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-10-20T23:16:57.659 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-10-20T23:16:57.659 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-10-20T23:16:57.659 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-10-20T23:16:57.659 INFO:teuthology.orchestra.run.smithi012.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-10-20T23:16:57.660 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-10-20T23:16:57.660 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-10-20T23:16:57.661 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages will be upgraded: 2021-10-20T23:16:57.661 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 librbd1 2021-10-20T23:16:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2021-10-20T23:16:57.675 INFO:teuthology.orchestra.run.smithi119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-10-20T23:16:57.675 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-20T23:16:57.676 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-20T23:16:57.676 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-10-20T23:16:57.676 INFO:teuthology.orchestra.run.smithi119.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-10-20T23:16:57.676 INFO:teuthology.orchestra.run.smithi119.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-10-20T23:16:57.677 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-10-20T23:16:57.678 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-10-20T23:16:57.678 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-10-20T23:16:57.678 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-10-20T23:16:57.679 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-10-20T23:16:57.679 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-10-20T23:16:57.679 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-10-20T23:16:57.679 INFO:teuthology.orchestra.run.smithi119.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-10-20T23:16:57.679 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-10-20T23:16:57.680 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-10-20T23:16:57.680 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-10-20T23:16:57.680 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-10-20T23:16:57.680 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-10-20T23:16:57.681 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-10-20T23:16:57.681 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-10-20T23:16:57.681 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-10-20T23:16:57.681 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2021-10-20T23:16:57.681 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 librbd1 2021-10-20T23:16:57.703 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2021-10-20T23:16:57.704 INFO:teuthology.orchestra.run.smithi136.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-10-20T23:16:57.704 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-20T23:16:57.705 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-20T23:16:57.705 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-10-20T23:16:57.705 INFO:teuthology.orchestra.run.smithi136.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-10-20T23:16:57.706 INFO:teuthology.orchestra.run.smithi136.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-10-20T23:16:57.708 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-10-20T23:16:57.708 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-10-20T23:16:57.708 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-10-20T23:16:57.708 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-10-20T23:16:57.708 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-10-20T23:16:57.709 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-10-20T23:16:57.709 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-10-20T23:16:57.709 INFO:teuthology.orchestra.run.smithi136.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-10-20T23:16:57.709 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-10-20T23:16:57.710 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-10-20T23:16:57.710 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-10-20T23:16:57.710 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-10-20T23:16:57.710 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-10-20T23:16:57.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-10-20T23:16:57.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-10-20T23:16:57.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-10-20T23:16:57.711 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages will be upgraded: 2021-10-20T23:16:57.711 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 librbd1 2021-10-20T23:16:57.713 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2021-10-20T23:16:57.713 INFO:teuthology.orchestra.run.smithi031.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-10-20T23:16:57.713 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-20T23:16:57.714 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-20T23:16:57.714 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-10-20T23:16:57.714 INFO:teuthology.orchestra.run.smithi031.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-10-20T23:16:57.714 INFO:teuthology.orchestra.run.smithi031.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-10-20T23:16:57.715 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-10-20T23:16:57.715 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-10-20T23:16:57.715 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-10-20T23:16:57.715 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-10-20T23:16:57.715 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-10-20T23:16:57.716 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-10-20T23:16:57.716 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-10-20T23:16:57.717 INFO:teuthology.orchestra.run.smithi031.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-10-20T23:16:57.717 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-10-20T23:16:57.717 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-10-20T23:16:57.717 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-10-20T23:16:57.717 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-10-20T23:16:57.718 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-10-20T23:16:57.718 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-10-20T23:16:57.718 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-10-20T23:16:57.718 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-10-20T23:16:57.719 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2021-10-20T23:16:57.719 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 librbd1 2021-10-20T23:16:57.810 INFO:teuthology.orchestra.run.smithi012.stdout:2 upgraded, 101 newly installed, 0 to remove and 26 not upgraded. 2021-10-20T23:16:57.810 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 153 MB of archives. 2021-10-20T23:16:57.810 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 698 MB of additional disk space will be used. 2021-10-20T23:16:57.811 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-138-g3fb760aa-1focal [1,695 kB] 2021-10-20T23:16:57.831 INFO:teuthology.orchestra.run.smithi119.stdout:2 upgraded, 101 newly installed, 0 to remove and 26 not upgraded. 2021-10-20T23:16:57.832 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 153 MB of archives. 2021-10-20T23:16:57.833 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 698 MB of additional disk space will be used. 2021-10-20T23:16:57.834 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-138-g3fb760aa-1focal [1,695 kB] 2021-10-20T23:16:57.847 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-10-20T23:16:57.864 INFO:teuthology.orchestra.run.smithi136.stdout:2 upgraded, 101 newly installed, 0 to remove and 26 not upgraded. 2021-10-20T23:16:57.864 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 153 MB of archives. 2021-10-20T23:16:57.865 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 698 MB of additional disk space will be used. 2021-10-20T23:16:57.867 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-138-g3fb760aa-1focal [1,695 kB] 2021-10-20T23:16:57.868 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-10-20T23:16:57.873 INFO:teuthology.orchestra.run.smithi031.stdout:2 upgraded, 101 newly installed, 0 to remove and 26 not upgraded. 2021-10-20T23:16:57.873 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 153 MB of archives. 2021-10-20T23:16:57.873 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 698 MB of additional disk space will be used. 2021-10-20T23:16:57.874 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-138-g3fb760aa-1focal [1,695 kB] 2021-10-20T23:16:57.898 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-10-20T23:16:57.906 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-10-20T23:16:57.930 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-10-20T23:16:57.951 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-10-20T23:16:57.959 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-10-20T23:16:57.980 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-10-20T23:16:57.982 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-10-20T23:16:57.992 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-10-20T23:16:58.014 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-10-20T23:16:58.021 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-10-20T23:16:58.036 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-138-g3fb760aa-1focal [3,246 kB] 2021-10-20T23:16:58.062 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-10-20T23:16:58.063 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-138-g3fb760aa-1focal [3,246 kB] 2021-10-20T23:16:58.085 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-10-20T23:16:58.118 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-10-20T23:16:58.142 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-10-20T23:16:58.197 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-138-g3fb760aa-1focal [3,246 kB] 2021-10-20T23:16:58.203 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-10-20T23:16:58.209 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-10-20T23:16:58.220 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-10-20T23:16:58.224 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-138-g3fb760aa-1focal [3,246 kB] 2021-10-20T23:16:58.225 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-10-20T23:16:58.232 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-10-20T23:16:58.242 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-10-20T23:16:58.257 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-10-20T23:16:58.260 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-10-20T23:16:58.265 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-10-20T23:16:58.271 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-10-20T23:16:58.279 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-10-20T23:16:58.296 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-10-20T23:16:58.327 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-10-20T23:16:58.350 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-10-20T23:16:58.351 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-10-20T23:16:58.353 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-138-g3fb760aa-1focal [463 kB] 2021-10-20T23:16:58.356 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-10-20T23:16:58.375 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-10-20T23:16:58.378 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-10-20T23:16:58.379 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-10-20T23:16:58.382 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-10-20T23:16:58.385 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-138-g3fb760aa-1focal [463 kB] 2021-10-20T23:16:58.386 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-10-20T23:16:58.389 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-10-20T23:16:58.401 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-10-20T23:16:58.403 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-10-20T23:16:58.404 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-10-20T23:16:58.405 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-10-20T23:16:58.406 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-10-20T23:16:58.408 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-10-20T23:16:58.408 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-10-20T23:16:58.410 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-138-g3fb760aa-1focal [365 kB] 2021-10-20T23:16:58.411 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-10-20T23:16:58.415 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-10-20T23:16:58.423 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-10-20T23:16:58.424 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-138-g3fb760aa-1focal [20.8 kB] 2021-10-20T23:16:58.424 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-138-g3fb760aa-1focal [156 kB] 2021-10-20T23:16:58.426 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-10-20T23:16:58.427 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-10-20T23:16:58.428 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-10-20T23:16:58.429 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-10-20T23:16:58.436 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-10-20T23:16:58.440 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-10-20T23:16:58.443 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-138-g3fb760aa-1focal [365 kB] 2021-10-20T23:16:58.443 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-10-20T23:16:58.447 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-10-20T23:16:58.452 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-10-20T23:16:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-10-20T23:16:58.454 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-10-20T23:16:58.456 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-10-20T23:16:58.457 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-10-20T23:16:58.457 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-138-g3fb760aa-1focal [20.8 kB] 2021-10-20T23:16:58.457 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-138-g3fb760aa-1focal [156 kB] 2021-10-20T23:16:58.458 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-10-20T23:16:58.460 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-10-20T23:16:58.460 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-10-20T23:16:58.461 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-138-g3fb760aa-1focal [29.4 kB] 2021-10-20T23:16:58.462 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-138-g3fb760aa-1focal [363 kB] 2021-10-20T23:16:58.475 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-10-20T23:16:58.476 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-10-20T23:16:58.477 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-10-20T23:16:58.478 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-10-20T23:16:58.478 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-10-20T23:16:58.480 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-10-20T23:16:58.486 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-138-g3fb760aa-1focal [3,139 kB] 2021-10-20T23:16:58.494 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-138-g3fb760aa-1focal [29.4 kB] 2021-10-20T23:16:58.502 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-138-g3fb760aa-1focal [363 kB] 2021-10-20T23:16:58.505 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-10-20T23:16:58.508 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-10-20T23:16:58.509 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-10-20T23:16:58.520 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-138-g3fb760aa-1focal [3,139 kB] 2021-10-20T23:16:58.521 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-10-20T23:16:58.524 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-10-20T23:16:58.525 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-10-20T23:16:58.533 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-10-20T23:16:58.536 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-10-20T23:16:58.538 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-10-20T23:16:58.541 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-10-20T23:16:58.544 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-10-20T23:16:58.545 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-10-20T23:16:58.556 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-10-20T23:16:58.559 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-10-20T23:16:58.560 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-10-20T23:16:58.563 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-10-20T23:16:58.564 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-10-20T23:16:58.567 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-10-20T23:16:58.568 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-10-20T23:16:58.587 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-10-20T23:16:58.588 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-10-20T23:16:58.590 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-10-20T23:16:58.592 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-10-20T23:16:58.595 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-10-20T23:16:58.601 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-10-20T23:16:58.601 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-10-20T23:16:58.603 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-10-20T23:16:58.606 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-10-20T23:16:58.607 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-10-20T23:16:58.610 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-10-20T23:16:58.614 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-10-20T23:16:58.615 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-10-20T23:16:58.615 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-10-20T23:16:58.616 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-10-20T23:16:58.618 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-10-20T23:16:58.620 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-10-20T23:16:58.636 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-10-20T23:16:58.638 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-10-20T23:16:58.639 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-10-20T23:16:58.640 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-10-20T23:16:58.670 INFO:teuthology.orchestra.run.smithi136.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-10-20T23:16:58.671 INFO:teuthology.orchestra.run.smithi136.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-10-20T23:16:58.672 INFO:teuthology.orchestra.run.smithi136.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-10-20T23:16:58.685 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-10-20T23:16:58.686 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-10-20T23:16:58.687 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-10-20T23:16:58.697 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-10-20T23:16:58.704 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-10-20T23:16:58.707 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-10-20T23:16:58.707 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-10-20T23:16:58.709 INFO:teuthology.orchestra.run.smithi012.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-10-20T23:16:58.710 INFO:teuthology.orchestra.run.smithi012.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-10-20T23:16:58.712 INFO:teuthology.orchestra.run.smithi012.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-10-20T23:16:58.720 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-10-20T23:16:58.726 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-138-g3fb760aa-1focal [463 kB] 2021-10-20T23:16:58.726 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-10-20T23:16:58.729 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-10-20T23:16:58.730 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-10-20T23:16:58.734 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-10-20T23:16:58.735 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-10-20T23:16:58.737 INFO:teuthology.orchestra.run.smithi119.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-10-20T23:16:58.752 INFO:teuthology.orchestra.run.smithi136.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-10-20T23:16:58.757 INFO:teuthology.orchestra.run.smithi136.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-10-20T23:16:58.760 INFO:teuthology.orchestra.run.smithi136.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-10-20T23:16:58.761 INFO:teuthology.orchestra.run.smithi136.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-10-20T23:16:58.765 INFO:teuthology.orchestra.run.smithi136.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-10-20T23:16:58.766 INFO:teuthology.orchestra.run.smithi136.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-10-20T23:16:58.766 INFO:teuthology.orchestra.run.smithi136.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-10-20T23:16:58.767 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-10-20T23:16:58.773 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-10-20T23:16:58.777 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-10-20T23:16:58.777 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-10-20T23:16:58.779 INFO:teuthology.orchestra.run.smithi012.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-10-20T23:16:58.780 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-10-20T23:16:58.780 INFO:teuthology.orchestra.run.smithi012.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-10-20T23:16:58.781 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-10-20T23:16:58.781 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-10-20T23:16:58.789 INFO:teuthology.orchestra.run.smithi012.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-138-g3fb760aa-1focal [116 kB] 2021-10-20T23:16:58.803 INFO:teuthology.orchestra.run.smithi119.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-10-20T23:16:58.803 INFO:teuthology.orchestra.run.smithi119.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-10-20T23:16:58.806 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-138-g3fb760aa-1focal [365 kB] 2021-10-20T23:16:58.842 INFO:teuthology.orchestra.run.smithi012.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-138-g3fb760aa-1focal [361 kB] 2021-10-20T23:16:58.843 INFO:teuthology.orchestra.run.smithi136.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-138-g3fb760aa-1focal [463 kB] 2021-10-20T23:16:58.843 INFO:teuthology.orchestra.run.smithi136.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-10-20T23:16:58.843 INFO:teuthology.orchestra.run.smithi136.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-10-20T23:16:58.866 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-10-20T23:16:58.867 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-10-20T23:16:58.913 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-138-g3fb760aa-1focal [20.8 kB] 2021-10-20T23:16:58.913 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-138-g3fb760aa-1focal [156 kB] 2021-10-20T23:16:58.921 INFO:teuthology.orchestra.run.smithi031.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-138-g3fb760aa-1focal [29.4 kB] 2021-10-20T23:16:58.923 INFO:teuthology.orchestra.run.smithi031.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-138-g3fb760aa-1focal [363 kB] 2021-10-20T23:16:58.956 INFO:teuthology.orchestra.run.smithi136.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-138-g3fb760aa-1focal [365 kB] 2021-10-20T23:16:58.969 INFO:teuthology.orchestra.run.smithi136.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-138-g3fb760aa-1focal [20.8 kB] 2021-10-20T23:16:58.969 INFO:teuthology.orchestra.run.smithi136.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-138-g3fb760aa-1focal [156 kB] 2021-10-20T23:16:58.993 INFO:teuthology.orchestra.run.smithi012.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-138-g3fb760aa-1focal [20.0 MB] 2021-10-20T23:16:59.023 INFO:teuthology.orchestra.run.smithi119.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-138-g3fb760aa-1focal [116 kB] 2021-10-20T23:16:59.026 INFO:teuthology.orchestra.run.smithi119.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-138-g3fb760aa-1focal [361 kB] 2021-10-20T23:16:59.034 INFO:teuthology.orchestra.run.smithi119.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-138-g3fb760aa-1focal [20.0 MB] 2021-10-20T23:16:59.107 INFO:teuthology.orchestra.run.smithi136.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-138-g3fb760aa-1focal [29.4 kB] 2021-10-20T23:16:59.109 INFO:teuthology.orchestra.run.smithi136.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-138-g3fb760aa-1focal [363 kB] 2021-10-20T23:16:59.115 INFO:teuthology.orchestra.run.smithi136.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-138-g3fb760aa-1focal [3,139 kB] 2021-10-20T23:16:59.128 INFO:teuthology.orchestra.run.smithi031.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-138-g3fb760aa-1focal [3,139 kB] 2021-10-20T23:16:59.452 INFO:teuthology.orchestra.run.smithi119.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-10-20T23:16:59.474 INFO:teuthology.orchestra.run.smithi031.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-10-20T23:16:59.494 INFO:teuthology.orchestra.run.smithi031.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-138-g3fb760aa-1focal [116 kB] 2021-10-20T23:16:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-10-20T23:16:59.500 INFO:teuthology.orchestra.run.smithi031.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-138-g3fb760aa-1focal [361 kB] 2021-10-20T23:16:59.518 INFO:teuthology.orchestra.run.smithi136.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-10-20T23:16:59.557 INFO:teuthology.orchestra.run.smithi119.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-10-20T23:16:59.562 INFO:teuthology.orchestra.run.smithi119.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-10-20T23:16:59.570 INFO:teuthology.orchestra.run.smithi136.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-138-g3fb760aa-1focal [116 kB] 2021-10-20T23:16:59.578 INFO:teuthology.orchestra.run.smithi136.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-138-g3fb760aa-1focal [361 kB] 2021-10-20T23:16:59.579 INFO:teuthology.orchestra.run.smithi136.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-10-20T23:16:59.587 INFO:teuthology.orchestra.run.smithi136.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-10-20T23:16:59.601 INFO:teuthology.orchestra.run.smithi031.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-138-g3fb760aa-1focal [20.0 MB] 2021-10-20T23:16:59.607 INFO:teuthology.orchestra.run.smithi031.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-10-20T23:16:59.697 INFO:teuthology.orchestra.run.smithi031.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-10-20T23:16:59.711 INFO:teuthology.orchestra.run.smithi012.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-10-20T23:16:59.712 INFO:teuthology.orchestra.run.smithi012.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-10-20T23:16:59.713 INFO:teuthology.orchestra.run.smithi136.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-138-g3fb760aa-1focal [20.0 MB] 2021-10-20T23:16:59.718 INFO:teuthology.orchestra.run.smithi119.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-10-20T23:16:59.718 INFO:teuthology.orchestra.run.smithi119.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-10-20T23:16:59.720 INFO:teuthology.orchestra.run.smithi119.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-10-20T23:16:59.721 INFO:teuthology.orchestra.run.smithi119.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-10-20T23:16:59.722 INFO:teuthology.orchestra.run.smithi119.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-10-20T23:16:59.724 INFO:teuthology.orchestra.run.smithi119.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-10-20T23:16:59.724 INFO:teuthology.orchestra.run.smithi119.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-10-20T23:16:59.745 INFO:teuthology.orchestra.run.smithi012.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-10-20T23:16:59.745 INFO:teuthology.orchestra.run.smithi012.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-10-20T23:16:59.745 INFO:teuthology.orchestra.run.smithi012.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-10-20T23:16:59.745 INFO:teuthology.orchestra.run.smithi012.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-10-20T23:16:59.746 INFO:teuthology.orchestra.run.smithi012.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-10-20T23:16:59.748 INFO:teuthology.orchestra.run.smithi012.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-10-20T23:16:59.748 INFO:teuthology.orchestra.run.smithi012.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-10-20T23:16:59.748 INFO:teuthology.orchestra.run.smithi136.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-10-20T23:16:59.749 INFO:teuthology.orchestra.run.smithi136.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-10-20T23:16:59.749 INFO:teuthology.orchestra.run.smithi136.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-10-20T23:16:59.752 INFO:teuthology.orchestra.run.smithi136.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-10-20T23:16:59.752 INFO:teuthology.orchestra.run.smithi136.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-10-20T23:16:59.753 INFO:teuthology.orchestra.run.smithi136.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-10-20T23:16:59.755 INFO:teuthology.orchestra.run.smithi136.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-10-20T23:16:59.763 INFO:teuthology.orchestra.run.smithi031.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-10-20T23:16:59.764 INFO:teuthology.orchestra.run.smithi031.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-10-20T23:16:59.765 INFO:teuthology.orchestra.run.smithi031.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-10-20T23:16:59.765 INFO:teuthology.orchestra.run.smithi031.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-10-20T23:16:59.766 INFO:teuthology.orchestra.run.smithi031.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-10-20T23:16:59.767 INFO:teuthology.orchestra.run.smithi031.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-10-20T23:16:59.768 INFO:teuthology.orchestra.run.smithi031.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-10-20T23:16:59.769 INFO:teuthology.orchestra.run.smithi119.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-10-20T23:16:59.770 INFO:teuthology.orchestra.run.smithi119.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-10-20T23:16:59.776 INFO:teuthology.orchestra.run.smithi031.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-10-20T23:16:59.781 INFO:teuthology.orchestra.run.smithi136.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-10-20T23:16:59.781 INFO:teuthology.orchestra.run.smithi136.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-10-20T23:16:59.828 INFO:teuthology.orchestra.run.smithi012.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-10-20T23:16:59.829 INFO:teuthology.orchestra.run.smithi136.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-10-20T23:16:59.830 INFO:teuthology.orchestra.run.smithi012.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-10-20T23:16:59.830 INFO:teuthology.orchestra.run.smithi012.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-10-20T23:16:59.836 INFO:teuthology.orchestra.run.smithi012.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-10-20T23:16:59.839 INFO:teuthology.orchestra.run.smithi012.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-10-20T23:16:59.841 INFO:teuthology.orchestra.run.smithi012.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-10-20T23:16:59.842 INFO:teuthology.orchestra.run.smithi012.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-10-20T23:16:59.845 INFO:teuthology.orchestra.run.smithi136.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-10-20T23:16:59.846 INFO:teuthology.orchestra.run.smithi012.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-10-20T23:16:59.852 INFO:teuthology.orchestra.run.smithi031.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-10-20T23:16:59.852 INFO:teuthology.orchestra.run.smithi031.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-10-20T23:16:59.854 INFO:teuthology.orchestra.run.smithi119.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-10-20T23:16:59.857 INFO:teuthology.orchestra.run.smithi031.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-10-20T23:16:59.861 INFO:teuthology.orchestra.run.smithi031.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-10-20T23:16:59.861 INFO:teuthology.orchestra.run.smithi119.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-10-20T23:16:59.864 INFO:teuthology.orchestra.run.smithi031.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-10-20T23:16:59.865 INFO:teuthology.orchestra.run.smithi119.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-10-20T23:16:59.866 INFO:teuthology.orchestra.run.smithi031.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-10-20T23:16:59.868 INFO:teuthology.orchestra.run.smithi119.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-10-20T23:16:59.869 INFO:teuthology.orchestra.run.smithi119.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-10-20T23:16:59.873 INFO:teuthology.orchestra.run.smithi031.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-10-20T23:16:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-10-20T23:16:59.877 INFO:teuthology.orchestra.run.smithi031.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-10-20T23:16:59.880 INFO:teuthology.orchestra.run.smithi119.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-10-20T23:16:59.882 INFO:teuthology.orchestra.run.smithi031.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-10-20T23:16:59.884 INFO:teuthology.orchestra.run.smithi119.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-10-20T23:16:59.910 INFO:teuthology.orchestra.run.smithi012.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-10-20T23:16:59.912 INFO:teuthology.orchestra.run.smithi136.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-10-20T23:16:59.916 INFO:teuthology.orchestra.run.smithi136.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-10-20T23:16:59.917 INFO:teuthology.orchestra.run.smithi136.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-10-20T23:16:59.920 INFO:teuthology.orchestra.run.smithi012.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-10-20T23:16:59.924 INFO:teuthology.orchestra.run.smithi136.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-10-20T23:16:59.926 INFO:teuthology.orchestra.run.smithi136.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-10-20T23:16:59.929 INFO:teuthology.orchestra.run.smithi136.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-10-20T23:16:59.929 INFO:teuthology.orchestra.run.smithi136.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-10-20T23:16:59.931 INFO:teuthology.orchestra.run.smithi136.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-10-20T23:16:59.937 INFO:teuthology.orchestra.run.smithi119.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-10-20T23:16:59.944 INFO:teuthology.orchestra.run.smithi119.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-10-20T23:16:59.954 INFO:teuthology.orchestra.run.smithi031.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-10-20T23:16:59.961 INFO:teuthology.orchestra.run.smithi031.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-10-20T23:16:59.961 INFO:teuthology.orchestra.run.smithi031.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-10-20T23:16:59.962 INFO:teuthology.orchestra.run.smithi031.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-10-20T23:16:59.963 INFO:teuthology.orchestra.run.smithi031.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-10-20T23:16:59.965 INFO:teuthology.orchestra.run.smithi031.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-10-20T23:16:59.994 INFO:teuthology.orchestra.run.smithi012.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-10-20T23:16:59.994 INFO:teuthology.orchestra.run.smithi136.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-10-20T23:16:59.995 INFO:teuthology.orchestra.run.smithi136.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-10-20T23:17:00.005 INFO:teuthology.orchestra.run.smithi012.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-10-20T23:17:00.006 INFO:teuthology.orchestra.run.smithi012.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-10-20T23:17:00.006 INFO:teuthology.orchestra.run.smithi012.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-10-20T23:17:00.006 INFO:teuthology.orchestra.run.smithi012.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-10-20T23:17:00.009 INFO:teuthology.orchestra.run.smithi012.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-10-20T23:17:00.019 INFO:teuthology.orchestra.run.smithi119.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-10-20T23:17:00.020 INFO:teuthology.orchestra.run.smithi119.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-10-20T23:17:00.020 INFO:teuthology.orchestra.run.smithi119.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-10-20T23:17:00.021 INFO:teuthology.orchestra.run.smithi119.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-10-20T23:17:00.041 INFO:teuthology.orchestra.run.smithi031.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-10-20T23:17:00.042 INFO:teuthology.orchestra.run.smithi031.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-10-20T23:17:00.043 INFO:teuthology.orchestra.run.smithi031.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-10-20T23:17:00.044 INFO:teuthology.orchestra.run.smithi031.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-10-20T23:17:00.047 INFO:teuthology.orchestra.run.smithi119.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-10-20T23:17:00.048 INFO:teuthology.orchestra.run.smithi119.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-10-20T23:17:00.048 INFO:teuthology.orchestra.run.smithi119.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-10-20T23:17:00.049 INFO:teuthology.orchestra.run.smithi119.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-10-20T23:17:00.066 INFO:teuthology.orchestra.run.smithi012.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-10-20T23:17:00.066 INFO:teuthology.orchestra.run.smithi012.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-10-20T23:17:00.074 INFO:teuthology.orchestra.run.smithi012.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-10-20T23:17:00.075 INFO:teuthology.orchestra.run.smithi012.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-10-20T23:17:00.076 INFO:teuthology.orchestra.run.smithi136.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-10-20T23:17:00.079 INFO:teuthology.orchestra.run.smithi136.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-10-20T23:17:00.099 INFO:teuthology.orchestra.run.smithi136.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-10-20T23:17:00.100 INFO:teuthology.orchestra.run.smithi136.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-10-20T23:17:00.101 INFO:teuthology.orchestra.run.smithi136.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-10-20T23:17:00.101 INFO:teuthology.orchestra.run.smithi136.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-10-20T23:17:00.102 INFO:teuthology.orchestra.run.smithi136.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-10-20T23:17:00.104 INFO:teuthology.orchestra.run.smithi136.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-10-20T23:17:00.105 INFO:teuthology.orchestra.run.smithi119.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-10-20T23:17:00.106 INFO:teuthology.orchestra.run.smithi119.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-10-20T23:17:00.123 INFO:teuthology.orchestra.run.smithi031.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-10-20T23:17:00.124 INFO:teuthology.orchestra.run.smithi031.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-10-20T23:17:00.125 INFO:teuthology.orchestra.run.smithi031.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-10-20T23:17:00.129 INFO:teuthology.orchestra.run.smithi031.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-10-20T23:17:00.157 INFO:teuthology.orchestra.run.smithi012.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-10-20T23:17:00.158 INFO:teuthology.orchestra.run.smithi136.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-10-20T23:17:00.159 INFO:teuthology.orchestra.run.smithi012.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-10-20T23:17:00.160 INFO:teuthology.orchestra.run.smithi012.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-10-20T23:17:00.164 INFO:teuthology.orchestra.run.smithi136.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-10-20T23:17:00.167 INFO:teuthology.orchestra.run.smithi012.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-10-20T23:17:00.187 INFO:teuthology.orchestra.run.smithi119.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-10-20T23:17:00.190 INFO:teuthology.orchestra.run.smithi119.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-10-20T23:17:01.555 INFO:teuthology.orchestra.run.smithi012.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-138-g3fb760aa-1focal [5,334 kB] 2021-10-20T23:17:01.575 INFO:teuthology.orchestra.run.smithi119.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-138-g3fb760aa-1focal [5,334 kB] 2021-10-20T23:17:02.171 INFO:teuthology.orchestra.run.smithi012.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-138-g3fb760aa-1focal [162 kB] 2021-10-20T23:17:02.192 INFO:teuthology.orchestra.run.smithi119.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-138-g3fb760aa-1focal [162 kB] 2021-10-20T23:17:02.202 INFO:teuthology.orchestra.run.smithi012.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-138-g3fb760aa-1focal [1,402 kB] 2021-10-20T23:17:02.225 INFO:teuthology.orchestra.run.smithi119.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-138-g3fb760aa-1focal [1,402 kB] 2021-10-20T23:17:02.369 INFO:teuthology.orchestra.run.smithi012.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-138-g3fb760aa-1focal [6,169 kB] 2021-10-20T23:17:02.391 INFO:teuthology.orchestra.run.smithi119.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-138-g3fb760aa-1focal [6,169 kB] 2021-10-20T23:17:02.432 INFO:teuthology.orchestra.run.smithi031.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-138-g3fb760aa-1focal [5,334 kB] 2021-10-20T23:17:02.496 INFO:teuthology.orchestra.run.smithi136.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-138-g3fb760aa-1focal [5,334 kB] 2021-10-20T23:17:03.096 INFO:teuthology.orchestra.run.smithi031.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-138-g3fb760aa-1focal [162 kB] 2021-10-20T23:17:03.100 INFO:teuthology.orchestra.run.smithi031.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-138-g3fb760aa-1focal [1,402 kB] 2021-10-20T23:17:03.125 INFO:teuthology.orchestra.run.smithi012.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-138-g3fb760aa-1focal [23.9 MB] 2021-10-20T23:17:03.151 INFO:teuthology.orchestra.run.smithi119.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-138-g3fb760aa-1focal [23.9 MB] 2021-10-20T23:17:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-138-g3fb760aa-1focal [162 kB] 2021-10-20T23:17:03.206 INFO:teuthology.orchestra.run.smithi136.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-138-g3fb760aa-1focal [1,402 kB] 2021-10-20T23:17:03.284 INFO:teuthology.orchestra.run.smithi031.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-138-g3fb760aa-1focal [6,169 kB] 2021-10-20T23:17:03.397 INFO:teuthology.orchestra.run.smithi136.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-138-g3fb760aa-1focal [6,169 kB] 2021-10-20T23:17:04.143 INFO:teuthology.orchestra.run.smithi031.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-138-g3fb760aa-1focal [23.9 MB] 2021-10-20T23:17:04.248 INFO:teuthology.orchestra.run.smithi136.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-138-g3fb760aa-1focal [23.9 MB] 2021-10-20T23:17:06.233 INFO:teuthology.orchestra.run.smithi012.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-138-g3fb760aa-1focal [4,008 B] 2021-10-20T23:17:06.236 INFO:teuthology.orchestra.run.smithi012.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-138-g3fb760aa-1focal [538 kB] 2021-10-20T23:17:06.252 INFO:teuthology.orchestra.run.smithi012.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-138-g3fb760aa-1focal [2,006 kB] 2021-10-20T23:17:06.266 INFO:teuthology.orchestra.run.smithi119.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-138-g3fb760aa-1focal [4,008 B] 2021-10-20T23:17:06.267 INFO:teuthology.orchestra.run.smithi119.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-138-g3fb760aa-1focal [538 kB] 2021-10-20T23:17:06.288 INFO:teuthology.orchestra.run.smithi119.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-138-g3fb760aa-1focal [2,006 kB] 2021-10-20T23:17:06.539 INFO:teuthology.orchestra.run.smithi119.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-138-g3fb760aa-1focal [53.2 kB] 2021-10-20T23:17:06.543 INFO:teuthology.orchestra.run.smithi012.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-138-g3fb760aa-1focal [53.2 kB] 2021-10-20T23:17:06.547 INFO:teuthology.orchestra.run.smithi012.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-138-g3fb760aa-1focal [58.2 kB] 2021-10-20T23:17:06.549 INFO:teuthology.orchestra.run.smithi012.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-138-g3fb760aa-1focal [3,208 kB] 2021-10-20T23:17:06.568 INFO:teuthology.orchestra.run.smithi119.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-138-g3fb760aa-1focal [58.2 kB] 2021-10-20T23:17:06.570 INFO:teuthology.orchestra.run.smithi119.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-138-g3fb760aa-1focal [3,208 kB] 2021-10-20T23:17:06.944 INFO:teuthology.orchestra.run.smithi012.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-138-g3fb760aa-1focal [34.4 kB] 2021-10-20T23:17:06.956 INFO:teuthology.orchestra.run.smithi012.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-138-g3fb760aa-1focal [7,876 kB] 2021-10-20T23:17:06.973 INFO:teuthology.orchestra.run.smithi119.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-138-g3fb760aa-1focal [34.4 kB] 2021-10-20T23:17:06.975 INFO:teuthology.orchestra.run.smithi119.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-138-g3fb760aa-1focal [7,876 kB] 2021-10-20T23:17:07.464 INFO:teuthology.orchestra.run.smithi031.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-138-g3fb760aa-1focal [4,008 B] 2021-10-20T23:17:07.465 INFO:teuthology.orchestra.run.smithi031.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-138-g3fb760aa-1focal [538 kB] 2021-10-20T23:17:07.474 INFO:teuthology.orchestra.run.smithi031.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-138-g3fb760aa-1focal [2,006 kB] 2021-10-20T23:17:07.581 INFO:teuthology.orchestra.run.smithi136.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-138-g3fb760aa-1focal [4,008 B] 2021-10-20T23:17:07.581 INFO:teuthology.orchestra.run.smithi136.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-138-g3fb760aa-1focal [538 kB] 2021-10-20T23:17:07.615 INFO:teuthology.orchestra.run.smithi136.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-138-g3fb760aa-1focal [2,006 kB] 2021-10-20T23:17:07.733 INFO:teuthology.orchestra.run.smithi031.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-138-g3fb760aa-1focal [53.2 kB] 2021-10-20T23:17:07.734 INFO:teuthology.orchestra.run.smithi031.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-138-g3fb760aa-1focal [58.2 kB] 2021-10-20T23:17:07.746 INFO:teuthology.orchestra.run.smithi031.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-138-g3fb760aa-1focal [3,208 kB] 2021-10-20T23:17:07.893 INFO:teuthology.orchestra.run.smithi136.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-138-g3fb760aa-1focal [53.2 kB] 2021-10-20T23:17:07.894 INFO:teuthology.orchestra.run.smithi136.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-138-g3fb760aa-1focal [58.2 kB] 2021-10-20T23:17:07.896 INFO:teuthology.orchestra.run.smithi136.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-138-g3fb760aa-1focal [3,208 kB] 2021-10-20T23:17:07.933 INFO:teuthology.orchestra.run.smithi012.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-138-g3fb760aa-1focal [4,120 B] 2021-10-20T23:17:07.934 INFO:teuthology.orchestra.run.smithi012.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-138-g3fb760aa-1focal [39.8 MB] 2021-10-20T23:17:07.956 INFO:teuthology.orchestra.run.smithi119.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-138-g3fb760aa-1focal [4,120 B] 2021-10-20T23:17:07.963 INFO:teuthology.orchestra.run.smithi119.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-138-g3fb760aa-1focal [39.8 MB] 2021-10-20T23:17:08.173 INFO:teuthology.orchestra.run.smithi031.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-138-g3fb760aa-1focal [34.4 kB] 2021-10-20T23:17:08.174 INFO:teuthology.orchestra.run.smithi031.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-138-g3fb760aa-1focal [7,876 kB] 2021-10-20T23:17:08.331 INFO:teuthology.orchestra.run.smithi136.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-138-g3fb760aa-1focal [34.4 kB] 2021-10-20T23:17:08.333 INFO:teuthology.orchestra.run.smithi136.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-138-g3fb760aa-1focal [7,876 kB] 2021-10-20T23:17:09.244 INFO:teuthology.orchestra.run.smithi031.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-138-g3fb760aa-1focal [4,120 B] 2021-10-20T23:17:09.244 INFO:teuthology.orchestra.run.smithi031.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-138-g3fb760aa-1focal [39.8 MB] 2021-10-20T23:17:09.405 INFO:teuthology.orchestra.run.smithi136.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-138-g3fb760aa-1focal [4,120 B] 2021-10-20T23:17:09.405 INFO:teuthology.orchestra.run.smithi136.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-138-g3fb760aa-1focal [39.8 MB] 2021-10-20T23:17:13.261 INFO:teuthology.orchestra.run.smithi119.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-138-g3fb760aa-1focal [15.9 kB] 2021-10-20T23:17:13.262 INFO:teuthology.orchestra.run.smithi119.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-138-g3fb760aa-1focal [18.1 kB] 2021-10-20T23:17:13.262 INFO:teuthology.orchestra.run.smithi119.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-138-g3fb760aa-1focal [9,719 kB] 2021-10-20T23:17:13.363 INFO:teuthology.orchestra.run.smithi012.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-138-g3fb760aa-1focal [15.9 kB] 2021-10-20T23:17:13.363 INFO:teuthology.orchestra.run.smithi012.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-138-g3fb760aa-1focal [18.1 kB] 2021-10-20T23:17:13.364 INFO:teuthology.orchestra.run.smithi012.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-138-g3fb760aa-1focal [9,719 kB] 2021-10-20T23:17:14.399 INFO:teuthology.orchestra.run.smithi119.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-138-g3fb760aa-1focal [60.9 kB] 2021-10-20T23:17:14.439 INFO:teuthology.orchestra.run.smithi012.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-138-g3fb760aa-1focal [60.9 kB] 2021-10-20T23:17:14.628 INFO:teuthology.orchestra.run.smithi031.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-138-g3fb760aa-1focal [15.9 kB] 2021-10-20T23:17:14.667 INFO:teuthology.orchestra.run.smithi031.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-138-g3fb760aa-1focal [18.1 kB] 2021-10-20T23:17:14.668 INFO:teuthology.orchestra.run.smithi031.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-138-g3fb760aa-1focal [9,719 kB] 2021-10-20T23:17:14.684 INFO:teuthology.orchestra.run.smithi136.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-138-g3fb760aa-1focal [15.9 kB] 2021-10-20T23:17:14.685 INFO:teuthology.orchestra.run.smithi136.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-138-g3fb760aa-1focal [18.1 kB] 2021-10-20T23:17:14.685 INFO:teuthology.orchestra.run.smithi136.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-138-g3fb760aa-1focal [9,719 kB] 2021-10-20T23:17:14.968 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 153 MB in 17s (9,147 kB/s) 2021-10-20T23:17:15.035 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 153 MB in 17s (9,111 kB/s) 2021-10-20T23:17:15.094 INFO:teuthology.orchestra.run.smithi031.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-138-g3fb760aa-1focal [60.9 kB] 2021-10-20T23:17:15.151 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyperclip. 2021-10-20T23:17:15.172 INFO:teuthology.orchestra.run.smithi136.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-138-g3fb760aa-1focal [60.9 kB] 2021-10-20T23:17:15.191 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyperclip. 2021-10-20T23:17:15.221 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-10-20T23:17:15.227 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-10-20T23:17:15.259 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-10-20T23:17:15.265 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-10-20T23:17:15.266 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-10-20T23:17:15.307 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-10-20T23:17:15.546 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-wcwidth. 2021-10-20T23:17:15.571 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-10-20T23:17:15.614 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-20T23:17:15.651 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-wcwidth. 2021-10-20T23:17:15.672 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-10-20T23:17:15.684 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 153 MB in 17s (8,798 kB/s) 2021-10-20T23:17:15.711 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-20T23:17:15.757 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 153 MB in 17s (8,754 kB/s) 2021-10-20T23:17:15.830 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyperclip. 2021-10-20T23:17:15.898 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-10-20T23:17:15.900 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyperclip. 2021-10-20T23:17:15.904 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-10-20T23:17:15.922 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cmd2. 2021-10-20T23:17:15.934 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-10-20T23:17:15.970 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-10-20T23:17:15.976 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-10-20T23:17:15.982 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-10-20T23:17:15.998 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-10-20T23:17:16.032 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cmd2. 2021-10-20T23:17:16.033 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-10-20T23:17:16.054 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-10-20T23:17:16.090 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-10-20T23:17:16.256 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-wcwidth. 2021-10-20T23:17:16.277 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-10-20T23:17:16.314 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-20T23:17:16.327 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-wcwidth. 2021-10-20T23:17:16.335 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-10-20T23:17:16.346 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-10-20T23:17:16.354 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-10-20T23:17:16.378 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-20T23:17:16.433 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-20T23:17:16.441 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-10-20T23:17:16.462 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-10-20T23:17:16.542 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-20T23:17:16.568 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cmd2. 2021-10-20T23:17:16.587 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-10-20T23:17:16.628 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-10-20T23:17:16.662 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cmd2. 2021-10-20T23:17:16.685 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-10-20T23:17:16.720 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-10-20T23:17:16.794 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../004-librbd1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:16.936 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../004-librbd1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:16.937 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librbd1 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:17:16.973 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-10-20T23:17:16.993 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-10-20T23:17:17.043 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librbd1 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:17:17.059 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-10-20T23:17:17.081 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-10-20T23:17:17.084 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-20T23:17:17.168 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-20T23:17:17.410 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../004-librbd1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:17.457 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../005-librados2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:17.499 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../004-librbd1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:17.533 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librbd1 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:17:17.556 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librados2 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:17:17.577 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../005-librados2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:17.606 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librbd1 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:17:17.724 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librados2 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:17:18.076 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../005-librados2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:18.163 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../005-librados2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:18.185 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs2. 2021-10-20T23:17:18.188 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librados2 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:17:18.207 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:18.245 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:18.293 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librados2 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:17:18.370 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs2. 2021-10-20T23:17:18.387 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:18.418 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:18.567 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rados. 2021-10-20T23:17:18.590 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../007-python3-rados_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:18.627 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:18.709 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rados. 2021-10-20T23:17:18.728 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../007-python3-rados_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:18.760 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:18.851 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs2. 2021-10-20T23:17:18.870 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:18.919 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:18.933 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-10-20T23:17:18.954 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:18.957 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs2. 2021-10-20T23:17:18.978 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:18.983 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.007 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.137 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-10-20T23:17:19.156 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:19.197 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.208 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rados. 2021-10-20T23:17:19.227 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../007-python3-rados_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:19.250 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cephfs. 2021-10-20T23:17:19.268 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.272 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:19.308 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rados. 2021-10-20T23:17:19.329 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../007-python3-rados_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:19.354 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.366 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.507 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cephfs. 2021-10-20T23:17:19.529 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:19.574 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.675 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-10-20T23:17:19.678 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-common. 2021-10-20T23:17:19.697 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:19.698 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:19.709 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-10-20T23:17:19.727 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:19.733 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.738 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.791 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:19.900 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-common. 2021-10-20T23:17:19.921 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:19.959 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:20.052 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cephfs. 2021-10-20T23:17:20.053 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-prettytable. 2021-10-20T23:17:20.067 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cephfs. 2021-10-20T23:17:20.071 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:20.072 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-10-20T23:17:20.091 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:20.103 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:20.110 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-10-20T23:17:20.124 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:20.304 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-prettytable. 2021-10-20T23:17:20.324 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-10-20T23:17:20.362 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-10-20T23:17:20.376 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rbd. 2021-10-20T23:17:20.398 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:20.432 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-ceph-common. 2021-10-20T23:17:20.435 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:20.444 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-common. 2021-10-20T23:17:20.450 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:20.467 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:20.562 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:20.563 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:20.620 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rbd. 2021-10-20T23:17:20.641 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:20.673 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:20.778 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-10-20T23:17:20.792 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-prettytable. 2021-10-20T23:17:20.802 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-10-20T23:17:20.812 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-10-20T23:17:20.829 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-10-20T23:17:20.846 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-prettytable. 2021-10-20T23:17:20.850 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-10-20T23:17:20.868 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-10-20T23:17:20.905 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-10-20T23:17:21.075 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-10-20T23:17:21.095 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-10-20T23:17:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-10-20T23:17:21.154 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rbd. 2021-10-20T23:17:21.163 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-10-20T23:17:21.164 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rbd. 2021-10-20T23:17:21.177 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:21.183 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:21.184 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-10-20T23:17:21.222 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:21.222 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:21.229 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-20T23:17:21.503 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-10-20T23:17:21.523 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-10-20T23:17:21.561 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-20T23:17:21.574 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-10-20T23:17:21.582 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librgw2. 2021-10-20T23:17:21.583 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-10-20T23:17:21.593 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-10-20T23:17:21.602 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../015-librgw2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:21.603 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-10-20T23:17:21.640 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:21.642 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-10-20T23:17:21.650 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-10-20T23:17:21.931 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librgw2. 2021-10-20T23:17:21.953 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../015-librgw2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:21.981 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-10-20T23:17:21.989 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-10-20T23:17:21.989 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:22.003 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-10-20T23:17:22.008 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-10-20T23:17:22.039 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-20T23:17:22.047 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-20T23:17:22.167 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rgw. 2021-10-20T23:17:22.188 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:22.228 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:22.334 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librgw2. 2021-10-20T23:17:22.355 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../015-librgw2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:22.375 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librgw2. 2021-10-20T23:17:22.383 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:22.396 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../015-librgw2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:22.433 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:22.524 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rgw. 2021-10-20T23:17:22.546 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:22.583 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:22.770 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-10-20T23:17:22.790 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-10-20T23:17:22.828 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-20T23:17:22.910 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-10-20T23:17:22.933 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-10-20T23:17:22.935 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rgw. 2021-10-20T23:17:22.956 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:22.977 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-20T23:17:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:23.114 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liboath0. 2021-10-20T23:17:23.137 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-10-20T23:17:23.173 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-10-20T23:17:23.314 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-10-20T23:17:23.332 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-10-20T23:17:23.344 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rgw. 2021-10-20T23:17:23.355 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liboath0. 2021-10-20T23:17:23.364 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:23.371 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-20T23:17:23.374 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-10-20T23:17:23.402 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:23.422 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-10-20T23:17:23.501 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libradosstriper1. 2021-10-20T23:17:23.519 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:23.559 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:23.716 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libradosstriper1. 2021-10-20T23:17:23.730 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-10-20T23:17:23.735 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:23.749 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liboath0. 2021-10-20T23:17:23.750 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-10-20T23:17:23.766 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:23.768 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-10-20T23:17:23.788 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-20T23:17:23.812 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-10-20T23:17:24.012 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-common. 2021-10-20T23:17:24.034 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../020-ceph-common_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:24.060 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libradosstriper1. 2021-10-20T23:17:24.071 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:24.079 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:24.110 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:24.125 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liboath0. 2021-10-20T23:17:24.146 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-10-20T23:17:24.175 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-10-20T23:17:24.227 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-common. 2021-10-20T23:17:24.247 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../020-ceph-common_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:24.285 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:24.444 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libradosstriper1. 2021-10-20T23:17:24.464 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:24.503 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:24.555 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-common. 2021-10-20T23:17:24.577 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../020-ceph-common_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:24.624 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:24.990 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-common. 2021-10-20T23:17:25.013 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../020-ceph-common_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:25.056 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:26.235 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-base. 2021-10-20T23:17:26.255 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../021-ceph-base_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:26.304 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:26.359 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-base. 2021-10-20T23:17:26.379 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../021-ceph-base_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:26.419 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:26.878 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-base. 2021-10-20T23:17:26.899 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../021-ceph-base_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:26.947 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:27.164 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-base. 2021-10-20T23:17:27.183 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../021-ceph-base_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:27.232 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:27.240 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cryptography. 2021-10-20T23:17:27.259 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-10-20T23:17:27.298 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-20T23:17:27.321 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cryptography. 2021-10-20T23:17:27.344 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-10-20T23:17:27.421 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-20T23:17:27.835 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-openssl. 2021-10-20T23:17:27.854 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-10-20T23:17:27.883 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-10-20T23:17:27.890 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cryptography. 2021-10-20T23:17:27.911 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-10-20T23:17:27.948 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-20T23:17:28.126 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cryptography. 2021-10-20T23:17:28.144 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-10-20T23:17:28.148 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-10-20T23:17:28.164 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:28.193 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-20T23:17:28.202 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:28.379 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-openssl. 2021-10-20T23:17:28.400 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-10-20T23:17:28.437 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-10-20T23:17:28.485 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-openssl. 2021-10-20T23:17:28.508 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-10-20T23:17:28.569 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-10-20T23:17:28.573 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-bcrypt. 2021-10-20T23:17:28.593 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-10-20T23:17:28.661 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-20T23:17:28.721 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-10-20T23:17:28.742 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:28.779 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:28.804 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-10-20T23:17:28.825 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:28.856 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:28.919 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cherrypy3. 2021-10-20T23:17:28.939 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-10-20T23:17:28.976 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-10-20T23:17:29.093 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bcrypt. 2021-10-20T23:17:29.115 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-10-20T23:17:29.143 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-20T23:17:29.181 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-openssl. 2021-10-20T23:17:29.200 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-10-20T23:17:29.200 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bcrypt. 2021-10-20T23:17:29.222 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-10-20T23:17:29.239 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-10-20T23:17:29.259 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-20T23:17:29.412 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cherrypy3. 2021-10-20T23:17:29.433 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-10-20T23:17:29.472 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-10-20T23:17:29.492 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-10-20T23:17:29.512 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:29.557 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:29.611 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cherrypy3. 2021-10-20T23:17:29.630 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-10-20T23:17:29.669 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-10-20T23:17:29.798 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jwt. 2021-10-20T23:17:29.819 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-10-20T23:17:29.856 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-10-20T23:17:29.914 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-bcrypt. 2021-10-20T23:17:29.932 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-10-20T23:17:29.972 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-20T23:17:29.999 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jwt. 2021-10-20T23:17:30.020 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-10-20T23:17:30.066 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-10-20T23:17:30.176 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-logutils. 2021-10-20T23:17:30.195 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-10-20T23:17:30.205 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jwt. 2021-10-20T23:17:30.223 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-10-20T23:17:30.259 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-10-20T23:17:30.262 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-10-20T23:17:30.349 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cherrypy3. 2021-10-20T23:17:30.370 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-10-20T23:17:30.392 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-logutils. 2021-10-20T23:17:30.414 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-10-20T23:17:30.415 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-10-20T23:17:30.459 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-10-20T23:17:30.545 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-markupsafe. 2021-10-20T23:17:30.565 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-10-20T23:17:30.606 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-10-20T23:17:30.615 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-logutils. 2021-10-20T23:17:30.635 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-10-20T23:17:30.674 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-10-20T23:17:30.788 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-markupsafe. 2021-10-20T23:17:30.803 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jwt. 2021-10-20T23:17:30.811 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-10-20T23:17:30.823 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-10-20T23:17:30.845 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-10-20T23:17:30.869 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-10-20T23:17:30.889 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-mako. 2021-10-20T23:17:30.912 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-10-20T23:17:30.955 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-20T23:17:31.001 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-markupsafe. 2021-10-20T23:17:31.020 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-10-20T23:17:31.060 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-10-20T23:17:31.181 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-mako. 2021-10-20T23:17:31.202 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-10-20T23:17:31.215 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-logutils. 2021-10-20T23:17:31.238 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-10-20T23:17:31.239 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-20T23:17:31.281 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-10-20T23:17:31.504 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-mako. 2021-10-20T23:17:31.524 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-10-20T23:17:31.559 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplegeneric. 2021-10-20T23:17:31.561 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-20T23:17:31.580 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-10-20T23:17:31.586 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-markupsafe. 2021-10-20T23:17:31.603 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-10-20T23:17:31.618 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-10-20T23:17:31.644 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-10-20T23:17:31.819 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplegeneric. 2021-10-20T23:17:31.838 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-10-20T23:17:31.865 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplegeneric. 2021-10-20T23:17:31.875 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-10-20T23:17:31.887 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-10-20T23:17:31.915 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-10-20T23:17:31.944 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-mako. 2021-10-20T23:17:31.953 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-singledispatch. 2021-10-20T23:17:31.963 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-10-20T23:17:31.977 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-10-20T23:17:32.020 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-10-20T23:17:32.028 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-20T23:17:32.220 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-singledispatch. 2021-10-20T23:17:32.239 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-10-20T23:17:32.251 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-singledispatch. 2021-10-20T23:17:32.275 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-10-20T23:17:32.287 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-10-20T23:17:32.309 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-10-20T23:17:32.339 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webob. 2021-10-20T23:17:32.356 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-simplegeneric. 2021-10-20T23:17:32.361 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-10-20T23:17:32.375 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-10-20T23:17:32.414 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-10-20T23:17:32.415 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-10-20T23:17:32.597 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webob. 2021-10-20T23:17:32.618 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-10-20T23:17:32.637 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webob. 2021-10-20T23:17:32.656 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-10-20T23:17:32.656 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-10-20T23:17:32.695 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-10-20T23:17:32.701 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-singledispatch. 2021-10-20T23:17:32.722 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-10-20T23:17:32.751 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-10-20T23:17:32.785 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-soupsieve. 2021-10-20T23:17:32.805 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-10-20T23:17:32.842 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-20T23:17:32.967 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-soupsieve. 2021-10-20T23:17:32.986 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-10-20T23:17:33.025 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-20T23:17:33.065 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-soupsieve. 2021-10-20T23:17:33.070 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-webob. 2021-10-20T23:17:33.084 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-10-20T23:17:33.091 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-10-20T23:17:33.105 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bs4. 2021-10-20T23:17:33.122 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-20T23:17:33.123 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-10-20T23:17:33.137 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-10-20T23:17:33.163 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-10-20T23:17:33.353 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bs4. 2021-10-20T23:17:33.371 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-10-20T23:17:33.411 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-10-20T23:17:33.450 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-bs4. 2021-10-20T23:17:33.456 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-soupsieve. 2021-10-20T23:17:33.473 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-10-20T23:17:33.475 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-10-20T23:17:33.515 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-20T23:17:33.518 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-10-20T23:17:33.567 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-waitress. 2021-10-20T23:17:33.586 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-10-20T23:17:33.627 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-10-20T23:17:33.772 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-waitress. 2021-10-20T23:17:33.791 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-10-20T23:17:33.818 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-bs4. 2021-10-20T23:17:33.840 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-10-20T23:17:33.842 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-10-20T23:17:33.884 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-10-20T23:17:33.903 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-waitress. 2021-10-20T23:17:33.923 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-10-20T23:17:33.952 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempita. 2021-10-20T23:17:33.964 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-10-20T23:17:33.971 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-10-20T23:17:34.010 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-10-20T23:17:34.194 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempita. 2021-10-20T23:17:34.214 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-10-20T23:17:34.249 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-10-20T23:17:34.263 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-waitress. 2021-10-20T23:17:34.283 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-10-20T23:17:34.306 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-tempita. 2021-10-20T23:17:34.313 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-paste. 2021-10-20T23:17:34.325 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-10-20T23:17:34.325 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-10-20T23:17:34.335 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-10-20T23:17:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-10-20T23:17:34.397 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-10-20T23:17:34.569 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-paste. 2021-10-20T23:17:34.591 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-10-20T23:17:34.627 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-10-20T23:17:34.649 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-tempita. 2021-10-20T23:17:34.670 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-10-20T23:17:34.675 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-paste. 2021-10-20T23:17:34.691 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-10-20T23:17:34.698 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-10-20T23:17:34.710 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-10-20T23:17:34.711 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-10-20T23:17:34.741 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-10-20T23:17:34.749 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-10-20T23:17:34.972 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-10-20T23:17:34.993 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-10-20T23:17:35.030 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-10-20T23:17:35.044 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-paste. 2021-10-20T23:17:35.064 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-10-20T23:17:35.077 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastedeploy. 2021-10-20T23:17:35.100 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-10-20T23:17:35.101 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-10-20T23:17:35.144 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-10-20T23:17:35.366 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastedeploy. 2021-10-20T23:17:35.386 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-10-20T23:17:35.413 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-10-20T23:17:35.419 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-10-20T23:17:35.424 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-10-20T23:17:35.435 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-10-20T23:17:35.439 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-10-20T23:17:35.473 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-10-20T23:17:35.477 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-10-20T23:17:35.531 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webtest. 2021-10-20T23:17:35.550 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-10-20T23:17:35.588 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-10-20T23:17:35.744 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webtest. 2021-10-20T23:17:35.763 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-10-20T23:17:35.791 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pastedeploy. 2021-10-20T23:17:35.802 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-10-20T23:17:35.811 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-10-20T23:17:35.822 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastedeploy. 2021-10-20T23:17:35.843 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-10-20T23:17:35.849 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-10-20T23:17:35.881 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-10-20T23:17:35.899 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pecan. 2021-10-20T23:17:35.918 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-10-20T23:17:35.957 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-10-20T23:17:36.105 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pecan. 2021-10-20T23:17:36.129 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-10-20T23:17:36.171 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-10-20T23:17:36.178 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-webtest. 2021-10-20T23:17:36.197 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-10-20T23:17:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webtest. 2021-10-20T23:17:36.236 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-10-20T23:17:36.255 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-10-20T23:17:36.292 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-10-20T23:17:36.337 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-werkzeug. 2021-10-20T23:17:36.360 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-10-20T23:17:36.404 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-20T23:17:36.501 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-werkzeug. 2021-10-20T23:17:36.507 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pecan. 2021-10-20T23:17:36.520 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-10-20T23:17:36.536 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-10-20T23:17:36.559 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-20T23:17:36.572 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-10-20T23:17:36.628 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pecan. 2021-10-20T23:17:36.649 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-10-20T23:17:36.686 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-10-20T23:17:36.799 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr. 2021-10-20T23:17:36.818 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:36.890 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:36.936 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-werkzeug. 2021-10-20T23:17:36.956 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-10-20T23:17:36.971 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr. 2021-10-20T23:17:36.990 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:37.011 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-20T23:17:37.029 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:37.076 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-werkzeug. 2021-10-20T23:17:37.096 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-10-20T23:17:37.134 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-20T23:17:37.327 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mon. 2021-10-20T23:17:37.347 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:37.385 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:37.398 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr. 2021-10-20T23:17:37.420 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:37.464 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:37.546 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr. 2021-10-20T23:17:37.548 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mon. 2021-10-20T23:17:37.565 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:37.568 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:37.598 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:37.604 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:37.926 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mon. 2021-10-20T23:17:37.945 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:38.019 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:38.116 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mon. 2021-10-20T23:17:38.136 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:38.173 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:38.397 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-osd. 2021-10-20T23:17:38.417 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:38.455 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:38.677 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-osd. 2021-10-20T23:17:38.698 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:38.738 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:39.047 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-osd. 2021-10-20T23:17:39.066 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:39.105 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:39.244 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-osd. 2021-10-20T23:17:39.266 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:39.310 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:40.819 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph. 2021-10-20T23:17:40.838 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../047-ceph_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:40.877 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:41.066 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph. 2021-10-20T23:17:41.086 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../047-ceph_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:41.123 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:41.247 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-fuse. 2021-10-20T23:17:41.266 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:41.305 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:41.426 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-fuse. 2021-10-20T23:17:41.449 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:41.492 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:41.510 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph. 2021-10-20T23:17:41.530 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../047-ceph_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:41.568 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:41.683 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mds. 2021-10-20T23:17:41.705 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:41.732 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph. 2021-10-20T23:17:41.749 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:41.753 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../047-ceph_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:41.790 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:41.888 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-fuse. 2021-10-20T23:17:41.907 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:41.946 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mds. 2021-10-20T23:17:41.946 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:41.966 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:42.012 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:42.051 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-fuse. 2021-10-20T23:17:42.074 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:42.109 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:42.277 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephadm. 2021-10-20T23:17:42.297 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../050-cephadm_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:42.335 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:42.341 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mds. 2021-10-20T23:17:42.360 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:42.399 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:42.529 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mds. 2021-10-20T23:17:42.532 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephadm. 2021-10-20T23:17:42.548 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:42.554 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../050-cephadm_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:42.587 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:42.590 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:42.680 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jinja2. 2021-10-20T23:17:42.699 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-10-20T23:17:42.738 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-10-20T23:17:42.852 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package cephadm. 2021-10-20T23:17:42.874 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../050-cephadm_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:42.901 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jinja2. 2021-10-20T23:17:42.902 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:42.922 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-10-20T23:17:42.959 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-10-20T23:17:43.099 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephadm. 2021-10-20T23:17:43.099 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-10-20T23:17:43.119 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:43.121 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../050-cephadm_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:43.158 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:43.158 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:43.247 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jinja2. 2021-10-20T23:17:43.267 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-10-20T23:17:43.287 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-10-20T23:17:43.306 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-10-20T23:17:43.307 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:43.345 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:43.435 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jinja2. 2021-10-20T23:17:43.454 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-10-20T23:17:43.485 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-10-20T23:17:43.485 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-repoze.lru. 2021-10-20T23:17:43.504 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-10-20T23:17:43.544 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-10-20T23:17:43.625 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-10-20T23:17:43.649 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:43.707 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-repoze.lru. 2021-10-20T23:17:43.717 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:43.728 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-10-20T23:17:43.765 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-10-20T23:17:43.839 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjs-underscore. 2021-10-20T23:17:43.854 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-10-20T23:17:43.858 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-10-20T23:17:43.875 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:43.901 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-20T23:17:43.912 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:44.035 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjs-underscore. 2021-10-20T23:17:44.054 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-10-20T23:17:44.063 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-repoze.lru. 2021-10-20T23:17:44.083 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-10-20T23:17:44.101 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-20T23:17:44.121 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-10-20T23:17:44.191 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-10-20T23:17:44.210 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-10-20T23:17:44.249 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-20T23:17:44.257 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-repoze.lru. 2021-10-20T23:17:44.277 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-10-20T23:17:44.315 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-10-20T23:17:44.345 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-10-20T23:17:44.366 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-10-20T23:17:44.374 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libjs-underscore. 2021-10-20T23:17:44.394 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-10-20T23:17:44.395 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-20T23:17:44.431 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-20T23:17:44.594 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-routes. 2021-10-20T23:17:44.595 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjs-underscore. 2021-10-20T23:17:44.612 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-10-20T23:17:44.615 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-10-20T23:17:44.651 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-10-20T23:17:44.659 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-20T23:17:44.667 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-10-20T23:17:44.687 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-10-20T23:17:44.715 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-routes. 2021-10-20T23:17:44.717 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-20T23:17:44.734 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-10-20T23:17:44.773 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-10-20T23:17:44.920 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-10-20T23:17:44.942 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-10-20T23:17:44.996 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-10-20T23:17:45.012 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-20T23:17:45.013 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-routes. 2021-10-20T23:17:45.017 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:45.034 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-10-20T23:17:45.054 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:45.071 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-10-20T23:17:45.084 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-10-20T23:17:45.104 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:45.142 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:45.425 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-10-20T23:17:45.445 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:45.482 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:45.548 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-routes. 2021-10-20T23:17:45.568 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-10-20T23:17:45.607 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-10-20T23:17:45.979 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-10-20T23:17:45.993 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-10-20T23:17:46.000 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:46.015 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:46.037 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:46.051 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:46.108 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-10-20T23:17:46.128 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:46.174 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:46.390 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-decorator. 2021-10-20T23:17:46.410 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-10-20T23:17:46.424 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-10-20T23:17:46.446 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:46.448 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-10-20T23:17:46.491 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:46.536 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-decorator. 2021-10-20T23:17:46.556 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-10-20T23:17:46.594 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-10-20T23:17:46.734 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-10-20T23:17:46.757 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-10-20T23:17:46.802 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-20T23:17:46.810 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-decorator. 2021-10-20T23:17:46.834 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-10-20T23:17:46.877 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-10-20T23:17:46.896 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-10-20T23:17:46.916 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-10-20T23:17:46.955 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-20T23:17:47.025 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-10-20T23:17:47.045 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:47.084 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:47.162 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-scipy. 2021-10-20T23:17:47.181 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-10-20T23:17:47.214 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-10-20T23:17:47.228 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-10-20T23:17:47.235 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-10-20T23:17:47.272 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-20T23:17:47.341 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-scipy. 2021-10-20T23:17:47.364 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-10-20T23:17:47.407 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-10-20T23:17:47.419 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-decorator. 2021-10-20T23:17:47.439 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-10-20T23:17:47.486 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-10-20T23:17:47.592 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-scipy. 2021-10-20T23:17:47.614 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-10-20T23:17:47.658 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-10-20T23:17:47.822 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-10-20T23:17:47.842 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-10-20T23:17:47.889 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-20T23:17:48.242 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-scipy. 2021-10-20T23:17:48.261 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-10-20T23:17:48.300 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-10-20T23:17:48.651 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-10-20T23:17:48.673 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-10-20T23:17:48.713 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-20T23:17:48.749 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-10-20T23:17:48.769 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-10-20T23:17:48.807 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-20T23:17:49.026 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-10-20T23:17:49.047 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-10-20T23:17:49.092 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-20T23:17:49.240 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-joblib. 2021-10-20T23:17:49.260 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-10-20T23:17:49.298 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-10-20T23:17:49.355 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-joblib. 2021-10-20T23:17:49.374 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-10-20T23:17:49.413 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-10-20T23:17:49.650 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-10-20T23:17:49.673 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-10-20T23:17:49.702 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn. 2021-10-20T23:17:49.713 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-joblib. 2021-10-20T23:17:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-10-20T23:17:49.733 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-10-20T23:17:49.768 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-20T23:17:49.771 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-10-20T23:17:49.783 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn. 2021-10-20T23:17:49.784 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-20T23:17:49.803 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-10-20T23:17:49.841 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-20T23:17:50.175 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-sklearn. 2021-10-20T23:17:50.195 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-10-20T23:17:50.233 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-20T23:17:50.354 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-joblib. 2021-10-20T23:17:50.375 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-10-20T23:17:50.412 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-10-20T23:17:50.476 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-10-20T23:17:50.498 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:50.533 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-10-20T23:17:50.534 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:50.553 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:50.592 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:50.835 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn. 2021-10-20T23:17:50.852 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-10-20T23:17:50.890 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-20T23:17:50.892 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-10-20T23:17:50.912 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:50.966 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:51.672 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cachetools. 2021-10-20T23:17:51.682 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-10-20T23:17:51.686 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cachetools. 2021-10-20T23:17:51.691 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-10-20T23:17:51.704 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:51.706 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-10-20T23:17:51.729 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-10-20T23:17:51.748 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:51.752 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-10-20T23:17:52.057 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1. 2021-10-20T23:17:52.081 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-10-20T23:17:52.086 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cachetools. 2021-10-20T23:17:52.089 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1. 2021-10-20T23:17:52.109 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-10-20T23:17:52.112 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-10-20T23:17:52.124 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-10-20T23:17:52.154 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-10-20T23:17:52.155 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-10-20T23:17:52.452 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-10-20T23:17:52.464 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyasn1. 2021-10-20T23:17:52.471 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-10-20T23:17:52.484 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-10-20T23:17:52.501 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-10-20T23:17:52.511 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-20T23:17:52.522 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-10-20T23:17:52.531 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-10-20T23:17:52.559 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-20T23:17:52.848 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rsa. 2021-10-20T23:17:52.862 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rsa. 2021-10-20T23:17:52.869 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-10-20T23:17:52.881 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-10-20T23:17:52.913 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rsa (4.0-3) ... 2021-10-20T23:17:52.918 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-10-20T23:17:52.937 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rsa (4.0-3) ... 2021-10-20T23:17:52.940 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-10-20T23:17:52.968 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cachetools. 2021-10-20T23:17:52.976 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-20T23:17:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-10-20T23:17:53.026 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-10-20T23:17:53.224 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-google-auth. 2021-10-20T23:17:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-10-20T23:17:53.246 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rsa. 2021-10-20T23:17:53.248 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-google-auth. 2021-10-20T23:17:53.266 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-10-20T23:17:53.267 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-10-20T23:17:53.282 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-10-20T23:17:53.304 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rsa (4.0-3) ... 2021-10-20T23:17:53.306 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-10-20T23:17:53.370 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1. 2021-10-20T23:17:53.394 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-10-20T23:17:53.447 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-10-20T23:17:53.609 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-blinker. 2021-10-20T23:17:53.632 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-10-20T23:17:53.633 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-google-auth. 2021-10-20T23:17:53.644 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-blinker. 2021-10-20T23:17:53.652 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-10-20T23:17:53.663 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-10-20T23:17:53.676 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-20T23:17:53.690 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-10-20T23:17:53.710 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-20T23:17:53.832 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-10-20T23:17:53.853 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-10-20T23:17:53.890 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-20T23:17:54.021 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-oauthlib. 2021-10-20T23:17:54.040 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-10-20T23:17:54.044 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-blinker. 2021-10-20T23:17:54.064 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-10-20T23:17:54.079 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-20T23:17:54.102 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-20T23:17:54.227 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rsa. 2021-10-20T23:17:54.250 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-10-20T23:17:54.293 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rsa (4.0-3) ... 2021-10-20T23:17:54.407 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-10-20T23:17:54.422 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-oauthlib. 2021-10-20T23:17:54.427 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-10-20T23:17:54.445 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-10-20T23:17:54.455 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-oauthlib. 2021-10-20T23:17:54.465 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-20T23:17:54.475 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-10-20T23:17:54.516 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-20T23:17:54.639 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-google-auth. 2021-10-20T23:17:54.657 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-10-20T23:17:54.695 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-10-20T23:17:54.757 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-20T23:17:54.793 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-websocket. 2021-10-20T23:17:54.814 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-10-20T23:17:54.850 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-10-20T23:17:54.860 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-10-20T23:17:54.873 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-10-20T23:17:54.916 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-20T23:17:55.041 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-blinker. 2021-10-20T23:17:55.063 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-10-20T23:17:55.107 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-20T23:17:55.184 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-10-20T23:17:55.188 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-kubernetes. 2021-10-20T23:17:55.203 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-10-20T23:17:55.209 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-10-20T23:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-20T23:17:55.246 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-10-20T23:17:55.252 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-websocket. 2021-10-20T23:17:55.274 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-10-20T23:17:55.319 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-10-20T23:17:55.435 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-oauthlib. 2021-10-20T23:17:55.458 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-10-20T23:17:55.501 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-20T23:17:55.553 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-websocket. 2021-10-20T23:17:55.575 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-10-20T23:17:55.620 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-10-20T23:17:55.639 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-kubernetes. 2021-10-20T23:17:55.659 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-10-20T23:17:55.698 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-10-20T23:17:55.801 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-10-20T23:17:55.822 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:55.859 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:55.905 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-10-20T23:17:55.927 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-10-20T23:17:55.965 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-kubernetes. 2021-10-20T23:17:55.971 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-20T23:17:55.984 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-10-20T23:17:56.023 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-10-20T23:17:56.187 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libonig5:amd64. 2021-10-20T23:17:56.207 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-10-20T23:17:56.253 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-10-20T23:17:56.285 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-10-20T23:17:56.308 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:56.333 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-websocket. 2021-10-20T23:17:56.351 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:56.355 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-10-20T23:17:56.399 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-10-20T23:17:56.528 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-10-20T23:17:56.548 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:56.590 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjq1:amd64. 2021-10-20T23:17:56.594 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:56.613 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-20T23:17:56.654 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libonig5:amd64. 2021-10-20T23:17:56.656 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:17:56.677 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-10-20T23:17:56.721 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-10-20T23:17:56.752 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-kubernetes. 2021-10-20T23:17:56.772 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-10-20T23:17:56.810 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-10-20T23:17:56.939 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libonig5:amd64. 2021-10-20T23:17:56.951 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package jq. 2021-10-20T23:17:56.960 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-10-20T23:17:56.970 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-20T23:17:56.997 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-10-20T23:17:57.009 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:17:57.099 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjq1:amd64. 2021-10-20T23:17:57.119 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-20T23:17:57.157 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:17:57.368 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libjq1:amd64. 2021-10-20T23:17:57.388 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-20T23:17:57.423 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-10-20T23:17:57.425 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:17:57.435 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package jq. 2021-10-20T23:17:57.444 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:17:57.454 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-20T23:17:57.482 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:57.493 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:17:57.695 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package socat. 2021-10-20T23:17:57.711 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package jq. 2021-10-20T23:17:57.717 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-10-20T23:17:57.731 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-20T23:17:57.761 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking socat (1.7.3.3-2) ... 2021-10-20T23:17:57.769 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:17:57.770 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package socat. 2021-10-20T23:17:57.793 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-10-20T23:17:57.817 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libonig5:amd64. 2021-10-20T23:17:57.836 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking socat (1.7.3.3-2) ... 2021-10-20T23:17:57.839 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-10-20T23:17:57.884 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-10-20T23:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package socat. 2021-10-20T23:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-10-20T23:17:58.124 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking socat (1.7.3.3-2) ... 2021-10-20T23:17:58.234 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-10-20T23:17:58.254 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-10-20T23:17:58.262 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjq1:amd64. 2021-10-20T23:17:58.282 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-20T23:17:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-10-20T23:17:58.292 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-10-20T23:17:58.318 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-10-20T23:17:58.320 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:17:58.350 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-10-20T23:17:58.570 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package xmlstarlet. 2021-10-20T23:17:58.571 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-10-20T23:17:58.590 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-10-20T23:17:58.593 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-10-20T23:17:58.606 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package jq. 2021-10-20T23:17:58.627 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-20T23:17:58.636 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package xmlstarlet. 2021-10-20T23:17:58.637 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-10-20T23:17:58.653 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-10-20T23:17:58.658 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-10-20T23:17:58.689 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:17:58.694 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-10-20T23:17:58.965 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package xmlstarlet. 2021-10-20T23:17:58.967 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package socat. 2021-10-20T23:17:58.987 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-10-20T23:17:58.990 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-10-20T23:17:58.991 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-test. 2021-10-20T23:17:59.011 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../083-ceph-test_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:59.015 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-test. 2021-10-20T23:17:59.023 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-10-20T23:17:59.037 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../083-ceph-test_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:59.049 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:59.058 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking socat (1.7.3.3-2) ... 2021-10-20T23:17:59.082 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:59.336 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-test. 2021-10-20T23:17:59.358 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../083-ceph-test_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:17:59.402 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:17:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-10-20T23:17:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-10-20T23:17:59.630 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-10-20T23:17:59.941 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package xmlstarlet. 2021-10-20T23:17:59.963 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-10-20T23:18:00.008 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-10-20T23:18:00.387 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-test. 2021-10-20T23:18:00.408 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../083-ceph-test_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:00.445 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:02.577 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-colorama. 2021-10-20T23:18:02.598 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-10-20T23:18:02.636 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-10-20T23:18:02.728 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-colorama. 2021-10-20T23:18:02.747 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-10-20T23:18:02.786 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-10-20T23:18:02.938 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-shell. 2021-10-20T23:18:02.959 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:18:02.997 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:03.006 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-colorama. 2021-10-20T23:18:03.027 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-10-20T23:18:03.039 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-shell. 2021-10-20T23:18:03.059 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:18:03.063 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-10-20T23:18:03.097 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:03.191 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs-dev. 2021-10-20T23:18:03.211 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:03.240 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:03.350 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs-dev. 2021-10-20T23:18:03.351 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package cephfs-shell. 2021-10-20T23:18:03.370 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:03.373 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:18:03.408 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:03.416 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:03.653 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs-dev. 2021-10-20T23:18:03.653 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package nvme-cli. 2021-10-20T23:18:03.671 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-10-20T23:18:03.674 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:03.718 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:03.728 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-10-20T23:18:03.828 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package nvme-cli. 2021-10-20T23:18:03.847 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-10-20T23:18:03.903 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-10-20T23:18:03.999 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-colorama. 2021-10-20T23:18:04.022 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-10-20T23:18:04.057 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-10-20T23:18:04.091 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-atomicwrites. 2021-10-20T23:18:04.111 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-10-20T23:18:04.147 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package nvme-cli. 2021-10-20T23:18:04.148 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-10-20T23:18:04.168 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-10-20T23:18:04.224 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-10-20T23:18:04.233 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-atomicwrites. 2021-10-20T23:18:04.256 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-10-20T23:18:04.299 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-10-20T23:18:04.301 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephfs-shell. 2021-10-20T23:18:04.321 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-20T23:18:04.351 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:04.443 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-attr. 2021-10-20T23:18:04.463 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-10-20T23:18:04.493 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-10-20T23:18:04.568 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-atomicwrites. 2021-10-20T23:18:04.590 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-10-20T23:18:04.626 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-10-20T23:18:04.627 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-attr. 2021-10-20T23:18:04.637 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs-dev. 2021-10-20T23:18:04.647 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-10-20T23:18:04.659 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:04.685 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-10-20T23:18:04.695 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:04.830 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webencodings. 2021-10-20T23:18:04.849 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-10-20T23:18:04.896 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-20T23:18:04.946 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-attr. 2021-10-20T23:18:04.965 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-10-20T23:18:05.004 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-10-20T23:18:05.005 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webencodings. 2021-10-20T23:18:05.028 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-10-20T23:18:05.072 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-20T23:18:05.107 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package nvme-cli. 2021-10-20T23:18:05.130 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-10-20T23:18:05.192 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-10-20T23:18:05.199 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-html5lib. 2021-10-20T23:18:05.219 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-10-20T23:18:05.274 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-10-20T23:18:05.333 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-webencodings. 2021-10-20T23:18:05.351 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-10-20T23:18:05.360 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-html5lib. 2021-10-20T23:18:05.382 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-10-20T23:18:05.398 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-20T23:18:05.416 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-10-20T23:18:05.579 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-atomicwrites. 2021-10-20T23:18:05.601 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-10-20T23:18:05.645 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-10-20T23:18:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-10-20T23:18:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-10-20T23:18:05.701 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-html5lib. 2021-10-20T23:18:05.719 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-20T23:18:05.719 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-10-20T23:18:05.720 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-10-20T23:18:05.741 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-10-20T23:18:05.759 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-10-20T23:18:05.787 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-20T23:18:06.171 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-10-20T23:18:06.191 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-10-20T23:18:06.228 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-20T23:18:06.247 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-packaging. 2021-10-20T23:18:06.256 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-packaging. 2021-10-20T23:18:06.269 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-10-20T23:18:06.275 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-10-20T23:18:06.322 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-packaging (20.3-1) ... 2021-10-20T23:18:06.347 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-packaging (20.3-1) ... 2021-10-20T23:18:06.356 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-attr. 2021-10-20T23:18:06.377 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-10-20T23:18:06.415 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-10-20T23:18:06.650 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastescript. 2021-10-20T23:18:06.669 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-10-20T23:18:06.675 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastescript. 2021-10-20T23:18:06.695 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-10-20T23:18:06.698 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-packaging. 2021-10-20T23:18:06.707 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-10-20T23:18:06.721 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-10-20T23:18:06.733 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-10-20T23:18:06.776 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webencodings. 2021-10-20T23:18:06.795 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-packaging (20.3-1) ... 2021-10-20T23:18:06.796 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-10-20T23:18:06.834 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-20T23:18:07.039 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pluggy. 2021-10-20T23:18:07.061 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-10-20T23:18:07.061 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pluggy. 2021-10-20T23:18:07.082 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-10-20T23:18:07.104 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-10-20T23:18:07.120 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-10-20T23:18:07.134 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pastescript. 2021-10-20T23:18:07.158 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-10-20T23:18:07.170 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-html5lib. 2021-10-20T23:18:07.193 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-10-20T23:18:07.201 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-10-20T23:18:07.236 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-10-20T23:18:07.431 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-psutil. 2021-10-20T23:18:07.432 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-psutil. 2021-10-20T23:18:07.451 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-10-20T23:18:07.452 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-10-20T23:18:07.489 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-10-20T23:18:07.490 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-10-20T23:18:07.538 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pluggy. 2021-10-20T23:18:07.561 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-10-20T23:18:07.608 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-10-20T23:18:07.613 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-10-20T23:18:07.628 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-10-20T23:18:07.665 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-20T23:18:07.818 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-py. 2021-10-20T23:18:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-10-20T23:18:07.850 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-py. 2021-10-20T23:18:07.873 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-10-20T23:18:07.876 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-py (1.8.1-1) ... 2021-10-20T23:18:07.917 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-py (1.8.1-1) ... 2021-10-20T23:18:07.950 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-psutil. 2021-10-20T23:18:07.971 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-10-20T23:18:08.007 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-10-20T23:18:08.135 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-packaging. 2021-10-20T23:18:08.155 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-10-20T23:18:08.193 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-packaging (20.3-1) ... 2021-10-20T23:18:08.234 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyinotify. 2021-10-20T23:18:08.245 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyinotify. 2021-10-20T23:18:08.257 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-10-20T23:18:08.266 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-10-20T23:18:08.303 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-20T23:18:08.304 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-20T23:18:08.335 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-py. 2021-10-20T23:18:08.355 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-10-20T23:18:08.394 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-py (1.8.1-1) ... 2021-10-20T23:18:08.531 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastescript. 2021-10-20T23:18:08.549 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-10-20T23:18:08.587 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-10-20T23:18:08.633 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pytest. 2021-10-20T23:18:08.654 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-10-20T23:18:08.656 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pytest. 2021-10-20T23:18:08.678 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-10-20T23:18:08.691 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-10-20T23:18:08.730 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyinotify. 2021-10-20T23:18:08.733 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-10-20T23:18:08.750 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-10-20T23:18:08.813 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-20T23:18:08.916 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pluggy. 2021-10-20T23:18:08.939 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-10-20T23:18:08.983 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-10-20T23:18:09.045 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplejson. 2021-10-20T23:18:09.066 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-10-20T23:18:09.068 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplejson. 2021-10-20T23:18:09.087 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-10-20T23:18:09.111 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-20T23:18:09.124 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pytest. 2021-10-20T23:18:09.130 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-20T23:18:09.145 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-10-20T23:18:09.182 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-10-20T23:18:09.360 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-psutil. 2021-10-20T23:18:09.380 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-10-20T23:18:09.418 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-10-20T23:18:09.519 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-simplejson. 2021-10-20T23:18:09.539 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-10-20T23:18:09.565 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package radosgw. 2021-10-20T23:18:09.577 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-20T23:18:09.586 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../101-radosgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:09.623 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:09.638 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package radosgw. 2021-10-20T23:18:09.661 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../101-radosgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:09.706 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:09.838 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-py. 2021-10-20T23:18:09.858 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-10-20T23:18:09.905 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-py (1.8.1-1) ... 2021-10-20T23:18:10.022 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package radosgw. 2021-10-20T23:18:10.045 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../101-radosgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:10.081 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:10.283 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyinotify. 2021-10-20T23:18:10.303 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-10-20T23:18:10.341 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-20T23:18:10.677 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pytest. 2021-10-20T23:18:10.697 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-10-20T23:18:10.735 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-10-20T23:18:10.743 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package rbd-fuse. 2021-10-20T23:18:10.764 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:10.801 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:10.808 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package rbd-fuse. 2021-10-20T23:18:10.828 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:10.867 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:11.092 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-attr (19.3.0-2) ... 2021-10-20T23:18:11.114 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplejson. 2021-10-20T23:18:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-10-20T23:18:11.176 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package rbd-fuse. 2021-10-20T23:18:11.180 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-20T23:18:11.195 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:11.211 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-attr (19.3.0-2) ... 2021-10-20T23:18:11.234 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:11.536 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-20T23:18:11.547 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-attr (19.3.0-2) ... 2021-10-20T23:18:11.574 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-20T23:18:11.635 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package radosgw. 2021-10-20T23:18:11.656 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../101-radosgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:11.663 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-10-20T23:18:11.693 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:11.697 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-10-20T23:18:11.789 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-10-20T23:18:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-10-20T23:18:11.904 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-20T23:18:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:12.007 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:12.038 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-10-20T23:18:12.139 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-10-20T23:18:12.307 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:12.602 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user cephadm....done 2021-10-20T23:18:12.671 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user cephadm....done 2021-10-20T23:18:12.790 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-10-20T23:18:12.826 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-10-20T23:18:12.828 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package rbd-fuse. 2021-10-20T23:18:12.849 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-20T23:18:12.886 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:12.968 INFO:teuthology.orchestra.run.smithi136.stdout:Adding system user cephadm....done 2021-10-20T23:18:13.130 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-10-20T23:18:13.150 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-10-20T23:18:13.159 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-10-20T23:18:13.241 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-attr (19.3.0-2) ... 2021-10-20T23:18:13.443 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-10-20T23:18:13.465 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-10-20T23:18:13.510 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-10-20T23:18:13.577 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-py (1.8.1-1) ... 2021-10-20T23:18:13.636 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-py (1.8.1-1) ... 2021-10-20T23:18:13.700 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-20T23:18:13.774 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-10-20T23:18:13.867 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-10-20T23:18:13.901 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-py (1.8.1-1) ... 2021-10-20T23:18:13.903 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-10-20T23:18:13.971 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-10-20T23:18:13.993 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-10-20T23:18:14.186 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:14.235 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-10-20T23:18:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-10-20T23:18:14.398 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-10-20T23:18:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-10-20T23:18:14.628 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-10-20T23:18:14.682 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-10-20T23:18:14.873 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user cephadm....done 2021-10-20T23:18:14.905 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-10-20T23:18:14.916 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-10-20T23:18:14.991 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-10-20T23:18:15.035 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-10-20T23:18:15.189 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-10-20T23:18:15.223 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-20T23:18:15.268 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-20T23:18:15.427 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-10-20T23:18:15.473 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-20T23:18:15.502 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-20T23:18:15.544 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-20T23:18:15.720 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-10-20T23:18:15.775 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-20T23:18:15.786 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:15.837 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:15.855 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-py (1.8.1-1) ... 2021-10-20T23:18:16.076 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:16.087 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-20T23:18:16.163 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-20T23:18:16.198 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-10-20T23:18:16.205 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-10-20T23:18:16.289 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-10-20T23:18:16.377 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-20T23:18:16.486 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-10-20T23:18:16.490 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-10-20T23:18:16.582 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-10-20T23:18:16.708 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-10-20T23:18:16.763 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-10-20T23:18:16.783 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-20T23:18:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-20T23:18:17.047 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-20T23:18:17.051 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-10-20T23:18:17.100 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-10-20T23:18:17.150 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-10-20T23:18:17.339 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-10-20T23:18:17.352 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-10-20T23:18:17.477 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-10-20T23:18:17.527 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-10-20T23:18:17.678 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-20T23:18:17.751 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-10-20T23:18:17.753 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-20T23:18:17.846 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-20T23:18:17.980 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-20T23:18:18.025 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-20T23:18:18.087 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-10-20T23:18:18.188 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-10-20T23:18:18.290 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:18.368 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-10-20T23:18:18.380 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-10-20T23:18:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-10-20T23:18:18.565 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-20T23:18:18.667 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-10-20T23:18:18.668 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-10-20T23:18:18.715 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-10-20T23:18:18.816 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-10-20T23:18:18.950 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-10-20T23:18:19.016 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-packaging (20.3-1) ... 2021-10-20T23:18:19.020 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-10-20T23:18:19.100 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-packaging (20.3-1) ... 2021-10-20T23:18:19.235 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-20T23:18:19.288 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-packaging (20.3-1) ... 2021-10-20T23:18:19.317 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-10-20T23:18:19.384 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-10-20T23:18:19.460 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-20T23:18:19.510 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-20T23:18:19.569 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-10-20T23:18:19.589 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-10-20T23:18:19.736 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-10-20T23:18:19.740 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-20T23:18:19.803 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-10-20T23:18:19.947 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-10-20T23:18:20.033 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-10-20T23:18:20.105 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-10-20T23:18:20.205 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-10-20T23:18:20.231 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-20T23:18:20.418 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-10-20T23:18:20.439 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-20T23:18:20.499 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-20T23:18:20.590 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-10-20T23:18:20.721 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-20T23:18:20.807 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-20T23:18:20.857 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-10-20T23:18:20.882 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-20T23:18:21.056 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-20T23:18:21.176 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up socat (1.7.3.3-2) ... 2021-10-20T23:18:21.192 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-10-20T23:18:21.243 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up socat (1.7.3.3-2) ... 2021-10-20T23:18:21.285 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:21.368 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:21.397 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up socat (1.7.3.3-2) ... 2021-10-20T23:18:21.493 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-packaging (20.3-1) ... 2021-10-20T23:18:21.524 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:21.579 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-10-20T23:18:21.695 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-10-20T23:18:21.802 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-10-20T23:18:21.858 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-10-20T23:18:21.913 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-20T23:18:21.956 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-20T23:18:22.021 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-20T23:18:22.040 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-10-20T23:18:22.139 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-10-20T23:18:22.209 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-20T23:18:22.243 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-10-20T23:18:22.324 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-10-20T23:18:22.335 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-10-20T23:18:22.399 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-10-20T23:18:22.450 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-10-20T23:18:22.549 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-10-20T23:18:22.603 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-10-20T23:18:22.662 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-10-20T23:18:22.746 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-10-20T23:18:22.794 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-10-20T23:18:22.860 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-10-20T23:18:22.960 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-20T23:18:23.056 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-10-20T23:18:23.069 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-10-20T23:18:23.144 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-10-20T23:18:23.345 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-20T23:18:23.345 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-20T23:18:23.348 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-10-20T23:18:23.455 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-10-20T23:18:23.463 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-20T23:18:23.580 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-10-20T23:18:23.659 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-20T23:18:23.721 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up socat (1.7.3.3-2) ... 2021-10-20T23:18:23.781 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-10-20T23:18:23.792 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-10-20T23:18:23.831 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:23.856 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-10-20T23:18:24.074 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-20T23:18:24.085 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-10-20T23:18:24.132 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-20T23:18:24.166 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-10-20T23:18:24.385 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-20T23:18:24.401 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-10-20T23:18:24.433 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-10-20T23:18:24.509 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-20T23:18:24.635 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-10-20T23:18:24.695 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-10-20T23:18:24.834 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-10-20T23:18:24.902 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-10-20T23:18:24.953 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-10-20T23:18:25.066 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-10-20T23:18:25.079 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-10-20T23:18:25.094 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-10-20T23:18:25.220 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-20T23:18:25.306 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-10-20T23:18:25.423 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-10-20T23:18:25.430 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-10-20T23:18:25.460 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-20T23:18:25.538 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-10-20T23:18:25.558 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-20T23:18:25.674 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-10-20T23:18:25.881 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-20T23:18:25.891 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-10-20T23:18:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-20T23:18:26.002 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-20T23:18:26.101 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-10-20T23:18:26.129 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-10-20T23:18:26.243 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-20T23:18:26.268 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-10-20T23:18:26.369 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-20T23:18:26.396 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-10-20T23:18:26.446 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-20T23:18:26.495 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-10-20T23:18:26.647 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-20T23:18:26.707 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-20T23:18:26.723 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librados2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:26.746 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-20T23:18:26.823 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-10-20T23:18:26.829 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-20T23:18:26.847 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-10-20T23:18:26.991 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-10-20T23:18:27.147 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librados2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:27.156 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-20T23:18:27.273 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-10-20T23:18:27.360 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-10-20T23:18:27.441 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librados2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:27.584 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-10-20T23:18:27.653 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-10-20T23:18:27.811 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-20T23:18:28.162 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-10-20T23:18:28.518 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-20T23:18:28.686 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-20T23:18:28.692 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:28.752 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:28.815 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-10-20T23:18:28.818 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:18:28.875 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:18:28.940 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-10-20T23:18:29.002 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-10-20T23:18:29.085 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:29.153 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-20T23:18:29.211 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:18:29.316 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-10-20T23:18:29.317 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-10-20T23:18:29.395 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-10-20T23:18:29.451 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librados2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-10-20T23:18:29.610 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-10-20T23:18:29.687 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-10-20T23:18:29.699 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-10-20T23:18:29.891 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-10-20T23:18:29.954 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-10-20T23:18:30.014 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-10-20T23:18:30.234 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:30.239 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-10-20T23:18:30.366 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:30.378 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-20T23:18:30.492 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-20T23:18:30.548 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:30.707 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-20T23:18:30.711 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:30.821 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-20T23:18:30.827 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:30.969 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-20T23:18:31.051 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:31.099 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:31.147 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-20T23:18:31.177 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-20T23:18:31.224 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:18:31.341 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-20T23:18:31.367 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-10-20T23:18:31.510 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-20T23:18:31.768 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-10-20T23:18:32.078 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-10-20T23:18:32.220 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librbd1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:32.346 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-20T23:18:32.374 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-10-20T23:18:32.388 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librbd1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:32.472 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-10-20T23:18:32.514 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-20T23:18:32.599 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-20T23:18:32.610 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librbd1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:32.649 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-10-20T23:18:32.711 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-20T23:18:32.748 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:32.800 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-20T23:18:32.812 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-10-20T23:18:32.877 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-20T23:18:32.914 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-20T23:18:32.925 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:18:33.051 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rsa (4.0-3) ... 2021-10-20T23:18:33.135 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:18:33.212 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:33.232 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:18:33.261 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rsa (4.0-3) ... 2021-10-20T23:18:33.338 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-20T23:18:33.352 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-10-20T23:18:33.359 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rsa (4.0-3) ... 2021-10-20T23:18:33.571 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-10-20T23:18:33.651 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-10-20T23:18:33.653 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:33.656 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-20T23:18:33.771 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:33.865 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:33.935 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:33.999 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:34.029 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-20T23:18:34.029 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-20T23:18:34.046 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:34.225 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-20T23:18:34.226 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-20T23:18:34.254 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-20T23:18:34.254 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-20T23:18:34.489 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:34.615 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-20T23:18:34.672 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:34.738 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librbd1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:34.751 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:34.799 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-20T23:18:34.878 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-20T23:18:34.897 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-20T23:18:34.918 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-10-20T23:18:35.024 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-10-20T23:18:35.103 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-10-20T23:18:35.151 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-20T23:18:35.161 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-10-20T23:18:35.244 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-10-20T23:18:35.426 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-10-20T23:18:35.494 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-10-20T23:18:35.504 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-10-20T23:18:35.604 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:35.619 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rsa (4.0-3) ... 2021-10-20T23:18:35.755 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:35.803 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:35.840 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:35.904 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:35.906 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:35.929 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-10-20T23:18:35.975 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:36.005 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:36.041 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-routes (2.4.1-2) ... 2021-10-20T23:18:36.126 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:36.132 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-routes (2.4.1-2) ... 2021-10-20T23:18:36.213 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:36.251 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-routes (2.4.1-2) ... 2021-10-20T23:18:36.339 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:36.410 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-10-20T23:18:36.517 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-10-20T23:18:36.579 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-20T23:18:36.579 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-20T23:18:36.630 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-10-20T23:18:36.721 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:36.845 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:36.861 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:36.923 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:36.961 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:37.049 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:37.140 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:37.221 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:37.290 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-10-20T23:18:37.334 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:37.349 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-10-20T23:18:37.374 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:37.460 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-10-20T23:18:37.501 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-20T23:18:37.835 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-10-20T23:18:38.170 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-10-20T23:18:38.243 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:38.262 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:38.383 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:38.573 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:38.732 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:38.798 INFO:teuthology.orchestra.run.smithi031.stdout:Adding group ceph....done 2021-10-20T23:18:38.833 INFO:teuthology.orchestra.run.smithi136.stdout:Adding group ceph....done 2021-10-20T23:18:38.858 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:38.919 INFO:teuthology.orchestra.run.smithi119.stdout:Adding group ceph....done 2021-10-20T23:18:38.984 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-routes (2.4.1-2) ... 2021-10-20T23:18:39.169 INFO:teuthology.orchestra.run.smithi136.stdout:Adding system user ceph....done 2021-10-20T23:18:39.184 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user ceph....done 2021-10-20T23:18:39.321 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user ceph....done 2021-10-20T23:18:39.329 INFO:teuthology.orchestra.run.smithi136.stdout:Setting system user ceph properties....done 2021-10-20T23:18:39.351 INFO:teuthology.orchestra.run.smithi136.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-10-20T23:18:39.359 INFO:teuthology.orchestra.run.smithi031.stdout:Setting system user ceph properties....done 2021-10-20T23:18:39.382 INFO:teuthology.orchestra.run.smithi031.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-10-20T23:18:39.404 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-10-20T23:18:39.493 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-10-20T23:18:39.531 INFO:teuthology.orchestra.run.smithi119.stdout:Setting system user ceph properties....done 2021-10-20T23:18:39.536 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-10-20T23:18:39.556 INFO:teuthology.orchestra.run.smithi119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-10-20T23:18:39.703 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-10-20T23:18:39.707 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:39.814 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-10-20T23:18:39.835 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:39.860 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-10-20T23:18:40.012 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-10-20T23:18:40.128 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:40.254 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-10-20T23:18:40.283 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:40.339 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:40.417 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:40.469 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:40.498 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:40.595 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:40.714 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-20T23:18:40.715 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-20T23:18:40.774 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-20T23:18:40.774 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-20T23:18:40.864 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-20T23:18:40.865 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-20T23:18:41.207 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:41.352 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:41.458 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:41.530 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:41.692 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-10-20T23:18:41.776 INFO:teuthology.orchestra.run.smithi012.stdout:Adding group ceph....done 2021-10-20T23:18:41.797 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-10-20T23:18:41.869 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-10-20T23:18:42.162 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:42.195 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user ceph....done 2021-10-20T23:18:42.252 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:42.379 INFO:teuthology.orchestra.run.smithi012.stdout:Setting system user ceph properties....done 2021-10-20T23:18:42.389 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-20T23:18:42.389 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-20T23:18:42.407 INFO:teuthology.orchestra.run.smithi012.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-10-20T23:18:42.513 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-20T23:18:42.514 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-20T23:18:42.563 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-10-20T23:18:42.569 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-20T23:18:42.570 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-20T23:18:42.814 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:42.897 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-10-20T23:18:42.969 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:43.017 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:43.048 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-20T23:18:43.048 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-20T23:18:43.188 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-20T23:18:43.188 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-20T23:18:43.264 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-20T23:18:43.265 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-20T23:18:43.367 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:43.493 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:43.494 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:43.666 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:43.710 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:43.746 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:43.767 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-20T23:18:43.767 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-20T23:18:43.845 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:43.880 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:44.221 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-20T23:18:44.221 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-20T23:18:44.358 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-20T23:18:44.358 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-20T23:18:44.421 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:44.436 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-20T23:18:44.436 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-20T23:18:44.677 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:44.799 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-10-20T23:18:44.803 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:44.813 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:44.891 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:44.940 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:44.963 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.016 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.091 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.168 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.189 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-20T23:18:45.189 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-20T23:18:45.281 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.339 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-20T23:18:45.339 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-20T23:18:45.430 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-20T23:18:45.431 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-20T23:18:45.555 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-20T23:18:45.556 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-20T23:18:45.631 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.774 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.792 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.894 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.925 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:45.935 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:46.007 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:46.037 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:46.068 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-10-20T23:18:46.086 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:46.188 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:46.224 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-20T23:18:46.224 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-20T23:18:46.230 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-10-20T23:18:46.340 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-10-20T23:18:46.361 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-20T23:18:46.522 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-20T23:18:46.624 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-20T23:18:46.684 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:46.826 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:47.374 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-20T23:18:47.375 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-20T23:18:47.889 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:48.022 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:48.156 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:48.384 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-20T23:18:48.384 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-20T23:18:48.825 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:48.952 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:49.023 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-20T23:18:49.077 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-20T23:18:49.176 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-20T23:18:49.238 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-10-20T23:18:49.318 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-20T23:18:49.435 INFO:teuthology.orchestra.run.smithi136.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-20T23:18:49.437 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-10-20T23:18:49.510 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-10-20T23:18:49.530 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-20T23:18:49.621 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-20T23:18:49.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-10-20T23:18:49.678 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-10-20T23:18:49.679 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-10-20T23:18:49.692 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2021-10-20T23:18:49.726 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-20T23:18:49.729 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-10-20T23:18:49.795 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2021-10-20T23:18:49.824 INFO:teuthology.orchestra.run.smithi136.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-10-20T23:18:49.825 INFO:teuthology.orchestra.run.smithi136.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-10-20T23:18:49.825 INFO:teuthology.orchestra.run.smithi136.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-10-20T23:18:49.825 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:18:49.825 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-20T23:18:49.826 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:18:49.827 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:18:49.827 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:18:49.827 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:18:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2021-10-20T23:18:49.828 INFO:teuthology.orchestra.run.smithi136.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-10-20T23:18:49.856 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2021-10-20T23:18:49.857 INFO:teuthology.orchestra.run.smithi136.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-10-20T23:18:49.858 INFO:teuthology.orchestra.run.smithi136.stdout: libssl-dev 2021-10-20T23:18:49.860 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2021-10-20T23:18:49.861 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2021-10-20T23:18:49.966 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2021-10-20T23:18:49.966 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2021-10-20T23:18:50.001 INFO:teuthology.orchestra.run.smithi119.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-10-20T23:18:50.002 INFO:teuthology.orchestra.run.smithi119.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-10-20T23:18:50.002 INFO:teuthology.orchestra.run.smithi119.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-10-20T23:18:50.002 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:18:50.002 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-20T23:18:50.003 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:18:50.004 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:18:50.005 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:18:50.005 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:18:50.006 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2021-10-20T23:18:50.006 INFO:teuthology.orchestra.run.smithi119.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-10-20T23:18:50.038 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2021-10-20T23:18:50.038 INFO:teuthology.orchestra.run.smithi119.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-10-20T23:18:50.039 INFO:teuthology.orchestra.run.smithi119.stdout: libssl-dev 2021-10-20T23:18:50.043 INFO:teuthology.orchestra.run.smithi136.stdout:0 upgraded, 10 newly installed, 0 to remove and 26 not upgraded. 2021-10-20T23:18:50.043 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 2,913 kB of archives. 2021-10-20T23:18:50.043 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-10-20T23:18:50.044 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-10-20T23:18:50.119 INFO:teuthology.orchestra.run.smithi031.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-10-20T23:18:50.120 INFO:teuthology.orchestra.run.smithi031.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-10-20T23:18:50.120 INFO:teuthology.orchestra.run.smithi031.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-10-20T23:18:50.120 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:18:50.120 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-20T23:18:50.121 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:18:50.121 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:18:50.121 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:18:50.122 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:18:50.122 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2021-10-20T23:18:50.123 INFO:teuthology.orchestra.run.smithi031.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-10-20T23:18:50.153 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2021-10-20T23:18:50.154 INFO:teuthology.orchestra.run.smithi031.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-10-20T23:18:50.154 INFO:teuthology.orchestra.run.smithi031.stdout: libssl-dev 2021-10-20T23:18:50.225 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 10 newly installed, 0 to remove and 26 not upgraded. 2021-10-20T23:18:50.225 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 2,913 kB of archives. 2021-10-20T23:18:50.226 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-10-20T23:18:50.226 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-10-20T23:18:50.338 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 10 newly installed, 0 to remove and 26 not upgraded. 2021-10-20T23:18:50.339 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 2,913 kB of archives. 2021-10-20T23:18:50.339 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-10-20T23:18:50.339 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-10-20T23:18:50.507 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-10-20T23:18:50.649 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-10-20T23:18:50.656 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-10-20T23:18:50.674 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-10-20T23:18:50.678 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-10-20T23:18:50.679 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-10-20T23:18:50.680 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-10-20T23:18:50.684 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-10-20T23:18:50.686 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-10-20T23:18:50.686 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-10-20T23:18:50.809 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-10-20T23:18:50.825 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-10-20T23:18:50.832 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-10-20T23:18:50.847 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-10-20T23:18:50.855 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-10-20T23:18:50.856 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-10-20T23:18:50.861 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-10-20T23:18:50.862 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-10-20T23:18:50.862 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-10-20T23:18:50.949 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-10-20T23:18:50.956 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-10-20T23:18:50.976 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-10-20T23:18:50.981 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-10-20T23:18:50.983 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-10-20T23:18:50.987 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-10-20T23:18:50.988 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-10-20T23:18:50.989 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-10-20T23:18:51.141 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 2,913 kB in 1s (3,158 kB/s) 2021-10-20T23:18:51.253 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package flex. 2021-10-20T23:18:51.313 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 2,913 kB in 1s (3,175 kB/s) 2021-10-20T23:18:51.326 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-10-20T23:18:51.332 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:51.376 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking flex (2.6.4-6.2) ... 2021-10-20T23:18:51.445 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 2,913 kB in 1s (3,140 kB/s) 2021-10-20T23:18:51.457 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package flex. 2021-10-20T23:18:51.527 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-10-20T23:18:51.533 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:51.580 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking flex (2.6.4-6.2) ... 2021-10-20T23:18:51.599 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package flex. 2021-10-20T23:18:51.673 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-10-20T23:18:51.679 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:51.722 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking flex (2.6.4-6.2) ... 2021-10-20T23:18:52.094 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package bison. 2021-10-20T23:18:52.102 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package bison. 2021-10-20T23:18:52.118 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-10-20T23:18:52.122 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-10-20T23:18:52.157 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-10-20T23:18:52.159 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-10-20T23:18:52.219 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package bison. 2021-10-20T23:18:52.245 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-10-20T23:18:52.290 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-10-20T23:18:52.366 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-20T23:18:52.589 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-10-20T23:18:52.602 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-10-20T23:18:52.609 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-10-20T23:18:52.624 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-10-20T23:18:52.710 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-10-20T23:18:52.723 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-10-20T23:18:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-10-20T23:18:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-10-20T23:18:52.868 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-10-20T23:18:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-20T23:18:52.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-10-20T23:18:53.013 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2021-10-20T23:18:53.047 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package dump. 2021-10-20T23:18:53.070 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-10-20T23:18:53.076 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package dump. 2021-10-20T23:18:53.099 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-10-20T23:18:53.114 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking dump (0.4b46-6) ... 2021-10-20T23:18:53.134 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking dump (0.4b46-6) ... 2021-10-20T23:18:53.183 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2021-10-20T23:18:53.184 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2021-10-20T23:18:53.247 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package dump. 2021-10-20T23:18:53.267 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-10-20T23:18:53.305 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking dump (0.4b46-6) ... 2021-10-20T23:18:53.333 INFO:teuthology.orchestra.run.smithi012.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-10-20T23:18:53.333 INFO:teuthology.orchestra.run.smithi012.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-10-20T23:18:53.333 INFO:teuthology.orchestra.run.smithi012.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-10-20T23:18:53.334 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:18:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-20T23:18:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:18:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:18:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:18:53.335 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:18:53.336 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2021-10-20T23:18:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-10-20T23:18:53.366 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2021-10-20T23:18:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-10-20T23:18:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: libssl-dev 2021-10-20T23:18:53.421 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package indent. 2021-10-20T23:18:53.434 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package indent. 2021-10-20T23:18:53.444 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-10-20T23:18:53.455 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-10-20T23:18:53.493 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking indent (2.2.12-1) ... 2021-10-20T23:18:53.522 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking indent (2.2.12-1) ... 2021-10-20T23:18:53.551 INFO:teuthology.orchestra.run.smithi012.stdout:0 upgraded, 10 newly installed, 0 to remove and 26 not upgraded. 2021-10-20T23:18:53.551 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 2,913 kB of archives. 2021-10-20T23:18:53.552 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-10-20T23:18:53.552 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-10-20T23:18:53.591 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package indent. 2021-10-20T23:18:53.610 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-10-20T23:18:53.648 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking indent (2.2.12-1) ... 2021-10-20T23:18:53.762 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-10-20T23:18:53.785 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-10-20T23:18:53.790 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-10-20T23:18:53.813 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-10-20T23:18:53.830 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-10-20T23:18:53.857 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-10-20T23:18:54.016 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-10-20T23:18:54.116 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-10-20T23:18:54.136 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-10-20T23:18:54.144 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-10-20T23:18:54.156 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-10-20T23:18:54.163 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-10-20T23:18:54.166 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-10-20T23:18:54.169 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-10-20T23:18:54.173 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-20T23:18:54.181 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-10-20T23:18:54.188 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-10-20T23:18:54.188 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-10-20T23:18:54.191 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-10-20T23:18:54.194 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-10-20T23:18:54.195 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-10-20T23:18:54.195 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-10-20T23:18:54.210 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-20T23:18:54.235 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-10-20T23:18:54.522 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-10-20T23:18:54.545 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-10-20T23:18:54.561 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libfl2:amd64. 2021-10-20T23:18:54.580 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:54.588 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-20T23:18:54.589 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl2:amd64. 2021-10-20T23:18:54.610 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:54.619 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:54.647 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:54.655 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 2,913 kB in 1s (3,154 kB/s) 2021-10-20T23:18:54.806 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package flex. 2021-10-20T23:18:54.871 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-10-20T23:18:54.877 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-10-20T23:18:54.883 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:54.891 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:54.900 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-10-20T23:18:54.920 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking flex (2.6.4-6.2) ... 2021-10-20T23:18:54.922 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:54.929 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:54.958 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl2:amd64. 2021-10-20T23:18:54.966 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:54.982 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:55.025 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:55.191 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-10-20T23:18:55.212 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-10-20T23:18:55.228 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-10-20T23:18:55.249 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-20T23:18:55.250 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-10-20T23:18:55.277 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-10-20T23:18:55.294 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-20T23:18:55.301 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:55.344 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:55.467 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package bison. 2021-10-20T23:18:55.486 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-10-20T23:18:55.528 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-10-20T23:18:55.580 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-10-20T23:18:55.599 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-10-20T23:18:55.663 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-20T23:18:55.751 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up flex (2.6.4-6.2) ... 2021-10-20T23:18:55.879 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-10-20T23:18:55.988 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-10-20T23:18:56.005 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-10-20T23:18:56.011 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-10-20T23:18:56.035 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up flex (2.6.4-6.2) ... 2021-10-20T23:18:56.096 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-10-20T23:18:56.135 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up flex (2.6.4-6.2) ... 2021-10-20T23:18:56.156 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-20T23:18:56.234 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-10-20T23:18:56.291 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-20T23:18:56.360 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-10-20T23:18:56.442 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:56.442 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-10-20T23:18:56.466 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package dump. 2021-10-20T23:18:56.486 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-20T23:18:56.486 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-10-20T23:18:56.524 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking dump (0.4b46-6) ... 2021-10-20T23:18:56.551 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-10-20T23:18:56.568 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up dump (0.4b46-6) ... 2021-10-20T23:18:56.645 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-20T23:18:56.652 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-20T23:18:56.663 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-10-20T23:18:56.728 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-10-20T23:18:56.753 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-20T23:18:56.771 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:56.818 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-10-20T23:18:56.853 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package indent. 2021-10-20T23:18:56.873 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-10-20T23:18:56.896 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:56.897 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up dump (0.4b46-6) ... 2021-10-20T23:18:56.904 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up indent (2.2.12-1) ... 2021-10-20T23:18:56.911 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking indent (2.2.12-1) ... 2021-10-20T23:18:56.992 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-10-20T23:18:57.022 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up dump (0.4b46-6) ... 2021-10-20T23:18:57.057 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-10-20T23:18:57.117 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-10-20T23:18:57.155 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-10-20T23:18:57.177 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-10-20T23:18:57.206 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-10-20T23:18:57.225 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up indent (2.2.12-1) ... 2021-10-20T23:18:57.228 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-10-20T23:18:57.249 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-10-20T23:18:57.283 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-10-20T23:18:57.312 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up indent (2.2.12-1) ... 2021-10-20T23:18:57.335 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:57.439 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:57.461 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-20T23:18:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-20T23:18:57.595 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:57.603 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-10-20T23:18:57.626 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-10-20T23:18:57.637 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-20T23:18:57.661 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-20T23:18:57.723 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-20T23:18:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-20T23:18:57.874 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-20T23:18:58.182 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libfl2:amd64. 2021-10-20T23:18:58.204 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:58.256 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:58.551 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-10-20T23:18:58.571 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-10-20T23:18:58.609 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-20T23:18:58.879 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-10-20T23:18:58.901 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-10-20T23:18:58.937 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-20T23:18:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up flex (2.6.4-6.2) ... 2021-10-20T23:18:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-10-20T23:18:59.622 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-10-20T23:18:59.701 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-10-20T23:18:59.758 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-10-20T23:18:59.830 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-20T23:18:59.840 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-10-20T23:18:59.956 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-20T23:19:00.107 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-10-20T23:19:00.216 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up dump (0.4b46-6) ... 2021-10-20T23:19:00.295 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-10-20T23:19:00.360 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-10-20T23:19:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-20T23:19:00.371 DEBUG:teuthology.parallel:result is None 2021-10-20T23:19:00.435 INFO:teuthology.orchestra.run.smithi136.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-20T23:19:00.437 DEBUG:teuthology.parallel:result is None 2021-10-20T23:19:00.449 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-10-20T23:19:00.548 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-20T23:19:00.551 DEBUG:teuthology.parallel:result is None 2021-10-20T23:19:00.562 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up indent (2.2.12-1) ... 2021-10-20T23:19:00.682 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-20T23:19:00.809 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-20T23:19:00.976 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-20T23:19:02.946 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-10-20T23:19:03.888 INFO:teuthology.orchestra.run.smithi012.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-20T23:19:03.891 DEBUG:teuthology.parallel:result is None 2021-10-20T23:19:03.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo lsb_release -is 2021-10-20T23:19:03.940 INFO:teuthology.orchestra.run.smithi012.stdout:Ubuntu 2021-10-20T23:19:03.946 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:19:03.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:19:04.105 DEBUG:teuthology.orchestra.run.smithi012:> dpkg-query -W -f '${Version}' ceph 2021-10-20T23:19:04.127 INFO:teuthology.orchestra.run.smithi012.stdout:15.2.14-138-g3fb760aa-1focal 2021-10-20T23:19:04.128 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:19:04.129 INFO:teuthology.task.install:The correct ceph version 15.2.14-138-g3fb760aa-1focal is installed. 2021-10-20T23:19:04.129 DEBUG:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2021-10-20T23:19:04.182 INFO:teuthology.orchestra.run.smithi031.stdout:Ubuntu 2021-10-20T23:19:04.187 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:19:04.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:19:04.343 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-query -W -f '${Version}' ceph 2021-10-20T23:19:04.368 INFO:teuthology.orchestra.run.smithi031.stdout:15.2.14-138-g3fb760aa-1focal 2021-10-20T23:19:04.369 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:19:04.369 INFO:teuthology.task.install:The correct ceph version 15.2.14-138-g3fb760aa-1focal is installed. 2021-10-20T23:19:04.370 DEBUG:teuthology.orchestra.run.smithi119:> sudo lsb_release -is 2021-10-20T23:19:04.423 INFO:teuthology.orchestra.run.smithi119.stdout:Ubuntu 2021-10-20T23:19:04.428 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:19:04.429 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:19:04.585 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-query -W -f '${Version}' ceph 2021-10-20T23:19:04.611 INFO:teuthology.orchestra.run.smithi119.stdout:15.2.14-138-g3fb760aa-1focal 2021-10-20T23:19:04.611 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:19:04.612 INFO:teuthology.task.install:The correct ceph version 15.2.14-138-g3fb760aa-1focal is installed. 2021-10-20T23:19:04.612 DEBUG:teuthology.orchestra.run.smithi136:> sudo lsb_release -is 2021-10-20T23:19:04.669 INFO:teuthology.orchestra.run.smithi136.stdout:Ubuntu 2021-10-20T23:19:04.675 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-20T23:19:04.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:19:04.835 DEBUG:teuthology.orchestra.run.smithi136:> dpkg-query -W -f '${Version}' ceph 2021-10-20T23:19:04.857 INFO:teuthology.orchestra.run.smithi136.stdout:15.2.14-138-g3fb760aa-1focal 2021-10-20T23:19:04.858 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:19:04.858 INFO:teuthology.task.install:The correct ceph version 15.2.14-138-g3fb760aa-1focal is installed. 2021-10-20T23:19:04.859 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-10-20T23:19:04.859 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:19:04.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-20T23:19:04.877 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:19:04.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-20T23:19:04.895 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2021-10-20T23:19:04.896 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-20T23:19:04.913 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-10-20T23:19:04.913 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-20T23:19:04.931 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-10-20T23:19:04.932 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:19:04.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2021-10-20T23:19:04.950 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-20T23:19:04.964 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:19:04.964 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2021-10-20T23:19:04.979 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-20T23:19:04.995 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2021-10-20T23:19:04.996 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2021-10-20T23:19:05.012 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-20T23:19:05.071 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-10-20T23:19:05.072 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2021-10-20T23:19:05.089 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-20T23:19:05.102 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-10-20T23:19:05.103 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:19:05.104 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-20T23:19:05.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-20T23:19:05.181 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:19:05.181 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-20T23:19:05.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-20T23:19:05.256 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2021-10-20T23:19:05.256 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-20T23:19:05.273 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-20T23:19:05.283 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-10-20T23:19:05.283 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-20T23:19:05.300 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-20T23:19:05.358 INFO:teuthology.run_tasks:Running task ceph... 2021-10-20T23:19:05.438 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-10-20T23:19:05.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2021-10-20T23:19:05.442 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2021-10-20T23:19:05.446 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2021-10-20T23:19:05.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2021-10-20T23:19:05.466 INFO:tasks.ceph:Disabling ceph logrotate... 2021-10-20T23:19:05.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2021-10-20T23:19:05.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2021-10-20T23:19:05.506 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2021-10-20T23:19:05.508 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2021-10-20T23:19:05.525 INFO:tasks.ceph:Creating extra log directories... 2021-10-20T23:19:05.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-10-20T23:19:05.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-10-20T23:19:05.531 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-10-20T23:19:05.566 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-10-20T23:19:05.584 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-10-20T23:19:05.584 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-10-20T23:19:05.585 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-10-20T23:19:05.585 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:19:05.586 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-10-20T23:19:05.595 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-10-20T23:19:05.678 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:19:05.679 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-10-20T23:19:05.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-10-20T23:19:05.769 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2021-10-20T23:19:05.770 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-10-20T23:19:05.778 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-10-20T23:19:05.864 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-10-20T23:19:05.868 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-10-20T23:19:05.876 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-10-20T23:19:05.915 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-10-20T23:19:05.916 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-10-20T23:19:05.916 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002', 'branch': 'wip-yuri5-testing-2021-10-20-0922-octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6453002', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri5-testing-2021-10-20-0922-octopus'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri5-testing-2021-10-20-0922-octopus', 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1']], 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-yuri5-testing-2021-10-20-0922-octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3fb760aae831e6138791851b7921f8f0e05db414', 'targets': {'smithi012.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCie0CDk0zxC4RmtTbSWDe9460hatbPL+TafxjoV3vs4KV/I6Osp+XUvMn623QuLIDANVbMrhg/qIfYaIMSsrJ5ByyaryqMmRvnv8idNncn9j1F/YqN86hl8AYKFxJiKpEtMg0G2jW3wy0vCK8Q4E+Y5ipq26D4MQJ5NpFSmtXLDr0L19JNQKRAi9iTXzn0FI0zkPkPhnAlXMEkpnW0OoJrEANz7hkOkEDuCwtiAmXGwk5wofTRGeg53yfwNkSC7UOtUgsjvYAMnnd24lF7PxxHyGiOwhVGQhCy9gRIRVoMk9PW9EApyyPr3Rm1q/T8fIyloS6cKfyZflUAXyJACdVIfZNWnC537JwaDfKxAxTdL9MOYbBLUIThLLhhoAAWqAdVBq3ZsPaDpB+d0v5F5whblLegLAtfpp+IKGQuXkTWjFP5lavixYxWJOb3wyYRkGQ6SIavMQ2NovLT5O54Ho/SyeKsR3j7kFI8mYY2KQ0OjL46u0cRAD+jkKhbO7ZIiv0=', 'smithi031.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsD83MSr0Bls2DOXA3npp+oARqw5TJYFobxhAVxNUpLTKB2KPHSGB5JKGM/OVMAfjKNKxt7yYhHsnf078eKoRE4fY+fZz4YKrDHe57pWgPsGa4pfY96sQb91h1jnvUsU+1tFOpWK9jYiCpVYXhF80O45maKRIU0Rqs2zCGRLYxB7X08irBv/Soc2WYewdlEIbt4PID4eAWQ4xjI9VMK6bcYGU46s/L+NHUgu8Z12JSLuHw9dRiXL44ELTsx65pkTu5ZPf/wW8aY45HIZdfj+a0QmEQ+6zMLesWfkH8xcrYwFu2dP5V54X6Nxbc0iUNKlQ+rHXB6XX9phiCXG9AJyTnxgZ9l4/5oTwRwtJ9Lnt6C6Vpb40Gyf3E3TprhQSpow0vVv7ltsolhS05Xh14L1UqN3ZFB/XBFFO3ezuX4V2NaJBry6tD2MELlr5jAPj6+H1N67QKMEYmPMMjUY/BkseLRifbNw2HDS0gIQO73Nyh05v3tgl1jev163PQIo5MCkc=', 'smithi119.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKHeMxSBN9bt7e51nAsCIXzyCfVEzulwvcb79ie/B2AOIg/sVUvd4WRH75f1CSHTPCGXFxRu+IhwAz2FYCuT6Sddg5cS/mWBGFPF/I9lhdddE4H1a6oJZ/eH8qlTVJ6h9kt9FQ7kdC1TkyC/kwyFDOdKZgR8Au5TdkpyjKeYIbTBhE0QUdUfI8NibKqLkwLpvAyl+ksKaNTnXvanBa6YRPwQKBRJHbOAw89eu5NX1qD7Os8Sx0L+LsD7xJKaAcvfzdM/024pDNEZwk6j2lGzaNXG3P2fKsQYGpAJsbAH2trj7ciwLMcglAwLdLTKWD7X0NAAygzZ3kkl2vo83ITatPRYO16tuHD/G0AiqC3Sa8UIJCNjSPFr22WvQzMb/ESJfmrAqokB5c3BdYR9IWMUq8oO3606++7oLEww4TJkZX1Ws8gIclATgXEQgjOl/oAiWVvtVbeMz/sTZXdQOhKfdu/jO6rw1kMgveNNeIpfyplcheyf9A+yn88i/Y06StqY0=', 'smithi136.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNfJECBM3sjq99kuedwl6QLJSTeMn177h7ZyehleV/v19KrA6bvNwIJJNkOE0SI8XT7kGcvyh2hPp4P7LSvHSbQJ7G2rJlu8p8hXX/ZYVXjNb08M1pgZ5gL+tC2kaRv3kUAaNIngWmf28tMxl0ZOIikrG7wT17eNydFFdDUn2l9k03uJf4l0zGBD3Aqst2M9TpO0EH8652DM3ujLroWpifIm6bdGKCYDDaSdnvZAfFNAn0dGfwAISRqysD1whxeyRcySOQfTJFkbIRYKHOaUkBcP8xddOezHOJouQ69n79BhpD/yhKFg1V4Hz70RlynlfbNZuZZuTNtFGXlJulCm1jFxuXFDrbIbWaxeEWVeE+ci2gKn7jDHMaTvYO/1eX08TYnb6irGSJZrRrHtzy4PbUzorFzLy+j/UNpTGEU/ks+rWoPNTqF6TNx80RbDsE+SwB8LS+9ap7bYpoAxJWHgxMrmXtWcIhy9PPpRjsC+Ixv2GpmDdGKyxMIKwslUp7cRs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b35344e81ac507b6cad7c1cae575ce08b9c766f2', 'timestamp': '2021-10-20_18:49:58', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.6888'} 2021-10-20T23:19:05.917 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-10-20T23:19:05.920 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-10-20T23:19:05.925 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-10-20T23:19:05.931 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-10-20T23:19:05.964 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2021-10-20T23:19:05.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2021-10-20T23:19:05.978 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2021-10-20T23:19:05.980 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2021-10-20T23:19:05.997 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:19:05.997 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2021-10-20T23:19:06.005 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-20T23:19:06.006 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-20T23:19:06.054 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-20T23:19:06.055 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-20T23:19:06.055 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-10-20T23:19:06.055 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-20T23:19:06.056 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2021-10-20 23:15:36.652568353 +0000 2021-10-20T23:19:06.056 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2021-10-20 23:15:36.480573082 +0000 2021-10-20T23:19:06.056 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2021-10-20 23:15:36.480573082 +0000 2021-10-20T23:19:06.056 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2021-10-20T23:19:06.064 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2021-10-20T23:19:06.064 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2021-10-20T23:19:06.064 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00040387 s, 1.3 MB/s 2021-10-20T23:19:06.069 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-20T23:19:06.077 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-20T23:19:06.078 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-20T23:19:06.078 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-10-20T23:19:06.079 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-20T23:19:06.079 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2021-10-20 23:15:37.072556806 +0000 2021-10-20T23:19:06.080 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2021-10-20 23:15:36.892561755 +0000 2021-10-20T23:19:06.080 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2021-10-20 23:15:36.892561755 +0000 2021-10-20T23:19:06.080 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2021-10-20T23:19:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2021-10-20T23:19:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2021-10-20T23:19:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000388703 s, 1.3 MB/s 2021-10-20T23:19:06.091 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-20T23:19:06.100 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-20T23:19:06.102 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-20T23:19:06.102 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-10-20T23:19:06.102 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-20T23:19:06.102 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2021-10-20 23:15:37.460546139 +0000 2021-10-20T23:19:06.103 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2021-10-20 23:15:37.296550648 +0000 2021-10-20T23:19:06.103 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2021-10-20 23:15:37.296550648 +0000 2021-10-20T23:19:06.103 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2021-10-20T23:19:06.111 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2021-10-20T23:19:06.111 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2021-10-20T23:19:06.112 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00039305 s, 1.3 MB/s 2021-10-20T23:19:06.116 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-20T23:19:06.124 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-20T23:19:06.125 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-20T23:19:06.125 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 366 Links: 1 2021-10-20T23:19:06.125 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-20T23:19:06.125 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2021-10-20 23:15:37.888534372 +0000 2021-10-20T23:19:06.126 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2021-10-20 23:15:37.716539101 +0000 2021-10-20T23:19:06.126 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2021-10-20 23:15:37.716539101 +0000 2021-10-20T23:19:06.126 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2021-10-20T23:19:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2021-10-20T23:19:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2021-10-20T23:19:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000382552 s, 1.3 MB/s 2021-10-20T23:19:06.138 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:06.139 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:19:06.139 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2021-10-20T23:19:06.148 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-20T23:19:06.148 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-20T23:19:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-20T23:19:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-20T23:19:06.196 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-10-20T23:19:06.196 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-20T23:19:06.196 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2021-10-20 23:15:36.603352921 +0000 2021-10-20T23:19:06.196 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2021-10-20 23:15:36.407358320 +0000 2021-10-20T23:19:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2021-10-20 23:15:36.407358320 +0000 2021-10-20T23:19:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2021-10-20T23:19:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2021-10-20T23:19:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2021-10-20T23:19:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000420056 s, 1.2 MB/s 2021-10-20T23:19:06.211 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-20T23:19:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-20T23:19:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-20T23:19:06.218 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-10-20T23:19:06.219 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-20T23:19:06.219 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2021-10-20 23:15:37.011341682 +0000 2021-10-20T23:19:06.219 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2021-10-20 23:15:36.839346420 +0000 2021-10-20T23:19:06.219 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2021-10-20 23:15:36.839346420 +0000 2021-10-20T23:19:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2021-10-20T23:19:06.227 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2021-10-20T23:19:06.227 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2021-10-20T23:19:06.227 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000379688 s, 1.3 MB/s 2021-10-20T23:19:06.231 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-20T23:19:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-20T23:19:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-20T23:19:06.239 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-10-20T23:19:06.239 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-20T23:19:06.239 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2021-10-20 23:15:37.407330774 +0000 2021-10-20T23:19:06.239 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2021-10-20 23:15:37.239335401 +0000 2021-10-20T23:19:06.240 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2021-10-20 23:15:37.239335401 +0000 2021-10-20T23:19:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2021-10-20T23:19:06.246 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2021-10-20T23:19:06.247 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2021-10-20T23:19:06.247 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000377859 s, 1.4 MB/s 2021-10-20T23:19:06.251 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-20T23:19:06.299 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-20T23:19:06.300 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-20T23:19:06.300 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 365 Links: 1 2021-10-20T23:19:06.300 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-20T23:19:06.300 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2021-10-20 23:15:37.839318873 +0000 2021-10-20T23:19:06.300 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2021-10-20 23:15:37.663323722 +0000 2021-10-20T23:19:06.301 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2021-10-20 23:15:37.663323722 +0000 2021-10-20T23:19:06.301 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2021-10-20T23:19:06.311 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2021-10-20T23:19:06.311 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2021-10-20T23:19:06.315 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000410456 s, 1.2 MB/s 2021-10-20T23:19:06.316 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:06.316 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-10-20T23:19:06.317 INFO:tasks.ceph:Generating config... 2021-10-20T23:19:06.319 INFO:tasks.ceph:[client] client mount timeout = 600 2021-10-20T23:19:06.319 INFO:tasks.ceph:[client] debug client = 20 2021-10-20T23:19:06.319 INFO:tasks.ceph:[client] debug ms = 1 2021-10-20T23:19:06.320 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-10-20T23:19:06.320 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-10-20T23:19:06.320 INFO:tasks.ceph:[mds] debug mds = 20 2021-10-20T23:19:06.320 INFO:tasks.ceph:[mds] debug ms = 1 2021-10-20T23:19:06.321 INFO:tasks.ceph:[mds] mds bal frag = True 2021-10-20T23:19:06.321 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-10-20T23:19:06.321 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-10-20T23:19:06.322 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-10-20T23:19:06.322 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-10-20T23:19:06.322 INFO:tasks.ceph:[mds] mds debug frag = True 2021-10-20T23:19:06.323 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-10-20T23:19:06.323 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-10-20T23:19:06.323 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-10-20T23:19:06.323 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-10-20T23:19:06.324 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-10-20T23:19:06.324 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-10-20T23:19:06.324 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-10-20T23:19:06.325 INFO:tasks.ceph:[mgr] debug ms = 1 2021-10-20T23:19:06.325 INFO:tasks.ceph:[mon] debug mon = 20 2021-10-20T23:19:06.325 INFO:tasks.ceph:[mon] debug ms = 1 2021-10-20T23:19:06.326 INFO:tasks.ceph:[mon] debug paxos = 20 2021-10-20T23:19:06.326 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-10-20T23:19:06.326 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-10-20T23:19:06.327 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-10-20T23:19:06.327 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-10-20T23:19:06.328 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-10-20T23:19:06.328 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-10-20T23:19:06.328 INFO:tasks.ceph:[osd] debug ms = 1 2021-10-20T23:19:06.328 INFO:tasks.ceph:[osd] debug osd = 20 2021-10-20T23:19:06.329 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-10-20T23:19:06.329 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-10-20T23:19:06.329 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-10-20T23:19:06.330 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-10-20T23:19:06.330 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-10-20T23:19:06.330 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-10-20T23:19:06.333 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-10-20T23:19:06.333 INFO:tasks.ceph:Setting up mon.a... 2021-10-20T23:19:06.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-10-20T23:19:06.404 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2021-10-20T23:19:06.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-10-20T23:19:06.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-20T23:19:06.454 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.b', '172.21.15.31'), ('mon.c', '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]')] 2021-10-20T23:19:06.455 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.12 --add b 172.21.15.31 --addv c '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:06.485 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:06.485 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:19:06.485 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2021-10-20T23:19:06.486 INFO:teuthology.orchestra.run.smithi012.stdout:fsid e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:19:06.486 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2021-10-20T23:19:06.481979+0000 2021-10-20T23:19:06.486 INFO:teuthology.orchestra.run.smithi012.stdout:created 2021-10-20T23:19:06.481979+0000 2021-10-20T23:19:06.486 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 0 (unknown) 2021-10-20T23:19:06.487 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2021-10-20T23:19:06.487 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.b 2021-10-20T23:19:06.487 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] mon.c 2021-10-20T23:19:06.487 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-10-20T23:19:06.489 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e54e6890-5274-4a86-a9de-861e39b4bc51... 2021-10-20T23:19:06.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:19:06.494 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:19:06.497 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:19:06.499 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:19:06.519 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2021-10-20T23:19:06.520 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2021-10-20T23:19:06.520 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:19:06.520 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2021-10-20T23:19:06.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.521 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2021-10-20T23:19:06.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.521 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2021-10-20T23:19:06.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.522 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2021-10-20T23:19:06.522 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2021-10-20T23:19:06.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.522 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2021-10-20T23:19:06.522 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2021-10-20T23:19:06.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.523 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:19:06.523 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2021-10-20T23:19:06.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.524 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:19:06.524 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:19:06.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.524 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2021-10-20T23:19:06.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.525 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2021-10-20T23:19:06.525 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2021-10-20T23:19:06.525 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:19:06.525 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:19:06.525 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2021-10-20T23:19:06.526 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:19:06.526 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2021-10-20T23:19:06.526 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:19:06.526 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:19:06.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.527 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:19:06.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.527 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2021-10-20T23:19:06.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.528 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2021-10-20T23:19:06.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.528 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2021-10-20T23:19:06.528 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2021-10-20T23:19:06.529 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2021-10-20T23:19:06.529 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:19:06.529 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:19:06.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.529 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2021-10-20T23:19:06.530 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2021-10-20T23:19:06.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.530 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2021-10-20T23:19:06.530 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2021-10-20T23:19:06.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.531 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2021-10-20T23:19:06.531 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2021-10-20T23:19:06.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.531 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2021-10-20T23:19:06.531 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2021-10-20T23:19:06.532 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2021-10-20T23:19:06.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.532 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2021-10-20T23:19:06.532 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2021-10-20T23:19:06.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.533 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:19:06.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.533 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2021-10-20T23:19:06.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.534 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2021-10-20T23:19:06.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.534 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:19:06.534 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2021-10-20T23:19:06.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.535 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2021-10-20T23:19:06.535 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2021-10-20T23:19:06.535 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2021-10-20T23:19:06.535 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore compression mode = aggressive 2021-10-20T23:19:06.536 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2021-10-20T23:19:06.536 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 20 2021-10-20T23:19:06.536 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 20 2021-10-20T23:19:06.536 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:19:06.536 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2021-10-20T23:19:06.537 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 10 2021-10-20T23:19:06.537 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:19:06.537 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2021-10-20T23:19:06.537 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:19:06.538 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:19:06.538 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2021-10-20T23:19:06.538 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2021-10-20T23:19:06.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.539 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2021-10-20T23:19:06.539 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:19:06.539 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2021-10-20T23:19:06.539 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2021-10-20T23:19:06.539 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2021-10-20T23:19:06.540 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:19:06.540 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:19:06.540 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2021-10-20T23:19:06.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.540 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2021-10-20T23:19:06.541 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:19:06.541 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2021-10-20T23:19:06.541 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2021-10-20T23:19:06.541 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2021-10-20T23:19:06.542 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2021-10-20T23:19:06.542 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2021-10-20T23:19:06.542 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:19:06.542 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2021-10-20T23:19:06.542 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2021-10-20T23:19:06.543 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:19:06.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.543 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:19:06.543 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:19:06.543 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:19:06.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.544 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:19:06.544 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:19:06.544 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:19:06.545 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2021-10-20T23:19:06.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:06.545 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2021-10-20T23:19:06.545 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2021-10-20T23:19:06.545 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2021-10-20T23:19:06.546 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2021-10-20T23:19:06.546 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:19:06.546 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:19:06.546 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2021-10-20T23:19:06.547 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2021-10-20T23:19:06.547 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:19:06.547 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 15m 2021-10-20T23:19:06.549 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 15m 2021-10-20T23:19:06.550 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2021-10-20T23:19:06.550 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2021-10-20T23:19:06.550 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2021-10-20T23:19:06.551 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2021-10-20T23:19:06.551 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2021-10-20T23:19:06.551 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2021-10-20T23:19:06.551 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2021-10-20T23:19:06.552 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2021-10-20T23:19:06.552 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:19:06.552 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal frag = True 2021-10-20T23:19:06.552 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal fragment size max = 10000 2021-10-20T23:19:06.553 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal merge size = 5 2021-10-20T23:19:06.553 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal split bits = 3 2021-10-20T23:19:06.553 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal split size = 100 2021-10-20T23:19:06.553 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2021-10-20T23:19:06.553 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2021-10-20T23:19:06.554 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2021-10-20T23:19:06.554 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2021-10-20T23:19:06.554 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2021-10-20T23:19:06.554 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 15m 2021-10-20T23:19:06.555 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 15m 2021-10-20T23:19:06.560 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2021-10-20T23:19:06.561 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2021-10-20T23:19:06.561 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:19:06.561 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2021-10-20T23:19:06.561 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.561 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2021-10-20T23:19:06.562 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.562 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2021-10-20T23:19:06.562 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.562 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2021-10-20T23:19:06.563 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2021-10-20T23:19:06.563 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.563 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2021-10-20T23:19:06.563 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2021-10-20T23:19:06.564 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.564 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:19:06.564 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2021-10-20T23:19:06.564 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.564 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:19:06.565 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:19:06.565 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.566 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2021-10-20T23:19:06.566 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.566 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2021-10-20T23:19:06.566 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2021-10-20T23:19:06.567 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:19:06.567 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:19:06.567 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2021-10-20T23:19:06.568 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:19:06.568 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2021-10-20T23:19:06.569 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:19:06.569 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:19:06.569 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.570 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:19:06.570 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.570 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2021-10-20T23:19:06.571 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.571 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2021-10-20T23:19:06.571 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.571 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2021-10-20T23:19:06.572 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2021-10-20T23:19:06.572 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2021-10-20T23:19:06.572 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:19:06.572 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:19:06.573 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.573 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2021-10-20T23:19:06.573 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2021-10-20T23:19:06.573 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.573 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2021-10-20T23:19:06.574 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2021-10-20T23:19:06.574 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.574 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2021-10-20T23:19:06.574 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2021-10-20T23:19:06.574 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.575 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2021-10-20T23:19:06.575 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2021-10-20T23:19:06.576 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2021-10-20T23:19:06.576 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.576 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2021-10-20T23:19:06.577 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2021-10-20T23:19:06.578 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.578 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:19:06.578 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.580 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2021-10-20T23:19:06.580 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.581 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2021-10-20T23:19:06.581 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.582 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:19:06.582 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2021-10-20T23:19:06.582 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.582 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2021-10-20T23:19:06.582 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2021-10-20T23:19:06.583 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2021-10-20T23:19:06.583 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore compression mode = aggressive 2021-10-20T23:19:06.583 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2021-10-20T23:19:06.583 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 20 2021-10-20T23:19:06.584 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 20 2021-10-20T23:19:06.584 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:19:06.584 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2021-10-20T23:19:06.584 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 10 2021-10-20T23:19:06.584 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:19:06.585 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2021-10-20T23:19:06.585 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:19:06.585 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:19:06.586 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2021-10-20T23:19:06.586 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2021-10-20T23:19:06.586 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.587 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2021-10-20T23:19:06.587 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:19:06.588 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2021-10-20T23:19:06.588 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2021-10-20T23:19:06.588 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2021-10-20T23:19:06.588 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:19:06.589 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:19:06.589 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2021-10-20T23:19:06.589 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.589 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2021-10-20T23:19:06.589 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:19:06.590 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2021-10-20T23:19:06.590 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2021-10-20T23:19:06.591 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2021-10-20T23:19:06.591 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2021-10-20T23:19:06.591 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2021-10-20T23:19:06.592 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:19:06.592 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2021-10-20T23:19:06.592 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2021-10-20T23:19:06.593 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:19:06.593 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.593 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:19:06.593 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:19:06.594 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:19:06.594 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.594 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:19:06.594 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:19:06.594 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:19:06.595 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2021-10-20T23:19:06.595 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:19:06.595 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2021-10-20T23:19:06.595 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2021-10-20T23:19:06.596 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2021-10-20T23:19:06.596 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2021-10-20T23:19:06.597 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:19:06.597 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:19:06.597 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2021-10-20T23:19:06.597 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2021-10-20T23:19:06.598 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:19:06.598 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 15m 2021-10-20T23:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 15m 2021-10-20T23:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2021-10-20T23:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2021-10-20T23:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2021-10-20T23:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2021-10-20T23:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2021-10-20T23:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2021-10-20T23:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2021-10-20T23:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2021-10-20T23:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal frag = True 2021-10-20T23:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal fragment size max = 10000 2021-10-20T23:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal merge size = 5 2021-10-20T23:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal split bits = 3 2021-10-20T23:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal split size = 100 2021-10-20T23:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2021-10-20T23:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2021-10-20T23:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2021-10-20T23:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2021-10-20T23:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2021-10-20T23:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 15m 2021-10-20T23:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 15m 2021-10-20T23:19:06.604 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2021-10-20T23:19:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2021-10-20T23:19:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:19:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2021-10-20T23:19:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2021-10-20T23:19:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2021-10-20T23:19:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2021-10-20T23:19:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2021-10-20T23:19:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2021-10-20T23:19:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2021-10-20T23:19:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:19:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2021-10-20T23:19:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:19:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:19:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2021-10-20T23:19:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2021-10-20T23:19:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2021-10-20T23:19:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:19:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:19:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2021-10-20T23:19:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:19:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2021-10-20T23:19:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:19:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:19:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:19:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2021-10-20T23:19:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2021-10-20T23:19:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2021-10-20T23:19:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2021-10-20T23:19:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2021-10-20T23:19:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:19:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:19:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.617 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2021-10-20T23:19:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2021-10-20T23:19:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2021-10-20T23:19:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2021-10-20T23:19:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2021-10-20T23:19:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2021-10-20T23:19:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2021-10-20T23:19:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2021-10-20T23:19:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2021-10-20T23:19:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2021-10-20T23:19:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2021-10-20T23:19:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:19:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2021-10-20T23:19:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2021-10-20T23:19:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:19:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2021-10-20T23:19:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2021-10-20T23:19:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2021-10-20T23:19:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2021-10-20T23:19:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore compression mode = aggressive 2021-10-20T23:19:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2021-10-20T23:19:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2021-10-20T23:19:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2021-10-20T23:19:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:19:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2021-10-20T23:19:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2021-10-20T23:19:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:19:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2021-10-20T23:19:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:19:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:19:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2021-10-20T23:19:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-10-20T23:19:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.629 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2021-10-20T23:19:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:19:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2021-10-20T23:19:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-10-20T23:19:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-10-20T23:19:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:19:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:19:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2021-10-20T23:19:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.632 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2021-10-20T23:19:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:19:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-10-20T23:19:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2021-10-20T23:19:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-10-20T23:19:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2021-10-20T23:19:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2021-10-20T23:19:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:19:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2021-10-20T23:19:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2021-10-20T23:19:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:19:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:19:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:19:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:19:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:19:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:19:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:19:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2021-10-20T23:19:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:19:06.636 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2021-10-20T23:19:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2021-10-20T23:19:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2021-10-20T23:19:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2021-10-20T23:19:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:19:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:19:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2021-10-20T23:19:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2021-10-20T23:19:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:19:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 15m 2021-10-20T23:19:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 15m 2021-10-20T23:19:06.642 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2021-10-20T23:19:06.642 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2021-10-20T23:19:06.642 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2021-10-20T23:19:06.643 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2021-10-20T23:19:06.643 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2021-10-20T23:19:06.643 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2021-10-20T23:19:06.643 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2021-10-20T23:19:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2021-10-20T23:19:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:19:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal frag = True 2021-10-20T23:19:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal fragment size max = 10000 2021-10-20T23:19:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal merge size = 5 2021-10-20T23:19:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split bits = 3 2021-10-20T23:19:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split size = 100 2021-10-20T23:19:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2021-10-20T23:19:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2021-10-20T23:19:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2021-10-20T23:19:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2021-10-20T23:19:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-10-20T23:19:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 15m 2021-10-20T23:19:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 15m 2021-10-20T23:19:06.647 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2021-10-20T23:19:06.647 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2021-10-20T23:19:06.648 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:19:06.648 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2021-10-20T23:19:06.648 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.648 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2021-10-20T23:19:06.648 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.649 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2021-10-20T23:19:06.649 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.649 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2021-10-20T23:19:06.649 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2021-10-20T23:19:06.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.650 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2021-10-20T23:19:06.650 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2021-10-20T23:19:06.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.651 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:19:06.651 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2021-10-20T23:19:06.651 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.651 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:19:06.651 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:19:06.652 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.652 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2021-10-20T23:19:06.652 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.652 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2021-10-20T23:19:06.653 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2021-10-20T23:19:06.653 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:19:06.653 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:19:06.653 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2021-10-20T23:19:06.654 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:19:06.654 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2021-10-20T23:19:06.654 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:19:06.654 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:19:06.655 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.655 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:19:06.655 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.655 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2021-10-20T23:19:06.655 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.656 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2021-10-20T23:19:06.656 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.656 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2021-10-20T23:19:06.656 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2021-10-20T23:19:06.657 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2021-10-20T23:19:06.657 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:19:06.657 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:19:06.657 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.657 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2021-10-20T23:19:06.658 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2021-10-20T23:19:06.658 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.658 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2021-10-20T23:19:06.658 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2021-10-20T23:19:06.659 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.659 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2021-10-20T23:19:06.659 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2021-10-20T23:19:06.659 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.659 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2021-10-20T23:19:06.660 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2021-10-20T23:19:06.660 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2021-10-20T23:19:06.660 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.660 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2021-10-20T23:19:06.661 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2021-10-20T23:19:06.661 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.661 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:19:06.661 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.661 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2021-10-20T23:19:06.662 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.662 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2021-10-20T23:19:06.662 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.662 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:19:06.663 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2021-10-20T23:19:06.663 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.663 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2021-10-20T23:19:06.663 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2021-10-20T23:19:06.663 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2021-10-20T23:19:06.664 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore compression mode = aggressive 2021-10-20T23:19:06.664 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2021-10-20T23:19:06.664 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 20 2021-10-20T23:19:06.664 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 20 2021-10-20T23:19:06.664 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:19:06.665 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2021-10-20T23:19:06.665 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 10 2021-10-20T23:19:06.665 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:19:06.665 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2021-10-20T23:19:06.666 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:19:06.666 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:19:06.666 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2021-10-20T23:19:06.666 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2021-10-20T23:19:06.666 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.667 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2021-10-20T23:19:06.667 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:19:06.667 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2021-10-20T23:19:06.667 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2021-10-20T23:19:06.668 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2021-10-20T23:19:06.668 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:19:06.668 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:19:06.668 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2021-10-20T23:19:06.668 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.669 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2021-10-20T23:19:06.669 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:19:06.669 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2021-10-20T23:19:06.669 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2021-10-20T23:19:06.669 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2021-10-20T23:19:06.670 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2021-10-20T23:19:06.670 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2021-10-20T23:19:06.670 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:19:06.670 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2021-10-20T23:19:06.671 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2021-10-20T23:19:06.671 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:19:06.671 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.671 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:19:06.671 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:19:06.672 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:19:06.672 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.672 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:19:06.672 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:19:06.673 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:19:06.673 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2021-10-20T23:19:06.673 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:19:06.673 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2021-10-20T23:19:06.673 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2021-10-20T23:19:06.674 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2021-10-20T23:19:06.674 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2021-10-20T23:19:06.674 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:19:06.674 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:19:06.675 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2021-10-20T23:19:06.675 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2021-10-20T23:19:06.675 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:19:06.675 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 15m 2021-10-20T23:19:06.675 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 15m 2021-10-20T23:19:06.676 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2021-10-20T23:19:06.676 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2021-10-20T23:19:06.676 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2021-10-20T23:19:06.676 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2021-10-20T23:19:06.676 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2021-10-20T23:19:06.677 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2021-10-20T23:19:06.677 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2021-10-20T23:19:06.677 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2021-10-20T23:19:06.677 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:19:06.678 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal frag = True 2021-10-20T23:19:06.678 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal fragment size max = 10000 2021-10-20T23:19:06.678 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal merge size = 5 2021-10-20T23:19:06.678 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split bits = 3 2021-10-20T23:19:06.678 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split size = 100 2021-10-20T23:19:06.679 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2021-10-20T23:19:06.679 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2021-10-20T23:19:06.679 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2021-10-20T23:19:06.679 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2021-10-20T23:19:06.679 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2021-10-20T23:19:06.680 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 15m 2021-10-20T23:19:06.680 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 15m 2021-10-20T23:19:06.680 INFO:tasks.ceph:Creating admin key on mon.a... 2021-10-20T23:19:06.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-10-20T23:19:06.728 INFO:tasks.ceph:Copying monmap to all nodes... 2021-10-20T23:19:06.737 DEBUG:teuthology.orchestra.remote:smithi012:/etc/ceph/ceph.keyring is 206B 2021-10-20T23:19:06.765 DEBUG:teuthology.orchestra.remote:smithi012:/home/ubuntu/cephtest/ceph.monmap is 379B 2021-10-20T23:19:06.783 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2021-10-20T23:19:06.783 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:19:06.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2021-10-20T23:19:06.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-20T23:19:06.811 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2021-10-20T23:19:06.812 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:06.861 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2021-10-20T23:19:06.862 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:19:06.862 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2021-10-20T23:19:06.862 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-20T23:19:06.890 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2021-10-20T23:19:06.890 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:06.896 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2021-10-20T23:19:06.897 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2021-10-20T23:19:06.897 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2021-10-20T23:19:06.898 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-20T23:19:06.925 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2021-10-20T23:19:06.926 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:06.977 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2021-10-20T23:19:06.978 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-10-20T23:19:06.980 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2021-10-20T23:19:06.980 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-20T23:19:07.008 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-10-20T23:19:07.008 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:07.062 INFO:tasks.ceph:Setting up mon nodes... 2021-10-20T23:19:07.063 INFO:tasks.ceph:Setting up mgr nodes... 2021-10-20T23:19:07.063 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-10-20T23:19:07.108 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-10-20T23:19:07.110 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-10-20T23:19:07.181 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-10-20T23:19:07.183 INFO:tasks.ceph:Setting up mds nodes... 2021-10-20T23:19:07.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-10-20T23:19:07.229 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-10-20T23:19:07.231 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-10-20T23:19:07.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2021-10-20T23:19:07.333 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2021-10-20T23:19:07.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2021-10-20T23:19:07.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-10-20T23:19:07.397 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-10-20T23:19:07.399 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-10-20T23:19:07.460 INFO:tasks.ceph_client:Setting up client nodes... 2021-10-20T23:19:07.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-10-20T23:19:07.521 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-10-20T23:19:07.536 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-10-20T23:19:07.615 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-10-20T23:19:07.627 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-10-20T23:19:07.627 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-10-20T23:19:07.628 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-10-20T23:19:07.647 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:07.647 INFO:tasks.ceph:role: osd.0 2021-10-20T23:19:07.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2021-10-20T23:19:07.648 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-10-20T23:19:08.173 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-10-20T23:19:08.173 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-20T23:19:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-20T23:19:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2021-10-20T23:19:08.174 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-20T23:19:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2021-10-20T23:19:08.175 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-20T23:19:08.175 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-20T23:19:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-20T23:19:08.176 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-20T23:19:08.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2021-10-20T23:19:08.177 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-10-20T23:19:08.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-10-20T23:19:08.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:19:08.283 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2021-10-20T23:19:08.284 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-10-20T23:19:08.296 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:08.297 INFO:tasks.ceph:role: osd.1 2021-10-20T23:19:08.297 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2021-10-20T23:19:08.297 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-10-20T23:19:08.846 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-10-20T23:19:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-20T23:19:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-20T23:19:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2021-10-20T23:19:08.862 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-20T23:19:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2021-10-20T23:19:08.863 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-20T23:19:08.863 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-20T23:19:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-20T23:19:08.864 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-20T23:19:08.865 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2021-10-20T23:19:08.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-10-20T23:19:08.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-10-20T23:19:08.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:19:08.918 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2021-10-20T23:19:08.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-10-20T23:19:08.980 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:08.981 INFO:tasks.ceph:role: osd.2 2021-10-20T23:19:08.981 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2021-10-20T23:19:08.981 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-10-20T23:19:09.448 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-10-20T23:19:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-20T23:19:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-20T23:19:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2021-10-20T23:19:09.450 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-20T23:19:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2021-10-20T23:19:09.450 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-20T23:19:09.456 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-20T23:19:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-20T23:19:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-20T23:19:09.459 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2021-10-20T23:19:09.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-10-20T23:19:09.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-10-20T23:19:09.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:19:09.530 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2021-10-20T23:19:09.530 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-10-20T23:19:09.547 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:09.547 INFO:tasks.ceph:role: osd.3 2021-10-20T23:19:09.548 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2021-10-20T23:19:09.548 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-10-20T23:19:10.108 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-10-20T23:19:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-20T23:19:10.109 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-20T23:19:10.109 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2021-10-20T23:19:10.109 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-20T23:19:10.109 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2021-10-20T23:19:10.110 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-20T23:19:10.110 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-20T23:19:10.110 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-20T23:19:10.115 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-20T23:19:10.116 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2021-10-20T23:19:10.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-10-20T23:19:10.177 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-10-20T23:19:10.190 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2021-10-20T23:19:10.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:19:10.193 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:10.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:10.300+0000 7eff2d23ad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-10-20T23:19:10.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:10.304+0000 7eff2d23ad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-10-20T23:19:10.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:10.304+0000 7eff2d23ad80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-10-20T23:19:10.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:10.304+0000 7eff2d23ad80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-10-20T23:19:10.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:10.304+0000 7eff2d23ad80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-10-20T23:19:10.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:10.312+0000 7eff2d23ad80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-10-20T23:19:10.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:10.340+0000 7eff2d23ad80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-10-20T23:19:12.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-10-20T23:19:12.803 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:12.876+0000 7fe83d7c5d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-10-20T23:19:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:12.876+0000 7fe83d7c5d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-10-20T23:19:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:12.876+0000 7fe83d7c5d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-10-20T23:19:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:12.876+0000 7fe83d7c5d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-10-20T23:19:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:12.876+0000 7fe83d7c5d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-10-20T23:19:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:12.880+0000 7fe83d7c5d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-10-20T23:19:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:12.900+0000 7fe83d7c5d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-10-20T23:19:15.362 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-10-20T23:19:15.379 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:15.408+0000 7fa76e86cd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-10-20T23:19:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:15.408+0000 7fa76e86cd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-10-20T23:19:15.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:15.408+0000 7fa76e86cd80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-10-20T23:19:15.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:15.408+0000 7fa76e86cd80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-10-20T23:19:15.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:15.408+0000 7fa76e86cd80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-10-20T23:19:15.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:15.408+0000 7fa76e86cd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-10-20T23:19:15.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:15.428+0000 7fa76e86cd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-10-20T23:19:17.861 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-10-20T23:19:17.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:17.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:17.948+0000 7f7d4b246d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-10-20T23:19:17.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:17.948+0000 7f7d4b246d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-10-20T23:19:17.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:17.948+0000 7f7d4b246d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-10-20T23:19:17.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:17.948+0000 7f7d4b246d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-10-20T23:19:17.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:17.948+0000 7f7d4b246d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-10-20T23:19:17.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:17.952+0000 7f7d4b246d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-10-20T23:19:17.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:17.972+0000 7f7d4b246d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-10-20T23:19:20.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-10-20T23:19:20.458 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-10-20T23:19:20.476 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:20.477 INFO:tasks.ceph:role: osd.4 2021-10-20T23:19:20.477 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2021-10-20T23:19:20.477 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-10-20T23:19:21.042 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-10-20T23:19:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-20T23:19:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-20T23:19:21.043 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2021-10-20T23:19:21.043 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-20T23:19:21.043 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2021-10-20T23:19:21.043 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-20T23:19:21.044 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-20T23:19:21.044 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-20T23:19:21.046 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-20T23:19:21.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2021-10-20T23:19:21.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-10-20T23:19:21.129 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-10-20T23:19:21.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:19:21.144 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2021-10-20T23:19:21.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-10-20T23:19:21.199 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:21.199 INFO:tasks.ceph:role: osd.5 2021-10-20T23:19:21.200 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2021-10-20T23:19:21.200 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-10-20T23:19:21.704 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-10-20T23:19:21.705 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-20T23:19:21.705 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-20T23:19:21.705 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2021-10-20T23:19:21.705 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-20T23:19:21.706 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2021-10-20T23:19:21.706 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-20T23:19:21.706 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-20T23:19:21.706 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-20T23:19:21.706 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-20T23:19:21.708 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2021-10-20T23:19:21.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-10-20T23:19:21.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-10-20T23:19:21.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:19:21.801 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2021-10-20T23:19:21.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-10-20T23:19:21.818 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:21.819 INFO:tasks.ceph:role: osd.6 2021-10-20T23:19:21.819 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2021-10-20T23:19:21.820 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-10-20T23:19:22.330 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-10-20T23:19:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-20T23:19:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-20T23:19:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2021-10-20T23:19:22.331 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-20T23:19:22.332 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2021-10-20T23:19:22.332 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-20T23:19:22.332 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-20T23:19:22.332 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-20T23:19:22.333 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-20T23:19:22.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2021-10-20T23:19:22.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-10-20T23:19:22.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-10-20T23:19:22.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:19:22.399 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2021-10-20T23:19:22.400 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-10-20T23:19:22.456 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-20T23:19:22.457 INFO:tasks.ceph:role: osd.7 2021-10-20T23:19:22.457 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2021-10-20T23:19:22.458 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-10-20T23:19:22.946 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-10-20T23:19:22.946 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-20T23:19:22.946 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-20T23:19:22.947 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2021-10-20T23:19:22.947 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-20T23:19:22.947 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2021-10-20T23:19:22.947 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-20T23:19:22.948 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-20T23:19:22.948 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-20T23:19:22.948 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-20T23:19:22.949 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2021-10-20T23:19:22.949 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-10-20T23:19:23.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-10-20T23:19:23.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:19:23.020 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2021-10-20T23:19:23.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:23.104 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:23.098+0000 7f5995bbad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-10-20T23:19:23.105 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:23.102+0000 7f5995bbad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-10-20T23:19:23.105 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:23.102+0000 7f5995bbad80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-10-20T23:19:23.106 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:23.102+0000 7f5995bbad80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-10-20T23:19:23.106 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:23.102+0000 7f5995bbad80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-10-20T23:19:23.113 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:23.110+0000 7f5995bbad80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-10-20T23:19:23.140 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:23.134+0000 7f5995bbad80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-10-20T23:19:25.585 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-10-20T23:19:25.601 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:25.686 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:25.678+0000 7fe4102f1d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-10-20T23:19:25.686 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:25.682+0000 7fe4102f1d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-10-20T23:19:25.687 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:25.682+0000 7fe4102f1d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-10-20T23:19:25.687 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:25.682+0000 7fe4102f1d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-10-20T23:19:25.687 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:25.682+0000 7fe4102f1d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-10-20T23:19:25.687 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:25.682+0000 7fe4102f1d80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-10-20T23:19:25.706 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:25.702+0000 7fe4102f1d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-10-20T23:19:28.148 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-10-20T23:19:28.166 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:28.250 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:28.242+0000 7f484fd4cd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-10-20T23:19:28.250 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:28.242+0000 7f484fd4cd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-10-20T23:19:28.251 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:28.242+0000 7f484fd4cd80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-10-20T23:19:28.251 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:28.242+0000 7f484fd4cd80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-10-20T23:19:28.254 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:28.242+0000 7f484fd4cd80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-10-20T23:19:28.255 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:28.246+0000 7f484fd4cd80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-10-20T23:19:28.268 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:28.262+0000 7f484fd4cd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-10-20T23:19:30.699 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-10-20T23:19:30.714 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:30.750+0000 7f52925dbd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-10-20T23:19:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:30.754+0000 7f52925dbd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-10-20T23:19:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:30.754+0000 7f52925dbd80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-10-20T23:19:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:30.754+0000 7f52925dbd80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-10-20T23:19:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:30.754+0000 7f52925dbd80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-10-20T23:19:30.759 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:30.754+0000 7f52925dbd80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-10-20T23:19:30.776 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:30.770+0000 7f52925dbd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-10-20T23:19:33.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-10-20T23:19:33.225 INFO:tasks.ceph:Reading keys from all nodes... 2021-10-20T23:19:33.226 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:33.235 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.XFIxGw4r0p 2021-10-20T23:19:33.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.XFIxGw4r0p 2021-10-20T23:19:33.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.XFIxGw4r0p 2021-10-20T23:19:33.317 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.XFIxGw4r0p is 56B 2021-10-20T23:19:33.331 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.XFIxGw4r0p 2021-10-20T23:19:33.338 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.eHFMnQ83y9 2021-10-20T23:19:33.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.eHFMnQ83y9 2021-10-20T23:19:33.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.eHFMnQ83y9 2021-10-20T23:19:33.480 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.eHFMnQ83y9 is 56B 2021-10-20T23:19:33.496 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.eHFMnQ83y9 2021-10-20T23:19:33.506 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:33.562 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.Jo9XANP3pU 2021-10-20T23:19:33.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.Jo9XANP3pU 2021-10-20T23:19:33.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.Jo9XANP3pU 2021-10-20T23:19:33.658 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.Jo9XANP3pU is 56B 2021-10-20T23:19:33.674 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.Jo9XANP3pU 2021-10-20T23:19:33.681 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:33.729 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.6A9cMppQ47 2021-10-20T23:19:33.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.6A9cMppQ47 2021-10-20T23:19:33.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.6A9cMppQ47 2021-10-20T23:19:33.811 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.6A9cMppQ47 is 56B 2021-10-20T23:19:33.826 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.6A9cMppQ47 2021-10-20T23:19:33.834 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:33.881 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.WgJj7s9JSB 2021-10-20T23:19:33.882 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.WgJj7s9JSB 2021-10-20T23:19:33.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.WgJj7s9JSB 2021-10-20T23:19:33.965 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.WgJj7s9JSB is 56B 2021-10-20T23:19:33.980 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.WgJj7s9JSB 2021-10-20T23:19:33.988 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:34.039 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.tZArKITQnj 2021-10-20T23:19:34.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.tZArKITQnj 2021-10-20T23:19:34.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.tZArKITQnj 2021-10-20T23:19:34.120 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.tZArKITQnj is 56B 2021-10-20T23:19:34.136 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.tZArKITQnj 2021-10-20T23:19:34.143 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:34.189 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.hatXtMzNE4 2021-10-20T23:19:34.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.hatXtMzNE4 2021-10-20T23:19:34.258 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.hatXtMzNE4 2021-10-20T23:19:34.326 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.hatXtMzNE4 is 56B 2021-10-20T23:19:34.341 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.hatXtMzNE4 2021-10-20T23:19:34.347 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:34.354 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.HsDQsQLV2H 2021-10-20T23:19:34.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.HsDQsQLV2H 2021-10-20T23:19:34.372 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.HsDQsQLV2H 2021-10-20T23:19:34.441 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.HsDQsQLV2H is 56B 2021-10-20T23:19:34.455 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.HsDQsQLV2H 2021-10-20T23:19:34.462 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:34.511 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.lGLit99WtD 2021-10-20T23:19:34.511 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.lGLit99WtD 2021-10-20T23:19:34.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.lGLit99WtD 2021-10-20T23:19:34.596 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.lGLit99WtD is 56B 2021-10-20T23:19:34.613 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.lGLit99WtD 2021-10-20T23:19:34.620 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:34.667 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.p64Vg2tvs4 2021-10-20T23:19:34.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.p64Vg2tvs4 2021-10-20T23:19:34.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.p64Vg2tvs4 2021-10-20T23:19:34.705 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.p64Vg2tvs4 is 56B 2021-10-20T23:19:34.720 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.p64Vg2tvs4 2021-10-20T23:19:34.727 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:34.775 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.GJdDmDa2fR 2021-10-20T23:19:34.776 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.GJdDmDa2fR 2021-10-20T23:19:34.791 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.GJdDmDa2fR 2021-10-20T23:19:34.857 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.GJdDmDa2fR is 56B 2021-10-20T23:19:34.871 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.GJdDmDa2fR 2021-10-20T23:19:34.878 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:34.927 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.C4iIbNYVQf 2021-10-20T23:19:34.927 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.C4iIbNYVQf 2021-10-20T23:19:34.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.C4iIbNYVQf 2021-10-20T23:19:35.014 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.C4iIbNYVQf is 56B 2021-10-20T23:19:35.035 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.C4iIbNYVQf 2021-10-20T23:19:35.044 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:35.091 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.Sg6lF6JbwN 2021-10-20T23:19:35.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.Sg6lF6JbwN 2021-10-20T23:19:35.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.Sg6lF6JbwN 2021-10-20T23:19:35.181 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.Sg6lF6JbwN is 56B 2021-10-20T23:19:35.197 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.Sg6lF6JbwN 2021-10-20T23:19:35.216 DEBUG:teuthology.orchestra.remote:smithi119:/etc/ceph/ceph.client.0.keyring is 59B 2021-10-20T23:19:35.283 DEBUG:teuthology.orchestra.remote:smithi136:/etc/ceph/ceph.client.1.keyring is 59B 2021-10-20T23:19:35.299 INFO:tasks.ceph:Adding keys to all mons... 2021-10-20T23:19:35.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2021-10-20T23:19:35.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2021-10-20T23:19:35.316 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2021-10-20T23:19:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ== 2021-10-20T23:19:35.317 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2021-10-20T23:19:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q== 2021-10-20T23:19:35.317 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2021-10-20T23:19:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw== 2021-10-20T23:19:35.318 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2021-10-20T23:19:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA== 2021-10-20T23:19:35.318 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2021-10-20T23:19:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw== 2021-10-20T23:19:35.319 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2021-10-20T23:19:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ== 2021-10-20T23:19:35.320 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2021-10-20T23:19:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg== 2021-10-20T23:19:35.320 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2021-10-20T23:19:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg== 2021-10-20T23:19:35.321 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2021-10-20T23:19:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ== 2021-10-20T23:19:35.322 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2021-10-20T23:19:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q== 2021-10-20T23:19:35.322 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2021-10-20T23:19:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw== 2021-10-20T23:19:35.323 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2021-10-20T23:19:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw== 2021-10-20T23:19:35.324 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2021-10-20T23:19:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg== 2021-10-20T23:19:35.324 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2021-10-20T23:19:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg== 2021-10-20T23:19:35.325 INFO:teuthology.orchestra.run.smithi012.stdout:[client.1] 2021-10-20T23:19:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A== 2021-10-20T23:19:35.328 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2021-10-20T23:19:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ== 2021-10-20T23:19:35.329 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2021-10-20T23:19:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q== 2021-10-20T23:19:35.329 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2021-10-20T23:19:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw== 2021-10-20T23:19:35.330 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2021-10-20T23:19:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA== 2021-10-20T23:19:35.330 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2021-10-20T23:19:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw== 2021-10-20T23:19:35.331 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2021-10-20T23:19:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ== 2021-10-20T23:19:35.331 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2021-10-20T23:19:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg== 2021-10-20T23:19:35.332 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2021-10-20T23:19:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg== 2021-10-20T23:19:35.332 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2021-10-20T23:19:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ== 2021-10-20T23:19:35.332 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2021-10-20T23:19:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q== 2021-10-20T23:19:35.333 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2021-10-20T23:19:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw== 2021-10-20T23:19:35.333 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2021-10-20T23:19:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw== 2021-10-20T23:19:35.334 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2021-10-20T23:19:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg== 2021-10-20T23:19:35.334 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2021-10-20T23:19:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg== 2021-10-20T23:19:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2021-10-20T23:19:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A== 2021-10-20T23:19:35.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-10-20T23:19:35.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-10-20T23:19:35.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-20T23:19:35.425 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-20T23:19:35.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-20T23:19:35.475 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-20T23:19:35.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:35.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:35.602 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:35.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:35.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:35.692 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:35.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:35.784 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:35.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-10-20T23:19:35.831 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-10-20T23:19:35.873 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-20T23:19:35.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-20T23:19:35.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:19:35.922 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:19:35.924 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:19:35.928 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:19:35.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:35.963 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:36.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:36.077 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:36.122 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:36.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:36.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:36.168 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-20T23:19:36.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-20T23:19:36.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-20T23:19:36.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-20T23:19:36.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-20T23:19:36.386 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-10-20T23:19:36.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-10-20T23:19:36.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-10-20T23:19:36.464 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-10-20T23:19:36.480 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-10-20T23:19:36.499 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-10-20T23:19:36.553 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-10-20T23:19:36.566 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-10-20T23:19:36.583 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-10-20T23:19:36.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-10-20T23:19:36.671 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:36.673 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-10-20T23:19:36.678 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-10-20T23:19:36.679 INFO:tasks.ceph.mon.a:Restarting daemon 2021-10-20T23:19:36.680 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-10-20T23:19:36.682 INFO:tasks.ceph.mon.a:Started 2021-10-20T23:19:36.683 INFO:tasks.ceph.mon.b:Restarting daemon 2021-10-20T23:19:36.683 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-10-20T23:19:36.722 INFO:tasks.ceph.mon.b:Started 2021-10-20T23:19:36.723 INFO:tasks.ceph.mon.c:Restarting daemon 2021-10-20T23:19:36.723 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-10-20T23:19:36.726 INFO:tasks.ceph.mon.c:Started 2021-10-20T23:19:36.726 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-10-20T23:19:36.727 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-10-20T23:19:36.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-10-20T23:19:36.730 INFO:tasks.ceph.mgr.y:Started 2021-10-20T23:19:36.731 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-10-20T23:19:36.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-10-20T23:19:36.734 INFO:tasks.ceph.mgr.x:Started 2021-10-20T23:19:36.735 INFO:tasks.ceph:Setting crush tunables to default 2021-10-20T23:19:36.735 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2021-10-20T23:19:36.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb748ba700 1 Processor -- start 2021-10-20T23:19:36.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb748ba700 1 -- start start 2021-10-20T23:19:36.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb748ba700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb70146950 0x7ffb70140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:36.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb748ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 0x7ffb70140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:36.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb748ba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 0x7ffb700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:36.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb748ba700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb70147510 con 0x7ffb70146950 2021-10-20T23:19:36.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb748ba700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb70143b60 con 0x7ffb700b4690 2021-10-20T23:19:36.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb748ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70143e00 con 0x7ffb700b4180 2021-10-20T23:19:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb70146950 0x7ffb70140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb70146950 0x7ffb70140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36070/0 (socket says 172.21.15.12:36070) 2021-10-20T23:19:36.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6e59c700 1 -- 172.21.15.12:0/3213738314 learned_addr learned my addr 172.21.15.12:0/3213738314 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:36.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6e59c700 1 -- 172.21.15.12:0/3213738314 >> v2:172.21.15.12:3300/0 conn(0x7ffb70146950 msgr2=0x7ffb70140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-10-20T23:19:36.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6e59c700 1 -- 172.21.15.12:0/3213738314 >> v2:172.21.15.12:3300/0 conn(0x7ffb70146950 msgr2=0x7ffb70140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-10-20T23:19:36.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6e59c700 1 --2- 172.21.15.12:0/3213738314 >> v2:172.21.15.12:3300/0 conn(0x7ffb70146950 0x7ffb70140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-10-20T23:19:36.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb67fff700 1 --2- 172.21.15.12:0/3213738314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 0x7ffb70140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:36.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6e59c700 1 --2- 172.21.15.12:0/3213738314 >> v2:172.21.15.12:3300/0 conn(0x7ffb70146950 0x7ffb70140230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-10-20T23:19:36.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6ed9d700 1 --2- 172.21.15.12:0/3213738314 >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 0x7ffb700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:36.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb67fff700 1 -- 172.21.15.12:0/3213738314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 msgr2=0x7ffb70140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-10-20T23:19:36.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb67fff700 1 -- 172.21.15.12:0/3213738314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 msgr2=0x7ffb70140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-10-20T23:19:36.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb67fff700 1 --2- 172.21.15.12:0/3213738314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 0x7ffb70140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-10-20T23:19:36.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6ed9d700 1 -- 172.21.15.12:0/3213738314 >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 msgr2=0x7ffb700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-10-20T23:19:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb67fff700 1 --2- 172.21.15.12:0/3213738314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 0x7ffb70140720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-10-20T23:19:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6ed9d700 1 -- 172.21.15.12:0/3213738314 >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 msgr2=0x7ffb700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-10-20T23:19:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6ed9d700 1 --2- 172.21.15.12:0/3213738314 >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 0x7ffb700b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-10-20T23:19:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:36.848+0000 7ffb6ed9d700 1 --2- 172.21.15.12:0/3213738314 >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 0x7ffb700b4ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-10-20T23:19:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6e59c700 1 --2- 172.21.15.12:0/3213738314 >> v2:172.21.15.12:3300/0 conn(0x7ffb70146950 0x7ffb70140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6ed9d700 1 --2- 172.21.15.12:0/3213738314 >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 0x7ffb700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb67fff700 1 --2- 172.21.15.12:0/3213738314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 0x7ffb70140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6e59c700 1 -- 172.21.15.12:0/3213738314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 msgr2=0x7ffb70140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6e59c700 1 --2- 172.21.15.12:0/3213738314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 0x7ffb70140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6e59c700 1 -- 172.21.15.12:0/3213738314 >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 msgr2=0x7ffb700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6e59c700 1 --2- 172.21.15.12:0/3213738314 >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 0x7ffb700b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6e59c700 1 -- 172.21.15.12:0/3213738314 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700b0c90 con 0x7ffb70146950 2021-10-20T23:19:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6e59c700 1 --2- 172.21.15.12:0/3213738314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb70146950 0x7ffb70140230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ffb60000e90 tx=0x7ffb60008040).ready entity=mon.0 client_cookie=5a277c9ec430c609 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6dd9b700 1 -- 172.21.15.12:0/3213738314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb600106e0 con 0x7ffb70146950 2021-10-20T23:19:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6dd9b700 1 -- 172.21.15.12:0/3213738314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb60010840 con 0x7ffb70146950 2021-10-20T23:19:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb6dd9b700 1 -- 172.21.15.12:0/3213738314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb60010ba0 con 0x7ffb70146950 2021-10-20T23:19:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb748ba700 1 -- 172.21.15.12:0/3213738314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb70146950 msgr2=0x7ffb70140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb748ba700 1 --2- 172.21.15.12:0/3213738314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb70146950 0x7ffb70140230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ffb60000e90 tx=0x7ffb60008040).stop 2021-10-20T23:19:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb748ba700 1 -- 172.21.15.12:0/3213738314 shutdown_connections 2021-10-20T23:19:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb748ba700 1 --2- 172.21.15.12:0/3213738314 >> v2:172.21.15.31:3300/0 conn(0x7ffb700b4690 0x7ffb700b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb748ba700 1 --2- 172.21.15.12:0/3213738314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b4180 0x7ffb70140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb748ba700 1 --2- 172.21.15.12:0/3213738314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb70146950 0x7ffb70140230 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.052+0000 7ffb748ba700 1 -- 172.21.15.12:0/3213738314 >> 172.21.15.12:0/3213738314 conn(0x7ffb7005c490 msgr2=0x7ffb7005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:37.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.056+0000 7ffb748ba700 1 -- 172.21.15.12:0/3213738314 shutdown_connections 2021-10-20T23:19:37.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.056+0000 7ffb748ba700 1 -- 172.21.15.12:0/3213738314 wait complete. 2021-10-20T23:19:37.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.056+0000 7ffb748ba700 1 Processor -- start 2021-10-20T23:19:37.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.056+0000 7ffb748ba700 1 -- start start 2021-10-20T23:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb748ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b4180 0x7ffb700b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb748ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb700b4690 0x7ffb700b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:37.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb748ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb70146950 0x7ffb7013f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:37.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb748ba700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70142950 con 0x7ffb700b4690 2021-10-20T23:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb748ba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700aeb00 con 0x7ffb700b4180 2021-10-20T23:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb748ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70142210 con 0x7ffb70146950 2021-10-20T23:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb67fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb700b4690 0x7ffb700b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb67fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb700b4690 0x7ffb700b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36092/0 (socket says 172.21.15.12:36092) 2021-10-20T23:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb6ed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb70146950 0x7ffb7013f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb67fff700 1 -- 172.21.15.12:0/4008091468 learned_addr learned my addr 172.21.15.12:0/4008091468 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:37.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb6e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b4180 0x7ffb700b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:37.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb6ed9d700 1 -- 172.21.15.12:0/4008091468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b4180 msgr2=0x7ffb700b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:37.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb6ed9d700 1 --2- 172.21.15.12:0/4008091468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b4180 0x7ffb700b8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb6ed9d700 1 -- 172.21.15.12:0/4008091468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb700b4690 msgr2=0x7ffb700b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:37.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb6ed9d700 1 --2- 172.21.15.12:0/4008091468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb700b4690 0x7ffb700b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb6ed9d700 1 -- 172.21.15.12:0/4008091468 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6000e040 con 0x7ffb70146950 2021-10-20T23:19:37.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb6ed9d700 1 --2- 172.21.15.12:0/4008091468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb70146950 0x7ffb7013f0d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ffb700aff50 tx=0x7ffb68008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:37.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb677fe700 1 -- 172.21.15.12:0/4008091468 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb68010820 con 0x7ffb70146950 2021-10-20T23:19:37.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb677fe700 1 -- 172.21.15.12:0/4008091468 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68010980 con 0x7ffb70146950 2021-10-20T23:19:37.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb748ba700 1 -- 172.21.15.12:0/4008091468 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb701424b0 con 0x7ffb70146950 2021-10-20T23:19:37.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb677fe700 1 -- 172.21.15.12:0/4008091468 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb68010ce0 con 0x7ffb70146950 2021-10-20T23:19:37.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb748ba700 1 -- 172.21.15.12:0/4008091468 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb700b8bf0 con 0x7ffb70146950 2021-10-20T23:19:37.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb677fe700 1 -- 172.21.15.12:0/4008091468 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7ffb68012040 con 0x7ffb70146950 2021-10-20T23:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.060+0000 7ffb677fe700 1 -- 172.21.15.12:0/4008091468 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ffb68006390 con 0x7ffb70146950 2021-10-20T23:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.064+0000 7ffb748ba700 1 -- 172.21.15.12:0/4008091468 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb70142640 con 0x7ffb70146950 2021-10-20T23:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.064+0000 7ffb677fe700 1 -- 172.21.15.12:0/4008091468 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ffb6800f040 con 0x7ffb70146950 2021-10-20T23:19:37.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.132+0000 7ffb748ba700 1 -- 172.21.15.12:0/4008091468 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ffb70057350 con 0x7ffb70146950 2021-10-20T23:19:37.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb677fe700 1 -- 172.21.15.12:0/4008091468 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ffb680065d0 con 0x7ffb70146950 2021-10-20T23:19:37.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb748ba700 1 -- 172.21.15.12:0/4008091468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb70146950 msgr2=0x7ffb7013f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:37.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb748ba700 1 --2- 172.21.15.12:0/4008091468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb70146950 0x7ffb7013f0d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ffb700aff50 tx=0x7ffb68008040).stop 2021-10-20T23:19:37.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb748ba700 1 -- 172.21.15.12:0/4008091468 shutdown_connections 2021-10-20T23:19:37.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb748ba700 1 --2- 172.21.15.12:0/4008091468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb70146950 0x7ffb7013f0d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb748ba700 1 --2- 172.21.15.12:0/4008091468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb700b4690 0x7ffb700b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb748ba700 1 --2- 172.21.15.12:0/4008091468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b4180 0x7ffb700b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:37.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb748ba700 1 -- 172.21.15.12:0/4008091468 >> 172.21.15.12:0/4008091468 conn(0x7ffb7005c490 msgr2=0x7ffb700b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:37.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb748ba700 1 -- 172.21.15.12:0/4008091468 shutdown_connections 2021-10-20T23:19:37.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:37.144+0000 7ffb748ba700 1 -- 172.21.15.12:0/4008091468 wait complete. 2021-10-20T23:19:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2021-10-20T23:19:37.168 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-10-20T23:19:37.169 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:37.176 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.B2qB6Edwhn 2021-10-20T23:19:37.177 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.B2qB6Edwhn 2021-10-20T23:19:37.191 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.B2qB6Edwhn 2021-10-20T23:19:37.260 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.B2qB6Edwhn is 37B 2021-10-20T23:19:37.276 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.B2qB6Edwhn 2021-10-20T23:19:37.285 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:37.334 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.QmcFAXbGhV 2021-10-20T23:19:37.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.QmcFAXbGhV 2021-10-20T23:19:37.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.QmcFAXbGhV 2021-10-20T23:19:37.372 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.QmcFAXbGhV is 37B 2021-10-20T23:19:37.389 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.QmcFAXbGhV 2021-10-20T23:19:37.397 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:37.445 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.pv11Nq0ddc 2021-10-20T23:19:37.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.pv11Nq0ddc 2021-10-20T23:19:37.459 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.pv11Nq0ddc 2021-10-20T23:19:37.523 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.pv11Nq0ddc is 37B 2021-10-20T23:19:37.538 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.pv11Nq0ddc 2021-10-20T23:19:37.544 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-20T23:19:37.597 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.KOuqerFu1P 2021-10-20T23:19:37.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.KOuqerFu1P 2021-10-20T23:19:37.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.KOuqerFu1P 2021-10-20T23:19:37.682 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.KOuqerFu1P is 37B 2021-10-20T23:19:37.697 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.KOuqerFu1P 2021-10-20T23:19:37.703 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:37.710 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.6n26llHIbB 2021-10-20T23:19:37.711 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.6n26llHIbB 2021-10-20T23:19:37.769 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.6n26llHIbB 2021-10-20T23:19:37.787 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.6n26llHIbB is 37B 2021-10-20T23:19:37.799 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.6n26llHIbB 2021-10-20T23:19:37.804 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:37.851 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.349nUG9xhn 2021-10-20T23:19:37.851 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.349nUG9xhn 2021-10-20T23:19:37.870 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.349nUG9xhn 2021-10-20T23:19:37.932 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.349nUG9xhn is 37B 2021-10-20T23:19:37.948 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.349nUG9xhn 2021-10-20T23:19:37.955 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:38.003 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.yB48Ms5Vxa 2021-10-20T23:19:38.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.yB48Ms5Vxa 2021-10-20T23:19:38.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.yB48Ms5Vxa 2021-10-20T23:19:38.041 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.yB48Ms5Vxa is 37B 2021-10-20T23:19:38.052 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.yB48Ms5Vxa 2021-10-20T23:19:38.059 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-20T23:19:38.107 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.CTGE8VJW0Z 2021-10-20T23:19:38.107 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.CTGE8VJW0Z 2021-10-20T23:19:38.120 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.CTGE8VJW0Z 2021-10-20T23:19:38.184 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.CTGE8VJW0Z is 37B 2021-10-20T23:19:38.199 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.CTGE8VJW0Z 2021-10-20T23:19:38.206 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 55fdd305-1085-4e58-afe8-69a6e5889a50 0 2021-10-20T23:19:38.359 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.353+0000 7f9f611c8700 1 Processor -- start 2021-10-20T23:19:38.359 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.353+0000 7f9f611c8700 1 -- start start 2021-10-20T23:19:38.362 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.353+0000 7f9f611c8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b56c0 0x7f9f5c0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.353+0000 7f9f611c8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c0ad810 con 0x7f9f5c0b15e0 2021-10-20T23:19:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f611c8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c0adab0 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f611c8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0add50 con 0x7f9f5c0b56c0 2021-10-20T23:19:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f5ad9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9f5c0b29c0 0x7f9f5c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56310/0 (socket says 172.21.15.31:56310) 2021-10-20T23:19:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f5ad9d700 1 -- 172.21.15.31:0/1760155532 learned_addr learned my addr 172.21.15.31:0/1760155532 (peer_addr_for_me v1:172.21.15.31:0/0) 2021-10-20T23:19:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f5b59e700 1 --2- 172.21.15.31:0/1760155532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b56c0 0x7f9f5c0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f59d9b700 1 -- 172.21.15.31:0/1760155532 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481232256 0 0) 0x7f9f5c0adab0 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f59d9b700 1 -- 172.21.15.31:0/1760155532 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f40003260 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f5b59e700 1 -- 172.21.15.31:0/1760155532 >> v1:172.21.15.31:6789/0 conn(0x7f9f5c0b29c0 legacy=0x7f9f5c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f5b59e700 1 -- 172.21.15.31:0/1760155532 >> v1:172.21.15.12:6789/0 conn(0x7f9f5c0b15e0 legacy=0x7f9f5c1434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f59d9b700 1 -- 172.21.15.31:0/1760155532 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559107838 0 0) 0x7f9f5c0ad810 con 0x7f9f5c0b15e0 2021-10-20T23:19:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f5b59e700 1 -- 172.21.15.31:0/1760155532 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0adff0 con 0x7f9f5c0b56c0 2021-10-20T23:19:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f5b59e700 1 --2- 172.21.15.31:0/1760155532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b56c0 0x7f9f5c0afe30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9f540032f0 tx=0x7f9f540091d0).ready entity=mon.2 client_cookie=add8e139bbf446a2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:38.366 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f59d9b700 1 -- 172.21.15.31:0/1760155532 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5400b6c0 con 0x7f9f5c0b56c0 2021-10-20T23:19:38.366 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f59d9b700 1 -- 172.21.15.31:0/1760155532 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5400b820 con 0x7f9f5c0b56c0 2021-10-20T23:19:38.366 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f59d9b700 1 -- 172.21.15.31:0/1760155532 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5400b990 con 0x7f9f5c0b56c0 2021-10-20T23:19:38.370 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f611c8700 1 -- 172.21.15.31:0/1760155532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b56c0 msgr2=0x7f9f5c0afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.370 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f611c8700 1 --2- 172.21.15.31:0/1760155532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b56c0 0x7f9f5c0afe30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9f540032f0 tx=0x7f9f540091d0).stop 2021-10-20T23:19:38.370 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f611c8700 1 -- 172.21.15.31:0/1760155532 shutdown_connections 2021-10-20T23:19:38.370 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f611c8700 1 --2- 172.21.15.31:0/1760155532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b56c0 0x7f9f5c0afe30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f611c8700 1 -- 172.21.15.31:0/1760155532 >> 172.21.15.31:0/1760155532 conn(0x7f9f5c06a110 msgr2=0x7f9f5c05cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f611c8700 1 -- 172.21.15.31:0/1760155532 shutdown_connections 2021-10-20T23:19:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.357+0000 7f9f611c8700 1 -- 172.21.15.31:0/1760155532 wait complete. 2021-10-20T23:19:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 Processor -- start 2021-10-20T23:19:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 -- start start 2021-10-20T23:19:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b15e0 0x7f9f5c148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f5c0b29c0 0x7f9f5c1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.373 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f5c0b56c0 0x7f9f5c144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.373 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c145db0 con 0x7f9f5c0b56c0 2021-10-20T23:19:38.373 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c149800 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.373 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c147c20 con 0x7f9f5c0b15e0 2021-10-20T23:19:38.373 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f5c0b29c0 0x7f9f5c1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b15e0 0x7f9f5c148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f5c0b29c0 0x7f9f5c1565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60342/0 (socket says 172.21.15.31:60342) 2021-10-20T23:19:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5a59c700 1 -- 172.21.15.31:0/2153461370 learned_addr learned my addr 172.21.15.31:0/2153461370 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5b59e700 1 --2- 172.21.15.31:0/2153461370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f5c0b56c0 0x7f9f5c144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5a59c700 1 -- 172.21.15.31:0/2153461370 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b15e0 msgr2=0x7f9f5c148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5a59c700 1 --2- 172.21.15.31:0/2153461370 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b15e0 0x7f9f5c148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5a59c700 1 -- 172.21.15.31:0/2153461370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f5c0b56c0 msgr2=0x7f9f5c144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5a59c700 1 --2- 172.21.15.31:0/2153461370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f5c0b56c0 0x7f9f5c144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5a59c700 1 -- 172.21.15.31:0/2153461370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54009470 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5b59e700 1 --2- 172.21.15.31:0/2153461370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f5c0b56c0 0x7f9f5c144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:19:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f5a59c700 1 --2- 172.21.15.31:0/2153461370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f5c0b29c0 0x7f9f5c1565a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9f50000bc0 tx=0x7f9f50007a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f4bfff700 1 -- 172.21.15.31:0/2153461370 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f50012400 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f4bfff700 1 -- 172.21.15.31:0/2153461370 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50012560 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 -- 172.21.15.31:0/2153461370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c155e60 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.377 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f4bfff700 1 -- 172.21.15.31:0/2153461370 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f500128c0 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.377 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 -- 172.21.15.31:0/2153461370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c146fc0 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.377 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f4bfff700 1 -- 172.21.15.31:0/2153461370 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f9f50019030 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.377 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f4bfff700 1 -- 172.21.15.31:0/2153461370 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f9f5001c7b0 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.378 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.361+0000 7f9f611c8700 1 -- 172.21.15.31:0/2153461370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c148030 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.378 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.365+0000 7f9f4bfff700 1 -- 172.21.15.31:0/2153461370 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f9f50017070 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.447 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.437+0000 7f9f611c8700 1 -- 172.21.15.31:0/2153461370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", "id": 0} v 0) v1 -- 0x7f9f5c0b12f0 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.455 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f4bfff700 1 -- 172.21.15.31:0/2153461370 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9f5001c970 con 0x7f9f5c0b29c0 2021-10-20T23:19:38.456 INFO:teuthology.orchestra.run.smithi031.stdout:0 2021-10-20T23:19:38.457 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f611c8700 1 -- 172.21.15.31:0/2153461370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f5c0b29c0 msgr2=0x7f9f5c1565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.457 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f611c8700 1 --2- 172.21.15.31:0/2153461370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f5c0b29c0 0x7f9f5c1565a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9f50000bc0 tx=0x7f9f50007a30).stop 2021-10-20T23:19:38.458 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f611c8700 1 -- 172.21.15.31:0/2153461370 shutdown_connections 2021-10-20T23:19:38.458 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f611c8700 1 --2- 172.21.15.31:0/2153461370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f5c0b56c0 0x7f9f5c144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.458 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f611c8700 1 --2- 172.21.15.31:0/2153461370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f5c0b29c0 0x7f9f5c1565a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.458 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f611c8700 1 --2- 172.21.15.31:0/2153461370 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f5c0b15e0 0x7f9f5c148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.459 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f611c8700 1 -- 172.21.15.31:0/2153461370 >> 172.21.15.31:0/2153461370 conn(0x7f9f5c06a110 msgr2=0x7f9f5c143950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:38.459 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f611c8700 1 -- 172.21.15.31:0/2153461370 shutdown_connections 2021-10-20T23:19:38.459 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.449+0000 7f9f611c8700 1 -- 172.21.15.31:0/2153461370 wait complete. 2021-10-20T23:19:38.470 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 46781b1a-7c1f-4b28-b7f4-95f1ac9cb292 1 2021-10-20T23:19:38.572 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa42ad68700 1 Processor -- start 2021-10-20T23:19:38.572 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa42ad68700 1 -- start start 2021-10-20T23:19:38.575 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa42ad68700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4240619e0 0x7fa424061dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.575 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa42ad68700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4240b3c50 0x7fa4240b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.576 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa42ad68700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa42405f760 0x7fa424143a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.576 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa42ad68700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4240ae9c0 con 0x7fa4240619e0 2021-10-20T23:19:38.576 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa42ad68700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4240601b0 con 0x7fa42405f760 2021-10-20T23:19:38.577 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa42ad68700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42405ff10 con 0x7fa4240b3c50 2021-10-20T23:19:38.577 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa429305700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa42405f760 0x7fa424143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.577 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa423fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4240b3c50 0x7fa4240b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.577 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa429305700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa42405f760 0x7fa424143a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60352/0 (socket says 172.21.15.31:60352) 2021-10-20T23:19:38.577 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa429305700 1 -- 172.21.15.31:0/3008957197 learned_addr learned my addr 172.21.15.31:0/3008957197 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:38.578 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.565+0000 7fa428b04700 1 --2- 172.21.15.31:0/3008957197 >> v2:172.21.15.12:3300/0 conn(0x7fa4240619e0 0x7fa424061dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.578 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa429305700 1 -- 172.21.15.31:0/3008957197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4240b3c50 msgr2=0x7fa4240b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:38.578 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa429305700 1 --2- 172.21.15.31:0/3008957197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4240b3c50 0x7fa4240b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.578 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa429305700 1 -- 172.21.15.31:0/3008957197 >> v2:172.21.15.12:3300/0 conn(0x7fa4240619e0 msgr2=0x7fa424061dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa429305700 1 --2- 172.21.15.31:0/3008957197 >> v2:172.21.15.12:3300/0 conn(0x7fa4240619e0 0x7fa424061dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa429305700 1 -- 172.21.15.31:0/3008957197 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424143320 con 0x7fa42405f760 2021-10-20T23:19:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa429305700 1 --2- 172.21.15.31:0/3008957197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42405f760 0x7fa424143a60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fa41c0032f0 tx=0x7fa41c009290).ready entity=mon.1 client_cookie=ae207a91f41ee401 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa4237fe700 1 -- 172.21.15.31:0/3008957197 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa41c00b680 con 0x7fa42405f760 2021-10-20T23:19:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa4237fe700 1 -- 172.21.15.31:0/3008957197 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c00b7e0 con 0x7fa42405f760 2021-10-20T23:19:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa4237fe700 1 -- 172.21.15.31:0/3008957197 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa41c00b950 con 0x7fa42405f760 2021-10-20T23:19:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 -- 172.21.15.31:0/3008957197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42405f760 msgr2=0x7fa424143a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 --2- 172.21.15.31:0/3008957197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42405f760 0x7fa424143a60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fa41c0032f0 tx=0x7fa41c009290).stop 2021-10-20T23:19:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 -- 172.21.15.31:0/3008957197 shutdown_connections 2021-10-20T23:19:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 --2- 172.21.15.31:0/3008957197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42405f760 0x7fa424143a60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 --2- 172.21.15.31:0/3008957197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4240b3c50 0x7fa4240b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 --2- 172.21.15.31:0/3008957197 >> v2:172.21.15.12:3300/0 conn(0x7fa4240619e0 0x7fa424061dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 -- 172.21.15.31:0/3008957197 >> 172.21.15.31:0/3008957197 conn(0x7fa4240639b0 msgr2=0x7fa424063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 -- 172.21.15.31:0/3008957197 shutdown_connections 2021-10-20T23:19:38.582 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 -- 172.21.15.31:0/3008957197 wait complete. 2021-10-20T23:19:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 Processor -- start 2021-10-20T23:19:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.569+0000 7fa42ad68700 1 -- start start 2021-10-20T23:19:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa42ad68700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa42405f760 0x7fa424142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa42ad68700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4240619e0 0x7fa4240652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa42ad68700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4240b3c50 0x7fa42413e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa42ad68700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4240667b0 con 0x7fa4240b3c50 2021-10-20T23:19:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa42ad68700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa424067400 con 0x7fa4240619e0 2021-10-20T23:19:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa42ad68700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa424144720 con 0x7fa42405f760 2021-10-20T23:19:38.587 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa428b04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa42405f760 0x7fa424142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.590 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa428b04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa42405f760 0x7fa424142bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:41454/0 (socket says 172.21.15.31:41454) 2021-10-20T23:19:38.590 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa428b04700 1 -- 172.21.15.31:0/161096360 learned_addr learned my addr 172.21.15.31:0/161096360 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:38.591 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa423fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4240619e0 0x7fa4240652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.591 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa429305700 1 --2- 172.21.15.31:0/161096360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4240b3c50 0x7fa42413e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.591 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa428b04700 1 -- 172.21.15.31:0/161096360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4240619e0 msgr2=0x7fa4240652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.591 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa428b04700 1 --2- 172.21.15.31:0/161096360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4240619e0 0x7fa4240652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.591 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa428b04700 1 -- 172.21.15.31:0/161096360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4240b3c50 msgr2=0x7fa42413e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.592 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa428b04700 1 --2- 172.21.15.31:0/161096360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4240b3c50 0x7fa42413e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.592 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa428b04700 1 -- 172.21.15.31:0/161096360 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c009530 con 0x7fa42405f760 2021-10-20T23:19:38.592 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa428b04700 1 --2- 172.21.15.31:0/161096360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa42405f760 0x7fa424142bd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa424066390 tx=0x7fa418006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:38.592 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa421ffb700 1 -- 172.21.15.31:0/161096360 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa418010780 con 0x7fa42405f760 2021-10-20T23:19:38.593 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa421ffb700 1 -- 172.21.15.31:0/161096360 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4180108e0 con 0x7fa42405f760 2021-10-20T23:19:38.593 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa42ad68700 1 -- 172.21.15.31:0/161096360 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa424067160 con 0x7fa42405f760 2021-10-20T23:19:38.593 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa421ffb700 1 -- 172.21.15.31:0/161096360 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa418010c40 con 0x7fa42405f760 2021-10-20T23:19:38.593 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa42ad68700 1 -- 172.21.15.31:0/161096360 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4240b60c0 con 0x7fa42405f760 2021-10-20T23:19:38.593 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa421ffb700 1 -- 172.21.15.31:0/161096360 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fa41801c460 con 0x7fa42405f760 2021-10-20T23:19:38.594 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa421ffb700 1 -- 172.21.15.31:0/161096360 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fa4180123f0 con 0x7fa42405f760 2021-10-20T23:19:38.594 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.573+0000 7fa42ad68700 1 -- 172.21.15.31:0/161096360 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa424057350 con 0x7fa42405f760 2021-10-20T23:19:38.594 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.577+0000 7fa421ffb700 1 -- 172.21.15.31:0/161096360 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fa4180125b0 con 0x7fa42405f760 2021-10-20T23:19:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.645+0000 7fa42ad68700 1 -- 172.21.15.31:0/161096360 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", "id": 1} v 0) v1 -- 0x7fa424044650 con 0x7fa42405f760 2021-10-20T23:19:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa421ffb700 1 -- 172.21.15.31:0/161096360 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa418006020 con 0x7fa42405f760 2021-10-20T23:19:38.661 INFO:teuthology.orchestra.run.smithi031.stdout:1 2021-10-20T23:19:38.663 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa42ad68700 1 -- 172.21.15.31:0/161096360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa42405f760 msgr2=0x7fa424142bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa42ad68700 1 --2- 172.21.15.31:0/161096360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa42405f760 0x7fa424142bd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa424066390 tx=0x7fa418006df0).stop 2021-10-20T23:19:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa42ad68700 1 -- 172.21.15.31:0/161096360 shutdown_connections 2021-10-20T23:19:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa42ad68700 1 --2- 172.21.15.31:0/161096360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4240b3c50 0x7fa42413e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa42ad68700 1 --2- 172.21.15.31:0/161096360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4240619e0 0x7fa4240652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa42ad68700 1 --2- 172.21.15.31:0/161096360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa42405f760 0x7fa424142bd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa42ad68700 1 -- 172.21.15.31:0/161096360 >> 172.21.15.31:0/161096360 conn(0x7fa4240639b0 msgr2=0x7fa4240aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa42ad68700 1 -- 172.21.15.31:0/161096360 shutdown_connections 2021-10-20T23:19:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.653+0000 7fa42ad68700 1 -- 172.21.15.31:0/161096360 wait complete. 2021-10-20T23:19:38.671 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 2575330a-a36d-475d-ab15-08d6384ed089 2 2021-10-20T23:19:38.773 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.765+0000 7f1086cfe700 1 Processor -- start 2021-10-20T23:19:38.773 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.765+0000 7f1086cfe700 1 -- start start 2021-10-20T23:19:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f108013dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.777 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f10800b43c0 0x7f108013e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.777 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10800b3ff0 con 0x7f10800af780 2021-10-20T23:19:38.777 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108013ed20 con 0x7f10800b43c0 2021-10-20T23:19:38.777 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108005ca50 con 0x7f10800b0790 2021-10-20T23:19:38.778 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f108013dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.778 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f108529b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f10800b43c0 0x7f108013e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.778 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f108013dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:41464/0 (socket says 172.21.15.31:41464) 2021-10-20T23:19:38.778 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107ffff700 1 -- 172.21.15.31:0/3601665240 learned_addr learned my addr 172.21.15.31:0/3601665240 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:38.778 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107ffff700 1 -- 172.21.15.31:0/3601665240 >> v2:172.21.15.31:3300/0 conn(0x7f10800b43c0 msgr2=0x7f108013e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:38.779 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107ffff700 1 --2- 172.21.15.31:0/3601665240 >> v2:172.21.15.31:3300/0 conn(0x7f10800b43c0 0x7f108013e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.779 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107ffff700 1 -- 172.21.15.31:0/3601665240 >> v1:172.21.15.12:6789/0 conn(0x7f10800af780 legacy=0x7f10800b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.779 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107ffff700 1 -- 172.21.15.31:0/3601665240 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800afb60 con 0x7f10800b0790 2021-10-20T23:19:38.779 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107ffff700 1 --2- 172.21.15.31:0/3601665240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f108013dfa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f106c002f70 tx=0x7f106c006eb0).ready entity=mon.2 client_cookie=74871c8252a6c4ff server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107f7fe700 1 -- 172.21.15.31:0/3601665240 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f106c00d570 con 0x7f10800b0790 2021-10-20T23:19:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107f7fe700 1 -- 172.21.15.31:0/3601665240 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c000e90 con 0x7f10800b0790 2021-10-20T23:19:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f107f7fe700 1 -- 172.21.15.31:0/3601665240 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f106c00d900 con 0x7f10800b0790 2021-10-20T23:19:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 -- 172.21.15.31:0/3601665240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 msgr2=0x7f108013dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 --2- 172.21.15.31:0/3601665240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f108013dfa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f106c002f70 tx=0x7f106c006eb0).stop 2021-10-20T23:19:38.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 -- 172.21.15.31:0/3601665240 shutdown_connections 2021-10-20T23:19:38.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 --2- 172.21.15.31:0/3601665240 >> v2:172.21.15.31:3300/0 conn(0x7f10800b43c0 0x7f108013e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 --2- 172.21.15.31:0/3601665240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f108013dfa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 -- 172.21.15.31:0/3601665240 >> 172.21.15.31:0/3601665240 conn(0x7f108006a110 msgr2=0x7f108005cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:38.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 -- 172.21.15.31:0/3601665240 shutdown_connections 2021-10-20T23:19:38.782 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.769+0000 7f1086cfe700 1 -- 172.21.15.31:0/3601665240 wait complete. 2021-10-20T23:19:38.784 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 Processor -- start 2021-10-20T23:19:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 -- start start 2021-10-20T23:19:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800af780 0x7f1080142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f1080140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.786 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800b43c0 0x7f10801413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.786 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800a0480 con 0x7f10800af780 2021-10-20T23:19:38.786 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800a0720 con 0x7f10800b43c0 2021-10-20T23:19:38.786 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10800a09c0 con 0x7f10800b0790 2021-10-20T23:19:38.787 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f108529b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800b43c0 0x7f10801413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.787 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f107ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f1080140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.787 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f108529b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800b43c0 0x7f10801413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60370/0 (socket says 172.21.15.31:60370) 2021-10-20T23:19:38.787 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f108529b700 1 -- 172.21.15.31:0/3382758647 learned_addr learned my addr 172.21.15.31:0/3382758647 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:38.787 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1084a9a700 1 --2- 172.21.15.31:0/3382758647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800af780 0x7f1080142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f108529b700 1 -- 172.21.15.31:0/3382758647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 msgr2=0x7f1080140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f108529b700 1 --2- 172.21.15.31:0/3382758647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f1080140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f108529b700 1 -- 172.21.15.31:0/3382758647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800af780 msgr2=0x7f1080142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f108529b700 1 --2- 172.21.15.31:0/3382758647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800af780 0x7f1080142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f108529b700 1 -- 172.21.15.31:0/3382758647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c00b1e0 con 0x7f10800b43c0 2021-10-20T23:19:38.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f107ffff700 1 --2- 172.21.15.31:0/3382758647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f1080140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:19:38.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f108529b700 1 --2- 172.21.15.31:0/3382758647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800b43c0 0x7f10801413d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f107800c000 tx=0x7f10780091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:38.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f107dffb700 1 -- 172.21.15.31:0/3382758647 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1078012600 con 0x7f10800b43c0 2021-10-20T23:19:38.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f107dffb700 1 -- 172.21.15.31:0/3382758647 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1078012760 con 0x7f10800b43c0 2021-10-20T23:19:38.790 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 -- 172.21.15.31:0/3382758647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10800a0c60 con 0x7f10800b43c0 2021-10-20T23:19:38.790 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f107dffb700 1 -- 172.21.15.31:0/3382758647 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1078012ac0 con 0x7f10800b43c0 2021-10-20T23:19:38.790 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f1086cfe700 1 -- 172.21.15.31:0/3382758647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1080141a20 con 0x7f10800b43c0 2021-10-20T23:19:38.790 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f107dffb700 1 -- 172.21.15.31:0/3382758647 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f107801b400 con 0x7f10800b43c0 2021-10-20T23:19:38.790 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.773+0000 7f107dffb700 1 -- 172.21.15.31:0/3382758647 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f1078012df0 con 0x7f10800b43c0 2021-10-20T23:19:38.791 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.777+0000 7f1086cfe700 1 -- 172.21.15.31:0/3382758647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1080057350 con 0x7f10800b43c0 2021-10-20T23:19:38.791 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.781+0000 7f107dffb700 1 -- 172.21.15.31:0/3382758647 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f1078038870 con 0x7f10800b43c0 2021-10-20T23:19:38.855 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.849+0000 7f1086cfe700 1 -- 172.21.15.31:0/3382758647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", "id": 2} v 0) v1 -- 0x7f1080044650 con 0x7f10800b43c0 2021-10-20T23:19:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.857+0000 7f107dffb700 1 -- 172.21.15.31:0/3382758647 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1078028030 con 0x7f10800b43c0 2021-10-20T23:19:38.865 INFO:teuthology.orchestra.run.smithi031.stdout:2 2021-10-20T23:19:38.867 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.861+0000 7f1086cfe700 1 -- 172.21.15.31:0/3382758647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800b43c0 msgr2=0x7f10801413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.867 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.861+0000 7f1086cfe700 1 --2- 172.21.15.31:0/3382758647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800b43c0 0x7f10801413d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f107800c000 tx=0x7f10780091d0).stop 2021-10-20T23:19:38.867 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.861+0000 7f1086cfe700 1 -- 172.21.15.31:0/3382758647 shutdown_connections 2021-10-20T23:19:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.861+0000 7f1086cfe700 1 --2- 172.21.15.31:0/3382758647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800b43c0 0x7f10801413d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.861+0000 7f1086cfe700 1 --2- 172.21.15.31:0/3382758647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b0790 0x7f1080140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.861+0000 7f1086cfe700 1 --2- 172.21.15.31:0/3382758647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800af780 0x7f1080142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.861+0000 7f1086cfe700 1 -- 172.21.15.31:0/3382758647 >> 172.21.15.31:0/3382758647 conn(0x7f108006a110 msgr2=0x7f1080143ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:38.869 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.861+0000 7f1086cfe700 1 -- 172.21.15.31:0/3382758647 shutdown_connections 2021-10-20T23:19:38.869 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.861+0000 7f1086cfe700 1 -- 172.21.15.31:0/3382758647 wait complete. 2021-10-20T23:19:38.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new e76967d4-67cc-435f-8c7b-b6e53e98ded9 3 2021-10-20T23:19:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05c012d700 1 Processor -- start 2021-10-20T23:19:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05c012d700 1 -- start start 2021-10-20T23:19:38.978 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05c012d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b813e460 0x7f05b8064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05c012d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05b80b38a0 0x7f05b80b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05c012d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05b80b7a20 0x7f05b8066da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05c012d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b8065fd0 con 0x7f05b80b38a0 2021-10-20T23:19:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05c012d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80653a0 con 0x7f05b80b7a20 2021-10-20T23:19:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05c012d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80b30d0 con 0x7f05b813e460 2021-10-20T23:19:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bdec9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b813e460 0x7f05b8064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05be6ca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05b80b7a20 0x7f05b8066da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05be6ca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05b80b7a20 0x7f05b8066da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60376/0 (socket says 172.21.15.31:60376) 2021-10-20T23:19:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bdec9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b813e460 0x7f05b8064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:41472/0 (socket says 172.21.15.31:41472) 2021-10-20T23:19:38.981 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05be6ca700 1 -- 172.21.15.31:0/1277476668 learned_addr learned my addr 172.21.15.31:0/1277476668 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:38.981 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bd6c8700 1 --2- 172.21.15.31:0/1277476668 >> v2:172.21.15.12:3300/0 conn(0x7f05b80b38a0 0x7f05b80b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.981 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bdec9700 1 -- 172.21.15.31:0/1277476668 >> v2:172.21.15.31:3300/0 conn(0x7f05b80b7a20 msgr2=0x7f05b8066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:38.981 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bdec9700 1 --2- 172.21.15.31:0/1277476668 >> v2:172.21.15.31:3300/0 conn(0x7f05b80b7a20 0x7f05b8066da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.982 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bdec9700 1 -- 172.21.15.31:0/1277476668 >> v2:172.21.15.12:3300/0 conn(0x7f05b80b38a0 msgr2=0x7f05b80b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:38.982 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bdec9700 1 --2- 172.21.15.31:0/1277476668 >> v2:172.21.15.12:3300/0 conn(0x7f05b80b38a0 0x7f05b80b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.982 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bdec9700 1 -- 172.21.15.31:0/1277476668 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8064e60 con 0x7f05b813e460 2021-10-20T23:19:38.982 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bdec9700 1 --2- 172.21.15.31:0/1277476668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b813e460 0x7f05b8064870 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f05b4002f70 tx=0x7f05b4006df0).ready entity=mon.2 client_cookie=486b616be1e6c4c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:38.983 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bcec7700 1 -- 172.21.15.31:0/1277476668 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b400d4a0 con 0x7f05b813e460 2021-10-20T23:19:38.983 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bcec7700 1 -- 172.21.15.31:0/1277476668 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4000e90 con 0x7f05b813e460 2021-10-20T23:19:38.983 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.969+0000 7f05bcec7700 1 -- 172.21.15.31:0/1277476668 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b400d7f0 con 0x7f05b813e460 2021-10-20T23:19:38.983 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- 172.21.15.31:0/1277476668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b813e460 msgr2=0x7f05b8064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.983 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 --2- 172.21.15.31:0/1277476668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b813e460 0x7f05b8064870 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f05b4002f70 tx=0x7f05b4006df0).stop 2021-10-20T23:19:38.984 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- 172.21.15.31:0/1277476668 shutdown_connections 2021-10-20T23:19:38.984 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 --2- 172.21.15.31:0/1277476668 >> v2:172.21.15.31:3300/0 conn(0x7f05b80b7a20 0x7f05b8066da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.984 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 --2- 172.21.15.31:0/1277476668 >> v2:172.21.15.12:3300/0 conn(0x7f05b80b38a0 0x7f05b80b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.984 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 --2- 172.21.15.31:0/1277476668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b813e460 0x7f05b8064870 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.985 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- 172.21.15.31:0/1277476668 >> 172.21.15.31:0/1277476668 conn(0x7f05b80629d0 msgr2=0x7f05b8062de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:38.985 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- 172.21.15.31:0/1277476668 shutdown_connections 2021-10-20T23:19:38.985 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- 172.21.15.31:0/1277476668 wait complete. 2021-10-20T23:19:38.985 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 Processor -- start 2021-10-20T23:19:38.985 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- start start 2021-10-20T23:19:38.988 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b80b38a0 0x7f05b80ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.989 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b813e460 0x7f05b80b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.989 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b80b5cf0 0x7f05b80b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:38.989 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80b0070 con 0x7f05b80b38a0 2021-10-20T23:19:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80b02a0 con 0x7f05b813e460 2021-10-20T23:19:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80b0540 con 0x7f05b80b5cf0 2021-10-20T23:19:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05be6ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b80b5cf0 0x7f05b80b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bd6c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b813e460 0x7f05b80b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.991 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bd6c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b813e460 0x7f05b80b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60382/0 (socket says 172.21.15.31:60382) 2021-10-20T23:19:38.991 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bd6c8700 1 -- 172.21.15.31:0/3741567166 learned_addr learned my addr 172.21.15.31:0/3741567166 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:38.991 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05be6ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b80b5cf0 0x7f05b80b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:41480/0 (socket says 172.21.15.31:41480) 2021-10-20T23:19:38.991 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bdec9700 1 --2- 172.21.15.31:0/3741567166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b80b38a0 0x7f05b80ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:38.992 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bd6c8700 1 -- 172.21.15.31:0/3741567166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b80b5cf0 msgr2=0x7f05b80b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.992 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bd6c8700 1 --2- 172.21.15.31:0/3741567166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b80b5cf0 0x7f05b80b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.992 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bd6c8700 1 -- 172.21.15.31:0/3741567166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b80b38a0 msgr2=0x7f05b80ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:38.992 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bd6c8700 1 --2- 172.21.15.31:0/3741567166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b80b38a0 0x7f05b80ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:38.992 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bd6c8700 1 -- 172.21.15.31:0/3741567166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b400b180 con 0x7f05b813e460 2021-10-20T23:19:38.993 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05be6ca700 1 --2- 172.21.15.31:0/3741567166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b80b5cf0 0x7f05b80b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:19:38.993 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05bd6c8700 1 --2- 172.21.15.31:0/3741567166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b813e460 0x7f05b80b5560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f05a800c000 tx=0x7f05a8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:38.993 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05a6ffd700 1 -- 172.21.15.31:0/3741567166 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a8010590 con 0x7f05b813e460 2021-10-20T23:19:38.993 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05a6ffd700 1 -- 172.21.15.31:0/3741567166 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a80106f0 con 0x7f05b813e460 2021-10-20T23:19:38.994 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- 172.21.15.31:0/3741567166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b80b07e0 con 0x7f05b813e460 2021-10-20T23:19:38.994 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05a6ffd700 1 -- 172.21.15.31:0/3741567166 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a8010a50 con 0x7f05b813e460 2021-10-20T23:19:38.994 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05c012d700 1 -- 172.21.15.31:0/3741567166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b80b7090 con 0x7f05b813e460 2021-10-20T23:19:38.996 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.973+0000 7f05a6ffd700 1 -- 172.21.15.31:0/3741567166 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f05a801b400 con 0x7f05b813e460 2021-10-20T23:19:38.996 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.977+0000 7f05a6ffd700 1 -- 172.21.15.31:0/3741567166 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f05a8010d80 con 0x7f05b813e460 2021-10-20T23:19:38.996 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.977+0000 7f05c012d700 1 -- 172.21.15.31:0/3741567166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b80b0970 con 0x7f05b813e460 2021-10-20T23:19:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:38.981+0000 7f05a6ffd700 1 -- 172.21.15.31:0/3741567166 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f05a801bb40 con 0x7f05b813e460 2021-10-20T23:19:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.045+0000 7f05c012d700 1 -- 172.21.15.31:0/3741567166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", "id": 3} v 0) v1 -- 0x7f05b8065100 con 0x7f05b813e460 2021-10-20T23:19:39.061 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05a6ffd700 1 -- 172.21.15.31:0/3741567166 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f05a801bd60 con 0x7f05b813e460 2021-10-20T23:19:39.062 INFO:teuthology.orchestra.run.smithi031.stdout:3 2021-10-20T23:19:39.063 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05c012d700 1 -- 172.21.15.31:0/3741567166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b813e460 msgr2=0x7f05b80b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.064 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05c012d700 1 --2- 172.21.15.31:0/3741567166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b813e460 0x7f05b80b5560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f05a800c000 tx=0x7f05a8006df0).stop 2021-10-20T23:19:39.064 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05c012d700 1 -- 172.21.15.31:0/3741567166 shutdown_connections 2021-10-20T23:19:39.064 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05c012d700 1 --2- 172.21.15.31:0/3741567166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b80b5cf0 0x7f05b80b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.065 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05c012d700 1 --2- 172.21.15.31:0/3741567166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b813e460 0x7f05b80b5560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.065 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05c012d700 1 --2- 172.21.15.31:0/3741567166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b80b38a0 0x7f05b80ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.065 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05c012d700 1 -- 172.21.15.31:0/3741567166 >> 172.21.15.31:0/3741567166 conn(0x7f05b80629d0 msgr2=0x7f05b80b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:39.065 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05c012d700 1 -- 172.21.15.31:0/3741567166 shutdown_connections 2021-10-20T23:19:39.066 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.057+0000 7f05c012d700 1 -- 172.21.15.31:0/3741567166 wait complete. 2021-10-20T23:19:39.075 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new b4da75a6-08bb-4741-aa9c-ccbf8ccff189 4 2021-10-20T23:19:39.173 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.165+0000 7fc67f0c8700 1 Processor -- start 2021-10-20T23:19:39.174 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.165+0000 7fc67f0c8700 1 -- start start 2021-10-20T23:19:39.179 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6780afca0 0x7fc67813e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.179 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6780af130 0x7fc678144500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6780671d0 con 0x7fc6780b2850 2021-10-20T23:19:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6780b2c30 con 0x7fc6780af130 2021-10-20T23:19:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc678067400 con 0x7fc6780afca0 2021-10-20T23:19:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d8c5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6780afca0 0x7fc67813e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d8c5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6780afca0 0x7fc67813e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60386/0 (socket says 172.21.15.31:60386) 2021-10-20T23:19:39.181 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d8c5700 1 -- 172.21.15.31:0/1724099137 learned_addr learned my addr 172.21.15.31:0/1724099137 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:39.181 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67e8c7700 1 --2- 172.21.15.31:0/1724099137 >> v2:172.21.15.12:3300/0 conn(0x7fc6780af130 0x7fc678144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.182 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d8c5700 1 -- 172.21.15.31:0/1724099137 >> v2:172.21.15.12:3300/0 conn(0x7fc6780af130 msgr2=0x7fc678144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:39.182 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d8c5700 1 --2- 172.21.15.31:0/1724099137 >> v2:172.21.15.12:3300/0 conn(0x7fc6780af130 0x7fc678144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.183 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d8c5700 1 -- 172.21.15.31:0/1724099137 >> v1:172.21.15.12:6789/0 conn(0x7fc6780b2850 legacy=0x7fc67813e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.183 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d8c5700 1 -- 172.21.15.31:0/1724099137 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780676a0 con 0x7fc6780afca0 2021-10-20T23:19:39.183 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d8c5700 1 --2- 172.21.15.31:0/1724099137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 0x7fc67813e8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fc668002f70 tx=0x7fc668006eb0).ready entity=mon.1 client_cookie=b36f5642d755fd9d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:39.183 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d0c4700 1 -- 172.21.15.31:0/1724099137 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66800d610 con 0x7fc6780afca0 2021-10-20T23:19:39.183 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d0c4700 1 -- 172.21.15.31:0/1724099137 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc668000e90 con 0x7fc6780afca0 2021-10-20T23:19:39.184 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67d0c4700 1 -- 172.21.15.31:0/1724099137 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66800d9a0 con 0x7fc6780afca0 2021-10-20T23:19:39.184 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 -- 172.21.15.31:0/1724099137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 msgr2=0x7fc67813e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.184 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 --2- 172.21.15.31:0/1724099137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 0x7fc67813e8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fc668002f70 tx=0x7fc668006eb0).stop 2021-10-20T23:19:39.184 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 -- 172.21.15.31:0/1724099137 shutdown_connections 2021-10-20T23:19:39.185 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 --2- 172.21.15.31:0/1724099137 >> v2:172.21.15.12:3300/0 conn(0x7fc6780af130 0x7fc678144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.185 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 --2- 172.21.15.31:0/1724099137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 0x7fc67813e8c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.185 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 -- 172.21.15.31:0/1724099137 >> 172.21.15.31:0/1724099137 conn(0x7fc678061230 msgr2=0x7fc678062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:39.185 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 -- 172.21.15.31:0/1724099137 shutdown_connections 2021-10-20T23:19:39.185 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 -- 172.21.15.31:0/1724099137 wait complete. 2021-10-20T23:19:39.186 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 Processor -- start 2021-10-20T23:19:39.186 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.169+0000 7fc67f0c8700 1 -- start start 2021-10-20T23:19:39.186 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67f0c8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6780af130 0x7fc6780b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.186 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67f0c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 0x7fc67813f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.186 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67f0c8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6780b2850 0x7fc67813f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.187 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67f0c8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780aef40 con 0x7fc6780b2850 2021-10-20T23:19:39.187 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67f0c8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67813fbb0 con 0x7fc6780afca0 2021-10-20T23:19:39.187 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67f0c8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc678141430 con 0x7fc6780af130 2021-10-20T23:19:39.187 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67e0c6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6780af130 0x7fc6780b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.188 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67d8c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 0x7fc67813f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.188 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67e0c6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6780af130 0x7fc6780b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:41490/0 (socket says 172.21.15.31:41490) 2021-10-20T23:19:39.188 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67e0c6700 1 -- 172.21.15.31:0/709934957 learned_addr learned my addr 172.21.15.31:0/709934957 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:39.188 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67e8c7700 1 --2- 172.21.15.31:0/709934957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6780b2850 0x7fc67813f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.188 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67d8c5700 1 -- 172.21.15.31:0/709934957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6780af130 msgr2=0x7fc6780b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.189 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67d8c5700 1 --2- 172.21.15.31:0/709934957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6780af130 0x7fc6780b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.189 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67d8c5700 1 -- 172.21.15.31:0/709934957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6780b2850 msgr2=0x7fc67813f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.189 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67d8c5700 1 --2- 172.21.15.31:0/709934957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6780b2850 0x7fc67813f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.189 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67d8c5700 1 -- 172.21.15.31:0/709934957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66800b1e0 con 0x7fc6780afca0 2021-10-20T23:19:39.189 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67d8c5700 1 --2- 172.21.15.31:0/709934957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 0x7fc67813f1d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc668002f70 tx=0x7fc668015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:39.190 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc6677fe700 1 -- 172.21.15.31:0/709934957 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc668011860 con 0x7fc6780afca0 2021-10-20T23:19:39.190 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc6677fe700 1 -- 172.21.15.31:0/709934957 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6680119c0 con 0x7fc6780afca0 2021-10-20T23:19:39.190 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc6677fe700 1 -- 172.21.15.31:0/709934957 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc668011d20 con 0x7fc6780afca0 2021-10-20T23:19:39.190 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67f0c8700 1 -- 172.21.15.31:0/709934957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6781416d0 con 0x7fc6780afca0 2021-10-20T23:19:39.190 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67f0c8700 1 -- 172.21.15.31:0/709934957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc678152620 con 0x7fc6780afca0 2021-10-20T23:19:39.191 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc6677fe700 1 -- 172.21.15.31:0/709934957 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fc66801a040 con 0x7fc6780afca0 2021-10-20T23:19:39.191 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc6677fe700 1 -- 172.21.15.31:0/709934957 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fc66801eb30 con 0x7fc6780afca0 2021-10-20T23:19:39.192 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.173+0000 7fc67f0c8700 1 -- 172.21.15.31:0/709934957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc678141b70 con 0x7fc6780afca0 2021-10-20T23:19:39.192 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.177+0000 7fc6677fe700 1 -- 172.21.15.31:0/709934957 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fc66801ed40 con 0x7fc6780afca0 2021-10-20T23:19:39.254 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.249+0000 7fc67f0c8700 1 -- 172.21.15.31:0/709934957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", "id": 4} v 0) v1 -- 0x7fc678067940 con 0x7fc6780afca0 2021-10-20T23:19:39.264 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.257+0000 7fc6677fe700 1 -- 172.21.15.31:0/709934957 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc668006020 con 0x7fc6780afca0 2021-10-20T23:19:39.265 INFO:teuthology.orchestra.run.smithi031.stdout:4 2021-10-20T23:19:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.261+0000 7fc67f0c8700 1 -- 172.21.15.31:0/709934957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 msgr2=0x7fc67813f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.261+0000 7fc67f0c8700 1 --2- 172.21.15.31:0/709934957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 0x7fc67813f1d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc668002f70 tx=0x7fc668015000).stop 2021-10-20T23:19:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.261+0000 7fc67f0c8700 1 -- 172.21.15.31:0/709934957 shutdown_connections 2021-10-20T23:19:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.261+0000 7fc67f0c8700 1 --2- 172.21.15.31:0/709934957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6780b2850 0x7fc67813f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.268 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.261+0000 7fc67f0c8700 1 --2- 172.21.15.31:0/709934957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6780afca0 0x7fc67813f1d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.268 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.261+0000 7fc67f0c8700 1 --2- 172.21.15.31:0/709934957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6780af130 0x7fc6780b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.268 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.261+0000 7fc67f0c8700 1 -- 172.21.15.31:0/709934957 >> 172.21.15.31:0/709934957 conn(0x7fc678061230 msgr2=0x7fc67805f750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:39.269 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.261+0000 7fc67f0c8700 1 -- 172.21.15.31:0/709934957 shutdown_connections 2021-10-20T23:19:39.269 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.261+0000 7fc67f0c8700 1 -- 172.21.15.31:0/709934957 wait complete. 2021-10-20T23:19:39.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 44da5aeb-adb6-4f57-a07f-e7cd5528bd11 5 2021-10-20T23:19:39.379 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.369+0000 7fbf28e82700 1 Processor -- start 2021-10-20T23:19:39.379 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.369+0000 7fbf28e82700 1 -- start start 2021-10-20T23:19:39.380 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf240aad80 0x7fbf24067300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.380 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 0x7fbf240b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.380 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf24065960 con 0x7fbf240ab160 2021-10-20T23:19:39.381 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf24064f10 con 0x7fbf240aad80 2021-10-20T23:19:39.381 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240b3ce0 con 0x7fbf240b4d50 2021-10-20T23:19:39.381 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf237fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf240aad80 0x7fbf24067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.381 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf237fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf240aad80 0x7fbf24067300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60398/0 (socket says 172.21.15.31:60398) 2021-10-20T23:19:39.382 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf23fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 0x7fbf240b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.382 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf237fe700 1 -- 172.21.15.31:0/205524277 learned_addr learned my addr 172.21.15.31:0/205524277 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:39.382 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf237fe700 1 -- 172.21.15.31:0/205524277 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 msgr2=0x7fbf240b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:39.383 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf237fe700 1 --2- 172.21.15.31:0/205524277 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 0x7fbf240b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.383 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf237fe700 1 -- 172.21.15.31:0/205524277 >> v1:172.21.15.12:6789/0 conn(0x7fbf240ab160 legacy=0x7fbf24064800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.383 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf237fe700 1 -- 172.21.15.31:0/205524277 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf24066e60 con 0x7fbf240aad80 2021-10-20T23:19:39.383 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf237fe700 1 --2- 172.21.15.31:0/205524277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 0x7fbf24067300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fbf14002f70 tx=0x7fbf14006eb0).ready entity=mon.1 client_cookie=488b2d243056d01 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:39.383 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf227fc700 1 -- 172.21.15.31:0/205524277 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf1400d570 con 0x7fbf240aad80 2021-10-20T23:19:39.384 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf227fc700 1 -- 172.21.15.31:0/205524277 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14000e90 con 0x7fbf240aad80 2021-10-20T23:19:39.384 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf227fc700 1 -- 172.21.15.31:0/205524277 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf1400d900 con 0x7fbf240aad80 2021-10-20T23:19:39.388 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 -- 172.21.15.31:0/205524277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 msgr2=0x7fbf24067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.389 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 --2- 172.21.15.31:0/205524277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 0x7fbf24067300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fbf14002f70 tx=0x7fbf14006eb0).stop 2021-10-20T23:19:39.389 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 -- 172.21.15.31:0/205524277 shutdown_connections 2021-10-20T23:19:39.389 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 --2- 172.21.15.31:0/205524277 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 0x7fbf240b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.389 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 --2- 172.21.15.31:0/205524277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 0x7fbf24067300 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 -- 172.21.15.31:0/205524277 >> 172.21.15.31:0/205524277 conn(0x7fbf24062be0 msgr2=0x7fbf2405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 -- 172.21.15.31:0/205524277 shutdown_connections 2021-10-20T23:19:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.373+0000 7fbf28e82700 1 -- 172.21.15.31:0/205524277 wait complete. 2021-10-20T23:19:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 Processor -- start 2021-10-20T23:19:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 -- start start 2021-10-20T23:19:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 0x7fbf240af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240ab160 0x7fbf24138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 0x7fbf24138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.392 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2405fe00 con 0x7fbf240ab160 2021-10-20T23:19:39.392 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240aa1a0 con 0x7fbf240aad80 2021-10-20T23:19:39.392 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240aa400 con 0x7fbf240b4d50 2021-10-20T23:19:39.392 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 0x7fbf240af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.392 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 0x7fbf240af4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60402/0 (socket says 172.21.15.31:60402) 2021-10-20T23:19:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf237fe700 1 -- 172.21.15.31:0/2164350686 learned_addr learned my addr 172.21.15.31:0/2164350686 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf23fff700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 0x7fbf24138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf22ffd700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240ab160 0x7fbf24138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf23fff700 1 -- 172.21.15.31:0/2164350686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 msgr2=0x7fbf240af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf23fff700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 0x7fbf240af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.394 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf23fff700 1 -- 172.21.15.31:0/2164350686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240ab160 msgr2=0x7fbf24138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.394 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf23fff700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240ab160 0x7fbf24138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.394 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf23fff700 1 -- 172.21.15.31:0/2164350686 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1400b1e0 con 0x7fbf240b4d50 2021-10-20T23:19:39.394 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf22ffd700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240ab160 0x7fbf24138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:19:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf23fff700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 0x7fbf24138c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbf1c00c000 tx=0x7fbf1c0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf20ff9700 1 -- 172.21.15.31:0/2164350686 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf1c012600 con 0x7fbf240b4d50 2021-10-20T23:19:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf20ff9700 1 -- 172.21.15.31:0/2164350686 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c012760 con 0x7fbf240b4d50 2021-10-20T23:19:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 -- 172.21.15.31:0/2164350686 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf240ad2e0 con 0x7fbf240b4d50 2021-10-20T23:19:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf20ff9700 1 -- 172.21.15.31:0/2164350686 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf1c012ac0 con 0x7fbf240b4d50 2021-10-20T23:19:39.396 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf28e82700 1 -- 172.21.15.31:0/2164350686 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf24139150 con 0x7fbf240b4d50 2021-10-20T23:19:39.396 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf20ff9700 1 -- 172.21.15.31:0/2164350686 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fbf1c022070 con 0x7fbf240b4d50 2021-10-20T23:19:39.396 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.377+0000 7fbf20ff9700 1 -- 172.21.15.31:0/2164350686 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fbf1c01bb90 con 0x7fbf240b4d50 2021-10-20T23:19:39.396 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.381+0000 7fbf28e82700 1 -- 172.21.15.31:0/2164350686 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf240ad140 con 0x7fbf240b4d50 2021-10-20T23:19:39.396 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.381+0000 7fbf20ff9700 1 -- 172.21.15.31:0/2164350686 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fbf1c039870 con 0x7fbf240b4d50 2021-10-20T23:19:39.457 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.449+0000 7fbf28e82700 1 -- 172.21.15.31:0/2164350686 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", "id": 5} v 0) v1 -- 0x7fbf240aa5c0 con 0x7fbf240b4d50 2021-10-20T23:19:39.468 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.461+0000 7fbf20ff9700 1 -- 172.21.15.31:0/2164350686 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbf1c029020 con 0x7fbf240b4d50 2021-10-20T23:19:39.468 INFO:teuthology.orchestra.run.smithi031.stdout:5 2021-10-20T23:19:39.469 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.461+0000 7fbf28e82700 1 -- 172.21.15.31:0/2164350686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 msgr2=0x7fbf24138c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.470 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.461+0000 7fbf28e82700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 0x7fbf24138c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbf1c00c000 tx=0x7fbf1c0091d0).stop 2021-10-20T23:19:39.470 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.461+0000 7fbf28e82700 1 -- 172.21.15.31:0/2164350686 shutdown_connections 2021-10-20T23:19:39.471 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.461+0000 7fbf28e82700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf240b4d50 0x7fbf24138c60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.471 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.461+0000 7fbf28e82700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240ab160 0x7fbf24138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.471 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.461+0000 7fbf28e82700 1 --2- 172.21.15.31:0/2164350686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf240aad80 0x7fbf240af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.472 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.461+0000 7fbf28e82700 1 -- 172.21.15.31:0/2164350686 >> 172.21.15.31:0/2164350686 conn(0x7fbf24062be0 msgr2=0x7fbf241395f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:39.472 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.465+0000 7fbf28e82700 1 -- 172.21.15.31:0/2164350686 shutdown_connections 2021-10-20T23:19:39.472 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.465+0000 7fbf28e82700 1 -- 172.21.15.31:0/2164350686 wait complete. 2021-10-20T23:19:39.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new b74da8f7-c44a-4ec6-afbf-41cba5c861dc 6 2021-10-20T23:19:39.577 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.569+0000 7fab28d46700 1 Processor -- start 2021-10-20T23:19:39.577 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- start start 2021-10-20T23:19:39.581 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240aea40 0x7fab241437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.581 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fab240ad000 0x7fab24143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.581 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab240b0480 0x7fab24146b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.581 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab240adc50 con 0x7fab240b0480 2021-10-20T23:19:39.582 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab240b0990 con 0x7fab240ad000 2021-10-20T23:19:39.582 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab24146700 con 0x7fab240aea40 2021-10-20T23:19:39.582 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab237fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240aea40 0x7fab241437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.584 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab237fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240aea40 0x7fab241437b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:41508/0 (socket says 172.21.15.31:41508) 2021-10-20T23:19:39.584 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab237fe700 1 -- 172.21.15.31:0/1973110263 learned_addr learned my addr 172.21.15.31:0/1973110263 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:39.584 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab22ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fab240ad000 0x7fab24143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.585 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab23fff700 1 --2- 172.21.15.31:0/1973110263 >> v2:172.21.15.12:3300/0 conn(0x7fab240b0480 0x7fab24146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.585 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab237fe700 1 -- 172.21.15.31:0/1973110263 >> v2:172.21.15.31:3300/0 conn(0x7fab240ad000 msgr2=0x7fab24143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:39.585 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab237fe700 1 --2- 172.21.15.31:0/1973110263 >> v2:172.21.15.31:3300/0 conn(0x7fab240ad000 0x7fab24143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.586 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab237fe700 1 -- 172.21.15.31:0/1973110263 >> v2:172.21.15.12:3300/0 conn(0x7fab240b0480 msgr2=0x7fab24146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:39.586 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab237fe700 1 --2- 172.21.15.31:0/1973110263 >> v2:172.21.15.12:3300/0 conn(0x7fab240b0480 0x7fab24146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.586 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab237fe700 1 -- 172.21.15.31:0/1973110263 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab240aee20 con 0x7fab240aea40 2021-10-20T23:19:39.586 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab23fff700 1 --2- 172.21.15.31:0/1973110263 >> v2:172.21.15.12:3300/0 conn(0x7fab240b0480 0x7fab24146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:19:39.587 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab237fe700 1 --2- 172.21.15.31:0/1973110263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240aea40 0x7fab241437b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fab18002f70 tx=0x7fab18006eb0).ready entity=mon.2 client_cookie=6bda7cf3fb1ab168 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:39.587 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab227fc700 1 -- 172.21.15.31:0/1973110263 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1800d570 con 0x7fab240aea40 2021-10-20T23:19:39.587 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab227fc700 1 -- 172.21.15.31:0/1973110263 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab18000e90 con 0x7fab240aea40 2021-10-20T23:19:39.587 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab227fc700 1 -- 172.21.15.31:0/1973110263 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1800d900 con 0x7fab240aea40 2021-10-20T23:19:39.587 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- 172.21.15.31:0/1973110263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240aea40 msgr2=0x7fab241437b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.588 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 --2- 172.21.15.31:0/1973110263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240aea40 0x7fab241437b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fab18002f70 tx=0x7fab18006eb0).stop 2021-10-20T23:19:39.588 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- 172.21.15.31:0/1973110263 shutdown_connections 2021-10-20T23:19:39.588 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 --2- 172.21.15.31:0/1973110263 >> v2:172.21.15.12:3300/0 conn(0x7fab240b0480 0x7fab24146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.588 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 --2- 172.21.15.31:0/1973110263 >> v2:172.21.15.31:3300/0 conn(0x7fab240ad000 0x7fab24143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.590 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 --2- 172.21.15.31:0/1973110263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240aea40 0x7fab241437b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.590 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- 172.21.15.31:0/1973110263 >> 172.21.15.31:0/1973110263 conn(0x7fab24061230 msgr2=0x7fab24062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:39.591 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- 172.21.15.31:0/1973110263 shutdown_connections 2021-10-20T23:19:39.591 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- 172.21.15.31:0/1973110263 wait complete. 2021-10-20T23:19:39.591 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 Processor -- start 2021-10-20T23:19:39.592 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.573+0000 7fab28d46700 1 -- start start 2021-10-20T23:19:39.595 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab28d46700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab240ad000 0x7fab24148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.595 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab28d46700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab240aea40 0x7fab24066ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.595 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab28d46700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240b0480 0x7fab240674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.597 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab28d46700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab24142310 con 0x7fab240ad000 2021-10-20T23:19:39.597 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab28d46700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab241425b0 con 0x7fab240aea40 2021-10-20T23:19:39.597 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab28d46700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab24152e40 con 0x7fab240b0480 2021-10-20T23:19:39.597 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab22ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab240aea40 0x7fab24066ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.597 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab23fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240b0480 0x7fab240674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.598 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab23fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240b0480 0x7fab240674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:41518/0 (socket says 172.21.15.31:41518) 2021-10-20T23:19:39.598 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab23fff700 1 -- 172.21.15.31:0/1575449376 learned_addr learned my addr 172.21.15.31:0/1575449376 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:39.598 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab237fe700 1 --2- 172.21.15.31:0/1575449376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab240ad000 0x7fab24148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.598 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab23fff700 1 -- 172.21.15.31:0/1575449376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab240aea40 msgr2=0x7fab24066ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.599 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab23fff700 1 --2- 172.21.15.31:0/1575449376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab240aea40 0x7fab24066ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.599 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab23fff700 1 -- 172.21.15.31:0/1575449376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab240ad000 msgr2=0x7fab24148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.599 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab23fff700 1 --2- 172.21.15.31:0/1575449376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab240ad000 0x7fab24148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.599 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab23fff700 1 -- 172.21.15.31:0/1575449376 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1800b1e0 con 0x7fab240b0480 2021-10-20T23:19:39.600 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab23fff700 1 --2- 172.21.15.31:0/1575449376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240b0480 0x7fab240674e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fab1c006940 tx=0x7fab1c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:39.600 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab20ff9700 1 -- 172.21.15.31:0/1575449376 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1c011590 con 0x7fab240b0480 2021-10-20T23:19:39.600 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab20ff9700 1 -- 172.21.15.31:0/1575449376 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c0116f0 con 0x7fab240b0480 2021-10-20T23:19:39.600 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab28d46700 1 -- 172.21.15.31:0/1575449376 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab241530e0 con 0x7fab240b0480 2021-10-20T23:19:39.600 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab20ff9700 1 -- 172.21.15.31:0/1575449376 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1c011a50 con 0x7fab240b0480 2021-10-20T23:19:39.601 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab28d46700 1 -- 172.21.15.31:0/1575449376 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab241403e0 con 0x7fab240b0480 2021-10-20T23:19:39.601 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab20ff9700 1 -- 172.21.15.31:0/1575449376 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fab1c01c460 con 0x7fab240b0480 2021-10-20T23:19:39.601 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab20ff9700 1 -- 172.21.15.31:0/1575449376 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fab1c011d80 con 0x7fab240b0480 2021-10-20T23:19:39.601 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.577+0000 7fab28d46700 1 -- 172.21.15.31:0/1575449376 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab24153270 con 0x7fab240b0480 2021-10-20T23:19:39.601 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.581+0000 7fab20ff9700 1 -- 172.21.15.31:0/1575449376 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fab1c01c6f0 con 0x7fab240b0480 2021-10-20T23:19:39.657 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.649+0000 7fab28d46700 1 -- 172.21.15.31:0/1575449376 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", "id": 6} v 0) v1 -- 0x7fab240b0bc0 con 0x7fab240b0480 2021-10-20T23:19:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab20ff9700 1 -- 172.21.15.31:0/1575449376 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fab1c01cba0 con 0x7fab240b0480 2021-10-20T23:19:39.667 INFO:teuthology.orchestra.run.smithi031.stdout:6 2021-10-20T23:19:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab28d46700 1 -- 172.21.15.31:0/1575449376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240b0480 msgr2=0x7fab240674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab28d46700 1 --2- 172.21.15.31:0/1575449376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240b0480 0x7fab240674e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fab1c006940 tx=0x7fab1c008040).stop 2021-10-20T23:19:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab28d46700 1 -- 172.21.15.31:0/1575449376 shutdown_connections 2021-10-20T23:19:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab28d46700 1 --2- 172.21.15.31:0/1575449376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab240b0480 0x7fab240674e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab28d46700 1 --2- 172.21.15.31:0/1575449376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab240aea40 0x7fab24066ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab28d46700 1 --2- 172.21.15.31:0/1575449376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab240ad000 0x7fab24148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab28d46700 1 -- 172.21.15.31:0/1575449376 >> 172.21.15.31:0/1575449376 conn(0x7fab24061230 msgr2=0x7fab24143720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab28d46700 1 -- 172.21.15.31:0/1575449376 shutdown_connections 2021-10-20T23:19:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.661+0000 7fab28d46700 1 -- 172.21.15.31:0/1575449376 wait complete. 2021-10-20T23:19:39.679 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5 7 2021-10-20T23:19:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f415a425700 1 Processor -- start 2021-10-20T23:19:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f415a425700 1 -- start start 2021-10-20T23:19:39.778 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f415a425700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f415405fc00 0x7f41540b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.779 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f415a425700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41540b5990 0x7f41540b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.779 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f415a425700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4154143f60 con 0x7f41540b6560 2021-10-20T23:19:39.779 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f415a425700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41540ba6b0 con 0x7f415405fc00 2021-10-20T23:19:39.779 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f415a425700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415405ffe0 con 0x7f41540b5990 2021-10-20T23:19:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f41589c2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41540b5990 0x7f41540b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f41589c2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41540b5990 0x7f41540b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60422/0 (socket says 172.21.15.31:60422) 2021-10-20T23:19:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.769+0000 7f41589c2700 1 -- 172.21.15.31:0/1898064624 learned_addr learned my addr 172.21.15.31:0/1898064624 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f4153fff700 1 --2- 172.21.15.31:0/1898064624 >> v2:172.21.15.12:3300/0 conn(0x7f415405fc00 0x7f41540b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f4152ffd700 1 -- 172.21.15.31:0/1898064624 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793691401 0 0) 0x7f4154143f60 con 0x7f41540b6560 2021-10-20T23:19:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f4152ffd700 1 -- 172.21.15.31:0/1898064624 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4140003260 con 0x7f41540b6560 2021-10-20T23:19:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f41589c2700 1 -- 172.21.15.31:0/1898064624 >> v2:172.21.15.12:3300/0 conn(0x7f415405fc00 msgr2=0x7f41540b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f41589c2700 1 --2- 172.21.15.31:0/1898064624 >> v2:172.21.15.12:3300/0 conn(0x7f415405fc00 0x7f41540b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f41589c2700 1 -- 172.21.15.31:0/1898064624 >> v1:172.21.15.12:6789/0 conn(0x7f41540b6560 legacy=0x7f41540b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.782 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f41589c2700 1 -- 172.21.15.31:0/1898064624 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4154143a50 con 0x7f41540b5990 2021-10-20T23:19:39.782 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f41589c2700 1 --2- 172.21.15.31:0/1898064624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 0x7f41540b4a00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f414c0032f0 tx=0x7f414c009290).ready entity=mon.1 client_cookie=ef24118f156d07c5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:39.782 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f4152ffd700 1 -- 172.21.15.31:0/1898064624 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c00b680 con 0x7f41540b5990 2021-10-20T23:19:39.782 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f4152ffd700 1 -- 172.21.15.31:0/1898064624 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c00b7e0 con 0x7f41540b5990 2021-10-20T23:19:39.783 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f4152ffd700 1 -- 172.21.15.31:0/1898064624 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c00b950 con 0x7f41540b5990 2021-10-20T23:19:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f415a425700 1 -- 172.21.15.31:0/1898064624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 msgr2=0x7f41540b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f415a425700 1 --2- 172.21.15.31:0/1898064624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 0x7f41540b4a00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f414c0032f0 tx=0x7f414c009290).stop 2021-10-20T23:19:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f415a425700 1 -- 172.21.15.31:0/1898064624 shutdown_connections 2021-10-20T23:19:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f415a425700 1 --2- 172.21.15.31:0/1898064624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 0x7f41540b4a00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.787 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f415a425700 1 --2- 172.21.15.31:0/1898064624 >> v2:172.21.15.12:3300/0 conn(0x7f415405fc00 0x7f41540b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.787 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f415a425700 1 -- 172.21.15.31:0/1898064624 >> 172.21.15.31:0/1898064624 conn(0x7f41540623a0 msgr2=0x7f4154066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:39.787 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f415a425700 1 -- 172.21.15.31:0/1898064624 shutdown_connections 2021-10-20T23:19:39.787 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.773+0000 7f415a425700 1 -- 172.21.15.31:0/1898064624 wait complete. 2021-10-20T23:19:39.788 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f415a425700 1 Processor -- start 2021-10-20T23:19:39.788 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f415a425700 1 -- start start 2021-10-20T23:19:39.788 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f415a425700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f415405fc00 0x7f41540b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.788 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f415a425700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 0x7f41540aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.788 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f415a425700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41540b6560 0x7f415413d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:39.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f415a425700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4154140400 con 0x7f415405fc00 2021-10-20T23:19:39.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f415a425700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540aef90 con 0x7f41540b5990 2021-10-20T23:19:39.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f415a425700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415413fa20 con 0x7f41540b6560 2021-10-20T23:19:39.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f41537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 0x7f41540aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.789 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f4153fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f415405fc00 0x7f41540b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.790 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f41589c2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41540b6560 0x7f415413d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:39.790 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f41537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 0x7f41540aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60428/0 (socket says 172.21.15.31:60428) 2021-10-20T23:19:39.790 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f41537fe700 1 -- 172.21.15.31:0/1202474863 learned_addr learned my addr 172.21.15.31:0/1202474863 (peer_addr_for_me v2:172.21.15.31:0/0) 2021-10-20T23:19:39.790 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f41537fe700 1 -- 172.21.15.31:0/1202474863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41540b6560 msgr2=0x7f415413d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.791 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f41537fe700 1 --2- 172.21.15.31:0/1202474863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41540b6560 0x7f415413d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.791 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f41537fe700 1 -- 172.21.15.31:0/1202474863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f415405fc00 msgr2=0x7f41540b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.791 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f41537fe700 1 --2- 172.21.15.31:0/1202474863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f415405fc00 0x7f41540b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.791 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.777+0000 7f41537fe700 1 -- 172.21.15.31:0/1202474863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c009530 con 0x7f41540b5990 2021-10-20T23:19:39.791 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.781+0000 7f41537fe700 1 --2- 172.21.15.31:0/1202474863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 0x7f41540aeaa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f41540b3820 tx=0x7f4148007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:39.792 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.781+0000 7f41517fa700 1 -- 172.21.15.31:0/1202474863 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414800ce80 con 0x7f41540b5990 2021-10-20T23:19:39.792 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.781+0000 7f41517fa700 1 -- 172.21.15.31:0/1202474863 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4148012400 con 0x7f41540b5990 2021-10-20T23:19:39.792 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.781+0000 7f415a425700 1 -- 172.21.15.31:0/1202474863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415413fcc0 con 0x7f41540b5990 2021-10-20T23:19:39.792 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.781+0000 7f41517fa700 1 -- 172.21.15.31:0/1202474863 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4148012760 con 0x7f41540b5990 2021-10-20T23:19:39.793 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.781+0000 7f415a425700 1 -- 172.21.15.31:0/1202474863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41540af3b0 con 0x7f41540b5990 2021-10-20T23:19:39.793 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.781+0000 7f41517fa700 1 -- 172.21.15.31:0/1202474863 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4148019030 con 0x7f41540b5990 2021-10-20T23:19:39.794 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.781+0000 7f41517fa700 1 -- 172.21.15.31:0/1202474863 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f414801ba40 con 0x7f41540b5990 2021-10-20T23:19:39.794 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.781+0000 7f415a425700 1 -- 172.21.15.31:0/1202474863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4154143cc0 con 0x7f41540b5990 2021-10-20T23:19:39.794 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.785+0000 7f41517fa700 1 -- 172.21.15.31:0/1202474863 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4148017070 con 0x7f41540b5990 2021-10-20T23:19:39.856 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.849+0000 7f415a425700 1 -- 172.21.15.31:0/1202474863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", "id": 7} v 0) v1 -- 0x7f4154057350 con 0x7f41540b5990 2021-10-20T23:19:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f41517fa700 1 -- 172.21.15.31:0/1202474863 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f414801bc50 con 0x7f41540b5990 2021-10-20T23:19:39.868 INFO:teuthology.orchestra.run.smithi031.stdout:7 2021-10-20T23:19:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f415a425700 1 -- 172.21.15.31:0/1202474863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 msgr2=0x7f41540aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f415a425700 1 --2- 172.21.15.31:0/1202474863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 0x7f41540aeaa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f41540b3820 tx=0x7f4148007a90).stop 2021-10-20T23:19:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f415a425700 1 -- 172.21.15.31:0/1202474863 shutdown_connections 2021-10-20T23:19:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f415a425700 1 --2- 172.21.15.31:0/1202474863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41540b6560 0x7f415413d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f415a425700 1 --2- 172.21.15.31:0/1202474863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41540b5990 0x7f41540aeaa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f415a425700 1 --2- 172.21.15.31:0/1202474863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f415405fc00 0x7f41540b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f415a425700 1 -- 172.21.15.31:0/1202474863 >> 172.21.15.31:0/1202474863 conn(0x7f41540623a0 msgr2=0x7f415405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:39.872 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f415a425700 1 -- 172.21.15.31:0/1202474863 shutdown_connections 2021-10-20T23:19:39.872 INFO:teuthology.orchestra.run.smithi031.stderr:2021-10-20T23:19:39.861+0000 7f415a425700 1 -- 172.21.15.31:0/1202474863 wait complete. 2021-10-20T23:19:39.878 INFO:tasks.ceph.osd.0:Restarting daemon 2021-10-20T23:19:39.879 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-10-20T23:19:39.882 INFO:tasks.ceph.osd.0:Started 2021-10-20T23:19:39.882 INFO:tasks.ceph.osd.1:Restarting daemon 2021-10-20T23:19:39.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-10-20T23:19:39.886 INFO:tasks.ceph.osd.1:Started 2021-10-20T23:19:39.886 INFO:tasks.ceph.osd.2:Restarting daemon 2021-10-20T23:19:39.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-10-20T23:19:39.890 INFO:tasks.ceph.osd.2:Started 2021-10-20T23:19:39.890 INFO:tasks.ceph.osd.3:Restarting daemon 2021-10-20T23:19:39.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-10-20T23:19:39.893 INFO:tasks.ceph.osd.3:Started 2021-10-20T23:19:39.893 INFO:tasks.ceph.osd.4:Restarting daemon 2021-10-20T23:19:39.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-10-20T23:19:39.896 INFO:tasks.ceph.osd.4:Started 2021-10-20T23:19:39.897 INFO:tasks.ceph.osd.5:Restarting daemon 2021-10-20T23:19:39.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-10-20T23:19:39.899 INFO:tasks.ceph.osd.5:Started 2021-10-20T23:19:39.900 INFO:tasks.ceph.osd.6:Restarting daemon 2021-10-20T23:19:39.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-10-20T23:19:39.902 INFO:tasks.ceph.osd.6:Started 2021-10-20T23:19:39.903 INFO:tasks.ceph.osd.7:Restarting daemon 2021-10-20T23:19:39.903 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-10-20T23:19:39.906 INFO:tasks.ceph.osd.7:Started 2021-10-20T23:19:39.907 INFO:tasks.ceph:Waiting for OSDs to come up 2021-10-20T23:19:40.265 INFO:tasks.ceph.osd.3.smithi012.stderr:2021-10-20T23:19:40.256+0000 7fc8a449cd80 -1 Falling back to public interface 2021-10-20T23:19:40.269 INFO:tasks.ceph.osd.2.smithi012.stderr:2021-10-20T23:19:40.260+0000 7ff8903cbd80 -1 Falling back to public interface 2021-10-20T23:19:40.289 INFO:tasks.ceph.osd.0.smithi012.stderr:2021-10-20T23:19:40.280+0000 7f4edf8ccd80 -1 Falling back to public interface 2021-10-20T23:19:40.291 INFO:tasks.ceph.osd.5.smithi031.stderr:2021-10-20T23:19:40.285+0000 7f12e72ced80 -1 Falling back to public interface 2021-10-20T23:19:40.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2021-10-20T23:19:40.488+0000 7fbceede9d80 -1 Falling back to public interface 2021-10-20T23:19:40.499 INFO:tasks.ceph.osd.4.smithi031.stderr:2021-10-20T23:19:40.493+0000 7fa31c8c8d80 -1 Falling back to public interface 2021-10-20T23:19:40.515 INFO:tasks.ceph.osd.7.smithi031.stderr:2021-10-20T23:19:40.509+0000 7f310fdc5d80 -1 Falling back to public interface 2021-10-20T23:19:40.527 INFO:tasks.ceph.osd.6.smithi031.stderr:2021-10-20T23:19:40.521+0000 7faa01ecbd80 -1 Falling back to public interface 2021-10-20T23:19:40.713 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-10-20T23:19:40.804 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831f298700 1 Processor -- start 2021-10-20T23:19:40.805 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831f298700 1 -- start start 2021-10-20T23:19:40.808 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831f298700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f831813d310 0x7f8318142df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:40.808 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831f298700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180b0d20 con 0x7f83180ad3a0 2021-10-20T23:19:40.809 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831f298700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831813fa50 con 0x7f83180b0810 2021-10-20T23:19:40.809 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831f298700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831813f860 con 0x7f831813d310 2021-10-20T23:19:40.809 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d034700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f83180ad3a0 0x7f8318140190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34732/0 (socket says 172.21.15.12:34732) 2021-10-20T23:19:40.809 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d034700 1 -- 172.21.15.12:0/2816660886 learned_addr learned my addr 172.21.15.12:0/2816660886 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:40.810 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d835700 1 --2- 172.21.15.12:0/2816660886 >> v2:172.21.15.31:3300/0 conn(0x7f831813d310 0x7f8318142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:40.810 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811085524 0 0) 0x7f83180b0d20 con 0x7f83180ad3a0 2021-10-20T23:19:40.810 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82fc003260 con 0x7f83180ad3a0 2021-10-20T23:19:40.810 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000968238 0 0) 0x7f831813fa50 con 0x7f83180b0810 2021-10-20T23:19:40.811 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83180b0d20 con 0x7f83180b0810 2021-10-20T23:19:40.811 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 397184488 0 0) 0x7f82fc003260 con 0x7f83180ad3a0 2021-10-20T23:19:40.811 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 >> v2:172.21.15.31:3300/0 conn(0x7f831813d310 msgr2=0x7f8318142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:40.811 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 --2- 172.21.15.12:0/2816660886 >> v2:172.21.15.31:3300/0 conn(0x7f831813d310 0x7f8318142df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:40.812 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 >> v1:172.21.15.31:6789/0 conn(0x7f83180b0810 legacy=0x7f831813cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:40.812 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831813fcf0 con 0x7f83180ad3a0 2021-10-20T23:19:40.812 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f8308001660 con 0x7f83180ad3a0 2021-10-20T23:19:40.812 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 >> v1:172.21.15.12:6789/0 conn(0x7f83180ad3a0 legacy=0x7f8318140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:40.812 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc0038e0 0x7f82fc003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:40.813 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82fc004500 0x7f82fc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:40.813 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82fc004e70 0x7f82fc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:40.813 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc00bcf0 con 0x7f82fc004e70 2021-10-20T23:19:40.813 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc00be30 con 0x7f82fc0038e0 2021-10-20T23:19:40.814 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc00bff0 con 0x7f82fc004500 2021-10-20T23:19:40.814 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d835700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82fc004e70 0x7f82fc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:40.814 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d034700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc0038e0 0x7f82fc003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:40.814 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831c833700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82fc004500 0x7f82fc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:40.815 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d835700 1 -- 172.21.15.12:0/2816660886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82fc004500 msgr2=0x7f82fc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:40.815 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d835700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82fc004500 0x7f82fc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:40.815 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d835700 1 -- 172.21.15.12:0/2816660886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc0038e0 msgr2=0x7f82fc003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:40.816 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d835700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc0038e0 0x7f82fc003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:40.816 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831d835700 1 -- 172.21.15.12:0/2816660886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc003260 con 0x7f82fc004e70 2021-10-20T23:19:40.816 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.796+0000 7f831c833700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82fc004500 0x7f82fc004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:19:40.816 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f831d835700 1 -- 172.21.15.12:0/2816660886 reap_dead start 2021-10-20T23:19:40.816 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f831d835700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82fc004e70 0x7f82fc00b750 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f831400d000 tx=0x7f8314006e80).ready entity=mon.0 client_cookie=57eec47e1992a737 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:40.817 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831400c4a0 con 0x7f82fc004e70 2021-10-20T23:19:40.817 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831400f720 con 0x7f82fc004e70 2021-10-20T23:19:40.817 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f830ffff700 1 -- 172.21.15.12:0/2816660886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831400fa80 con 0x7f82fc004e70 2021-10-20T23:19:40.820 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f831f298700 1 -- 172.21.15.12:0/2816660886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82fc004e70 msgr2=0x7f82fc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:40.821 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f831f298700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82fc004e70 0x7f82fc00b750 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f831400d000 tx=0x7f8314006e80).stop 2021-10-20T23:19:40.821 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f831f298700 1 -- 172.21.15.12:0/2816660886 shutdown_connections 2021-10-20T23:19:40.821 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f831f298700 1 --2- 172.21.15.12:0/2816660886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82fc004e70 0x7f82fc00b750 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:40.821 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f831f298700 1 -- 172.21.15.12:0/2816660886 >> 172.21.15.12:0/2816660886 conn(0x7f83180630c0 msgr2=0x7f83180634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:40.822 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f831f298700 1 -- 172.21.15.12:0/2816660886 shutdown_connections 2021-10-20T23:19:40.822 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.800+0000 7f831f298700 1 -- 172.21.15.12:0/2816660886 wait complete. 2021-10-20T23:19:40.823 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 Processor -- start 2021-10-20T23:19:40.823 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 -- start start 2021-10-20T23:19:40.823 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc004e70 0x7f83180a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:40.823 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318140c20 0x7f83180ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:40.824 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83180aca60 0x7f8318142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:40.824 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831813d700 con 0x7f8318140c20 2021-10-20T23:19:40.824 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8318153480 con 0x7f82fc004e70 2021-10-20T23:19:40.824 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83181419e0 con 0x7f83180aca60 2021-10-20T23:19:40.824 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d835700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83180aca60 0x7f8318142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:40.825 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d034700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc004e70 0x7f83180a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:40.825 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831c833700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318140c20 0x7f83180ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:40.825 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d835700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83180aca60 0x7f8318142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:41908/0 (socket says 172.21.15.12:41908) 2021-10-20T23:19:40.825 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d835700 1 -- 172.21.15.12:0/1465776163 learned_addr learned my addr 172.21.15.12:0/1465776163 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:40.826 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d835700 1 -- 172.21.15.12:0/1465776163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc004e70 msgr2=0x7f83180a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:40.826 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d835700 1 --2- 172.21.15.12:0/1465776163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc004e70 0x7f83180a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:40.826 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d835700 1 -- 172.21.15.12:0/1465776163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318140c20 msgr2=0x7f83180ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:40.826 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d835700 1 --2- 172.21.15.12:0/1465776163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318140c20 0x7f83180ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:40.827 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d835700 1 -- 172.21.15.12:0/1465776163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318141c80 con 0x7f83180aca60 2021-10-20T23:19:40.827 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831d835700 1 --2- 172.21.15.12:0/1465776163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83180aca60 0x7f8318142120 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f831813f4c0 tx=0x7f8314006e80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:40.827 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f830e7fc700 1 -- 172.21.15.12:0/1465776163 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831400c4a0 con 0x7f83180aca60 2021-10-20T23:19:40.827 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f830e7fc700 1 -- 172.21.15.12:0/1465776163 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314000e90 con 0x7f83180aca60 2021-10-20T23:19:40.827 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 -- 172.21.15.12:0/1465776163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83181531b0 con 0x7f83180aca60 2021-10-20T23:19:40.828 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f830e7fc700 1 -- 172.21.15.12:0/1465776163 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831401a410 con 0x7f83180aca60 2021-10-20T23:19:40.828 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.804+0000 7f831f298700 1 -- 172.21.15.12:0/1465776163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83180a9c50 con 0x7f83180aca60 2021-10-20T23:19:40.828 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.808+0000 7f830e7fc700 1 -- 172.21.15.12:0/1465776163 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 2) v1 ==== 32742+0+0 (secure 0 0 0) 0x7f831402b070 con 0x7f83180aca60 2021-10-20T23:19:40.828 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.808+0000 7f830e7fc700 1 -- 172.21.15.12:0/1465776163 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f831403b760 con 0x7f83180aca60 2021-10-20T23:19:40.829 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.808+0000 7f831f298700 1 -- 172.21.15.12:0/1465776163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8318141e10 con 0x7f83180aca60 2021-10-20T23:19:40.829 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.812+0000 7f830e7fc700 1 -- 172.21.15.12:0/1465776163 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f8314010350 con 0x7f83180aca60 2021-10-20T23:19:40.882 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.872+0000 7f831f298700 1 -- 172.21.15.12:0/1465776163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83180afa10 con 0x7f83180aca60 2021-10-20T23:19:40.883 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.872+0000 7f830e7fc700 1 -- 172.21.15.12:0/1465776163 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7f831402cb40 con 0x7f83180aca60 2021-10-20T23:19:40.884 INFO:teuthology.misc.health.smithi012.stdout: 2021-10-20T23:19:40.884 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:39.854252+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:19:40.885 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.876+0000 7f831f298700 1 -- 172.21.15.12:0/1465776163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83180aca60 msgr2=0x7f8318142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:40.885 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.876+0000 7f831f298700 1 --2- 172.21.15.12:0/1465776163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83180aca60 0x7f8318142120 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f831813f4c0 tx=0x7f8314006e80).stop 2021-10-20T23:19:40.885 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.876+0000 7f831f298700 1 -- 172.21.15.12:0/1465776163 shutdown_connections 2021-10-20T23:19:40.886 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.876+0000 7f831f298700 1 --2- 172.21.15.12:0/1465776163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83180aca60 0x7f8318142120 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:40.886 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.876+0000 7f831f298700 1 --2- 172.21.15.12:0/1465776163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318140c20 0x7f83180ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:40.886 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.876+0000 7f831f298700 1 --2- 172.21.15.12:0/1465776163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc004e70 0x7f83180a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:40.886 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.876+0000 7f831f298700 1 -- 172.21.15.12:0/1465776163 >> 172.21.15.12:0/1465776163 conn(0x7f83180630c0 msgr2=0x7f83181400b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:40.887 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.876+0000 7f831f298700 1 -- 172.21.15.12:0/1465776163 shutdown_connections 2021-10-20T23:19:40.887 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:40.876+0000 7f831f298700 1 -- 172.21.15.12:0/1465776163 wait complete. 2021-10-20T23:19:40.894 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-10-20T23:19:41.216 INFO:tasks.ceph.osd.0.smithi012.stderr:2021-10-20T23:19:41.208+0000 7f4edf8ccd80 -1 osd.0 0 log_to_monitors {default=true} 2021-10-20T23:19:41.449 INFO:tasks.ceph.osd.3.smithi012.stderr:2021-10-20T23:19:41.440+0000 7fc8a449cd80 -1 osd.3 0 log_to_monitors {default=true} 2021-10-20T23:19:41.495 INFO:tasks.ceph.osd.5.smithi031.stderr:2021-10-20T23:19:41.489+0000 7f12e72ced80 -1 osd.5 0 log_to_monitors {default=true} 2021-10-20T23:19:41.511 INFO:tasks.ceph.osd.2.smithi012.stderr:2021-10-20T23:19:41.500+0000 7ff8903cbd80 -1 osd.2 0 log_to_monitors {default=true} 2021-10-20T23:19:41.644 INFO:tasks.ceph.osd.4.smithi031.stderr:2021-10-20T23:19:41.637+0000 7fa31c8c8d80 -1 osd.4 0 log_to_monitors {default=true} 2021-10-20T23:19:41.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2021-10-20T23:19:41.664+0000 7fbceede9d80 -1 osd.1 0 log_to_monitors {default=true} 2021-10-20T23:19:41.678 INFO:tasks.ceph.osd.7.smithi031.stderr:2021-10-20T23:19:41.673+0000 7f310fdc5d80 -1 osd.7 0 log_to_monitors {default=true} 2021-10-20T23:19:41.705 INFO:tasks.ceph.osd.6.smithi031.stderr:2021-10-20T23:19:41.697+0000 7faa01ecbd80 -1 osd.6 0 log_to_monitors {default=true} 2021-10-20T23:19:42.989 INFO:tasks.ceph.osd.3.smithi012.stderr:2021-10-20T23:19:42.980+0000 7fc896541700 -1 osd.3 0 waiting for initial osdmap 2021-10-20T23:19:42.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2021-10-20T23:19:42.980+0000 7f4ed1971700 -1 osd.0 0 waiting for initial osdmap 2021-10-20T23:19:42.990 INFO:tasks.ceph.osd.7.smithi031.stderr:2021-10-20T23:19:42.985+0000 7f3101e6a700 -1 osd.7 0 waiting for initial osdmap 2021-10-20T23:19:42.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2021-10-20T23:19:42.980+0000 7fbce0e8e700 -1 osd.1 0 waiting for initial osdmap 2021-10-20T23:19:42.991 INFO:tasks.ceph.osd.5.smithi031.stderr:2021-10-20T23:19:42.985+0000 7f12d9373700 -1 osd.5 0 waiting for initial osdmap 2021-10-20T23:19:42.992 INFO:tasks.ceph.osd.4.smithi031.stderr:2021-10-20T23:19:42.985+0000 7fa30e96d700 -1 osd.4 0 waiting for initial osdmap 2021-10-20T23:19:42.992 INFO:tasks.ceph.osd.6.smithi031.stderr:2021-10-20T23:19:42.985+0000 7fa9f3f70700 -1 osd.6 0 waiting for initial osdmap 2021-10-20T23:19:42.993 INFO:tasks.ceph.osd.2.smithi012.stderr:2021-10-20T23:19:42.984+0000 7ff882470700 -1 osd.2 0 waiting for initial osdmap 2021-10-20T23:19:42.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2021-10-20T23:19:42.988+0000 7fbce830c700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-20T23:19:43.000 INFO:tasks.ceph.osd.4.smithi031.stderr:2021-10-20T23:19:42.993+0000 7fa315deb700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-20T23:19:43.000 INFO:tasks.ceph.osd.3.smithi012.stderr:2021-10-20T23:19:42.992+0000 7fc89d9bf700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-20T23:19:43.001 INFO:tasks.ceph.osd.6.smithi031.stderr:2021-10-20T23:19:42.993+0000 7fa9fb3ee700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-20T23:19:43.001 INFO:tasks.ceph.osd.2.smithi012.stderr:2021-10-20T23:19:42.992+0000 7ff8898ee700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-20T23:19:43.001 INFO:tasks.ceph.osd.5.smithi031.stderr:2021-10-20T23:19:42.997+0000 7f12e07f1700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-20T23:19:43.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2021-10-20T23:19:42.996+0000 7f4ed8def700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-20T23:19:43.004 INFO:tasks.ceph.osd.7.smithi031.stderr:2021-10-20T23:19:42.997+0000 7f31092e8700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-20T23:19:47.703 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-10-20T23:19:47.803 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.795+0000 7f3431799700 1 Processor -- start 2021-10-20T23:19:47.803 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.795+0000 7f3431799700 1 -- start start 2021-10-20T23:19:47.806 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c13fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:47.806 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c0b3ae0 con 0x7f342c0adb40 2021-10-20T23:19:47.806 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c143300 con 0x7f342c0b0370 2021-10-20T23:19:47.806 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c1435a0 con 0x7f342c0b3700 2021-10-20T23:19:47.807 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3430f98700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f342c0adb40 0x7f342c14a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34962/0 (socket says 172.21.15.12:34962) 2021-10-20T23:19:47.807 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3430f98700 1 -- 172.21.15.12:0/125361513 learned_addr learned my addr 172.21.15.12:0/125361513 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:47.807 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342bfff700 1 --2- 172.21.15.12:0/125361513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c13fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:47.807 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342b7fe700 1 -- 172.21.15.12:0/125361513 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927491727 0 0) 0x7f342c0b3ae0 con 0x7f342c0adb40 2021-10-20T23:19:47.808 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342b7fe700 1 -- 172.21.15.12:0/125361513 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3410003260 con 0x7f342c0adb40 2021-10-20T23:19:47.808 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342b7fe700 1 -- 172.21.15.12:0/125361513 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272949117 0 0) 0x7f342c143300 con 0x7f342c0b0370 2021-10-20T23:19:47.808 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342b7fe700 1 -- 172.21.15.12:0/125361513 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f342c0b3ae0 con 0x7f342c0b0370 2021-10-20T23:19:47.808 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342bfff700 1 -- 172.21.15.12:0/125361513 >> v1:172.21.15.31:6789/0 conn(0x7f342c0b0370 legacy=0x7f342c066910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:47.809 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342bfff700 1 -- 172.21.15.12:0/125361513 >> v1:172.21.15.12:6789/0 conn(0x7f342c0adb40 legacy=0x7f342c14a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:47.809 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342bfff700 1 -- 172.21.15.12:0/125361513 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c143840 con 0x7f342c0b3700 2021-10-20T23:19:47.809 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342bfff700 1 --2- 172.21.15.12:0/125361513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c13fd10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f341c002f70 tx=0x7f341c006df0).ready entity=mon.2 client_cookie=75f9ea1afd0b3e10 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:47.813 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342b7fe700 1 -- 172.21.15.12:0/125361513 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f341c00d5c0 con 0x7f342c0b3700 2021-10-20T23:19:47.814 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342b7fe700 1 -- 172.21.15.12:0/125361513 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c000e90 con 0x7f342c0b3700 2021-10-20T23:19:47.814 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f342b7fe700 1 -- 172.21.15.12:0/125361513 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f341c00d910 con 0x7f342c0b3700 2021-10-20T23:19:47.814 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 -- 172.21.15.12:0/125361513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 msgr2=0x7f342c13fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:47.814 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 --2- 172.21.15.12:0/125361513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c13fd10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f341c002f70 tx=0x7f341c006df0).stop 2021-10-20T23:19:47.815 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 -- 172.21.15.12:0/125361513 shutdown_connections 2021-10-20T23:19:47.815 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 --2- 172.21.15.12:0/125361513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c13fd10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:47.815 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 -- 172.21.15.12:0/125361513 >> 172.21.15.12:0/125361513 conn(0x7f342c05c830 msgr2=0x7f342c05cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:47.815 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 -- 172.21.15.12:0/125361513 shutdown_connections 2021-10-20T23:19:47.816 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.799+0000 7f3431799700 1 -- 172.21.15.12:0/125361513 wait complete. 2021-10-20T23:19:47.816 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3431799700 1 Processor -- start 2021-10-20T23:19:47.816 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3431799700 1 -- start start 2021-10-20T23:19:47.816 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3431799700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f342c0adb40 0x7f342c142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:47.817 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3431799700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f342c0b0370 0x7f342c13f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:47.817 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3431799700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:47.817 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3431799700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c134a20 con 0x7f342c0b0370 2021-10-20T23:19:47.817 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3431799700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c134240 con 0x7f342c0adb40 2021-10-20T23:19:47.818 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3431799700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c1344e0 con 0x7f342c0b3700 2021-10-20T23:19:47.818 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3423fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f342c0b0370 0x7f342c13f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:47.818 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3423fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f342c0b0370 0x7f342c13f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36374/0 (socket says 172.21.15.12:36374) 2021-10-20T23:19:47.818 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3423fff700 1 -- 172.21.15.12:0/1429400610 learned_addr learned my addr 172.21.15.12:0/1429400610 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:47.819 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f3430f98700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:47.819 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.803+0000 7f342bfff700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f342c0adb40 0x7f342c142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:47.819 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3423fff700 1 -- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 msgr2=0x7f342c150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:47.819 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3423fff700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:47.819 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3423fff700 1 -- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f342c0adb40 msgr2=0x7f342c142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:47.820 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3423fff700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f342c0adb40 0x7f342c142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:47.820 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3423fff700 1 -- 172.21.15.12:0/1429400610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c00b180 con 0x7f342c0b0370 2021-10-20T23:19:47.820 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3430f98700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:19:47.820 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3423fff700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f342c0b0370 0x7f342c13f6e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3414001110 tx=0x7f3414007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:47.821 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3429ffb700 1 -- 172.21.15.12:0/1429400610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3414012400 con 0x7f342c0b0370 2021-10-20T23:19:47.821 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3429ffb700 1 -- 172.21.15.12:0/1429400610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3414012560 con 0x7f342c0b0370 2021-10-20T23:19:47.821 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c134780 con 0x7f342c0b0370 2021-10-20T23:19:47.821 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3429ffb700 1 -- 172.21.15.12:0/1429400610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34140128c0 con 0x7f342c0b0370 2021-10-20T23:19:47.822 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c13d630 con 0x7f342c0b0370 2021-10-20T23:19:47.825 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c14fef0 con 0x7f342c0b0370 2021-10-20T23:19:47.825 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.807+0000 7f3429ffb700 1 -- 172.21.15.12:0/1429400610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3414019030 con 0x7f342c0b0370 2021-10-20T23:19:47.826 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.811+0000 7f3429ffb700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3404053610 0x7f3404055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:47.826 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.811+0000 7f3429ffb700 1 -- 172.21.15.12:0/1429400610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f341406a770 con 0x7f342c0b0370 2021-10-20T23:19:47.826 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.811+0000 7f342bfff700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3404053610 0x7f3404055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:47.827 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.811+0000 7f342bfff700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3404053610 0x7f3404055ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f341c018000 tx=0x7f341c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:47.827 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.819+0000 7f3429ffb700 1 -- 172.21.15.12:0/1429400610 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3414041d60 con 0x7f342c0b0370 2021-10-20T23:19:47.957 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.951+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f342c057350 con 0x7f342c0b0370 2021-10-20T23:19:47.959 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.951+0000 7f3429ffb700 1 -- 172.21.15.12:0/1429400610 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11805 (secure 0 0 0) 0x7f3414045380 con 0x7f342c0b0370 2021-10-20T23:19:47.959 INFO:teuthology.misc.health.smithi012.stdout: 2021-10-20T23:19:47.960 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":16,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:45.997698+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:19:47.963 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3404053610 msgr2=0x7f3404055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:47.963 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3404053610 0x7f3404055ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f341c018000 tx=0x7f341c014000).stop 2021-10-20T23:19:47.963 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f342c0b0370 msgr2=0x7f342c13f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:47.964 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f342c0b0370 0x7f342c13f6e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3414001110 tx=0x7f3414007a60).stop 2021-10-20T23:19:47.964 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 shutdown_connections 2021-10-20T23:19:47.964 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3404053610 0x7f3404055ad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:47.964 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f342c0b3700 0x7f342c150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:47.964 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f342c0b0370 0x7f342c13f6e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:47.965 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 --2- 172.21.15.12:0/1429400610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f342c0adb40 0x7f342c142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:47.965 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 >> 172.21.15.12:0/1429400610 conn(0x7f342c05c830 msgr2=0x7f342c05f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:47.965 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 shutdown_connections 2021-10-20T23:19:47.965 INFO:teuthology.misc.health.smithi012.stderr:2021-10-20T23:19:47.955+0000 7f3431799700 1 -- 172.21.15.12:0/1429400610 wait complete. 2021-10-20T23:19:47.977 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-10-20T23:19:47.977 INFO:tasks.ceph:Creating RBD pool 2021-10-20T23:19:47.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool create rbd 8 2021-10-20T23:19:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f4261ad1700 1 Processor -- start 2021-10-20T23:19:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f4261ad1700 1 -- start start 2021-10-20T23:19:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f4261ad1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f425c0b7370 0x7f425c0b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f4261ad1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f425c0b3060 0x7f425c13e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f4261ad1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c0b2380 con 0x7f425c13e710 2021-10-20T23:19:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f4261ad1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425c144250 con 0x7f425c0b7370 2021-10-20T23:19:48.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f4261ad1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0b3570 con 0x7f425c0b3060 2021-10-20T23:19:48.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f42612d0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f425c13e710 0x7f425c064ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34978/0 (socket says 172.21.15.12:34978) 2021-10-20T23:19:48.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f42612d0700 1 -- 172.21.15.12:0/968400337 learned_addr learned my addr 172.21.15.12:0/968400337 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:48.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f4260acf700 1 --2- 172.21.15.12:0/968400337 >> v2:172.21.15.31:3300/0 conn(0x7f425c0b7370 0x7f425c0b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:48.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f425bfff700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f425c0b3060 0x7f425c13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:48.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937786940 0 0) 0x7f425c0b2380 con 0x7f425c13e710 2021-10-20T23:19:48.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f423c003260 con 0x7f425c13e710 2021-10-20T23:19:48.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446244822 0 0) 0x7f423c003260 con 0x7f425c13e710 2021-10-20T23:19:48.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f425c0b3060 msgr2=0x7f425c13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:48.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f425b7fe700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f425c0b3060 0x7f425c13e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:48.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 >> v2:172.21.15.31:3300/0 conn(0x7f425c0b7370 msgr2=0x7f425c0b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:48.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.079+0000 7f425b7fe700 1 --2- 172.21.15.12:0/968400337 >> v2:172.21.15.31:3300/0 conn(0x7f425c0b7370 0x7f425c0b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:48.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c0b25b0 con 0x7f425c13e710 2021-10-20T23:19:48.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f42540019e0 con 0x7f425c13e710 2021-10-20T23:19:48.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 >> v1:172.21.15.12:6789/0 conn(0x7f425c13e710 legacy=0x7f425c064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:48.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f425c0b3060 0x7f423c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:48.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c003c80 0x7f423c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:48.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f423c0049f0 0x7f423c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:48.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c144250 con 0x7f423c003c80 2021-10-20T23:19:48.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0b3570 con 0x7f423c0049f0 2021-10-20T23:19:48.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c00b750 con 0x7f425c0b3060 2021-10-20T23:19:48.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425bfff700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c003c80 0x7f423c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:48.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f4260acf700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f425c0b3060 0x7f423c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:48.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f42612d0700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f423c0049f0 0x7f423c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:48.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425bfff700 1 -- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f425c0b3060 msgr2=0x7f423c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:48.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425bfff700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f425c0b3060 0x7f423c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:48.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425bfff700 1 -- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f423c0049f0 msgr2=0x7f423c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:48.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425bfff700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f423c0049f0 0x7f423c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425bfff700 1 -- 172.21.15.12:0/968400337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c003260 con 0x7f423c003c80 2021-10-20T23:19:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f42612d0700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f423c0049f0 0x7f423c004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:19:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425bfff700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c003c80 0x7f423c004500 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f423c0054d0 tx=0x7f424c006df0).ready entity=mon.0 client_cookie=5775b94885d908c4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f424c00e830 con 0x7f423c003c80 2021-10-20T23:19:48.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c00e990 con 0x7f423c003c80 2021-10-20T23:19:48.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f425b7fe700 1 -- 172.21.15.12:0/968400337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f424c00ecf0 con 0x7f423c003c80 2021-10-20T23:19:48.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f4261ad1700 1 -- 172.21.15.12:0/968400337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c003c80 msgr2=0x7f423c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:48.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f4261ad1700 1 --2- 172.21.15.12:0/968400337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c003c80 0x7f423c004500 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f423c0054d0 tx=0x7f424c006df0).stop 2021-10-20T23:19:48.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f42612d0700 1 -- 172.21.15.12:0/968400337 reap_dead start 2021-10-20T23:19:48.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f4261ad1700 1 -- 172.21.15.12:0/968400337 shutdown_connections 2021-10-20T23:19:48.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f4261ad1700 1 -- 172.21.15.12:0/968400337 >> 172.21.15.12:0/968400337 conn(0x7f425c05f6b0 msgr2=0x7f425c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:48.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f4261ad1700 1 -- 172.21.15.12:0/968400337 shutdown_connections 2021-10-20T23:19:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.083+0000 7f4261ad1700 1 -- 172.21.15.12:0/968400337 wait complete. 2021-10-20T23:19:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4261ad1700 1 Processor -- start 2021-10-20T23:19:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4261ad1700 1 -- start start 2021-10-20T23:19:48.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4261ad1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c003c80 0x7f425c0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:48.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4261ad1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f425c0ac2c0 0x7f425c0ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:48.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4261ad1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f425c0adbb0 0x7f425c13c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:48.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4261ad1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0ac9e0 con 0x7f425c0adbb0 2021-10-20T23:19:48.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4261ad1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0626a0 con 0x7f425c0ac2c0 2021-10-20T23:19:48.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4261ad1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0acc10 con 0x7f423c003c80 2021-10-20T23:19:48.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f42612d0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f425c0adbb0 0x7f425c13c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:48.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f42612d0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f425c0adbb0 0x7f425c13c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36394/0 (socket says 172.21.15.12:36394) 2021-10-20T23:19:48.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f42612d0700 1 -- 172.21.15.12:0/303768257 learned_addr learned my addr 172.21.15.12:0/303768257 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:48.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4260acf700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c003c80 0x7f425c0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:48.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f425bfff700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f425c0ac2c0 0x7f425c0ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:48.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f42612d0700 1 -- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c003c80 msgr2=0x7f425c0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:48.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f42612d0700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c003c80 0x7f425c0b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:48.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f42612d0700 1 -- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f425c0ac2c0 msgr2=0x7f425c0ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:48.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f42612d0700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f425c0ac2c0 0x7f425c0ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:48.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f42612d0700 1 -- 172.21.15.12:0/303768257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c0acf20 con 0x7f425c0adbb0 2021-10-20T23:19:48.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f42612d0700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f425c0adbb0 0x7f425c13c630 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4254001210 tx=0x7f425c0669e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:48.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4259ffb700 1 -- 172.21.15.12:0/303768257 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4254010710 con 0x7f425c0adbb0 2021-10-20T23:19:48.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4259ffb700 1 -- 172.21.15.12:0/303768257 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4254010870 con 0x7f425c0adbb0 2021-10-20T23:19:48.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425c0ae030 con 0x7f425c0adbb0 2021-10-20T23:19:48.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.087+0000 7f4259ffb700 1 -- 172.21.15.12:0/303768257 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4254010bd0 con 0x7f425c0adbb0 2021-10-20T23:19:48.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.091+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425c061960 con 0x7f425c0adbb0 2021-10-20T23:19:48.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.091+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425c062810 con 0x7f425c0adbb0 2021-10-20T23:19:48.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.091+0000 7f4259ffb700 1 -- 172.21.15.12:0/303768257 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4254010d30 con 0x7f425c0adbb0 2021-10-20T23:19:48.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.091+0000 7f4259ffb700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4240053520 0x7f42400559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:48.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.091+0000 7f4259ffb700 1 -- 172.21.15.12:0/303768257 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f425406b2b0 con 0x7f425c0adbb0 2021-10-20T23:19:48.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.091+0000 7f4260acf700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4240053520 0x7f42400559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:48.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.091+0000 7f4260acf700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4240053520 0x7f42400559e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4244006000 tx=0x7f4244006d90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:48.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.095+0000 7f4259ffb700 1 -- 172.21.15.12:0/303768257 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f425c062810 con 0x7f425c0adbb0 2021-10-20T23:19:48.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:48.227+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f425c062810 con 0x7f425c0adbb0 2021-10-20T23:19:49.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.027+0000 7f4259ffb700 1 -- 172.21.15.12:0/303768257 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f425c062810 con 0x7f425c0adbb0 2021-10-20T23:19:49.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4240053520 msgr2=0x7f42400559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:49.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4240053520 0x7f42400559e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4244006000 tx=0x7f4244006d90).stop 2021-10-20T23:19:49.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f425c0adbb0 msgr2=0x7f425c13c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:49.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f425c0adbb0 0x7f425c13c630 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4254001210 tx=0x7f425c0669e0).stop 2021-10-20T23:19:49.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 shutdown_connections 2021-10-20T23:19:49.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4240053520 0x7f42400559e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:49.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f425c0adbb0 0x7f425c13c630 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:49.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f425c0ac2c0 0x7f425c0ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:49.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 --2- 172.21.15.12:0/303768257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c003c80 0x7f425c0b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:49.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 >> 172.21.15.12:0/303768257 conn(0x7f425c05f6b0 msgr2=0x7f425c13da80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:49.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 shutdown_connections 2021-10-20T23:19:49.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.031+0000 7f4261ad1700 1 -- 172.21.15.12:0/303768257 wait complete. 2021-10-20T23:19:49.040 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'rbd' created 2021-10-20T23:19:49.053 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-10-20T23:19:49.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c402b7700 1 Processor -- start 2021-10-20T23:19:49.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c402b7700 1 -- start start 2021-10-20T23:19:49.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c402b7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 0x7f4c380b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:49.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c402b7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c380b5b40 0x7f4c38148040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:49.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c402b7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c380b6960 con 0x7f4c380b0c50 2021-10-20T23:19:49.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c402b7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c381474b0 con 0x7f4c380b5b40 2021-10-20T23:19:49.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c402b7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380b60c0 con 0x7f4c380b6580 2021-10-20T23:19:49.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c3d852700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c380b5b40 0x7f4c38148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:49.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c3d852700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c380b5b40 0x7f4c38148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36402/0 (socket says 172.21.15.12:36402) 2021-10-20T23:19:49.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c3e854700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4c380b0c50 0x7f4c381446d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34998/0 (socket says 172.21.15.12:34998) 2021-10-20T23:19:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c3d852700 1 -- 172.21.15.12:0/1538413256 learned_addr learned my addr 172.21.15.12:0/1538413256 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.159+0000 7f4c3e053700 1 --2- 172.21.15.12:0/1538413256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 0x7f4c380b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c3d852700 1 -- 172.21.15.12:0/1538413256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 msgr2=0x7f4c380b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:49.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c3d852700 1 --2- 172.21.15.12:0/1538413256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 0x7f4c380b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:49.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c3d852700 1 -- 172.21.15.12:0/1538413256 >> v1:172.21.15.12:6789/0 conn(0x7f4c380b0c50 legacy=0x7f4c381446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:49.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c3d051700 1 -- 172.21.15.12:0/1538413256 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614766788 0 0) 0x7f4c380b6960 con 0x7f4c380b0c50 2021-10-20T23:19:49.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c3d852700 1 -- 172.21.15.12:0/1538413256 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c381476a0 con 0x7f4c380b5b40 2021-10-20T23:19:49.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c3d852700 1 --2- 172.21.15.12:0/1538413256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b5b40 0x7f4c38148040 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4c2c002f70 tx=0x7f4c2c006eb0).ready entity=mon.0 client_cookie=46157d5dc15e6403 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:49.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c3d051700 1 -- 172.21.15.12:0/1538413256 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c2c00d570 con 0x7f4c380b5b40 2021-10-20T23:19:49.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c3d051700 1 -- 172.21.15.12:0/1538413256 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c000e90 con 0x7f4c380b5b40 2021-10-20T23:19:49.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c3d051700 1 -- 172.21.15.12:0/1538413256 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c2c00d8c0 con 0x7f4c380b5b40 2021-10-20T23:19:49.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 -- 172.21.15.12:0/1538413256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b5b40 msgr2=0x7f4c38148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:49.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 --2- 172.21.15.12:0/1538413256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b5b40 0x7f4c38148040 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4c2c002f70 tx=0x7f4c2c006eb0).stop 2021-10-20T23:19:49.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 -- 172.21.15.12:0/1538413256 shutdown_connections 2021-10-20T23:19:49.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 --2- 172.21.15.12:0/1538413256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b5b40 0x7f4c38148040 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:49.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 --2- 172.21.15.12:0/1538413256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 0x7f4c380b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:49.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 -- 172.21.15.12:0/1538413256 >> 172.21.15.12:0/1538413256 conn(0x7f4c3805c490 msgr2=0x7f4c3805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:49.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 -- 172.21.15.12:0/1538413256 shutdown_connections 2021-10-20T23:19:49.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 -- 172.21.15.12:0/1538413256 wait complete. 2021-10-20T23:19:49.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 Processor -- start 2021-10-20T23:19:49.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.163+0000 7f4c402b7700 1 -- start start 2021-10-20T23:19:49.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c402b7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b0c50 0x7f4c3813d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:49.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c402b7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c380b5b40 0x7f4c3815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c402b7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 0x7f4c38140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c402b7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c38142910 con 0x7f4c380b0c50 2021-10-20T23:19:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c402b7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c38159d10 con 0x7f4c380b5b40 2021-10-20T23:19:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c402b7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3813ebe0 con 0x7f4c380b6580 2021-10-20T23:19:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e053700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b0c50 0x7f4c3813d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:49.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e053700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b0c50 0x7f4c3813d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36406/0 (socket says 172.21.15.12:36406) 2021-10-20T23:19:49.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e053700 1 -- 172.21.15.12:0/3559092498 learned_addr learned my addr 172.21.15.12:0/3559092498 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:49.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e854700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 0x7f4c38140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:49.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3d852700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c380b5b40 0x7f4c3815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e053700 1 -- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 msgr2=0x7f4c38140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e053700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 0x7f4c38140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e053700 1 -- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c380b5b40 msgr2=0x7f4c3815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:49.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e053700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c380b5b40 0x7f4c3815a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:49.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e053700 1 -- 172.21.15.12:0/3559092498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c00b1e0 con 0x7f4c380b0c50 2021-10-20T23:19:49.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c3e053700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b0c50 0x7f4c3813d840 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4c3400c000 tx=0x7f4c34006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:49.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c2b7fe700 1 -- 172.21.15.12:0/3559092498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c34011750 con 0x7f4c380b0c50 2021-10-20T23:19:49.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c2b7fe700 1 -- 172.21.15.12:0/3559092498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c340118b0 con 0x7f4c380b0c50 2021-10-20T23:19:49.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c38142670 con 0x7f4c380b0c50 2021-10-20T23:19:49.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c2b7fe700 1 -- 172.21.15.12:0/3559092498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c34011c10 con 0x7f4c380b0c50 2021-10-20T23:19:49.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3813dfc0 con 0x7f4c380b0c50 2021-10-20T23:19:49.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.167+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c381472b0 con 0x7f4c380b0c50 2021-10-20T23:19:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.171+0000 7f4c2b7fe700 1 -- 172.21.15.12:0/3559092498 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c34011d70 con 0x7f4c380b0c50 2021-10-20T23:19:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.171+0000 7f4c2b7fe700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c180536a0 0x7f4c18055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.171+0000 7f4c2b7fe700 1 -- 172.21.15.12:0/3559092498 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f4c3406b940 con 0x7f4c380b0c50 2021-10-20T23:19:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.171+0000 7f4c3d852700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c180536a0 0x7f4c18055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.171+0000 7f4c3d852700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c180536a0 0x7f4c18055b60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4c2c01c000 tx=0x7f4c2c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:49.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.175+0000 7f4c2b7fe700 1 -- 172.21.15.12:0/3559092498 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c381472b0 con 0x7f4c380b0c50 2021-10-20T23:19:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:49.307+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4c381472b0 con 0x7f4c380b0c50 2021-10-20T23:19:50.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.035+0000 7f4c2b7fe700 1 -- 172.21.15.12:0/3559092498 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4c381472b0 con 0x7f4c380b0c50 2021-10-20T23:19:50.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c180536a0 msgr2=0x7f4c18055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c180536a0 0x7f4c18055b60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4c2c01c000 tx=0x7f4c2c015000).stop 2021-10-20T23:19:50.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b0c50 msgr2=0x7f4c3813d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b0c50 0x7f4c3813d840 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4c3400c000 tx=0x7f4c34006df0).stop 2021-10-20T23:19:50.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 shutdown_connections 2021-10-20T23:19:50.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c180536a0 0x7f4c18055b60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c380b6580 0x7f4c38140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c380b5b40 0x7f4c3815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 --2- 172.21.15.12:0/3559092498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c380b0c50 0x7f4c3813d840 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 >> 172.21.15.12:0/3559092498 conn(0x7f4c3805c490 msgr2=0x7f4c380adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:50.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 shutdown_connections 2021-10-20T23:19:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.043+0000 7f4c402b7700 1 -- 172.21.15.12:0/3559092498 wait complete. 2021-10-20T23:19:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:enabled application 'rbd' on pool 'rbd' 2021-10-20T23:19:50.064 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-10-20T23:19:50.064 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:19:50.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:19:50.067 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:19:50.067 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:19:50.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:19:50.070 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:19:50.071 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:19:50.071 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:19:50.073 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:19:50.074 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-10-20T23:19:50.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:19:50.136 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:19:50.143 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:19:50.154 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:19:50.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aaddbc700 1 Processor -- start 2021-10-20T23:19:50.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aaddbc700 1 -- start start 2021-10-20T23:19:50.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aaddbc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1aa8139cc0 0x7f1aa80acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aaddbc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1aa80b21c0 0x7f1aa81434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aaddbc700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa80ad070 con 0x7f1aa813a0a0 2021-10-20T23:19:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aaddbc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa80b2730 con 0x7f1aa8139cc0 2021-10-20T23:19:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aaddbc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa8060d40 con 0x7f1aa80b21c0 2021-10-20T23:19:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa7fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1aa813a0a0 0x7f1aa80b65c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35034/0 (socket says 172.21.15.12:35034) 2021-10-20T23:19:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa7fff700 1 -- 172.21.15.12:0/2900874332 learned_addr learned my addr 172.21.15.12:0/2900874332 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa77fe700 1 --2- 172.21.15.12:0/2900874332 >> v2:172.21.15.12:3300/0 conn(0x7f1aa8139cc0 0x7f1aa80acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa6ffd700 1 --2- 172.21.15.12:0/2900874332 >> v2:172.21.15.31:3300/0 conn(0x7f1aa80b21c0 0x7f1aa81434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa67fc700 1 -- 172.21.15.12:0/2900874332 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006140264 0 0) 0x7f1aa0001490 con 0x7f1aa813a0a0 2021-10-20T23:19:50.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa67fc700 1 -- 172.21.15.12:0/2900874332 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a94003260 con 0x7f1aa813a0a0 2021-10-20T23:19:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa77fe700 1 -- 172.21.15.12:0/2900874332 >> v2:172.21.15.31:3300/0 conn(0x7f1aa80b21c0 msgr2=0x7f1aa81434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa77fe700 1 --2- 172.21.15.12:0/2900874332 >> v2:172.21.15.31:3300/0 conn(0x7f1aa80b21c0 0x7f1aa81434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa77fe700 1 -- 172.21.15.12:0/2900874332 >> v1:172.21.15.12:6789/0 conn(0x7f1aa813a0a0 legacy=0x7f1aa80b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa77fe700 1 -- 172.21.15.12:0/2900874332 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa80b6cd0 con 0x7f1aa8139cc0 2021-10-20T23:19:50.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa6ffd700 1 --2- 172.21.15.12:0/2900874332 >> v2:172.21.15.31:3300/0 conn(0x7f1aa80b21c0 0x7f1aa81434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:19:50.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa77fe700 1 --2- 172.21.15.12:0/2900874332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 0x7f1aa80acb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1a98002f70 tx=0x7f1a98006df0).ready entity=mon.0 client_cookie=8899c5a8ac9ab3de server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.175+0000 7f1aa67fc700 1 -- 172.21.15.12:0/2900874332 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9800d4f0 con 0x7f1aa8139cc0 2021-10-20T23:19:50.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aa67fc700 1 -- 172.21.15.12:0/2900874332 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98000e90 con 0x7f1aa8139cc0 2021-10-20T23:19:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aa67fc700 1 -- 172.21.15.12:0/2900874332 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9800d840 con 0x7f1aa8139cc0 2021-10-20T23:19:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 -- 172.21.15.12:0/2900874332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 msgr2=0x7f1aa80acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 --2- 172.21.15.12:0/2900874332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 0x7f1aa80acb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1a98002f70 tx=0x7f1a98006df0).stop 2021-10-20T23:19:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 -- 172.21.15.12:0/2900874332 shutdown_connections 2021-10-20T23:19:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 --2- 172.21.15.12:0/2900874332 >> v2:172.21.15.31:3300/0 conn(0x7f1aa80b21c0 0x7f1aa81434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 --2- 172.21.15.12:0/2900874332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 0x7f1aa80acb80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 -- 172.21.15.12:0/2900874332 >> 172.21.15.12:0/2900874332 conn(0x7f1aa80b3480 msgr2=0x7f1aa80b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:50.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 -- 172.21.15.12:0/2900874332 shutdown_connections 2021-10-20T23:19:50.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 -- 172.21.15.12:0/2900874332 wait complete. 2021-10-20T23:19:50.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 Processor -- start 2021-10-20T23:19:50.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 -- start start 2021-10-20T23:19:50.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1aa80b21c0 0x7f1aa805f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.179+0000 7f1aaddbc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 0x7f1aa8150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aaddbc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1aa813a0a0 0x7f1aa81538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aaddbc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa813b4c0 con 0x7f1aa8139cc0 2021-10-20T23:19:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aaddbc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa813b760 con 0x7f1aa813a0a0 2021-10-20T23:19:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aaddbc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa813ba00 con 0x7f1aa80b21c0 2021-10-20T23:19:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 0x7f1aa8150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa77fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1aa80b21c0 0x7f1aa805f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 0x7f1aa8150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36446/0 (socket says 172.21.15.12:36446) 2021-10-20T23:19:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1aa813a0a0 0x7f1aa81538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa6ffd700 1 -- 172.21.15.12:0/24364972 learned_addr learned my addr 172.21.15.12:0/24364972 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa7fff700 1 -- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1aa80b21c0 msgr2=0x7f1aa805f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa7fff700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1aa80b21c0 0x7f1aa805f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa7fff700 1 -- 172.21.15.12:0/24364972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 msgr2=0x7f1aa8150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa7fff700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 0x7f1aa8150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa7fff700 1 -- 172.21.15.12:0/24364972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c00b180 con 0x7f1aa813a0a0 2021-10-20T23:19:50.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa7fff700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1aa813a0a0 0x7f1aa81538e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1aa0001620 tx=0x7f1aa0007ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa4ff9700 1 -- 172.21.15.12:0/24364972 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa0005ba0 con 0x7f1aa813a0a0 2021-10-20T23:19:50.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa4ff9700 1 -- 172.21.15.12:0/24364972 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0005d00 con 0x7f1aa813a0a0 2021-10-20T23:19:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9800b180 con 0x7f1aa813a0a0 2021-10-20T23:19:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aa4ff9700 1 -- 172.21.15.12:0/24364972 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa00072c0 con 0x7f1aa813a0a0 2021-10-20T23:19:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa8140e30 con 0x7f1aa813a0a0 2021-10-20T23:19:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.183+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa8060fa0 con 0x7f1aa813a0a0 2021-10-20T23:19:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.187+0000 7f1aa4ff9700 1 -- 172.21.15.12:0/24364972 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1aa001a060 con 0x7f1aa813a0a0 2021-10-20T23:19:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.187+0000 7f1aa4ff9700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a88053580 0x7f1a88055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.187+0000 7f1aa4ff9700 1 -- 172.21.15.12:0/24364972 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1aa006a9a0 con 0x7f1aa813a0a0 2021-10-20T23:19:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.187+0000 7f1aa77fe700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a88053580 0x7f1a88055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.187+0000 7f1aa77fe700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a88053580 0x7f1a88055a40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1a9801a000 tx=0x7f1a98014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.195+0000 7f1aa4ff9700 1 -- 172.21.15.12:0/24364972 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1aa0041ee0 con 0x7f1aa813a0a0 2021-10-20T23:19:50.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.323+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aa80ad070 con 0x7f1aa813a0a0 2021-10-20T23:19:50.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.323+0000 7f1aa4ff9700 1 -- 172.21.15.12:0/24364972 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f1aa80ad070 con 0x7f1aa813a0a0 2021-10-20T23:19:50.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:50.332 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:50.025677+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:19:50.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a88053580 msgr2=0x7f1a88055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a88053580 0x7f1a88055a40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1a9801a000 tx=0x7f1a98014000).stop 2021-10-20T23:19:50.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1aa813a0a0 msgr2=0x7f1aa81538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1aa813a0a0 0x7f1aa81538e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1aa0001620 tx=0x7f1aa0007ba0).stop 2021-10-20T23:19:50.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 shutdown_connections 2021-10-20T23:19:50.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a88053580 0x7f1a88055a40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1aa813a0a0 0x7f1aa81538e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa8139cc0 0x7f1aa8150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 --2- 172.21.15.12:0/24364972 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1aa80b21c0 0x7f1aa805f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 >> 172.21.15.12:0/24364972 conn(0x7f1aa80b3480 msgr2=0x7f1aa8139150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:50.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 shutdown_connections 2021-10-20T23:19:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.327+0000 7f1aaddbc700 1 -- 172.21.15.12:0/24364972 wait complete. 2021-10-20T23:19:50.347 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:19:50.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:19:50.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.443+0000 7f6cb7fff700 1 Processor -- start 2021-10-20T23:19:50.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.443+0000 7f6cb7fff700 1 -- start start 2021-10-20T23:19:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6cb80601a0 0x7f6cb80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6cb805c560 0x7f6cb80a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb80aa4a0 con 0x7f6cb80af3c0 2021-10-20T23:19:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb80b1450 con 0x7f6cb805c560 2021-10-20T23:19:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb80af7a0 con 0x7f6cb80601a0 2021-10-20T23:19:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6cb805c560 0x7f6cb80a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6cb805c560 0x7f6cb80a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36456/0 (socket says 172.21.15.12:36456) 2021-10-20T23:19:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb77fe700 1 -- 172.21.15.12:0/1337903010 learned_addr learned my addr 172.21.15.12:0/1337903010 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb67fc700 1 --2- 172.21.15.12:0/1337903010 >> v2:172.21.15.31:3300/0 conn(0x7f6cb80601a0 0x7f6cb80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb5ffb700 1 -- 172.21.15.12:0/1337903010 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078381784 0 0) 0x7f6cb80aa4a0 con 0x7f6cb80af3c0 2021-10-20T23:19:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb5ffb700 1 -- 172.21.15.12:0/1337903010 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c9c003260 con 0x7f6cb80af3c0 2021-10-20T23:19:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb77fe700 1 -- 172.21.15.12:0/1337903010 >> v2:172.21.15.31:3300/0 conn(0x7f6cb80601a0 msgr2=0x7f6cb80b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb77fe700 1 --2- 172.21.15.12:0/1337903010 >> v2:172.21.15.31:3300/0 conn(0x7f6cb80601a0 0x7f6cb80b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb77fe700 1 -- 172.21.15.12:0/1337903010 >> v1:172.21.15.31:6789/0 conn(0x7f6cb80af3c0 legacy=0x7f6cb8144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb77fe700 1 -- 172.21.15.12:0/1337903010 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb805fb80 con 0x7f6cb805c560 2021-10-20T23:19:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb67fc700 1 --2- 172.21.15.12:0/1337903010 >> v2:172.21.15.31:3300/0 conn(0x7f6cb80601a0 0x7f6cb80b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:19:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb77fe700 1 --2- 172.21.15.12:0/1337903010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 0x7f6cb80a8bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6cb00032f0 tx=0x7f6cb0009290).ready entity=mon.0 client_cookie=8855040ae9a7e89 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb5ffb700 1 -- 172.21.15.12:0/1337903010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cb000b680 con 0x7f6cb805c560 2021-10-20T23:19:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb5ffb700 1 -- 172.21.15.12:0/1337903010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb000b7e0 con 0x7f6cb805c560 2021-10-20T23:19:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb5ffb700 1 -- 172.21.15.12:0/1337903010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cb000b950 con 0x7f6cb805c560 2021-10-20T23:19:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 -- 172.21.15.12:0/1337903010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 msgr2=0x7f6cb80a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 --2- 172.21.15.12:0/1337903010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 0x7f6cb80a8bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6cb00032f0 tx=0x7f6cb0009290).stop 2021-10-20T23:19:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 -- 172.21.15.12:0/1337903010 shutdown_connections 2021-10-20T23:19:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 --2- 172.21.15.12:0/1337903010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 0x7f6cb80a8bf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 --2- 172.21.15.12:0/1337903010 >> v2:172.21.15.31:3300/0 conn(0x7f6cb80601a0 0x7f6cb80b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 -- 172.21.15.12:0/1337903010 >> 172.21.15.12:0/1337903010 conn(0x7f6cb8061140 msgr2=0x7f6cb8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 -- 172.21.15.12:0/1337903010 shutdown_connections 2021-10-20T23:19:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.447+0000 7f6cb7fff700 1 -- 172.21.15.12:0/1337903010 wait complete. 2021-10-20T23:19:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.451+0000 7f6cb7fff700 1 Processor -- start 2021-10-20T23:19:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.451+0000 7f6cb7fff700 1 -- start start 2021-10-20T23:19:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.451+0000 7f6cb7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 0x7f6cb80b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb80601a0 0x7f6cb8153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cb80af3c0 0x7f6cb8142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8142280 con 0x7f6cb805c560 2021-10-20T23:19:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8153b40 con 0x7f6cb80601a0 2021-10-20T23:19:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb81405b0 con 0x7f6cb80af3c0 2021-10-20T23:19:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 0x7f6cb80b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 0x7f6cb80b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36458/0 (socket says 172.21.15.12:36458) 2021-10-20T23:19:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb6ffd700 1 -- 172.21.15.12:0/769400994 learned_addr learned my addr 172.21.15.12:0/769400994 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb67fc700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb80601a0 0x7f6cb8153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb77fe700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cb80af3c0 0x7f6cb8142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb6ffd700 1 -- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cb80af3c0 msgr2=0x7f6cb8142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb6ffd700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cb80af3c0 0x7f6cb8142950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb6ffd700 1 -- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb80601a0 msgr2=0x7f6cb8153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb6ffd700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb80601a0 0x7f6cb8153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb6ffd700 1 -- 172.21.15.12:0/769400994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac00b180 con 0x7f6cb805c560 2021-10-20T23:19:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb6ffd700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 0x7f6cb80b4c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6ca8001110 tx=0x7f6ca8007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6ca7fff700 1 -- 172.21.15.12:0/769400994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca8012400 con 0x7f6cb805c560 2021-10-20T23:19:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6ca7fff700 1 -- 172.21.15.12:0/769400994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8012560 con 0x7f6cb805c560 2021-10-20T23:19:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb0009530 con 0x7f6cb805c560 2021-10-20T23:19:50.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6ca7fff700 1 -- 172.21.15.12:0/769400994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca80128c0 con 0x7f6cb805c560 2021-10-20T23:19:50.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb805f6b0 con 0x7f6cb805c560 2021-10-20T23:19:50.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb805f8e0 con 0x7f6cb805c560 2021-10-20T23:19:50.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.455+0000 7f6ca7fff700 1 -- 172.21.15.12:0/769400994 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ca8019030 con 0x7f6cb805c560 2021-10-20T23:19:50.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.459+0000 7f6ca7fff700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c94053610 0x7f6c94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.459+0000 7f6ca7fff700 1 -- 172.21.15.12:0/769400994 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6ca806a8d0 con 0x7f6cb805c560 2021-10-20T23:19:50.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.459+0000 7f6cb67fc700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c94053610 0x7f6c94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.459+0000 7f6cb67fc700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c94053610 0x7f6c94055ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6cac00b000 tx=0x7f6cac006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.463+0000 7f6ca7fff700 1 -- 172.21.15.12:0/769400994 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ca8041d60 con 0x7f6cb805c560 2021-10-20T23:19:50.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.591+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6cb8057350 con 0x7f6cb805c560 2021-10-20T23:19:50.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.591+0000 7f6ca7fff700 1 -- 172.21.15.12:0/769400994 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6ca8045380 con 0x7f6cb805c560 2021-10-20T23:19:50.599 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:19:50.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c94053610 msgr2=0x7f6c94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c94053610 0x7f6c94055ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6cac00b000 tx=0x7f6cac006df0).stop 2021-10-20T23:19:50.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 msgr2=0x7f6cb80b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 0x7f6cb80b4c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6ca8001110 tx=0x7f6ca8007ae0).stop 2021-10-20T23:19:50.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 shutdown_connections 2021-10-20T23:19:50.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c94053610 0x7f6c94055ad0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cb80af3c0 0x7f6cb8142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb80601a0 0x7f6cb8153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 --2- 172.21.15.12:0/769400994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb805c560 0x7f6cb80b4c50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 >> 172.21.15.12:0/769400994 conn(0x7f6cb8061140 msgr2=0x7f6cb80b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:50.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 shutdown_connections 2021-10-20T23:19:50.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.595+0000 7f6cb7fff700 1 -- 172.21.15.12:0/769400994 wait complete. 2021-10-20T23:19:50.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:19:50.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2dc273700 1 Processor -- start 2021-10-20T23:19:50.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2dc273700 1 -- start start 2021-10-20T23:19:50.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2dc273700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 0x7fd2d4140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2dc273700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2d40b4690 0x7fd2d40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2dc273700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d4143b60 con 0x7fd2d4146950 2021-10-20T23:19:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2dc273700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d4147510 con 0x7fd2d40b4690 2021-10-20T23:19:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2dc273700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4143e00 con 0x7fd2d40b4180 2021-10-20T23:19:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2d980e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 0x7fd2d4140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2da810700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2d40b4690 0x7fd2d40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2da00f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd2d4146950 0x7fd2d4140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:42124/0 (socket says 172.21.15.12:42124) 2021-10-20T23:19:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2da00f700 1 -- 172.21.15.12:0/326611238 learned_addr learned my addr 172.21.15.12:0/326611238 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2d900d700 1 -- 172.21.15.12:0/326611238 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103322952 0 0) 0x7fd2d4143b60 con 0x7fd2d4146950 2021-10-20T23:19:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2d900d700 1 -- 172.21.15.12:0/326611238 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2bc003260 con 0x7fd2d4146950 2021-10-20T23:19:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2da810700 1 -- 172.21.15.12:0/326611238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 msgr2=0x7fd2d4140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2da810700 1 --2- 172.21.15.12:0/326611238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 0x7fd2d4140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2da810700 1 -- 172.21.15.12:0/326611238 >> v1:172.21.15.31:6789/0 conn(0x7fd2d4146950 legacy=0x7fd2d4140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2da810700 1 -- 172.21.15.12:0/326611238 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d40b0c90 con 0x7fd2d40b4690 2021-10-20T23:19:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2da810700 1 --2- 172.21.15.12:0/326611238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d40b4690 0x7fd2d40b4ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd2cc0032f0 tx=0x7fd2cc0091d0).ready entity=mon.1 client_cookie=fbd75344fbde3568 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.711+0000 7fd2d900d700 1 -- 172.21.15.12:0/326611238 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc00b600 con 0x7fd2d40b4690 2021-10-20T23:19:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2d900d700 1 -- 172.21.15.12:0/326611238 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc00b760 con 0x7fd2d40b4690 2021-10-20T23:19:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2d900d700 1 -- 172.21.15.12:0/326611238 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc00b8d0 con 0x7fd2d40b4690 2021-10-20T23:19:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 -- 172.21.15.12:0/326611238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d40b4690 msgr2=0x7fd2d40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 --2- 172.21.15.12:0/326611238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d40b4690 0x7fd2d40b4ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd2cc0032f0 tx=0x7fd2cc0091d0).stop 2021-10-20T23:19:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 -- 172.21.15.12:0/326611238 shutdown_connections 2021-10-20T23:19:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 --2- 172.21.15.12:0/326611238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d40b4690 0x7fd2d40b4ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 --2- 172.21.15.12:0/326611238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 0x7fd2d4140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 -- 172.21.15.12:0/326611238 >> 172.21.15.12:0/326611238 conn(0x7fd2d405c490 msgr2=0x7fd2d405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 -- 172.21.15.12:0/326611238 shutdown_connections 2021-10-20T23:19:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 -- 172.21.15.12:0/326611238 wait complete. 2021-10-20T23:19:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 Processor -- start 2021-10-20T23:19:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 -- start start 2021-10-20T23:19:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 0x7fd2d41489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.715+0000 7fd2dc273700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2d40b4690 0x7fd2d4142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2dc273700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d4146950 0x7fd2d413ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2dc273700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40b07b0 con 0x7fd2d40b4690 2021-10-20T23:19:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2dc273700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4152070 con 0x7fd2d4146950 2021-10-20T23:19:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2dc273700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d41495f0 con 0x7fd2d40b4180 2021-10-20T23:19:50.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2d980e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2d40b4690 0x7fd2d4142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2d980e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2d40b4690 0x7fd2d4142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36474/0 (socket says 172.21.15.12:36474) 2021-10-20T23:19:50.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2d980e700 1 -- 172.21.15.12:0/2026112329 learned_addr learned my addr 172.21.15.12:0/2026112329 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:50.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2da810700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d4146950 0x7fd2d413ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2da00f700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 0x7fd2d41489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2d980e700 1 -- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 msgr2=0x7fd2d41489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2d980e700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 0x7fd2d41489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2d980e700 1 -- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d4146950 msgr2=0x7fd2d413ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2d980e700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d4146950 0x7fd2d413ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2d980e700 1 -- 172.21.15.12:0/2026112329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc009470 con 0x7fd2d40b4690 2021-10-20T23:19:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2d980e700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2d40b4690 0x7fd2d4142810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd2c400c000 tx=0x7fd2c4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2c37fe700 1 -- 172.21.15.12:0/2026112329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c4010780 con 0x7fd2d40b4690 2021-10-20T23:19:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2c37fe700 1 -- 172.21.15.12:0/2026112329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c40108e0 con 0x7fd2d40b4690 2021-10-20T23:19:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2c37fe700 1 -- 172.21.15.12:0/2026112329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c4010c40 con 0x7fd2d40b4690 2021-10-20T23:19:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d4152260 con 0x7fd2d40b4690 2021-10-20T23:19:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d41527a0 con 0x7fd2d40b4690 2021-10-20T23:19:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d4152be0 con 0x7fd2d40b4690 2021-10-20T23:19:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.719+0000 7fd2c37fe700 1 -- 172.21.15.12:0/2026112329 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd2c401c460 con 0x7fd2d40b4690 2021-10-20T23:19:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.723+0000 7fd2c37fe700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b4053610 0x7fd2b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.723+0000 7fd2c37fe700 1 -- 172.21.15.12:0/2026112329 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd2c406bb50 con 0x7fd2d40b4690 2021-10-20T23:19:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.723+0000 7fd2da00f700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b4053610 0x7fd2b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.723+0000 7fd2da00f700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b4053610 0x7fd2b4055ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd2d000d000 tx=0x7fd2d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.727+0000 7fd2c37fe700 1 -- 172.21.15.12:0/2026112329 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2c4042df0 con 0x7fd2d40b4690 2021-10-20T23:19:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.855+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd2d4057350 con 0x7fd2d40b4690 2021-10-20T23:19:50.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.855+0000 7fd2c37fe700 1 -- 172.21.15.12:0/2026112329 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2c4046410 con 0x7fd2d40b4690 2021-10-20T23:19:50.863 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:19:50.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.855+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b4053610 msgr2=0x7fd2b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.855+0000 7fd2dc273700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b4053610 0x7fd2b4055ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd2d000d000 tx=0x7fd2d0009040).stop 2021-10-20T23:19:50.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.855+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2d40b4690 msgr2=0x7fd2d4142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.855+0000 7fd2dc273700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2d40b4690 0x7fd2d4142810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd2c400c000 tx=0x7fd2c4006df0).stop 2021-10-20T23:19:50.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.859+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 shutdown_connections 2021-10-20T23:19:50.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.859+0000 7fd2dc273700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b4053610 0x7fd2b4055ad0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.859+0000 7fd2dc273700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d4146950 0x7fd2d413ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.859+0000 7fd2dc273700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2d40b4690 0x7fd2d4142810 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.859+0000 7fd2dc273700 1 --2- 172.21.15.12:0/2026112329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2d40b4180 0x7fd2d41489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.859+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 >> 172.21.15.12:0/2026112329 conn(0x7fd2d405c490 msgr2=0x7fd2d413ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:50.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.859+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 shutdown_connections 2021-10-20T23:19:50.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.859+0000 7fd2dc273700 1 -- 172.21.15.12:0/2026112329 wait complete. 2021-10-20T23:19:50.875 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:19:50.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 Processor -- start 2021-10-20T23:19:50.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 -- start start 2021-10-20T23:19:50.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f24580b0fd0 0x7f2458144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580b0350 con 0x7f24581483a0 2021-10-20T23:19:50.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580b05f0 con 0x7f24580b1db0 2021-10-20T23:19:50.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580a90c0 con 0x7f24580b0fd0 2021-10-20T23:19:50.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245cd2b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f24581483a0 0x7f24580a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35076/0 (socket says 172.21.15.12:35076) 2021-10-20T23:19:50.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245cd2b700 1 -- 172.21.15.12:0/1969072526 learned_addr learned my addr 172.21.15.12:0/1969072526 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:50.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245dd2d700 1 --2- 172.21.15.12:0/1969072526 >> v2:172.21.15.31:3300/0 conn(0x7f24580b0fd0 0x7f2458144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f244ffff700 1 -- 172.21.15.12:0/1969072526 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353609906 0 0) 0x7f24580b0350 con 0x7f24581483a0 2021-10-20T23:19:50.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f244ffff700 1 -- 172.21.15.12:0/1969072526 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f243c003260 con 0x7f24581483a0 2021-10-20T23:19:50.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245dd2d700 1 -- 172.21.15.12:0/1969072526 >> v1:172.21.15.31:6789/0 conn(0x7f24580b1db0 legacy=0x7f24580b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245dd2d700 1 -- 172.21.15.12:0/1969072526 >> v1:172.21.15.12:6789/0 conn(0x7f24581483a0 legacy=0x7f24580a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245dd2d700 1 -- 172.21.15.12:0/1969072526 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24580b0890 con 0x7f24580b0fd0 2021-10-20T23:19:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245dd2d700 1 --2- 172.21.15.12:0/1969072526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24580b0fd0 0x7f2458144720 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2458147730 tx=0x7f2448006df0).ready entity=mon.1 client_cookie=deea1ae03b701b8a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f244ffff700 1 -- 172.21.15.12:0/1969072526 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244800d610 con 0x7f24580b0fd0 2021-10-20T23:19:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f244ffff700 1 -- 172.21.15.12:0/1969072526 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2448000e90 con 0x7f24580b0fd0 2021-10-20T23:19:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f244ffff700 1 -- 172.21.15.12:0/1969072526 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244800d960 con 0x7f24580b0fd0 2021-10-20T23:19:50.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 -- 172.21.15.12:0/1969072526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24580b0fd0 msgr2=0x7f2458144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 --2- 172.21.15.12:0/1969072526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24580b0fd0 0x7f2458144720 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2458147730 tx=0x7f2448006df0).stop 2021-10-20T23:19:50.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 -- 172.21.15.12:0/1969072526 shutdown_connections 2021-10-20T23:19:50.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 --2- 172.21.15.12:0/1969072526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24580b0fd0 0x7f2458144720 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 -- 172.21.15.12:0/1969072526 >> 172.21.15.12:0/1969072526 conn(0x7f245805f6b0 msgr2=0x7f245805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:50.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 -- 172.21.15.12:0/1969072526 shutdown_connections 2021-10-20T23:19:50.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.967+0000 7f245f790700 1 -- 172.21.15.12:0/1969072526 wait complete. 2021-10-20T23:19:50.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 Processor -- start 2021-10-20T23:19:50.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 -- start start 2021-10-20T23:19:50.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24580b0fd0 0x7f2458149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24580b1db0 0x7f24580af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581483a0 0x7f24580af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580afbb0 con 0x7f24581483a0 2021-10-20T23:19:50.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580ace90 con 0x7f24580b0fd0 2021-10-20T23:19:50.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2458142660 con 0x7f24580b1db0 2021-10-20T23:19:50.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245dd2d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581483a0 0x7f24580af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245dd2d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581483a0 0x7f24580af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36490/0 (socket says 172.21.15.12:36490) 2021-10-20T23:19:50.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245dd2d700 1 -- 172.21.15.12:0/213756466 learned_addr learned my addr 172.21.15.12:0/213756466 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:50.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245cd2b700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24580b1db0 0x7f24580af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245d52c700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24580b0fd0 0x7f2458149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245dd2d700 1 -- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24580b1db0 msgr2=0x7f24580af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245dd2d700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24580b1db0 0x7f24580af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245dd2d700 1 -- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24580b0fd0 msgr2=0x7f2458149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:50.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245dd2d700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24580b0fd0 0x7f2458149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:50.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245dd2d700 1 -- 172.21.15.12:0/213756466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244800b180 con 0x7f24581483a0 2021-10-20T23:19:50.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245dd2d700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581483a0 0x7f24580af6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2458147730 tx=0x7f2448014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f244e7fc700 1 -- 172.21.15.12:0/213756466 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2448013da0 con 0x7f24581483a0 2021-10-20T23:19:50.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f244e7fc700 1 -- 172.21.15.12:0/213756466 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244800d290 con 0x7f24581483a0 2021-10-20T23:19:50.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2458149170 con 0x7f24581483a0 2021-10-20T23:19:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f244e7fc700 1 -- 172.21.15.12:0/213756466 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244801e5f0 con 0x7f24581483a0 2021-10-20T23:19:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.971+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2458140ef0 con 0x7f24581483a0 2021-10-20T23:19:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.975+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24580b0b30 con 0x7f24581483a0 2021-10-20T23:19:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.975+0000 7f244e7fc700 1 -- 172.21.15.12:0/213756466 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2448025030 con 0x7f24581483a0 2021-10-20T23:19:50.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.975+0000 7f244e7fc700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2440053580 0x7f2440055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:50.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.975+0000 7f244e7fc700 1 -- 172.21.15.12:0/213756466 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f244806c3c0 con 0x7f24581483a0 2021-10-20T23:19:50.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.975+0000 7f245d52c700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2440053580 0x7f2440055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:50.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.975+0000 7f245d52c700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2440053580 0x7f2440055a40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f245000d000 tx=0x7f2450007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:50.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:50.979+0000 7f244e7fc700 1 -- 172.21.15.12:0/213756466 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f24480437b0 con 0x7f24581483a0 2021-10-20T23:19:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.111+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2458142820 con 0x7f24581483a0 2021-10-20T23:19:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f244e7fc700 1 -- 172.21.15.12:0/213756466 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+143 (secure 0 0 0) 0x7f24480230a0 con 0x7f24581483a0 2021-10-20T23:19:51.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:51.120 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:19:51.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:19:51.121 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:19:51.121 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:19:51.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:19:51.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:19:51.122 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:19:51.122 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:19:51.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:19:51.122 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:19:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2440053580 msgr2=0x7f2440055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2440053580 0x7f2440055a40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f245000d000 tx=0x7f2450007b90).stop 2021-10-20T23:19:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581483a0 msgr2=0x7f24580af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:51.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581483a0 0x7f24580af6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2458147730 tx=0x7f2448014000).stop 2021-10-20T23:19:51.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 shutdown_connections 2021-10-20T23:19:51.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2440053580 0x7f2440055a40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:51.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581483a0 0x7f24580af6c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24580b1db0 0x7f24580af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 --2- 172.21.15.12:0/213756466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24580b0fd0 0x7f2458149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 >> 172.21.15.12:0/213756466 conn(0x7f245805f6b0 msgr2=0x7f24580b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 shutdown_connections 2021-10-20T23:19:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.115+0000 7f245f790700 1 -- 172.21.15.12:0/213756466 wait complete. 2021-10-20T23:19:51.133 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:19:51.133 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:19:51.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 Processor -- start 2021-10-20T23:19:51.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 -- start start 2021-10-20T23:19:51.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08b00b6560 0x7f08b00b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:51.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08b00b5990 0x7f08b00b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b0143f60 con 0x7f08b005fc00 2021-10-20T23:19:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b00ba6b0 con 0x7f08b00b5990 2021-10-20T23:19:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b005ffe0 con 0x7f08b00b6560 2021-10-20T23:19:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b6461700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f08b005fc00 0x7f08b00b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35090/0 (socket says 172.21.15.12:35090) 2021-10-20T23:19:51.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b6461700 1 -- 172.21.15.12:0/1752124621 learned_addr learned my addr 172.21.15.12:0/1752124621 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:51.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b6c62700 1 --2- 172.21.15.12:0/1752124621 >> v2:172.21.15.12:3300/0 conn(0x7f08b00b5990 0x7f08b00b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:51.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b5c60700 1 --2- 172.21.15.12:0/1752124621 >> v2:172.21.15.31:3300/0 conn(0x7f08b00b6560 0x7f08b00b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:51.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b6c62700 1 -- 172.21.15.12:0/1752124621 >> v2:172.21.15.31:3300/0 conn(0x7f08b00b6560 msgr2=0x7f08b00b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b6c62700 1 --2- 172.21.15.12:0/1752124621 >> v2:172.21.15.31:3300/0 conn(0x7f08b00b6560 0x7f08b00b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b6c62700 1 -- 172.21.15.12:0/1752124621 >> v1:172.21.15.12:6789/0 conn(0x7f08b005fc00 legacy=0x7f08b00b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b6c62700 1 -- 172.21.15.12:0/1752124621 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0143a50 con 0x7f08b00b5990 2021-10-20T23:19:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b6c62700 1 --2- 172.21.15.12:0/1752124621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b5990 0x7f08b00b4a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f08a80032f0 tx=0x7f08a80091d0).ready entity=mon.0 client_cookie=f818bdd46051816 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b545f700 1 -- 172.21.15.12:0/1752124621 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a800b680 con 0x7f08b00b5990 2021-10-20T23:19:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b545f700 1 -- 172.21.15.12:0/1752124621 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a800b7e0 con 0x7f08b00b5990 2021-10-20T23:19:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b545f700 1 -- 172.21.15.12:0/1752124621 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a800b950 con 0x7f08b00b5990 2021-10-20T23:19:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 -- 172.21.15.12:0/1752124621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b5990 msgr2=0x7f08b00b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 --2- 172.21.15.12:0/1752124621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b5990 0x7f08b00b4a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f08a80032f0 tx=0x7f08a80091d0).stop 2021-10-20T23:19:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 -- 172.21.15.12:0/1752124621 shutdown_connections 2021-10-20T23:19:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 --2- 172.21.15.12:0/1752124621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b5990 0x7f08b00b4a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 --2- 172.21.15.12:0/1752124621 >> v2:172.21.15.31:3300/0 conn(0x7f08b00b6560 0x7f08b00b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.239+0000 7f08b86c5700 1 -- 172.21.15.12:0/1752124621 >> 172.21.15.12:0/1752124621 conn(0x7f08b00623a0 msgr2=0x7f08b0066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 -- 172.21.15.12:0/1752124621 shutdown_connections 2021-10-20T23:19:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 -- 172.21.15.12:0/1752124621 wait complete. 2021-10-20T23:19:51.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 Processor -- start 2021-10-20T23:19:51.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 -- start start 2021-10-20T23:19:51.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08b005fc00 0x7f08b00b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:51.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08b00b5990 0x7f08b00b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:51.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b6560 0x7f08b013f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b013eac0 con 0x7f08b00b6560 2021-10-20T23:19:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00aee60 con 0x7f08b00b5990 2021-10-20T23:19:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b013e210 con 0x7f08b005fc00 2021-10-20T23:19:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6c62700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b6560 0x7f08b013f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6c62700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b6560 0x7f08b013f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36506/0 (socket says 172.21.15.12:36506) 2021-10-20T23:19:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6c62700 1 -- 172.21.15.12:0/473525001 learned_addr learned my addr 172.21.15.12:0/473525001 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6461700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08b005fc00 0x7f08b00b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b5c60700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08b00b5990 0x7f08b00b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6c62700 1 -- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08b005fc00 msgr2=0x7f08b00b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6c62700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08b005fc00 0x7f08b00b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6c62700 1 -- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08b00b5990 msgr2=0x7f08b00b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6c62700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08b00b5990 0x7f08b00b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6c62700 1 -- 172.21.15.12:0/473525001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8009470 con 0x7f08b00b6560 2021-10-20T23:19:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6461700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08b005fc00 0x7f08b00b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:19:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b5c60700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08b00b5990 0x7f08b00b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:19:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b6c62700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b6560 0x7f08b013f2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f08b00b3450 tx=0x7f08a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f089f7fe700 1 -- 172.21.15.12:0/473525001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a8021440 con 0x7f08b00b6560 2021-10-20T23:19:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b00af090 con 0x7f08b00b6560 2021-10-20T23:19:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f089f7fe700 1 -- 172.21.15.12:0/473525001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a80215a0 con 0x7f08b00b6560 2021-10-20T23:19:51.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f089f7fe700 1 -- 172.21.15.12:0/473525001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a8021900 con 0x7f08b00b6560 2021-10-20T23:19:51.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.243+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b013fff0 con 0x7f08b00b6560 2021-10-20T23:19:51.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.247+0000 7f089f7fe700 1 -- 172.21.15.12:0/473525001 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f08a8027020 con 0x7f08b00b6560 2021-10-20T23:19:51.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.247+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b0143cc0 con 0x7f08b00b6560 2021-10-20T23:19:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.247+0000 7f089f7fe700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08900536d0 0x7f0890055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.247+0000 7f089f7fe700 1 -- 172.21.15.12:0/473525001 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f08a806cc10 con 0x7f08b00b6560 2021-10-20T23:19:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.247+0000 7f08b6461700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08900536d0 0x7f0890055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.247+0000 7f08b6461700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08900536d0 0x7f0890055b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f08ac008000 tx=0x7f08ac009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.251+0000 7f089f7fe700 1 -- 172.21.15.12:0/473525001 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08a8043f90 con 0x7f08b00b6560 2021-10-20T23:19:51.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:51.379+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f08b0057350 con 0x7f08b00b6560 2021-10-20T23:19:52.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.159+0000 7f089f7fe700 1 -- 172.21.15.12:0/473525001 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v20) v1 ==== 133+0+0 (secure 0 0 0) 0x7f08a8015020 con 0x7f08b00b6560 2021-10-20T23:19:52.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08900536d0 msgr2=0x7f0890055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:52.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08900536d0 0x7f0890055b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f08ac008000 tx=0x7f08ac009040).stop 2021-10-20T23:19:52.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b6560 msgr2=0x7f08b013f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:52.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b6560 0x7f08b013f2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f08b00b3450 tx=0x7f08a8016000).stop 2021-10-20T23:19:52.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 shutdown_connections 2021-10-20T23:19:52.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08900536d0 0x7f0890055b90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:52.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08b00b6560 0x7f08b013f2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:52.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08b00b5990 0x7f08b00b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:52.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 --2- 172.21.15.12:0/473525001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08b005fc00 0x7f08b00b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:52.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 >> 172.21.15.12:0/473525001 conn(0x7f08b00623a0 msgr2=0x7f08b012c270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:52.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 shutdown_connections 2021-10-20T23:19:52.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.163+0000 7f08b86c5700 1 -- 172.21.15.12:0/473525001 wait complete. 2021-10-20T23:19:52.174 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:19:52.184 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2021-10-20T23:19:52.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2021-10-20T23:19:52.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.287+0000 7f098e957700 1 Processor -- start 2021-10-20T23:19:52.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.287+0000 7f098e957700 1 -- start start 2021-10-20T23:19:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0988067120 0x7f09880b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:52.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09880b9bd0 con 0x7f098813fff0 2021-10-20T23:19:52.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0988067500 con 0x7f09881439b0 2021-10-20T23:19:52.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0988143080 con 0x7f0988067120 2021-10-20T23:19:52.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098cef4700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f098813fff0 0x7f0988140480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35104/0 (socket says 172.21.15.12:35104) 2021-10-20T23:19:52.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098cef4700 1 -- 172.21.15.12:0/1648776485 learned_addr learned my addr 172.21.15.12:0/1648776485 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:52.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f0987fff700 1 --2- 172.21.15.12:0/1648776485 >> v2:172.21.15.12:3300/0 conn(0x7f0988067120 0x7f09880b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f0987fff700 1 -- 172.21.15.12:0/1648776485 >> v1:172.21.15.31:6789/0 conn(0x7f09881439b0 legacy=0x7f09880aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f0987fff700 1 -- 172.21.15.12:0/1648776485 >> v1:172.21.15.12:6789/0 conn(0x7f098813fff0 legacy=0x7f0988140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f0986ffd700 1 -- 172.21.15.12:0/1648776485 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399120309 0 0) 0x7f0980001490 con 0x7f098813fff0 2021-10-20T23:19:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f0987fff700 1 -- 172.21.15.12:0/1648776485 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880af4d0 con 0x7f0988067120 2021-10-20T23:19:52.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f0987fff700 1 --2- 172.21.15.12:0/1648776485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 0x7f09880b96e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0970002f70 tx=0x7f0970006df0).ready entity=mon.0 client_cookie=ac7e6a478cf00d4b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:52.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f0986ffd700 1 -- 172.21.15.12:0/1648776485 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f097000d610 con 0x7f0988067120 2021-10-20T23:19:52.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f0986ffd700 1 -- 172.21.15.12:0/1648776485 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970000e90 con 0x7f0988067120 2021-10-20T23:19:52.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f0986ffd700 1 -- 172.21.15.12:0/1648776485 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f097000d960 con 0x7f0988067120 2021-10-20T23:19:52.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 -- 172.21.15.12:0/1648776485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 msgr2=0x7f09880b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 --2- 172.21.15.12:0/1648776485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 0x7f09880b96e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0970002f70 tx=0x7f0970006df0).stop 2021-10-20T23:19:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 -- 172.21.15.12:0/1648776485 shutdown_connections 2021-10-20T23:19:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 --2- 172.21.15.12:0/1648776485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 0x7f09880b96e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 -- 172.21.15.12:0/1648776485 >> 172.21.15.12:0/1648776485 conn(0x7f098805f9f0 msgr2=0x7f09880616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 -- 172.21.15.12:0/1648776485 shutdown_connections 2021-10-20T23:19:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.291+0000 7f098e957700 1 -- 172.21.15.12:0/1648776485 wait complete. 2021-10-20T23:19:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098e957700 1 Processor -- start 2021-10-20T23:19:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098e957700 1 -- start start 2021-10-20T23:19:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098e957700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 0x7f09880b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098e957700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098813fff0 0x7f0988155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098e957700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09881439b0 0x7f0988155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098e957700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880afc90 con 0x7f0988067120 2021-10-20T23:19:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098e957700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b97d0 con 0x7f098813fff0 2021-10-20T23:19:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098e957700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b8690 con 0x7f09881439b0 2021-10-20T23:19:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f0987fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 0x7f09880b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f0987fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 0x7f09880b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36516/0 (socket says 172.21.15.12:36516) 2021-10-20T23:19:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f0987fff700 1 -- 172.21.15.12:0/4003684394 learned_addr learned my addr 172.21.15.12:0/4003684394 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f09877fe700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098813fff0 0x7f0988155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098cef4700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09881439b0 0x7f0988155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f0987fff700 1 -- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09881439b0 msgr2=0x7f0988155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f0987fff700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09881439b0 0x7f0988155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f0987fff700 1 -- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098813fff0 msgr2=0x7f0988155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f0987fff700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098813fff0 0x7f0988155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f0987fff700 1 -- 172.21.15.12:0/4003684394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097000b180 con 0x7f0988067120 2021-10-20T23:19:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.295+0000 7f098cef4700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09881439b0 0x7f0988155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:19:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f0987fff700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 0x7f09880b50a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0970002f70 tx=0x7f0970015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f09857fa700 1 -- 172.21.15.12:0/4003684394 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f097000de70 con 0x7f0988067120 2021-10-20T23:19:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f09857fa700 1 -- 172.21.15.12:0/4003684394 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970011bb0 con 0x7f0988067120 2021-10-20T23:19:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09880b9250 con 0x7f0988067120 2021-10-20T23:19:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f09857fa700 1 -- 172.21.15.12:0/4003684394 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f097001e460 con 0x7f0988067120 2021-10-20T23:19:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09880b05f0 con 0x7f0988067120 2021-10-20T23:19:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09880b99d0 con 0x7f0988067120 2021-10-20T23:19:52.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f09857fa700 1 -- 172.21.15.12:0/4003684394 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0970025030 con 0x7f0988067120 2021-10-20T23:19:52.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f09857fa700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f096c053640 0x7f096c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:52.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.299+0000 7f09857fa700 1 -- 172.21.15.12:0/4003684394 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f097006cb80 con 0x7f0988067120 2021-10-20T23:19:52.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.303+0000 7f09877fe700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f096c053640 0x7f096c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:52.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.303+0000 7f09877fe700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f096c053640 0x7f096c055b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f097800d000 tx=0x7f0978007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:52.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.307+0000 7f09857fa700 1 -- 172.21.15.12:0/4003684394 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0970043e30 con 0x7f0988067120 2021-10-20T23:19:52.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:52.447+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f0988057350 con 0x7f0988067120 2021-10-20T23:19:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.159+0000 7f09857fa700 1 -- 172.21.15.12:0/4003684394 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 154+0+0 (secure 0 0 0) 0x7f0970023020 con 0x7f0988067120 2021-10-20T23:19:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f096c053640 msgr2=0x7f096c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f096c053640 0x7f096c055b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f097800d000 tx=0x7f0978007b90).stop 2021-10-20T23:19:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 msgr2=0x7f09880b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 0x7f09880b50a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0970002f70 tx=0x7f0970015000).stop 2021-10-20T23:19:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 shutdown_connections 2021-10-20T23:19:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f096c053640 0x7f096c055b00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09881439b0 0x7f0988155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098813fff0 0x7f0988155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 --2- 172.21.15.12:0/4003684394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0988067120 0x7f09880b50a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 >> 172.21.15.12:0/4003684394 conn(0x7f098805f9f0 msgr2=0x7f09881421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 shutdown_connections 2021-10-20T23:19:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.167+0000 7f098e957700 1 -- 172.21.15.12:0/4003684394 wait complete. 2021-10-20T23:19:53.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2021-10-20T23:19:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 Processor -- start 2021-10-20T23:19:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 -- start start 2021-10-20T23:19:53.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13cc061680 0x7f13cc0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:53.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f13cc1439a0 0x7f13cc1404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:53.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13cc0b6910 con 0x7f13cc0b4710 2021-10-20T23:19:53.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc0b9680 con 0x7f13cc1439a0 2021-10-20T23:19:53.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc0b6bb0 con 0x7f13cc061680 2021-10-20T23:19:53.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d120b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f13cc1439a0 0x7f13cc1404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:53.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13cbfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f13cc0b4710 0x7f13cc13fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35118/0 (socket says 172.21.15.12:35118) 2021-10-20T23:19:53.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13cbfff700 1 -- 172.21.15.12:0/3796247801 learned_addr learned my addr 172.21.15.12:0/3796247801 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:53.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d0a0a700 1 --2- 172.21.15.12:0/3796247801 >> v2:172.21.15.31:3300/0 conn(0x7f13cc061680 0x7f13cc0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:53.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d120b700 1 -- 172.21.15.12:0/3796247801 >> v2:172.21.15.31:3300/0 conn(0x7f13cc061680 msgr2=0x7f13cc0b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:53.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d120b700 1 --2- 172.21.15.12:0/3796247801 >> v2:172.21.15.31:3300/0 conn(0x7f13cc061680 0x7f13cc0b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:53.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13cb7fe700 1 -- 172.21.15.12:0/3796247801 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287588113 0 0) 0x7f13cc0b6910 con 0x7f13cc0b4710 2021-10-20T23:19:53.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d120b700 1 -- 172.21.15.12:0/3796247801 >> v1:172.21.15.12:6789/0 conn(0x7f13cc0b4710 legacy=0x7f13cc13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:53.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d120b700 1 -- 172.21.15.12:0/3796247801 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc0b6e50 con 0x7f13cc1439a0 2021-10-20T23:19:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d0a0a700 1 --2- 172.21.15.12:0/3796247801 >> v2:172.21.15.31:3300/0 conn(0x7f13cc061680 0x7f13cc0b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:19:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d120b700 1 --2- 172.21.15.12:0/3796247801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc1439a0 0x7f13cc1404b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f13c40032f0 tx=0x7f13c40091d0).ready entity=mon.0 client_cookie=2a164b0392d527fb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13cb7fe700 1 -- 172.21.15.12:0/3796247801 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c4009ea0 con 0x7f13cc1439a0 2021-10-20T23:19:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13cb7fe700 1 -- 172.21.15.12:0/3796247801 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c400b870 con 0x7f13cc1439a0 2021-10-20T23:19:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13cb7fe700 1 -- 172.21.15.12:0/3796247801 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c400b9e0 con 0x7f13cc1439a0 2021-10-20T23:19:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3796247801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc1439a0 msgr2=0x7f13cc1404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 --2- 172.21.15.12:0/3796247801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc1439a0 0x7f13cc1404b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f13c40032f0 tx=0x7f13c40091d0).stop 2021-10-20T23:19:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3796247801 shutdown_connections 2021-10-20T23:19:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 --2- 172.21.15.12:0/3796247801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc1439a0 0x7f13cc1404b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 --2- 172.21.15.12:0/3796247801 >> v2:172.21.15.31:3300/0 conn(0x7f13cc061680 0x7f13cc0b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3796247801 >> 172.21.15.12:0/3796247801 conn(0x7f13cc06adf0 msgr2=0x7f13cc05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3796247801 shutdown_connections 2021-10-20T23:19:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.295+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3796247801 wait complete. 2021-10-20T23:19:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 Processor -- start 2021-10-20T23:19:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 -- start start 2021-10-20T23:19:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc061680 0x7f13cc13ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13cc1439a0 0x7f13cc1441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13cc152de0 0x7f13cc1446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc1471f0 con 0x7f13cc061680 2021-10-20T23:19:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc152400 con 0x7f13cc1439a0 2021-10-20T23:19:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc1526a0 con 0x7f13cc152de0 2021-10-20T23:19:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d0a0a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc061680 0x7f13cc13ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d0a0a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc061680 0x7f13cc13ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36530/0 (socket says 172.21.15.12:36530) 2021-10-20T23:19:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d0a0a700 1 -- 172.21.15.12:0/3307072028 learned_addr learned my addr 172.21.15.12:0/3307072028 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d120b700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13cc152de0 0x7f13cc1446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13cbfff700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13cc1439a0 0x7f13cc1441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d0a0a700 1 -- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13cc152de0 msgr2=0x7f13cc1446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d0a0a700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13cc152de0 0x7f13cc1446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d0a0a700 1 -- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13cc1439a0 msgr2=0x7f13cc1441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d0a0a700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13cc1439a0 0x7f13cc1441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d0a0a700 1 -- 172.21.15.12:0/3307072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4009470 con 0x7f13cc061680 2021-10-20T23:19:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d0a0a700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc061680 0x7f13cc13ca80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f13bc006940 tx=0x7f13bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13c9ffb700 1 -- 172.21.15.12:0/3307072028 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13bc011780 con 0x7f13cc061680 2021-10-20T23:19:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13c9ffb700 1 -- 172.21.15.12:0/3307072028 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc0118e0 con 0x7f13cc061680 2021-10-20T23:19:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13cc152940 con 0x7f13cc061680 2021-10-20T23:19:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13c9ffb700 1 -- 172.21.15.12:0/3307072028 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13bc011c40 con 0x7f13cc061680 2021-10-20T23:19:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.299+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc13d800 con 0x7f13cc061680 2021-10-20T23:19:53.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.303+0000 7f13c9ffb700 1 -- 172.21.15.12:0/3307072028 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f13bc012420 con 0x7f13cc061680 2021-10-20T23:19:53.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.303+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc13e620 con 0x7f13cc061680 2021-10-20T23:19:53.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.303+0000 7f13c9ffb700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f13b00535b0 0x7f13b0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:53.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.303+0000 7f13c9ffb700 1 -- 172.21.15.12:0/3307072028 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5863+0+0 (secure 0 0 0) 0x7f13bc06b620 con 0x7f13cc061680 2021-10-20T23:19:53.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.303+0000 7f13cbfff700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f13b00535b0 0x7f13b0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:53.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.303+0000 7f13cbfff700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f13b00535b0 0x7f13b0055a70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f13b400d000 tx=0x7f13b4007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:53.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.307+0000 7f13c9ffb700 1 -- 172.21.15.12:0/3307072028 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f13bc0427f0 con 0x7f13cc061680 2021-10-20T23:19:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:53.435+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f13cc057350 con 0x7f13cc061680 2021-10-20T23:19:55.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.183+0000 7f13c9ffb700 1 -- 172.21.15.12:0/3307072028 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v23) v1 ==== 188+0+0 (secure 0 0 0) 0x7f13bc045e10 con 0x7f13cc061680 2021-10-20T23:19:55.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f13b00535b0 msgr2=0x7f13b0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:55.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f13b00535b0 0x7f13b0055a70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f13b400d000 tx=0x7f13b4007a00).stop 2021-10-20T23:19:55.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc061680 msgr2=0x7f13cc13ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:55.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc061680 0x7f13cc13ca80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f13bc006940 tx=0x7f13bc008040).stop 2021-10-20T23:19:55.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 shutdown_connections 2021-10-20T23:19:55.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f13b00535b0 0x7f13b0055a70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:55.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13cc152de0 0x7f13cc1446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:55.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13cc1439a0 0x7f13cc1441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:55.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 --2- 172.21.15.12:0/3307072028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13cc061680 0x7f13cc13ca80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:55.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 >> 172.21.15.12:0/3307072028 conn(0x7f13cc06adf0 msgr2=0x7f13cc0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:55.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 shutdown_connections 2021-10-20T23:19:55.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.191+0000 7f13d1a0c700 1 -- 172.21.15.12:0/3307072028 wait complete. 2021-10-20T23:19:55.201 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:19:55.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2021-10-20T23:19:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7e536700 1 Processor -- start 2021-10-20T23:19:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7e536700 1 -- start start 2021-10-20T23:19:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7e536700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb780b03d0 0x7fdb78146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:55.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7e536700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb780b1140 con 0x7fdb780b0b80 2021-10-20T23:19:55.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7e536700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb780a9570 con 0x7fdb780a9190 2021-10-20T23:19:55.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7e536700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb780b1370 con 0x7fdb780b03d0 2021-10-20T23:19:55.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7dd35700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb780b03d0 0x7fdb78146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:55.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7dd35700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb780b03d0 0x7fdb78146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36544/0 (socket says 172.21.15.12:36544) 2021-10-20T23:19:55.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7dd35700 1 -- 172.21.15.12:0/3437587924 learned_addr learned my addr 172.21.15.12:0/3437587924 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:55.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7cd33700 1 --1- 172.21.15.12:0/3437587924 >> v1:172.21.15.12:6789/0 conn(0x7fdb780b0b80 0x7fdb781401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35136/0 (socket says 172.21.15.12:35136) 2021-10-20T23:19:55.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7dd35700 1 -- 172.21.15.12:0/3437587924 >> v1:172.21.15.31:6789/0 conn(0x7fdb780a9190 legacy=0x7fdb78146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:55.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7dd35700 1 -- 172.21.15.12:0/3437587924 >> v1:172.21.15.12:6789/0 conn(0x7fdb780b0b80 legacy=0x7fdb781401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7dd35700 1 -- 172.21.15.12:0/3437587924 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780b1610 con 0x7fdb780b03d0 2021-10-20T23:19:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb7dd35700 1 --2- 172.21.15.12:0/3437587924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b03d0 0x7fdb78146c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdb700032f0 tx=0x7fdb70009290).ready entity=mon.0 client_cookie=b66d61f634c23d12 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb6ffff700 1 -- 172.21.15.12:0/3437587924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb7000b870 con 0x7fdb780b03d0 2021-10-20T23:19:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb6ffff700 1 -- 172.21.15.12:0/3437587924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7000b9d0 con 0x7fdb780b03d0 2021-10-20T23:19:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.315+0000 7fdb6ffff700 1 -- 172.21.15.12:0/3437587924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb7000bb40 con 0x7fdb780b03d0 2021-10-20T23:19:55.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.319+0000 7fdb7e536700 1 -- 172.21.15.12:0/3437587924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b03d0 msgr2=0x7fdb78146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.319+0000 7fdb7e536700 1 --2- 172.21.15.12:0/3437587924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b03d0 0x7fdb78146c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdb700032f0 tx=0x7fdb70009290).stop 2021-10-20T23:19:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.319+0000 7fdb7e536700 1 -- 172.21.15.12:0/3437587924 shutdown_connections 2021-10-20T23:19:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.319+0000 7fdb7e536700 1 --2- 172.21.15.12:0/3437587924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b03d0 0x7fdb78146c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.319+0000 7fdb7e536700 1 -- 172.21.15.12:0/3437587924 >> 172.21.15.12:0/3437587924 conn(0x7fdb78061140 msgr2=0x7fdb78062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:55.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.319+0000 7fdb7e536700 1 -- 172.21.15.12:0/3437587924 shutdown_connections 2021-10-20T23:19:55.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.319+0000 7fdb7e536700 1 -- 172.21.15.12:0/3437587924 wait complete. 2021-10-20T23:19:55.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.319+0000 7fdb7e536700 1 Processor -- start 2021-10-20T23:19:55.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.319+0000 7fdb7e536700 1 -- start start 2021-10-20T23:19:55.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7e536700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb780a9190 0x7fdb780af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7e536700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb780b03d0 0x7fdb78152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7e536700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b0b80 0x7fdb78153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7e536700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780abc50 con 0x7fdb780b0b80 2021-10-20T23:19:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7e536700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780aad40 con 0x7fdb780a9190 2021-10-20T23:19:55.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7e536700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780abe80 con 0x7fdb780b03d0 2021-10-20T23:19:55.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7dd35700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b0b80 0x7fdb78153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:55.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7dd35700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b0b80 0x7fdb78153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36550/0 (socket says 172.21.15.12:36550) 2021-10-20T23:19:55.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7dd35700 1 -- 172.21.15.12:0/1895074565 learned_addr learned my addr 172.21.15.12:0/1895074565 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:55.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7d534700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb780a9190 0x7fdb780af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:55.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7cd33700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb780b03d0 0x7fdb78152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:55.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7d534700 1 -- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb780b03d0 msgr2=0x7fdb78152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:55.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7d534700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb780b03d0 0x7fdb78152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:55.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7d534700 1 -- 172.21.15.12:0/1895074565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b0b80 msgr2=0x7fdb78153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:55.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7d534700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b0b80 0x7fdb78153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:55.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7d534700 1 -- 172.21.15.12:0/1895074565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb70009530 con 0x7fdb780a9190 2021-10-20T23:19:55.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7cd33700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb780b03d0 0x7fdb78152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:19:55.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7dd35700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b0b80 0x7fdb78153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:19:55.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7d534700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb780a9190 0x7fdb780af320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdb780b0290 tx=0x7fdb74007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:55.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb6e7fc700 1 -- 172.21.15.12:0/1895074565 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb7400ccd0 con 0x7fdb780a9190 2021-10-20T23:19:55.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb6e7fc700 1 -- 172.21.15.12:0/1895074565 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400ce30 con 0x7fdb780a9190 2021-10-20T23:19:55.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb780ac120 con 0x7fdb780a9190 2021-10-20T23:19:55.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb6e7fc700 1 -- 172.21.15.12:0/1895074565 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb740125f0 con 0x7fdb780a9190 2021-10-20T23:19:55.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.323+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb781528a0 con 0x7fdb780a9190 2021-10-20T23:19:55.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.327+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb78152a60 con 0x7fdb780a9190 2021-10-20T23:19:55.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.327+0000 7fdb6e7fc700 1 -- 172.21.15.12:0/1895074565 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb74019030 con 0x7fdb780a9190 2021-10-20T23:19:55.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.327+0000 7fdb6e7fc700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb60053610 0x7fdb60055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:55.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.327+0000 7fdb6e7fc700 1 -- 172.21.15.12:0/1895074565 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6315+0+0 (secure 0 0 0) 0x7fdb7406b2e0 con 0x7fdb780a9190 2021-10-20T23:19:55.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.327+0000 7fdb7cd33700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb60053610 0x7fdb60055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:55.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.327+0000 7fdb7cd33700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb60053610 0x7fdb60055ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fdb6800d000 tx=0x7fdb68007b80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:55.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.335+0000 7fdb6e7fc700 1 -- 172.21.15.12:0/1895074565 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb74042240 con 0x7fdb780a9190 2021-10-20T23:19:55.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:55.463+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fdb78057350 con 0x7fdb780a9190 2021-10-20T23:19:56.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.195+0000 7fdb6e7fc700 1 -- 172.21.15.12:0/1895074565 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 166+0+0 (secure 0 0 0) 0x7fdb74045860 con 0x7fdb780a9190 2021-10-20T23:19:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb60053610 msgr2=0x7fdb60055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb60053610 0x7fdb60055ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fdb6800d000 tx=0x7fdb68007b80).stop 2021-10-20T23:19:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb780a9190 msgr2=0x7fdb780af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb780a9190 0x7fdb780af320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdb780b0290 tx=0x7fdb74007b90).stop 2021-10-20T23:19:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 shutdown_connections 2021-10-20T23:19:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb60053610 0x7fdb60055ad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb780b0b80 0x7fdb78153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb780b03d0 0x7fdb78152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 --2- 172.21.15.12:0/1895074565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb780a9190 0x7fdb780af320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.199+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 >> 172.21.15.12:0/1895074565 conn(0x7fdb78061140 msgr2=0x7fdb7813ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.203+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 shutdown_connections 2021-10-20T23:19:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.203+0000 7fdb7e536700 1 -- 172.21.15.12:0/1895074565 wait complete. 2021-10-20T23:19:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:set pool 4 allow_ec_overwrites to true 2021-10-20T23:19:56.222 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:19:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 Processor -- start 2021-10-20T23:19:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 -- start start 2021-10-20T23:19:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52e00b34a0 0x7f52e0143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52e00af780 0x7f52e0140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e00b3880 con 0x7f52e00a9f40 2021-10-20T23:19:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e0144260 con 0x7f52e00b34a0 2021-10-20T23:19:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e01469b0 con 0x7f52e00af780 2021-10-20T23:19:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52dffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52e00b34a0 0x7f52e0143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52df7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f52e00a9f40 0x7f52e00af070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35150/0 (socket says 172.21.15.12:35150) 2021-10-20T23:19:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52df7fe700 1 -- 172.21.15.12:0/2817818721 learned_addr learned my addr 172.21.15.12:0/2817818721 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e4991700 1 --2- 172.21.15.12:0/2817818721 >> v2:172.21.15.31:3300/0 conn(0x7f52e00af780 0x7f52e0140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52dffff700 1 -- 172.21.15.12:0/2817818721 >> v2:172.21.15.31:3300/0 conn(0x7f52e00af780 msgr2=0x7f52e0140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52dffff700 1 --2- 172.21.15.12:0/2817818721 >> v2:172.21.15.31:3300/0 conn(0x7f52e00af780 0x7f52e0140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52dffff700 1 -- 172.21.15.12:0/2817818721 >> v1:172.21.15.12:6789/0 conn(0x7f52e00a9f40 legacy=0x7f52e00af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52deffd700 1 -- 172.21.15.12:0/2817818721 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165199915 0 0) 0x7f52e00b3880 con 0x7f52e00a9f40 2021-10-20T23:19:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52dffff700 1 -- 172.21.15.12:0/2817818721 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0146c50 con 0x7f52e00b34a0 2021-10-20T23:19:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52dffff700 1 --2- 172.21.15.12:0/2817818721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00b34a0 0x7f52e0143d70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f52d80032f0 tx=0x7f52d80091d0).ready entity=mon.0 client_cookie=82e0c3815905d814 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52deffd700 1 -- 172.21.15.12:0/2817818721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d800b680 con 0x7f52e00b34a0 2021-10-20T23:19:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52deffd700 1 -- 172.21.15.12:0/2817818721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d800b7e0 con 0x7f52e00b34a0 2021-10-20T23:19:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52deffd700 1 -- 172.21.15.12:0/2817818721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d800b950 con 0x7f52e00b34a0 2021-10-20T23:19:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 -- 172.21.15.12:0/2817818721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00b34a0 msgr2=0x7f52e0143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 --2- 172.21.15.12:0/2817818721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00b34a0 0x7f52e0143d70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f52d80032f0 tx=0x7f52d80091d0).stop 2021-10-20T23:19:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 -- 172.21.15.12:0/2817818721 shutdown_connections 2021-10-20T23:19:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 --2- 172.21.15.12:0/2817818721 >> v2:172.21.15.31:3300/0 conn(0x7f52e00af780 0x7f52e0140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 --2- 172.21.15.12:0/2817818721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00b34a0 0x7f52e0143d70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 -- 172.21.15.12:0/2817818721 >> 172.21.15.12:0/2817818721 conn(0x7f52e00607c0 msgr2=0x7f52e0060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 -- 172.21.15.12:0/2817818721 shutdown_connections 2021-10-20T23:19:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.323+0000 7f52e63f4700 1 -- 172.21.15.12:0/2817818721 wait complete. 2021-10-20T23:19:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 Processor -- start 2021-10-20T23:19:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 -- start start 2021-10-20T23:19:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00a9f40 0x7f52e01461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e00af780 0x7f52e01426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e00b34a0 0x7f52e0142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e01534e0 con 0x7f52e00a9f40 2021-10-20T23:19:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e0143080 con 0x7f52e00af780 2021-10-20T23:19:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e0153240 con 0x7f52e00b34a0 2021-10-20T23:19:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00a9f40 0x7f52e01461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00a9f40 0x7f52e01461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36560/0 (socket says 172.21.15.12:36560) 2021-10-20T23:19:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dffff700 1 -- 172.21.15.12:0/2222150598 learned_addr learned my addr 172.21.15.12:0/2222150598 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e4991700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e00b34a0 0x7f52e0142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52df7fe700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e00af780 0x7f52e01426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dffff700 1 -- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e00b34a0 msgr2=0x7f52e0142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dffff700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e00b34a0 0x7f52e0142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dffff700 1 -- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e00af780 msgr2=0x7f52e01426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dffff700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e00af780 0x7f52e01426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dffff700 1 -- 172.21.15.12:0/2222150598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8009470 con 0x7f52e00a9f40 2021-10-20T23:19:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dffff700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00a9f40 0x7f52e01461f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f52d80032f0 tx=0x7f52d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dd7fa700 1 -- 172.21.15.12:0/2222150598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d800b680 con 0x7f52e00a9f40 2021-10-20T23:19:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dd7fa700 1 -- 172.21.15.12:0/2222150598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d8021630 con 0x7f52e00a9f40 2021-10-20T23:19:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e0142200 con 0x7f52e00a9f40 2021-10-20T23:19:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52dd7fa700 1 -- 172.21.15.12:0/2222150598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8021990 con 0x7f52e00a9f40 2021-10-20T23:19:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.327+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e013fcc0 con 0x7f52e00a9f40 2021-10-20T23:19:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.331+0000 7f52dd7fa700 1 -- 172.21.15.12:0/2222150598 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52d8027020 con 0x7f52e00a9f40 2021-10-20T23:19:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.331+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e0142390 con 0x7f52e00a9f40 2021-10-20T23:19:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.331+0000 7f52dd7fa700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52c00536a0 0x7f52c0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.331+0000 7f52dd7fa700 1 -- 172.21.15.12:0/2222150598 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f52d806cd90 con 0x7f52e00a9f40 2021-10-20T23:19:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.331+0000 7f52df7fe700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52c00536a0 0x7f52c0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.331+0000 7f52df7fe700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52c00536a0 0x7f52c0055b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f52d400d000 tx=0x7f52d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.339+0000 7f52dd7fa700 1 -- 172.21.15.12:0/2222150598 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52d8043e00 con 0x7f52e00a9f40 2021-10-20T23:19:56.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.503+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f52e0146ef0 con 0x7f52e00a9f40 2021-10-20T23:19:56.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.515+0000 7f52dd7fa700 1 -- 172.21.15.12:0/2222150598 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v5) v1 ==== 187+0+0 (secure 0 0 0) 0x7f52d80150d0 con 0x7f52e00a9f40 2021-10-20T23:19:56.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.519+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52c00536a0 msgr2=0x7f52c0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.519+0000 7f52e63f4700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52c00536a0 0x7f52c0055b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f52d400d000 tx=0x7f52d4009040).stop 2021-10-20T23:19:56.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.519+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00a9f40 msgr2=0x7f52e01461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.519+0000 7f52e63f4700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00a9f40 0x7f52e01461f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f52d80032f0 tx=0x7f52d8016000).stop 2021-10-20T23:19:56.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.527+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 shutdown_connections 2021-10-20T23:19:56.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.527+0000 7f52e63f4700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52c00536a0 0x7f52c0055b60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.527+0000 7f52e63f4700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e00b34a0 0x7f52e0142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.527+0000 7f52e63f4700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e00af780 0x7f52e01426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.527+0000 7f52e63f4700 1 --2- 172.21.15.12:0/2222150598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e00a9f40 0x7f52e01461f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.527+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 >> 172.21.15.12:0/2222150598 conn(0x7f52e00607c0 msgr2=0x7f52e0060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:56.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.527+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 shutdown_connections 2021-10-20T23:19:56.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.527+0000 7f52e63f4700 1 -- 172.21.15.12:0/2222150598 wait complete. 2021-10-20T23:19:56.535 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 3 and data pool 4 2021-10-20T23:19:56.545 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:19:56.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 Processor -- start 2021-10-20T23:19:56.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 -- start start 2021-10-20T23:19:56.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4058061320 0x7f4058061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4058140440 0x7f40581408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40580aecf0 con 0x7f40580ad5c0 2021-10-20T23:19:56.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40580b6f20 con 0x7f4058061320 2021-10-20T23:19:56.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40580aef20 con 0x7f4058140440 2021-10-20T23:19:56.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f40580ad5c0 0x7f40580b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35174/0 (socket says 172.21.15.12:35174) 2021-10-20T23:19:56.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4056d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4058061320 0x7f4058061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405659c700 1 -- 172.21.15.12:0/4084047589 learned_addr learned my addr 172.21.15.12:0/4084047589 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:56.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405759e700 1 --2- 172.21.15.12:0/4084047589 >> v2:172.21.15.31:3300/0 conn(0x7f4058140440 0x7f40581408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4055d9b700 1 -- 172.21.15.12:0/4084047589 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774328361 0 0) 0x7f40580aecf0 con 0x7f40580ad5c0 2021-10-20T23:19:56.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4055d9b700 1 -- 172.21.15.12:0/4084047589 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4038003260 con 0x7f40580ad5c0 2021-10-20T23:19:56.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4056d9d700 1 -- 172.21.15.12:0/4084047589 >> v2:172.21.15.31:3300/0 conn(0x7f4058140440 msgr2=0x7f40581408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:56.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4056d9d700 1 --2- 172.21.15.12:0/4084047589 >> v2:172.21.15.31:3300/0 conn(0x7f4058140440 0x7f40581408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4056d9d700 1 -- 172.21.15.12:0/4084047589 >> v1:172.21.15.12:6789/0 conn(0x7f40580ad5c0 legacy=0x7f40580b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4056d9d700 1 -- 172.21.15.12:0/4084047589 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40580af1c0 con 0x7f4058061320 2021-10-20T23:19:56.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4056d9d700 1 --2- 172.21.15.12:0/4084047589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058061320 0x7f4058061700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f40580aeba0 tx=0x7f40480091d0).ready entity=mon.0 client_cookie=9c58be5e9b141061 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:56.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4055d9b700 1 -- 172.21.15.12:0/4084047589 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f404800b5a0 con 0x7f4058061320 2021-10-20T23:19:56.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4055d9b700 1 -- 172.21.15.12:0/4084047589 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404800b700 con 0x7f4058061320 2021-10-20T23:19:56.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f4055d9b700 1 -- 172.21.15.12:0/4084047589 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f404800b870 con 0x7f4058061320 2021-10-20T23:19:56.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 -- 172.21.15.12:0/4084047589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058061320 msgr2=0x7f4058061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 --2- 172.21.15.12:0/4084047589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058061320 0x7f4058061700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f40580aeba0 tx=0x7f40480091d0).stop 2021-10-20T23:19:56.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 -- 172.21.15.12:0/4084047589 shutdown_connections 2021-10-20T23:19:56.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 --2- 172.21.15.12:0/4084047589 >> v2:172.21.15.31:3300/0 conn(0x7f4058140440 0x7f40581408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 --2- 172.21.15.12:0/4084047589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058061320 0x7f4058061700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.635+0000 7f405c803700 1 -- 172.21.15.12:0/4084047589 >> 172.21.15.12:0/4084047589 conn(0x7f4058066de0 msgr2=0x7f40580671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:56.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 -- 172.21.15.12:0/4084047589 shutdown_connections 2021-10-20T23:19:56.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 -- 172.21.15.12:0/4084047589 wait complete. 2021-10-20T23:19:56.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 Processor -- start 2021-10-20T23:19:56.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 -- start start 2021-10-20T23:19:56.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058061320 0x7f40580b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40580ad5c0 0x7f4058148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058140440 0x7f4058148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40580b2dc0 con 0x7f4058140440 2021-10-20T23:19:56.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4058149200 con 0x7f4058061320 2021-10-20T23:19:56.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4058141180 con 0x7f40580ad5c0 2021-10-20T23:19:56.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058140440 0x7f4058148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058140440 0x7f4058148d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36588/0 (socket says 172.21.15.12:36588) 2021-10-20T23:19:56.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405759e700 1 -- 172.21.15.12:0/2842779485 learned_addr learned my addr 172.21.15.12:0/2842779485 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:56.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405659c700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40580ad5c0 0x7f4058148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f4056d9d700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058061320 0x7f40580b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405759e700 1 -- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40580ad5c0 msgr2=0x7f4058148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405759e700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40580ad5c0 0x7f4058148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405759e700 1 -- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058061320 msgr2=0x7f40580b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405759e700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058061320 0x7f40580b79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405759e700 1 -- 172.21.15.12:0/2842779485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4048009470 con 0x7f4058140440 2021-10-20T23:19:56.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405759e700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058140440 0x7f4058148d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4058149340 tx=0x7f4050006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:56.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f404ffff700 1 -- 172.21.15.12:0/2842779485 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4050011750 con 0x7f4058140440 2021-10-20T23:19:56.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f404ffff700 1 -- 172.21.15.12:0/2842779485 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40500118b0 con 0x7f4058140440 2021-10-20T23:19:56.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405814a720 con 0x7f4058140440 2021-10-20T23:19:56.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f404ffff700 1 -- 172.21.15.12:0/2842779485 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4050011c10 con 0x7f4058140440 2021-10-20T23:19:56.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.639+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4058141650 con 0x7f4058140440 2021-10-20T23:19:56.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.643+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40580af460 con 0x7f4058140440 2021-10-20T23:19:56.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.643+0000 7f404ffff700 1 -- 172.21.15.12:0/2842779485 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4050011d70 con 0x7f4058140440 2021-10-20T23:19:56.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.643+0000 7f404ffff700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f403c053520 0x7f403c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.643+0000 7f404ffff700 1 -- 172.21.15.12:0/2842779485 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f405006bdd0 con 0x7f4058140440 2021-10-20T23:19:56.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.643+0000 7f4056d9d700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f403c053520 0x7f403c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.643+0000 7f4056d9d700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f403c053520 0x7f403c0559e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f404801b000 tx=0x7f4048016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:56.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.651+0000 7f404ffff700 1 -- 172.21.15.12:0/2842779485 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4050042d30 con 0x7f4058140440 2021-10-20T23:19:56.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.772+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4058057350 con 0x7f4058140440 2021-10-20T23:19:56.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.772+0000 7f404ffff700 1 -- 172.21.15.12:0/2842779485 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f4050046350 con 0x7f4058140440 2021-10-20T23:19:56.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:56.783 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:19:56.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f403c053520 msgr2=0x7f403c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f403c053520 0x7f403c0559e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f404801b000 tx=0x7f4048016000).stop 2021-10-20T23:19:56.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058140440 msgr2=0x7f4058148d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058140440 0x7f4058148d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4058149340 tx=0x7f4050006df0).stop 2021-10-20T23:19:56.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 shutdown_connections 2021-10-20T23:19:56.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f403c053520 0x7f403c0559e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4058140440 0x7f4058148d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40580ad5c0 0x7f4058148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 --2- 172.21.15.12:0/2842779485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058061320 0x7f40580b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 >> 172.21.15.12:0/2842779485 conn(0x7f4058066de0 msgr2=0x7f40580b8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:56.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 shutdown_connections 2021-10-20T23:19:56.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.776+0000 7f405c803700 1 -- 172.21.15.12:0/2842779485 wait complete. 2021-10-20T23:19:56.797 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:19:56.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e1fc3700 1 Processor -- start 2021-10-20T23:19:56.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e1fc3700 1 -- start start 2021-10-20T23:19:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e1fc3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8dc0b2580 0x7fd8dc14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e1fc3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0a70c0 con 0x7fd8dc0b0010 2021-10-20T23:19:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e1fc3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0a72f0 con 0x7fd8dc0a8ac0 2021-10-20T23:19:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e1fc3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc0a7590 con 0x7fd8dc0b2580 2021-10-20T23:19:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8dbfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd8dc0b0010 0x7fd8dc0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35186/0 (socket says 172.21.15.12:35186) 2021-10-20T23:19:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8dbfff700 1 -- 172.21.15.12:0/4200235730 learned_addr learned my addr 172.21.15.12:0/4200235730 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e0fc1700 1 --2- 172.21.15.12:0/4200235730 >> v2:172.21.15.31:3300/0 conn(0x7fd8dc0b2580 0x7fd8dc14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8db7fe700 1 -- 172.21.15.12:0/4200235730 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615249737 0 0) 0x7fd8dc0a70c0 con 0x7fd8dc0b0010 2021-10-20T23:19:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8db7fe700 1 -- 172.21.15.12:0/4200235730 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c8003260 con 0x7fd8dc0b0010 2021-10-20T23:19:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8db7fe700 1 -- 172.21.15.12:0/4200235730 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041984153 0 0) 0x7fd8dc0a72f0 con 0x7fd8dc0a8ac0 2021-10-20T23:19:56.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8db7fe700 1 -- 172.21.15.12:0/4200235730 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8dc0a70c0 con 0x7fd8dc0a8ac0 2021-10-20T23:19:56.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8db7fe700 1 -- 172.21.15.12:0/4200235730 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821448094 0 0) 0x7fd8c8003260 con 0x7fd8dc0b0010 2021-10-20T23:19:56.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e0fc1700 1 -- 172.21.15.12:0/4200235730 >> v1:172.21.15.31:6789/0 conn(0x7fd8dc0a8ac0 legacy=0x7fd8dc151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e0fc1700 1 -- 172.21.15.12:0/4200235730 >> v1:172.21.15.12:6789/0 conn(0x7fd8dc0b0010 legacy=0x7fd8dc0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e0fc1700 1 -- 172.21.15.12:0/4200235730 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0a7830 con 0x7fd8dc0b2580 2021-10-20T23:19:56.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.888+0000 7fd8e0fc1700 1 --2- 172.21.15.12:0/4200235730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 0x7fd8dc14ae40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd8cc001490 tx=0x7fd8d0006df0).ready entity=mon.1 client_cookie=32643da9dc888821 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:56.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8db7fe700 1 -- 172.21.15.12:0/4200235730 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc0019e0 con 0x7fd8dc0b2580 2021-10-20T23:19:56.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8db7fe700 1 -- 172.21.15.12:0/4200235730 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0000e90 con 0x7fd8dc0b2580 2021-10-20T23:19:56.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8db7fe700 1 -- 172.21.15.12:0/4200235730 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d0012460 con 0x7fd8dc0b2580 2021-10-20T23:19:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/4200235730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 msgr2=0x7fd8dc14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8e1fc3700 1 --2- 172.21.15.12:0/4200235730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 0x7fd8dc14ae40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd8cc001490 tx=0x7fd8d0006df0).stop 2021-10-20T23:19:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/4200235730 shutdown_connections 2021-10-20T23:19:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8e1fc3700 1 --2- 172.21.15.12:0/4200235730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 0x7fd8dc14ae40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/4200235730 >> 172.21.15.12:0/4200235730 conn(0x7fd8dc060180 msgr2=0x7fd8dc0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/4200235730 shutdown_connections 2021-10-20T23:19:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/4200235730 wait complete. 2021-10-20T23:19:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8e1fc3700 1 Processor -- start 2021-10-20T23:19:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.892+0000 7fd8e1fc3700 1 -- start start 2021-10-20T23:19:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e1fc3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8dc0a8ac0 0x7fd8dc11ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e1fc3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8dc0b0010 0x7fd8dc067380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e1fc3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 0x7fd8dc156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e1fc3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc063ed0 con 0x7fd8dc0b0010 2021-10-20T23:19:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e1fc3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc063000 con 0x7fd8dc0b2580 2021-10-20T23:19:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e1fc3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc064140 con 0x7fd8dc0a8ac0 2021-10-20T23:19:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8dbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8dc0b0010 0x7fd8dc067380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8dbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8dc0b0010 0x7fd8dc067380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36600/0 (socket says 172.21.15.12:36600) 2021-10-20T23:19:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8dbfff700 1 -- 172.21.15.12:0/1618524464 learned_addr learned my addr 172.21.15.12:0/1618524464 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e0fc1700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8dc0a8ac0 0x7fd8dc11ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e17c2700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 0x7fd8dc156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8dbfff700 1 -- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8dc0a8ac0 msgr2=0x7fd8dc11ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8dbfff700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8dc0a8ac0 0x7fd8dc11ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8dbfff700 1 -- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 msgr2=0x7fd8dc156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:56.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8dbfff700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 0x7fd8dc156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:56.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8dbfff700 1 -- 172.21.15.12:0/1618524464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d000b180 con 0x7fd8dc0b0010 2021-10-20T23:19:56.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e17c2700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 0x7fd8dc156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:19:56.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8dbfff700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8dc0b0010 0x7fd8dc067380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd8cc001360 tx=0x7fd8cc001a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:56.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8d9ffb700 1 -- 172.21.15.12:0/1618524464 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc005ba0 con 0x7fd8dc0b0010 2021-10-20T23:19:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8d9ffb700 1 -- 172.21.15.12:0/1618524464 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc005d00 con 0x7fd8dc0b0010 2021-10-20T23:19:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc15a6f0 con 0x7fd8dc0b0010 2021-10-20T23:19:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8d9ffb700 1 -- 172.21.15.12:0/1618524464 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc007300 con 0x7fd8dc0b0010 2021-10-20T23:19:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc156600 con 0x7fd8dc0b0010 2021-10-20T23:19:56.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.896+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc057350 con 0x7fd8dc0b0010 2021-10-20T23:19:56.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.900+0000 7fd8d9ffb700 1 -- 172.21.15.12:0/1618524464 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8cc010030 con 0x7fd8dc0b0010 2021-10-20T23:19:56.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.900+0000 7fd8d9ffb700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8bc053610 0x7fd8bc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:56.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.900+0000 7fd8d9ffb700 1 -- 172.21.15.12:0/1618524464 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd8cc06bc90 con 0x7fd8dc0b0010 2021-10-20T23:19:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.900+0000 7fd8e0fc1700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8bc053610 0x7fd8bc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.900+0000 7fd8e0fc1700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8bc053610 0x7fd8bc055ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd8d001a000 tx=0x7fd8d0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:56.904+0000 7fd8d9ffb700 1 -- 172.21.15.12:0/1618524464 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8cc042b00 con 0x7fd8dc0b0010 2021-10-20T23:19:57.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.036+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8dc063170 con 0x7fd8dc0b0010 2021-10-20T23:19:57.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8d9ffb700 1 -- 172.21.15.12:0/1618524464 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fd8cc046120 con 0x7fd8dc0b0010 2021-10-20T23:19:57.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:57.049 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:19:57.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8bc053610 msgr2=0x7fd8bc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:57.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8bc053610 0x7fd8bc055ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd8d001a000 tx=0x7fd8d0014000).stop 2021-10-20T23:19:57.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8dc0b0010 msgr2=0x7fd8dc067380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:57.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8dc0b0010 0x7fd8dc067380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd8cc001360 tx=0x7fd8cc001a40).stop 2021-10-20T23:19:57.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 shutdown_connections 2021-10-20T23:19:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8bc053610 0x7fd8bc055ad0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8dc0b2580 0x7fd8dc156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8dc0b0010 0x7fd8dc067380 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 --2- 172.21.15.12:0/1618524464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8dc0a8ac0 0x7fd8dc11ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:57.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 >> 172.21.15.12:0/1618524464 conn(0x7fd8dc060180 msgr2=0x7fd8dc0b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:57.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 shutdown_connections 2021-10-20T23:19:57.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.040+0000 7fd8e1fc3700 1 -- 172.21.15.12:0/1618524464 wait complete. 2021-10-20T23:19:57.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:19:57.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.164+0000 7f777e549700 1 Processor -- start 2021-10-20T23:19:57.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.164+0000 7f777e549700 1 -- start start 2021-10-20T23:19:57.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f77780b0710 0x7f7778142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:57.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780b30d0 0x7f7778143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:57.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77780b0af0 con 0x7f77780ace70 2021-10-20T23:19:57.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77780ae680 con 0x7f77780b0710 2021-10-20T23:19:57.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77780ae920 con 0x7f77780b30d0 2021-10-20T23:19:57.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777d547700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f77780b0710 0x7f7778142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:57.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777cd46700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780b30d0 0x7f7778143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:57.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777dd48700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f77780ace70 0x7f777805f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:42268/0 (socket says 172.21.15.12:42268) 2021-10-20T23:19:57.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777dd48700 1 -- 172.21.15.12:0/477632274 learned_addr learned my addr 172.21.15.12:0/477632274 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:57.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f776ffff700 1 -- 172.21.15.12:0/477632274 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070900868 0 0) 0x7f77780b0af0 con 0x7f77780ace70 2021-10-20T23:19:57.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777cd46700 1 -- 172.21.15.12:0/477632274 >> v2:172.21.15.31:3300/0 conn(0x7f77780b0710 msgr2=0x7f7778142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:57.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777cd46700 1 --2- 172.21.15.12:0/477632274 >> v2:172.21.15.31:3300/0 conn(0x7f77780b0710 0x7f7778142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:57.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777cd46700 1 -- 172.21.15.12:0/477632274 >> v1:172.21.15.31:6789/0 conn(0x7f77780ace70 legacy=0x7f777805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:57.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777cd46700 1 -- 172.21.15.12:0/477632274 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77780aebc0 con 0x7f77780b30d0 2021-10-20T23:19:57.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777cd46700 1 --2- 172.21.15.12:0/477632274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780b30d0 0x7f7778143210 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f77740032f0 tx=0x7f77740091d0).ready entity=mon.2 client_cookie=f9f05196393d78c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:57.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f776ffff700 1 -- 172.21.15.12:0/477632274 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777400b6c0 con 0x7f77780b30d0 2021-10-20T23:19:57.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f776ffff700 1 -- 172.21.15.12:0/477632274 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777400b820 con 0x7f77780b30d0 2021-10-20T23:19:57.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f776ffff700 1 -- 172.21.15.12:0/477632274 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777400b990 con 0x7f77780b30d0 2021-10-20T23:19:57.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 -- 172.21.15.12:0/477632274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780b30d0 msgr2=0x7f7778143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:57.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 --2- 172.21.15.12:0/477632274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780b30d0 0x7f7778143210 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f77740032f0 tx=0x7f77740091d0).stop 2021-10-20T23:19:57.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 -- 172.21.15.12:0/477632274 shutdown_connections 2021-10-20T23:19:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 --2- 172.21.15.12:0/477632274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780b30d0 0x7f7778143210 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 --2- 172.21.15.12:0/477632274 >> v2:172.21.15.31:3300/0 conn(0x7f77780b0710 0x7f7778142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 -- 172.21.15.12:0/477632274 >> 172.21.15.12:0/477632274 conn(0x7f7778061140 msgr2=0x7f7778062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 -- 172.21.15.12:0/477632274 shutdown_connections 2021-10-20T23:19:57.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.168+0000 7f777e549700 1 -- 172.21.15.12:0/477632274 wait complete. 2021-10-20T23:19:57.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777e549700 1 Processor -- start 2021-10-20T23:19:57.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777e549700 1 -- start start 2021-10-20T23:19:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777e549700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780ace70 0x7f77781567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777e549700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77780b0710 0x7f7778067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777e549700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77780b30d0 0x7f777813d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777e549700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77780646a0 con 0x7f77780b30d0 2021-10-20T23:19:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777e549700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778157710 con 0x7f77780b0710 2021-10-20T23:19:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777e549700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777809ece0 con 0x7f77780ace70 2021-10-20T23:19:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777dd48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77780b30d0 0x7f777813d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777cd46700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77780b0710 0x7f7778067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777dd48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77780b30d0 0x7f777813d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36616/0 (socket says 172.21.15.12:36616) 2021-10-20T23:19:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777dd48700 1 -- 172.21.15.12:0/1520508375 learned_addr learned my addr 172.21.15.12:0/1520508375 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777d547700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780ace70 0x7f77781567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777dd48700 1 -- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780ace70 msgr2=0x7f77781567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777dd48700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780ace70 0x7f77781567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777dd48700 1 -- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77780b0710 msgr2=0x7f7778067410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777dd48700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77780b0710 0x7f7778067410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777dd48700 1 -- 172.21.15.12:0/1520508375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7774009470 con 0x7f77780b30d0 2021-10-20T23:19:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.172+0000 7f777dd48700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77780b30d0 0x7f777813d000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f77780647e0 tx=0x7f77700079c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.176+0000 7f776e7fc700 1 -- 172.21.15.12:0/1520508375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777000cea0 con 0x7f77780b30d0 2021-10-20T23:19:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.176+0000 7f776e7fc700 1 -- 172.21.15.12:0/1520508375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77700070d0 con 0x7f77780b30d0 2021-10-20T23:19:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.176+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7778156ca0 con 0x7f77780b30d0 2021-10-20T23:19:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.176+0000 7f776e7fc700 1 -- 172.21.15.12:0/1520508375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7770007430 con 0x7f77780b30d0 2021-10-20T23:19:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.176+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777815a820 con 0x7f77780b30d0 2021-10-20T23:19:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.176+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77780643d0 con 0x7f77780b30d0 2021-10-20T23:19:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.176+0000 7f776e7fc700 1 -- 172.21.15.12:0/1520508375 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7770010070 con 0x7f77780b30d0 2021-10-20T23:19:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.176+0000 7f776e7fc700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7758053610 0x7f7758055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.180+0000 7f777d547700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7758053610 0x7f7758055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.180+0000 7f776e7fc700 1 -- 172.21.15.12:0/1520508375 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f777006afd0 con 0x7f77780b30d0 2021-10-20T23:19:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.180+0000 7f777d547700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7758053610 0x7f7758055ad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f776800b000 tx=0x7f7768006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.188+0000 7f776e7fc700 1 -- 172.21.15.12:0/1520508375 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7770041ec0 con 0x7f77780b30d0 2021-10-20T23:19:57.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:57.352+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7778156ca0 con 0x7f77780b30d0 2021-10-20T23:19:58.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.204+0000 7f776e7fc700 1 -- 172.21.15.12:0/1520508375 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7778156ca0 con 0x7f77780b30d0 2021-10-20T23:19:58.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.204+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7758053610 msgr2=0x7f7758055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.204+0000 7f777e549700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7758053610 0x7f7758055ad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f776800b000 tx=0x7f7768006df0).stop 2021-10-20T23:19:58.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.204+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77780b30d0 msgr2=0x7f777813d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.204+0000 7f777e549700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77780b30d0 0x7f777813d000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f77780647e0 tx=0x7f77700079c0).stop 2021-10-20T23:19:58.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.208+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 shutdown_connections 2021-10-20T23:19:58.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.208+0000 7f777e549700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7758053610 0x7f7758055ad0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.208+0000 7f777e549700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77780b30d0 0x7f777813d000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.208+0000 7f777e549700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77780b0710 0x7f7778067410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.208+0000 7f777e549700 1 --2- 172.21.15.12:0/1520508375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77780ace70 0x7f77781567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.208+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 >> 172.21.15.12:0/1520508375 conn(0x7f7778061140 msgr2=0x7f7778142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:58.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.208+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 shutdown_connections 2021-10-20T23:19:58.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.208+0000 7f777e549700 1 -- 172.21.15.12:0/1520508375 wait complete. 2021-10-20T23:19:58.231 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:19:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 Processor -- start 2021-10-20T23:19:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 -- start start 2021-10-20T23:19:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7280b1f10 0x7fd7280b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7280aa390 con 0x7fd7280a9b70 2021-10-20T23:19:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7280ab260 con 0x7fd7280b00c0 2021-10-20T23:19:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7280b04a0 con 0x7fd7280b1f10 2021-10-20T23:19:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd727fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7280b1f10 0x7fd7280b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72d705700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd7280a9b70 0x7fd7280b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35218/0 (socket says 172.21.15.12:35218) 2021-10-20T23:19:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd727fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7280b1f10 0x7fd7280b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36620/0 (socket says 172.21.15.12:36620) 2021-10-20T23:19:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72d705700 1 -- 172.21.15.12:0/1803258865 learned_addr learned my addr 172.21.15.12:0/1803258865 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd727fff700 1 -- 172.21.15.12:0/1803258865 >> v1:172.21.15.31:6789/0 conn(0x7fd7280b00c0 legacy=0x7fd7280aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd727fff700 1 -- 172.21.15.12:0/1803258865 >> v1:172.21.15.12:6789/0 conn(0x7fd7280a9b70 legacy=0x7fd7280b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd727fff700 1 -- 172.21.15.12:0/1803258865 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7280aa0f0 con 0x7fd7280b1f10 2021-10-20T23:19:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd727fff700 1 --2- 172.21.15.12:0/1803258865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 0x7fd7280b1920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd718002f70 tx=0x7fd718006df0).ready entity=mon.0 client_cookie=1b1581e6d5b11f35 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd7277fe700 1 -- 172.21.15.12:0/1803258865 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd71800d610 con 0x7fd7280b1f10 2021-10-20T23:19:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd7277fe700 1 -- 172.21.15.12:0/1803258865 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718000e90 con 0x7fd7280b1f10 2021-10-20T23:19:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd7277fe700 1 -- 172.21.15.12:0/1803258865 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd71800d960 con 0x7fd7280b1f10 2021-10-20T23:19:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 -- 172.21.15.12:0/1803258865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 msgr2=0x7fd7280b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 --2- 172.21.15.12:0/1803258865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 0x7fd7280b1920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd718002f70 tx=0x7fd718006df0).stop 2021-10-20T23:19:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 -- 172.21.15.12:0/1803258865 shutdown_connections 2021-10-20T23:19:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 --2- 172.21.15.12:0/1803258865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 0x7fd7280b1920 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 -- 172.21.15.12:0/1803258865 >> 172.21.15.12:0/1803258865 conn(0x7fd7280607c0 msgr2=0x7fd728060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 -- 172.21.15.12:0/1803258865 shutdown_connections 2021-10-20T23:19:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.336+0000 7fd72f168700 1 -- 172.21.15.12:0/1803258865 wait complete. 2021-10-20T23:19:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.340+0000 7fd72f168700 1 Processor -- start 2021-10-20T23:19:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.340+0000 7fd72f168700 1 -- start start 2021-10-20T23:19:58.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72f168700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7280a9b70 0x7fd72813f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72f168700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7280b00c0 0x7fd728141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72f168700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 0x7fd728141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72f168700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd728142690 con 0x7fd7280b1f10 2021-10-20T23:19:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72f168700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72813fda0 con 0x7fd7280b00c0 2021-10-20T23:19:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72f168700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72813ba80 con 0x7fd7280a9b70 2021-10-20T23:19:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72d705700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 0x7fd728141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72d705700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 0x7fd728141c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36630/0 (socket says 172.21.15.12:36630) 2021-10-20T23:19:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72d705700 1 -- 172.21.15.12:0/859289107 learned_addr learned my addr 172.21.15.12:0/859289107 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd727fff700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7280b00c0 0x7fd728141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72cf04700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7280a9b70 0x7fd72813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72d705700 1 -- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7280a9b70 msgr2=0x7fd72813f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72d705700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7280a9b70 0x7fd72813f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72d705700 1 -- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7280b00c0 msgr2=0x7fd728141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72d705700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7280b00c0 0x7fd728141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72d705700 1 -- 172.21.15.12:0/859289107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71800b180 con 0x7fd7280b1f10 2021-10-20T23:19:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72cf04700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7280a9b70 0x7fd72813f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:19:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72d705700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 0x7fd728141c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd7280ad9e0 tx=0x7fd720007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd725ffb700 1 -- 172.21.15.12:0/859289107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd720005ba0 con 0x7fd7280b1f10 2021-10-20T23:19:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd725ffb700 1 -- 172.21.15.12:0/859289107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd720005d00 con 0x7fd7280b1f10 2021-10-20T23:19:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7281428c0 con 0x7fd7280b1f10 2021-10-20T23:19:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd725ffb700 1 -- 172.21.15.12:0/859289107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7200072c0 con 0x7fd7280b1f10 2021-10-20T23:19:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72813bf80 con 0x7fd7280b1f10 2021-10-20T23:19:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd728057350 con 0x7fd7280b1f10 2021-10-20T23:19:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.344+0000 7fd725ffb700 1 -- 172.21.15.12:0/859289107 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd72001a060 con 0x7fd7280b1f10 2021-10-20T23:19:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.348+0000 7fd725ffb700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7080535b0 0x7fd708055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.348+0000 7fd725ffb700 1 -- 172.21.15.12:0/859289107 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd72006b6b0 con 0x7fd7280b1f10 2021-10-20T23:19:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.348+0000 7fd72cf04700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7080535b0 0x7fd708055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.348+0000 7fd72cf04700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7080535b0 0x7fd708055a70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd71c00b000 tx=0x7fd71c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.352+0000 7fd725ffb700 1 -- 172.21.15.12:0/859289107 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd720042630 con 0x7fd7280b1f10 2021-10-20T23:19:58.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd728044650 con 0x7fd7280b1f10 2021-10-20T23:19:58.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd725ffb700 1 -- 172.21.15.12:0/859289107 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7fd720018020 con 0x7fd7280b1f10 2021-10-20T23:19:58.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:58.528 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1996246041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1996246041},{"type":"v1","addr":"172.21.15.31:6835","nonce":1996246041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/2770105392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2770105392},{"type":"v1","addr":"172.21.15.12:6833","nonce":2770105392}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:19:56.508295+0000","modified":"2021-10-20T23:19:58.195517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/2162960241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2162960241},{"type":"v1","addr":"172.21.15.12:6835","nonce":2162960241}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-20T23:19:58.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7080535b0 msgr2=0x7fd708055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7080535b0 0x7fd708055a70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd71c00b000 tx=0x7fd71c009040).stop 2021-10-20T23:19:58.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 msgr2=0x7fd728141c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 0x7fd728141c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd7280ad9e0 tx=0x7fd720007f40).stop 2021-10-20T23:19:58.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 shutdown_connections 2021-10-20T23:19:58.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7080535b0 0x7fd708055a70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7280b1f10 0x7fd728141c20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7280b00c0 0x7fd728141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 --2- 172.21.15.12:0/859289107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7280a9b70 0x7fd72813f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 >> 172.21.15.12:0/859289107 conn(0x7fd7280607c0 msgr2=0x7fd7280b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 shutdown_connections 2021-10-20T23:19:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.520+0000 7fd72f168700 1 -- 172.21.15.12:0/859289107 wait complete. 2021-10-20T23:19:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2021-10-20T23:19:58.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:19:58.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd967242700 1 Processor -- start 2021-10-20T23:19:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd967242700 1 -- start start 2021-10-20T23:19:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd967242700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd9600b6580 0x7fd9600b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd967242700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9601440b0 con 0x7fd9600b6960 2021-10-20T23:19:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd967242700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd960143b70 con 0x7fd9600b43c0 2021-10-20T23:19:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd967242700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd960143e10 con 0x7fd9600b6580 2021-10-20T23:19:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd9657df700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd9600b6960 0x7fd96012ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35232/0 (socket says 172.21.15.12:35232) 2021-10-20T23:19:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd9657df700 1 -- 172.21.15.12:0/2334805742 learned_addr learned my addr 172.21.15.12:0/2334805742 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd964fde700 1 --2- 172.21.15.12:0/2334805742 >> v2:172.21.15.31:3300/0 conn(0x7fd9600b6580 0x7fd9600b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd9577fe700 1 -- 172.21.15.12:0/2334805742 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020430473 0 0) 0x7fd9601440b0 con 0x7fd9600b6960 2021-10-20T23:19:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd9577fe700 1 -- 172.21.15.12:0/2334805742 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94c003260 con 0x7fd9600b6960 2021-10-20T23:19:58.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd964fde700 1 -- 172.21.15.12:0/2334805742 >> v1:172.21.15.31:6789/0 conn(0x7fd9600b43c0 legacy=0x7fd960061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd964fde700 1 -- 172.21.15.12:0/2334805742 >> v1:172.21.15.12:6789/0 conn(0x7fd9600b6960 legacy=0x7fd96012ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd964fde700 1 -- 172.21.15.12:0/2334805742 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600615f0 con 0x7fd9600b6580 2021-10-20T23:19:58.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd964fde700 1 --2- 172.21.15.12:0/2334805742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9600b6580 0x7fd9600b5bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd960143120 tx=0x7fd95c006df0).ready entity=mon.1 client_cookie=cd1331b219fdd64c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:58.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd9577fe700 1 -- 172.21.15.12:0/2334805742 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95c00d610 con 0x7fd9600b6580 2021-10-20T23:19:58.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd9577fe700 1 -- 172.21.15.12:0/2334805742 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c000e90 con 0x7fd9600b6580 2021-10-20T23:19:58.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd9577fe700 1 -- 172.21.15.12:0/2334805742 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95c00d960 con 0x7fd9600b6580 2021-10-20T23:19:58.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd967242700 1 -- 172.21.15.12:0/2334805742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9600b6580 msgr2=0x7fd9600b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.636+0000 7fd967242700 1 --2- 172.21.15.12:0/2334805742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9600b6580 0x7fd9600b5bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd960143120 tx=0x7fd95c006df0).stop 2021-10-20T23:19:58.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.640+0000 7fd967242700 1 -- 172.21.15.12:0/2334805742 shutdown_connections 2021-10-20T23:19:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.640+0000 7fd967242700 1 --2- 172.21.15.12:0/2334805742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9600b6580 0x7fd9600b5bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.640+0000 7fd967242700 1 -- 172.21.15.12:0/2334805742 >> 172.21.15.12:0/2334805742 conn(0x7fd96005c490 msgr2=0x7fd96005c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.640+0000 7fd967242700 1 -- 172.21.15.12:0/2334805742 shutdown_connections 2021-10-20T23:19:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.640+0000 7fd967242700 1 -- 172.21.15.12:0/2334805742 wait complete. 2021-10-20T23:19:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.640+0000 7fd967242700 1 Processor -- start 2021-10-20T23:19:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.640+0000 7fd967242700 1 -- start start 2021-10-20T23:19:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd967242700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9600b43c0 0x7fd960127280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd967242700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9600b6580 0x7fd96013d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd967242700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9600b6960 0x7fd96013d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd967242700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960145810 con 0x7fd9600b43c0 2021-10-20T23:19:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd967242700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96013c920 con 0x7fd9600b6580 2021-10-20T23:19:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd967242700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96013c4c0 con 0x7fd9600b6960 2021-10-20T23:19:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd964fde700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9600b43c0 0x7fd960127280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd964fde700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9600b43c0 0x7fd960127280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36640/0 (socket says 172.21.15.12:36640) 2021-10-20T23:19:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd964fde700 1 -- 172.21.15.12:0/1411941233 learned_addr learned my addr 172.21.15.12:0/1411941233 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd9657df700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9600b6960 0x7fd96013d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd957fff700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9600b6580 0x7fd96013d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd964fde700 1 -- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9600b6960 msgr2=0x7fd96013d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd964fde700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9600b6960 0x7fd96013d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd964fde700 1 -- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9600b6580 msgr2=0x7fd96013d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd964fde700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9600b6580 0x7fd96013d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd964fde700 1 -- 172.21.15.12:0/1411941233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c00b180 con 0x7fd9600b43c0 2021-10-20T23:19:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd964fde700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9600b43c0 0x7fd960127280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd960143120 tx=0x7fd95c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd955ffb700 1 -- 172.21.15.12:0/1411941233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95c016070 con 0x7fd9600b43c0 2021-10-20T23:19:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd955ffb700 1 -- 172.21.15.12:0/1411941233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c00de90 con 0x7fd9600b43c0 2021-10-20T23:19:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96013dd10 con 0x7fd9600b43c0 2021-10-20T23:19:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd955ffb700 1 -- 172.21.15.12:0/1411941233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95c002f70 con 0x7fd9600b43c0 2021-10-20T23:19:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96013b910 con 0x7fd9600b43c0 2021-10-20T23:19:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.644+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96013ca90 con 0x7fd9600b43c0 2021-10-20T23:19:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.648+0000 7fd955ffb700 1 -- 172.21.15.12:0/1411941233 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd95c025030 con 0x7fd9600b43c0 2021-10-20T23:19:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.648+0000 7fd955ffb700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd940053580 0x7fd940055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.648+0000 7fd955ffb700 1 -- 172.21.15.12:0/1411941233 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd95c06c980 con 0x7fd9600b43c0 2021-10-20T23:19:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.648+0000 7fd957fff700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd940053580 0x7fd940055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.648+0000 7fd957fff700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd940053580 0x7fd940055a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd95000b000 tx=0x7fd950009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:58.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.652+0000 7fd955ffb700 1 -- 172.21.15.12:0/1411941233 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd95c043980 con 0x7fd9600b43c0 2021-10-20T23:19:58.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.780+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd960061890 con 0x7fd9600b43c0 2021-10-20T23:19:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd955ffb700 1 -- 172.21.15.12:0/1411941233 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fd95c046fa0 con 0x7fd9600b43c0 2021-10-20T23:19:58.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:58.793 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:19:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd940053580 msgr2=0x7fd940055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd940053580 0x7fd940055a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd95000b000 tx=0x7fd950009040).stop 2021-10-20T23:19:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9600b43c0 msgr2=0x7fd960127280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9600b43c0 0x7fd960127280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd960143120 tx=0x7fd95c014000).stop 2021-10-20T23:19:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 shutdown_connections 2021-10-20T23:19:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd940053580 0x7fd940055a40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9600b6960 0x7fd96013d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9600b6580 0x7fd96013d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 --2- 172.21.15.12:0/1411941233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9600b43c0 0x7fd960127280 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 >> 172.21.15.12:0/1411941233 conn(0x7fd96005c490 msgr2=0x7fd960141b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 shutdown_connections 2021-10-20T23:19:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.784+0000 7fd967242700 1 -- 172.21.15.12:0/1411941233 wait complete. 2021-10-20T23:19:58.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:19:58.809 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-10-20T23:19:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f113dc93700 1 Processor -- start 2021-10-20T23:19:58.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f113dc93700 1 -- start start 2021-10-20T23:19:58.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f113dc93700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11380b18f0 0x7f11380b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f113dc93700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11380b33e0 con 0x7f11380a9c10 2021-10-20T23:19:58.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f113dc93700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11380b0c70 con 0x7f11380b3000 2021-10-20T23:19:58.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f113dc93700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11380b27f0 con 0x7f11380b18f0 2021-10-20T23:19:58.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f1137fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11380b18f0 0x7f11380b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f113d492700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f11380a9c10 0x7f1138147ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35246/0 (socket says 172.21.15.12:35246) 2021-10-20T23:19:58.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f113d492700 1 -- 172.21.15.12:0/1472145310 learned_addr learned my addr 172.21.15.12:0/1472145310 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:58.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f113cc91700 1 --1- 172.21.15.12:0/1472145310 >> v1:172.21.15.31:6789/0 conn(0x7f11380b3000 0x7f1138065510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:42306/0 (socket says 172.21.15.12:42306) 2021-10-20T23:19:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f1137fff700 1 -- 172.21.15.12:0/1472145310 >> v1:172.21.15.31:6789/0 conn(0x7f11380b3000 legacy=0x7f1138065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f1137fff700 1 -- 172.21.15.12:0/1472145310 >> v1:172.21.15.12:6789/0 conn(0x7f11380a9c10 legacy=0x7f1138147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f1137fff700 1 -- 172.21.15.12:0/1472145310 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380b0f10 con 0x7f11380b18f0 2021-10-20T23:19:58.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f11377fe700 1 -- 172.21.15.12:0/1472145310 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351965111 0 0) 0x7f11380b33e0 con 0x7f11380a9c10 2021-10-20T23:19:58.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f1137fff700 1 --2- 172.21.15.12:0/1472145310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11380b18f0 0x7f11380b2300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f11280032f0 tx=0x7f11280091d0).ready entity=mon.1 client_cookie=1d6dc284ac44a949 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:58.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f11377fe700 1 -- 172.21.15.12:0/1472145310 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1128009ea0 con 0x7f11380b18f0 2021-10-20T23:19:58.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f11377fe700 1 -- 172.21.15.12:0/1472145310 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112800b8a0 con 0x7f11380b18f0 2021-10-20T23:19:58.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.904+0000 7f11377fe700 1 -- 172.21.15.12:0/1472145310 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f112800ba10 con 0x7f11380b18f0 2021-10-20T23:19:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 -- 172.21.15.12:0/1472145310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11380b18f0 msgr2=0x7f11380b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 --2- 172.21.15.12:0/1472145310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11380b18f0 0x7f11380b2300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f11280032f0 tx=0x7f11280091d0).stop 2021-10-20T23:19:58.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 -- 172.21.15.12:0/1472145310 shutdown_connections 2021-10-20T23:19:58.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 --2- 172.21.15.12:0/1472145310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11380b18f0 0x7f11380b2300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 -- 172.21.15.12:0/1472145310 >> 172.21.15.12:0/1472145310 conn(0x7f11380636e0 msgr2=0x7f1138063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:58.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 -- 172.21.15.12:0/1472145310 shutdown_connections 2021-10-20T23:19:58.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 -- 172.21.15.12:0/1472145310 wait complete. 2021-10-20T23:19:58.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 Processor -- start 2021-10-20T23:19:58.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 -- start start 2021-10-20T23:19:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11380a9c10 0x7f113814e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11380b18f0 0x7f1138144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11380b3000 0x7f1138144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113814db40 con 0x7f11380a9c10 2021-10-20T23:19:58.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11380b4ac0 con 0x7f11380b3000 2021-10-20T23:19:58.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113dc93700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11380b4cf0 con 0x7f11380b18f0 2021-10-20T23:19:58.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113cc91700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11380a9c10 0x7f113814e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113cc91700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11380a9c10 0x7f113814e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36654/0 (socket says 172.21.15.12:36654) 2021-10-20T23:19:58.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113cc91700 1 -- 172.21.15.12:0/37670836 learned_addr learned my addr 172.21.15.12:0/37670836 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:58.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f1137fff700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11380b18f0 0x7f1138144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113d492700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11380b3000 0x7f1138144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.908+0000 7f113cc91700 1 -- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11380b18f0 msgr2=0x7f1138144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f113cc91700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11380b18f0 0x7f1138144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f113cc91700 1 -- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11380b3000 msgr2=0x7f1138144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:58.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f113cc91700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11380b3000 0x7f1138144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:58.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f113cc91700 1 -- 172.21.15.12:0/37670836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128009470 con 0x7f11380a9c10 2021-10-20T23:19:58.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f113cc91700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11380a9c10 0x7f113814e9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1138067e80 tx=0x7f1120007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:58.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f1135ffb700 1 -- 172.21.15.12:0/37670836 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f112000ce80 con 0x7f11380a9c10 2021-10-20T23:19:58.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f1135ffb700 1 -- 172.21.15.12:0/37670836 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120007170 con 0x7f11380a9c10 2021-10-20T23:19:58.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113814cb40 con 0x7f11380a9c10 2021-10-20T23:19:58.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f1135ffb700 1 -- 172.21.15.12:0/37670836 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1120004520 con 0x7f11380a9c10 2021-10-20T23:19:58.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11380605c0 con 0x7f11380a9c10 2021-10-20T23:19:58.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11380b5070 con 0x7f11380a9c10 2021-10-20T23:19:58.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f1135ffb700 1 -- 172.21.15.12:0/37670836 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1120004680 con 0x7f11380a9c10 2021-10-20T23:19:58.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.912+0000 7f1135ffb700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f111c0536a0 0x7f111c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:58.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.916+0000 7f1135ffb700 1 -- 172.21.15.12:0/37670836 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f112006b2a0 con 0x7f11380a9c10 2021-10-20T23:19:58.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.916+0000 7f1137fff700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f111c0536a0 0x7f111c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:58.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.916+0000 7f1137fff700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f111c0536a0 0x7f111c055b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f112801b000 tx=0x7f1128016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:58.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:58.924+0000 7f1135ffb700 1 -- 172.21.15.12:0/37670836 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1120042240 con 0x7f11380a9c10 2021-10-20T23:19:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.052+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1138057350 con 0x7f11380a9c10 2021-10-20T23:19:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.052+0000 7f1135ffb700 1 -- 172.21.15.12:0/37670836 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f1120045860 con 0x7f11380a9c10 2021-10-20T23:19:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:19:59.063 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:19:59.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f111c0536a0 msgr2=0x7f111c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f111c0536a0 0x7f111c055b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f112801b000 tx=0x7f1128016000).stop 2021-10-20T23:19:59.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11380a9c10 msgr2=0x7f113814e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11380a9c10 0x7f113814e9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1138067e80 tx=0x7f1120007bd0).stop 2021-10-20T23:19:59.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 shutdown_connections 2021-10-20T23:19:59.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f111c0536a0 0x7f111c055b60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11380b3000 0x7f1138144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11380b18f0 0x7f1138144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 --2- 172.21.15.12:0/37670836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11380a9c10 0x7f113814e9e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 >> 172.21.15.12:0/37670836 conn(0x7f11380636e0 msgr2=0x7f113814a180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:59.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 shutdown_connections 2021-10-20T23:19:59.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.056+0000 7f113dc93700 1 -- 172.21.15.12:0/37670836 wait complete. 2021-10-20T23:19:59.075 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:19:51.434642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:19:54.214563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:19:59.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:19:59.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e216fa700 1 Processor -- start 2021-10-20T23:19:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e216fa700 1 -- start start 2021-10-20T23:19:59.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e216fa700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6e1c061320 0x7f6e1c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e216fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 0x7f6e1c0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e216fa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0aecf0 con 0x7f6e1c140440 2021-10-20T23:19:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e216fa700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1c0b6f20 con 0x7f6e1c061320 2021-10-20T23:19:59.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e216fa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0aef20 con 0x7f6e1c0ad5c0 2021-10-20T23:19:59.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e1bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6e1c061320 0x7f6e1c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e1b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 0x7f6e1c0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e20ef9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6e1c140440 0x7f6e1c146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:42324/0 (socket says 172.21.15.12:42324) 2021-10-20T23:19:59.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e20ef9700 1 -- 172.21.15.12:0/2767536546 learned_addr learned my addr 172.21.15.12:0/2767536546 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:59.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e1affd700 1 -- 172.21.15.12:0/2767536546 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347789000 0 0) 0x7f6e1c0aecf0 con 0x7f6e1c140440 2021-10-20T23:19:59.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.176+0000 7f6e1affd700 1 -- 172.21.15.12:0/2767536546 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e08003260 con 0x7f6e1c140440 2021-10-20T23:19:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e1bfff700 1 -- 172.21.15.12:0/2767536546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 msgr2=0x7f6e1c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e1bfff700 1 --2- 172.21.15.12:0/2767536546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 0x7f6e1c0b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e1bfff700 1 -- 172.21.15.12:0/2767536546 >> v1:172.21.15.31:6789/0 conn(0x7f6e1c140440 legacy=0x7f6e1c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e1bfff700 1 -- 172.21.15.12:0/2767536546 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0af1c0 con 0x7f6e1c061320 2021-10-20T23:19:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e1b7fe700 1 --2- 172.21.15.12:0/2767536546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 0x7f6e1c0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:19:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e1bfff700 1 --2- 172.21.15.12:0/2767536546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e1c061320 0x7f6e1c061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6e10002f70 tx=0x7f6e10006df0).ready entity=mon.1 client_cookie=85b5cb3aad8e031b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e1affd700 1 -- 172.21.15.12:0/2767536546 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e1000d4a0 con 0x7f6e1c061320 2021-10-20T23:19:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e1affd700 1 -- 172.21.15.12:0/2767536546 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e10000e90 con 0x7f6e1c061320 2021-10-20T23:19:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e1affd700 1 -- 172.21.15.12:0/2767536546 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e1000d7f0 con 0x7f6e1c061320 2021-10-20T23:19:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 -- 172.21.15.12:0/2767536546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e1c061320 msgr2=0x7f6e1c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 --2- 172.21.15.12:0/2767536546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e1c061320 0x7f6e1c061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6e10002f70 tx=0x7f6e10006df0).stop 2021-10-20T23:19:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 -- 172.21.15.12:0/2767536546 shutdown_connections 2021-10-20T23:19:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 --2- 172.21.15.12:0/2767536546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 0x7f6e1c0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 --2- 172.21.15.12:0/2767536546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e1c061320 0x7f6e1c061700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 -- 172.21.15.12:0/2767536546 >> 172.21.15.12:0/2767536546 conn(0x7f6e1c066de0 msgr2=0x7f6e1c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 -- 172.21.15.12:0/2767536546 shutdown_connections 2021-10-20T23:19:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 -- 172.21.15.12:0/2767536546 wait complete. 2021-10-20T23:19:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 Processor -- start 2021-10-20T23:19:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.180+0000 7f6e216fa700 1 -- start start 2021-10-20T23:19:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e216fa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e1c061320 0x7f6e1c140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e216fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 0x7f6e1c0b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e216fa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e1c140440 0x7f6e1c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e216fa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c152e10 con 0x7f6e1c140440 2021-10-20T23:19:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e216fa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0aca00 con 0x7f6e1c061320 2021-10-20T23:19:59.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e216fa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c153040 con 0x7f6e1c0ad5c0 2021-10-20T23:19:59.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e20ef9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e1c140440 0x7f6e1c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e20ef9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e1c140440 0x7f6e1c0b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36672/0 (socket says 172.21.15.12:36672) 2021-10-20T23:19:59.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e20ef9700 1 -- 172.21.15.12:0/2609623967 learned_addr learned my addr 172.21.15.12:0/2609623967 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:59.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e1bfff700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e1c061320 0x7f6e1c140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e1b7fe700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 0x7f6e1c0b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e20ef9700 1 -- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 msgr2=0x7f6e1c0b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e20ef9700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 0x7f6e1c0b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e20ef9700 1 -- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e1c061320 msgr2=0x7f6e1c140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e20ef9700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e1c061320 0x7f6e1c140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e20ef9700 1 -- 172.21.15.12:0/2609623967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c009470 con 0x7f6e1c140440 2021-10-20T23:19:59.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e20ef9700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e1c140440 0x7f6e1c0b1880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f6e14001110 tx=0x7f6e14007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e197fa700 1 -- 172.21.15.12:0/2609623967 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e140070d0 con 0x7f6e1c140440 2021-10-20T23:19:59.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e197fa700 1 -- 172.21.15.12:0/2609623967 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e14007230 con 0x7f6e1c140440 2021-10-20T23:19:59.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1000b180 con 0x7f6e1c140440 2021-10-20T23:19:59.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e197fa700 1 -- 172.21.15.12:0/2609623967 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e14005610 con 0x7f6e1c140440 2021-10-20T23:19:59.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.184+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c0b0ce0 con 0x7f6e1c140440 2021-10-20T23:19:59.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.188+0000 7f6e197fa700 1 -- 172.21.15.12:0/2609623967 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6e14010070 con 0x7f6e1c140440 2021-10-20T23:19:59.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.188+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c153200 con 0x7f6e1c140440 2021-10-20T23:19:59.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.188+0000 7f6e197fa700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6dfc0535b0 0x7f6dfc055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.188+0000 7f6e197fa700 1 -- 172.21.15.12:0/2609623967 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6e1406b1e0 con 0x7f6e1c140440 2021-10-20T23:19:59.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.188+0000 7f6e1bfff700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6dfc0535b0 0x7f6dfc055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.188+0000 7f6e1bfff700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6dfc0535b0 0x7f6dfc055a70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6e10018000 tx=0x7f6e10014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.192+0000 7f6e197fa700 1 -- 172.21.15.12:0/2609623967 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e14042140 con 0x7f6e1c140440 2021-10-20T23:19:59.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6e1c0af460 con 0x7f6e1c140440 2021-10-20T23:19:59.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e197fa700 1 -- 172.21.15.12:0/2609623967 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6e14045760 con 0x7f6e1c140440 2021-10-20T23:19:59.329 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:19:59.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6dfc0535b0 msgr2=0x7f6dfc055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6dfc0535b0 0x7f6dfc055a70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6e10018000 tx=0x7f6e10014000).stop 2021-10-20T23:19:59.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e1c140440 msgr2=0x7f6e1c0b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e1c140440 0x7f6e1c0b1880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f6e14001110 tx=0x7f6e14007a80).stop 2021-10-20T23:19:59.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 shutdown_connections 2021-10-20T23:19:59.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6dfc0535b0 0x7f6dfc055a70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e1c140440 0x7f6e1c0b1880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e1c0ad5c0 0x7f6e1c0b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 --2- 172.21.15.12:0/2609623967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e1c061320 0x7f6e1c140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 >> 172.21.15.12:0/2609623967 conn(0x7f6e1c066de0 msgr2=0x7f6e1c1447e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:59.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 shutdown_connections 2021-10-20T23:19:59.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.320+0000 7f6e216fa700 1 -- 172.21.15.12:0/2609623967 wait complete. 2021-10-20T23:19:59.341 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:19:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1f81c700 1 Processor -- start 2021-10-20T23:19:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1f81c700 1 -- start start 2021-10-20T23:19:59.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1f81c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde18146950 0x7fde18140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1f81c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde180b4180 0x7fde18140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1f81c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde18143b60 con 0x7fde180b4690 2021-10-20T23:19:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1f81c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde18147510 con 0x7fde180b4180 2021-10-20T23:19:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1f81c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde18143e00 con 0x7fde18146950 2021-10-20T23:19:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1cdb7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde180b4180 0x7fde18140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1ddb9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fde180b4690 0x7fde180b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:42338/0 (socket says 172.21.15.12:42338) 2021-10-20T23:19:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1cdb7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde180b4180 0x7fde18140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:51652/0 (socket says 172.21.15.12:51652) 2021-10-20T23:19:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1ddb9700 1 -- 172.21.15.12:0/2793202625 learned_addr learned my addr 172.21.15.12:0/2793202625 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.440+0000 7fde1d5b8700 1 --2- 172.21.15.12:0/2793202625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde18146950 0x7fde18140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1cdb7700 1 -- 172.21.15.12:0/2793202625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde18146950 msgr2=0x7fde18140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1cdb7700 1 --2- 172.21.15.12:0/2793202625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde18146950 0x7fde18140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1cdb7700 1 -- 172.21.15.12:0/2793202625 >> v1:172.21.15.31:6789/0 conn(0x7fde180b4690 legacy=0x7fde180b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1cdb7700 1 -- 172.21.15.12:0/2793202625 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde180b0c90 con 0x7fde180b4180 2021-10-20T23:19:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1cdb7700 1 --2- 172.21.15.12:0/2793202625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde180b4180 0x7fde18140720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fde14002f70 tx=0x7fde14006df0).ready entity=mon.1 client_cookie=bea606d89181d67a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde07fff700 1 -- 172.21.15.12:0/2793202625 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde1400d570 con 0x7fde180b4180 2021-10-20T23:19:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde07fff700 1 -- 172.21.15.12:0/2793202625 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde14000e90 con 0x7fde180b4180 2021-10-20T23:19:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde07fff700 1 -- 172.21.15.12:0/2793202625 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde1400d8c0 con 0x7fde180b4180 2021-10-20T23:19:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 -- 172.21.15.12:0/2793202625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde180b4180 msgr2=0x7fde18140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 --2- 172.21.15.12:0/2793202625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde180b4180 0x7fde18140720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fde14002f70 tx=0x7fde14006df0).stop 2021-10-20T23:19:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 -- 172.21.15.12:0/2793202625 shutdown_connections 2021-10-20T23:19:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 --2- 172.21.15.12:0/2793202625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde180b4180 0x7fde18140720 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 --2- 172.21.15.12:0/2793202625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde18146950 0x7fde18140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 -- 172.21.15.12:0/2793202625 >> 172.21.15.12:0/2793202625 conn(0x7fde1805c490 msgr2=0x7fde1805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 -- 172.21.15.12:0/2793202625 shutdown_connections 2021-10-20T23:19:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 -- 172.21.15.12:0/2793202625 wait complete. 2021-10-20T23:19:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 Processor -- start 2021-10-20T23:19:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.444+0000 7fde1f81c700 1 -- start start 2021-10-20T23:19:59.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1f81c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde180b4180 0x7fde180b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1f81c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde180b4690 0x7fde18155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1f81c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde18146950 0x7fde181563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1f81c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18142c50 con 0x7fde180b4180 2021-10-20T23:19:59.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1f81c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18142ef0 con 0x7fde18146950 2021-10-20T23:19:59.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1f81c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde18155a60 con 0x7fde180b4690 2021-10-20T23:19:59.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1d5b8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde180b4180 0x7fde180b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1d5b8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde180b4180 0x7fde180b84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36684/0 (socket says 172.21.15.12:36684) 2021-10-20T23:19:59.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1d5b8700 1 -- 172.21.15.12:0/230809465 learned_addr learned my addr 172.21.15.12:0/230809465 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:59.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1ddb9700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde18146950 0x7fde181563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1cdb7700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde180b4690 0x7fde18155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1d5b8700 1 -- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde180b4690 msgr2=0x7fde18155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1d5b8700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde180b4690 0x7fde18155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1d5b8700 1 -- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde18146950 msgr2=0x7fde181563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1d5b8700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde18146950 0x7fde181563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1d5b8700 1 -- 172.21.15.12:0/230809465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1400b180 con 0x7fde180b4180 2021-10-20T23:19:59.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1d5b8700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde180b4180 0x7fde180b84f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fde0800c000 tx=0x7fde08006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde067fc700 1 -- 172.21.15.12:0/230809465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde08011750 con 0x7fde180b4180 2021-10-20T23:19:59.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde180b89e0 con 0x7fde180b4180 2021-10-20T23:19:59.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde067fc700 1 -- 172.21.15.12:0/230809465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde080118b0 con 0x7fde180b4180 2021-10-20T23:19:59.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde067fc700 1 -- 172.21.15.12:0/230809465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde08011c10 con 0x7fde180b4180 2021-10-20T23:19:59.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.448+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde180ad5f0 con 0x7fde180b4180 2021-10-20T23:19:59.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.452+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde18155c20 con 0x7fde180b4180 2021-10-20T23:19:59.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.452+0000 7fde067fc700 1 -- 172.21.15.12:0/230809465 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde08011d70 con 0x7fde180b4180 2021-10-20T23:19:59.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.452+0000 7fde067fc700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddf8053580 0x7fddf8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.452+0000 7fde067fc700 1 -- 172.21.15.12:0/230809465 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fde0806bfd0 con 0x7fde180b4180 2021-10-20T23:19:59.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.452+0000 7fde1cdb7700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddf8053580 0x7fddf8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.452+0000 7fde1cdb7700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddf8053580 0x7fddf8055a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fde1401a000 tx=0x7fde14014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.456+0000 7fde067fc700 1 -- 172.21.15.12:0/230809465 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde08042ec0 con 0x7fde180b4180 2021-10-20T23:19:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.584+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde181430b0 con 0x7fde180b4180 2021-10-20T23:19:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.584+0000 7fde067fc700 1 -- 172.21.15.12:0/230809465 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde080464e0 con 0x7fde180b4180 2021-10-20T23:19:59.595 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:19:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddf8053580 msgr2=0x7fddf8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddf8053580 0x7fddf8055a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fde1401a000 tx=0x7fde14014000).stop 2021-10-20T23:19:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde180b4180 msgr2=0x7fde180b84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde180b4180 0x7fde180b84f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fde0800c000 tx=0x7fde08006df0).stop 2021-10-20T23:19:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 shutdown_connections 2021-10-20T23:19:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddf8053580 0x7fddf8055a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde18146950 0x7fde181563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde180b4690 0x7fde18155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 --2- 172.21.15.12:0/230809465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde180b4180 0x7fde180b84f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 >> 172.21.15.12:0/230809465 conn(0x7fde1805c490 msgr2=0x7fde180b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:59.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 shutdown_connections 2021-10-20T23:19:59.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.588+0000 7fde1f81c700 1 -- 172.21.15.12:0/230809465 wait complete. 2021-10-20T23:19:59.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:19:59.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.708+0000 7f0078a48700 1 Processor -- start 2021-10-20T23:19:59.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.708+0000 7f0078a48700 1 -- start start 2021-10-20T23:19:59.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.708+0000 7f0078a48700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0074060d20 0x7f007405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.708+0000 7f0078a48700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0074143c90 0x7f007412c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.708+0000 7f0078a48700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740b3c40 con 0x7f00740b21b0 2021-10-20T23:19:59.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.708+0000 7f0078a48700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0074063df0 con 0x7f0074143c90 2021-10-20T23:19:59.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.708+0000 7f0078a48700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740b2590 con 0x7f0074060d20 2021-10-20T23:19:59.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0073fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0074143c90 0x7f007412c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0073fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0074143c90 0x7f007412c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36694/0 (socket says 172.21.15.12:36694) 2021-10-20T23:19:59.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0073fff700 1 -- 172.21.15.12:0/4201307864 learned_addr learned my addr 172.21.15.12:0/4201307864 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:59.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f00737fe700 1 --1- 172.21.15.12:0/4201307864 >> v1:172.21.15.12:6789/0 conn(0x7f00740b21b0 0x7f00740b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35284/0 (socket says 172.21.15.12:35284) 2021-10-20T23:19:59.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0072ffd700 1 --2- 172.21.15.12:0/4201307864 >> v2:172.21.15.31:3300/0 conn(0x7f0074060d20 0x7f007405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0073fff700 1 -- 172.21.15.12:0/4201307864 >> v2:172.21.15.31:3300/0 conn(0x7f0074060d20 msgr2=0x7f007405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:59.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0073fff700 1 --2- 172.21.15.12:0/4201307864 >> v2:172.21.15.31:3300/0 conn(0x7f0074060d20 0x7f007405f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0073fff700 1 -- 172.21.15.12:0/4201307864 >> v1:172.21.15.12:6789/0 conn(0x7f00740b21b0 legacy=0x7f00740b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0073fff700 1 -- 172.21.15.12:0/4201307864 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740b2e30 con 0x7f0074143c90 2021-10-20T23:19:59.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0073fff700 1 --2- 172.21.15.12:0/4201307864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0074143c90 0x7f007412c020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0064001110 tx=0x7f006c009290).ready entity=mon.0 client_cookie=7046a06f98852a24 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f00727fc700 1 -- 172.21.15.12:0/4201307864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006c00b730 con 0x7f0074143c90 2021-10-20T23:19:59.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f00727fc700 1 -- 172.21.15.12:0/4201307864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00b890 con 0x7f0074143c90 2021-10-20T23:19:59.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f00727fc700 1 -- 172.21.15.12:0/4201307864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006c00ba00 con 0x7f0074143c90 2021-10-20T23:19:59.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0078a48700 1 -- 172.21.15.12:0/4201307864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0074143c90 msgr2=0x7f007412c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0078a48700 1 --2- 172.21.15.12:0/4201307864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0074143c90 0x7f007412c020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0064001110 tx=0x7f006c009290).stop 2021-10-20T23:19:59.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0078a48700 1 -- 172.21.15.12:0/4201307864 shutdown_connections 2021-10-20T23:19:59.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0078a48700 1 --2- 172.21.15.12:0/4201307864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0074143c90 0x7f007412c020 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0078a48700 1 --2- 172.21.15.12:0/4201307864 >> v2:172.21.15.31:3300/0 conn(0x7f0074060d20 0x7f007405f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0078a48700 1 -- 172.21.15.12:0/4201307864 >> 172.21.15.12:0/4201307864 conn(0x7f007405c490 msgr2=0x7f007405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:59.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0078a48700 1 -- 172.21.15.12:0/4201307864 shutdown_connections 2021-10-20T23:19:59.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.712+0000 7f0078a48700 1 -- 172.21.15.12:0/4201307864 wait complete. 2021-10-20T23:19:59.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 Processor -- start 2021-10-20T23:19:59.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 -- start start 2021-10-20T23:19:59.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0074060d20 0x7f0074145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00740b21b0 0x7f0074155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0074143c90 0x7f0074144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00741566c0 con 0x7f00740b21b0 2021-10-20T23:19:59.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074156960 con 0x7f0074060d20 2021-10-20T23:19:59.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074146c30 con 0x7f0074143c90 2021-10-20T23:19:59.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0072ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00740b21b0 0x7f0074155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0072ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00740b21b0 0x7f0074155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36698/0 (socket says 172.21.15.12:36698) 2021-10-20T23:19:59.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0072ffd700 1 -- 172.21.15.12:0/276084124 learned_addr learned my addr 172.21.15.12:0/276084124 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:59.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f00737fe700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0074060d20 0x7f0074145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0073fff700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0074143c90 0x7f0074144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0072ffd700 1 -- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0074143c90 msgr2=0x7f0074144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0072ffd700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0074143c90 0x7f0074144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0072ffd700 1 -- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0074060d20 msgr2=0x7f0074145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0072ffd700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0074060d20 0x7f0074145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0072ffd700 1 -- 172.21.15.12:0/276084124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009530 con 0x7f00740b21b0 2021-10-20T23:19:59.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0073fff700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0074143c90 0x7f0074144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:19:59.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0072ffd700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00740b21b0 0x7f0074155e80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f005c00c000 tx=0x7f005c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0070ff9700 1 -- 172.21.15.12:0/276084124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f005c010780 con 0x7f00740b21b0 2021-10-20T23:19:59.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0070ff9700 1 -- 172.21.15.12:0/276084124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c0108e0 con 0x7f00740b21b0 2021-10-20T23:19:59.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00740652c0 con 0x7f00740b21b0 2021-10-20T23:19:59.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0070ff9700 1 -- 172.21.15.12:0/276084124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f005c010c40 con 0x7f00740b21b0 2021-10-20T23:19:59.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.716+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0074156370 con 0x7f00740b21b0 2021-10-20T23:19:59.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.720+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074146df0 con 0x7f00740b21b0 2021-10-20T23:19:59.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.720+0000 7f0070ff9700 1 -- 172.21.15.12:0/276084124 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f005c01c460 con 0x7f00740b21b0 2021-10-20T23:19:59.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.720+0000 7f0070ff9700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0058053610 0x7f0058055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.720+0000 7f0070ff9700 1 -- 172.21.15.12:0/276084124 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f005c06bf60 con 0x7f00740b21b0 2021-10-20T23:19:59.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.720+0000 7f00737fe700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0058053610 0x7f0058055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.720+0000 7f00737fe700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0058053610 0x7f0058055ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f006400d000 tx=0x7f0064000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.724+0000 7f0070ff9700 1 -- 172.21.15.12:0/276084124 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f005c042e60 con 0x7f00740b21b0 2021-10-20T23:19:59.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.852+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00740638b0 con 0x7f00740b21b0 2021-10-20T23:19:59.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.852+0000 7f0070ff9700 1 -- 172.21.15.12:0/276084124 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f005c046480 con 0x7f00740b21b0 2021-10-20T23:19:59.861 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:19:59.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0058053610 msgr2=0x7f0058055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0058053610 0x7f0058055ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f006400d000 tx=0x7f0064000bc0).stop 2021-10-20T23:19:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00740b21b0 msgr2=0x7f0074155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00740b21b0 0x7f0074155e80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f005c00c000 tx=0x7f005c006df0).stop 2021-10-20T23:19:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 shutdown_connections 2021-10-20T23:19:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0058053610 0x7f0058055ad0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0074143c90 0x7f0074144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00740b21b0 0x7f0074155e80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 --2- 172.21.15.12:0/276084124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0074060d20 0x7f0074145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 >> 172.21.15.12:0/276084124 conn(0x7f007405c490 msgr2=0x7f0074140210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 shutdown_connections 2021-10-20T23:19:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.856+0000 7f0078a48700 1 -- 172.21.15.12:0/276084124 wait complete. 2021-10-20T23:19:59.874 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:19:59.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd226657700 1 Processor -- start 2021-10-20T23:19:59.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd226657700 1 -- start start 2021-10-20T23:19:59.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd226657700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2200b6290 0x7fd220061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd226657700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 0x7fd220061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd226657700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2200b5f50 con 0x7fd220061e50 2021-10-20T23:19:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd226657700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2200b1f70 con 0x7fd2200b6290 2021-10-20T23:19:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd226657700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200b2210 con 0x7fd2200b4060 2021-10-20T23:19:59.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd225655700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2200b6290 0x7fd220061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd225e56700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd220061e50 0x7fd220146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35300/0 (socket says 172.21.15.12:35300) 2021-10-20T23:19:59.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.972+0000 7fd225e56700 1 -- 172.21.15.12:0/1313254165 learned_addr learned my addr 172.21.15.12:0/1313254165 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:19:59.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd224e54700 1 --2- 172.21.15.12:0/1313254165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 0x7fd220061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd217fff700 1 -- 172.21.15.12:0/1313254165 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933642491 0 0) 0x7fd218001490 con 0x7fd220061e50 2021-10-20T23:19:59.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd217fff700 1 -- 172.21.15.12:0/1313254165 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd204003260 con 0x7fd220061e50 2021-10-20T23:19:59.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd217fff700 1 -- 172.21.15.12:0/1313254165 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1433099833 0 0) 0x7fd204003260 con 0x7fd220061e50 2021-10-20T23:19:59.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd225655700 1 -- 172.21.15.12:0/1313254165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 msgr2=0x7fd220061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:19:59.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd225655700 1 --2- 172.21.15.12:0/1313254165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 0x7fd220061960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd225655700 1 -- 172.21.15.12:0/1313254165 >> v1:172.21.15.12:6789/0 conn(0x7fd220061e50 legacy=0x7fd220146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd225655700 1 -- 172.21.15.12:0/1313254165 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200b24b0 con 0x7fd2200b6290 2021-10-20T23:19:59.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd225655700 1 --2- 172.21.15.12:0/1313254165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2200b6290 0x7fd220061470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fd218001d10 tx=0x7fd210006df0).ready entity=mon.0 client_cookie=26b98808223e1555 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd217fff700 1 -- 172.21.15.12:0/1313254165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd218001b70 con 0x7fd2200b6290 2021-10-20T23:19:59.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd217fff700 1 -- 172.21.15.12:0/1313254165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd210000e90 con 0x7fd2200b6290 2021-10-20T23:19:59.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd217fff700 1 -- 172.21.15.12:0/1313254165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd210012460 con 0x7fd2200b6290 2021-10-20T23:19:59.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 -- 172.21.15.12:0/1313254165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2200b6290 msgr2=0x7fd220061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 --2- 172.21.15.12:0/1313254165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2200b6290 0x7fd220061470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fd218001d10 tx=0x7fd210006df0).stop 2021-10-20T23:19:59.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 -- 172.21.15.12:0/1313254165 shutdown_connections 2021-10-20T23:19:59.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 --2- 172.21.15.12:0/1313254165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 0x7fd220061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 --2- 172.21.15.12:0/1313254165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2200b6290 0x7fd220061470 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 -- 172.21.15.12:0/1313254165 >> 172.21.15.12:0/1313254165 conn(0x7fd22005c490 msgr2=0x7fd22005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:19:59.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 -- 172.21.15.12:0/1313254165 shutdown_connections 2021-10-20T23:19:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 -- 172.21.15.12:0/1313254165 wait complete. 2021-10-20T23:19:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 Processor -- start 2021-10-20T23:19:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.976+0000 7fd226657700 1 -- start start 2021-10-20T23:19:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd226657700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd220061e50 0x7fd220145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd226657700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 0x7fd220155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd226657700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2200b6290 0x7fd220155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:19:59.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd226657700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200af9a0 con 0x7fd220061e50 2021-10-20T23:19:59.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd226657700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200affd0 con 0x7fd2200b6290 2021-10-20T23:19:59.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd226657700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200b0230 con 0x7fd2200b4060 2021-10-20T23:19:59.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225655700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd220061e50 0x7fd220145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225655700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd220061e50 0x7fd220145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36714/0 (socket says 172.21.15.12:36714) 2021-10-20T23:19:59.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd224e54700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 0x7fd220155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225655700 1 -- 172.21.15.12:0/3817591111 learned_addr learned my addr 172.21.15.12:0/3817591111 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:19:59.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225e56700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2200b6290 0x7fd220155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:19:59.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225655700 1 -- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 msgr2=0x7fd220155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225655700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 0x7fd220155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225655700 1 -- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2200b6290 msgr2=0x7fd220155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:19:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225655700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2200b6290 0x7fd220155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:19:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225655700 1 -- 172.21.15.12:0/3817591111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21000b180 con 0x7fd220061e50 2021-10-20T23:19:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd225655700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd220061e50 0x7fd220145de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd218001d10 tx=0x7fd210014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:19:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd2167fc700 1 -- 172.21.15.12:0/3817591111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd210016030 con 0x7fd220061e50 2021-10-20T23:19:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd2167fc700 1 -- 172.21.15.12:0/3817591111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd210013e40 con 0x7fd220061e50 2021-10-20T23:20:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2200af020 con 0x7fd220061e50 2021-10-20T23:20:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd2167fc700 1 -- 172.21.15.12:0/3817591111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21000ddb0 con 0x7fd220061e50 2021-10-20T23:20:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd220143cd0 con 0x7fd220061e50 2021-10-20T23:20:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.980+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2200b2750 con 0x7fd220061e50 2021-10-20T23:20:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.984+0000 7fd2167fc700 1 -- 172.21.15.12:0/3817591111 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd210024020 con 0x7fd220061e50 2021-10-20T23:20:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.984+0000 7fd2167fc700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd208053610 0x7fd208055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.984+0000 7fd2167fc700 1 -- 172.21.15.12:0/3817591111 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd210017070 con 0x7fd220061e50 2021-10-20T23:20:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.984+0000 7fd224e54700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd208053610 0x7fd208055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.984+0000 7fd224e54700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd208053610 0x7fd208055ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd21c00b000 tx=0x7fd21c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:19:59.988+0000 7fd2167fc700 1 -- 172.21.15.12:0/3817591111 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2100439c0 con 0x7fd220061e50 2021-10-20T23:20:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd220057350 con 0x7fd220061e50 2021-10-20T23:20:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd2167fc700 1 -- 172.21.15.12:0/3817591111 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd210046fe0 con 0x7fd220061e50 2021-10-20T23:20:00.125 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd208053610 msgr2=0x7fd208055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd208053610 0x7fd208055ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd21c00b000 tx=0x7fd21c006df0).stop 2021-10-20T23:20:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd220061e50 msgr2=0x7fd220145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd220061e50 0x7fd220145de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd218001d10 tx=0x7fd210014000).stop 2021-10-20T23:20:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 shutdown_connections 2021-10-20T23:20:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd208053610 0x7fd208055ad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2200b6290 0x7fd220155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2200b4060 0x7fd220155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 --2- 172.21.15.12:0/3817591111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd220061e50 0x7fd220145de0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 >> 172.21.15.12:0/3817591111 conn(0x7fd22005c490 msgr2=0x7fd220146700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:00.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 shutdown_connections 2021-10-20T23:20:00.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.116+0000 7fd226657700 1 -- 172.21.15.12:0/3817591111 wait complete. 2021-10-20T23:20:00.137 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-10-20T23:20:00.138 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-10-20T23:20:00.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-10-20T23:20:00.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.232+0000 7f474afb3700 1 Processor -- start 2021-10-20T23:20:00.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.232+0000 7f474afb3700 1 -- start start 2021-10-20T23:20:00.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f47440b76b0 0x7f4744065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f474414aeb0 0x7f474414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47440b2a90 con 0x7f47440b2ee0 2021-10-20T23:20:00.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47440616a0 con 0x7f47440b76b0 2021-10-20T23:20:00.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4744065a80 con 0x7f474414aeb0 2021-10-20T23:20:00.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4749fb1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f47440b76b0 0x7f4744065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4749fb1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f47440b76b0 0x7f4744065590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36718/0 (socket says 172.21.15.12:36718) 2021-10-20T23:20:00.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4749fb1700 1 -- 172.21.15.12:0/15010193 learned_addr learned my addr 172.21.15.12:0/15010193 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:00.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474a7b2700 1 --2- 172.21.15.12:0/15010193 >> v2:172.21.15.31:3300/0 conn(0x7f474414aeb0 0x7f474414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4749fb1700 1 -- 172.21.15.12:0/15010193 >> v2:172.21.15.31:3300/0 conn(0x7f474414aeb0 msgr2=0x7f474414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:00.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4749fb1700 1 --2- 172.21.15.12:0/15010193 >> v2:172.21.15.31:3300/0 conn(0x7f474414aeb0 0x7f474414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4749fb1700 1 -- 172.21.15.12:0/15010193 >> v1:172.21.15.31:6789/0 conn(0x7f47440b2ee0 legacy=0x7f4744060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4749fb1700 1 -- 172.21.15.12:0/15010193 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47440b7a90 con 0x7f47440b76b0 2021-10-20T23:20:00.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4749fb1700 1 --2- 172.21.15.12:0/15010193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47440b76b0 0x7f4744065590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f47340032f0 tx=0x7f4734009250).ready entity=mon.0 client_cookie=41b5f8ca1cea9264 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4748faf700 1 -- 172.21.15.12:0/15010193 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4734009ea0 con 0x7f47440b76b0 2021-10-20T23:20:00.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4748faf700 1 -- 172.21.15.12:0/15010193 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473400b870 con 0x7f47440b76b0 2021-10-20T23:20:00.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f4748faf700 1 -- 172.21.15.12:0/15010193 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f473400b9e0 con 0x7f47440b76b0 2021-10-20T23:20:00.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 -- 172.21.15.12:0/15010193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47440b76b0 msgr2=0x7f4744065590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 --2- 172.21.15.12:0/15010193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47440b76b0 0x7f4744065590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f47340032f0 tx=0x7f4734009250).stop 2021-10-20T23:20:00.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 -- 172.21.15.12:0/15010193 shutdown_connections 2021-10-20T23:20:00.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 --2- 172.21.15.12:0/15010193 >> v2:172.21.15.31:3300/0 conn(0x7f474414aeb0 0x7f474414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 --2- 172.21.15.12:0/15010193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47440b76b0 0x7f4744065590 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 -- 172.21.15.12:0/15010193 >> 172.21.15.12:0/15010193 conn(0x7f474405f6b0 msgr2=0x7f474405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:00.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 -- 172.21.15.12:0/15010193 shutdown_connections 2021-10-20T23:20:00.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 -- 172.21.15.12:0/15010193 wait complete. 2021-10-20T23:20:00.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 Processor -- start 2021-10-20T23:20:00.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.236+0000 7f474afb3700 1 -- start start 2021-10-20T23:20:00.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474afb3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47440b2ee0 0x7f474409edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474afb3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47440b76b0 0x7f4744157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474afb3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f474414aeb0 0x7f47440a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474afb3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440a2c90 con 0x7f47440b76b0 2021-10-20T23:20:00.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474afb3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440af780 con 0x7f47440b2ee0 2021-10-20T23:20:00.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474afb3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47440a2e70 con 0x7f474414aeb0 2021-10-20T23:20:00.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f47497b0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47440b76b0 0x7f4744157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f4749fb1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47440b2ee0 0x7f474409edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f4749fb1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47440b2ee0 0x7f474409edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:51698/0 (socket says 172.21.15.12:51698) 2021-10-20T23:20:00.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f4749fb1700 1 -- 172.21.15.12:0/2543356591 learned_addr learned my addr 172.21.15.12:0/2543356591 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474a7b2700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f474414aeb0 0x7f47440a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f4749fb1700 1 -- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f474414aeb0 msgr2=0x7f47440a27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f4749fb1700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f474414aeb0 0x7f47440a27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f4749fb1700 1 -- 172.21.15.12:0/2543356591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47440b76b0 msgr2=0x7f4744157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f4749fb1700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47440b76b0 0x7f4744157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f4749fb1700 1 -- 172.21.15.12:0/2543356591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340094d0 con 0x7f47440b2ee0 2021-10-20T23:20:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474a7b2700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f474414aeb0 0x7f47440a27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f4749fb1700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47440b2ee0 0x7f474409edf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f47440a2220 tx=0x7f4734016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f473affd700 1 -- 172.21.15.12:0/2543356591 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4734006440 con 0x7f47440b2ee0 2021-10-20T23:20:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f473affd700 1 -- 172.21.15.12:0/2543356591 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47340065a0 con 0x7f47440b2ee0 2021-10-20T23:20:00.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47440a3110 con 0x7f47440b2ee0 2021-10-20T23:20:00.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f473affd700 1 -- 172.21.15.12:0/2543356591 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4734006900 con 0x7f47440b2ee0 2021-10-20T23:20:00.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.240+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4744149ec0 con 0x7f47440b2ee0 2021-10-20T23:20:00.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.244+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47440b27f0 con 0x7f47440b2ee0 2021-10-20T23:20:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.244+0000 7f473affd700 1 -- 172.21.15.12:0/2543356591 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4734027020 con 0x7f47440b2ee0 2021-10-20T23:20:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.244+0000 7f473affd700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47240534f0 0x7f47240559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.244+0000 7f473affd700 1 -- 172.21.15.12:0/2543356591 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f473406ce60 con 0x7f47440b2ee0 2021-10-20T23:20:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.244+0000 7f47497b0700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47240534f0 0x7f47240559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.244+0000 7f47497b0700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47240534f0 0x7f47240559b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f474000d000 tx=0x7f4740007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.252+0000 7f473affd700 1 -- 172.21.15.12:0/2543356591 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4734043dc0 con 0x7f47440b2ee0 2021-10-20T23:20:00.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.408+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4744057350 con 0x7f47440b2ee0 2021-10-20T23:20:00.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.416+0000 7f473affd700 1 -- 172.21.15.12:0/2543356591 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+131254 (secure 0 0 0) 0x7f4734015020 con 0x7f47440b2ee0 2021-10-20T23:20:00.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47240534f0 msgr2=0x7f47240559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47240534f0 0x7f47240559b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f474000d000 tx=0x7f4740007b90).stop 2021-10-20T23:20:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47440b2ee0 msgr2=0x7f474409edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47440b2ee0 0x7f474409edf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f47440a2220 tx=0x7f4734016000).stop 2021-10-20T23:20:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 shutdown_connections 2021-10-20T23:20:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47240534f0 0x7f47240559b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f474414aeb0 0x7f47440a27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47440b76b0 0x7f4744157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 --2- 172.21.15.12:0/2543356591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47440b2ee0 0x7f474409edf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 >> 172.21.15.12:0/2543356591 conn(0x7f474405f6b0 msgr2=0x7f4744065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 shutdown_connections 2021-10-20T23:20:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.420+0000 7f474afb3700 1 -- 172.21.15.12:0/2543356591 wait complete. 2021-10-20T23:20:00.440 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":14444},{"type":"v1","addr":"172.21.15.31:6801","nonce":14444}]},"active_addr":"172.21.15.31:6801/14444","active_change":"2021-10-20T23:19:39.947661+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1652935293}]},{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":4139229698}]},{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2375708531}]}]}} 2021-10-20T23:20:00.444 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-10-20T23:20:00.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-10-20T23:20:00.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:00.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefe05d8700 1 Processor -- start 2021-10-20T23:20:00.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefe05d8700 1 -- start start 2021-10-20T23:20:00.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefe05d8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b0fd0 0x7fefd8144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefe05d8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80b0350 con 0x7fefd80b1db0 2021-10-20T23:20:00.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefe05d8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80b05f0 con 0x7fefd81483a0 2021-10-20T23:20:00.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefe05d8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80a90c0 con 0x7fefd80b0fd0 2021-10-20T23:20:00.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefde374700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fefd80b1db0 0x7fefd80b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35326/0 (socket says 172.21.15.12:35326) 2021-10-20T23:20:00.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefde374700 1 -- 172.21.15.12:0/1313580981 learned_addr learned my addr 172.21.15.12:0/1313580981 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:00.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdeb75700 1 --2- 172.21.15.12:0/1313580981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b0fd0 0x7fefd8144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdd372700 1 -- 172.21.15.12:0/1313580981 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791724723 0 0) 0x7fefd80b0350 con 0x7fefd80b1db0 2021-10-20T23:20:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdd372700 1 -- 172.21.15.12:0/1313580981 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc0003260 con 0x7fefd80b1db0 2021-10-20T23:20:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdd372700 1 -- 172.21.15.12:0/1313580981 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240104185 0 0) 0x7fefd80b05f0 con 0x7fefd81483a0 2021-10-20T23:20:00.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdd372700 1 -- 172.21.15.12:0/1313580981 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd80b0350 con 0x7fefd81483a0 2021-10-20T23:20:00.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdeb75700 1 -- 172.21.15.12:0/1313580981 >> v1:172.21.15.31:6789/0 conn(0x7fefd81483a0 legacy=0x7fefd80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdeb75700 1 -- 172.21.15.12:0/1313580981 >> v1:172.21.15.12:6789/0 conn(0x7fefd80b1db0 legacy=0x7fefd80b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdeb75700 1 -- 172.21.15.12:0/1313580981 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80b0890 con 0x7fefd80b0fd0 2021-10-20T23:20:00.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdeb75700 1 --2- 172.21.15.12:0/1313580981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b0fd0 0x7fefd8144720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fefd8147730 tx=0x7fefd4006df0).ready entity=mon.2 client_cookie=d9522676db7172ce server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdd372700 1 -- 172.21.15.12:0/1313580981 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd400d5c0 con 0x7fefd80b0fd0 2021-10-20T23:20:00.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdd372700 1 -- 172.21.15.12:0/1313580981 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4000e90 con 0x7fefd80b0fd0 2021-10-20T23:20:00.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.540+0000 7fefdd372700 1 -- 172.21.15.12:0/1313580981 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd400d910 con 0x7fefd80b0fd0 2021-10-20T23:20:00.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 -- 172.21.15.12:0/1313580981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b0fd0 msgr2=0x7fefd8144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 --2- 172.21.15.12:0/1313580981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b0fd0 0x7fefd8144720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fefd8147730 tx=0x7fefd4006df0).stop 2021-10-20T23:20:00.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 -- 172.21.15.12:0/1313580981 shutdown_connections 2021-10-20T23:20:00.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 --2- 172.21.15.12:0/1313580981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b0fd0 0x7fefd8144720 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 -- 172.21.15.12:0/1313580981 >> 172.21.15.12:0/1313580981 conn(0x7fefd805f6b0 msgr2=0x7fefd805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:00.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 -- 172.21.15.12:0/1313580981 shutdown_connections 2021-10-20T23:20:00.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 -- 172.21.15.12:0/1313580981 wait complete. 2021-10-20T23:20:00.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 Processor -- start 2021-10-20T23:20:00.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 -- start start 2021-10-20T23:20:00.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd80b0fd0 0x7fefd8063450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b1db0 0x7fefd8063940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd81483a0 0x7fefd8159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8063e30 con 0x7fefd80b0fd0 2021-10-20T23:20:00.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8145150 con 0x7fefd81483a0 2021-10-20T23:20:00.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefe05d8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd81577e0 con 0x7fefd80b1db0 2021-10-20T23:20:00.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefde374700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd80b0fd0 0x7fefd8063450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefddb73700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b1db0 0x7fefd8063940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefde374700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd80b0fd0 0x7fefd8063450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36740/0 (socket says 172.21.15.12:36740) 2021-10-20T23:20:00.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefde374700 1 -- 172.21.15.12:0/1812778764 learned_addr learned my addr 172.21.15.12:0/1812778764 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:00.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefdeb75700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd81483a0 0x7fefd8159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefde374700 1 -- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b1db0 msgr2=0x7fefd8063940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefde374700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b1db0 0x7fefd8063940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefde374700 1 -- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd81483a0 msgr2=0x7fefd8159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefde374700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd81483a0 0x7fefd8159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefde374700 1 -- 172.21.15.12:0/1812778764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd400b180 con 0x7fefd80b0fd0 2021-10-20T23:20:00.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.544+0000 7fefddb73700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b1db0 0x7fefd8063940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:00.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefde374700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd80b0fd0 0x7fefd8063450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fefcc0011d0 tx=0x7fefcc007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefcb7fe700 1 -- 172.21.15.12:0/1812778764 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefcc0070d0 con 0x7fefd80b0fd0 2021-10-20T23:20:00.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefcb7fe700 1 -- 172.21.15.12:0/1812778764 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc007230 con 0x7fefd80b0fd0 2021-10-20T23:20:00.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd8148c80 con 0x7fefd80b0fd0 2021-10-20T23:20:00.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefcb7fe700 1 -- 172.21.15.12:0/1812778764 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefcc005610 con 0x7fefd80b0fd0 2021-10-20T23:20:00.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd81498b0 con 0x7fefd80b0fd0 2021-10-20T23:20:00.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd81579a0 con 0x7fefd80b0fd0 2021-10-20T23:20:00.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefcb7fe700 1 -- 172.21.15.12:0/1812778764 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fefcc01a060 con 0x7fefd80b0fd0 2021-10-20T23:20:00.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefcb7fe700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053660 0x7fefb8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.548+0000 7fefcb7fe700 1 -- 172.21.15.12:0/1812778764 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fefcc06b240 con 0x7fefd80b0fd0 2021-10-20T23:20:00.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.552+0000 7fefddb73700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053660 0x7fefb8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.552+0000 7fefddb73700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053660 0x7fefb8055b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fefd000d000 tx=0x7fefd0007d80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.556+0000 7fefcb7fe700 1 -- 172.21.15.12:0/1812778764 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fefcc042240 con 0x7fefd80b0fd0 2021-10-20T23:20:00.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.680+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefd80b27c0 con 0x7fefd80b0fd0 2021-10-20T23:20:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefcb7fe700 1 -- 172.21.15.12:0/1812778764 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fefcc018020 con 0x7fefd80b0fd0 2021-10-20T23:20:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:00.692 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053660 msgr2=0x7fefb8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053660 0x7fefb8055b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fefd000d000 tx=0x7fefd0007d80).stop 2021-10-20T23:20:00.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd80b0fd0 msgr2=0x7fefd8063450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd80b0fd0 0x7fefd8063450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fefcc0011d0 tx=0x7fefcc007b50).stop 2021-10-20T23:20:00.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 shutdown_connections 2021-10-20T23:20:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053660 0x7fefb8055b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd81483a0 0x7fefd8159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd80b1db0 0x7fefd8063940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 --2- 172.21.15.12:0/1812778764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd80b0fd0 0x7fefd8063450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 >> 172.21.15.12:0/1812778764 conn(0x7fefd805f6b0 msgr2=0x7fefd80aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:00.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 shutdown_connections 2021-10-20T23:20:00.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.684+0000 7fefe05d8700 1 -- 172.21.15.12:0/1812778764 wait complete. 2021-10-20T23:20:00.705 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-10-20T23:20:00.706 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:00.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1ea6c1700 1 Processor -- start 2021-10-20T23:20:00.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1ea6c1700 1 -- start start 2021-10-20T23:20:00.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1ea6c1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe1e40b6580 0x7fe1e40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1ea6c1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b43c0 0x7fe1e40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1ea6c1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1e4061d30 0x7fe1e40621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1ea6c1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e41440b0 con 0x7fe1e4061d30 2021-10-20T23:20:00.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1ea6c1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40b6e50 con 0x7fe1e40b6580 2021-10-20T23:20:00.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1ea6c1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4143b70 con 0x7fe1e40b43c0 2021-10-20T23:20:00.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1e8c5e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1e4061d30 0x7fe1e40621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1e8c5e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1e4061d30 0x7fe1e40621a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36750/0 (socket says 172.21.15.12:36750) 2021-10-20T23:20:00.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.801+0000 7fe1e8c5e700 1 -- 172.21.15.12:0/3930057761 learned_addr learned my addr 172.21.15.12:0/3930057761 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:00.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e37fe700 1 --2- 172.21.15.12:0/3930057761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b43c0 0x7fe1e40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e3fff700 1 --2- 172.21.15.12:0/3930057761 >> v2:172.21.15.31:3300/0 conn(0x7fe1e40b6580 0x7fe1e40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e8c5e700 1 -- 172.21.15.12:0/3930057761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b43c0 msgr2=0x7fe1e40b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:00.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e8c5e700 1 --2- 172.21.15.12:0/3930057761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b43c0 0x7fe1e40b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e8c5e700 1 -- 172.21.15.12:0/3930057761 >> v2:172.21.15.31:3300/0 conn(0x7fe1e40b6580 msgr2=0x7fe1e40b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:00.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e8c5e700 1 --2- 172.21.15.12:0/3930057761 >> v2:172.21.15.31:3300/0 conn(0x7fe1e40b6580 0x7fe1e40b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e8c5e700 1 -- 172.21.15.12:0/3930057761 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4143e10 con 0x7fe1e4061d30 2021-10-20T23:20:00.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e37fe700 1 --2- 172.21.15.12:0/3930057761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b43c0 0x7fe1e40b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:00.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e8c5e700 1 --2- 172.21.15.12:0/3930057761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 0x7fe1e40621a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fe1dc0032f0 tx=0x7fe1dc009290).ready entity=mon.0 client_cookie=61011616989f91c0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e2ffd700 1 -- 172.21.15.12:0/3930057761 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1dc00b870 con 0x7fe1e4061d30 2021-10-20T23:20:00.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e2ffd700 1 -- 172.21.15.12:0/3930057761 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00b9d0 con 0x7fe1e4061d30 2021-10-20T23:20:00.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1e2ffd700 1 -- 172.21.15.12:0/3930057761 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1dc00bb40 con 0x7fe1e4061d30 2021-10-20T23:20:00.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3930057761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 msgr2=0x7fe1e40621a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3930057761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 0x7fe1e40621a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fe1dc0032f0 tx=0x7fe1dc009290).stop 2021-10-20T23:20:00.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3930057761 shutdown_connections 2021-10-20T23:20:00.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3930057761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 0x7fe1e40621a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3930057761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b43c0 0x7fe1e40b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3930057761 >> v2:172.21.15.31:3300/0 conn(0x7fe1e40b6580 0x7fe1e40b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3930057761 >> 172.21.15.12:0/3930057761 conn(0x7fe1e405c490 msgr2=0x7fe1e405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:00.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3930057761 shutdown_connections 2021-10-20T23:20:00.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3930057761 wait complete. 2021-10-20T23:20:00.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 Processor -- start 2021-10-20T23:20:00.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.805+0000 7fe1ea6c1700 1 -- start start 2021-10-20T23:20:00.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1ea6c1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 0x7fe1e40ba140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1ea6c1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e40b43c0 0x7fe1e412a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1ea6c1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b6580 0x7fe1e40b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1ea6c1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40afb20 con 0x7fe1e4061d30 2021-10-20T23:20:00.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1ea6c1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40ba630 con 0x7fe1e40b43c0 2021-10-20T23:20:00.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1ea6c1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40ad7a0 con 0x7fe1e40b6580 2021-10-20T23:20:00.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 0x7fe1e40ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e40b43c0 0x7fe1e412a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 0x7fe1e40ba140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36752/0 (socket says 172.21.15.12:36752) 2021-10-20T23:20:00.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e3fff700 1 -- 172.21.15.12:0/3175440969 learned_addr learned my addr 172.21.15.12:0/3175440969 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:00.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e8c5e700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b6580 0x7fe1e40b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e8c5e700 1 -- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e40b43c0 msgr2=0x7fe1e412a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e8c5e700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e40b43c0 0x7fe1e412a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e8c5e700 1 -- 172.21.15.12:0/3175440969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 msgr2=0x7fe1e40ba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e8c5e700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 0x7fe1e40ba140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e8c5e700 1 -- 172.21.15.12:0/3175440969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc009530 con 0x7fe1e40b6580 2021-10-20T23:20:00.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e3fff700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 0x7fe1e40ba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:00.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e8c5e700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b6580 0x7fe1e40b1cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe1e412aaf0 tx=0x7fe1dc016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e17fa700 1 -- 172.21.15.12:0/3175440969 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1dc00b870 con 0x7fe1e40b6580 2021-10-20T23:20:00.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e17fa700 1 -- 172.21.15.12:0/3175440969 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc020470 con 0x7fe1e40b6580 2021-10-20T23:20:00.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1e17fa700 1 -- 172.21.15.12:0/3175440969 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1dc011ea0 con 0x7fe1e40b6580 2021-10-20T23:20:00.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40ada40 con 0x7fe1e40b6580 2021-10-20T23:20:00.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.809+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e4152f60 con 0x7fe1e40b6580 2021-10-20T23:20:00.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.813+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e41530f0 con 0x7fe1e40b6580 2021-10-20T23:20:00.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.813+0000 7fe1e17fa700 1 -- 172.21.15.12:0/3175440969 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe1dc00f070 con 0x7fe1e40b6580 2021-10-20T23:20:00.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.813+0000 7fe1e17fa700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1c8053610 0x7fe1c8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:00.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.813+0000 7fe1e17fa700 1 -- 172.21.15.12:0/3175440969 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe1dc06c570 con 0x7fe1e40b6580 2021-10-20T23:20:00.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.813+0000 7fe1e3fff700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1c8053610 0x7fe1c8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:00.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.813+0000 7fe1e3fff700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1c8053610 0x7fe1c8055ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe1d4008000 tx=0x7fe1d4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:00.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.821+0000 7fe1e17fa700 1 -- 172.21.15.12:0/3175440969 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1dc043460 con 0x7fe1e40b6580 2021-10-20T23:20:00.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.953+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1e40615f0 con 0x7fe1e40b6580 2021-10-20T23:20:00.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1e17fa700 1 -- 172.21.15.12:0/3175440969 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fe1dc015090 con 0x7fe1e40b6580 2021-10-20T23:20:00.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:00.963 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:00.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1c8053610 msgr2=0x7fe1c8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1c8053610 0x7fe1c8055ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe1d4008000 tx=0x7fe1d4008040).stop 2021-10-20T23:20:00.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b6580 msgr2=0x7fe1e40b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:00.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b6580 0x7fe1e40b1cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe1e412aaf0 tx=0x7fe1dc016000).stop 2021-10-20T23:20:00.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 shutdown_connections 2021-10-20T23:20:00.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1c8053610 0x7fe1c8055ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e40b6580 0x7fe1e40b1cc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e40b43c0 0x7fe1e412a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 --2- 172.21.15.12:0/3175440969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e4061d30 0x7fe1e40ba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:00.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 >> 172.21.15.12:0/3175440969 conn(0x7fe1e405c490 msgr2=0x7fe1e4128380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:00.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 shutdown_connections 2021-10-20T23:20:00.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:00.957+0000 7fe1ea6c1700 1 -- 172.21.15.12:0/3175440969 wait complete. 2021-10-20T23:20:00.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-10-20T23:20:01.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 Processor -- start 2021-10-20T23:20:01.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 -- start start 2021-10-20T23:20:01.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc1bc0b54a0 0x7fc1bc0af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc1bc0b0610 0x7fc1bc1475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1bc0b5880 con 0x7fc1bc0675a0 2021-10-20T23:20:01.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1bc1452e0 con 0x7fc1bc0b54a0 2021-10-20T23:20:01.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1bc0adff0 con 0x7fc1bc0b0610 2021-10-20T23:20:01.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1bad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc1bc0b54a0 0x7fc1bc0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1bad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc1bc0b54a0 0x7fc1bc0af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36760/0 (socket says 172.21.15.12:36760) 2021-10-20T23:20:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1bb59e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc1bc0675a0 0x7fc1bc0acc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35358/0 (socket says 172.21.15.12:35358) 2021-10-20T23:20:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1bad9d700 1 -- 172.21.15.12:0/2201003676 learned_addr learned my addr 172.21.15.12:0/2201003676 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1ba59c700 1 --2- 172.21.15.12:0/2201003676 >> v2:172.21.15.31:3300/0 conn(0x7fc1bc0b0610 0x7fc1bc1475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1bad9d700 1 -- 172.21.15.12:0/2201003676 >> v2:172.21.15.31:3300/0 conn(0x7fc1bc0b0610 msgr2=0x7fc1bc1475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1bad9d700 1 --2- 172.21.15.12:0/2201003676 >> v2:172.21.15.31:3300/0 conn(0x7fc1bc0b0610 0x7fc1bc1475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1bad9d700 1 -- 172.21.15.12:0/2201003676 >> v1:172.21.15.12:6789/0 conn(0x7fc1bc0675a0 legacy=0x7fc1bc0acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1bad9d700 1 -- 172.21.15.12:0/2201003676 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc0ac800 con 0x7fc1bc0b54a0 2021-10-20T23:20:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1b9d9b700 1 -- 172.21.15.12:0/2201003676 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275223648 0 0) 0x7fc1bc0b5880 con 0x7fc1bc0675a0 2021-10-20T23:20:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1bad9d700 1 --2- 172.21.15.12:0/2201003676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0b54a0 0x7fc1bc0af550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fc1ac002f70 tx=0x7fc1ac006eb0).ready entity=mon.0 client_cookie=c2aeb5feada52f40 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1b9d9b700 1 -- 172.21.15.12:0/2201003676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1ac00d5c0 con 0x7fc1bc0b54a0 2021-10-20T23:20:01.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1b9d9b700 1 -- 172.21.15.12:0/2201003676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac000e90 con 0x7fc1bc0b54a0 2021-10-20T23:20:01.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1b9d9b700 1 -- 172.21.15.12:0/2201003676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1ac00d910 con 0x7fc1bc0b54a0 2021-10-20T23:20:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 -- 172.21.15.12:0/2201003676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0b54a0 msgr2=0x7fc1bc0af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 --2- 172.21.15.12:0/2201003676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0b54a0 0x7fc1bc0af550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fc1ac002f70 tx=0x7fc1ac006eb0).stop 2021-10-20T23:20:01.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 -- 172.21.15.12:0/2201003676 shutdown_connections 2021-10-20T23:20:01.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 --2- 172.21.15.12:0/2201003676 >> v2:172.21.15.31:3300/0 conn(0x7fc1bc0b0610 0x7fc1bc1475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 --2- 172.21.15.12:0/2201003676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0b54a0 0x7fc1bc0af550 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 -- 172.21.15.12:0/2201003676 >> 172.21.15.12:0/2201003676 conn(0x7fc1bc062560 msgr2=0x7fc1bc062940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 -- 172.21.15.12:0/2201003676 shutdown_connections 2021-10-20T23:20:01.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.077+0000 7fc1c09d2700 1 -- 172.21.15.12:0/2201003676 wait complete. 2021-10-20T23:20:01.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 Processor -- start 2021-10-20T23:20:01.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 -- start start 2021-10-20T23:20:01.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0675a0 0x7fc1bc0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1bc0b0610 0x7fc1bc063910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1bc0b54a0 0x7fc1bc066430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc146d90 con 0x7fc1bc0675a0 2021-10-20T23:20:01.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc063240 con 0x7fc1bc0b54a0 2021-10-20T23:20:01.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc146fc0 con 0x7fc1bc0b0610 2021-10-20T23:20:01.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1bad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0675a0 0x7fc1bc0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1bad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0675a0 0x7fc1bc0b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36766/0 (socket says 172.21.15.12:36766) 2021-10-20T23:20:01.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1bad9d700 1 -- 172.21.15.12:0/3198927195 learned_addr learned my addr 172.21.15.12:0/3198927195 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:01.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1ba59c700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1bc0b0610 0x7fc1bc063910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1bad9d700 1 -- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1bc0b0610 msgr2=0x7fc1bc063910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1bad9d700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1bc0b0610 0x7fc1bc063910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1bad9d700 1 -- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1bc0b54a0 msgr2=0x7fc1bc066430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1bad9d700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1bc0b54a0 0x7fc1bc066430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-10-20T23:20:01.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1bad9d700 1 -- 172.21.15.12:0/3198927195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac00b1e0 con 0x7fc1bc0675a0 2021-10-20T23:20:01.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1bad9d700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0675a0 0x7fc1bc0b4120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc1ac002f70 tx=0x7fc1ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1abfff700 1 -- 172.21.15.12:0/3198927195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1ac0118a0 con 0x7fc1bc0675a0 2021-10-20T23:20:01.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1abfff700 1 -- 172.21.15.12:0/3198927195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac011a00 con 0x7fc1bc0675a0 2021-10-20T23:20:01.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc147260 con 0x7fc1bc0675a0 2021-10-20T23:20:01.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1abfff700 1 -- 172.21.15.12:0/3198927195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1ac011d60 con 0x7fc1bc0675a0 2021-10-20T23:20:01.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.081+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc066920 con 0x7fc1bc0675a0 2021-10-20T23:20:01.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1bc063e00 con 0x7fc1bc0675a0 2021-10-20T23:20:01.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1abfff700 1 -- 172.21.15.12:0/3198927195 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc1ac01a040 con 0x7fc1bc0675a0 2021-10-20T23:20:01.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1abfff700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1980536a0 0x7fc198055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1abfff700 1 -- 172.21.15.12:0/3198927195 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc1ac06cad0 con 0x7fc1bc0675a0 2021-10-20T23:20:01.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1ba59c700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1980536a0 0x7fc198055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1abfff700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7fc19805b0a0 0x7fc19805d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1abfff700 1 -- 172.21.15.12:0/3198927195 --> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc19805da80 con 0x7fc19805b0a0 2021-10-20T23:20:01.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1abfff700 1 -- 172.21.15.12:0/3198927195 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1ac071240 con 0x7fc1bc0675a0 2021-10-20T23:20:01.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1bb59e700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7fc19805b0a0 0x7fc19805d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1bb59e700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7fc19805b0a0 0x7fc19805d4c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.085+0000 7fc1ba59c700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1980536a0 0x7fc198055b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc1b000b000 tx=0x7fc1b0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.089+0000 7fc1abfff700 1 -- 172.21.15.12:0/3198927195 <== osd.0 v2:172.21.15.12:6816/14574 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fc19805da80 con 0x7fc19805b0a0 2021-10-20T23:20:01.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.101+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 --> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1bc0b14f0 con 0x7fc19805b0a0 2021-10-20T23:20:01.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.101+0000 7fc1abfff700 1 -- 172.21.15.12:0/3198927195 <== osd.0 v2:172.21.15.12:6816/14574 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc1bc0b14f0 con 0x7fc19805b0a0 2021-10-20T23:20:01.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.101+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7fc19805b0a0 msgr2=0x7fc19805d4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1c09d2700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7fc19805b0a0 0x7fc19805d4c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1980536a0 msgr2=0x7fc198055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1c09d2700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1980536a0 0x7fc198055b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc1b000b000 tx=0x7fc1b0008040).stop 2021-10-20T23:20:01.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0675a0 msgr2=0x7fc1bc0b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1c09d2700 1 --2- 172.21.15.12:0/3198927195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1bc0675a0 0x7fc1bc0b4120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc1ac002f70 tx=0x7fc1ac015000).stop 2021-10-20T23:20:01.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1bb59e700 1 -- 172.21.15.12:0/3198927195 reap_dead start 2021-10-20T23:20:01.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 shutdown_connections 2021-10-20T23:20:01.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 >> 172.21.15.12:0/3198927195 conn(0x7fc1bc062560 msgr2=0x7fc1bc144680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 shutdown_connections 2021-10-20T23:20:01.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.105+0000 7fc1c09d2700 1 -- 172.21.15.12:0/3198927195 wait complete. 2021-10-20T23:20:01.121 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2021-10-20T23:20:01.122 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-10-20T23:20:01.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f783488d700 1 Processor -- start 2021-10-20T23:20:01.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f783488d700 1 -- start start 2021-10-20T23:20:01.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f783488d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78300b96e0 0x7f78300aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f783488d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f783013fff0 0x7f7830140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f783488d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7830067500 con 0x7f7830067120 2021-10-20T23:20:01.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f783488d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7830143080 con 0x7f78300b96e0 2021-10-20T23:20:01.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f783488d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78300af4d0 con 0x7f783013fff0 2021-10-20T23:20:01.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782e59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7830067120 0x7f78301439b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35370/0 (socket says 172.21.15.12:35370) 2021-10-20T23:20:01.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782e59c700 1 -- 172.21.15.12:0/3029054875 learned_addr learned my addr 172.21.15.12:0/3029054875 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:01.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782dd9b700 1 --2- 172.21.15.12:0/3029054875 >> v2:172.21.15.12:3300/0 conn(0x7f78300b96e0 0x7f78300aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782ed9d700 1 --2- 172.21.15.12:0/3029054875 >> v2:172.21.15.31:3300/0 conn(0x7f783013fff0 0x7f7830140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782d59a700 1 -- 172.21.15.12:0/3029054875 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024700039 0 0) 0x7f7830067500 con 0x7f7830067120 2021-10-20T23:20:01.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782d59a700 1 -- 172.21.15.12:0/3029054875 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7814003260 con 0x7f7830067120 2021-10-20T23:20:01.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782dd9b700 1 -- 172.21.15.12:0/3029054875 >> v2:172.21.15.31:3300/0 conn(0x7f783013fff0 msgr2=0x7f7830140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:01.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782dd9b700 1 --2- 172.21.15.12:0/3029054875 >> v2:172.21.15.31:3300/0 conn(0x7f783013fff0 0x7f7830140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782dd9b700 1 -- 172.21.15.12:0/3029054875 >> v1:172.21.15.12:6789/0 conn(0x7f7830067120 legacy=0x7f78301439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782dd9b700 1 -- 172.21.15.12:0/3029054875 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7830143270 con 0x7f78300b96e0 2021-10-20T23:20:01.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782dd9b700 1 --2- 172.21.15.12:0/3029054875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 0x7f78300aec00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7824002f70 tx=0x7f7824006df0).ready entity=mon.0 client_cookie=9ea4b4eb24333cd9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782d59a700 1 -- 172.21.15.12:0/3029054875 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782400d4f0 con 0x7f78300b96e0 2021-10-20T23:20:01.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782d59a700 1 -- 172.21.15.12:0/3029054875 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824000e90 con 0x7f78300b96e0 2021-10-20T23:20:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.225+0000 7f782d59a700 1 -- 172.21.15.12:0/3029054875 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782400d840 con 0x7f78300b96e0 2021-10-20T23:20:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 -- 172.21.15.12:0/3029054875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 msgr2=0x7f78300aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 --2- 172.21.15.12:0/3029054875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 0x7f78300aec00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7824002f70 tx=0x7f7824006df0).stop 2021-10-20T23:20:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 -- 172.21.15.12:0/3029054875 shutdown_connections 2021-10-20T23:20:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 --2- 172.21.15.12:0/3029054875 >> v2:172.21.15.31:3300/0 conn(0x7f783013fff0 0x7f7830140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 --2- 172.21.15.12:0/3029054875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 0x7f78300aec00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 -- 172.21.15.12:0/3029054875 >> 172.21.15.12:0/3029054875 conn(0x7f783005f9f0 msgr2=0x7f78300616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 -- 172.21.15.12:0/3029054875 shutdown_connections 2021-10-20T23:20:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 -- 172.21.15.12:0/3029054875 wait complete. 2021-10-20T23:20:01.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 Processor -- start 2021-10-20T23:20:01.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 -- start start 2021-10-20T23:20:01.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7830067120 0x7f78301454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 0x7f7830142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783013fff0 0x7f7830155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7830152250 con 0x7f78300b96e0 2021-10-20T23:20:01.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78301557c0 con 0x7f783013fff0 2021-10-20T23:20:01.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f783488d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7830138710 con 0x7f7830067120 2021-10-20T23:20:01.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f782dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 0x7f7830142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f782dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 0x7f7830142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36784/0 (socket says 172.21.15.12:36784) 2021-10-20T23:20:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.229+0000 7f782dd9b700 1 -- 172.21.15.12:0/557487729 learned_addr learned my addr 172.21.15.12:0/557487729 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782ed9d700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783013fff0 0x7f7830155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782e59c700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7830067120 0x7f78301454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782dd9b700 1 -- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7830067120 msgr2=0x7f78301454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782dd9b700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7830067120 0x7f78301454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782dd9b700 1 -- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783013fff0 msgr2=0x7f7830155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782dd9b700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783013fff0 0x7f7830155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782dd9b700 1 -- 172.21.15.12:0/557487729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782400b180 con 0x7f78300b96e0 2021-10-20T23:20:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782dd9b700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 0x7f7830142800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7824002f70 tx=0x7f7824014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f781f7fe700 1 -- 172.21.15.12:0/557487729 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7824013e90 con 0x7f78300b96e0 2021-10-20T23:20:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f781f7fe700 1 -- 172.21.15.12:0/557487729 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782400de60 con 0x7f78300b96e0 2021-10-20T23:20:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f781f7fe700 1 -- 172.21.15.12:0/557487729 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782401e5f0 con 0x7f78300b96e0 2021-10-20T23:20:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78301389b0 con 0x7f78300b96e0 2021-10-20T23:20:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78300b7810 con 0x7f78300b96e0 2021-10-20T23:20:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78301523a0 con 0x7f78300b96e0 2021-10-20T23:20:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f781f7fe700 1 -- 172.21.15.12:0/557487729 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f782401c070 con 0x7f78300b96e0 2021-10-20T23:20:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f781f7fe700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f780c053610 0x7f780c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f781f7fe700 1 -- 172.21.15.12:0/557487729 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f782406c400 con 0x7f78300b96e0 2021-10-20T23:20:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f781f7fe700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7f780c05af20 0x7f780c05d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f781f7fe700 1 -- 172.21.15.12:0/557487729 --> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f780c05d900 con 0x7f780c05af20 2021-10-20T23:20:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f781f7fe700 1 -- 172.21.15.12:0/557487729 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f782406ea90 con 0x7f78300b96e0 2021-10-20T23:20:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782e59c700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f780c053610 0x7f780c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782ed9d700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7f780c05af20 0x7f780c05d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782ed9d700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7f780c05af20 0x7f780c05d340 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.233+0000 7f782e59c700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f780c053610 0x7f780c055ad0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f782000b000 tx=0x7f7820009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.237+0000 7f781f7fe700 1 -- 172.21.15.12:0/557487729 <== osd.1 v2:172.21.15.12:6824/14575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f780c05d900 con 0x7f780c05af20 2021-10-20T23:20:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 --> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7830156600 con 0x7f780c05af20 2021-10-20T23:20:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f781f7fe700 1 -- 172.21.15.12:0/557487729 <== osd.1 v2:172.21.15.12:6824/14575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7830156600 con 0x7f780c05af20 2021-10-20T23:20:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7f780c05af20 msgr2=0x7f780c05d340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7f780c05af20 0x7f780c05d340 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f780c053610 msgr2=0x7f780c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f780c053610 0x7f780c055ad0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f782000b000 tx=0x7f7820009040).stop 2021-10-20T23:20:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 msgr2=0x7f7830142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 --2- 172.21.15.12:0/557487729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78300b96e0 0x7f7830142800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7824002f70 tx=0x7f7824014000).stop 2021-10-20T23:20:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f782ed9d700 1 -- 172.21.15.12:0/557487729 reap_dead start 2021-10-20T23:20:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 shutdown_connections 2021-10-20T23:20:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 >> 172.21.15.12:0/557487729 conn(0x7f783005f9f0 msgr2=0x7f783013eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 shutdown_connections 2021-10-20T23:20:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.253+0000 7f783488d700 1 -- 172.21.15.12:0/557487729 wait complete. 2021-10-20T23:20:01.273 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:01.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-10-20T23:20:01.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd33065700 1 Processor -- start 2021-10-20T23:20:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd33065700 1 -- start start 2021-10-20T23:20:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd33065700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd2c0b4710 0x7fcd2c13fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd33065700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcd2c1439a0 0x7fcd2c140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd33065700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c0b6910 con 0x7fcd2c061680 2021-10-20T23:20:01.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd33065700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b9680 con 0x7fcd2c1439a0 2021-10-20T23:20:01.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd33065700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b6bb0 con 0x7fcd2c0b4710 2021-10-20T23:20:01.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd32864700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcd2c1439a0 0x7fcd2c140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd32864700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcd2c1439a0 0x7fcd2c140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36792/0 (socket says 172.21.15.12:36792) 2021-10-20T23:20:01.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd32864700 1 -- 172.21.15.12:0/3697363478 learned_addr learned my addr 172.21.15.12:0/3697363478 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:01.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd31862700 1 --2- 172.21.15.12:0/3697363478 >> v2:172.21.15.31:3300/0 conn(0x7fcd2c0b4710 0x7fcd2c13fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd32864700 1 -- 172.21.15.12:0/3697363478 >> v2:172.21.15.31:3300/0 conn(0x7fcd2c0b4710 msgr2=0x7fcd2c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:01.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd32864700 1 --2- 172.21.15.12:0/3697363478 >> v2:172.21.15.31:3300/0 conn(0x7fcd2c0b4710 0x7fcd2c13fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd32864700 1 -- 172.21.15.12:0/3697363478 >> v1:172.21.15.31:6789/0 conn(0x7fcd2c061680 legacy=0x7fcd2c0b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.373+0000 7fcd32864700 1 -- 172.21.15.12:0/3697363478 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c0b6e50 con 0x7fcd2c1439a0 2021-10-20T23:20:01.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 --2- 172.21.15.12:0/3697363478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c1439a0 0x7fcd2c140290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fcd240032f0 tx=0x7fcd24009290).ready entity=mon.0 client_cookie=2152bdaf78fc0710 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd31061700 1 -- 172.21.15.12:0/3697363478 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2400b870 con 0x7fcd2c1439a0 2021-10-20T23:20:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd31061700 1 -- 172.21.15.12:0/3697363478 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2400b9d0 con 0x7fcd2c1439a0 2021-10-20T23:20:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd31061700 1 -- 172.21.15.12:0/3697363478 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2400bb40 con 0x7fcd2c1439a0 2021-10-20T23:20:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 -- 172.21.15.12:0/3697363478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c1439a0 msgr2=0x7fcd2c140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 --2- 172.21.15.12:0/3697363478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c1439a0 0x7fcd2c140290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fcd240032f0 tx=0x7fcd24009290).stop 2021-10-20T23:20:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 -- 172.21.15.12:0/3697363478 shutdown_connections 2021-10-20T23:20:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 --2- 172.21.15.12:0/3697363478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c1439a0 0x7fcd2c140290 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 --2- 172.21.15.12:0/3697363478 >> v2:172.21.15.31:3300/0 conn(0x7fcd2c0b4710 0x7fcd2c13fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 -- 172.21.15.12:0/3697363478 >> 172.21.15.12:0/3697363478 conn(0x7fcd2c06adf0 msgr2=0x7fcd2c05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 -- 172.21.15.12:0/3697363478 shutdown_connections 2021-10-20T23:20:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 -- 172.21.15.12:0/3697363478 wait complete. 2021-10-20T23:20:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 Processor -- start 2021-10-20T23:20:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 -- start start 2021-10-20T23:20:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c061680 0x7fcd2c0b8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd2c1439a0 0x7fcd2c0b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c146750 0x7fcd2c13f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0ad830 con 0x7fcd2c146750 2021-10-20T23:20:01.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c1534b0 con 0x7fcd2c061680 2021-10-20T23:20:01.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd33065700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c147150 con 0x7fcd2c1439a0 2021-10-20T23:20:01.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c146750 0x7fcd2c13f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c146750 0x7fcd2c13f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36798/0 (socket says 172.21.15.12:36798) 2021-10-20T23:20:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 -- 172.21.15.12:0/4292980405 learned_addr learned my addr 172.21.15.12:0/4292980405 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd31862700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd2c1439a0 0x7fcd2c0b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32063700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c061680 0x7fcd2c0b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 -- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd2c1439a0 msgr2=0x7fcd2c0b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd2c1439a0 0x7fcd2c0b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 -- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c061680 msgr2=0x7fcd2c0b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c061680 0x7fcd2c0b8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 -- 172.21.15.12:0/4292980405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd24009530 con 0x7fcd2c146750 2021-10-20T23:20:01.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32063700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c061680 0x7fcd2c0b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:01.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd32864700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c146750 0x7fcd2c13f010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcd2c0af5d0 tx=0x7fcd24016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.377+0000 7fcd1b7fe700 1 -- 172.21.15.12:0/4292980405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2400b870 con 0x7fcd2c146750 2021-10-20T23:20:01.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd1b7fe700 1 -- 172.21.15.12:0/4292980405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24021440 con 0x7fcd2c146750 2021-10-20T23:20:01.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c156570 con 0x7fcd2c146750 2021-10-20T23:20:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd1b7fe700 1 -- 172.21.15.12:0/4292980405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd240217a0 con 0x7fcd2c146750 2021-10-20T23:20:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c0b8d40 con 0x7fcd2c146750 2021-10-20T23:20:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd2c1464b0 con 0x7fcd2c146750 2021-10-20T23:20:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd1b7fe700 1 -- 172.21.15.12:0/4292980405 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcd2400f070 con 0x7fcd2c146750 2021-10-20T23:20:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd1b7fe700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd0c0536a0 0x7fcd0c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd1b7fe700 1 -- 172.21.15.12:0/4292980405 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcd2406d280 con 0x7fcd2c146750 2021-10-20T23:20:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd1b7fe700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7fcd0c05b120 0x7fcd0c05d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd1b7fe700 1 -- 172.21.15.12:0/4292980405 --> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd0c05db00 con 0x7fcd0c05b120 2021-10-20T23:20:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd1b7fe700 1 -- 172.21.15.12:0/4292980405 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd2406f910 con 0x7fcd2c146750 2021-10-20T23:20:01.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd32063700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd0c0536a0 0x7fcd0c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd31862700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7fcd0c05b120 0x7fcd0c05d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.381+0000 7fcd31862700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7fcd0c05b120 0x7fcd0c05d540 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.385+0000 7fcd32063700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd0c0536a0 0x7fcd0c055b60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fcd28008000 tx=0x7fcd28009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.385+0000 7fcd1b7fe700 1 -- 172.21.15.12:0/4292980405 <== osd.2 v2:172.21.15.12:6808/14573 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fcd0c05db00 con 0x7fcd0c05b120 2021-10-20T23:20:01.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 --> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd2c156700 con 0x7fcd0c05b120 2021-10-20T23:20:01.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd1b7fe700 1 -- 172.21.15.12:0/4292980405 <== osd.2 v2:172.21.15.12:6808/14573 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd2c156700 con 0x7fcd0c05b120 2021-10-20T23:20:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7fcd0c05b120 msgr2=0x7fcd0c05d540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7fcd0c05b120 0x7fcd0c05d540 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd0c0536a0 msgr2=0x7fcd0c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd0c0536a0 0x7fcd0c055b60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fcd28008000 tx=0x7fcd28009040).stop 2021-10-20T23:20:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c146750 msgr2=0x7fcd2c13f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 --2- 172.21.15.12:0/4292980405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd2c146750 0x7fcd2c13f010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcd2c0af5d0 tx=0x7fcd24016000).stop 2021-10-20T23:20:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd32864700 1 -- 172.21.15.12:0/4292980405 reap_dead start 2021-10-20T23:20:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 shutdown_connections 2021-10-20T23:20:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 >> 172.21.15.12:0/4292980405 conn(0x7fcd2c06adf0 msgr2=0x7fcd2c142360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 shutdown_connections 2021-10-20T23:20:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.401+0000 7fcd33065700 1 -- 172.21.15.12:0/4292980405 wait complete. 2021-10-20T23:20:01.425 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:01.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-10-20T23:20:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1072df9700 1 Processor -- start 2021-10-20T23:20:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1072df9700 1 -- start start 2021-10-20T23:20:01.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1072df9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f106c0638d0 0x7f106c143d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1072df9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f106c061920 0x7f106c140980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1072df9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c063cb0 con 0x7f106c0b12d0 2021-10-20T23:20:01.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1072df9700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c13fdb0 con 0x7f106c0638d0 2021-10-20T23:20:01.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1072df9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c061ff0 con 0x7f106c061920 2021-10-20T23:20:01.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1071df7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f106c0638d0 0x7f106c143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1071df7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f106c0638d0 0x7f106c143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36808/0 (socket says 172.21.15.12:36808) 2021-10-20T23:20:01.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1071df7700 1 -- 172.21.15.12:0/488836412 learned_addr learned my addr 172.21.15.12:0/488836412 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:01.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f10715f6700 1 --2- 172.21.15.12:0/488836412 >> v2:172.21.15.31:3300/0 conn(0x7f106c061920 0x7f106c140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1071df7700 1 -- 172.21.15.12:0/488836412 >> v2:172.21.15.31:3300/0 conn(0x7f106c061920 msgr2=0x7f106c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:01.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1071df7700 1 --2- 172.21.15.12:0/488836412 >> v2:172.21.15.31:3300/0 conn(0x7f106c061920 0x7f106c140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1071df7700 1 -- 172.21.15.12:0/488836412 >> v1:172.21.15.31:6789/0 conn(0x7f106c0b12d0 legacy=0x7f106c128c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1071df7700 1 -- 172.21.15.12:0/488836412 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c13ffa0 con 0x7f106c0638d0 2021-10-20T23:20:01.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1070df5700 1 -- 172.21.15.12:0/488836412 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477421984 0 0) 0x7f106c063cb0 con 0x7f106c0b12d0 2021-10-20T23:20:01.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1071df7700 1 --2- 172.21.15.12:0/488836412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 0x7f106c143d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f105c002f70 tx=0x7f105c006f40).ready entity=mon.0 client_cookie=260247c0a760e96e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1070df5700 1 -- 172.21.15.12:0/488836412 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f105c00da80 con 0x7f106c0638d0 2021-10-20T23:20:01.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1070df5700 1 -- 172.21.15.12:0/488836412 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c000e90 con 0x7f106c0638d0 2021-10-20T23:20:01.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.533+0000 7f1070df5700 1 -- 172.21.15.12:0/488836412 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f105c00ddd0 con 0x7f106c0638d0 2021-10-20T23:20:01.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 -- 172.21.15.12:0/488836412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 msgr2=0x7f106c143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 --2- 172.21.15.12:0/488836412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 0x7f106c143d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f105c002f70 tx=0x7f105c006f40).stop 2021-10-20T23:20:01.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 -- 172.21.15.12:0/488836412 shutdown_connections 2021-10-20T23:20:01.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 --2- 172.21.15.12:0/488836412 >> v2:172.21.15.31:3300/0 conn(0x7f106c061920 0x7f106c140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 --2- 172.21.15.12:0/488836412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 0x7f106c143d50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 -- 172.21.15.12:0/488836412 >> 172.21.15.12:0/488836412 conn(0x7f106c05c490 msgr2=0x7f106c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 -- 172.21.15.12:0/488836412 shutdown_connections 2021-10-20T23:20:01.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 -- 172.21.15.12:0/488836412 wait complete. 2021-10-20T23:20:01.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 Processor -- start 2021-10-20T23:20:01.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 -- start start 2021-10-20T23:20:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c061920 0x7f106c129ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 0x7f106c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c0b12d0 0x7f106c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0b3080 con 0x7f106c0638d0 2021-10-20T23:20:01.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c14e440 con 0x7f106c061920 2021-10-20T23:20:01.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1072df9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0b53c0 con 0x7f106c0b12d0 2021-10-20T23:20:01.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f10715f6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 0x7f106c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f10715f6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 0x7f106c151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36814/0 (socket says 172.21.15.12:36814) 2021-10-20T23:20:01.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f10715f6700 1 -- 172.21.15.12:0/2172071268 learned_addr learned my addr 172.21.15.12:0/2172071268 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f1071df7700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c061920 0x7f106c129ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f10725f8700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c0b12d0 0x7f106c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f10715f6700 1 -- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c0b12d0 msgr2=0x7f106c152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f10715f6700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c0b12d0 0x7f106c152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f10715f6700 1 -- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c061920 msgr2=0x7f106c129ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.537+0000 7f10715f6700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c061920 0x7f106c129ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f10715f6700 1 -- 172.21.15.12:0/2172071268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c00b460 con 0x7f106c0638d0 2021-10-20T23:20:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f10725f8700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c0b12d0 0x7f106c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f10715f6700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 0x7f106c151d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f106800c000 tx=0x7f1068006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1062ffd700 1 -- 172.21.15.12:0/2172071268 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1068010780 con 0x7f106c0638d0 2021-10-20T23:20:01.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1062ffd700 1 -- 172.21.15.12:0/2172071268 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10680108e0 con 0x7f106c0638d0 2021-10-20T23:20:01.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c0b5620 con 0x7f106c0638d0 2021-10-20T23:20:01.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1062ffd700 1 -- 172.21.15.12:0/2172071268 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1068010c40 con 0x7f106c0638d0 2021-10-20T23:20:01.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c129fa0 con 0x7f106c0638d0 2021-10-20T23:20:01.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f106c152910 con 0x7f106c0638d0 2021-10-20T23:20:01.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1062ffd700 1 -- 172.21.15.12:0/2172071268 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1068026430 con 0x7f106c0638d0 2021-10-20T23:20:01.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1062ffd700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1054053580 0x7f1054055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1062ffd700 1 -- 172.21.15.12:0/2172071268 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f106806ca80 con 0x7f106c0638d0 2021-10-20T23:20:01.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1062ffd700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f105405b000 0x7f105405d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1062ffd700 1 -- 172.21.15.12:0/2172071268 --> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f105405da80 con 0x7f105405b000 2021-10-20T23:20:01.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1062ffd700 1 -- 172.21.15.12:0/2172071268 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f106806ce40 con 0x7f106c0638d0 2021-10-20T23:20:01.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.541+0000 7f1071df7700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1054053580 0x7f1054055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.545+0000 7f10725f8700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f105405b000 0x7f105405d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.545+0000 7f1071df7700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1054053580 0x7f1054055a40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f105c01e000 tx=0x7f106c1404e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.545+0000 7f10725f8700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f105405b000 0x7f105405d420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.545+0000 7f1062ffd700 1 -- 172.21.15.12:0/2172071268 <== osd.3 v2:172.21.15.12:6800/14572 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f105405da80 con 0x7f105405b000 2021-10-20T23:20:01.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 --> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f106c057350 con 0x7f105405b000 2021-10-20T23:20:01.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1062ffd700 1 -- 172.21.15.12:0/2172071268 <== osd.3 v2:172.21.15.12:6800/14572 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f106c057350 con 0x7f105405b000 2021-10-20T23:20:01.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f105405b000 msgr2=0x7f105405d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1072df9700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f105405b000 0x7f105405d420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1054053580 msgr2=0x7f1054055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1072df9700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1054053580 0x7f1054055a40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f105c01e000 tx=0x7f106c1404e0).stop 2021-10-20T23:20:01.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 msgr2=0x7f106c151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1072df9700 1 --2- 172.21.15.12:0/2172071268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f106c0638d0 0x7f106c151d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f106800c000 tx=0x7f1068006df0).stop 2021-10-20T23:20:01.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f10725f8700 1 -- 172.21.15.12:0/2172071268 reap_dead start 2021-10-20T23:20:01.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 shutdown_connections 2021-10-20T23:20:01.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.561+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 >> 172.21.15.12:0/2172071268 conn(0x7f106c05c490 msgr2=0x7f106c13edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.565+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 shutdown_connections 2021-10-20T23:20:01.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.565+0000 7f1072df9700 1 -- 172.21.15.12:0/2172071268 wait complete. 2021-10-20T23:20:01.581 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:01.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-10-20T23:20:01.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 Processor -- start 2021-10-20T23:20:01.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 -- start start 2021-10-20T23:20:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 0x7f5e8c0b9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c061bf0 con 0x7f5e8c147590 2021-10-20T23:20:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c0b2030 con 0x7f5e8c0b4130 2021-10-20T23:20:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b22d0 con 0x7f5e8c0b9620 2021-10-20T23:20:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e910a8700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5e8c147590 0x7f5e8c147970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35416/0 (socket says 172.21.15.12:35416) 2021-10-20T23:20:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e910a8700 1 -- 172.21.15.12:0/3432305359 learned_addr learned my addr 172.21.15.12:0/3432305359 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e918a9700 1 --2- 172.21.15.12:0/3432305359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 0x7f5e8c0b9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e83fff700 1 -- 172.21.15.12:0/3432305359 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082085101 0 0) 0x7f5e8c061bf0 con 0x7f5e8c147590 2021-10-20T23:20:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e83fff700 1 -- 172.21.15.12:0/3432305359 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e70003260 con 0x7f5e8c147590 2021-10-20T23:20:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e83fff700 1 -- 172.21.15.12:0/3432305359 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945470881 0 0) 0x7f5e8c0b2030 con 0x7f5e8c0b4130 2021-10-20T23:20:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e918a9700 1 -- 172.21.15.12:0/3432305359 >> v1:172.21.15.31:6789/0 conn(0x7f5e8c0b4130 legacy=0x7f5e8c0614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e918a9700 1 -- 172.21.15.12:0/3432305359 >> v1:172.21.15.12:6789/0 conn(0x7f5e8c147590 legacy=0x7f5e8c147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e918a9700 1 -- 172.21.15.12:0/3432305359 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0b2570 con 0x7f5e8c0b9620 2021-10-20T23:20:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e918a9700 1 --2- 172.21.15.12:0/3432305359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 0x7f5e8c0b9a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5e840032f0 tx=0x7f5e840091d0).ready entity=mon.2 client_cookie=3e15cb711968a64b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e83fff700 1 -- 172.21.15.12:0/3432305359 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8400b6c0 con 0x7f5e8c0b9620 2021-10-20T23:20:01.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e83fff700 1 -- 172.21.15.12:0/3432305359 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400b820 con 0x7f5e8c0b9620 2021-10-20T23:20:01.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e83fff700 1 -- 172.21.15.12:0/3432305359 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8400b990 con 0x7f5e8c0b9620 2021-10-20T23:20:01.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 -- 172.21.15.12:0/3432305359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 msgr2=0x7f5e8c0b9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 --2- 172.21.15.12:0/3432305359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 0x7f5e8c0b9a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5e840032f0 tx=0x7f5e840091d0).stop 2021-10-20T23:20:01.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 -- 172.21.15.12:0/3432305359 shutdown_connections 2021-10-20T23:20:01.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 --2- 172.21.15.12:0/3432305359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 0x7f5e8c0b9a90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 -- 172.21.15.12:0/3432305359 >> 172.21.15.12:0/3432305359 conn(0x7f5e8c06adf0 msgr2=0x7f5e8c05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.689+0000 7f5e920aa700 1 -- 172.21.15.12:0/3432305359 shutdown_connections 2021-10-20T23:20:01.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 -- 172.21.15.12:0/3432305359 wait complete. 2021-10-20T23:20:01.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 Processor -- start 2021-10-20T23:20:01.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 -- start start 2021-10-20T23:20:01.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e8c0b4130 0x7f5e8c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 0x7f5e8c0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e8c147590 0x7f5e8c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0aee50 con 0x7f5e8c147590 2021-10-20T23:20:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0af0f0 con 0x7f5e8c0b4130 2021-10-20T23:20:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c148640 con 0x7f5e8c0b9620 2021-10-20T23:20:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e918a9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e8c147590 0x7f5e8c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e918a9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e8c147590 0x7f5e8c14a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36832/0 (socket says 172.21.15.12:36832) 2021-10-20T23:20:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e918a9700 1 -- 172.21.15.12:0/842067475 learned_addr learned my addr 172.21.15.12:0/842067475 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e910a8700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e8c0b4130 0x7f5e8c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e908a7700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 0x7f5e8c0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e918a9700 1 -- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 msgr2=0x7f5e8c0b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e918a9700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e8c0b9620 0x7f5e8c0b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e918a9700 1 -- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e8c0b4130 msgr2=0x7f5e8c148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e918a9700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e8c0b4130 0x7f5e8c148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e918a9700 1 -- 172.21.15.12:0/842067475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84009470 con 0x7f5e8c147590 2021-10-20T23:20:01.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e918a9700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e8c147590 0x7f5e8c14a470 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5e840032f0 tx=0x7f5e84016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e827fc700 1 -- 172.21.15.12:0/842067475 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8400b990 con 0x7f5e8c147590 2021-10-20T23:20:01.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c0afb90 con 0x7f5e8c147590 2021-10-20T23:20:01.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e827fc700 1 -- 172.21.15.12:0/842067475 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e84021630 con 0x7f5e8c147590 2021-10-20T23:20:01.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e827fc700 1 -- 172.21.15.12:0/842067475 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8400b6c0 con 0x7f5e8c147590 2021-10-20T23:20:01.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.693+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c14b690 con 0x7f5e8c147590 2021-10-20T23:20:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e8c0af750 con 0x7f5e8c147590 2021-10-20T23:20:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e827fc700 1 -- 172.21.15.12:0/842067475 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5e84027020 con 0x7f5e8c147590 2021-10-20T23:20:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e827fc700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e74053610 0x7f5e74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e827fc700 1 -- 172.21.15.12:0/842067475 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5e8406cee0 con 0x7f5e8c147590 2021-10-20T23:20:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e827fc700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f5e7405af90 0x7f5e7405d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e827fc700 1 -- 172.21.15.12:0/842067475 --> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e7405d970 con 0x7f5e7405af90 2021-10-20T23:20:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e827fc700 1 -- 172.21.15.12:0/842067475 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e84043e40 con 0x7f5e8c147590 2021-10-20T23:20:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e910a8700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e74053610 0x7f5e74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e908a7700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f5e7405af90 0x7f5e7405d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e910a8700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e74053610 0x7f5e74055ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5e8800d000 tx=0x7f5e88009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.697+0000 7f5e908a7700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f5e7405af90 0x7f5e7405d3b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.701+0000 7f5e827fc700 1 -- 172.21.15.12:0/842067475 <== osd.4 v2:172.21.15.31:6810/14820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f5e7405d970 con 0x7f5e7405af90 2021-10-20T23:20:01.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.717+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 --> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e8c148160 con 0x7f5e7405af90 2021-10-20T23:20:01.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.717+0000 7f5e827fc700 1 -- 172.21.15.12:0/842067475 <== osd.4 v2:172.21.15.31:6810/14820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e8c148160 con 0x7f5e7405af90 2021-10-20T23:20:01.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f5e7405af90 msgr2=0x7f5e7405d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f5e7405af90 0x7f5e7405d3b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e74053610 msgr2=0x7f5e74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e74053610 0x7f5e74055ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5e8800d000 tx=0x7f5e88009040).stop 2021-10-20T23:20:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e8c147590 msgr2=0x7f5e8c14a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 --2- 172.21.15.12:0/842067475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e8c147590 0x7f5e8c14a470 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5e840032f0 tx=0x7f5e84016000).stop 2021-10-20T23:20:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e918a9700 1 -- 172.21.15.12:0/842067475 reap_dead start 2021-10-20T23:20:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 shutdown_connections 2021-10-20T23:20:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 >> 172.21.15.12:0/842067475 conn(0x7f5e8c06adf0 msgr2=0x7f5e8c147970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 shutdown_connections 2021-10-20T23:20:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.721+0000 7f5e920aa700 1 -- 172.21.15.12:0/842067475 wait complete. 2021-10-20T23:20:01.745 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:01.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-10-20T23:20:01.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabb520b700 1 Processor -- start 2021-10-20T23:20:01.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabb520b700 1 -- start start 2021-10-20T23:20:01.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabb520b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabb00a76b0 0x7fabb0066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabb520b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fabb00b1970 0x7fabb0066f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabb520b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb0067450 con 0x7fabb00b0060 2021-10-20T23:20:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabb520b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb00a7a90 con 0x7fabb00a76b0 2021-10-20T23:20:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabb520b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb0147620 con 0x7fabb00b1970 2021-10-20T23:20:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabaed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabb00a76b0 0x7fabb0066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabaf59e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fabb00b0060 0x7fabb005f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35436/0 (socket says 172.21.15.12:35436) 2021-10-20T23:20:01.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabaf59e700 1 -- 172.21.15.12:0/806332247 learned_addr learned my addr 172.21.15.12:0/806332247 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:01.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.845+0000 7fabae59c700 1 --2- 172.21.15.12:0/806332247 >> v2:172.21.15.31:3300/0 conn(0x7fabb00b1970 0x7fabb0066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabadd9b700 1 -- 172.21.15.12:0/806332247 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516253406 0 0) 0x7fabb0067450 con 0x7fabb00b0060 2021-10-20T23:20:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabadd9b700 1 -- 172.21.15.12:0/806332247 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab94003260 con 0x7fabb00b0060 2021-10-20T23:20:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabaed9d700 1 -- 172.21.15.12:0/806332247 >> v2:172.21.15.31:3300/0 conn(0x7fabb00b1970 msgr2=0x7fabb0066f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabaed9d700 1 --2- 172.21.15.12:0/806332247 >> v2:172.21.15.31:3300/0 conn(0x7fabb00b1970 0x7fabb0066f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabaed9d700 1 -- 172.21.15.12:0/806332247 >> v1:172.21.15.12:6789/0 conn(0x7fabb00b0060 legacy=0x7fabb005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabadd9b700 1 -- 172.21.15.12:0/806332247 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2162918310 0 0) 0x7fab94003260 con 0x7fabb00b0060 2021-10-20T23:20:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabaed9d700 1 -- 172.21.15.12:0/806332247 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb01478c0 con 0x7fabb00a76b0 2021-10-20T23:20:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabaed9d700 1 --2- 172.21.15.12:0/806332247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00a76b0 0x7fabb0066a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7faba8001b80 tx=0x7faba4006df0).ready entity=mon.0 client_cookie=8ac6ca555702971c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabadd9b700 1 -- 172.21.15.12:0/806332247 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba80019e0 con 0x7fabb00a76b0 2021-10-20T23:20:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabadd9b700 1 -- 172.21.15.12:0/806332247 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba4000e90 con 0x7fabb00a76b0 2021-10-20T23:20:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabadd9b700 1 -- 172.21.15.12:0/806332247 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba4012460 con 0x7fabb00a76b0 2021-10-20T23:20:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabb520b700 1 -- 172.21.15.12:0/806332247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00a76b0 msgr2=0x7fabb0066a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabb520b700 1 --2- 172.21.15.12:0/806332247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00a76b0 0x7fabb0066a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7faba8001b80 tx=0x7faba4006df0).stop 2021-10-20T23:20:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabb520b700 1 -- 172.21.15.12:0/806332247 shutdown_connections 2021-10-20T23:20:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabb520b700 1 --2- 172.21.15.12:0/806332247 >> v2:172.21.15.31:3300/0 conn(0x7fabb00b1970 0x7fabb0066f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabb520b700 1 --2- 172.21.15.12:0/806332247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00a76b0 0x7fabb0066a70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabb520b700 1 -- 172.21.15.12:0/806332247 >> 172.21.15.12:0/806332247 conn(0x7fabb00b53e0 msgr2=0x7fabb00b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabb520b700 1 -- 172.21.15.12:0/806332247 shutdown_connections 2021-10-20T23:20:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabb520b700 1 -- 172.21.15.12:0/806332247 wait complete. 2021-10-20T23:20:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.849+0000 7fabb520b700 1 Processor -- start 2021-10-20T23:20:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabb520b700 1 -- start start 2021-10-20T23:20:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabb520b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabb00a76b0 0x7fabb00ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabb520b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00b0060 0x7fabb00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabb520b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabb00b1970 0x7fabb00af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabb520b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00abe90 con 0x7fabb00b0060 2021-10-20T23:20:01.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabb520b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00ae2e0 con 0x7fabb00b1970 2021-10-20T23:20:01.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabb520b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00af5c0 con 0x7fabb00a76b0 2021-10-20T23:20:01.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00b0060 0x7fabb00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00b0060 0x7fabb00b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36846/0 (socket says 172.21.15.12:36846) 2021-10-20T23:20:01.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabae59c700 1 -- 172.21.15.12:0/3821381597 learned_addr learned my addr 172.21.15.12:0/3821381597 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:01.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabaed9d700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabb00a76b0 0x7fabb00ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabaf59e700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabb00b1970 0x7fabb00af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabae59c700 1 -- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabb00a76b0 msgr2=0x7fabb00ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabae59c700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabb00a76b0 0x7fabb00ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabae59c700 1 -- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabb00b1970 msgr2=0x7fabb00af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabae59c700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabb00b1970 0x7fabb00af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabae59c700 1 -- 172.21.15.12:0/3821381597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba400b180 con 0x7fabb00b0060 2021-10-20T23:20:01.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabae59c700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00b0060 0x7fabb00b42b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7faba000c000 tx=0x7faba0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fab9ffff700 1 -- 172.21.15.12:0/3821381597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba0010780 con 0x7fabb00b0060 2021-10-20T23:20:01.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fab9ffff700 1 -- 172.21.15.12:0/3821381597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba00108e0 con 0x7fabb00b0060 2021-10-20T23:20:01.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb00ad760 con 0x7fabb00b0060 2021-10-20T23:20:01.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fab9ffff700 1 -- 172.21.15.12:0/3821381597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba0010c40 con 0x7fabb00b0060 2021-10-20T23:20:01.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.853+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb00adca0 con 0x7fabb00b0060 2021-10-20T23:20:01.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fabb00aee70 con 0x7fabb00b0060 2021-10-20T23:20:01.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fab9ffff700 1 -- 172.21.15.12:0/3821381597 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faba001c460 con 0x7fabb00b0060 2021-10-20T23:20:01.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fab9ffff700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab8c053640 0x7fab8c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fab9ffff700 1 -- 172.21.15.12:0/3821381597 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7faba006bf60 con 0x7fabb00b0060 2021-10-20T23:20:01.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fab9ffff700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7fab8c05b040 0x7fab8c05d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:01.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fab9ffff700 1 -- 172.21.15.12:0/3821381597 --> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab8c05da20 con 0x7fab8c05b040 2021-10-20T23:20:01.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fab9ffff700 1 -- 172.21.15.12:0/3821381597 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faba006e570 con 0x7fabb00b0060 2021-10-20T23:20:01.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fabaed9d700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab8c053640 0x7fab8c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fabaf59e700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7fab8c05b040 0x7fab8c05d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:01.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fabaf59e700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7fab8c05b040 0x7fab8c05d460 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.857+0000 7fabaed9d700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab8c053640 0x7fab8c055b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7faba401a000 tx=0x7faba4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:01.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.861+0000 7fab9ffff700 1 -- 172.21.15.12:0/3821381597 <== osd.5 v2:172.21.15.31:6802/14819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fab8c05da20 con 0x7fab8c05b040 2021-10-20T23:20:01.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 --> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fabb014ae20 con 0x7fab8c05b040 2021-10-20T23:20:01.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fab9ffff700 1 -- 172.21.15.12:0/3821381597 <== osd.5 v2:172.21.15.31:6802/14819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fabb014ae20 con 0x7fab8c05b040 2021-10-20T23:20:01.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7fab8c05b040 msgr2=0x7fab8c05d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7fab8c05b040 0x7fab8c05d460 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:01.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab8c053640 msgr2=0x7fab8c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab8c053640 0x7fab8c055b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7faba401a000 tx=0x7faba4014000).stop 2021-10-20T23:20:01.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00b0060 msgr2=0x7fabb00b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:01.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 --2- 172.21.15.12:0/3821381597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb00b0060 0x7fabb00b42b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7faba000c000 tx=0x7faba0006df0).stop 2021-10-20T23:20:01.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabaf59e700 1 -- 172.21.15.12:0/3821381597 reap_dead start 2021-10-20T23:20:01.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 shutdown_connections 2021-10-20T23:20:01.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 >> 172.21.15.12:0/3821381597 conn(0x7fabb00b53e0 msgr2=0x7fabb0149c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:01.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 shutdown_connections 2021-10-20T23:20:01.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:01.881+0000 7fabb520b700 1 -- 172.21.15.12:0/3821381597 wait complete. 2021-10-20T23:20:01.905 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:01.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-10-20T23:20:02.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e099e4700 1 Processor -- start 2021-10-20T23:20:02.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e099e4700 1 -- start start 2021-10-20T23:20:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e099e4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e04067120 0x7f4e040b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e099e4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e041439b0 0x7f4e040aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e099e4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e0413fff0 0x7f4e04140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e099e4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e04143080 con 0x7f4e04067120 2021-10-20T23:20:02.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e099e4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e040b9bd0 con 0x7f4e0413fff0 2021-10-20T23:20:02.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e099e4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e04067500 con 0x7f4e041439b0 2021-10-20T23:20:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e02ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e04067120 0x7f4e040b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e02ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e04067120 0x7f4e040b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36854/0 (socket says 172.21.15.12:36854) 2021-10-20T23:20:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e02ffd700 1 -- 172.21.15.12:0/1728927150 learned_addr learned my addr 172.21.15.12:0/1728927150 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e027fc700 1 --2- 172.21.15.12:0/1728927150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e041439b0 0x7f4e040aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e037fe700 1 --2- 172.21.15.12:0/1728927150 >> v2:172.21.15.31:3300/0 conn(0x7f4e0413fff0 0x7f4e04140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e02ffd700 1 -- 172.21.15.12:0/1728927150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e041439b0 msgr2=0x7f4e040aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:02.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e02ffd700 1 --2- 172.21.15.12:0/1728927150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e041439b0 0x7f4e040aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e02ffd700 1 -- 172.21.15.12:0/1728927150 >> v2:172.21.15.31:3300/0 conn(0x7f4e0413fff0 msgr2=0x7f4e04140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:02.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e02ffd700 1 --2- 172.21.15.12:0/1728927150 >> v2:172.21.15.31:3300/0 conn(0x7f4e0413fff0 0x7f4e04140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e02ffd700 1 -- 172.21.15.12:0/1728927150 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040af4d0 con 0x7f4e04067120 2021-10-20T23:20:02.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e037fe700 1 --2- 172.21.15.12:0/1728927150 >> v2:172.21.15.31:3300/0 conn(0x7f4e0413fff0 0x7f4e04140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:02.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e02ffd700 1 --2- 172.21.15.12:0/1728927150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e04067120 0x7f4e040b96e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4df40032f0 tx=0x7f4df4009290).ready entity=mon.0 client_cookie=4b44b9c26ced8d87 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e01ffb700 1 -- 172.21.15.12:0/1728927150 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df400b870 con 0x7f4e04067120 2021-10-20T23:20:02.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e01ffb700 1 -- 172.21.15.12:0/1728927150 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df400b9d0 con 0x7f4e04067120 2021-10-20T23:20:02.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.005+0000 7f4e01ffb700 1 -- 172.21.15.12:0/1728927150 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df400bb40 con 0x7f4e04067120 2021-10-20T23:20:02.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 -- 172.21.15.12:0/1728927150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e04067120 msgr2=0x7f4e040b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 --2- 172.21.15.12:0/1728927150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e04067120 0x7f4e040b96e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4df40032f0 tx=0x7f4df4009290).stop 2021-10-20T23:20:02.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 -- 172.21.15.12:0/1728927150 shutdown_connections 2021-10-20T23:20:02.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 --2- 172.21.15.12:0/1728927150 >> v2:172.21.15.31:3300/0 conn(0x7f4e0413fff0 0x7f4e04140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 --2- 172.21.15.12:0/1728927150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e041439b0 0x7f4e040aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 --2- 172.21.15.12:0/1728927150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e04067120 0x7f4e040b96e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 -- 172.21.15.12:0/1728927150 >> 172.21.15.12:0/1728927150 conn(0x7f4e0405f9f0 msgr2=0x7f4e040616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:02.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 -- 172.21.15.12:0/1728927150 shutdown_connections 2021-10-20T23:20:02.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 -- 172.21.15.12:0/1728927150 wait complete. 2021-10-20T23:20:02.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 Processor -- start 2021-10-20T23:20:02.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 -- start start 2021-10-20T23:20:02.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e04067120 0x7f4e040b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0413fff0 0x7f4e041558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e041439b0 0x7f4e04141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e04152d70 con 0x7f4e0413fff0 2021-10-20T23:20:02.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e04152fe0 con 0x7f4e041439b0 2021-10-20T23:20:02.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.009+0000 7f4e099e4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e040b8ca0 con 0x7f4e04067120 2021-10-20T23:20:02.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0413fff0 0x7f4e041558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0413fff0 0x7f4e041558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36862/0 (socket says 172.21.15.12:36862) 2021-10-20T23:20:02.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e02ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e04067120 0x7f4e040b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e027fc700 1 -- 172.21.15.12:0/1441900670 learned_addr learned my addr 172.21.15.12:0/1441900670 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e037fe700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e041439b0 0x7f4e04141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e027fc700 1 -- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e04067120 msgr2=0x7f4e040b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e027fc700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e04067120 0x7f4e040b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e027fc700 1 -- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e041439b0 msgr2=0x7f4e04141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e027fc700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e041439b0 0x7f4e04141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e027fc700 1 -- 172.21.15.12:0/1441900670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4009530 con 0x7f4e0413fff0 2021-10-20T23:20:02.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e027fc700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0413fff0 0x7f4e041558e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4dec00c000 tx=0x7f4dec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4dfbfff700 1 -- 172.21.15.12:0/1441900670 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dec011750 con 0x7f4e0413fff0 2021-10-20T23:20:02.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4dfbfff700 1 -- 172.21.15.12:0/1441900670 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec0118b0 con 0x7f4e0413fff0 2021-10-20T23:20:02.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4dfbfff700 1 -- 172.21.15.12:0/1441900670 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dec011c10 con 0x7f4e0413fff0 2021-10-20T23:20:02.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e040b8f40 con 0x7f4e0413fff0 2021-10-20T23:20:02.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e041129c0 con 0x7f4e0413fff0 2021-10-20T23:20:02.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e041531e0 con 0x7f4e0413fff0 2021-10-20T23:20:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.013+0000 7f4dfbfff700 1 -- 172.21.15.12:0/1441900670 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4dec011d70 con 0x7f4e0413fff0 2021-10-20T23:20:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4dfbfff700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4de80536d0 0x7f4de8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4dfbfff700 1 -- 172.21.15.12:0/1441900670 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4dec06be60 con 0x7f4e0413fff0 2021-10-20T23:20:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4dfbfff700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f4de805b150 0x7f4de805d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4dfbfff700 1 -- 172.21.15.12:0/1441900670 --> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4de805db30 con 0x7f4de805b150 2021-10-20T23:20:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4dfbfff700 1 -- 172.21.15.12:0/1441900670 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dec06e4f0 con 0x7f4e0413fff0 2021-10-20T23:20:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4e02ffd700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4de80536d0 0x7f4de8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4e037fe700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f4de805b150 0x7f4de805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4e037fe700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f4de805b150 0x7f4de805d570 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4e02ffd700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4de80536d0 0x7f4de8055b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4df401a000 tx=0x7f4df4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.017+0000 7f4dfbfff700 1 -- 172.21.15.12:0/1441900670 <== osd.6 v2:172.21.15.31:6826/14822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f4de805db30 con 0x7f4de805b150 2021-10-20T23:20:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.037+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 --> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e040b3f30 con 0x7f4de805b150 2021-10-20T23:20:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.037+0000 7f4dfbfff700 1 -- 172.21.15.12:0/1441900670 <== osd.6 v2:172.21.15.31:6826/14822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4e040b3f30 con 0x7f4de805b150 2021-10-20T23:20:02.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f4de805b150 msgr2=0x7f4de805d570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f4de805b150 0x7f4de805d570 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4de80536d0 msgr2=0x7f4de8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4de80536d0 0x7f4de8055b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4df401a000 tx=0x7f4df4016000).stop 2021-10-20T23:20:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0413fff0 msgr2=0x7f4e041558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 --2- 172.21.15.12:0/1441900670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0413fff0 0x7f4e041558e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4dec00c000 tx=0x7f4dec006df0).stop 2021-10-20T23:20:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e037fe700 1 -- 172.21.15.12:0/1441900670 reap_dead start 2021-10-20T23:20:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 shutdown_connections 2021-10-20T23:20:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 >> 172.21.15.12:0/1441900670 conn(0x7f4e0405f9f0 msgr2=0x7f4e040b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 shutdown_connections 2021-10-20T23:20:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.041+0000 7f4e099e4700 1 -- 172.21.15.12:0/1441900670 wait complete. 2021-10-20T23:20:02.058 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:02.058 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-10-20T23:20:02.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.161+0000 7f4c61c1f700 1 Processor -- start 2021-10-20T23:20:02.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.161+0000 7f4c61c1f700 1 -- start start 2021-10-20T23:20:02.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c5c0b96e0 0x7f4c5c0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c5c13fff0 0x7f4c5c140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c067500 con 0x7f4c5c067120 2021-10-20T23:20:02.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5c143080 con 0x7f4c5c0b96e0 2021-10-20T23:20:02.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0af4d0 con 0x7f4c5c13fff0 2021-10-20T23:20:02.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c5c0b96e0 0x7f4c5c0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c5c0b96e0 0x7f4c5c0aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36872/0 (socket says 172.21.15.12:36872) 2021-10-20T23:20:02.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5affd700 1 -- 172.21.15.12:0/3889978526 learned_addr learned my addr 172.21.15.12:0/3889978526 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:02.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5bfff700 1 --2- 172.21.15.12:0/3889978526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c5c13fff0 0x7f4c5c140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5affd700 1 -- 172.21.15.12:0/3889978526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c5c13fff0 msgr2=0x7f4c5c140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:02.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5affd700 1 --2- 172.21.15.12:0/3889978526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c5c13fff0 0x7f4c5c140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5affd700 1 -- 172.21.15.12:0/3889978526 >> v1:172.21.15.12:6789/0 conn(0x7f4c5c067120 legacy=0x7f4c5c1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5affd700 1 -- 172.21.15.12:0/3889978526 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c143270 con 0x7f4c5c0b96e0 2021-10-20T23:20:02.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5affd700 1 --2- 172.21.15.12:0/3889978526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0b96e0 0x7f4c5c0aec00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4c44002f70 tx=0x7f4c44006eb0).ready entity=mon.0 client_cookie=97d3cefe46287859 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5a7fc700 1 -- 172.21.15.12:0/3889978526 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4400d5c0 con 0x7f4c5c0b96e0 2021-10-20T23:20:02.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5a7fc700 1 -- 172.21.15.12:0/3889978526 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c44000e90 con 0x7f4c5c0b96e0 2021-10-20T23:20:02.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c5a7fc700 1 -- 172.21.15.12:0/3889978526 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4400d950 con 0x7f4c5c0b96e0 2021-10-20T23:20:02.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3889978526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0b96e0 msgr2=0x7f4c5c0aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 --2- 172.21.15.12:0/3889978526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0b96e0 0x7f4c5c0aec00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4c44002f70 tx=0x7f4c44006eb0).stop 2021-10-20T23:20:02.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3889978526 shutdown_connections 2021-10-20T23:20:02.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 --2- 172.21.15.12:0/3889978526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c5c13fff0 0x7f4c5c140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 --2- 172.21.15.12:0/3889978526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0b96e0 0x7f4c5c0aec00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3889978526 >> 172.21.15.12:0/3889978526 conn(0x7f4c5c05f9f0 msgr2=0x7f4c5c0616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:02.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3889978526 shutdown_connections 2021-10-20T23:20:02.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.165+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3889978526 wait complete. 2021-10-20T23:20:02.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c61c1f700 1 Processor -- start 2021-10-20T23:20:02.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c61c1f700 1 -- start start 2021-10-20T23:20:02.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c61c1f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c5c067120 0x7f4c5c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c61c1f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c5c0b96e0 0x7f4c5c0b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c61c1f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c13fff0 0x7f4c5c0b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c61c1f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0b8cc0 con 0x7f4c5c13fff0 2021-10-20T23:20:02.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c61c1f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0b0040 con 0x7f4c5c0b96e0 2021-10-20T23:20:02.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c61c1f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0b02e0 con 0x7f4c5c067120 2021-10-20T23:20:02.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c5bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c13fff0 0x7f4c5c0b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c5bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c13fff0 0x7f4c5c0b2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36880/0 (socket says 172.21.15.12:36880) 2021-10-20T23:20:02.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c5bfff700 1 -- 172.21.15.12:0/3495124525 learned_addr learned my addr 172.21.15.12:0/3495124525 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:02.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c5affd700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c5c0b96e0 0x7f4c5c0b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c5b7fe700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c5c067120 0x7f4c5c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.169+0000 7f4c5bfff700 1 -- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c5c067120 msgr2=0x7f4c5c0b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c5bfff700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c5c067120 0x7f4c5c0b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c5bfff700 1 -- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c5c0b96e0 msgr2=0x7f4c5c0b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c5bfff700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c5c0b96e0 0x7f4c5c0b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c5bfff700 1 -- 172.21.15.12:0/3495124525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4400b1e0 con 0x7f4c5c13fff0 2021-10-20T23:20:02.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c5bfff700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c13fff0 0x7f4c5c0b2840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4c5400a000 tx=0x7f4c54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c58ff9700 1 -- 172.21.15.12:0/3495124525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c540127e0 con 0x7f4c5c13fff0 2021-10-20T23:20:02.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c58ff9700 1 -- 172.21.15.12:0/3495124525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c54012940 con 0x7f4c5c13fff0 2021-10-20T23:20:02.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c0b0580 con 0x7f4c5c13fff0 2021-10-20T23:20:02.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c58ff9700 1 -- 172.21.15.12:0/3495124525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c54012ca0 con 0x7f4c5c13fff0 2021-10-20T23:20:02.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c0b3440 con 0x7f4c5c13fff0 2021-10-20T23:20:02.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c5c0b9480 con 0x7f4c5c13fff0 2021-10-20T23:20:02.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c58ff9700 1 -- 172.21.15.12:0/3495124525 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c54013480 con 0x7f4c5c13fff0 2021-10-20T23:20:02.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c58ff9700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c400536a0 0x7f4c40055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c58ff9700 1 -- 172.21.15.12:0/3495124525 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4c5406bdb0 con 0x7f4c5c13fff0 2021-10-20T23:20:02.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c58ff9700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f4c4005b120 0x7f4c4005d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c58ff9700 1 -- 172.21.15.12:0/3495124525 --> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c4005db00 con 0x7f4c4005b120 2021-10-20T23:20:02.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c58ff9700 1 -- 172.21.15.12:0/3495124525 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c5406e440 con 0x7f4c5c13fff0 2021-10-20T23:20:02.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c5b7fe700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c400536a0 0x7f4c40055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c5affd700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f4c4005b120 0x7f4c4005d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.173+0000 7f4c5affd700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f4c4005b120 0x7f4c4005d540 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.177+0000 7f4c5b7fe700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c400536a0 0x7f4c40055b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4c4c00d000 tx=0x7f4c4c007b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.177+0000 7f4c58ff9700 1 -- 172.21.15.12:0/3495124525 <== osd.7 v2:172.21.15.31:6818/14835 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f4c4005db00 con 0x7f4c4005b120 2021-10-20T23:20:02.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.197+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 --> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4c5c0b3020 con 0x7f4c4005b120 2021-10-20T23:20:02.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.197+0000 7f4c58ff9700 1 -- 172.21.15.12:0/3495124525 <== osd.7 v2:172.21.15.31:6818/14835 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4c5c0b3020 con 0x7f4c4005b120 2021-10-20T23:20:02.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f4c4005b120 msgr2=0x7f4c4005d540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f4c4005b120 0x7f4c4005d540 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c400536a0 msgr2=0x7f4c40055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c400536a0 0x7f4c40055b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4c4c00d000 tx=0x7f4c4c007b50).stop 2021-10-20T23:20:02.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c13fff0 msgr2=0x7f4c5c0b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 --2- 172.21.15.12:0/3495124525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c13fff0 0x7f4c5c0b2840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4c5400a000 tx=0x7f4c54008040).stop 2021-10-20T23:20:02.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c5bfff700 1 -- 172.21.15.12:0/3495124525 reap_dead start 2021-10-20T23:20:02.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 shutdown_connections 2021-10-20T23:20:02.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 >> 172.21.15.12:0/3495124525 conn(0x7f4c5c05f9f0 msgr2=0x7f4c5c0b9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:02.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 shutdown_connections 2021-10-20T23:20:02.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.201+0000 7f4c61c1f700 1 -- 172.21.15.12:0/3495124525 wait complete. 2021-10-20T23:20:02.221 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:02.222 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-10-20T23:20:02.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49f08ba700 1 Processor -- start 2021-10-20T23:20:02.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49f08ba700 1 -- start start 2021-10-20T23:20:02.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49f08ba700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49ec0b2580 0x7f49ec14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49f08ba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49ec0b0010 0x7f49ec14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49f08ba700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec0a70c0 con 0x7f49ec0afbd0 2021-10-20T23:20:02.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49f08ba700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ec0a72f0 con 0x7f49ec0b2580 2021-10-20T23:20:02.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49f08ba700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ec0a7590 con 0x7f49ec0b0010 2021-10-20T23:20:02.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49ead9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49ec0b2580 0x7f49ec14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49ead9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49ec0b2580 0x7f49ec14ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36888/0 (socket says 172.21.15.12:36888) 2021-10-20T23:20:02.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49ead9d700 1 -- 172.21.15.12:0/3622446655 learned_addr learned my addr 172.21.15.12:0/3622446655 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:02.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49ea59c700 1 --2- 172.21.15.12:0/3622446655 >> v2:172.21.15.31:3300/0 conn(0x7f49ec0b0010 0x7f49ec14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49ead9d700 1 -- 172.21.15.12:0/3622446655 >> v2:172.21.15.31:3300/0 conn(0x7f49ec0b0010 msgr2=0x7f49ec14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:02.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49ead9d700 1 --2- 172.21.15.12:0/3622446655 >> v2:172.21.15.31:3300/0 conn(0x7f49ec0b0010 0x7f49ec14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49ead9d700 1 -- 172.21.15.12:0/3622446655 >> v1:172.21.15.31:6789/0 conn(0x7f49ec0afbd0 legacy=0x7f49ec0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49ead9d700 1 -- 172.21.15.12:0/3622446655 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec0a7830 con 0x7f49ec0b2580 2021-10-20T23:20:02.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49ead9d700 1 --2- 172.21.15.12:0/3622446655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b2580 0x7f49ec14ae40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f49d4002f70 tx=0x7f49d4006eb0).ready entity=mon.0 client_cookie=a0749ed10efd8d31 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49e9d9b700 1 -- 172.21.15.12:0/3622446655 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49d400d5c0 con 0x7f49ec0b2580 2021-10-20T23:20:02.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49e9d9b700 1 -- 172.21.15.12:0/3622446655 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4000e90 con 0x7f49ec0b2580 2021-10-20T23:20:02.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49e9d9b700 1 -- 172.21.15.12:0/3622446655 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49d400d950 con 0x7f49ec0b2580 2021-10-20T23:20:02.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49f08ba700 1 -- 172.21.15.12:0/3622446655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b2580 msgr2=0x7f49ec14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.329+0000 7f49f08ba700 1 --2- 172.21.15.12:0/3622446655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b2580 0x7f49ec14ae40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f49d4002f70 tx=0x7f49d4006eb0).stop 2021-10-20T23:20:02.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 -- 172.21.15.12:0/3622446655 shutdown_connections 2021-10-20T23:20:02.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 --2- 172.21.15.12:0/3622446655 >> v2:172.21.15.31:3300/0 conn(0x7f49ec0b0010 0x7f49ec14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 --2- 172.21.15.12:0/3622446655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b2580 0x7f49ec14ae40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 -- 172.21.15.12:0/3622446655 >> 172.21.15.12:0/3622446655 conn(0x7f49ec060180 msgr2=0x7f49ec0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:02.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 -- 172.21.15.12:0/3622446655 shutdown_connections 2021-10-20T23:20:02.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 -- 172.21.15.12:0/3622446655 wait complete. 2021-10-20T23:20:02.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 Processor -- start 2021-10-20T23:20:02.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 -- start start 2021-10-20T23:20:02.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49ec0afbd0 0x7f49ec065f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b0010 0x7f49ec0a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49ec0b2580 0x7f49ec0a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0abb60 con 0x7f49ec0b0010 2021-10-20T23:20:02.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0ac280 con 0x7f49ec0b2580 2021-10-20T23:20:02.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49f08ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec05d270 con 0x7f49ec0afbd0 2021-10-20T23:20:02.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49ea59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b0010 0x7f49ec0a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49ea59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b0010 0x7f49ec0a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36894/0 (socket says 172.21.15.12:36894) 2021-10-20T23:20:02.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49ead9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49ec0afbd0 0x7f49ec065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49ea59c700 1 -- 172.21.15.12:0/3476302311 learned_addr learned my addr 172.21.15.12:0/3476302311 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:02.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.333+0000 7f49eb59e700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49ec0b2580 0x7f49ec0a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49ea59c700 1 -- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49ec0afbd0 msgr2=0x7f49ec065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49ea59c700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49ec0afbd0 0x7f49ec065f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49ea59c700 1 -- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49ec0b2580 msgr2=0x7f49ec0a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49ea59c700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49ec0b2580 0x7f49ec0a9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49ea59c700 1 -- 172.21.15.12:0/3476302311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d400b1e0 con 0x7f49ec0b0010 2021-10-20T23:20:02.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49ea59c700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b0010 0x7f49ec0a9140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f49dc00c000 tx=0x7f49dc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49e3fff700 1 -- 172.21.15.12:0/3476302311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49dc00ee00 con 0x7f49ec0b0010 2021-10-20T23:20:02.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49e3fff700 1 -- 172.21.15.12:0/3476302311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc00c850 con 0x7f49ec0b0010 2021-10-20T23:20:02.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49e3fff700 1 -- 172.21.15.12:0/3476302311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49dc00cbb0 con 0x7f49ec0b0010 2021-10-20T23:20:02.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec0ac4e0 con 0x7f49ec0b0010 2021-10-20T23:20:02.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec0aab00 con 0x7f49ec0b0010 2021-10-20T23:20:02.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec057350 con 0x7f49ec0b0010 2021-10-20T23:20:02.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49e3fff700 1 -- 172.21.15.12:0/3476302311 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f49dc022070 con 0x7f49ec0b0010 2021-10-20T23:20:02.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49e3fff700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49d0053580 0x7f49d0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:02.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49e3fff700 1 -- 172.21.15.12:0/3476302311 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f49dc06c090 con 0x7f49ec0b0010 2021-10-20T23:20:02.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.337+0000 7f49ead9d700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49d0053580 0x7f49d0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:02.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.341+0000 7f49ead9d700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49d0053580 0x7f49d0055a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f49d401c000 tx=0x7f49d4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:02.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.345+0000 7f49e3fff700 1 -- 172.21.15.12:0/3476302311 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f49dc042fb0 con 0x7f49ec0b0010 2021-10-20T23:20:02.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f49ec0698e0 con 0x7f49ec0b0010 2021-10-20T23:20:02.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49e3fff700 1 -- 172.21.15.12:0/3476302311 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49dc0465d0 con 0x7f49ec0b0010 2021-10-20T23:20:02.481 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:02.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49d0053580 msgr2=0x7f49d0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49d0053580 0x7f49d0055a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f49d401c000 tx=0x7f49d4015000).stop 2021-10-20T23:20:02.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b0010 msgr2=0x7f49ec0a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:02.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b0010 0x7f49ec0a9140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f49dc00c000 tx=0x7f49dc0091d0).stop 2021-10-20T23:20:02.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 shutdown_connections 2021-10-20T23:20:02.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49d0053580 0x7f49d0055a40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49ec0b2580 0x7f49ec0a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49ec0b0010 0x7f49ec0a9140 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 --2- 172.21.15.12:0/3476302311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49ec0afbd0 0x7f49ec065f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:02.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 >> 172.21.15.12:0/3476302311 conn(0x7f49ec060180 msgr2=0x7f49ec0675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:02.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 shutdown_connections 2021-10-20T23:20:02.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:02.473+0000 7f49f08ba700 1 -- 172.21.15.12:0/3476302311 wait complete. 2021-10-20T23:20:02.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2021-10-20T23:20:03.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-10-20T23:20:03.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.601+0000 7f863e0de700 1 Processor -- start 2021-10-20T23:20:03.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.601+0000 7f863e0de700 1 -- start start 2021-10-20T23:20:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.601+0000 7f863e0de700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b0b80 0x7f8638146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.601+0000 7f863e0de700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86380b1140 con 0x7f86380b03d0 2021-10-20T23:20:03.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.601+0000 7f863e0de700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86380a9570 con 0x7f86380a9190 2021-10-20T23:20:03.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863e0de700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86380b1370 con 0x7f86380b0b80 2021-10-20T23:20:03.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863d8dd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f86380b03d0 0x7f86381401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35498/0 (socket says 172.21.15.12:35498) 2021-10-20T23:20:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863d8dd700 1 -- 172.21.15.12:0/3827918847 learned_addr learned my addr 172.21.15.12:0/3827918847 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863c8db700 1 --2- 172.21.15.12:0/3827918847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b0b80 0x7f8638146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f8623fff700 1 -- 172.21.15.12:0/3827918847 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296635358 0 0) 0x7f86380b1140 con 0x7f86380b03d0 2021-10-20T23:20:03.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f8623fff700 1 -- 172.21.15.12:0/3827918847 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f861c003260 con 0x7f86380b03d0 2021-10-20T23:20:03.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f8623fff700 1 -- 172.21.15.12:0/3827918847 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898847543 0 0) 0x7f86380a9570 con 0x7f86380a9190 2021-10-20T23:20:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f8623fff700 1 -- 172.21.15.12:0/3827918847 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86380b1140 con 0x7f86380a9190 2021-10-20T23:20:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863c8db700 1 -- 172.21.15.12:0/3827918847 >> v1:172.21.15.31:6789/0 conn(0x7f86380a9190 legacy=0x7f8638146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863c8db700 1 -- 172.21.15.12:0/3827918847 >> v1:172.21.15.12:6789/0 conn(0x7f86380b03d0 legacy=0x7f86381401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863c8db700 1 -- 172.21.15.12:0/3827918847 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380b1610 con 0x7f86380b0b80 2021-10-20T23:20:03.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863c8db700 1 --2- 172.21.15.12:0/3827918847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b0b80 0x7f8638146c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f862c002f70 tx=0x7f862c006df0).ready entity=mon.2 client_cookie=e0040b0152d06935 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:03.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f8623fff700 1 -- 172.21.15.12:0/3827918847 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f862c00d5c0 con 0x7f86380b0b80 2021-10-20T23:20:03.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f8623fff700 1 -- 172.21.15.12:0/3827918847 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c000e90 con 0x7f86380b0b80 2021-10-20T23:20:03.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f8623fff700 1 -- 172.21.15.12:0/3827918847 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f862c00d910 con 0x7f86380b0b80 2021-10-20T23:20:03.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863e0de700 1 -- 172.21.15.12:0/3827918847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b0b80 msgr2=0x7f8638146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863e0de700 1 --2- 172.21.15.12:0/3827918847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b0b80 0x7f8638146c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f862c002f70 tx=0x7f862c006df0).stop 2021-10-20T23:20:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863e0de700 1 -- 172.21.15.12:0/3827918847 shutdown_connections 2021-10-20T23:20:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863e0de700 1 --2- 172.21.15.12:0/3827918847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b0b80 0x7f8638146c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863e0de700 1 -- 172.21.15.12:0/3827918847 >> 172.21.15.12:0/3827918847 conn(0x7f8638061140 msgr2=0x7f8638062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863e0de700 1 -- 172.21.15.12:0/3827918847 shutdown_connections 2021-10-20T23:20:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.605+0000 7f863e0de700 1 -- 172.21.15.12:0/3827918847 wait complete. 2021-10-20T23:20:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 Processor -- start 2021-10-20T23:20:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 -- start start 2021-10-20T23:20:03.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86380a9190 0x7f8638140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b03d0 0x7f86380af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86380b0b80 0x7f8638143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86380b3ea0 con 0x7f86380b0b80 2021-10-20T23:20:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86381423c0 con 0x7f86380a9190 2021-10-20T23:20:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86381425f0 con 0x7f86380b03d0 2021-10-20T23:20:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d8dd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86380b0b80 0x7f8638143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d8dd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86380b0b80 0x7f8638143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36910/0 (socket says 172.21.15.12:36910) 2021-10-20T23:20:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d8dd700 1 -- 172.21.15.12:0/885228327 learned_addr learned my addr 172.21.15.12:0/885228327 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863c8db700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b03d0 0x7f86380af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d0dc700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86380a9190 0x7f8638140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d8dd700 1 -- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b03d0 msgr2=0x7f86380af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d8dd700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b03d0 0x7f86380af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d8dd700 1 -- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86380a9190 msgr2=0x7f8638140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d8dd700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86380a9190 0x7f8638140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d8dd700 1 -- 172.21.15.12:0/885228327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c00b180 con 0x7f86380b0b80 2021-10-20T23:20:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863d8dd700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86380b0b80 0x7f8638143640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8630001490 tx=0x7f8630007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f862affd700 1 -- 172.21.15.12:0/885228327 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8630005d40 con 0x7f86380b0b80 2021-10-20T23:20:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f862affd700 1 -- 172.21.15.12:0/885228327 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86300070d0 con 0x7f86380b0b80 2021-10-20T23:20:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8638142890 con 0x7f86380b0b80 2021-10-20T23:20:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f862affd700 1 -- 172.21.15.12:0/885228327 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8630005ea0 con 0x7f86380b0b80 2021-10-20T23:20:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.609+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86380ae560 con 0x7f86380b0b80 2021-10-20T23:20:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.613+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86380ac650 con 0x7f86380b0b80 2021-10-20T23:20:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.613+0000 7f862affd700 1 -- 172.21.15.12:0/885228327 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f863001a060 con 0x7f86380b0b80 2021-10-20T23:20:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.613+0000 7f862affd700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8614053610 0x7f8614055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.613+0000 7f862affd700 1 -- 172.21.15.12:0/885228327 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f863006b1d0 con 0x7f86380b0b80 2021-10-20T23:20:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.613+0000 7f863d0dc700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8614053610 0x7f8614055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.613+0000 7f863d0dc700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8614053610 0x7f8614055ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f863400d000 tx=0x7f8634007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.621+0000 7f862affd700 1 -- 172.21.15.12:0/885228327 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f86300421d0 con 0x7f86380b0b80 2021-10-20T23:20:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.749+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8638057350 con 0x7f86380b0b80 2021-10-20T23:20:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.749+0000 7f862affd700 1 -- 172.21.15.12:0/885228327 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8630018020 con 0x7f86380b0b80 2021-10-20T23:20:03.756 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2021-10-20T23:20:03.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8614053610 msgr2=0x7f8614055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8614053610 0x7f8614055ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f863400d000 tx=0x7f8634007a20).stop 2021-10-20T23:20:03.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86380b0b80 msgr2=0x7f8638143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86380b0b80 0x7f8638143640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8630001490 tx=0x7f8630007e00).stop 2021-10-20T23:20:03.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 shutdown_connections 2021-10-20T23:20:03.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8614053610 0x7f8614055ad0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86380b0b80 0x7f8638143640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86380b03d0 0x7f86380af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 --2- 172.21.15.12:0/885228327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86380a9190 0x7f8638140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 >> 172.21.15.12:0/885228327 conn(0x7f8638061140 msgr2=0x7f863813e910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 shutdown_connections 2021-10-20T23:20:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.753+0000 7f863e0de700 1 -- 172.21.15.12:0/885228327 wait complete. 2021-10-20T23:20:03.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2021-10-20T23:20:03.770 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-10-20T23:20:03.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.869+0000 7fc45d98a700 1 Processor -- start 2021-10-20T23:20:03.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.869+0000 7fc45d98a700 1 -- start start 2021-10-20T23:20:03.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 0x7fc4580af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc4580ad850 0x7fc4580a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580afda0 con 0x7fc4580ad320 2021-10-20T23:20:03.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45805c610 con 0x7fc4580ad850 2021-10-20T23:20:03.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc458140800 con 0x7fc4580af2c0 2021-10-20T23:20:03.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d189700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc4580ad850 0x7fc4580a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d189700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc4580ad850 0x7fc4580a8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36918/0 (socket says 172.21.15.12:36918) 2021-10-20T23:20:03.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d189700 1 -- 172.21.15.12:0/1376215374 learned_addr learned my addr 172.21.15.12:0/1376215374 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:03.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45c988700 1 --2- 172.21.15.12:0/1376215374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 0x7fc4580af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d189700 1 -- 172.21.15.12:0/1376215374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 msgr2=0x7fc4580af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:03.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d189700 1 --2- 172.21.15.12:0/1376215374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 0x7fc4580af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d189700 1 -- 172.21.15.12:0/1376215374 >> v1:172.21.15.31:6789/0 conn(0x7fc4580ad320 legacy=0x7fc458143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d189700 1 -- 172.21.15.12:0/1376215374 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458143860 con 0x7fc4580ad850 2021-10-20T23:20:03.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d189700 1 --2- 172.21.15.12:0/1376215374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad850 0x7fc4580a8cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc4500032f0 tx=0x7fc450009290).ready entity=mon.0 client_cookie=8f3ee78218a8d00e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:03.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc4577fe700 1 -- 172.21.15.12:0/1376215374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc45000b8a0 con 0x7fc4580ad850 2021-10-20T23:20:03.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc4577fe700 1 -- 172.21.15.12:0/1376215374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45000ba00 con 0x7fc4580ad850 2021-10-20T23:20:03.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc4577fe700 1 -- 172.21.15.12:0/1376215374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc45000bb70 con 0x7fc4580ad850 2021-10-20T23:20:03.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 -- 172.21.15.12:0/1376215374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad850 msgr2=0x7fc4580a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 --2- 172.21.15.12:0/1376215374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad850 0x7fc4580a8cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc4500032f0 tx=0x7fc450009290).stop 2021-10-20T23:20:03.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 -- 172.21.15.12:0/1376215374 shutdown_connections 2021-10-20T23:20:03.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 --2- 172.21.15.12:0/1376215374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad850 0x7fc4580a8cb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 --2- 172.21.15.12:0/1376215374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 0x7fc4580af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 -- 172.21.15.12:0/1376215374 >> 172.21.15.12:0/1376215374 conn(0x7fc458061140 msgr2=0x7fc458062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 -- 172.21.15.12:0/1376215374 shutdown_connections 2021-10-20T23:20:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.873+0000 7fc45d98a700 1 -- 172.21.15.12:0/1376215374 wait complete. 2021-10-20T23:20:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.877+0000 7fc45d98a700 1 Processor -- start 2021-10-20T23:20:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.877+0000 7fc45d98a700 1 -- start start 2021-10-20T23:20:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.877+0000 7fc45d98a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad320 0x7fc45805f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.877+0000 7fc45d98a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4580ad850 0x7fc458065680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.877+0000 7fc45d98a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 0x7fc458065b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.877+0000 7fc45d98a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580602a0 con 0x7fc4580ad320 2021-10-20T23:20:03.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.877+0000 7fc45d98a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580ac060 con 0x7fc4580ad850 2021-10-20T23:20:03.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45d98a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580aae30 con 0x7fc4580af2c0 2021-10-20T23:20:03.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45c988700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad320 0x7fc45805f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45c988700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad320 0x7fc45805f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36920/0 (socket says 172.21.15.12:36920) 2021-10-20T23:20:03.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45c988700 1 -- 172.21.15.12:0/1223673789 learned_addr learned my addr 172.21.15.12:0/1223673789 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:03.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45d189700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 0x7fc458065b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc457fff700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4580ad850 0x7fc458065680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45c988700 1 -- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 msgr2=0x7fc458065b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45c988700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 0x7fc458065b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45c988700 1 -- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4580ad850 msgr2=0x7fc458065680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45c988700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4580ad850 0x7fc458065680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:03.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45c988700 1 -- 172.21.15.12:0/1223673789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc450009530 con 0x7fc4580ad320 2021-10-20T23:20:03.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45c988700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad320 0x7fc45805f9f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc44c0030b0 tx=0x7fc44c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:03.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc455ffb700 1 -- 172.21.15.12:0/1223673789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc44c011780 con 0x7fc4580ad320 2021-10-20T23:20:03.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc455ffb700 1 -- 172.21.15.12:0/1223673789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c0118e0 con 0x7fc4580ad320 2021-10-20T23:20:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc455ffb700 1 -- 172.21.15.12:0/1223673789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc44c011c40 con 0x7fc4580ad320 2021-10-20T23:20:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4580ab0d0 con 0x7fc4580ad320 2021-10-20T23:20:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4580abce0 con 0x7fc4580ad320 2021-10-20T23:20:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc455ffb700 1 -- 172.21.15.12:0/1223673789 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc44c01c460 con 0x7fc4580ad320 2021-10-20T23:20:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc458057350 con 0x7fc4580ad320 2021-10-20T23:20:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc455ffb700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc4380534f0 0x7fc4380559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc455ffb700 1 -- 172.21.15.12:0/1223673789 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc44c06bad0 con 0x7fc4580ad320 2021-10-20T23:20:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc457fff700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc4380534f0 0x7fc4380559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.881+0000 7fc457fff700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc4380534f0 0x7fc4380559b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc44400d000 tx=0x7fc444000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:03.889+0000 7fc455ffb700 1 -- 172.21.15.12:0/1223673789 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc44c042a70 con 0x7fc4580ad320 2021-10-20T23:20:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.017+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc458061990 con 0x7fc4580ad320 2021-10-20T23:20:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.017+0000 7fc455ffb700 1 -- 172.21.15.12:0/1223673789 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc44c046090 con 0x7fc4580ad320 2021-10-20T23:20:04.024 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc4380534f0 msgr2=0x7fc4380559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc4380534f0 0x7fc4380559b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc44400d000 tx=0x7fc444000bc0).stop 2021-10-20T23:20:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad320 msgr2=0x7fc45805f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad320 0x7fc45805f9f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc44c0030b0 tx=0x7fc44c008040).stop 2021-10-20T23:20:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 shutdown_connections 2021-10-20T23:20:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc4380534f0 0x7fc4380559b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4580af2c0 0x7fc458065b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4580ad850 0x7fc458065680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 --2- 172.21.15.12:0/1223673789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4580ad320 0x7fc45805f9f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 >> 172.21.15.12:0/1223673789 conn(0x7fc458061140 msgr2=0x7fc4580a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 shutdown_connections 2021-10-20T23:20:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.021+0000 7fc45d98a700 1 -- 172.21.15.12:0/1223673789 wait complete. 2021-10-20T23:20:04.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2021-10-20T23:20:04.042 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-10-20T23:20:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c3ebd700 1 Processor -- start 2021-10-20T23:20:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c3ebd700 1 -- start start 2021-10-20T23:20:04.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c3ebd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc1483a0 0x7ff1bc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c3ebd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1bc0a70c0 0x7ff1bc144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c3ebd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0b0350 con 0x7ff1bc0b1db0 2021-10-20T23:20:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c3ebd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc0a90c0 con 0x7ff1bc0a70c0 2021-10-20T23:20:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c3ebd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0b05f0 con 0x7ff1bc1483a0 2021-10-20T23:20:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c1458700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc1483a0 0x7ff1bc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c245a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1bc0a70c0 0x7ff1bc144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c1458700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc1483a0 0x7ff1bc0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:42686/0 (socket says 172.21.15.12:42686) 2021-10-20T23:20:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c1458700 1 -- 172.21.15.12:0/1977903766 learned_addr learned my addr 172.21.15.12:0/1977903766 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c245a700 1 -- 172.21.15.12:0/1977903766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc1483a0 msgr2=0x7ff1bc0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:04.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c245a700 1 --2- 172.21.15.12:0/1977903766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc1483a0 0x7ff1bc0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c245a700 1 -- 172.21.15.12:0/1977903766 >> v1:172.21.15.31:6789/0 conn(0x7ff1bc0b1db0 legacy=0x7ff1bc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.141+0000 7ff1c245a700 1 -- 172.21.15.12:0/1977903766 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc0b0890 con 0x7ff1bc0a70c0 2021-10-20T23:20:04.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c245a700 1 --2- 172.21.15.12:0/1977903766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1bc0a70c0 0x7ff1bc144720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ff1b4002f70 tx=0x7ff1b4006df0).ready entity=mon.1 client_cookie=d21e8cba5edbc72 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c0c57700 1 -- 172.21.15.12:0/1977903766 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b400d570 con 0x7ff1bc0a70c0 2021-10-20T23:20:04.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c0c57700 1 -- 172.21.15.12:0/1977903766 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4000e90 con 0x7ff1bc0a70c0 2021-10-20T23:20:04.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c0c57700 1 -- 172.21.15.12:0/1977903766 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b400d8c0 con 0x7ff1bc0a70c0 2021-10-20T23:20:04.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/1977903766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1bc0a70c0 msgr2=0x7ff1bc144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 --2- 172.21.15.12:0/1977903766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1bc0a70c0 0x7ff1bc144720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ff1b4002f70 tx=0x7ff1b4006df0).stop 2021-10-20T23:20:04.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/1977903766 shutdown_connections 2021-10-20T23:20:04.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 --2- 172.21.15.12:0/1977903766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1bc0a70c0 0x7ff1bc144720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 --2- 172.21.15.12:0/1977903766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc1483a0 0x7ff1bc0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/1977903766 >> 172.21.15.12:0/1977903766 conn(0x7ff1bc05f6b0 msgr2=0x7ff1bc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:04.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/1977903766 shutdown_connections 2021-10-20T23:20:04.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/1977903766 wait complete. 2021-10-20T23:20:04.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 Processor -- start 2021-10-20T23:20:04.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.145+0000 7ff1c3ebd700 1 -- start start 2021-10-20T23:20:04.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c3ebd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1bc0a70c0 0x7ff1bc0ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c3ebd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc0b1db0 0x7ff1bc0a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c3ebd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc1483a0 0x7ff1bc15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c3ebd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc15aaf0 con 0x7ff1bc1483a0 2021-10-20T23:20:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c3ebd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0aa990 con 0x7ff1bc0a70c0 2021-10-20T23:20:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c3ebd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0aac30 con 0x7ff1bc0b1db0 2021-10-20T23:20:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c245a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc1483a0 0x7ff1bc15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c245a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc1483a0 0x7ff1bc15a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36938/0 (socket says 172.21.15.12:36938) 2021-10-20T23:20:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c245a700 1 -- 172.21.15.12:0/3963326410 learned_addr learned my addr 172.21.15.12:0/3963326410 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c1c59700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1bc0a70c0 0x7ff1bc0ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c1458700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc0b1db0 0x7ff1bc0a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c245a700 1 -- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc0b1db0 msgr2=0x7ff1bc0a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c245a700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc0b1db0 0x7ff1bc0a9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c245a700 1 -- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1bc0a70c0 msgr2=0x7ff1bc0ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c245a700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1bc0a70c0 0x7ff1bc0ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c245a700 1 -- 172.21.15.12:0/3963326410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b400b180 con 0x7ff1bc1483a0 2021-10-20T23:20:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c245a700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc1483a0 0x7ff1bc15a1d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff1b4002f70 tx=0x7ff1b4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1aaffd700 1 -- 172.21.15.12:0/3963326410 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b4013de0 con 0x7ff1bc1483a0 2021-10-20T23:20:04.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1aaffd700 1 -- 172.21.15.12:0/3963326410 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b400de20 con 0x7ff1bc1483a0 2021-10-20T23:20:04.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc0abb20 con 0x7ff1bc1483a0 2021-10-20T23:20:04.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1aaffd700 1 -- 172.21.15.12:0/3963326410 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b401e5f0 con 0x7ff1bc1483a0 2021-10-20T23:20:04.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc148ab0 con 0x7ff1bc1483a0 2021-10-20T23:20:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc15acf0 con 0x7ff1bc1483a0 2021-10-20T23:20:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.149+0000 7ff1aaffd700 1 -- 172.21.15.12:0/3963326410 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff1b4025030 con 0x7ff1bc1483a0 2021-10-20T23:20:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.153+0000 7ff1aaffd700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff19c053610 0x7ff19c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.153+0000 7ff1aaffd700 1 -- 172.21.15.12:0/3963326410 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff1b406c6c0 con 0x7ff1bc1483a0 2021-10-20T23:20:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.153+0000 7ff1c1c59700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff19c053610 0x7ff19c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.153+0000 7ff1c1c59700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff19c053610 0x7ff19c055ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff1ac00d000 tx=0x7ff1ac007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.157+0000 7ff1aaffd700 1 -- 172.21.15.12:0/3963326410 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff1b40436c0 con 0x7ff1bc1483a0 2021-10-20T23:20:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.281+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff1bc0aadf0 con 0x7ff1bc1483a0 2021-10-20T23:20:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1aaffd700 1 -- 172.21.15.12:0/3963326410 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1b4023020 con 0x7ff1bc1483a0 2021-10-20T23:20:04.291 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:04.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff19c053610 msgr2=0x7ff19c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff19c053610 0x7ff19c055ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff1ac00d000 tx=0x7ff1ac007b90).stop 2021-10-20T23:20:04.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc1483a0 msgr2=0x7ff1bc15a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc1483a0 0x7ff1bc15a1d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff1b4002f70 tx=0x7ff1b4014000).stop 2021-10-20T23:20:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 shutdown_connections 2021-10-20T23:20:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff19c053610 0x7ff19c055ad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1bc1483a0 0x7ff1bc15a1d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1bc0b1db0 0x7ff1bc0a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 --2- 172.21.15.12:0/3963326410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1bc0a70c0 0x7ff1bc0ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 >> 172.21.15.12:0/3963326410 conn(0x7ff1bc05f6b0 msgr2=0x7ff1bc1447a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 shutdown_connections 2021-10-20T23:20:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.285+0000 7ff1c3ebd700 1 -- 172.21.15.12:0/3963326410 wait complete. 2021-10-20T23:20:04.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2021-10-20T23:20:04.303 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-10-20T23:20:04.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.405+0000 7fda29e54700 1 Processor -- start 2021-10-20T23:20:04.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.405+0000 7fda29e54700 1 -- start start 2021-10-20T23:20:04.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.405+0000 7fda29e54700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 0x7fda24142e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.405+0000 7fda29e54700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda24067880 con 0x7fda240ac6f0 2021-10-20T23:20:04.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.405+0000 7fda29e54700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda24067b20 con 0x7fda240b2580 2021-10-20T23:20:04.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.405+0000 7fda29e54700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda240ad5b0 con 0x7fda240b00e0 2021-10-20T23:20:04.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.405+0000 7fda29653700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fda240ac6f0 0x7fda24143360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35540/0 (socket says 172.21.15.12:35540) 2021-10-20T23:20:04.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.405+0000 7fda29653700 1 -- 172.21.15.12:0/1180909586 learned_addr learned my addr 172.21.15.12:0/1180909586 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:04.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.405+0000 7fda23fff700 1 --2- 172.21.15.12:0/1180909586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 0x7fda24142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda237fe700 1 -- 172.21.15.12:0/1180909586 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726159899 0 0) 0x7fda24067880 con 0x7fda240ac6f0 2021-10-20T23:20:04.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda237fe700 1 -- 172.21.15.12:0/1180909586 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda10003260 con 0x7fda240ac6f0 2021-10-20T23:20:04.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda237fe700 1 -- 172.21.15.12:0/1180909586 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709397834 0 0) 0x7fda24067b20 con 0x7fda240b2580 2021-10-20T23:20:04.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda237fe700 1 -- 172.21.15.12:0/1180909586 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda24067880 con 0x7fda240b2580 2021-10-20T23:20:04.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda237fe700 1 -- 172.21.15.12:0/1180909586 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349805485 0 0) 0x7fda10003260 con 0x7fda240ac6f0 2021-10-20T23:20:04.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda23fff700 1 -- 172.21.15.12:0/1180909586 >> v1:172.21.15.31:6789/0 conn(0x7fda240b2580 legacy=0x7fda24140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda23fff700 1 -- 172.21.15.12:0/1180909586 >> v1:172.21.15.12:6789/0 conn(0x7fda240ac6f0 legacy=0x7fda24143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda23fff700 1 -- 172.21.15.12:0/1180909586 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24146fd0 con 0x7fda240b00e0 2021-10-20T23:20:04.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda23fff700 1 --2- 172.21.15.12:0/1180909586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 0x7fda24142e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fda1c001b80 tx=0x7fda14006df0).ready entity=mon.2 client_cookie=758635fda66e1492 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda237fe700 1 -- 172.21.15.12:0/1180909586 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1c0019e0 con 0x7fda240b00e0 2021-10-20T23:20:04.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda237fe700 1 -- 172.21.15.12:0/1180909586 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda14000e90 con 0x7fda240b00e0 2021-10-20T23:20:04.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda237fe700 1 -- 172.21.15.12:0/1180909586 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda14012460 con 0x7fda240b00e0 2021-10-20T23:20:04.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda29e54700 1 -- 172.21.15.12:0/1180909586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 msgr2=0x7fda24142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda29e54700 1 --2- 172.21.15.12:0/1180909586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 0x7fda24142e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fda1c001b80 tx=0x7fda14006df0).stop 2021-10-20T23:20:04.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda29e54700 1 -- 172.21.15.12:0/1180909586 shutdown_connections 2021-10-20T23:20:04.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda29e54700 1 --2- 172.21.15.12:0/1180909586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 0x7fda24142e70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda29e54700 1 -- 172.21.15.12:0/1180909586 >> 172.21.15.12:0/1180909586 conn(0x7fda24060180 msgr2=0x7fda240b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:04.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda29e54700 1 -- 172.21.15.12:0/1180909586 shutdown_connections 2021-10-20T23:20:04.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.409+0000 7fda29e54700 1 -- 172.21.15.12:0/1180909586 wait complete. 2021-10-20T23:20:04.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 Processor -- start 2021-10-20T23:20:04.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 -- start start 2021-10-20T23:20:04.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda240ac6f0 0x7fda24146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 0x7fda24142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda240b2580 0x7fda24143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240a94e0 con 0x7fda240ac6f0 2021-10-20T23:20:04.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24156430 con 0x7fda240b2580 2021-10-20T23:20:04.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda24156860 con 0x7fda240b00e0 2021-10-20T23:20:04.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda28e52700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda240ac6f0 0x7fda24146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda28e52700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda240ac6f0 0x7fda24146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36948/0 (socket says 172.21.15.12:36948) 2021-10-20T23:20:04.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda28e52700 1 -- 172.21.15.12:0/2397115416 learned_addr learned my addr 172.21.15.12:0/2397115416 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:04.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda23fff700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 0x7fda24142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29653700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda240b2580 0x7fda24143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda28e52700 1 -- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 msgr2=0x7fda24142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda28e52700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 0x7fda24142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda28e52700 1 -- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda240b2580 msgr2=0x7fda24143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda28e52700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda240b2580 0x7fda24143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda28e52700 1 -- 172.21.15.12:0/2397115416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1400b180 con 0x7fda240ac6f0 2021-10-20T23:20:04.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29653700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda240b2580 0x7fda24143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:04.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda28e52700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda240ac6f0 0x7fda24146230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fda18001110 tx=0x7fda18007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda21ffb700 1 -- 172.21.15.12:0/2397115416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda18012400 con 0x7fda240ac6f0 2021-10-20T23:20:04.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda21ffb700 1 -- 172.21.15.12:0/2397115416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18012560 con 0x7fda240ac6f0 2021-10-20T23:20:04.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda240a9710 con 0x7fda240ac6f0 2021-10-20T23:20:04.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda21ffb700 1 -- 172.21.15.12:0/2397115416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda180128c0 con 0x7fda240ac6f0 2021-10-20T23:20:04.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda24145060 con 0x7fda240ac6f0 2021-10-20T23:20:04.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.413+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda24145cd0 con 0x7fda240ac6f0 2021-10-20T23:20:04.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.417+0000 7fda21ffb700 1 -- 172.21.15.12:0/2397115416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda18019030 con 0x7fda240ac6f0 2021-10-20T23:20:04.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.417+0000 7fda21ffb700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda040536a0 0x7fda04055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.417+0000 7fda21ffb700 1 -- 172.21.15.12:0/2397115416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fda1806b430 con 0x7fda240ac6f0 2021-10-20T23:20:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.417+0000 7fda23fff700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda040536a0 0x7fda04055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.417+0000 7fda23fff700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda040536a0 0x7fda04055b60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fda14018000 tx=0x7fda14014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.421+0000 7fda21ffb700 1 -- 172.21.15.12:0/2397115416 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda18042320 con 0x7fda240ac6f0 2021-10-20T23:20:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.545+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fda24143a70 con 0x7fda240ac6f0 2021-10-20T23:20:04.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.545+0000 7fda21ffb700 1 -- 172.21.15.12:0/2397115416 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda18045940 con 0x7fda240ac6f0 2021-10-20T23:20:04.553 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:04.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda040536a0 msgr2=0x7fda04055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda040536a0 0x7fda04055b60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fda14018000 tx=0x7fda14014000).stop 2021-10-20T23:20:04.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda240ac6f0 msgr2=0x7fda24146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda240ac6f0 0x7fda24146230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fda18001110 tx=0x7fda18007a90).stop 2021-10-20T23:20:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 shutdown_connections 2021-10-20T23:20:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda040536a0 0x7fda04055b60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda240b2580 0x7fda24143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda240b00e0 0x7fda24142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 --2- 172.21.15.12:0/2397115416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda240ac6f0 0x7fda24146230 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 >> 172.21.15.12:0/2397115416 conn(0x7fda24060180 msgr2=0x7fda240b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 shutdown_connections 2021-10-20T23:20:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.549+0000 7fda29e54700 1 -- 172.21.15.12:0/2397115416 wait complete. 2021-10-20T23:20:04.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2021-10-20T23:20:04.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-10-20T23:20:04.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7117fff700 1 Processor -- start 2021-10-20T23:20:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7117fff700 1 -- start start 2021-10-20T23:20:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7117fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71180ad5c0 0x7f7118061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7117fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71180aecf0 con 0x7f7118140440 2021-10-20T23:20:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7117fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71180b6f20 con 0x7f7118061320 2021-10-20T23:20:04.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7117fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180aef20 con 0x7f71180ad5c0 2021-10-20T23:20:04.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f71177fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7118140440 0x7f7118146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35552/0 (socket says 172.21.15.12:35552) 2021-10-20T23:20:04.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f71177fe700 1 -- 172.21.15.12:0/2342134348 learned_addr learned my addr 172.21.15.12:0/2342134348 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:04.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f71167fc700 1 --2- 172.21.15.12:0/2342134348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71180ad5c0 0x7f7118061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7115ffb700 1 -- 172.21.15.12:0/2342134348 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193827860 0 0) 0x7f71180aecf0 con 0x7f7118140440 2021-10-20T23:20:04.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f71167fc700 1 -- 172.21.15.12:0/2342134348 >> v1:172.21.15.31:6789/0 conn(0x7f7118061320 legacy=0x7f71180b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f71167fc700 1 -- 172.21.15.12:0/2342134348 >> v1:172.21.15.12:6789/0 conn(0x7f7118140440 legacy=0x7f7118146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f71167fc700 1 -- 172.21.15.12:0/2342134348 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180af1c0 con 0x7f71180ad5c0 2021-10-20T23:20:04.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f71167fc700 1 --2- 172.21.15.12:0/2342134348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71180ad5c0 0x7f7118061700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f7108002f70 tx=0x7f7108006df0).ready entity=mon.2 client_cookie=ef72efa207dcf294 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7115ffb700 1 -- 172.21.15.12:0/2342134348 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710800d5c0 con 0x7f71180ad5c0 2021-10-20T23:20:04.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7115ffb700 1 -- 172.21.15.12:0/2342134348 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7108000e90 con 0x7f71180ad5c0 2021-10-20T23:20:04.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.669+0000 7f7115ffb700 1 -- 172.21.15.12:0/2342134348 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710800d910 con 0x7f71180ad5c0 2021-10-20T23:20:04.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 -- 172.21.15.12:0/2342134348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71180ad5c0 msgr2=0x7f7118061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 --2- 172.21.15.12:0/2342134348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71180ad5c0 0x7f7118061700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f7108002f70 tx=0x7f7108006df0).stop 2021-10-20T23:20:04.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 -- 172.21.15.12:0/2342134348 shutdown_connections 2021-10-20T23:20:04.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 --2- 172.21.15.12:0/2342134348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71180ad5c0 0x7f7118061700 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 -- 172.21.15.12:0/2342134348 >> 172.21.15.12:0/2342134348 conn(0x7f7118066de0 msgr2=0x7f71180671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 -- 172.21.15.12:0/2342134348 shutdown_connections 2021-10-20T23:20:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 -- 172.21.15.12:0/2342134348 wait complete. 2021-10-20T23:20:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 Processor -- start 2021-10-20T23:20:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 -- start start 2021-10-20T23:20:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118061320 0x7f71180afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71180ad5c0 0x7f71181523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7118140440 0x7f71181528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7118145e80 con 0x7f7118061320 2021-10-20T23:20:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180b14a0 con 0x7f71180ad5c0 2021-10-20T23:20:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7117fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7118152db0 con 0x7f7118140440 2021-10-20T23:20:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7116ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118061320 0x7f71180afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7116ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118061320 0x7f71180afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36962/0 (socket says 172.21.15.12:36962) 2021-10-20T23:20:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f7116ffd700 1 -- 172.21.15.12:0/238289399 learned_addr learned my addr 172.21.15.12:0/238289399 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f71167fc700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71180ad5c0 0x7f71181523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.673+0000 7f71177fe700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7118140440 0x7f71181528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f7116ffd700 1 -- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7118140440 msgr2=0x7f71181528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f7116ffd700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7118140440 0x7f71181528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f7116ffd700 1 -- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71180ad5c0 msgr2=0x7f71181523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f7116ffd700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71180ad5c0 0x7f71181523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f7116ffd700 1 -- 172.21.15.12:0/238289399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710800b180 con 0x7f7118061320 2021-10-20T23:20:04.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f7116ffd700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118061320 0x7f71180afee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f71180b9550 tx=0x7f7100007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f710ffff700 1 -- 172.21.15.12:0/238289399 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7100012400 con 0x7f7118061320 2021-10-20T23:20:04.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f710ffff700 1 -- 172.21.15.12:0/238289399 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100012560 con 0x7f7118061320 2021-10-20T23:20:04.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71180b0760 con 0x7f7118061320 2021-10-20T23:20:04.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f710ffff700 1 -- 172.21.15.12:0/238289399 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71000128c0 con 0x7f7118061320 2021-10-20T23:20:04.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71180b3e50 con 0x7f7118061320 2021-10-20T23:20:04.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f710ffff700 1 -- 172.21.15.12:0/238289399 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7100010070 con 0x7f7118061320 2021-10-20T23:20:04.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71180b1610 con 0x7f7118061320 2021-10-20T23:20:04.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f710ffff700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70fc0536a0 0x7f70fc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f710ffff700 1 -- 172.21.15.12:0/238289399 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f710006aa70 con 0x7f7118061320 2021-10-20T23:20:04.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.677+0000 7f71167fc700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70fc0536a0 0x7f70fc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.681+0000 7f71167fc700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70fc0536a0 0x7f70fc055b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f710801c000 tx=0x7f7108015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.681+0000 7f710ffff700 1 -- 172.21.15.12:0/238289399 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71000419d0 con 0x7f7118061320 2021-10-20T23:20:04.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f71180af460 con 0x7f7118061320 2021-10-20T23:20:04.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f710ffff700 1 -- 172.21.15.12:0/238289399 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f710006ae60 con 0x7f7118061320 2021-10-20T23:20:04.815 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:04.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70fc0536a0 msgr2=0x7f70fc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70fc0536a0 0x7f70fc055b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f710801c000 tx=0x7f7108015000).stop 2021-10-20T23:20:04.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118061320 msgr2=0x7f71180afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118061320 0x7f71180afee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f71180b9550 tx=0x7f7100007c50).stop 2021-10-20T23:20:04.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 shutdown_connections 2021-10-20T23:20:04.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70fc0536a0 0x7f70fc055b60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7118140440 0x7f71181528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71180ad5c0 0x7f71181523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 --2- 172.21.15.12:0/238289399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118061320 0x7f71180afee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 >> 172.21.15.12:0/238289399 conn(0x7f7118066de0 msgr2=0x7f7118146880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:04.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 shutdown_connections 2021-10-20T23:20:04.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.809+0000 7f7117fff700 1 -- 172.21.15.12:0/238289399 wait complete. 2021-10-20T23:20:04.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2021-10-20T23:20:04.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-10-20T23:20:04.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18f59e700 1 Processor -- start 2021-10-20T23:20:04.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18f59e700 1 -- start start 2021-10-20T23:20:04.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900b0710 0x7fd190142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1900b30d0 0x7fd190143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1900ace70 0x7fd19005f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900b0af0 con 0x7fd1900b30d0 2021-10-20T23:20:04.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900ae680 con 0x7fd1900ace70 2021-10-20T23:20:04.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900ae920 con 0x7fd1900b0710 2021-10-20T23:20:04.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1900b30d0 0x7fd190143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1900b30d0 0x7fd190143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36970/0 (socket says 172.21.15.12:36970) 2021-10-20T23:20:04.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18dd9b700 1 -- 172.21.15.12:0/1660831318 learned_addr learned my addr 172.21.15.12:0/1660831318 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:04.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18ed9d700 1 --2- 172.21.15.12:0/1660831318 >> v2:172.21.15.31:3300/0 conn(0x7fd1900ace70 0x7fd19005f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18e59c700 1 --2- 172.21.15.12:0/1660831318 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900b0710 0x7fd190142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18dd9b700 1 -- 172.21.15.12:0/1660831318 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900b0710 msgr2=0x7fd190142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:04.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18dd9b700 1 --2- 172.21.15.12:0/1660831318 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900b0710 0x7fd190142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18dd9b700 1 -- 172.21.15.12:0/1660831318 >> v2:172.21.15.31:3300/0 conn(0x7fd1900ace70 msgr2=0x7fd19005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:04.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18dd9b700 1 --2- 172.21.15.12:0/1660831318 >> v2:172.21.15.31:3300/0 conn(0x7fd1900ace70 0x7fd19005f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.925+0000 7fd18dd9b700 1 -- 172.21.15.12:0/1660831318 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900aebc0 con 0x7fd1900b30d0 2021-10-20T23:20:04.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18dd9b700 1 --2- 172.21.15.12:0/1660831318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b30d0 0x7fd190143210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fd178002f70 tx=0x7fd178006e40).ready entity=mon.0 client_cookie=b918924993f8b0cc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18d59a700 1 -- 172.21.15.12:0/1660831318 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd17800bb90 con 0x7fd1900b30d0 2021-10-20T23:20:04.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18d59a700 1 -- 172.21.15.12:0/1660831318 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd178000e90 con 0x7fd1900b30d0 2021-10-20T23:20:04.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18d59a700 1 -- 172.21.15.12:0/1660831318 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1780153f0 con 0x7fd1900b30d0 2021-10-20T23:20:04.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 -- 172.21.15.12:0/1660831318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b30d0 msgr2=0x7fd190143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1660831318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b30d0 0x7fd190143210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fd178002f70 tx=0x7fd178006e40).stop 2021-10-20T23:20:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 -- 172.21.15.12:0/1660831318 shutdown_connections 2021-10-20T23:20:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1660831318 >> v2:172.21.15.31:3300/0 conn(0x7fd1900ace70 0x7fd19005f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1660831318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b30d0 0x7fd190143210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1660831318 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900b0710 0x7fd190142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 -- 172.21.15.12:0/1660831318 >> 172.21.15.12:0/1660831318 conn(0x7fd190061140 msgr2=0x7fd190062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:04.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 -- 172.21.15.12:0/1660831318 shutdown_connections 2021-10-20T23:20:04.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 -- 172.21.15.12:0/1660831318 wait complete. 2021-10-20T23:20:04.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 Processor -- start 2021-10-20T23:20:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.929+0000 7fd18f59e700 1 -- start start 2021-10-20T23:20:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900ace70 0x7fd19014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b0710 0x7fd1900b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1900b30d0 0x7fd1900aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900b4620 con 0x7fd1900b0710 2021-10-20T23:20:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1901394b0 con 0x7fd1900b30d0 2021-10-20T23:20:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd190139210 con 0x7fd1900ace70 2021-10-20T23:20:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b0710 0x7fd1900b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b0710 0x7fd1900b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36978/0 (socket says 172.21.15.12:36978) 2021-10-20T23:20:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18dd9b700 1 -- 172.21.15.12:0/1369624367 learned_addr learned my addr 172.21.15.12:0/1369624367 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18e59c700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900ace70 0x7fd19014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18ed9d700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1900b30d0 0x7fd1900aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18dd9b700 1 -- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900ace70 msgr2=0x7fd19014e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18dd9b700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900ace70 0x7fd19014e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18dd9b700 1 -- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1900b30d0 msgr2=0x7fd1900aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18dd9b700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1900b30d0 0x7fd1900aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18dd9b700 1 -- 172.21.15.12:0/1369624367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17800d4d0 con 0x7fd1900b0710 2021-10-20T23:20:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18e59c700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900ace70 0x7fd19014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18dd9b700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b0710 0x7fd1900b5e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd178002f70 tx=0x7fd178018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd1877fe700 1 -- 172.21.15.12:0/1369624367 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd178009030 con 0x7fd1900b0710 2021-10-20T23:20:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd1877fe700 1 -- 172.21.15.12:0/1369624367 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17800a040 con 0x7fd1900b0710 2021-10-20T23:20:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1900b4380 con 0x7fd1900b0710 2021-10-20T23:20:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd1877fe700 1 -- 172.21.15.12:0/1369624367 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd178015b30 con 0x7fd1900b0710 2021-10-20T23:20:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1900b4800 con 0x7fd1900b0710 2021-10-20T23:20:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.933+0000 7fd1877fe700 1 -- 172.21.15.12:0/1369624367 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd178015c90 con 0x7fd1900b0710 2021-10-20T23:20:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.937+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1900a9e40 con 0x7fd1900b0710 2021-10-20T23:20:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.937+0000 7fd1877fe700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd168053520 0x7fd1680559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.937+0000 7fd1877fe700 1 -- 172.21.15.12:0/1369624367 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd17806ca10 con 0x7fd1900b0710 2021-10-20T23:20:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.937+0000 7fd18e59c700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd168053520 0x7fd1680559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.937+0000 7fd18e59c700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd168053520 0x7fd1680559e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd18000b000 tx=0x7fd180006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:04.941+0000 7fd1877fe700 1 -- 172.21.15.12:0/1369624367 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1900a9e40 con 0x7fd1900b0710 2021-10-20T23:20:05.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd1900a9e40 con 0x7fd1900b0710 2021-10-20T23:20:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd1877fe700 1 -- 172.21.15.12:0/1369624367 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1900a9e40 con 0x7fd1900b0710 2021-10-20T23:20:05.071 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:05.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd168053520 msgr2=0x7fd1680559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd168053520 0x7fd1680559e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd18000b000 tx=0x7fd180006df0).stop 2021-10-20T23:20:05.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b0710 msgr2=0x7fd1900b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b0710 0x7fd1900b5e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd178002f70 tx=0x7fd178018000).stop 2021-10-20T23:20:05.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 shutdown_connections 2021-10-20T23:20:05.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd168053520 0x7fd1680559e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1900b30d0 0x7fd1900aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1900b0710 0x7fd1900b5e10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 --2- 172.21.15.12:0/1369624367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1900ace70 0x7fd19014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 >> 172.21.15.12:0/1369624367 conn(0x7fd190061140 msgr2=0x7fd1900a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 shutdown_connections 2021-10-20T23:20:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.065+0000 7fd18f59e700 1 -- 172.21.15.12:0/1369624367 wait complete. 2021-10-20T23:20:05.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2021-10-20T23:20:05.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-10-20T23:20:05.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.185+0000 7fe71359e700 1 Processor -- start 2021-10-20T23:20:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.185+0000 7fe71359e700 1 -- start start 2021-10-20T23:20:05.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 0x7fe7140afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7140add80 con 0x7fe7140b1790 2021-10-20T23:20:05.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7140ae020 con 0x7fe7140b2580 2021-10-20T23:20:05.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140a9390 con 0x7fe7140b1260 2021-10-20T23:20:05.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe712d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe7140b1790 0x7fe71414a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35582/0 (socket says 172.21.15.12:35582) 2021-10-20T23:20:05.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe712d9d700 1 -- 172.21.15.12:0/922967266 learned_addr learned my addr 172.21.15.12:0/922967266 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:05.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe70bfff700 1 --2- 172.21.15.12:0/922967266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 0x7fe7140afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe711d9b700 1 -- 172.21.15.12:0/922967266 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665279281 0 0) 0x7fe7140add80 con 0x7fe7140b1790 2021-10-20T23:20:05.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe711d9b700 1 -- 172.21.15.12:0/922967266 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f8003260 con 0x7fe7140b1790 2021-10-20T23:20:05.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe70bfff700 1 -- 172.21.15.12:0/922967266 >> v1:172.21.15.31:6789/0 conn(0x7fe7140b2580 legacy=0x7fe7140abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe711d9b700 1 -- 172.21.15.12:0/922967266 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192017708 0 0) 0x7fe7140ae020 con 0x7fe7140b2580 2021-10-20T23:20:05.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe70bfff700 1 -- 172.21.15.12:0/922967266 >> v1:172.21.15.12:6789/0 conn(0x7fe7140b1790 legacy=0x7fe71414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe70bfff700 1 -- 172.21.15.12:0/922967266 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7140a9830 con 0x7fe7140b1260 2021-10-20T23:20:05.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe70bfff700 1 --2- 172.21.15.12:0/922967266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 0x7fe7140afbd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe714067a30 tx=0x7fe6fc006df0).ready entity=mon.2 client_cookie=1c20820f43f3e57c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:05.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe711d9b700 1 -- 172.21.15.12:0/922967266 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6fc014070 con 0x7fe7140b1260 2021-10-20T23:20:05.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe711d9b700 1 -- 172.21.15.12:0/922967266 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc000e90 con 0x7fe7140b1260 2021-10-20T23:20:05.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe711d9b700 1 -- 172.21.15.12:0/922967266 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6fc00fbb0 con 0x7fe7140b1260 2021-10-20T23:20:05.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 -- 172.21.15.12:0/922967266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 msgr2=0x7fe7140afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 --2- 172.21.15.12:0/922967266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 0x7fe7140afbd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe714067a30 tx=0x7fe6fc006df0).stop 2021-10-20T23:20:05.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 -- 172.21.15.12:0/922967266 shutdown_connections 2021-10-20T23:20:05.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 --2- 172.21.15.12:0/922967266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 0x7fe7140afbd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 -- 172.21.15.12:0/922967266 >> 172.21.15.12:0/922967266 conn(0x7fe714060180 msgr2=0x7fe7140b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:05.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 -- 172.21.15.12:0/922967266 shutdown_connections 2021-10-20T23:20:05.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.189+0000 7fe71359e700 1 -- 172.21.15.12:0/922967266 wait complete. 2021-10-20T23:20:05.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 Processor -- start 2021-10-20T23:20:05.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 -- start start 2021-10-20T23:20:05.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 0x7fe714143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7140b1790 0x7fe714065110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7140b2580 0x7fe714065600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140a1940 con 0x7fe7140b2580 2021-10-20T23:20:05.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71409ec30 con 0x7fe7140b1790 2021-10-20T23:20:05.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71409f2c0 con 0x7fe7140b1260 2021-10-20T23:20:05.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe712d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7140b2580 0x7fe714065600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe712d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7140b2580 0x7fe714065600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36994/0 (socket says 172.21.15.12:36994) 2021-10-20T23:20:05.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe712d9d700 1 -- 172.21.15.12:0/3914700397 learned_addr learned my addr 172.21.15.12:0/3914700397 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:05.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71259c700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 0x7fe714143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe70bfff700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7140b1790 0x7fe714065110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe712d9d700 1 -- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 msgr2=0x7fe714143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe712d9d700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 0x7fe714143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe712d9d700 1 -- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7140b1790 msgr2=0x7fe714065110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe712d9d700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7140b1790 0x7fe714065110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe712d9d700 1 -- 172.21.15.12:0/3914700397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc00b180 con 0x7fe7140b2580 2021-10-20T23:20:05.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe712d9d700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7140b2580 0x7fe714065600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fe7140a8cf0 tx=0x7fe70c007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:05.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe70b7fe700 1 -- 172.21.15.12:0/3914700397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70c00ce90 con 0x7fe7140b2580 2021-10-20T23:20:05.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe70b7fe700 1 -- 172.21.15.12:0/3914700397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c005ba0 con 0x7fe7140b2580 2021-10-20T23:20:05.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71409fe50 con 0x7fe7140b2580 2021-10-20T23:20:05.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe70b7fe700 1 -- 172.21.15.12:0/3914700397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70c0070d0 con 0x7fe7140b2580 2021-10-20T23:20:05.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.193+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7140a0e50 con 0x7fe7140b2580 2021-10-20T23:20:05.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.197+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71409f400 con 0x7fe7140b2580 2021-10-20T23:20:05.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.197+0000 7fe70b7fe700 1 -- 172.21.15.12:0/3914700397 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe70c010070 con 0x7fe7140b2580 2021-10-20T23:20:05.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.197+0000 7fe70b7fe700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6ec0534f0 0x7fe6ec0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.197+0000 7fe70b7fe700 1 -- 172.21.15.12:0/3914700397 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe70c06b340 con 0x7fe7140b2580 2021-10-20T23:20:05.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.197+0000 7fe71259c700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6ec0534f0 0x7fe6ec0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.197+0000 7fe71259c700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6ec0534f0 0x7fe6ec0559b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe70400d000 tx=0x7fe704007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:05.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.201+0000 7fe70b7fe700 1 -- 172.21.15.12:0/3914700397 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe70c0422a0 con 0x7fe7140b2580 2021-10-20T23:20:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe714057350 con 0x7fe7140b2580 2021-10-20T23:20:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe70b7fe700 1 -- 172.21.15.12:0/3914700397 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe70c018020 con 0x7fe7140b2580 2021-10-20T23:20:05.335 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6ec0534f0 msgr2=0x7fe6ec0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6ec0534f0 0x7fe6ec0559b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe70400d000 tx=0x7fe704007a00).stop 2021-10-20T23:20:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7140b2580 msgr2=0x7fe714065600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7140b2580 0x7fe714065600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fe7140a8cf0 tx=0x7fe70c007d60).stop 2021-10-20T23:20:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 shutdown_connections 2021-10-20T23:20:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6ec0534f0 0x7fe6ec0559b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7140b2580 0x7fe714065600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7140b1790 0x7fe714065110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 --2- 172.21.15.12:0/3914700397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7140b1260 0x7fe714143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 >> 172.21.15.12:0/3914700397 conn(0x7fe714060180 msgr2=0x7fe7140b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 shutdown_connections 2021-10-20T23:20:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.329+0000 7fe71359e700 1 -- 172.21.15.12:0/3914700397 wait complete. 2021-10-20T23:20:05.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2021-10-20T23:20:05.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-10-20T23:20:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.445+0000 7f54340dc700 1 Processor -- start 2021-10-20T23:20:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.445+0000 7f54340dc700 1 -- start start 2021-10-20T23:20:05.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f542c061650 0x7f542c0665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c0604e0 con 0x7f542c060100 2021-10-20T23:20:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c060c70 con 0x7f542c066ac0 2021-10-20T23:20:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c060f10 con 0x7f542c061650 2021-10-20T23:20:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5431e78700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f542c060100 0x7f542c065970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35592/0 (socket says 172.21.15.12:35592) 2021-10-20T23:20:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5431e78700 1 -- 172.21.15.12:0/3765448053 learned_addr learned my addr 172.21.15.12:0/3765448053 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5431677700 1 --2- 172.21.15.12:0/3765448053 >> v2:172.21.15.31:3300/0 conn(0x7f542c061650 0x7f542c0665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5430e76700 1 -- 172.21.15.12:0/3765448053 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232661479 0 0) 0x7f542c0604e0 con 0x7f542c060100 2021-10-20T23:20:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5430e76700 1 -- 172.21.15.12:0/3765448053 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5414003260 con 0x7f542c060100 2021-10-20T23:20:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5431677700 1 -- 172.21.15.12:0/3765448053 >> v1:172.21.15.31:6789/0 conn(0x7f542c066ac0 legacy=0x7f542c14d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5431677700 1 -- 172.21.15.12:0/3765448053 >> v1:172.21.15.12:6789/0 conn(0x7f542c060100 legacy=0x7f542c065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5431677700 1 -- 172.21.15.12:0/3765448053 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0611b0 con 0x7f542c061650 2021-10-20T23:20:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5431677700 1 --2- 172.21.15.12:0/3765448053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f542c061650 0x7f542c0665d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f541c002f70 tx=0x7f541c006df0).ready entity=mon.1 client_cookie=905935b6e0488b82 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5430e76700 1 -- 172.21.15.12:0/3765448053 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541c00d610 con 0x7f542c061650 2021-10-20T23:20:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5430e76700 1 -- 172.21.15.12:0/3765448053 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c000e90 con 0x7f542c061650 2021-10-20T23:20:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f5430e76700 1 -- 172.21.15.12:0/3765448053 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541c00d960 con 0x7f542c061650 2021-10-20T23:20:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 -- 172.21.15.12:0/3765448053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f542c061650 msgr2=0x7f542c0665d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 --2- 172.21.15.12:0/3765448053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f542c061650 0x7f542c0665d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f541c002f70 tx=0x7f541c006df0).stop 2021-10-20T23:20:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 -- 172.21.15.12:0/3765448053 shutdown_connections 2021-10-20T23:20:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 --2- 172.21.15.12:0/3765448053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f542c061650 0x7f542c0665d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 -- 172.21.15.12:0/3765448053 >> 172.21.15.12:0/3765448053 conn(0x7f542c05cf30 msgr2=0x7f542c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 -- 172.21.15.12:0/3765448053 shutdown_connections 2021-10-20T23:20:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.449+0000 7f54340dc700 1 -- 172.21.15.12:0/3765448053 wait complete. 2021-10-20T23:20:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 Processor -- start 2021-10-20T23:20:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 -- start start 2021-10-20T23:20:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f542c060100 0x7f542c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f542c061650 0x7f542c0b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c066ac0 0x7f542c0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0a43f0 con 0x7f542c066ac0 2021-10-20T23:20:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0a4690 con 0x7f542c061650 2021-10-20T23:20:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0a4930 con 0x7f542c060100 2021-10-20T23:20:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5432679700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c066ac0 0x7f542c0b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5432679700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c066ac0 0x7f542c0b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37008/0 (socket says 172.21.15.12:37008) 2021-10-20T23:20:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5432679700 1 -- 172.21.15.12:0/2475215616 learned_addr learned my addr 172.21.15.12:0/2475215616 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:05.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5431677700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f542c061650 0x7f542c0b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5431e78700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f542c060100 0x7f542c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5432679700 1 -- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f542c060100 msgr2=0x7f542c0b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5432679700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f542c060100 0x7f542c0b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5432679700 1 -- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f542c061650 msgr2=0x7f542c0b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5432679700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f542c061650 0x7f542c0b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5432679700 1 -- 172.21.15.12:0/2475215616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c00b180 con 0x7f542c066ac0 2021-10-20T23:20:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5431e78700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f542c060100 0x7f542c0b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f5432679700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c066ac0 0x7f542c0b0820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f542c063e70 tx=0x7f54240013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f541affd700 1 -- 172.21.15.12:0/2475215616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5424006aa0 con 0x7f542c066ac0 2021-10-20T23:20:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c0a4dd0 con 0x7f542c066ac0 2021-10-20T23:20:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f541affd700 1 -- 172.21.15.12:0/2475215616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424006c00 con 0x7f542c066ac0 2021-10-20T23:20:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f541affd700 1 -- 172.21.15.12:0/2475215616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5424007030 con 0x7f542c066ac0 2021-10-20T23:20:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.453+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c1533b0 con 0x7f542c066ac0 2021-10-20T23:20:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.457+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c0a4af0 con 0x7f542c066ac0 2021-10-20T23:20:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.457+0000 7f541affd700 1 -- 172.21.15.12:0/2475215616 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5424010030 con 0x7f542c066ac0 2021-10-20T23:20:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.457+0000 7f541affd700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f540c053610 0x7f540c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.457+0000 7f541affd700 1 -- 172.21.15.12:0/2475215616 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f542406ba10 con 0x7f542c066ac0 2021-10-20T23:20:05.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.457+0000 7f5431e78700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f540c053610 0x7f540c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.457+0000 7f5431e78700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f540c053610 0x7f540c055ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f542800b000 tx=0x7f5428009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:05.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.465+0000 7f541affd700 1 -- 172.21.15.12:0/2475215616 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5424042970 con 0x7f542c066ac0 2021-10-20T23:20:05.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f542c057350 con 0x7f542c066ac0 2021-10-20T23:20:05.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f541affd700 1 -- 172.21.15.12:0/2475215616 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5424045f90 con 0x7f542c066ac0 2021-10-20T23:20:05.603 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2021-10-20T23:20:05.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f540c053610 msgr2=0x7f540c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f540c053610 0x7f540c055ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f542800b000 tx=0x7f5428009040).stop 2021-10-20T23:20:05.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c066ac0 msgr2=0x7f542c0b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c066ac0 0x7f542c0b0820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f542c063e70 tx=0x7f54240013a0).stop 2021-10-20T23:20:05.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 shutdown_connections 2021-10-20T23:20:05.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f540c053610 0x7f540c055ad0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c066ac0 0x7f542c0b0820 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f542c061650 0x7f542c0b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 --2- 172.21.15.12:0/2475215616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f542c060100 0x7f542c0b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 >> 172.21.15.12:0/2475215616 conn(0x7f542c05cf30 msgr2=0x7f542c148190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:05.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 shutdown_connections 2021-10-20T23:20:05.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.598+0000 7f54340dc700 1 -- 172.21.15.12:0/2475215616 wait complete. 2021-10-20T23:20:05.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2021-10-20T23:20:05.616 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-10-20T23:20:05.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-20T23:20:05.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.718+0000 7fba722a2700 1 Processor -- start 2021-10-20T23:20:05.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.718+0000 7fba722a2700 1 -- start start 2021-10-20T23:20:05.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.718+0000 7fba722a2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b0010 0x7fba6c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.718+0000 7fba722a2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fba6c0afbd0 0x7fba6c0a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.718+0000 7fba722a2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6c0a70c0 con 0x7fba6c0b2580 2021-10-20T23:20:05.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.718+0000 7fba722a2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6c0a72f0 con 0x7fba6c0afbd0 2021-10-20T23:20:05.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.718+0000 7fba722a2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c0a7590 con 0x7fba6c0b0010 2021-10-20T23:20:05.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba71aa1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fba6c0afbd0 0x7fba6c0a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba71aa1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fba6c0afbd0 0x7fba6c0a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37016/0 (socket says 172.21.15.12:37016) 2021-10-20T23:20:05.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba71aa1700 1 -- 172.21.15.12:0/1502680314 learned_addr learned my addr 172.21.15.12:0/1502680314 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:05.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba712a0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fba6c0b2580 0x7fba6c14ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35606/0 (socket says 172.21.15.12:35606) 2021-10-20T23:20:05.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba70a9f700 1 --2- 172.21.15.12:0/1502680314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b0010 0x7fba6c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba71aa1700 1 -- 172.21.15.12:0/1502680314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b0010 msgr2=0x7fba6c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:05.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba71aa1700 1 --2- 172.21.15.12:0/1502680314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b0010 0x7fba6c0a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba71aa1700 1 -- 172.21.15.12:0/1502680314 >> v1:172.21.15.12:6789/0 conn(0x7fba6c0b2580 legacy=0x7fba6c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba63fff700 1 -- 172.21.15.12:0/1502680314 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243553341 0 0) 0x7fba6c0a70c0 con 0x7fba6c0b2580 2021-10-20T23:20:05.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba71aa1700 1 -- 172.21.15.12:0/1502680314 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c0a7830 con 0x7fba6c0afbd0 2021-10-20T23:20:05.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba71aa1700 1 --2- 172.21.15.12:0/1502680314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 0x7fba6c0a88a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fba640032f0 tx=0x7fba64009290).ready entity=mon.0 client_cookie=ddb0a142f7975a41 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:05.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba63fff700 1 -- 172.21.15.12:0/1502680314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6400b8a0 con 0x7fba6c0afbd0 2021-10-20T23:20:05.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba63fff700 1 -- 172.21.15.12:0/1502680314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6400ba00 con 0x7fba6c0afbd0 2021-10-20T23:20:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba63fff700 1 -- 172.21.15.12:0/1502680314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6400bb70 con 0x7fba6c0afbd0 2021-10-20T23:20:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba722a2700 1 -- 172.21.15.12:0/1502680314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 msgr2=0x7fba6c0a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba722a2700 1 --2- 172.21.15.12:0/1502680314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 0x7fba6c0a88a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fba640032f0 tx=0x7fba64009290).stop 2021-10-20T23:20:05.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba722a2700 1 -- 172.21.15.12:0/1502680314 shutdown_connections 2021-10-20T23:20:05.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba722a2700 1 --2- 172.21.15.12:0/1502680314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 0x7fba6c0a88a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba722a2700 1 --2- 172.21.15.12:0/1502680314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b0010 0x7fba6c0a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba722a2700 1 -- 172.21.15.12:0/1502680314 >> 172.21.15.12:0/1502680314 conn(0x7fba6c060180 msgr2=0x7fba6c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:05.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba722a2700 1 -- 172.21.15.12:0/1502680314 shutdown_connections 2021-10-20T23:20:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.722+0000 7fba722a2700 1 -- 172.21.15.12:0/1502680314 wait complete. 2021-10-20T23:20:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba722a2700 1 Processor -- start 2021-10-20T23:20:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba722a2700 1 -- start start 2021-10-20T23:20:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba722a2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 0x7fba6c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba722a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba6c0b0010 0x7fba6c0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba722a2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b2580 0x7fba6c14a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba722a2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c0aba90 con 0x7fba6c0afbd0 2021-10-20T23:20:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba722a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c15a200 con 0x7fba6c0b0010 2021-10-20T23:20:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba722a2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c15a4a0 con 0x7fba6c0b2580 2021-10-20T23:20:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba712a0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 0x7fba6c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba712a0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 0x7fba6c159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37018/0 (socket says 172.21.15.12:37018) 2021-10-20T23:20:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba712a0700 1 -- 172.21.15.12:0/1131437086 learned_addr learned my addr 172.21.15.12:0/1131437086 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba71aa1700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b2580 0x7fba6c14a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba70a9f700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba6c0b0010 0x7fba6c0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba712a0700 1 -- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b2580 msgr2=0x7fba6c14a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba712a0700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b2580 0x7fba6c14a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba712a0700 1 -- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba6c0b0010 msgr2=0x7fba6c0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba712a0700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba6c0b0010 0x7fba6c0b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.726+0000 7fba712a0700 1 -- 172.21.15.12:0/1131437086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba64009530 con 0x7fba6c0afbd0 2021-10-20T23:20:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba712a0700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 0x7fba6c159b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fba5c000ed0 tx=0x7fba5c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba627fc700 1 -- 172.21.15.12:0/1131437086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba5c0070d0 con 0x7fba6c0afbd0 2021-10-20T23:20:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba627fc700 1 -- 172.21.15.12:0/1131437086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c007230 con 0x7fba6c0afbd0 2021-10-20T23:20:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6c0b4890 con 0x7fba6c0afbd0 2021-10-20T23:20:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba627fc700 1 -- 172.21.15.12:0/1131437086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba5c005550 con 0x7fba6c0afbd0 2021-10-20T23:20:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c0b2e60 con 0x7fba6c0afbd0 2021-10-20T23:20:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6c15a040 con 0x7fba6c0afbd0 2021-10-20T23:20:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba627fc700 1 -- 172.21.15.12:0/1131437086 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fba5c01a060 con 0x7fba6c0afbd0 2021-10-20T23:20:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba627fc700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fba54053610 0x7fba54055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba627fc700 1 -- 172.21.15.12:0/1131437086 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fba5c06b190 con 0x7fba6c0afbd0 2021-10-20T23:20:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.730+0000 7fba70a9f700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fba54053610 0x7fba54055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.734+0000 7fba70a9f700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fba54053610 0x7fba54055ad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fba6800b000 tx=0x7fba68006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:05.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.738+0000 7fba627fc700 1 -- 172.21.15.12:0/1131437086 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba5c042190 con 0x7fba6c0afbd0 2021-10-20T23:20:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.862+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba6c15a670 con 0x7fba54053610 2021-10-20T23:20:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.870+0000 7fba627fc700 1 -- 172.21.15.12:0/1131437086 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82350 (secure 0 0 0) 0x7fba6c15a670 con 0x7fba54053610 2021-10-20T23:20:05.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fba54053610 msgr2=0x7fba54055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fba54053610 0x7fba54055ad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fba6800b000 tx=0x7fba68006df0).stop 2021-10-20T23:20:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 msgr2=0x7fba6c159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 0x7fba6c159b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fba5c000ed0 tx=0x7fba5c007c80).stop 2021-10-20T23:20:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 shutdown_connections 2021-10-20T23:20:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fba54053610 0x7fba54055ad0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fba6c0b2580 0x7fba6c14a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba6c0b0010 0x7fba6c0b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 --2- 172.21.15.12:0/1131437086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba6c0afbd0 0x7fba6c159b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:05.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 >> 172.21.15.12:0/1131437086 conn(0x7fba6c060180 msgr2=0x7fba6c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:05.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 shutdown_connections 2021-10-20T23:20:05.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.874+0000 7fba722a2700 1 -- 172.21.15.12:0/1131437086 wait complete. 2021-10-20T23:20:05.883 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2021-10-20T23:20:05.892 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2021-10-20T23:20:03.964693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390784,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583936,"statfs":{"total":773094113280,"available":764501950464,"internally_reserved":8589934592,"allocated":2162688,"data_stored":828856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002502"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.290989+0000","last_change":"2021-10-20T23:19:56.287991+0000","last_active":"2021-10-20T23:19:56.290989+0000","last_peered":"2021-10-20T23:19:56.290989+0000","last_clean":"2021-10-20T23:19:56.290989+0000","last_became_active":"2021-10-20T23:19:56.287315+0000","last_became_peered":"2021-10-20T23:19:56.287315+0000","last_unstale":"2021-10-20T23:19:56.290989+0000","last_undegraded":"2021-10-20T23:19:56.290989+0000","last_fullsized":"2021-10-20T23:19:56.290989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.281373+0000","last_change":"2021-10-20T23:19:45.232100+0000","last_active":"2021-10-20T23:19:56.281373+0000","last_peered":"2021-10-20T23:19:56.281373+0000","last_clean":"2021-10-20T23:19:56.281373+0000","last_became_active":"2021-10-20T23:19:45.231374+0000","last_became_peered":"2021-10-20T23:19:45.231374+0000","last_unstale":"2021-10-20T23:19:56.281373+0000","last_undegraded":"2021-10-20T23:19:56.281373+0000","last_fullsized":"2021-10-20T23:19:56.281373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:40.954153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:40.954153+0000","last_clean_scrub_stamp":"2021-10-20T23:19:40.954153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.197140+0000","last_change":"2021-10-20T23:19:50.050604+0000","last_active":"2021-10-20T23:19:56.197140+0000","last_peered":"2021-10-20T23:19:56.197140+0000","last_clean":"2021-10-20T23:19:56.197140+0000","last_became_active":"2021-10-20T23:19:50.050295+0000","last_became_peered":"2021-10-20T23:19:50.050295+0000","last_unstale":"2021-10-20T23:19:56.197140+0000","last_undegraded":"2021-10-20T23:19:56.197140+0000","last_fullsized":"2021-10-20T23:19:56.197140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.516397+0000","last_change":"2021-10-20T23:19:53.176236+0000","last_active":"2021-10-20T23:19:56.516397+0000","last_peered":"2021-10-20T23:19:56.516397+0000","last_clean":"2021-10-20T23:19:56.516397+0000","last_became_active":"2021-10-20T23:19:53.175767+0000","last_became_peered":"2021-10-20T23:19:53.175767+0000","last_unstale":"2021-10-20T23:19:56.516397+0000","last_undegraded":"2021-10-20T23:19:56.516397+0000","last_fullsized":"2021-10-20T23:19:56.516397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.290993+0000","last_change":"2021-10-20T23:19:56.285470+0000","last_active":"2021-10-20T23:19:56.290993+0000","last_peered":"2021-10-20T23:19:56.290993+0000","last_clean":"2021-10-20T23:19:56.290993+0000","last_became_active":"2021-10-20T23:19:56.282928+0000","last_became_peered":"2021-10-20T23:19:56.282928+0000","last_unstale":"2021-10-20T23:19:56.290993+0000","last_undegraded":"2021-10-20T23:19:56.290993+0000","last_fullsized":"2021-10-20T23:19:56.290993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.281031+0000","last_change":"2021-10-20T23:19:50.051597+0000","last_active":"2021-10-20T23:19:56.281031+0000","last_peered":"2021-10-20T23:19:56.281031+0000","last_clean":"2021-10-20T23:19:56.281031+0000","last_became_active":"2021-10-20T23:19:50.051189+0000","last_became_peered":"2021-10-20T23:19:50.051189+0000","last_unstale":"2021-10-20T23:19:56.281031+0000","last_undegraded":"2021-10-20T23:19:56.281031+0000","last_fullsized":"2021-10-20T23:19:56.281031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.203797+0000","last_change":"2021-10-20T23:19:53.179898+0000","last_active":"2021-10-20T23:19:56.203797+0000","last_peered":"2021-10-20T23:19:56.203797+0000","last_clean":"2021-10-20T23:19:56.203797+0000","last_became_active":"2021-10-20T23:19:53.179345+0000","last_became_peered":"2021-10-20T23:19:53.179345+0000","last_unstale":"2021-10-20T23:19:56.203797+0000","last_undegraded":"2021-10-20T23:19:56.203797+0000","last_fullsized":"2021-10-20T23:19:56.203797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.210511+0000","last_change":"2021-10-20T23:19:56.206831+0000","last_active":"2021-10-20T23:19:56.210511+0000","last_peered":"2021-10-20T23:19:56.210511+0000","last_clean":"2021-10-20T23:19:56.210511+0000","last_became_active":"2021-10-20T23:19:56.206221+0000","last_became_peered":"2021-10-20T23:19:56.206221+0000","last_unstale":"2021-10-20T23:19:56.210511+0000","last_undegraded":"2021-10-20T23:19:56.210511+0000","last_fullsized":"2021-10-20T23:19:56.210511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.277342+0000","last_change":"2021-10-20T23:19:50.050317+0000","last_active":"2021-10-20T23:19:56.277342+0000","last_peered":"2021-10-20T23:19:56.277342+0000","last_clean":"2021-10-20T23:19:56.277342+0000","last_became_active":"2021-10-20T23:19:50.049970+0000","last_became_peered":"2021-10-20T23:19:50.049970+0000","last_unstale":"2021-10-20T23:19:56.277342+0000","last_undegraded":"2021-10-20T23:19:56.277342+0000","last_fullsized":"2021-10-20T23:19:56.277342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.535164+0000","last_change":"2021-10-20T23:19:53.173049+0000","last_active":"2021-10-20T23:19:56.535164+0000","last_peered":"2021-10-20T23:19:56.535164+0000","last_clean":"2021-10-20T23:19:56.535164+0000","last_became_active":"2021-10-20T23:19:53.172681+0000","last_became_peered":"2021-10-20T23:19:53.172681+0000","last_unstale":"2021-10-20T23:19:56.535164+0000","last_undegraded":"2021-10-20T23:19:56.535164+0000","last_fullsized":"2021-10-20T23:19:56.535164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.288048+0000","last_change":"2021-10-20T23:19:56.283665+0000","last_active":"2021-10-20T23:19:56.288048+0000","last_peered":"2021-10-20T23:19:56.288048+0000","last_clean":"2021-10-20T23:19:56.288048+0000","last_became_active":"2021-10-20T23:19:56.282177+0000","last_became_peered":"2021-10-20T23:19:56.282177+0000","last_unstale":"2021-10-20T23:19:56.288048+0000","last_undegraded":"2021-10-20T23:19:56.288048+0000","last_fullsized":"2021-10-20T23:19:56.288048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.197201+0000","last_change":"2021-10-20T23:19:50.052800+0000","last_active":"2021-10-20T23:19:56.197201+0000","last_peered":"2021-10-20T23:19:56.197201+0000","last_clean":"2021-10-20T23:19:56.197201+0000","last_became_active":"2021-10-20T23:19:50.052290+0000","last_became_peered":"2021-10-20T23:19:50.052290+0000","last_unstale":"2021-10-20T23:19:56.197201+0000","last_undegraded":"2021-10-20T23:19:56.197201+0000","last_fullsized":"2021-10-20T23:19:56.197201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'5","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.532864+0000","last_change":"2021-10-20T23:19:53.180031+0000","last_active":"2021-10-20T23:19:56.532864+0000","last_peered":"2021-10-20T23:19:56.532864+0000","last_clean":"2021-10-20T23:19:56.532864+0000","last_became_active":"2021-10-20T23:19:53.179606+0000","last_became_peered":"2021-10-20T23:19:53.179606+0000","last_unstale":"2021-10-20T23:19:56.532864+0000","last_undegraded":"2021-10-20T23:19:56.532864+0000","last_fullsized":"2021-10-20T23:19:56.532864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.210551+0000","last_change":"2021-10-20T23:19:56.207152+0000","last_active":"2021-10-20T23:19:56.210551+0000","last_peered":"2021-10-20T23:19:56.210551+0000","last_clean":"2021-10-20T23:19:56.210551+0000","last_became_active":"2021-10-20T23:19:56.206346+0000","last_became_peered":"2021-10-20T23:19:56.206346+0000","last_unstale":"2021-10-20T23:19:56.210551+0000","last_undegraded":"2021-10-20T23:19:56.210551+0000","last_fullsized":"2021-10-20T23:19:56.210551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'6","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.535815+0000","last_change":"2021-10-20T23:19:53.180572+0000","last_active":"2021-10-20T23:19:56.535815+0000","last_peered":"2021-10-20T23:19:56.535815+0000","last_clean":"2021-10-20T23:19:56.535815+0000","last_became_active":"2021-10-20T23:19:53.179718+0000","last_became_peered":"2021-10-20T23:19:53.179718+0000","last_unstale":"2021-10-20T23:19:56.535815+0000","last_undegraded":"2021-10-20T23:19:56.535815+0000","last_fullsized":"2021-10-20T23:19:56.535815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.198325+0000","last_change":"2021-10-20T23:19:50.196425+0000","last_active":"2021-10-20T23:19:56.198325+0000","last_peered":"2021-10-20T23:19:56.198325+0000","last_clean":"2021-10-20T23:19:56.198325+0000","last_became_active":"2021-10-20T23:19:50.195815+0000","last_became_peered":"2021-10-20T23:19:50.195815+0000","last_unstale":"2021-10-20T23:19:56.198325+0000","last_undegraded":"2021-10-20T23:19:56.198325+0000","last_fullsized":"2021-10-20T23:19:56.198325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.290996+0000","last_change":"2021-10-20T23:19:56.285549+0000","last_active":"2021-10-20T23:19:56.290996+0000","last_peered":"2021-10-20T23:19:56.290996+0000","last_clean":"2021-10-20T23:19:56.290996+0000","last_became_active":"2021-10-20T23:19:56.282936+0000","last_became_peered":"2021-10-20T23:19:56.282936+0000","last_unstale":"2021-10-20T23:19:56.290996+0000","last_undegraded":"2021-10-20T23:19:56.290996+0000","last_fullsized":"2021-10-20T23:19:56.290996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"25'8","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.535244+0000","last_change":"2021-10-20T23:19:53.173985+0000","last_active":"2021-10-20T23:19:56.535244+0000","last_peered":"2021-10-20T23:19:56.535244+0000","last_clean":"2021-10-20T23:19:56.535244+0000","last_became_active":"2021-10-20T23:19:53.173490+0000","last_became_peered":"2021-10-20T23:19:53.173490+0000","last_unstale":"2021-10-20T23:19:56.535244+0000","last_undegraded":"2021-10-20T23:19:56.535244+0000","last_fullsized":"2021-10-20T23:19:56.535244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.281510+0000","last_change":"2021-10-20T23:19:50.200005+0000","last_active":"2021-10-20T23:19:56.281510+0000","last_peered":"2021-10-20T23:19:56.281510+0000","last_clean":"2021-10-20T23:19:56.281510+0000","last_became_active":"2021-10-20T23:19:50.198735+0000","last_became_peered":"2021-10-20T23:19:50.198735+0000","last_unstale":"2021-10-20T23:19:56.281510+0000","last_undegraded":"2021-10-20T23:19:56.281510+0000","last_fullsized":"2021-10-20T23:19:56.281510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.285642+0000","last_change":"2021-10-20T23:19:56.282687+0000","last_active":"2021-10-20T23:19:56.285642+0000","last_peered":"2021-10-20T23:19:56.285642+0000","last_clean":"2021-10-20T23:19:56.285642+0000","last_became_active":"2021-10-20T23:19:56.281783+0000","last_became_peered":"2021-10-20T23:19:56.281783+0000","last_unstale":"2021-10-20T23:19:56.285642+0000","last_undegraded":"2021-10-20T23:19:56.285642+0000","last_fullsized":"2021-10-20T23:19:56.285642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.527172+0000","last_change":"2021-10-20T23:19:53.202291+0000","last_active":"2021-10-20T23:19:56.527172+0000","last_peered":"2021-10-20T23:19:56.527172+0000","last_clean":"2021-10-20T23:19:56.527172+0000","last_became_active":"2021-10-20T23:19:53.201739+0000","last_became_peered":"2021-10-20T23:19:53.201739+0000","last_unstale":"2021-10-20T23:19:56.527172+0000","last_undegraded":"2021-10-20T23:19:56.527172+0000","last_fullsized":"2021-10-20T23:19:56.527172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.197956+0000","last_change":"2021-10-20T23:19:50.047617+0000","last_active":"2021-10-20T23:19:56.197956+0000","last_peered":"2021-10-20T23:19:56.197956+0000","last_clean":"2021-10-20T23:19:56.197956+0000","last_became_active":"2021-10-20T23:19:50.046787+0000","last_became_peered":"2021-10-20T23:19:50.046787+0000","last_unstale":"2021-10-20T23:19:56.197956+0000","last_undegraded":"2021-10-20T23:19:56.197956+0000","last_fullsized":"2021-10-20T23:19:56.197956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.288068+0000","last_change":"2021-10-20T23:19:56.285901+0000","last_active":"2021-10-20T23:19:56.288068+0000","last_peered":"2021-10-20T23:19:56.288068+0000","last_clean":"2021-10-20T23:19:56.288068+0000","last_became_active":"2021-10-20T23:19:56.284413+0000","last_became_peered":"2021-10-20T23:19:56.284413+0000","last_unstale":"2021-10-20T23:19:56.288068+0000","last_undegraded":"2021-10-20T23:19:56.288068+0000","last_fullsized":"2021-10-20T23:19:56.288068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"25'4","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.535776+0000","last_change":"2021-10-20T23:19:53.178971+0000","last_active":"2021-10-20T23:19:56.535776+0000","last_peered":"2021-10-20T23:19:56.535776+0000","last_clean":"2021-10-20T23:19:56.535776+0000","last_became_active":"2021-10-20T23:19:53.178634+0000","last_became_peered":"2021-10-20T23:19:53.178634+0000","last_unstale":"2021-10-20T23:19:56.535776+0000","last_undegraded":"2021-10-20T23:19:56.535776+0000","last_fullsized":"2021-10-20T23:19:56.535776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.202684+0000","last_change":"2021-10-20T23:19:50.049986+0000","last_active":"2021-10-20T23:19:56.202684+0000","last_peered":"2021-10-20T23:19:56.202684+0000","last_clean":"2021-10-20T23:19:56.202684+0000","last_became_active":"2021-10-20T23:19:50.049434+0000","last_became_peered":"2021-10-20T23:19:50.049434+0000","last_unstale":"2021-10-20T23:19:56.202684+0000","last_undegraded":"2021-10-20T23:19:56.202684+0000","last_fullsized":"2021-10-20T23:19:56.202684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":103606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":103031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":103191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":103766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":104566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":104566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]}]}} 2021-10-20T23:20:05.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-20T23:20:05.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a60ee4700 1 Processor -- start 2021-10-20T23:20:05.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a60ee4700 1 -- start start 2021-10-20T23:20:06.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a60ee4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a5c0b1db0 0x7f4a5c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a60ee4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 0x7f4a5c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a60ee4700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c0b0350 con 0x7f4a5c1483a0 2021-10-20T23:20:06.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a60ee4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c0a90c0 con 0x7f4a5c0b1db0 2021-10-20T23:20:06.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a60ee4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0b05f0 con 0x7f4a5c0a70c0 2021-10-20T23:20:06.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a59d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a5c1483a0 0x7f4a5c0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35620/0 (socket says 172.21.15.12:35620) 2021-10-20T23:20:06.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a59d9b700 1 -- 172.21.15.12:0/3089811505 learned_addr learned my addr 172.21.15.12:0/3089811505 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:06.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5a59c700 1 --2- 172.21.15.12:0/3089811505 >> v2:172.21.15.12:3300/0 conn(0x7f4a5c0b1db0 0x7f4a5c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5ad9d700 1 --2- 172.21.15.12:0/3089811505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 0x7f4a5c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5a59c700 1 -- 172.21.15.12:0/3089811505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 msgr2=0x7f4a5c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:06.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5a59c700 1 --2- 172.21.15.12:0/3089811505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 0x7f4a5c144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5a59c700 1 -- 172.21.15.12:0/3089811505 >> v1:172.21.15.12:6789/0 conn(0x7f4a5c1483a0 legacy=0x7f4a5c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5a59c700 1 -- 172.21.15.12:0/3089811505 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c0b0890 con 0x7f4a5c0b1db0 2021-10-20T23:20:06.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5a59c700 1 --2- 172.21.15.12:0/3089811505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c0b1db0 0x7f4a5c0b0fd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4a5c147730 tx=0x7f4a4c006df0).ready entity=mon.0 client_cookie=73f2e4c6cf49b5b4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5959a700 1 -- 172.21.15.12:0/3089811505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4c00d570 con 0x7f4a5c0b1db0 2021-10-20T23:20:06.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5959a700 1 -- 172.21.15.12:0/3089811505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c000e90 con 0x7f4a5c0b1db0 2021-10-20T23:20:06.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.994+0000 7f4a5959a700 1 -- 172.21.15.12:0/3089811505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4c00d8c0 con 0x7f4a5c0b1db0 2021-10-20T23:20:06.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 -- 172.21.15.12:0/3089811505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c0b1db0 msgr2=0x7f4a5c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 --2- 172.21.15.12:0/3089811505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c0b1db0 0x7f4a5c0b0fd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4a5c147730 tx=0x7f4a4c006df0).stop 2021-10-20T23:20:06.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 -- 172.21.15.12:0/3089811505 shutdown_connections 2021-10-20T23:20:06.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 --2- 172.21.15.12:0/3089811505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 0x7f4a5c144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 --2- 172.21.15.12:0/3089811505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c0b1db0 0x7f4a5c0b0fd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 -- 172.21.15.12:0/3089811505 >> 172.21.15.12:0/3089811505 conn(0x7f4a5c05f6b0 msgr2=0x7f4a5c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 -- 172.21.15.12:0/3089811505 shutdown_connections 2021-10-20T23:20:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 -- 172.21.15.12:0/3089811505 wait complete. 2021-10-20T23:20:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 Processor -- start 2021-10-20T23:20:06.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:05.998+0000 7f4a60ee4700 1 -- start start 2021-10-20T23:20:06.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a60ee4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 0x7f4a5c149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a60ee4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0b1db0 0x7f4a5c0ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a60ee4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c1483a0 0x7f4a5c14a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a60ee4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c14b7b0 con 0x7f4a5c1483a0 2021-10-20T23:20:06.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a60ee4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c14b270 con 0x7f4a5c0b1db0 2021-10-20T23:20:06.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a60ee4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c14b510 con 0x7f4a5c0a70c0 2021-10-20T23:20:06.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c1483a0 0x7f4a5c14a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5a59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 0x7f4a5c149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c1483a0 0x7f4a5c14a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37036/0 (socket says 172.21.15.12:37036) 2021-10-20T23:20:06.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5ad9d700 1 -- 172.21.15.12:0/1530303174 learned_addr learned my addr 172.21.15.12:0/1530303174 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:06.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a59d9b700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0b1db0 0x7f4a5c0ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5ad9d700 1 -- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 msgr2=0x7f4a5c149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5ad9d700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 0x7f4a5c149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5ad9d700 1 -- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0b1db0 msgr2=0x7f4a5c0ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5ad9d700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0b1db0 0x7f4a5c0ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5ad9d700 1 -- 172.21.15.12:0/1530303174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c00b180 con 0x7f4a5c1483a0 2021-10-20T23:20:06.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a5ad9d700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c1483a0 0x7f4a5c14a240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4a5400a000 tx=0x7f4a54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a537fe700 1 -- 172.21.15.12:0/1530303174 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a540127e0 con 0x7f4a5c1483a0 2021-10-20T23:20:06.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c143840 con 0x7f4a5c1483a0 2021-10-20T23:20:06.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a537fe700 1 -- 172.21.15.12:0/1530303174 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54012940 con 0x7f4a5c1483a0 2021-10-20T23:20:06.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a537fe700 1 -- 172.21.15.12:0/1530303174 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a54012ca0 con 0x7f4a5c1483a0 2021-10-20T23:20:06.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.002+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c143cc0 con 0x7f4a5c1483a0 2021-10-20T23:20:06.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.006+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c144310 con 0x7f4a5c1483a0 2021-10-20T23:20:06.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:20:06.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.006+0000 7f4a537fe700 1 -- 172.21.15.12:0/1530303174 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a54013480 con 0x7f4a5c1483a0 2021-10-20T23:20:06.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.006+0000 7f4a537fe700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a340536a0 0x7f4a34055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.006+0000 7f4a537fe700 1 -- 172.21.15.12:0/1530303174 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4a5406c2d0 con 0x7f4a5c1483a0 2021-10-20T23:20:06.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.006+0000 7f4a5a59c700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a340536a0 0x7f4a34055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.006+0000 7f4a5a59c700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a340536a0 0x7f4a34055b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4a4c01c000 tx=0x7f4a4c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.010+0000 7f4a537fe700 1 -- 172.21.15.12:0/1530303174 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a540430e0 con 0x7f4a5c1483a0 2021-10-20T23:20:06.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:20:06.021 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:20:06.024 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:20:06.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.142+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a5c0aae80 con 0x7f4a340536a0 2021-10-20T23:20:06.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a537fe700 1 -- 172.21.15.12:0/1530303174 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82389 (secure 0 0 0) 0x7f4a4c00db80 con 0x7f4a340536a0 2021-10-20T23:20:06.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:06.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a340536a0 msgr2=0x7f4a34055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a340536a0 0x7f4a34055b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4a4c01c000 tx=0x7f4a4c015000).stop 2021-10-20T23:20:06.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c1483a0 msgr2=0x7f4a5c14a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c1483a0 0x7f4a5c14a240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4a5400a000 tx=0x7f4a54008040).stop 2021-10-20T23:20:06.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 shutdown_connections 2021-10-20T23:20:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a340536a0 0x7f4a34055b60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5c1483a0 0x7f4a5c14a240 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0b1db0 0x7f4a5c0ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 --2- 172.21.15.12:0/1530303174 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a5c0a70c0 0x7f4a5c149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 >> 172.21.15.12:0/1530303174 conn(0x7f4a5c05f6b0 msgr2=0x7f4a5c0b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:06.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 shutdown_connections 2021-10-20T23:20:06.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.150+0000 7f4a60ee4700 1 -- 172.21.15.12:0/1530303174 wait complete. 2021-10-20T23:20:06.160 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2021-10-20T23:20:06.169 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2021-10-20T23:20:05.965373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390784,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583936,"statfs":{"total":773094113280,"available":764501950464,"internally_reserved":8589934592,"allocated":2162688,"data_stored":828856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.771522"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.290989+0000","last_change":"2021-10-20T23:19:56.287991+0000","last_active":"2021-10-20T23:19:56.290989+0000","last_peered":"2021-10-20T23:19:56.290989+0000","last_clean":"2021-10-20T23:19:56.290989+0000","last_became_active":"2021-10-20T23:19:56.287315+0000","last_became_peered":"2021-10-20T23:19:56.287315+0000","last_unstale":"2021-10-20T23:19:56.290989+0000","last_undegraded":"2021-10-20T23:19:56.290989+0000","last_fullsized":"2021-10-20T23:19:56.290989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.281373+0000","last_change":"2021-10-20T23:19:45.232100+0000","last_active":"2021-10-20T23:19:56.281373+0000","last_peered":"2021-10-20T23:19:56.281373+0000","last_clean":"2021-10-20T23:19:56.281373+0000","last_became_active":"2021-10-20T23:19:45.231374+0000","last_became_peered":"2021-10-20T23:19:45.231374+0000","last_unstale":"2021-10-20T23:19:56.281373+0000","last_undegraded":"2021-10-20T23:19:56.281373+0000","last_fullsized":"2021-10-20T23:19:56.281373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:40.954153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:40.954153+0000","last_clean_scrub_stamp":"2021-10-20T23:19:40.954153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.197140+0000","last_change":"2021-10-20T23:19:50.050604+0000","last_active":"2021-10-20T23:19:56.197140+0000","last_peered":"2021-10-20T23:19:56.197140+0000","last_clean":"2021-10-20T23:19:56.197140+0000","last_became_active":"2021-10-20T23:19:50.050295+0000","last_became_peered":"2021-10-20T23:19:50.050295+0000","last_unstale":"2021-10-20T23:19:56.197140+0000","last_undegraded":"2021-10-20T23:19:56.197140+0000","last_fullsized":"2021-10-20T23:19:56.197140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.516397+0000","last_change":"2021-10-20T23:19:53.176236+0000","last_active":"2021-10-20T23:19:56.516397+0000","last_peered":"2021-10-20T23:19:56.516397+0000","last_clean":"2021-10-20T23:19:56.516397+0000","last_became_active":"2021-10-20T23:19:53.175767+0000","last_became_peered":"2021-10-20T23:19:53.175767+0000","last_unstale":"2021-10-20T23:19:56.516397+0000","last_undegraded":"2021-10-20T23:19:56.516397+0000","last_fullsized":"2021-10-20T23:19:56.516397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.290993+0000","last_change":"2021-10-20T23:19:56.285470+0000","last_active":"2021-10-20T23:19:56.290993+0000","last_peered":"2021-10-20T23:19:56.290993+0000","last_clean":"2021-10-20T23:19:56.290993+0000","last_became_active":"2021-10-20T23:19:56.282928+0000","last_became_peered":"2021-10-20T23:19:56.282928+0000","last_unstale":"2021-10-20T23:19:56.290993+0000","last_undegraded":"2021-10-20T23:19:56.290993+0000","last_fullsized":"2021-10-20T23:19:56.290993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.281031+0000","last_change":"2021-10-20T23:19:50.051597+0000","last_active":"2021-10-20T23:19:56.281031+0000","last_peered":"2021-10-20T23:19:56.281031+0000","last_clean":"2021-10-20T23:19:56.281031+0000","last_became_active":"2021-10-20T23:19:50.051189+0000","last_became_peered":"2021-10-20T23:19:50.051189+0000","last_unstale":"2021-10-20T23:19:56.281031+0000","last_undegraded":"2021-10-20T23:19:56.281031+0000","last_fullsized":"2021-10-20T23:19:56.281031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.203797+0000","last_change":"2021-10-20T23:19:53.179898+0000","last_active":"2021-10-20T23:19:56.203797+0000","last_peered":"2021-10-20T23:19:56.203797+0000","last_clean":"2021-10-20T23:19:56.203797+0000","last_became_active":"2021-10-20T23:19:53.179345+0000","last_became_peered":"2021-10-20T23:19:53.179345+0000","last_unstale":"2021-10-20T23:19:56.203797+0000","last_undegraded":"2021-10-20T23:19:56.203797+0000","last_fullsized":"2021-10-20T23:19:56.203797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.210511+0000","last_change":"2021-10-20T23:19:56.206831+0000","last_active":"2021-10-20T23:19:56.210511+0000","last_peered":"2021-10-20T23:19:56.210511+0000","last_clean":"2021-10-20T23:19:56.210511+0000","last_became_active":"2021-10-20T23:19:56.206221+0000","last_became_peered":"2021-10-20T23:19:56.206221+0000","last_unstale":"2021-10-20T23:19:56.210511+0000","last_undegraded":"2021-10-20T23:19:56.210511+0000","last_fullsized":"2021-10-20T23:19:56.210511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.277342+0000","last_change":"2021-10-20T23:19:50.050317+0000","last_active":"2021-10-20T23:19:56.277342+0000","last_peered":"2021-10-20T23:19:56.277342+0000","last_clean":"2021-10-20T23:19:56.277342+0000","last_became_active":"2021-10-20T23:19:50.049970+0000","last_became_peered":"2021-10-20T23:19:50.049970+0000","last_unstale":"2021-10-20T23:19:56.277342+0000","last_undegraded":"2021-10-20T23:19:56.277342+0000","last_fullsized":"2021-10-20T23:19:56.277342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.535164+0000","last_change":"2021-10-20T23:19:53.173049+0000","last_active":"2021-10-20T23:19:56.535164+0000","last_peered":"2021-10-20T23:19:56.535164+0000","last_clean":"2021-10-20T23:19:56.535164+0000","last_became_active":"2021-10-20T23:19:53.172681+0000","last_became_peered":"2021-10-20T23:19:53.172681+0000","last_unstale":"2021-10-20T23:19:56.535164+0000","last_undegraded":"2021-10-20T23:19:56.535164+0000","last_fullsized":"2021-10-20T23:19:56.535164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.288048+0000","last_change":"2021-10-20T23:19:56.283665+0000","last_active":"2021-10-20T23:19:56.288048+0000","last_peered":"2021-10-20T23:19:56.288048+0000","last_clean":"2021-10-20T23:19:56.288048+0000","last_became_active":"2021-10-20T23:19:56.282177+0000","last_became_peered":"2021-10-20T23:19:56.282177+0000","last_unstale":"2021-10-20T23:19:56.288048+0000","last_undegraded":"2021-10-20T23:19:56.288048+0000","last_fullsized":"2021-10-20T23:19:56.288048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.197201+0000","last_change":"2021-10-20T23:19:50.052800+0000","last_active":"2021-10-20T23:19:56.197201+0000","last_peered":"2021-10-20T23:19:56.197201+0000","last_clean":"2021-10-20T23:19:56.197201+0000","last_became_active":"2021-10-20T23:19:50.052290+0000","last_became_peered":"2021-10-20T23:19:50.052290+0000","last_unstale":"2021-10-20T23:19:56.197201+0000","last_undegraded":"2021-10-20T23:19:56.197201+0000","last_fullsized":"2021-10-20T23:19:56.197201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'5","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.532864+0000","last_change":"2021-10-20T23:19:53.180031+0000","last_active":"2021-10-20T23:19:56.532864+0000","last_peered":"2021-10-20T23:19:56.532864+0000","last_clean":"2021-10-20T23:19:56.532864+0000","last_became_active":"2021-10-20T23:19:53.179606+0000","last_became_peered":"2021-10-20T23:19:53.179606+0000","last_unstale":"2021-10-20T23:19:56.532864+0000","last_undegraded":"2021-10-20T23:19:56.532864+0000","last_fullsized":"2021-10-20T23:19:56.532864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.210551+0000","last_change":"2021-10-20T23:19:56.207152+0000","last_active":"2021-10-20T23:19:56.210551+0000","last_peered":"2021-10-20T23:19:56.210551+0000","last_clean":"2021-10-20T23:19:56.210551+0000","last_became_active":"2021-10-20T23:19:56.206346+0000","last_became_peered":"2021-10-20T23:19:56.206346+0000","last_unstale":"2021-10-20T23:19:56.210551+0000","last_undegraded":"2021-10-20T23:19:56.210551+0000","last_fullsized":"2021-10-20T23:19:56.210551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'6","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.535815+0000","last_change":"2021-10-20T23:19:53.180572+0000","last_active":"2021-10-20T23:19:56.535815+0000","last_peered":"2021-10-20T23:19:56.535815+0000","last_clean":"2021-10-20T23:19:56.535815+0000","last_became_active":"2021-10-20T23:19:53.179718+0000","last_became_peered":"2021-10-20T23:19:53.179718+0000","last_unstale":"2021-10-20T23:19:56.535815+0000","last_undegraded":"2021-10-20T23:19:56.535815+0000","last_fullsized":"2021-10-20T23:19:56.535815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.198325+0000","last_change":"2021-10-20T23:19:50.196425+0000","last_active":"2021-10-20T23:19:56.198325+0000","last_peered":"2021-10-20T23:19:56.198325+0000","last_clean":"2021-10-20T23:19:56.198325+0000","last_became_active":"2021-10-20T23:19:50.195815+0000","last_became_peered":"2021-10-20T23:19:50.195815+0000","last_unstale":"2021-10-20T23:19:56.198325+0000","last_undegraded":"2021-10-20T23:19:56.198325+0000","last_fullsized":"2021-10-20T23:19:56.198325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.290996+0000","last_change":"2021-10-20T23:19:56.285549+0000","last_active":"2021-10-20T23:19:56.290996+0000","last_peered":"2021-10-20T23:19:56.290996+0000","last_clean":"2021-10-20T23:19:56.290996+0000","last_became_active":"2021-10-20T23:19:56.282936+0000","last_became_peered":"2021-10-20T23:19:56.282936+0000","last_unstale":"2021-10-20T23:19:56.290996+0000","last_undegraded":"2021-10-20T23:19:56.290996+0000","last_fullsized":"2021-10-20T23:19:56.290996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"25'8","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.535244+0000","last_change":"2021-10-20T23:19:53.173985+0000","last_active":"2021-10-20T23:19:56.535244+0000","last_peered":"2021-10-20T23:19:56.535244+0000","last_clean":"2021-10-20T23:19:56.535244+0000","last_became_active":"2021-10-20T23:19:53.173490+0000","last_became_peered":"2021-10-20T23:19:53.173490+0000","last_unstale":"2021-10-20T23:19:56.535244+0000","last_undegraded":"2021-10-20T23:19:56.535244+0000","last_fullsized":"2021-10-20T23:19:56.535244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.281510+0000","last_change":"2021-10-20T23:19:50.200005+0000","last_active":"2021-10-20T23:19:56.281510+0000","last_peered":"2021-10-20T23:19:56.281510+0000","last_clean":"2021-10-20T23:19:56.281510+0000","last_became_active":"2021-10-20T23:19:50.198735+0000","last_became_peered":"2021-10-20T23:19:50.198735+0000","last_unstale":"2021-10-20T23:19:56.281510+0000","last_undegraded":"2021-10-20T23:19:56.281510+0000","last_fullsized":"2021-10-20T23:19:56.281510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.285642+0000","last_change":"2021-10-20T23:19:56.282687+0000","last_active":"2021-10-20T23:19:56.285642+0000","last_peered":"2021-10-20T23:19:56.285642+0000","last_clean":"2021-10-20T23:19:56.285642+0000","last_became_active":"2021-10-20T23:19:56.281783+0000","last_became_peered":"2021-10-20T23:19:56.281783+0000","last_unstale":"2021-10-20T23:19:56.285642+0000","last_undegraded":"2021-10-20T23:19:56.285642+0000","last_fullsized":"2021-10-20T23:19:56.285642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.527172+0000","last_change":"2021-10-20T23:19:53.202291+0000","last_active":"2021-10-20T23:19:56.527172+0000","last_peered":"2021-10-20T23:19:56.527172+0000","last_clean":"2021-10-20T23:19:56.527172+0000","last_became_active":"2021-10-20T23:19:53.201739+0000","last_became_peered":"2021-10-20T23:19:53.201739+0000","last_unstale":"2021-10-20T23:19:56.527172+0000","last_undegraded":"2021-10-20T23:19:56.527172+0000","last_fullsized":"2021-10-20T23:19:56.527172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.197956+0000","last_change":"2021-10-20T23:19:50.047617+0000","last_active":"2021-10-20T23:19:56.197956+0000","last_peered":"2021-10-20T23:19:56.197956+0000","last_clean":"2021-10-20T23:19:56.197956+0000","last_became_active":"2021-10-20T23:19:50.046787+0000","last_became_peered":"2021-10-20T23:19:50.046787+0000","last_unstale":"2021-10-20T23:19:56.197956+0000","last_undegraded":"2021-10-20T23:19:56.197956+0000","last_fullsized":"2021-10-20T23:19:56.197956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.288068+0000","last_change":"2021-10-20T23:19:56.285901+0000","last_active":"2021-10-20T23:19:56.288068+0000","last_peered":"2021-10-20T23:19:56.288068+0000","last_clean":"2021-10-20T23:19:56.288068+0000","last_became_active":"2021-10-20T23:19:56.284413+0000","last_became_peered":"2021-10-20T23:19:56.284413+0000","last_unstale":"2021-10-20T23:19:56.288068+0000","last_undegraded":"2021-10-20T23:19:56.288068+0000","last_fullsized":"2021-10-20T23:19:56.288068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:55.170276+0000","last_clean_scrub_stamp":"2021-10-20T23:19:55.170276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"25'4","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.535776+0000","last_change":"2021-10-20T23:19:53.178971+0000","last_active":"2021-10-20T23:19:56.535776+0000","last_peered":"2021-10-20T23:19:56.535776+0000","last_clean":"2021-10-20T23:19:56.535776+0000","last_became_active":"2021-10-20T23:19:53.178634+0000","last_became_peered":"2021-10-20T23:19:53.178634+0000","last_unstale":"2021-10-20T23:19:56.535776+0000","last_undegraded":"2021-10-20T23:19:56.535776+0000","last_fullsized":"2021-10-20T23:19:56.535776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:52.152192+0000","last_clean_scrub_stamp":"2021-10-20T23:19:52.152192+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-10-20T23:19:56.202684+0000","last_change":"2021-10-20T23:19:50.049986+0000","last_active":"2021-10-20T23:19:56.202684+0000","last_peered":"2021-10-20T23:19:56.202684+0000","last_clean":"2021-10-20T23:19:56.202684+0000","last_became_active":"2021-10-20T23:19:50.049434+0000","last_became_peered":"2021-10-20T23:19:50.049434+0000","last_unstale":"2021-10-20T23:19:56.202684+0000","last_undegraded":"2021-10-20T23:19:56.202684+0000","last_fullsized":"2021-10-20T23:19:56.202684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":103606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":103031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":103191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":103766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":104566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":104566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]}]}} 2021-10-20T23:20:06.172 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-10-20T23:20:06.172 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-10-20T23:20:06.172 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-10-20T23:20:06.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-10-20T23:20:06.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72ff409700 1 Processor -- start 2021-10-20T23:20:06.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72ff409700 1 -- start start 2021-10-20T23:20:06.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72ff409700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f81439a0 0x7f72f81404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72ff409700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f80b6910 con 0x7f72f8061680 2021-10-20T23:20:06.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72ff409700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f80b6bb0 con 0x7f72f80b4710 2021-10-20T23:20:06.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72ff409700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80b9680 con 0x7f72f81439a0 2021-10-20T23:20:06.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fe407700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f72f8061680 0x7f72f80b9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35636/0 (socket says 172.21.15.12:35636) 2021-10-20T23:20:06.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fe407700 1 -- 172.21.15.12:0/3297656765 learned_addr learned my addr 172.21.15.12:0/3297656765 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:06.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fec08700 1 --2- 172.21.15.12:0/3297656765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f81439a0 0x7f72f81404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fd405700 1 -- 172.21.15.12:0/3297656765 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118736464 0 0) 0x7f72f80b6910 con 0x7f72f8061680 2021-10-20T23:20:06.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fd405700 1 -- 172.21.15.12:0/3297656765 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e0003260 con 0x7f72f8061680 2021-10-20T23:20:06.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fd405700 1 -- 172.21.15.12:0/3297656765 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318931391 0 0) 0x7f72f80b6bb0 con 0x7f72f80b4710 2021-10-20T23:20:06.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fd405700 1 -- 172.21.15.12:0/3297656765 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f80b6910 con 0x7f72f80b4710 2021-10-20T23:20:06.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fec08700 1 -- 172.21.15.12:0/3297656765 >> v1:172.21.15.31:6789/0 conn(0x7f72f80b4710 legacy=0x7f72f813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fec08700 1 -- 172.21.15.12:0/3297656765 >> v1:172.21.15.12:6789/0 conn(0x7f72f8061680 legacy=0x7f72f80b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fec08700 1 -- 172.21.15.12:0/3297656765 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f80b6e50 con 0x7f72f81439a0 2021-10-20T23:20:06.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fec08700 1 --2- 172.21.15.12:0/3297656765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f81439a0 0x7f72f81404b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f72f00032f0 tx=0x7f72f00091d0).ready entity=mon.2 client_cookie=a8f1eec923229b96 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fd405700 1 -- 172.21.15.12:0/3297656765 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f000b640 con 0x7f72f81439a0 2021-10-20T23:20:06.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fd405700 1 -- 172.21.15.12:0/3297656765 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000b7a0 con 0x7f72f81439a0 2021-10-20T23:20:06.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.274+0000 7f72fd405700 1 -- 172.21.15.12:0/3297656765 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f000b910 con 0x7f72f81439a0 2021-10-20T23:20:06.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- 172.21.15.12:0/3297656765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f81439a0 msgr2=0x7f72f81404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 --2- 172.21.15.12:0/3297656765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f81439a0 0x7f72f81404b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f72f00032f0 tx=0x7f72f00091d0).stop 2021-10-20T23:20:06.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- 172.21.15.12:0/3297656765 shutdown_connections 2021-10-20T23:20:06.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 --2- 172.21.15.12:0/3297656765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f81439a0 0x7f72f81404b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- 172.21.15.12:0/3297656765 >> 172.21.15.12:0/3297656765 conn(0x7f72f806adf0 msgr2=0x7f72f805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:06.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- 172.21.15.12:0/3297656765 shutdown_connections 2021-10-20T23:20:06.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- 172.21.15.12:0/3297656765 wait complete. 2021-10-20T23:20:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 Processor -- start 2021-10-20T23:20:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- start start 2021-10-20T23:20:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f8061680 0x7f72f81467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72f81439a0 0x7f72f8152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f80af6b0 0x7f72f8153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8115700 con 0x7f72f81439a0 2021-10-20T23:20:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8146cd0 con 0x7f72f8061680 2021-10-20T23:20:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8153800 con 0x7f72f80af6b0 2021-10-20T23:20:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fdc06700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72f81439a0 0x7f72f8152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fdc06700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72f81439a0 0x7f72f8152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37048/0 (socket says 172.21.15.12:37048) 2021-10-20T23:20:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fe407700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f8061680 0x7f72f81467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fdc06700 1 -- 172.21.15.12:0/728409504 learned_addr learned my addr 172.21.15.12:0/728409504 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fec08700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f80af6b0 0x7f72f8153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fdc06700 1 -- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f80af6b0 msgr2=0x7f72f8153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fdc06700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f80af6b0 0x7f72f8153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fdc06700 1 -- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f8061680 msgr2=0x7f72f81467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fdc06700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f8061680 0x7f72f81467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fdc06700 1 -- 172.21.15.12:0/728409504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f0009470 con 0x7f72f81439a0 2021-10-20T23:20:06.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72fdc06700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72f81439a0 0x7f72f8152e20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f72ec001110 tx=0x7f72ec007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72eb7fe700 1 -- 172.21.15.12:0/728409504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72ec012400 con 0x7f72f81439a0 2021-10-20T23:20:06.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72eb7fe700 1 -- 172.21.15.12:0/728409504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec012560 con 0x7f72f81439a0 2021-10-20T23:20:06.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f80afdf0 con 0x7f72f81439a0 2021-10-20T23:20:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.278+0000 7f72eb7fe700 1 -- 172.21.15.12:0/728409504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72ec0128c0 con 0x7f72f81439a0 2021-10-20T23:20:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.282+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f8152950 con 0x7f72f81439a0 2021-10-20T23:20:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.282+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f80aff80 con 0x7f72f81439a0 2021-10-20T23:20:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.282+0000 7f72eb7fe700 1 -- 172.21.15.12:0/728409504 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f72ec019030 con 0x7f72f81439a0 2021-10-20T23:20:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.282+0000 7f72eb7fe700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72d80536d0 0x7f72d8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.282+0000 7f72eb7fe700 1 -- 172.21.15.12:0/728409504 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f72ec06ad90 con 0x7f72f81439a0 2021-10-20T23:20:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.282+0000 7f72fe407700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72d80536d0 0x7f72d8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.282+0000 7f72fe407700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72d80536d0 0x7f72d8055b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f72f400d000 tx=0x7f72f4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.290+0000 7f72eb7fe700 1 -- 172.21.15.12:0/728409504 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72ec041d90 con 0x7f72f81439a0 2021-10-20T23:20:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.458+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f72f8057350 con 0x7f72f81439a0 2021-10-20T23:20:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.458+0000 7f72eb7fe700 1 -- 172.21.15.12:0/728409504 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f72ec0453b0 con 0x7f72f81439a0 2021-10-20T23:20:06.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:06.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72d80536d0 msgr2=0x7f72d8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72d80536d0 0x7f72d8055b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f72f400d000 tx=0x7f72f4009040).stop 2021-10-20T23:20:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72f81439a0 msgr2=0x7f72f8152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72f81439a0 0x7f72f8152e20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f72ec001110 tx=0x7f72ec007a90).stop 2021-10-20T23:20:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 shutdown_connections 2021-10-20T23:20:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72d80536d0 0x7f72d8055b90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f80af6b0 0x7f72f8153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72f81439a0 0x7f72f8152e20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 --2- 172.21.15.12:0/728409504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f8061680 0x7f72f81467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 >> 172.21.15.12:0/728409504 conn(0x7f72f806adf0 msgr2=0x7f72f813f460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 shutdown_connections 2021-10-20T23:20:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.462+0000 7f72ff409700 1 -- 172.21.15.12:0/728409504 wait complete. 2021-10-20T23:20:06.480 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-10-20T23:20:06.480 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-10-20T23:20:06.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:06.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb00aca0700 1 Processor -- start 2021-10-20T23:20:06.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb00aca0700 1 -- start start 2021-10-20T23:20:06.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb00aca0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb0040b6580 0x7fb0040b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb00aca0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0040b43c0 0x7fb0040b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb00aca0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0041440b0 con 0x7fb004061d30 2021-10-20T23:20:06.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb00aca0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0040b6e50 con 0x7fb0040b6580 2021-10-20T23:20:06.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb00aca0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb004143b70 con 0x7fb0040b43c0 2021-10-20T23:20:06.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb00923d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb004061d30 0x7fb0041466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35652/0 (socket says 172.21.15.12:35652) 2021-10-20T23:20:06.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb00923d700 1 -- 172.21.15.12:0/3156545977 learned_addr learned my addr 172.21.15.12:0/3156545977 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:06.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb008a3c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb0040b6580 0x7fb0040b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb003fff700 1 --2- 172.21.15.12:0/3156545977 >> v2:172.21.15.31:3300/0 conn(0x7fb0040b43c0 0x7fb0040b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb0037fe700 1 -- 172.21.15.12:0/3156545977 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681209279 0 0) 0x7fb0041440b0 con 0x7fb004061d30 2021-10-20T23:20:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb0037fe700 1 -- 172.21.15.12:0/3156545977 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe4003260 con 0x7fb004061d30 2021-10-20T23:20:06.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb008a3c700 1 -- 172.21.15.12:0/3156545977 >> v2:172.21.15.31:3300/0 conn(0x7fb0040b43c0 msgr2=0x7fb0040b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:06.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb008a3c700 1 --2- 172.21.15.12:0/3156545977 >> v2:172.21.15.31:3300/0 conn(0x7fb0040b43c0 0x7fb0040b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb008a3c700 1 -- 172.21.15.12:0/3156545977 >> v1:172.21.15.12:6789/0 conn(0x7fb004061d30 legacy=0x7fb0041466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb008a3c700 1 -- 172.21.15.12:0/3156545977 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb004143e10 con 0x7fb0040b6580 2021-10-20T23:20:06.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb008a3c700 1 --2- 172.21.15.12:0/3156545977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0040b6580 0x7fb0040b5bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb004143120 tx=0x7fafec006df0).ready entity=mon.0 client_cookie=6cce25ae70e0e7cb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.578+0000 7fb0037fe700 1 -- 172.21.15.12:0/3156545977 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafec00d4f0 con 0x7fb0040b6580 2021-10-20T23:20:06.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb0037fe700 1 -- 172.21.15.12:0/3156545977 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec000e90 con 0x7fb0040b6580 2021-10-20T23:20:06.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb0037fe700 1 -- 172.21.15.12:0/3156545977 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafec00d840 con 0x7fb0040b6580 2021-10-20T23:20:06.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 -- 172.21.15.12:0/3156545977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0040b6580 msgr2=0x7fb0040b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 --2- 172.21.15.12:0/3156545977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0040b6580 0x7fb0040b5bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb004143120 tx=0x7fafec006df0).stop 2021-10-20T23:20:06.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 -- 172.21.15.12:0/3156545977 shutdown_connections 2021-10-20T23:20:06.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 --2- 172.21.15.12:0/3156545977 >> v2:172.21.15.31:3300/0 conn(0x7fb0040b43c0 0x7fb0040b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 --2- 172.21.15.12:0/3156545977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0040b6580 0x7fb0040b5bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 -- 172.21.15.12:0/3156545977 >> 172.21.15.12:0/3156545977 conn(0x7fb00405c490 msgr2=0x7fb00405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:06.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 -- 172.21.15.12:0/3156545977 shutdown_connections 2021-10-20T23:20:06.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 -- 172.21.15.12:0/3156545977 wait complete. 2021-10-20T23:20:06.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 Processor -- start 2021-10-20T23:20:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 -- start start 2021-10-20T23:20:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004061d30 0x7fb004129ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0040b43c0 0x7fb004152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0040b6580 0x7fb0040b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004153150 con 0x7fb004061d30 2021-10-20T23:20:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00412c680 con 0x7fb0040b43c0 2021-10-20T23:20:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00aca0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00412b8f0 con 0x7fb0040b6580 2021-10-20T23:20:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb008a3c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004061d30 0x7fb004129ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb008a3c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004061d30 0x7fb004129ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37060/0 (socket says 172.21.15.12:37060) 2021-10-20T23:20:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb008a3c700 1 -- 172.21.15.12:0/898652597 learned_addr learned my addr 172.21.15.12:0/898652597 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb00923d700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0040b6580 0x7fb0040b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.582+0000 7fb003fff700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0040b43c0 0x7fb004152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb008a3c700 1 -- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0040b6580 msgr2=0x7fb0040b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb008a3c700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0040b6580 0x7fb0040b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb008a3c700 1 -- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0040b43c0 msgr2=0x7fb004152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb008a3c700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0040b43c0 0x7fb004152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb008a3c700 1 -- 172.21.15.12:0/898652597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec00b180 con 0x7fb004061d30 2021-10-20T23:20:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb008a3c700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004061d30 0x7fb004129ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb004143120 tx=0x7fafec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb001ffb700 1 -- 172.21.15.12:0/898652597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafec002f70 con 0x7fb004061d30 2021-10-20T23:20:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb001ffb700 1 -- 172.21.15.12:0/898652597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec00de40 con 0x7fb004061d30 2021-10-20T23:20:06.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00412bb90 con 0x7fb004061d30 2021-10-20T23:20:06.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb001ffb700 1 -- 172.21.15.12:0/898652597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafec01e5f0 con 0x7fb004061d30 2021-10-20T23:20:06.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00412b4c0 con 0x7fb004061d30 2021-10-20T23:20:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0040615f0 con 0x7fb004061d30 2021-10-20T23:20:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.586+0000 7fb001ffb700 1 -- 172.21.15.12:0/898652597 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fafec025030 con 0x7fb004061d30 2021-10-20T23:20:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.590+0000 7fb001ffb700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe80536a0 0x7fafe8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.590+0000 7fb001ffb700 1 -- 172.21.15.12:0/898652597 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fafec06c800 con 0x7fb004061d30 2021-10-20T23:20:06.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.590+0000 7fb003fff700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe80536a0 0x7fafe8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.590+0000 7fb003fff700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe80536a0 0x7fafe8055b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7faff400b000 tx=0x7faff4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.594+0000 7fb001ffb700 1 -- 172.21.15.12:0/898652597 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fafec0436f0 con 0x7fb004061d30 2021-10-20T23:20:06.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.722+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb004057350 con 0x7fb004061d30 2021-10-20T23:20:06.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb001ffb700 1 -- 172.21.15.12:0/898652597 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fafec023020 con 0x7fb004061d30 2021-10-20T23:20:06.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:06.731 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:06.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe80536a0 msgr2=0x7fafe8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe80536a0 0x7fafe8055b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7faff400b000 tx=0x7faff4008040).stop 2021-10-20T23:20:06.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004061d30 msgr2=0x7fb004129ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004061d30 0x7fb004129ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb004143120 tx=0x7fafec014000).stop 2021-10-20T23:20:06.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 shutdown_connections 2021-10-20T23:20:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe80536a0 0x7fafe8055b60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0040b6580 0x7fb0040b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0040b43c0 0x7fb004152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 --2- 172.21.15.12:0/898652597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004061d30 0x7fb004129ac0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 >> 172.21.15.12:0/898652597 conn(0x7fb00405c490 msgr2=0x7fb004143160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 shutdown_connections 2021-10-20T23:20:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.726+0000 7fb00aca0700 1 -- 172.21.15.12:0/898652597 wait complete. 2021-10-20T23:20:06.745 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:19:51.434642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:19:54.214563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:20:06.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:20:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.850+0000 7f37e9b8e700 1 Processor -- start 2021-10-20T23:20:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.850+0000 7f37e9b8e700 1 -- start start 2021-10-20T23:20:06.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e9b8e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e413d820 0x7f37e4060830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e9b8e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37e40b0cd0 0x7f37e4060d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e9b8e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e4066960 con 0x7f37e40b6380 2021-10-20T23:20:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e9b8e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e4066c00 con 0x7f37e40b0cd0 2021-10-20T23:20:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e9b8e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4066ea0 con 0x7f37e413d820 2021-10-20T23:20:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e8b8c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f37e40b6380 0x7f37e413d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35662/0 (socket says 172.21.15.12:35662) 2021-10-20T23:20:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e8b8c700 1 -- 172.21.15.12:0/1072187516 learned_addr learned my addr 172.21.15.12:0/1072187516 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:06.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37dbfff700 1 --2- 172.21.15.12:0/1072187516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e413d820 0x7f37e4060830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e938d700 1 --2- 172.21.15.12:0/1072187516 >> v2:172.21.15.31:3300/0 conn(0x7f37e40b0cd0 0x7f37e4060d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37db7fe700 1 -- 172.21.15.12:0/1072187516 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639737616 0 0) 0x7f37e4066960 con 0x7f37e40b6380 2021-10-20T23:20:06.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37db7fe700 1 -- 172.21.15.12:0/1072187516 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37d0003260 con 0x7f37e40b6380 2021-10-20T23:20:06.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e938d700 1 -- 172.21.15.12:0/1072187516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e413d820 msgr2=0x7f37e4060830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:06.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e938d700 1 --2- 172.21.15.12:0/1072187516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e413d820 0x7f37e4060830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e938d700 1 -- 172.21.15.12:0/1072187516 >> v1:172.21.15.12:6789/0 conn(0x7f37e40b6380 legacy=0x7f37e413d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e938d700 1 -- 172.21.15.12:0/1072187516 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4067140 con 0x7f37e40b0cd0 2021-10-20T23:20:06.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37e938d700 1 --2- 172.21.15.12:0/1072187516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37e40b0cd0 0x7f37e4060d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f37dc0032f0 tx=0x7f37dc0091d0).ready entity=mon.1 client_cookie=97b1dfc6deefebab server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37db7fe700 1 -- 172.21.15.12:0/1072187516 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37dc00b600 con 0x7f37e40b0cd0 2021-10-20T23:20:06.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37db7fe700 1 -- 172.21.15.12:0/1072187516 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc00b760 con 0x7f37e40b0cd0 2021-10-20T23:20:06.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.854+0000 7f37db7fe700 1 -- 172.21.15.12:0/1072187516 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37dc00b8d0 con 0x7f37e40b0cd0 2021-10-20T23:20:06.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 -- 172.21.15.12:0/1072187516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37e40b0cd0 msgr2=0x7f37e4060d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 --2- 172.21.15.12:0/1072187516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37e40b0cd0 0x7f37e4060d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f37dc0032f0 tx=0x7f37dc0091d0).stop 2021-10-20T23:20:06.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 -- 172.21.15.12:0/1072187516 shutdown_connections 2021-10-20T23:20:06.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 --2- 172.21.15.12:0/1072187516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37e40b0cd0 0x7f37e4060d20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 --2- 172.21.15.12:0/1072187516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e413d820 0x7f37e4060830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 -- 172.21.15.12:0/1072187516 >> 172.21.15.12:0/1072187516 conn(0x7f37e4063670 msgr2=0x7f37e4063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:06.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 -- 172.21.15.12:0/1072187516 shutdown_connections 2021-10-20T23:20:06.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 -- 172.21.15.12:0/1072187516 wait complete. 2021-10-20T23:20:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 Processor -- start 2021-10-20T23:20:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.858+0000 7f37e9b8e700 1 -- start start 2021-10-20T23:20:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e9b8e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37e40b0cd0 0x7f37e413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e9b8e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e40b6380 0x7f37e414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e9b8e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e413d820 0x7f37e4151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e9b8e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e414dcc0 con 0x7f37e413d820 2021-10-20T23:20:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e9b8e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e40a9f20 con 0x7f37e40b0cd0 2021-10-20T23:20:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e9b8e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e414deb0 con 0x7f37e40b6380 2021-10-20T23:20:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e938d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e413d820 0x7f37e4151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e938d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e413d820 0x7f37e4151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37078/0 (socket says 172.21.15.12:37078) 2021-10-20T23:20:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e938d700 1 -- 172.21.15.12:0/4211563121 learned_addr learned my addr 172.21.15.12:0/4211563121 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37dbfff700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e40b6380 0x7f37e414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e8b8c700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37e40b0cd0 0x7f37e413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e938d700 1 -- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e40b6380 msgr2=0x7f37e414e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e938d700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e40b6380 0x7f37e414e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e938d700 1 -- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37e40b0cd0 msgr2=0x7f37e413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e938d700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37e40b0cd0 0x7f37e413c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e938d700 1 -- 172.21.15.12:0/4211563121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc009470 con 0x7f37e413d820 2021-10-20T23:20:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e938d700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e413d820 0x7f37e4151290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f37dc0032f0 tx=0x7f37dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37d9ffb700 1 -- 172.21.15.12:0/4211563121 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37dc00b600 con 0x7f37e413d820 2021-10-20T23:20:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37d9ffb700 1 -- 172.21.15.12:0/4211563121 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc011b60 con 0x7f37e413d820 2021-10-20T23:20:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e40afaa0 con 0x7f37e413d820 2021-10-20T23:20:06.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37d9ffb700 1 -- 172.21.15.12:0/4211563121 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37dc01f3f0 con 0x7f37e413d820 2021-10-20T23:20:06.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e414e110 con 0x7f37e413d820 2021-10-20T23:20:06.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e4057350 con 0x7f37e413d820 2021-10-20T23:20:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.862+0000 7f37d9ffb700 1 -- 172.21.15.12:0/4211563121 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f37dc026030 con 0x7f37e413d820 2021-10-20T23:20:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.866+0000 7f37d9ffb700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37c4053580 0x7f37c4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.866+0000 7f37d9ffb700 1 -- 172.21.15.12:0/4211563121 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f37dc06c6d0 con 0x7f37e413d820 2021-10-20T23:20:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.866+0000 7f37e8b8c700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37c4053580 0x7f37c4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.866+0000 7f37e8b8c700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37c4053580 0x7f37c4055a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f37e000d000 tx=0x7f37e0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:06.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.870+0000 7f37d9ffb700 1 -- 172.21.15.12:0/4211563121 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f37dc046ff0 con 0x7f37e413d820 2021-10-20T23:20:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f37e406aaf0 con 0x7f37e413d820 2021-10-20T23:20:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37d9ffb700 1 -- 172.21.15.12:0/4211563121 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f37dc046be0 con 0x7f37e413d820 2021-10-20T23:20:07.003 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:20:07.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37c4053580 msgr2=0x7f37c4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37c4053580 0x7f37c4055a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f37e000d000 tx=0x7f37e0009040).stop 2021-10-20T23:20:07.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e413d820 msgr2=0x7f37e4151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e413d820 0x7f37e4151290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f37dc0032f0 tx=0x7f37dc016000).stop 2021-10-20T23:20:07.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 shutdown_connections 2021-10-20T23:20:07.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37c4053580 0x7f37c4055a40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e413d820 0x7f37e4151290 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37e40b6380 0x7f37e414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 --2- 172.21.15.12:0/4211563121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37e40b0cd0 0x7f37e413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 >> 172.21.15.12:0/4211563121 conn(0x7f37e4063670 msgr2=0x7f37e4060080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:07.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 shutdown_connections 2021-10-20T23:20:07.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:06.998+0000 7f37e9b8e700 1 -- 172.21.15.12:0/4211563121 wait complete. 2021-10-20T23:20:07.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:20:07.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbebfff700 1 Processor -- start 2021-10-20T23:20:07.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbebfff700 1 -- start start 2021-10-20T23:20:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbebfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbbec05c7d0 0x7fbbec0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbebfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbbec05d0b0 0x7fbbec13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbebfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec13f880 con 0x7fbbec0ace30 2021-10-20T23:20:07.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbebfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec067d70 con 0x7fbbec05c7d0 2021-10-20T23:20:07.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbebfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec0b2af0 con 0x7fbbec05d0b0 2021-10-20T23:20:07.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbeaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbbec05c7d0 0x7fbbec0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbeaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbbec05c7d0 0x7fbbec0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37082/0 (socket says 172.21.15.12:37082) 2021-10-20T23:20:07.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbeaffd700 1 -- 172.21.15.12:0/2908788758 learned_addr learned my addr 172.21.15.12:0/2908788758 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:07.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.130+0000 7fbbe27fc700 1 --2- 172.21.15.12:0/2908788758 >> v2:172.21.15.31:3300/0 conn(0x7fbbec05d0b0 0x7fbbec13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbeaffd700 1 -- 172.21.15.12:0/2908788758 >> v2:172.21.15.31:3300/0 conn(0x7fbbec05d0b0 msgr2=0x7fbbec13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:07.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbeaffd700 1 --2- 172.21.15.12:0/2908788758 >> v2:172.21.15.31:3300/0 conn(0x7fbbec05d0b0 0x7fbbec13f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbeaffd700 1 -- 172.21.15.12:0/2908788758 >> v1:172.21.15.31:6789/0 conn(0x7fbbec0ace30 legacy=0x7fbbec0b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbeaffd700 1 -- 172.21.15.12:0/2908788758 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec05cbb0 con 0x7fbbec05c7d0 2021-10-20T23:20:07.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbe27fc700 1 --2- 172.21.15.12:0/2908788758 >> v2:172.21.15.31:3300/0 conn(0x7fbbec05d0b0 0x7fbbec13f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:07.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbeaffd700 1 --2- 172.21.15.12:0/2908788758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec05c7d0 0x7fbbec0b10f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fbbec0b2c30 tx=0x7fbbdc006eb0).ready entity=mon.0 client_cookie=34d22d36d1e4f07 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbea7fc700 1 -- 172.21.15.12:0/2908788758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbdc00d610 con 0x7fbbec05c7d0 2021-10-20T23:20:07.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbea7fc700 1 -- 172.21.15.12:0/2908788758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc000e90 con 0x7fbbec05c7d0 2021-10-20T23:20:07.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbea7fc700 1 -- 172.21.15.12:0/2908788758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbdc00d960 con 0x7fbbec05c7d0 2021-10-20T23:20:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbebfff700 1 -- 172.21.15.12:0/2908788758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec05c7d0 msgr2=0x7fbbec0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbebfff700 1 --2- 172.21.15.12:0/2908788758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec05c7d0 0x7fbbec0b10f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fbbec0b2c30 tx=0x7fbbdc006eb0).stop 2021-10-20T23:20:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbebfff700 1 -- 172.21.15.12:0/2908788758 shutdown_connections 2021-10-20T23:20:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbebfff700 1 --2- 172.21.15.12:0/2908788758 >> v2:172.21.15.31:3300/0 conn(0x7fbbec05d0b0 0x7fbbec13f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbebfff700 1 --2- 172.21.15.12:0/2908788758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec05c7d0 0x7fbbec0b10f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbebfff700 1 -- 172.21.15.12:0/2908788758 >> 172.21.15.12:0/2908788758 conn(0x7fbbec060180 msgr2=0x7fbbec0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:07.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbebfff700 1 -- 172.21.15.12:0/2908788758 shutdown_connections 2021-10-20T23:20:07.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.134+0000 7fbbebfff700 1 -- 172.21.15.12:0/2908788758 wait complete. 2021-10-20T23:20:07.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 Processor -- start 2021-10-20T23:20:07.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 -- start start 2021-10-20T23:20:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbec05c7d0 0x7fbbec13bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbec05d0b0 0x7fbbec0a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec0ace30 0x7fbbec0a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec063b60 con 0x7fbbec0ace30 2021-10-20T23:20:07.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec1500f0 con 0x7fbbec05c7d0 2021-10-20T23:20:07.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec150390 con 0x7fbbec05d0b0 2021-10-20T23:20:07.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec0ace30 0x7fbbec0a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbec05c7d0 0x7fbbec13bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec0ace30 0x7fbbec0a9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37092/0 (socket says 172.21.15.12:37092) 2021-10-20T23:20:07.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeb7fe700 1 -- 172.21.15.12:0/326951384 learned_addr learned my addr 172.21.15.12:0/326951384 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:07.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbe27fc700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbec05d0b0 0x7fbbec0a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeb7fe700 1 -- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbec05d0b0 msgr2=0x7fbbec0a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeb7fe700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbec05d0b0 0x7fbbec0a9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeb7fe700 1 -- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbec05c7d0 msgr2=0x7fbbec13bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeb7fe700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbec05c7d0 0x7fbbec13bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeb7fe700 1 -- 172.21.15.12:0/326951384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc00b1e0 con 0x7fbbec0ace30 2021-10-20T23:20:07.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbeb7fe700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec0ace30 0x7fbbec0a9630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fbbec060680 tx=0x7fbbe40013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbe8ff9700 1 -- 172.21.15.12:0/326951384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe4006aa0 con 0x7fbbec0ace30 2021-10-20T23:20:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbe8ff9700 1 -- 172.21.15.12:0/326951384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4006c00 con 0x7fbbec0ace30 2021-10-20T23:20:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec150630 con 0x7fbbec0ace30 2021-10-20T23:20:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbe8ff9700 1 -- 172.21.15.12:0/326951384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe4007030 con 0x7fbbec0ace30 2021-10-20T23:20:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.138+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec0aaad0 con 0x7fbbec0ace30 2021-10-20T23:20:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.142+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec0b1790 con 0x7fbbec0ace30 2021-10-20T23:20:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.142+0000 7fbbe8ff9700 1 -- 172.21.15.12:0/326951384 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbbe4010030 con 0x7fbbec0ace30 2021-10-20T23:20:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.142+0000 7fbbe8ff9700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc4053610 0x7fbbc4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.142+0000 7fbbe8ff9700 1 -- 172.21.15.12:0/326951384 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbbe406b760 con 0x7fbbec0ace30 2021-10-20T23:20:07.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.142+0000 7fbbeaffd700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc4053610 0x7fbbc4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.142+0000 7fbbeaffd700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc4053610 0x7fbbc4055ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbbdc01b000 tx=0x7fbbdc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.146+0000 7fbbe8ff9700 1 -- 172.21.15.12:0/326951384 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbbe4042650 con 0x7fbbec0ace30 2021-10-20T23:20:07.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbbec13f880 con 0x7fbbec0ace30 2021-10-20T23:20:07.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbe8ff9700 1 -- 172.21.15.12:0/326951384 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbbec13f880 con 0x7fbbec0ace30 2021-10-20T23:20:07.279 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:07.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc4053610 msgr2=0x7fbbc4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc4053610 0x7fbbc4055ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbbdc01b000 tx=0x7fbbdc015000).stop 2021-10-20T23:20:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec0ace30 msgr2=0x7fbbec0a9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec0ace30 0x7fbbec0a9630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fbbec060680 tx=0x7fbbe40013a0).stop 2021-10-20T23:20:07.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 shutdown_connections 2021-10-20T23:20:07.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc4053610 0x7fbbc4055ad0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec0ace30 0x7fbbec0a9630 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbec05d0b0 0x7fbbec0a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 --2- 172.21.15.12:0/326951384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbec05c7d0 0x7fbbec13bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 >> 172.21.15.12:0/326951384 conn(0x7fbbec060180 msgr2=0x7fbbec136250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 shutdown_connections 2021-10-20T23:20:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.274+0000 7fbbebfff700 1 -- 172.21.15.12:0/326951384 wait complete. 2021-10-20T23:20:07.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:20:07.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 Processor -- start 2021-10-20T23:20:07.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 -- start start 2021-10-20T23:20:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff18061d20 0x7eff181445a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff180b2520 0x7eff1813dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff18062100 con 0x7eff180b3ac0 2021-10-20T23:20:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180b11e0 con 0x7eff18061d20 2021-10-20T23:20:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff18144a90 con 0x7eff180b2520 2021-10-20T23:20:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff16ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff18061d20 0x7eff181445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff167fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7eff180b3ac0 0x7eff1805ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:42754/0 (socket says 172.21.15.12:42754) 2021-10-20T23:20:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff167fc700 1 -- 172.21.15.12:0/4187315711 learned_addr learned my addr 172.21.15.12:0/4187315711 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff177fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff180b2520 0x7eff1813dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff177fe700 1 -- 172.21.15.12:0/4187315711 >> v2:172.21.15.31:3300/0 conn(0x7eff18061d20 msgr2=0x7eff181445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff177fe700 1 --2- 172.21.15.12:0/4187315711 >> v2:172.21.15.31:3300/0 conn(0x7eff18061d20 0x7eff181445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff177fe700 1 -- 172.21.15.12:0/4187315711 >> v1:172.21.15.31:6789/0 conn(0x7eff180b3ac0 legacy=0x7eff1805ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff177fe700 1 -- 172.21.15.12:0/4187315711 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180b2ca0 con 0x7eff180b2520 2021-10-20T23:20:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff15ffb700 1 -- 172.21.15.12:0/4187315711 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980930605 0 0) 0x7eff18062100 con 0x7eff180b3ac0 2021-10-20T23:20:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff177fe700 1 --2- 172.21.15.12:0/4187315711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff180b2520 0x7eff1813dd40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7eff18141000 tx=0x7eff100091d0).ready entity=mon.2 client_cookie=a6da6791fe5abd server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff15ffb700 1 -- 172.21.15.12:0/4187315711 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1000b680 con 0x7eff180b2520 2021-10-20T23:20:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff15ffb700 1 -- 172.21.15.12:0/4187315711 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1000b7e0 con 0x7eff180b2520 2021-10-20T23:20:07.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff15ffb700 1 -- 172.21.15.12:0/4187315711 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1000b950 con 0x7eff180b2520 2021-10-20T23:20:07.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 -- 172.21.15.12:0/4187315711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff180b2520 msgr2=0x7eff1813dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 --2- 172.21.15.12:0/4187315711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff180b2520 0x7eff1813dd40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7eff18141000 tx=0x7eff100091d0).stop 2021-10-20T23:20:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 -- 172.21.15.12:0/4187315711 shutdown_connections 2021-10-20T23:20:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 --2- 172.21.15.12:0/4187315711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff180b2520 0x7eff1813dd40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 --2- 172.21.15.12:0/4187315711 >> v2:172.21.15.31:3300/0 conn(0x7eff18061d20 0x7eff181445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.398+0000 7eff1d317700 1 -- 172.21.15.12:0/4187315711 >> 172.21.15.12:0/4187315711 conn(0x7eff180639b0 msgr2=0x7eff18063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 -- 172.21.15.12:0/4187315711 shutdown_connections 2021-10-20T23:20:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 -- 172.21.15.12:0/4187315711 wait complete. 2021-10-20T23:20:07.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 Processor -- start 2021-10-20T23:20:07.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 -- start start 2021-10-20T23:20:07.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff18061d20 0x7eff181436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff180b2520 0x7eff18152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff180b3ac0 0x7eff18066fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff180ae1d0 con 0x7eff180b3ac0 2021-10-20T23:20:07.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18152a20 con 0x7eff180b2520 2021-10-20T23:20:07.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180b0960 con 0x7eff18061d20 2021-10-20T23:20:07.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff180b3ac0 0x7eff18066fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff180b3ac0 0x7eff18066fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37106/0 (socket says 172.21.15.12:37106) 2021-10-20T23:20:07.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff177fe700 1 -- 172.21.15.12:0/3978845866 learned_addr learned my addr 172.21.15.12:0/3978845866 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:07.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff16ffd700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff18061d20 0x7eff181436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff167fc700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff180b2520 0x7eff18152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff177fe700 1 -- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff18061d20 msgr2=0x7eff181436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff177fe700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff18061d20 0x7eff181436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff177fe700 1 -- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff180b2520 msgr2=0x7eff18152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff177fe700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff180b2520 0x7eff18152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff177fe700 1 -- 172.21.15.12:0/3978845866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009470 con 0x7eff180b3ac0 2021-10-20T23:20:07.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff177fe700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff180b3ac0 0x7eff18066fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7eff18141000 tx=0x7eff10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff0ffff700 1 -- 172.21.15.12:0/3978845866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1000b950 con 0x7eff180b3ac0 2021-10-20T23:20:07.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff180ad9f0 con 0x7eff180b3ac0 2021-10-20T23:20:07.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff0ffff700 1 -- 172.21.15.12:0/3978845866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10021630 con 0x7eff180b3ac0 2021-10-20T23:20:07.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff0ffff700 1 -- 172.21.15.12:0/3978845866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1000b680 con 0x7eff180b3ac0 2021-10-20T23:20:07.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.402+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff180adf30 con 0x7eff180b3ac0 2021-10-20T23:20:07.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.406+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff18066ca0 con 0x7eff180b3ac0 2021-10-20T23:20:07.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.406+0000 7eff0ffff700 1 -- 172.21.15.12:0/3978845866 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff10027020 con 0x7eff180b3ac0 2021-10-20T23:20:07.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.406+0000 7eff0ffff700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efefc053640 0x7efefc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.406+0000 7eff0ffff700 1 -- 172.21.15.12:0/3978845866 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7eff1006cf90 con 0x7eff180b3ac0 2021-10-20T23:20:07.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.406+0000 7eff16ffd700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efefc053640 0x7efefc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.406+0000 7eff16ffd700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efefc053640 0x7efefc055b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7eff0800b000 tx=0x7eff08006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.414+0000 7eff0ffff700 1 -- 172.21.15.12:0/3978845866 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff10043e80 con 0x7eff180b3ac0 2021-10-20T23:20:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.542+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff1805f830 con 0x7eff180b3ac0 2021-10-20T23:20:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.542+0000 7eff0ffff700 1 -- 172.21.15.12:0/3978845866 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7eff100474a0 con 0x7eff180b3ac0 2021-10-20T23:20:07.548 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:07.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efefc053640 msgr2=0x7efefc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efefc053640 0x7efefc055b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7eff0800b000 tx=0x7eff08006df0).stop 2021-10-20T23:20:07.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff180b3ac0 msgr2=0x7eff18066fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff180b3ac0 0x7eff18066fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7eff18141000 tx=0x7eff10016000).stop 2021-10-20T23:20:07.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 shutdown_connections 2021-10-20T23:20:07.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efefc053640 0x7efefc055b00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff180b3ac0 0x7eff18066fa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff180b2520 0x7eff18152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 --2- 172.21.15.12:0/3978845866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff18061d20 0x7eff181436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 >> 172.21.15.12:0/3978845866 conn(0x7eff180639b0 msgr2=0x7eff1813b230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:07.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 shutdown_connections 2021-10-20T23:20:07.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.546+0000 7eff1d317700 1 -- 172.21.15.12:0/3978845866 wait complete. 2021-10-20T23:20:07.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:20:07.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.670+0000 7f79603ca700 1 Processor -- start 2021-10-20T23:20:07.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.670+0000 7f79603ca700 1 -- start start 2021-10-20T23:20:07.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 0x7f7958140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79580b4690 0x7f79580b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7958143b60 con 0x7f7958146950 2021-10-20T23:20:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7958147510 con 0x7f79580b4690 2021-10-20T23:20:07.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7958143e00 con 0x7f79580b4180 2021-10-20T23:20:07.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795e967700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79580b4690 0x7f79580b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795e166700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7958146950 0x7f7958140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:42768/0 (socket says 172.21.15.12:42768) 2021-10-20T23:20:07.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d965700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 0x7f7958140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795e166700 1 -- 172.21.15.12:0/760048815 learned_addr learned my addr 172.21.15.12:0/760048815 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d164700 1 -- 172.21.15.12:0/760048815 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703334422 0 0) 0x7f7958143b60 con 0x7f7958146950 2021-10-20T23:20:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d164700 1 -- 172.21.15.12:0/760048815 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7940003260 con 0x7f7958146950 2021-10-20T23:20:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d965700 1 -- 172.21.15.12:0/760048815 >> v2:172.21.15.31:3300/0 conn(0x7f79580b4690 msgr2=0x7f79580b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d965700 1 --2- 172.21.15.12:0/760048815 >> v2:172.21.15.31:3300/0 conn(0x7f79580b4690 0x7f79580b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d965700 1 -- 172.21.15.12:0/760048815 >> v1:172.21.15.31:6789/0 conn(0x7f7958146950 legacy=0x7f7958140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d965700 1 -- 172.21.15.12:0/760048815 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580b0c90 con 0x7f79580b4180 2021-10-20T23:20:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d965700 1 --2- 172.21.15.12:0/760048815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 0x7f7958140940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f794c002f70 tx=0x7f794c006df0).ready entity=mon.2 client_cookie=1e822bb16dfcd6c1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d164700 1 -- 172.21.15.12:0/760048815 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794c00d4a0 con 0x7f79580b4180 2021-10-20T23:20:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d164700 1 -- 172.21.15.12:0/760048815 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c000e90 con 0x7f79580b4180 2021-10-20T23:20:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f795d164700 1 -- 172.21.15.12:0/760048815 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794c00d7f0 con 0x7f79580b4180 2021-10-20T23:20:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 -- 172.21.15.12:0/760048815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 msgr2=0x7f7958140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 --2- 172.21.15.12:0/760048815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 0x7f7958140940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f794c002f70 tx=0x7f794c006df0).stop 2021-10-20T23:20:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 -- 172.21.15.12:0/760048815 shutdown_connections 2021-10-20T23:20:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 --2- 172.21.15.12:0/760048815 >> v2:172.21.15.31:3300/0 conn(0x7f79580b4690 0x7f79580b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 --2- 172.21.15.12:0/760048815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 0x7f7958140940 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 -- 172.21.15.12:0/760048815 >> 172.21.15.12:0/760048815 conn(0x7f795805c490 msgr2=0x7f795805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 -- 172.21.15.12:0/760048815 shutdown_connections 2021-10-20T23:20:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.674+0000 7f79603ca700 1 -- 172.21.15.12:0/760048815 wait complete. 2021-10-20T23:20:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 Processor -- start 2021-10-20T23:20:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 -- start start 2021-10-20T23:20:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 0x7f795813e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79580b4690 0x7f79581523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7958146950 0x7f79581528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7958146440 con 0x7f79580b4690 2021-10-20T23:20:07.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7958156570 con 0x7f7958146950 2021-10-20T23:20:07.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79580ae5a0 con 0x7f79580b4180 2021-10-20T23:20:07.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795d965700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79580b4690 0x7f79581523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795d965700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79580b4690 0x7f79581523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37118/0 (socket says 172.21.15.12:37118) 2021-10-20T23:20:07.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795d965700 1 -- 172.21.15.12:0/4121362604 learned_addr learned my addr 172.21.15.12:0/4121362604 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795e967700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7958146950 0x7f79581528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795e166700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 0x7f795813e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795d965700 1 -- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 msgr2=0x7f795813e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795d965700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 0x7f795813e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795d965700 1 -- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7958146950 msgr2=0x7f79581528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795d965700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7958146950 0x7f79581528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795d965700 1 -- 172.21.15.12:0/4121362604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c00b180 con 0x7f79580b4690 2021-10-20T23:20:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f795d965700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79580b4690 0x7f79581523d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f794c002f70 tx=0x7f794c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f794b7fe700 1 -- 172.21.15.12:0/4121362604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794c012930 con 0x7f79580b4690 2021-10-20T23:20:07.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f794b7fe700 1 -- 172.21.15.12:0/4121362604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c012a90 con 0x7f79580b4690 2021-10-20T23:20:07.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79580ae840 con 0x7f79580b4690 2021-10-20T23:20:07.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f794b7fe700 1 -- 172.21.15.12:0/4121362604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794c012df0 con 0x7f79580b4690 2021-10-20T23:20:07.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.678+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79580adb10 con 0x7f79580b4690 2021-10-20T23:20:07.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.682+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7958156770 con 0x7f79580b4690 2021-10-20T23:20:07.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.682+0000 7f794b7fe700 1 -- 172.21.15.12:0/4121362604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f794c01c070 con 0x7f79580b4690 2021-10-20T23:20:07.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.682+0000 7f794b7fe700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7938053610 0x7f7938055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.682+0000 7f794b7fe700 1 -- 172.21.15.12:0/4121362604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f794c06c4f0 con 0x7f79580b4690 2021-10-20T23:20:07.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.682+0000 7f795e166700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7938053610 0x7f7938055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.682+0000 7f795e166700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7938053610 0x7f7938055ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f795400d000 tx=0x7f7954009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.686+0000 7f794b7fe700 1 -- 172.21.15.12:0/4121362604 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7958156770 con 0x7f79580b4690 2021-10-20T23:20:07.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.814+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7958156770 con 0x7f79580b4690 2021-10-20T23:20:07.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.818+0000 7f794b7fe700 1 -- 172.21.15.12:0/4121362604 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7958156770 con 0x7f79580b4690 2021-10-20T23:20:07.823 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:07.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.818+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7938053610 msgr2=0x7f7938055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.818+0000 7f79603ca700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7938053610 0x7f7938055ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f795400d000 tx=0x7f7954009040).stop 2021-10-20T23:20:07.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.818+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79580b4690 msgr2=0x7f79581523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.818+0000 7f79603ca700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79580b4690 0x7f79581523d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f794c002f70 tx=0x7f794c014000).stop 2021-10-20T23:20:07.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.822+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 shutdown_connections 2021-10-20T23:20:07.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.822+0000 7f79603ca700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7938053610 0x7f7938055ad0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.822+0000 7f79603ca700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7958146950 0x7f79581528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.822+0000 7f79603ca700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79580b4690 0x7f79581523d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.822+0000 7f79603ca700 1 --2- 172.21.15.12:0/4121362604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f79580b4180 0x7f795813e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.822+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 >> 172.21.15.12:0/4121362604 conn(0x7f795805c490 msgr2=0x7f7958144a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:07.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.822+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 shutdown_connections 2021-10-20T23:20:07.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.822+0000 7f79603ca700 1 -- 172.21.15.12:0/4121362604 wait complete. 2021-10-20T23:20:07.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:07.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 Processor -- start 2021-10-20T23:20:07.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 -- start start 2021-10-20T23:20:07.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37a00b0010 0x7f37a00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00afbd0 0x7f37a00a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a00a70c0 con 0x7f37a00b2580 2021-10-20T23:20:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a00a72f0 con 0x7f37a00b0010 2021-10-20T23:20:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00a7590 con 0x7f37a00afbd0 2021-10-20T23:20:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a5493700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37a00b0010 0x7f37a00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6495700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00afbd0 0x7f37a00a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a5493700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37a00b0010 0x7f37a00a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:52098/0 (socket says 172.21.15.12:52098) 2021-10-20T23:20:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6495700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00afbd0 0x7f37a00a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:42886/0 (socket says 172.21.15.12:42886) 2021-10-20T23:20:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a5493700 1 -- 172.21.15.12:0/3025060387 learned_addr learned my addr 172.21.15.12:0/3025060387 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a5c94700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f37a00b2580 0x7f37a014ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:42782/0 (socket says 172.21.15.12:42782) 2021-10-20T23:20:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a5493700 1 -- 172.21.15.12:0/3025060387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00afbd0 msgr2=0x7f37a00a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a5493700 1 --2- 172.21.15.12:0/3025060387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00afbd0 0x7f37a00a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a5493700 1 -- 172.21.15.12:0/3025060387 >> v1:172.21.15.31:6789/0 conn(0x7f37a00b2580 legacy=0x7f37a014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a5493700 1 -- 172.21.15.12:0/3025060387 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00a7830 con 0x7f37a00b0010 2021-10-20T23:20:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a5493700 1 --2- 172.21.15.12:0/3025060387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a00b0010 0x7f37a00a83b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3790002f70 tx=0x7f3790006eb0).ready entity=mon.1 client_cookie=7c277d8e98ac3fef server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a4c92700 1 -- 172.21.15.12:0/3025060387 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f379000d570 con 0x7f37a00b0010 2021-10-20T23:20:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a4c92700 1 -- 172.21.15.12:0/3025060387 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790000e90 con 0x7f37a00b0010 2021-10-20T23:20:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a4c92700 1 -- 172.21.15.12:0/3025060387 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f379000d900 con 0x7f37a00b0010 2021-10-20T23:20:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 -- 172.21.15.12:0/3025060387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a00b0010 msgr2=0x7f37a00a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 --2- 172.21.15.12:0/3025060387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a00b0010 0x7f37a00a83b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3790002f70 tx=0x7f3790006eb0).stop 2021-10-20T23:20:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 -- 172.21.15.12:0/3025060387 shutdown_connections 2021-10-20T23:20:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 --2- 172.21.15.12:0/3025060387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00afbd0 0x7f37a00a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 --2- 172.21.15.12:0/3025060387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a00b0010 0x7f37a00a83b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 -- 172.21.15.12:0/3025060387 >> 172.21.15.12:0/3025060387 conn(0x7f37a0060180 msgr2=0x7f37a00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 -- 172.21.15.12:0/3025060387 shutdown_connections 2021-10-20T23:20:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.930+0000 7f37a6c96700 1 -- 172.21.15.12:0/3025060387 wait complete. 2021-10-20T23:20:07.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 Processor -- start 2021-10-20T23:20:07.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 -- start start 2021-10-20T23:20:07.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a00afbd0 0x7f37a00632a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a00b0010 0x7f37a00ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00b2580 0x7f37a0065ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00ac580 con 0x7f37a00afbd0 2021-10-20T23:20:07.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a01571c0 con 0x7f37a00b0010 2021-10-20T23:20:07.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00ac2d0 con 0x7f37a00b2580 2021-10-20T23:20:07.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a5c94700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a00afbd0 0x7f37a00632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6495700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00b2580 0x7f37a0065ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a5493700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a00b0010 0x7f37a00ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a5c94700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a00afbd0 0x7f37a00632a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37130/0 (socket says 172.21.15.12:37130) 2021-10-20T23:20:07.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a5c94700 1 -- 172.21.15.12:0/191833973 learned_addr learned my addr 172.21.15.12:0/191833973 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:07.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6495700 1 -- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a00b0010 msgr2=0x7f37a00ab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6495700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a00b0010 0x7f37a00ab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6495700 1 -- 172.21.15.12:0/191833973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a00afbd0 msgr2=0x7f37a00632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:07.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6495700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a00afbd0 0x7f37a00632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:07.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6495700 1 -- 172.21.15.12:0/191833973 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379000b1e0 con 0x7f37a00b2580 2021-10-20T23:20:07.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a5c94700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a00afbd0 0x7f37a00632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:07.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6495700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00b2580 0x7f37a0065ec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f37a0065ad0 tx=0x7f37980091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f378effd700 1 -- 172.21.15.12:0/191833973 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3798012600 con 0x7f37a00b2580 2021-10-20T23:20:07.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f378effd700 1 -- 172.21.15.12:0/191833973 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3798012760 con 0x7f37a00b2580 2021-10-20T23:20:07.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a0063790 con 0x7f37a00b2580 2021-10-20T23:20:07.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f378effd700 1 -- 172.21.15.12:0/191833973 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3798012ac0 con 0x7f37a00b2580 2021-10-20T23:20:07.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.934+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a0157420 con 0x7f37a00b2580 2021-10-20T23:20:07.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.938+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a0057350 con 0x7f37a00b2580 2021-10-20T23:20:07.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.938+0000 7f378effd700 1 -- 172.21.15.12:0/191833973 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3798022070 con 0x7f37a00b2580 2021-10-20T23:20:07.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.938+0000 7f378effd700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3780053610 0x7f3780055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:07.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.938+0000 7f378effd700 1 -- 172.21.15.12:0/191833973 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f379806c310 con 0x7f37a00b2580 2021-10-20T23:20:07.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.938+0000 7f37a5c94700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3780053610 0x7f3780055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:07.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.938+0000 7f37a5c94700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3780053610 0x7f3780055ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f379c00d000 tx=0x7f379c000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:07.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:07.946+0000 7f378effd700 1 -- 172.21.15.12:0/191833973 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3798043310 con 0x7f37a00b2580 2021-10-20T23:20:08.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.114+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37a00698e0 con 0x7f37a00b2580 2021-10-20T23:20:08.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.114+0000 7f378effd700 1 -- 172.21.15.12:0/191833973 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f3798016090 con 0x7f37a00b2580 2021-10-20T23:20:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:08.121 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1996246041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1996246041},{"type":"v1","addr":"172.21.15.31:6835","nonce":1996246041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/2770105392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2770105392},{"type":"v1","addr":"172.21.15.12:6833","nonce":2770105392}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:19:56.508295+0000","modified":"2021-10-20T23:19:58.195517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/2162960241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2162960241},{"type":"v1","addr":"172.21.15.12:6835","nonce":2162960241}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-20T23:20:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3780053610 msgr2=0x7f3780055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3780053610 0x7f3780055ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f379c00d000 tx=0x7f379c000bc0).stop 2021-10-20T23:20:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00b2580 msgr2=0x7f37a0065ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00b2580 0x7f37a0065ec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f37a0065ad0 tx=0x7f37980091d0).stop 2021-10-20T23:20:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 shutdown_connections 2021-10-20T23:20:08.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3780053610 0x7f3780055ad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a00b2580 0x7f37a0065ec0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a00b0010 0x7f37a00ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 --2- 172.21.15.12:0/191833973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a00afbd0 0x7f37a00632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 >> 172.21.15.12:0/191833973 conn(0x7f37a0060180 msgr2=0x7f37a00674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 shutdown_connections 2021-10-20T23:20:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.118+0000 7f37a6c96700 1 -- 172.21.15.12:0/191833973 wait complete. 2021-10-20T23:20:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2021-10-20T23:20:08.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:19:56.508295+0000', 'modified': '2021-10-20T23:19:58.195517+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/2162960241', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 2162960241}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 2162960241}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:20:08.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:20:08.438 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:20:08.555 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":4272,"want_state":"up:active","state":"up:active","rank_uptime":12.033122225,"mdsmap_epoch":7,"osdmap_epoch":25,"osdmap_epoch_barrier":25,"uptime":18.391585737} 2021-10-20T23:20:08.556 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 4272, "mdsmap_epoch": 7, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "rank_uptime": 12.033122225, "state": "up:active", "uptime": 18.391585737, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:20:08.556 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-10-20T23:20:08.583 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-10-20T23:20:08.584 INFO:tasks.ceph_fuse:config is None 2021-10-20T23:20:08.584 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None} 2021-10-20T23:20:08.585 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-10-20T23:20:08.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:08.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.690+0000 7f8ea7bd7700 1 Processor -- start 2021-10-20T23:20:08.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.690+0000 7f8ea7bd7700 1 -- start start 2021-10-20T23:20:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ea00b06e0 0x7f8ea0143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00673d0 con 0x7f8ea0066ff0 2021-10-20T23:20:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00affd0 con 0x7f8ea00ad030 2021-10-20T23:20:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea00b0270 con 0x7f8ea00b06e0 2021-10-20T23:20:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea6174700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ea00b06e0 0x7f8ea0143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea6174700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ea00b06e0 0x7f8ea0143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37140/0 (socket says 172.21.15.12:37140) 2021-10-20T23:20:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea6174700 1 -- 172.21.15.12:0/4206519917 learned_addr learned my addr 172.21.15.12:0/4206519917 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea6174700 1 -- 172.21.15.12:0/4206519917 >> v1:172.21.15.31:6789/0 conn(0x7f8ea00ad030 legacy=0x7f8ea00b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:08.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea6174700 1 -- 172.21.15.12:0/4206519917 >> v1:172.21.15.12:6789/0 conn(0x7f8ea0066ff0 legacy=0x7f8ea01438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea6174700 1 -- 172.21.15.12:0/4206519917 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00af3a0 con 0x7f8ea00b06e0 2021-10-20T23:20:08.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea6174700 1 --2- 172.21.15.12:0/4206519917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea00b06e0 0x7f8ea0143fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f8ea00625c0 tx=0x7f8e94006eb0).ready entity=mon.0 client_cookie=d4ec0627d363aa75 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:08.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea4971700 1 -- 172.21.15.12:0/4206519917 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9400d610 con 0x7f8ea00b06e0 2021-10-20T23:20:08.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea4971700 1 -- 172.21.15.12:0/4206519917 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94000e90 con 0x7f8ea00b06e0 2021-10-20T23:20:08.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea4971700 1 -- 172.21.15.12:0/4206519917 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9400d960 con 0x7f8ea00b06e0 2021-10-20T23:20:08.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/4206519917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea00b06e0 msgr2=0x7f8ea0143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 --2- 172.21.15.12:0/4206519917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea00b06e0 0x7f8ea0143fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f8ea00625c0 tx=0x7f8e94006eb0).stop 2021-10-20T23:20:08.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/4206519917 shutdown_connections 2021-10-20T23:20:08.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 --2- 172.21.15.12:0/4206519917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea00b06e0 0x7f8ea0143fe0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/4206519917 >> 172.21.15.12:0/4206519917 conn(0x7f8ea005f6b0 msgr2=0x7f8ea005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:08.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/4206519917 shutdown_connections 2021-10-20T23:20:08.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.694+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/4206519917 wait complete. 2021-10-20T23:20:08.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea7bd7700 1 Processor -- start 2021-10-20T23:20:08.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea7bd7700 1 -- start start 2021-10-20T23:20:08.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea7bd7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea0066ff0 0x7f8ea00a2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea7bd7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ea00b06e0 0x7f8ea00a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea7bd7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea0156060 0x7f8ea01564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea7bd7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00a3210 con 0x7f8ea0156060 2021-10-20T23:20:08.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea7bd7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea009ed40 con 0x7f8ea0066ff0 2021-10-20T23:20:08.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea7bd7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea0153890 con 0x7f8ea00b06e0 2021-10-20T23:20:08.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea6174700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea0156060 0x7f8ea01564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea6174700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea0156060 0x7f8ea01564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37146/0 (socket says 172.21.15.12:37146) 2021-10-20T23:20:08.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea6174700 1 -- 172.21.15.12:0/2394281660 learned_addr learned my addr 172.21.15.12:0/2394281660 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:08.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea5973700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea0066ff0 0x7f8ea00a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea5172700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ea00b06e0 0x7f8ea00a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea6174700 1 -- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ea00b06e0 msgr2=0x7f8ea00a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea6174700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ea00b06e0 0x7f8ea00a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea6174700 1 -- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea0066ff0 msgr2=0x7f8ea00a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea6174700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea0066ff0 0x7f8ea00a2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea6174700 1 -- 172.21.15.12:0/2394281660 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9400b1e0 con 0x7f8ea0156060 2021-10-20T23:20:08.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea5973700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea0066ff0 0x7f8ea00a2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:08.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8ea6174700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea0156060 0x7f8ea01564f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8ea00a3350 tx=0x7f8e94015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:08.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.698+0000 7f8e92ffd700 1 -- 172.21.15.12:0/2394281660 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e94002f70 con 0x7f8ea0156060 2021-10-20T23:20:08.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.702+0000 7f8e92ffd700 1 -- 172.21.15.12:0/2394281660 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9400bec0 con 0x7f8ea0156060 2021-10-20T23:20:08.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.702+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea009ef70 con 0x7f8ea0156060 2021-10-20T23:20:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.702+0000 7f8e92ffd700 1 -- 172.21.15.12:0/2394281660 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e94011d30 con 0x7f8ea0156060 2021-10-20T23:20:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.702+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea009f6b0 con 0x7f8ea0156060 2021-10-20T23:20:08.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.702+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea0153660 con 0x7f8ea0156060 2021-10-20T23:20:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.702+0000 7f8e92ffd700 1 -- 172.21.15.12:0/2394281660 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8e94025030 con 0x7f8ea0156060 2021-10-20T23:20:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.702+0000 7f8e92ffd700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e800536a0 0x7f8e80055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.702+0000 7f8e92ffd700 1 -- 172.21.15.12:0/2394281660 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8e9406cd60 con 0x7f8ea0156060 2021-10-20T23:20:08.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.702+0000 7f8ea5973700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e800536a0 0x7f8e80055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.706+0000 7f8ea5973700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e800536a0 0x7f8e80055b60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8e9c00d000 tx=0x7f8e9c000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.710+0000 7f8e92ffd700 1 -- 172.21.15.12:0/2394281660 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8e94043c50 con 0x7f8ea0156060 2021-10-20T23:20:08.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.838+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ea009f8a0 con 0x7f8ea0156060 2021-10-20T23:20:08.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.838+0000 7f8e92ffd700 1 -- 172.21.15.12:0/2394281660 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f8e94023020 con 0x7f8ea0156060 2021-10-20T23:20:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:08.845 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:08.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e800536a0 msgr2=0x7f8e80055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e800536a0 0x7f8e80055b60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8e9c00d000 tx=0x7f8e9c000bc0).stop 2021-10-20T23:20:08.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea0156060 msgr2=0x7f8ea01564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea0156060 0x7f8ea01564f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8ea00a3350 tx=0x7f8e94015000).stop 2021-10-20T23:20:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 shutdown_connections 2021-10-20T23:20:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e800536a0 0x7f8e80055b60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ea0156060 0x7f8ea01564f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ea00b06e0 0x7f8ea00a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 --2- 172.21.15.12:0/2394281660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea0066ff0 0x7f8ea00a2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 >> 172.21.15.12:0/2394281660 conn(0x7f8ea005f6b0 msgr2=0x7f8ea0141dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 shutdown_connections 2021-10-20T23:20:08.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.842+0000 7f8ea7bd7700 1 -- 172.21.15.12:0/2394281660 wait complete. 2021-10-20T23:20:08.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:19:51.434642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:19:54.214563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:20:08.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:20:08.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cf0d3700 1 Processor -- start 2021-10-20T23:20:08.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cf0d3700 1 -- start start 2021-10-20T23:20:08.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cf0d3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55c80ad5c0 0x7f55c8061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cf0d3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 0x7f55c81408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cf0d3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80aecf0 con 0x7f55c8061320 2021-10-20T23:20:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cf0d3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c80b6f20 con 0x7f55c80ad5c0 2021-10-20T23:20:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cf0d3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80aef20 con 0x7f55c8140440 2021-10-20T23:20:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cd8d0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55c80ad5c0 0x7f55c8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cd8d0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55c80ad5c0 0x7f55c8061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37154/0 (socket says 172.21.15.12:37154) 2021-10-20T23:20:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cd8d0700 1 -- 172.21.15.12:0/3985181185 learned_addr learned my addr 172.21.15.12:0/3985181185 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55ce8d2700 1 --2- 172.21.15.12:0/3985181185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 0x7f55c81408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cd8d0700 1 -- 172.21.15.12:0/3985181185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 msgr2=0x7f55c81408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cd8d0700 1 --2- 172.21.15.12:0/3985181185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 0x7f55c81408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cd8d0700 1 -- 172.21.15.12:0/3985181185 >> v1:172.21.15.31:6789/0 conn(0x7f55c8061320 legacy=0x7f55c80b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cd8d0700 1 -- 172.21.15.12:0/3985181185 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c80af1c0 con 0x7f55c80ad5c0 2021-10-20T23:20:08.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.966+0000 7f55cd8d0700 1 --2- 172.21.15.12:0/3985181185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c80ad5c0 0x7f55c8061700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f55b8002f70 tx=0x7f55b8006eb0).ready entity=mon.0 client_cookie=816647053dea66b8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:08.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cd0cf700 1 -- 172.21.15.12:0/3985181185 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55b800d570 con 0x7f55c80ad5c0 2021-10-20T23:20:08.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cd0cf700 1 -- 172.21.15.12:0/3985181185 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b8000e90 con 0x7f55c80ad5c0 2021-10-20T23:20:08.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cd0cf700 1 -- 172.21.15.12:0/3985181185 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55b800d900 con 0x7f55c80ad5c0 2021-10-20T23:20:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 -- 172.21.15.12:0/3985181185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c80ad5c0 msgr2=0x7f55c8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 --2- 172.21.15.12:0/3985181185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c80ad5c0 0x7f55c8061700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f55b8002f70 tx=0x7f55b8006eb0).stop 2021-10-20T23:20:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 -- 172.21.15.12:0/3985181185 shutdown_connections 2021-10-20T23:20:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 --2- 172.21.15.12:0/3985181185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 0x7f55c81408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 --2- 172.21.15.12:0/3985181185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c80ad5c0 0x7f55c8061700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 -- 172.21.15.12:0/3985181185 >> 172.21.15.12:0/3985181185 conn(0x7f55c8066de0 msgr2=0x7f55c80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:08.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 -- 172.21.15.12:0/3985181185 shutdown_connections 2021-10-20T23:20:08.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 -- 172.21.15.12:0/3985181185 wait complete. 2021-10-20T23:20:08.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 Processor -- start 2021-10-20T23:20:08.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.970+0000 7f55cf0d3700 1 -- start start 2021-10-20T23:20:08.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55cf0d3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c8061320 0x7f55c80ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55cf0d3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55c80ad5c0 0x7f55c81530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55cf0d3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 0x7f55c80b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55cf0d3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80b14b0 con 0x7f55c8061320 2021-10-20T23:20:08.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55cf0d3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c81526c0 con 0x7f55c80ad5c0 2021-10-20T23:20:08.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55cf0d3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8152960 con 0x7f55c8140440 2021-10-20T23:20:08.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce0d1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c8061320 0x7f55c80ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce0d1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c8061320 0x7f55c80ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37156/0 (socket says 172.21.15.12:37156) 2021-10-20T23:20:08.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce0d1700 1 -- 172.21.15.12:0/494448347 learned_addr learned my addr 172.21.15.12:0/494448347 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:08.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55cd8d0700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55c80ad5c0 0x7f55c81530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce8d2700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 0x7f55c80b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce0d1700 1 -- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 msgr2=0x7f55c80b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce0d1700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 0x7f55c80b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce0d1700 1 -- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55c80ad5c0 msgr2=0x7f55c81530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:08.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce0d1700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55c80ad5c0 0x7f55c81530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:08.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce0d1700 1 -- 172.21.15.12:0/494448347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b800b1e0 con 0x7f55c8061320 2021-10-20T23:20:08.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55ce0d1700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c8061320 0x7f55c80ac460 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f55c80af7e0 tx=0x7f55c4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:08.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55b77fe700 1 -- 172.21.15.12:0/494448347 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55c4007030 con 0x7f55c8061320 2021-10-20T23:20:08.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55b77fe700 1 -- 172.21.15.12:0/494448347 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4007190 con 0x7f55c8061320 2021-10-20T23:20:08.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c8152c00 con 0x7f55c8061320 2021-10-20T23:20:08.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55b77fe700 1 -- 172.21.15.12:0/494448347 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55c4006510 con 0x7f55c8061320 2021-10-20T23:20:08.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.974+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c8153590 con 0x7f55c8061320 2021-10-20T23:20:08.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.978+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c8152d90 con 0x7f55c8061320 2021-10-20T23:20:08.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.978+0000 7f55b77fe700 1 -- 172.21.15.12:0/494448347 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f55c4010030 con 0x7f55c8061320 2021-10-20T23:20:08.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.978+0000 7f55b77fe700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f55a8053580 0x7f55a8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:08.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.978+0000 7f55b77fe700 1 -- 172.21.15.12:0/494448347 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f55c406b610 con 0x7f55c8061320 2021-10-20T23:20:08.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.978+0000 7f55cd8d0700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f55a8053580 0x7f55a8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:08.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.978+0000 7f55cd8d0700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f55a8053580 0x7f55a8055a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f55b801c000 tx=0x7f55b8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:08.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:08.982+0000 7f55b77fe700 1 -- 172.21.15.12:0/494448347 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f55c4042610 con 0x7f55c8061320 2021-10-20T23:20:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.114+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f55c8057350 con 0x7f55c8061320 2021-10-20T23:20:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55b77fe700 1 -- 172.21.15.12:0/494448347 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f55c4045c30 con 0x7f55c8061320 2021-10-20T23:20:09.122 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:20:09.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f55a8053580 msgr2=0x7f55a8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f55a8053580 0x7f55a8055a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f55b801c000 tx=0x7f55b8015000).stop 2021-10-20T23:20:09.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c8061320 msgr2=0x7f55c80ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c8061320 0x7f55c80ac460 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f55c80af7e0 tx=0x7f55c4007c10).stop 2021-10-20T23:20:09.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 shutdown_connections 2021-10-20T23:20:09.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f55a8053580 0x7f55a8055a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55c8140440 0x7f55c80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55c80ad5c0 0x7f55c81530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 --2- 172.21.15.12:0/494448347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c8061320 0x7f55c80ac460 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 >> 172.21.15.12:0/494448347 conn(0x7f55c8066de0 msgr2=0x7f55c805cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 shutdown_connections 2021-10-20T23:20:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.118+0000 7f55cf0d3700 1 -- 172.21.15.12:0/494448347 wait complete. 2021-10-20T23:20:09.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:20:09.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f1cbd700 1 Processor -- start 2021-10-20T23:20:09.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f1cbd700 1 -- start start 2021-10-20T23:20:09.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f1cbd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f06ec061320 0x7f06ec061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f1cbd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec0ad5c0 0x7f06ec0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f1cbd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec0aecf0 con 0x7f06ec140440 2021-10-20T23:20:09.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f1cbd700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0b6f20 con 0x7f06ec061320 2021-10-20T23:20:09.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f1cbd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0aef20 con 0x7f06ec0ad5c0 2021-10-20T23:20:09.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f0cbb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f06ec061320 0x7f06ec061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f0cbb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f06ec061320 0x7f06ec061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37166/0 (socket says 172.21.15.12:37166) 2021-10-20T23:20:09.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06ebfff700 1 --2- 172.21.15.12:0/4244786308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec0ad5c0 0x7f06ec0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f0cbb700 1 -- 172.21.15.12:0/4244786308 learned_addr learned my addr 172.21.15.12:0/4244786308 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:09.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06eb7fe700 1 -- 172.21.15.12:0/4244786308 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969685811 0 0) 0x7f06ec0aecf0 con 0x7f06ec140440 2021-10-20T23:20:09.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06eb7fe700 1 -- 172.21.15.12:0/4244786308 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d8003260 con 0x7f06ec140440 2021-10-20T23:20:09.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f0cbb700 1 -- 172.21.15.12:0/4244786308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec0ad5c0 msgr2=0x7f06ec0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:09.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f0cbb700 1 --2- 172.21.15.12:0/4244786308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec0ad5c0 0x7f06ec0b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f0cbb700 1 -- 172.21.15.12:0/4244786308 >> v1:172.21.15.31:6789/0 conn(0x7f06ec140440 legacy=0x7f06ec146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f0cbb700 1 -- 172.21.15.12:0/4244786308 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0af1c0 con 0x7f06ec061320 2021-10-20T23:20:09.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06ebfff700 1 --2- 172.21.15.12:0/4244786308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec0ad5c0 0x7f06ec0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:09.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.242+0000 7f06f0cbb700 1 --2- 172.21.15.12:0/4244786308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec061320 0x7f06ec061700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f06e0002f70 tx=0x7f06e0006eb0).ready entity=mon.0 client_cookie=c32a1acb75e53a01 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:09.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06eb7fe700 1 -- 172.21.15.12:0/4244786308 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e000d5c0 con 0x7f06ec061320 2021-10-20T23:20:09.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06eb7fe700 1 -- 172.21.15.12:0/4244786308 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0000e90 con 0x7f06ec061320 2021-10-20T23:20:09.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06eb7fe700 1 -- 172.21.15.12:0/4244786308 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e000d950 con 0x7f06ec061320 2021-10-20T23:20:09.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 -- 172.21.15.12:0/4244786308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec061320 msgr2=0x7f06ec061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 --2- 172.21.15.12:0/4244786308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec061320 0x7f06ec061700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f06e0002f70 tx=0x7f06e0006eb0).stop 2021-10-20T23:20:09.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 -- 172.21.15.12:0/4244786308 shutdown_connections 2021-10-20T23:20:09.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 --2- 172.21.15.12:0/4244786308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec0ad5c0 0x7f06ec0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 --2- 172.21.15.12:0/4244786308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec061320 0x7f06ec061700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 -- 172.21.15.12:0/4244786308 >> 172.21.15.12:0/4244786308 conn(0x7f06ec066de0 msgr2=0x7f06ec0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:09.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 -- 172.21.15.12:0/4244786308 shutdown_connections 2021-10-20T23:20:09.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 -- 172.21.15.12:0/4244786308 wait complete. 2021-10-20T23:20:09.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 Processor -- start 2021-10-20T23:20:09.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.246+0000 7f06f1cbd700 1 -- start start 2021-10-20T23:20:09.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f1cbd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec061320 0x7f06ec0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f1cbd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06ec0ad5c0 0x7f06ec147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f1cbd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec140440 0x7f06ec148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f1cbd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0b3d70 con 0x7f06ec140440 2021-10-20T23:20:09.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f1cbd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec14a880 con 0x7f06ec0ad5c0 2021-10-20T23:20:09.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f1cbd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec153320 con 0x7f06ec061320 2021-10-20T23:20:09.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f14bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec140440 0x7f06ec148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f14bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec140440 0x7f06ec148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37174/0 (socket says 172.21.15.12:37174) 2021-10-20T23:20:09.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f14bc700 1 -- 172.21.15.12:0/3374396285 learned_addr learned my addr 172.21.15.12:0/3374396285 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:09.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06ebfff700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06ec0ad5c0 0x7f06ec147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f0cbb700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec061320 0x7f06ec0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f14bc700 1 -- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec061320 msgr2=0x7f06ec0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f14bc700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec061320 0x7f06ec0b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f14bc700 1 -- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06ec0ad5c0 msgr2=0x7f06ec147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f14bc700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06ec0ad5c0 0x7f06ec147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f14bc700 1 -- 172.21.15.12:0/3374396285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc00b180 con 0x7f06ec140440 2021-10-20T23:20:09.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06ebfff700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06ec0ad5c0 0x7f06ec147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:09.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f14bc700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec140440 0x7f06ec148230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f06ec143910 tx=0x7f06e4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:09.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06e9ffb700 1 -- 172.21.15.12:0/3374396285 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e4002310 con 0x7f06ec140440 2021-10-20T23:20:09.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06e9ffb700 1 -- 172.21.15.12:0/3374396285 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4002470 con 0x7f06ec140440 2021-10-20T23:20:09.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e000b1e0 con 0x7f06ec140440 2021-10-20T23:20:09.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06e9ffb700 1 -- 172.21.15.12:0/3374396285 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e40017a0 con 0x7f06ec140440 2021-10-20T23:20:09.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec1496e0 con 0x7f06ec140440 2021-10-20T23:20:09.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06e9ffb700 1 -- 172.21.15.12:0/3374396285 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f06e4010030 con 0x7f06ec140440 2021-10-20T23:20:09.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.250+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec0af460 con 0x7f06ec140440 2021-10-20T23:20:09.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.254+0000 7f06e9ffb700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06cc053580 0x7f06cc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.254+0000 7f06e9ffb700 1 -- 172.21.15.12:0/3374396285 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f06e406bb30 con 0x7f06ec140440 2021-10-20T23:20:09.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.254+0000 7f06f0cbb700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06cc053580 0x7f06cc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.254+0000 7f06f0cbb700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06cc053580 0x7f06cc055a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f06e001a000 tx=0x7f06e0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:09.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.258+0000 7f06e9ffb700 1 -- 172.21.15.12:0/3374396285 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06e4042a20 con 0x7f06ec140440 2021-10-20T23:20:09.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.386+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06ec0b3ec0 con 0x7f06ec140440 2021-10-20T23:20:09.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.386+0000 7f06e9ffb700 1 -- 172.21.15.12:0/3374396285 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06e4046040 con 0x7f06ec140440 2021-10-20T23:20:09.392 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:09.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06cc053580 msgr2=0x7f06cc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06cc053580 0x7f06cc055a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f06e001a000 tx=0x7f06e0015000).stop 2021-10-20T23:20:09.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec140440 msgr2=0x7f06ec148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec140440 0x7f06ec148230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f06ec143910 tx=0x7f06e4007dd0).stop 2021-10-20T23:20:09.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 shutdown_connections 2021-10-20T23:20:09.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06cc053580 0x7f06cc055a40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06ec140440 0x7f06ec148230 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06ec0ad5c0 0x7f06ec147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 --2- 172.21.15.12:0/3374396285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06ec061320 0x7f06ec0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 >> 172.21.15.12:0/3374396285 conn(0x7f06ec066de0 msgr2=0x7f06ec0b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:09.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 shutdown_connections 2021-10-20T23:20:09.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.390+0000 7f06f1cbd700 1 -- 172.21.15.12:0/3374396285 wait complete. 2021-10-20T23:20:09.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:20:09.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 Processor -- start 2021-10-20T23:20:09.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 -- start start 2021-10-20T23:20:09.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6278061920 0x7f6278143d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6278063cb0 con 0x7f62780638d0 2021-10-20T23:20:09.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6278061ff0 con 0x7f6278140980 2021-10-20T23:20:09.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627813fdb0 con 0x7f6278061920 2021-10-20T23:20:09.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f62767fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6278061920 0x7f6278143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6276ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f62780638d0 0x7f62780b12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35772/0 (socket says 172.21.15.12:35772) 2021-10-20T23:20:09.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f62767fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6278061920 0x7f6278143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37180/0 (socket says 172.21.15.12:37180) 2021-10-20T23:20:09.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6276ffd700 1 -- 172.21.15.12:0/482326472 learned_addr learned my addr 172.21.15.12:0/482326472 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:09.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6275ffb700 1 -- 172.21.15.12:0/482326472 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404851296 0 0) 0x7f6278063cb0 con 0x7f62780638d0 2021-10-20T23:20:09.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6275ffb700 1 -- 172.21.15.12:0/482326472 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f625c003260 con 0x7f62780638d0 2021-10-20T23:20:09.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f62767fc700 1 -- 172.21.15.12:0/482326472 >> v1:172.21.15.31:6789/0 conn(0x7f6278140980 legacy=0x7f6278128c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f62767fc700 1 -- 172.21.15.12:0/482326472 >> v1:172.21.15.12:6789/0 conn(0x7f62780638d0 legacy=0x7f62780b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f62767fc700 1 -- 172.21.15.12:0/482326472 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627813ffa0 con 0x7f6278061920 2021-10-20T23:20:09.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f62767fc700 1 --2- 172.21.15.12:0/482326472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 0x7f6278143d50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f626c002f70 tx=0x7f626c006df0).ready entity=mon.0 client_cookie=72e6f44365c2e41e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:09.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6275ffb700 1 -- 172.21.15.12:0/482326472 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f626c00d610 con 0x7f6278061920 2021-10-20T23:20:09.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6275ffb700 1 -- 172.21.15.12:0/482326472 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c000e90 con 0x7f6278061920 2021-10-20T23:20:09.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6275ffb700 1 -- 172.21.15.12:0/482326472 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f626c00d960 con 0x7f6278061920 2021-10-20T23:20:09.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 -- 172.21.15.12:0/482326472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 msgr2=0x7f6278143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 --2- 172.21.15.12:0/482326472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 0x7f6278143d50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f626c002f70 tx=0x7f626c006df0).stop 2021-10-20T23:20:09.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 -- 172.21.15.12:0/482326472 shutdown_connections 2021-10-20T23:20:09.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 --2- 172.21.15.12:0/482326472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 0x7f6278143d50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 -- 172.21.15.12:0/482326472 >> 172.21.15.12:0/482326472 conn(0x7f627805c490 msgr2=0x7f627805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 -- 172.21.15.12:0/482326472 shutdown_connections 2021-10-20T23:20:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.522+0000 7f6277fff700 1 -- 172.21.15.12:0/482326472 wait complete. 2021-10-20T23:20:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6277fff700 1 Processor -- start 2021-10-20T23:20:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6277fff700 1 -- start start 2021-10-20T23:20:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6277fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 0x7f627814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6277fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780638d0 0x7f6278064670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6277fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6278140980 0x7f62780b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6277fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62780b47a0 con 0x7f6278061920 2021-10-20T23:20:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6277fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278066fb0 con 0x7f62780638d0 2021-10-20T23:20:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6277fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62780b5bd0 con 0x7f6278140980 2021-10-20T23:20:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6276ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 0x7f627814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6276ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 0x7f627814f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37184/0 (socket says 172.21.15.12:37184) 2021-10-20T23:20:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6276ffd700 1 -- 172.21.15.12:0/3651321711 learned_addr learned my addr 172.21.15.12:0/3651321711 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f62767fc700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780638d0 0x7f6278064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f62777fe700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6278140980 0x7f62780b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6276ffd700 1 -- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6278140980 msgr2=0x7f62780b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6276ffd700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6278140980 0x7f62780b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6276ffd700 1 -- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780638d0 msgr2=0x7f6278064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6276ffd700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780638d0 0x7f6278064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6276ffd700 1 -- 172.21.15.12:0/3651321711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c00b180 con 0x7f6278061920 2021-10-20T23:20:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f62767fc700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780638d0 0x7f6278064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f62777fe700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6278140980 0x7f62780b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.526+0000 7f6276ffd700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 0x7f627814f480 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6268001110 tx=0x7f6268007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f6267fff700 1 -- 172.21.15.12:0/3651321711 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f626800ce20 con 0x7f6278061920 2021-10-20T23:20:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f6267fff700 1 -- 172.21.15.12:0/3651321711 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62680072e0 con 0x7f6278061920 2021-10-20T23:20:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62780b03d0 con 0x7f6278061920 2021-10-20T23:20:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f6267fff700 1 -- 172.21.15.12:0/3651321711 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6268005800 con 0x7f6278061920 2021-10-20T23:20:09.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62780b5ec0 con 0x7f6278061920 2021-10-20T23:20:09.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6278066e10 con 0x7f6278061920 2021-10-20T23:20:09.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f6267fff700 1 -- 172.21.15.12:0/3651321711 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6268010070 con 0x7f6278061920 2021-10-20T23:20:09.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f6267fff700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6254053580 0x7f6254055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f6267fff700 1 -- 172.21.15.12:0/3651321711 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f626806b270 con 0x7f6278061920 2021-10-20T23:20:09.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.530+0000 7f62767fc700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6254053580 0x7f6254055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.534+0000 7f62767fc700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6254053580 0x7f6254055a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f626c01a000 tx=0x7f626c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:09.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.538+0000 7f6267fff700 1 -- 172.21.15.12:0/3651321711 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6278066e10 con 0x7f6278061920 2021-10-20T23:20:09.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.662+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6278066e10 con 0x7f6278061920 2021-10-20T23:20:09.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6267fff700 1 -- 172.21.15.12:0/3651321711 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6278066e10 con 0x7f6278061920 2021-10-20T23:20:09.669 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:09.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6254053580 msgr2=0x7f6254055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6254053580 0x7f6254055a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f626c01a000 tx=0x7f626c014000).stop 2021-10-20T23:20:09.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 msgr2=0x7f627814f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 0x7f627814f480 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6268001110 tx=0x7f6268007ad0).stop 2021-10-20T23:20:09.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 shutdown_connections 2021-10-20T23:20:09.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6254053580 0x7f6254055a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6278140980 0x7f62780b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780638d0 0x7f6278064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 --2- 172.21.15.12:0/3651321711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6278061920 0x7f627814f480 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 >> 172.21.15.12:0/3651321711 conn(0x7f627805c490 msgr2=0x7f627813e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:09.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 shutdown_connections 2021-10-20T23:20:09.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.666+0000 7f6277fff700 1 -- 172.21.15.12:0/3651321711 wait complete. 2021-10-20T23:20:09.682 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:20:09.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1bfff700 1 Processor -- start 2021-10-20T23:20:09.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1bfff700 1 -- start start 2021-10-20T23:20:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff1c0b0710 0x7eff1c142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b30d0 0x7eff1c143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1bfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c0b0af0 con 0x7eff1c0ace70 2021-10-20T23:20:09.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1bfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0ae680 con 0x7eff1c0b0710 2021-10-20T23:20:09.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0ae920 con 0x7eff1c0b30d0 2021-10-20T23:20:09.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff1c0b0710 0x7eff1c142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1a7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b30d0 0x7eff1c143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7eff1c0ace70 0x7eff1c05f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:42854/0 (socket says 172.21.15.12:42854) 2021-10-20T23:20:09.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1b7fe700 1 -- 172.21.15.12:0/1668470832 learned_addr learned my addr 172.21.15.12:0/1668470832 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:09.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.794+0000 7eff1affd700 1 --2- 172.21.15.12:0/1668470832 >> v2:172.21.15.31:3300/0 conn(0x7eff1c0b0710 0x7eff1c142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:52166/0 (socket says 172.21.15.12:52166) 2021-10-20T23:20:09.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff19ffb700 1 -- 172.21.15.12:0/1668470832 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923845943 0 0) 0x7eff1c0b0af0 con 0x7eff1c0ace70 2021-10-20T23:20:09.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1668470832 >> v2:172.21.15.31:3300/0 conn(0x7eff1c0b0710 msgr2=0x7eff1c142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:09.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1a7fc700 1 --2- 172.21.15.12:0/1668470832 >> v2:172.21.15.31:3300/0 conn(0x7eff1c0b0710 0x7eff1c142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1668470832 >> v1:172.21.15.31:6789/0 conn(0x7eff1c0ace70 legacy=0x7eff1c05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1668470832 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0aebc0 con 0x7eff1c0b30d0 2021-10-20T23:20:09.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1a7fc700 1 --2- 172.21.15.12:0/1668470832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b30d0 0x7eff1c143210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7eff10002f70 tx=0x7eff10006df0).ready entity=mon.2 client_cookie=4230d88ba0ef4551 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff19ffb700 1 -- 172.21.15.12:0/1668470832 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1000d570 con 0x7eff1c0b30d0 2021-10-20T23:20:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff19ffb700 1 -- 172.21.15.12:0/1668470832 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10000e90 con 0x7eff1c0b30d0 2021-10-20T23:20:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff19ffb700 1 -- 172.21.15.12:0/1668470832 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1000d8c0 con 0x7eff1c0b30d0 2021-10-20T23:20:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 -- 172.21.15.12:0/1668470832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b30d0 msgr2=0x7eff1c143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 --2- 172.21.15.12:0/1668470832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b30d0 0x7eff1c143210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7eff10002f70 tx=0x7eff10006df0).stop 2021-10-20T23:20:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 -- 172.21.15.12:0/1668470832 shutdown_connections 2021-10-20T23:20:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 --2- 172.21.15.12:0/1668470832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b30d0 0x7eff1c143210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 --2- 172.21.15.12:0/1668470832 >> v2:172.21.15.31:3300/0 conn(0x7eff1c0b0710 0x7eff1c142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 -- 172.21.15.12:0/1668470832 >> 172.21.15.12:0/1668470832 conn(0x7eff1c061140 msgr2=0x7eff1c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 -- 172.21.15.12:0/1668470832 shutdown_connections 2021-10-20T23:20:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 -- 172.21.15.12:0/1668470832 wait complete. 2021-10-20T23:20:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 Processor -- start 2021-10-20T23:20:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.798+0000 7eff1bfff700 1 -- start start 2021-10-20T23:20:09.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0ace70 0x7eff1c1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b0710 0x7eff1c0ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c0b30d0 0x7eff1c066240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c066730 con 0x7eff1c0ace70 2021-10-20T23:20:09.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c065630 con 0x7eff1c0b30d0 2021-10-20T23:20:09.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0658d0 con 0x7eff1c0b0710 2021-10-20T23:20:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0ace70 0x7eff1c1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0ace70 0x7eff1c1522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37200/0 (socket says 172.21.15.12:37200) 2021-10-20T23:20:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1a7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b0710 0x7eff1c0ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1affd700 1 -- 172.21.15.12:0/638098781 learned_addr learned my addr 172.21.15.12:0/638098781 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1b7fe700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c0b30d0 0x7eff1c066240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1affd700 1 -- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b0710 msgr2=0x7eff1c0ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1affd700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b0710 0x7eff1c0ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1affd700 1 -- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c0b30d0 msgr2=0x7eff1c066240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1affd700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c0b30d0 0x7eff1c066240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1affd700 1 -- 172.21.15.12:0/638098781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1000b180 con 0x7eff1c0ace70 2021-10-20T23:20:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1affd700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0ace70 0x7eff1c1522c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7eff0c00c000 tx=0x7eff0c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff0bfff700 1 -- 172.21.15.12:0/638098781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff0c010780 con 0x7eff1c0ace70 2021-10-20T23:20:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff0bfff700 1 -- 172.21.15.12:0/638098781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c0108e0 con 0x7eff1c0ace70 2021-10-20T23:20:09.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff0bfff700 1 -- 172.21.15.12:0/638098781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff0c010c40 con 0x7eff1c0ace70 2021-10-20T23:20:09.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c065b70 con 0x7eff1c0ace70 2021-10-20T23:20:09.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.802+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c0a2ee0 con 0x7eff1c0ace70 2021-10-20T23:20:09.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.806+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c057350 con 0x7eff1c0ace70 2021-10-20T23:20:09.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.806+0000 7eff0bfff700 1 -- 172.21.15.12:0/638098781 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff0c01c460 con 0x7eff1c0ace70 2021-10-20T23:20:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.806+0000 7eff0bfff700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efef80535b0 0x7efef8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.806+0000 7eff0bfff700 1 -- 172.21.15.12:0/638098781 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7eff0c06be00 con 0x7eff1c0ace70 2021-10-20T23:20:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.806+0000 7eff1a7fc700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efef80535b0 0x7efef8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.806+0000 7eff1a7fc700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efef80535b0 0x7efef8055a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7eff1001a000 tx=0x7eff10014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:09.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.814+0000 7eff0bfff700 1 -- 172.21.15.12:0/638098781 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff0c042da0 con 0x7eff1c0ace70 2021-10-20T23:20:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff1c0b2c70 con 0x7eff1c0ace70 2021-10-20T23:20:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff0bfff700 1 -- 172.21.15.12:0/638098781 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7eff0c0463c0 con 0x7eff1c0ace70 2021-10-20T23:20:09.946 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:09.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efef80535b0 msgr2=0x7efef8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efef80535b0 0x7efef8055a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7eff1001a000 tx=0x7eff10014000).stop 2021-10-20T23:20:09.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0ace70 msgr2=0x7eff1c1522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0ace70 0x7eff1c1522c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7eff0c00c000 tx=0x7eff0c006df0).stop 2021-10-20T23:20:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 shutdown_connections 2021-10-20T23:20:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efef80535b0 0x7efef8055a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c0b30d0 0x7eff1c066240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c0b0710 0x7eff1c0ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 --2- 172.21.15.12:0/638098781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0ace70 0x7eff1c1522c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:09.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 >> 172.21.15.12:0/638098781 conn(0x7eff1c061140 msgr2=0x7eff1c141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:09.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 shutdown_connections 2021-10-20T23:20:09.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:09.942+0000 7eff1bfff700 1 -- 172.21.15.12:0/638098781 wait complete. 2021-10-20T23:20:09.958 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:20:09.959 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:10.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53df59e700 1 Processor -- start 2021-10-20T23:20:10.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53df59e700 1 -- start start 2021-10-20T23:20:10.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53df59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53e00ad5c0 0x7f53e0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:10.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53df59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f53e0140440 0x7f53e01408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:10.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53df59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00aecf0 con 0x7f53e0061320 2021-10-20T23:20:10.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53df59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e00b6f20 con 0x7f53e00ad5c0 2021-10-20T23:20:10.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53df59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e00aef20 con 0x7f53e0140440 2021-10-20T23:20:10.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53de59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f53e0061320 0x7f53e00b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35800/0 (socket says 172.21.15.12:35800) 2021-10-20T23:20:10.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53de59c700 1 -- 172.21.15.12:0/1188518949 learned_addr learned my addr 172.21.15.12:0/1188518949 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:10.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53ddd9b700 1 --2- 172.21.15.12:0/1188518949 >> v2:172.21.15.12:3300/0 conn(0x7f53e00ad5c0 0x7f53e0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:10.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53ded9d700 1 --2- 172.21.15.12:0/1188518949 >> v2:172.21.15.31:3300/0 conn(0x7f53e0140440 0x7f53e01408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:10.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53dd59a700 1 -- 172.21.15.12:0/1188518949 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039326986 0 0) 0x7f53e00aecf0 con 0x7f53e0061320 2021-10-20T23:20:10.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.054+0000 7f53dd59a700 1 -- 172.21.15.12:0/1188518949 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53c0003260 con 0x7f53e0061320 2021-10-20T23:20:10.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53ddd9b700 1 -- 172.21.15.12:0/1188518949 >> v2:172.21.15.31:3300/0 conn(0x7f53e0140440 msgr2=0x7f53e01408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:10.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53dd59a700 1 -- 172.21.15.12:0/1188518949 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3542395823 0 0) 0x7f53c0003260 con 0x7f53e0061320 2021-10-20T23:20:10.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53ddd9b700 1 --2- 172.21.15.12:0/1188518949 >> v2:172.21.15.31:3300/0 conn(0x7f53e0140440 0x7f53e01408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:10.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53ddd9b700 1 -- 172.21.15.12:0/1188518949 >> v1:172.21.15.12:6789/0 conn(0x7f53e0061320 legacy=0x7f53e00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:10.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53ddd9b700 1 -- 172.21.15.12:0/1188518949 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00af1c0 con 0x7f53e00ad5c0 2021-10-20T23:20:10.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53ded9d700 1 --2- 172.21.15.12:0/1188518949 >> v2:172.21.15.31:3300/0 conn(0x7f53e0140440 0x7f53e01408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:10.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53ddd9b700 1 --2- 172.21.15.12:0/1188518949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e00ad5c0 0x7f53e0061700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f53d0001b80 tx=0x7f53c8006df0).ready entity=mon.0 client_cookie=32d1c22586fc06c4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:10.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53dd59a700 1 -- 172.21.15.12:0/1188518949 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d00019e0 con 0x7f53e00ad5c0 2021-10-20T23:20:10.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53dd59a700 1 -- 172.21.15.12:0/1188518949 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8000e90 con 0x7f53e00ad5c0 2021-10-20T23:20:10.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53dd59a700 1 -- 172.21.15.12:0/1188518949 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c800d4a0 con 0x7f53e00ad5c0 2021-10-20T23:20:10.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53df59e700 1 -- 172.21.15.12:0/1188518949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e00ad5c0 msgr2=0x7f53e0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:10.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53df59e700 1 --2- 172.21.15.12:0/1188518949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e00ad5c0 0x7f53e0061700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f53d0001b80 tx=0x7f53c8006df0).stop 2021-10-20T23:20:10.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53df59e700 1 -- 172.21.15.12:0/1188518949 shutdown_connections 2021-10-20T23:20:10.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53df59e700 1 --2- 172.21.15.12:0/1188518949 >> v2:172.21.15.31:3300/0 conn(0x7f53e0140440 0x7f53e01408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:10.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53df59e700 1 --2- 172.21.15.12:0/1188518949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e00ad5c0 0x7f53e0061700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:10.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53df59e700 1 -- 172.21.15.12:0/1188518949 >> 172.21.15.12:0/1188518949 conn(0x7f53e0066de0 msgr2=0x7f53e00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:10.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53df59e700 1 -- 172.21.15.12:0/1188518949 shutdown_connections 2021-10-20T23:20:10.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.058+0000 7f53df59e700 1 -- 172.21.15.12:0/1188518949 wait complete. 2021-10-20T23:20:10.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53df59e700 1 Processor -- start 2021-10-20T23:20:10.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53df59e700 1 -- start start 2021-10-20T23:20:10.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53df59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0061320 0x7f53e0152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:10.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53df59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e00ad5c0 0x7f53e00b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:10.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53df59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53e0140440 0x7f53e00b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:10.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53df59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00aa870 con 0x7f53e0061320 2021-10-20T23:20:10.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53df59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e0153420 con 0x7f53e00ad5c0 2021-10-20T23:20:10.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53df59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00aaad0 con 0x7f53e0140440 2021-10-20T23:20:10.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53de59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0061320 0x7f53e0152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:10.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53de59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0061320 0x7f53e0152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37212/0 (socket says 172.21.15.12:37212) 2021-10-20T23:20:10.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53de59c700 1 -- 172.21.15.12:0/128779088 learned_addr learned my addr 172.21.15.12:0/128779088 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:10.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53ddd9b700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e00ad5c0 0x7f53e00b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:10.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53ded9d700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53e0140440 0x7f53e00b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53de59c700 1 -- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53e0140440 msgr2=0x7f53e00b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53de59c700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53e0140440 0x7f53e00b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53de59c700 1 -- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e00ad5c0 msgr2=0x7f53e00b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53de59c700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e00ad5c0 0x7f53e00b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53de59c700 1 -- 172.21.15.12:0/128779088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c800b180 con 0x7f53e0061320 2021-10-20T23:20:10.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53ded9d700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53e0140440 0x7f53e00b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:10.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53de59c700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0061320 0x7f53e0152e90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f53d0001c40 tx=0x7f53d00015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:10.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.062+0000 7f53d77fe700 1 -- 172.21.15.12:0/128779088 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d0004ab0 con 0x7f53e0061320 2021-10-20T23:20:10.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53d77fe700 1 -- 172.21.15.12:0/128779088 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0004c10 con 0x7f53e0061320 2021-10-20T23:20:10.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e00aad70 con 0x7f53e0061320 2021-10-20T23:20:10.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53d77fe700 1 -- 172.21.15.12:0/128779088 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d0007170 con 0x7f53e0061320 2021-10-20T23:20:10.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e00b0cc0 con 0x7f53e0061320 2021-10-20T23:20:10.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e00ab750 con 0x7f53e0061320 2021-10-20T23:20:10.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53d77fe700 1 -- 172.21.15.12:0/128779088 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f53d001b060 con 0x7f53e0061320 2021-10-20T23:20:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53d77fe700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53c4053520 0x7f53c40559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53d77fe700 1 -- 172.21.15.12:0/128779088 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f53d006b950 con 0x7f53e0061320 2021-10-20T23:20:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53ddd9b700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53c4053520 0x7f53c40559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.066+0000 7f53ddd9b700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53c4053520 0x7f53c40559e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f53c8018000 tx=0x7f53c8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.070+0000 7f53d77fe700 1 -- 172.21.15.12:0/128779088 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f53e00ab750 con 0x7f53e0061320 2021-10-20T23:20:10.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.230+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53e00ab750 con 0x7f53e0061320 2021-10-20T23:20:10.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53d77fe700 1 -- 172.21.15.12:0/128779088 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f53e00ab750 con 0x7f53e0061320 2021-10-20T23:20:10.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:10.238 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1996246041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1996246041},{"type":"v1","addr":"172.21.15.31:6835","nonce":1996246041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/2770105392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2770105392},{"type":"v1","addr":"172.21.15.12:6833","nonce":2770105392}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:19:56.508295+0000","modified":"2021-10-20T23:19:58.195517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/2162960241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2162960241},{"type":"v1","addr":"172.21.15.12:6835","nonce":2162960241}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-20T23:20:10.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53c4053520 msgr2=0x7f53c40559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:10.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53c4053520 0x7f53c40559e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f53c8018000 tx=0x7f53c8014000).stop 2021-10-20T23:20:10.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0061320 msgr2=0x7f53e0152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:10.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0061320 0x7f53e0152e90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f53d0001c40 tx=0x7f53d00015b0).stop 2021-10-20T23:20:10.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 shutdown_connections 2021-10-20T23:20:10.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53c4053520 0x7f53c40559e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:10.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53e0140440 0x7f53e00b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:10.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e00ad5c0 0x7f53e00b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:10.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 --2- 172.21.15.12:0/128779088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0061320 0x7f53e0152e90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:10.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 >> 172.21.15.12:0/128779088 conn(0x7f53e0066de0 msgr2=0x7f53e00b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:10.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 shutdown_connections 2021-10-20T23:20:10.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:10.234+0000 7f53df59e700 1 -- 172.21.15.12:0/128779088 wait complete. 2021-10-20T23:20:10.242 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2021-10-20T23:20:10.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:19:56.508295+0000', 'modified': '2021-10-20T23:19:58.195517+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/2162960241', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 2162960241}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 2162960241}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:20:10.555 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:20:10.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:20:10.675 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":4272,"want_state":"up:active","state":"up:active","rank_uptime":14.153516788999999,"mdsmap_epoch":7,"osdmap_epoch":25,"osdmap_epoch_barrier":25,"uptime":20.511983441000002} 2021-10-20T23:20:10.676 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 4272, "mdsmap_epoch": 7, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "rank_uptime": 14.153516789, "state": "up:active", "uptime": 20.511983441, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:20:10.676 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:20:10.677 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:20:10.677 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:20:10.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:10.678 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:10.686 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:20:10.746 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:20:10.746 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:20:10.756 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:20:10.757 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:20:10.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:10.759 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:20:10.764 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:20:10.764 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:10.766 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:20:10.781 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:20:10.781 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:20:10.843 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:20:10.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:20:10.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:10.846 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:20:10.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:20:10.854+0000 7f0ecd251080 -1 init, newargv = 0x5578ead96c30 newargc=9ceph-fuse[ 2021-10-20T23:20:10.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:13737]: starting ceph client 2021-10-20T23:20:10.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[13737]: starting fuse 2021-10-20T23:20:11.954 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:20:11.973 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:20:11.973 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:20:12.031 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:20:12.033 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:20:12.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:12.035 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:20:12.043 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:20:12.044 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:20:12.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:12.045 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:20:12.046 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:20:12.046 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:20:12.047 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:20:12.047 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:20:12.048 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:12.049 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:20:12.049 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:20:12.050 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:20:12.050 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:12.051 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:20:12.052 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:20:12.053 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:20:12.053 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:20:12.054 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:12.055 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:20:12.055 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:20:12.056 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:20:12.057 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:20:12.057 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:20:12.058 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:12.058 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:20:12.059 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:20:12.104 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.13737.asok 2021-10-20T23:20:12.109 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13737.asok 2021-10-20T23:20:12.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:12.109 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13737.asok status 2021-10-20T23:20:12.244 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:20:12.244 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:20:12.244 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:20:12.244 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:20:12.245 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:20:12.245 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:20:12.245 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:20:12.245 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "13737", 2021-10-20T23:20:12.246 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:20:12.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:20:12.246 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:20:12.246 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:20:12.246 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4639, 2021-10-20T23:20:12.247 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:20:12.247 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:20:12.247 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:20:12.247 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4639 2021-10-20T23:20:12.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:20:12.248 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:20:12.248 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:20:12.248 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:20:12.248 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2167721526 2021-10-20T23:20:12.249 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:20:12.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:20:12.250 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:20:12.250 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:20:12.250 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:20:12.250 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2167721526 2021-10-20T23:20:12.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:20:12.251 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4639 172.21.15.119:0/2167721526", 2021-10-20T23:20:12.251 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/2167721526", 2021-10-20T23:20:12.251 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:20:12.251 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 7, 2021-10-20T23:20:12.252 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 25, 2021-10-20T23:20:12.252 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:20:12.252 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:20:12.252 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:20:12.252 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:20:12.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:12.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff14b572700 1 Processor -- start 2021-10-20T23:20:12.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff14b572700 1 -- start start 2021-10-20T23:20:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff14b572700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff144064640 0x7ff1440b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff14b572700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff1440b4aa0 0x7ff144064a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff14b572700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1440b8090 con 0x7ff144143870 2021-10-20T23:20:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff14b572700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff144067510 con 0x7ff1440b4aa0 2021-10-20T23:20:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff14b572700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff144142f40 con 0x7ff144064640 2021-10-20T23:20:12.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff149d6f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff1440b4aa0 0x7ff144064a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff149d6f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff1440b4aa0 0x7ff144064a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37220/0 (socket says 172.21.15.12:37220) 2021-10-20T23:20:12.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff149d6f700 1 -- 172.21.15.12:0/448269366 learned_addr learned my addr 172.21.15.12:0/448269366 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:12.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff14a570700 1 --2- 172.21.15.12:0/448269366 >> v2:172.21.15.31:3300/0 conn(0x7ff144064640 0x7ff1440b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff149d6f700 1 -- 172.21.15.12:0/448269366 >> v2:172.21.15.31:3300/0 conn(0x7ff144064640 msgr2=0x7ff1440b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:12.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff149d6f700 1 --2- 172.21.15.12:0/448269366 >> v2:172.21.15.31:3300/0 conn(0x7ff144064640 0x7ff1440b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff149d6f700 1 -- 172.21.15.12:0/448269366 >> v1:172.21.15.12:6789/0 conn(0x7ff144143870 legacy=0x7ff144146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff149d6f700 1 -- 172.21.15.12:0/448269366 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff144143130 con 0x7ff1440b4aa0 2021-10-20T23:20:12.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.363+0000 7ff149d6f700 1 --2- 172.21.15.12:0/448269366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1440b4aa0 0x7ff144064a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff140002f70 tx=0x7ff140006eb0).ready entity=mon.0 client_cookie=5b5d8e72c8f16a8f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:12.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14956e700 1 -- 172.21.15.12:0/448269366 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff14000d5c0 con 0x7ff1440b4aa0 2021-10-20T23:20:12.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14956e700 1 -- 172.21.15.12:0/448269366 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff140000e90 con 0x7ff1440b4aa0 2021-10-20T23:20:12.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14956e700 1 -- 172.21.15.12:0/448269366 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff14000d950 con 0x7ff1440b4aa0 2021-10-20T23:20:12.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14b572700 1 -- 172.21.15.12:0/448269366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1440b4aa0 msgr2=0x7ff144064a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14b572700 1 --2- 172.21.15.12:0/448269366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1440b4aa0 0x7ff144064a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff140002f70 tx=0x7ff140006eb0).stop 2021-10-20T23:20:12.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14b572700 1 -- 172.21.15.12:0/448269366 shutdown_connections 2021-10-20T23:20:12.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14b572700 1 --2- 172.21.15.12:0/448269366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1440b4aa0 0x7ff144064a20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14b572700 1 --2- 172.21.15.12:0/448269366 >> v2:172.21.15.31:3300/0 conn(0x7ff144064640 0x7ff1440b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14b572700 1 -- 172.21.15.12:0/448269366 >> 172.21.15.12:0/448269366 conn(0x7ff14405f6b0 msgr2=0x7ff14405fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14b572700 1 -- 172.21.15.12:0/448269366 shutdown_connections 2021-10-20T23:20:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14b572700 1 -- 172.21.15.12:0/448269366 wait complete. 2021-10-20T23:20:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.367+0000 7ff14b572700 1 Processor -- start 2021-10-20T23:20:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 -- start start 2021-10-20T23:20:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff144064640 0x7ff144142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1440b4aa0 0x7ff1441467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff144143870 0x7ff14413f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14413e270 con 0x7ff144064640 2021-10-20T23:20:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440b1770 con 0x7ff144143870 2021-10-20T23:20:12.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff144145c80 con 0x7ff1440b4aa0 2021-10-20T23:20:12.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14a570700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff144064640 0x7ff144142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14a570700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff144064640 0x7ff144142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37226/0 (socket says 172.21.15.12:37226) 2021-10-20T23:20:12.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14a570700 1 -- 172.21.15.12:0/2513715634 learned_addr learned my addr 172.21.15.12:0/2513715634 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff149d6f700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1440b4aa0 0x7ff1441467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14ad71700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff144143870 0x7ff14413f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14a570700 1 -- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1440b4aa0 msgr2=0x7ff1441467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14a570700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1440b4aa0 0x7ff1441467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14a570700 1 -- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff144143870 msgr2=0x7ff14413f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14a570700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff144143870 0x7ff14413f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14a570700 1 -- 172.21.15.12:0/2513715634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14000b1e0 con 0x7ff144064640 2021-10-20T23:20:12.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14ad71700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff144143870 0x7ff14413f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:12.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14a570700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff144064640 0x7ff144142630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7ff13400c000 tx=0x7ff134006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff1337fe700 1 -- 172.21.15.12:0/2513715634 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff134010780 con 0x7ff144064640 2021-10-20T23:20:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff1337fe700 1 -- 172.21.15.12:0/2513715634 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1340108e0 con 0x7ff144064640 2021-10-20T23:20:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1440b1230 con 0x7ff144064640 2021-10-20T23:20:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff1337fe700 1 -- 172.21.15.12:0/2513715634 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff134010c40 con 0x7ff144064640 2021-10-20T23:20:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14413ee40 con 0x7ff144064640 2021-10-20T23:20:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1441433d0 con 0x7ff144064640 2021-10-20T23:20:12.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.371+0000 7ff1337fe700 1 -- 172.21.15.12:0/2513715634 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff13401c460 con 0x7ff144064640 2021-10-20T23:20:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.375+0000 7ff1337fe700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1240534f0 0x7ff1240559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.375+0000 7ff1337fe700 1 -- 172.21.15.12:0/2513715634 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff13406bf90 con 0x7ff144064640 2021-10-20T23:20:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.375+0000 7ff149d6f700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1240534f0 0x7ff1240559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.375+0000 7ff149d6f700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1240534f0 0x7ff1240559b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff14001a000 tx=0x7ff140015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.379+0000 7ff1337fe700 1 -- 172.21.15.12:0/2513715634 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff134042f30 con 0x7ff144064640 2021-10-20T23:20:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.511+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff144057350 con 0x7ff144064640 2021-10-20T23:20:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.511+0000 7ff1337fe700 1 -- 172.21.15.12:0/2513715634 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7ff134046550 con 0x7ff144064640 2021-10-20T23:20:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:12.515 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:12.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.511+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1240534f0 msgr2=0x7ff1240559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.511+0000 7ff14b572700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1240534f0 0x7ff1240559b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff14001a000 tx=0x7ff140015000).stop 2021-10-20T23:20:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.511+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff144064640 msgr2=0x7ff144142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.511+0000 7ff14b572700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff144064640 0x7ff144142630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7ff13400c000 tx=0x7ff134006df0).stop 2021-10-20T23:20:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.515+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 shutdown_connections 2021-10-20T23:20:12.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.515+0000 7ff14b572700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1240534f0 0x7ff1240559b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.515+0000 7ff14b572700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff144143870 0x7ff14413f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.515+0000 7ff14b572700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1440b4aa0 0x7ff1441467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.515+0000 7ff14b572700 1 --2- 172.21.15.12:0/2513715634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff144064640 0x7ff144142630 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.515+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 >> 172.21.15.12:0/2513715634 conn(0x7ff14405f6b0 msgr2=0x7ff1440b68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:12.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.515+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 shutdown_connections 2021-10-20T23:20:12.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.515+0000 7ff14b572700 1 -- 172.21.15.12:0/2513715634 wait complete. 2021-10-20T23:20:12.528 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:19:51.434642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:19:54.214563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:20:12.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:20:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 Processor -- start 2021-10-20T23:20:12.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 -- start start 2021-10-20T23:20:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c240b1ec0 0x7f9c240b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240b0420 con 0x7f9c240b22a0 2021-10-20T23:20:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240a77d0 con 0x7f9c240affb0 2021-10-20T23:20:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c240b0650 con 0x7f9c240b1ec0 2021-10-20T23:20:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c240b1ec0 0x7f9c240b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c240b1ec0 0x7f9c240b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37234/0 (socket says 172.21.15.12:37234) 2021-10-20T23:20:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2259c700 1 -- 172.21.15.12:0/3918144647 learned_addr learned my addr 172.21.15.12:0/3918144647 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2259c700 1 -- 172.21.15.12:0/3918144647 >> v1:172.21.15.31:6789/0 conn(0x7f9c240affb0 legacy=0x7f9c240a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2259c700 1 -- 172.21.15.12:0/3918144647 >> v1:172.21.15.12:6789/0 conn(0x7f9c240b22a0 legacy=0x7f9c24141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2259c700 1 -- 172.21.15.12:0/3918144647 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240b08f0 con 0x7f9c240b1ec0 2021-10-20T23:20:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2259c700 1 --2- 172.21.15.12:0/3918144647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240b1ec0 0x7f9c240b12d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f9c18002f70 tx=0x7f9c18006eb0).ready entity=mon.0 client_cookie=5a3d1156d587eb4f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2159a700 1 -- 172.21.15.12:0/3918144647 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1800d660 con 0x7f9c240b1ec0 2021-10-20T23:20:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2159a700 1 -- 172.21.15.12:0/3918144647 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18000e90 con 0x7f9c240b1ec0 2021-10-20T23:20:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c2159a700 1 -- 172.21.15.12:0/3918144647 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1800d9f0 con 0x7f9c240b1ec0 2021-10-20T23:20:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 -- 172.21.15.12:0/3918144647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240b1ec0 msgr2=0x7f9c240b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 --2- 172.21.15.12:0/3918144647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240b1ec0 0x7f9c240b12d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f9c18002f70 tx=0x7f9c18006eb0).stop 2021-10-20T23:20:12.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 -- 172.21.15.12:0/3918144647 shutdown_connections 2021-10-20T23:20:12.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 --2- 172.21.15.12:0/3918144647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240b1ec0 0x7f9c240b12d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 -- 172.21.15.12:0/3918144647 >> 172.21.15.12:0/3918144647 conn(0x7f9c2405f6b0 msgr2=0x7f9c2405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 -- 172.21.15.12:0/3918144647 shutdown_connections 2021-10-20T23:20:12.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.639+0000 7f9c28e36700 1 -- 172.21.15.12:0/3918144647 wait complete. 2021-10-20T23:20:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 Processor -- start 2021-10-20T23:20:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 -- start start 2021-10-20T23:20:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240affb0 0x7f9c24143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c240b1ec0 0x7f9c2415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240b22a0 0x7f9c2415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240aa850 con 0x7f9c240affb0 2021-10-20T23:20:12.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24148b30 con 0x7f9c240b22a0 2021-10-20T23:20:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24148480 con 0x7f9c240b1ec0 2021-10-20T23:20:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c2259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240affb0 0x7f9c24143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c2259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240affb0 0x7f9c24143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37240/0 (socket says 172.21.15.12:37240) 2021-10-20T23:20:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c2259c700 1 -- 172.21.15.12:0/1749342948 learned_addr learned my addr 172.21.15.12:0/1749342948 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c21d9b700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c240b1ec0 0x7f9c2415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c22d9d700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240b22a0 0x7f9c2415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c2259c700 1 -- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c240b1ec0 msgr2=0x7f9c2415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c2259c700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c240b1ec0 0x7f9c2415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c2259c700 1 -- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240b22a0 msgr2=0x7f9c2415a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c2259c700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240b22a0 0x7f9c2415a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c2259c700 1 -- 172.21.15.12:0/1749342948 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1800b1e0 con 0x7f9c240affb0 2021-10-20T23:20:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c22d9d700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240b22a0 0x7f9c2415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c2259c700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240affb0 0x7f9c24143620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9c18002f70 tx=0x7f9c18015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:12.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c137fe700 1 -- 172.21.15.12:0/1749342948 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1800d9e0 con 0x7f9c240affb0 2021-10-20T23:20:12.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c137fe700 1 -- 172.21.15.12:0/1749342948 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18011ca0 con 0x7f9c240affb0 2021-10-20T23:20:12.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c240aaa80 con 0x7f9c240affb0 2021-10-20T23:20:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c137fe700 1 -- 172.21.15.12:0/1749342948 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1801e460 con 0x7f9c240affb0 2021-10-20T23:20:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2415acc0 con 0x7f9c240affb0 2021-10-20T23:20:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.643+0000 7f9c137fe700 1 -- 172.21.15.12:0/1749342948 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9c18025030 con 0x7f9c240affb0 2021-10-20T23:20:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.647+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c240ac2e0 con 0x7f9c240affb0 2021-10-20T23:20:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.647+0000 7f9c137fe700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c00053610 0x7f9c00055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.647+0000 7f9c137fe700 1 -- 172.21.15.12:0/1749342948 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9c1806cfe0 con 0x7f9c240affb0 2021-10-20T23:20:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.647+0000 7f9c21d9b700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c00053610 0x7f9c00055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.647+0000 7f9c21d9b700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c00053610 0x7f9c00055ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9c1400b000 tx=0x7f9c14009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.651+0000 7f9c137fe700 1 -- 172.21.15.12:0/1749342948 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9c18043ed0 con 0x7f9c240affb0 2021-10-20T23:20:12.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.775+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9c240b0b90 con 0x7f9c240affb0 2021-10-20T23:20:12.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c137fe700 1 -- 172.21.15.12:0/1749342948 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9c18023070 con 0x7f9c240affb0 2021-10-20T23:20:12.781 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:20:12.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c00053610 msgr2=0x7f9c00055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c00053610 0x7f9c00055ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9c1400b000 tx=0x7f9c14009040).stop 2021-10-20T23:20:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240affb0 msgr2=0x7f9c24143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240affb0 0x7f9c24143620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9c18002f70 tx=0x7f9c18015000).stop 2021-10-20T23:20:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 shutdown_connections 2021-10-20T23:20:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c00053610 0x7f9c00055ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240b22a0 0x7f9c2415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c240b1ec0 0x7f9c2415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 --2- 172.21.15.12:0/1749342948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c240affb0 0x7f9c24143620 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 >> 172.21.15.12:0/1749342948 conn(0x7f9c2405f6b0 msgr2=0x7f9c240ad310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:12.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 shutdown_connections 2021-10-20T23:20:12.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.779+0000 7f9c28e36700 1 -- 172.21.15.12:0/1749342948 wait complete. 2021-10-20T23:20:12.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:20:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab5c5dc700 1 Processor -- start 2021-10-20T23:20:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab5c5dc700 1 -- start start 2021-10-20T23:20:12.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab5c5dc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fab54146950 0x7fab54140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab5c5dc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab540b4180 0x7fab54140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab5c5dc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab54143b60 con 0x7fab540b4690 2021-10-20T23:20:12.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab5c5dc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab54147510 con 0x7fab540b4180 2021-10-20T23:20:12.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab5c5dc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab54143e00 con 0x7fab54146950 2021-10-20T23:20:12.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59b77700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab540b4180 0x7fab54140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59b77700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab540b4180 0x7fab54140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37250/0 (socket says 172.21.15.12:37250) 2021-10-20T23:20:12.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59b77700 1 -- 172.21.15.12:0/2053803674 learned_addr learned my addr 172.21.15.12:0/2053803674 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:12.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab5a378700 1 --2- 172.21.15.12:0/2053803674 >> v2:172.21.15.31:3300/0 conn(0x7fab54146950 0x7fab54140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59b77700 1 -- 172.21.15.12:0/2053803674 >> v2:172.21.15.31:3300/0 conn(0x7fab54146950 msgr2=0x7fab54140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:12.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59b77700 1 --2- 172.21.15.12:0/2053803674 >> v2:172.21.15.31:3300/0 conn(0x7fab54146950 0x7fab54140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59b77700 1 -- 172.21.15.12:0/2053803674 >> v1:172.21.15.31:6789/0 conn(0x7fab540b4690 legacy=0x7fab540b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59b77700 1 -- 172.21.15.12:0/2053803674 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540b0c90 con 0x7fab540b4180 2021-10-20T23:20:12.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59b77700 1 --2- 172.21.15.12:0/2053803674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4180 0x7fab54140720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fab44002f70 tx=0x7fab44006eb0).ready entity=mon.0 client_cookie=84f2e4bdb9456b31 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:12.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59376700 1 -- 172.21.15.12:0/2053803674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab4400d610 con 0x7fab540b4180 2021-10-20T23:20:12.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59376700 1 -- 172.21.15.12:0/2053803674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44000e90 con 0x7fab540b4180 2021-10-20T23:20:12.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.899+0000 7fab59376700 1 -- 172.21.15.12:0/2053803674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab4400d9a0 con 0x7fab540b4180 2021-10-20T23:20:12.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2053803674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4180 msgr2=0x7fab54140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 --2- 172.21.15.12:0/2053803674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4180 0x7fab54140720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fab44002f70 tx=0x7fab44006eb0).stop 2021-10-20T23:20:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2053803674 shutdown_connections 2021-10-20T23:20:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 --2- 172.21.15.12:0/2053803674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4180 0x7fab54140720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 --2- 172.21.15.12:0/2053803674 >> v2:172.21.15.31:3300/0 conn(0x7fab54146950 0x7fab54140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2053803674 >> 172.21.15.12:0/2053803674 conn(0x7fab5405c490 msgr2=0x7fab5405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:12.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2053803674 shutdown_connections 2021-10-20T23:20:12.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2053803674 wait complete. 2021-10-20T23:20:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 Processor -- start 2021-10-20T23:20:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.903+0000 7fab5c5dc700 1 -- start start 2021-10-20T23:20:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5c5dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b4180 0x7fab540af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5c5dc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4690 0x7fab540af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5c5dc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab54146950 0x7fab540b8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5c5dc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab54146020 con 0x7fab540b4690 2021-10-20T23:20:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5c5dc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab540ae550 con 0x7fab54146950 2021-10-20T23:20:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5c5dc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab540ae7f0 con 0x7fab540b4180 2021-10-20T23:20:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab59b77700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4690 0x7fab540af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab59b77700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4690 0x7fab540af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37256/0 (socket says 172.21.15.12:37256) 2021-10-20T23:20:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab59b77700 1 -- 172.21.15.12:0/2758402063 learned_addr learned my addr 172.21.15.12:0/2758402063 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:12.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5a378700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b4180 0x7fab540af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5ab79700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab54146950 0x7fab540b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab59b77700 1 -- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b4180 msgr2=0x7fab540af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab59b77700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b4180 0x7fab540af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab59b77700 1 -- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab54146950 msgr2=0x7fab540b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:12.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab59b77700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab54146950 0x7fab540b8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:12.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab59b77700 1 -- 172.21.15.12:0/2758402063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4400b1e0 con 0x7fab540b4690 2021-10-20T23:20:12.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab59b77700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4690 0x7fab540af750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fab44002f70 tx=0x7fab44015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:12.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab437fe700 1 -- 172.21.15.12:0/2758402063 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab44011860 con 0x7fab540b4690 2021-10-20T23:20:12.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab437fe700 1 -- 172.21.15.12:0/2758402063 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab440119c0 con 0x7fab540b4690 2021-10-20T23:20:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab540aea90 con 0x7fab540b4690 2021-10-20T23:20:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab437fe700 1 -- 172.21.15.12:0/2758402063 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab44011d20 con 0x7fab540b4690 2021-10-20T23:20:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.907+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab540aded0 con 0x7fab540b4690 2021-10-20T23:20:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.911+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab54057350 con 0x7fab540b4690 2021-10-20T23:20:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.911+0000 7fab437fe700 1 -- 172.21.15.12:0/2758402063 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab44025030 con 0x7fab540b4690 2021-10-20T23:20:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.911+0000 7fab437fe700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab34053580 0x7fab34055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:12.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.911+0000 7fab437fe700 1 -- 172.21.15.12:0/2758402063 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fab4406cb70 con 0x7fab540b4690 2021-10-20T23:20:12.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.911+0000 7fab5a378700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab34053580 0x7fab34055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:12.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.911+0000 7fab5a378700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab34053580 0x7fab34055a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fab5000c000 tx=0x7fab50008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:12.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:12.919+0000 7fab437fe700 1 -- 172.21.15.12:0/2758402063 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab44043b70 con 0x7fab540b4690 2021-10-20T23:20:13.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.039+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fab540698e0 con 0x7fab540b4690 2021-10-20T23:20:13.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab437fe700 1 -- 172.21.15.12:0/2758402063 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fab44023020 con 0x7fab540b4690 2021-10-20T23:20:13.045 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:13.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab34053580 msgr2=0x7fab34055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab34053580 0x7fab34055a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fab5000c000 tx=0x7fab50008040).stop 2021-10-20T23:20:13.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4690 msgr2=0x7fab540af750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4690 0x7fab540af750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fab44002f70 tx=0x7fab44015000).stop 2021-10-20T23:20:13.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 shutdown_connections 2021-10-20T23:20:13.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab34053580 0x7fab34055a40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab54146950 0x7fab540b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540b4690 0x7fab540af750 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 --2- 172.21.15.12:0/2758402063 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b4180 0x7fab540af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 >> 172.21.15.12:0/2758402063 conn(0x7fab5405c490 msgr2=0x7fab5413b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:13.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 shutdown_connections 2021-10-20T23:20:13.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.043+0000 7fab5c5dc700 1 -- 172.21.15.12:0/2758402063 wait complete. 2021-10-20T23:20:13.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:20:13.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.163+0000 7fc79359e700 1 Processor -- start 2021-10-20T23:20:13.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.163+0000 7fc79359e700 1 -- start start 2021-10-20T23:20:13.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7940b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7940b6910 con 0x7fc7941439a0 2021-10-20T23:20:13.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7940b6bb0 con 0x7fc7940b4710 2021-10-20T23:20:13.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940b9680 con 0x7fc794061680 2021-10-20T23:20:13.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc792d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc7941439a0 0x7fc79414d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35860/0 (socket says 172.21.15.12:35860) 2021-10-20T23:20:13.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc792d9d700 1 -- 172.21.15.12:0/955972738 learned_addr learned my addr 172.21.15.12:0/955972738 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:13.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79259c700 1 --2- 172.21.15.12:0/955972738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7940b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79159a700 1 -- 172.21.15.12:0/955972738 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456013652 0 0) 0x7fc7940b6910 con 0x7fc7941439a0 2021-10-20T23:20:13.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79159a700 1 -- 172.21.15.12:0/955972738 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc774003260 con 0x7fc7941439a0 2021-10-20T23:20:13.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79159a700 1 -- 172.21.15.12:0/955972738 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223174802 0 0) 0x7fc7940b6bb0 con 0x7fc7940b4710 2021-10-20T23:20:13.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79159a700 1 -- 172.21.15.12:0/955972738 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7940b6910 con 0x7fc7940b4710 2021-10-20T23:20:13.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79259c700 1 -- 172.21.15.12:0/955972738 >> v1:172.21.15.31:6789/0 conn(0x7fc7940b4710 legacy=0x7fc79413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79259c700 1 -- 172.21.15.12:0/955972738 >> v1:172.21.15.12:6789/0 conn(0x7fc7941439a0 legacy=0x7fc79414d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79259c700 1 -- 172.21.15.12:0/955972738 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7940b6e50 con 0x7fc794061680 2021-10-20T23:20:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79259c700 1 --2- 172.21.15.12:0/955972738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7940b9d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc77c002f70 tx=0x7fc77c006df0).ready entity=mon.2 client_cookie=901526e8f908d9b0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79159a700 1 -- 172.21.15.12:0/955972738 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc77c00d5c0 con 0x7fc794061680 2021-10-20T23:20:13.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79159a700 1 -- 172.21.15.12:0/955972738 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c000e90 con 0x7fc794061680 2021-10-20T23:20:13.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79159a700 1 -- 172.21.15.12:0/955972738 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc77c00d910 con 0x7fc794061680 2021-10-20T23:20:13.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 -- 172.21.15.12:0/955972738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 msgr2=0x7fc7940b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 --2- 172.21.15.12:0/955972738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7940b9d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc77c002f70 tx=0x7fc77c006df0).stop 2021-10-20T23:20:13.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 -- 172.21.15.12:0/955972738 shutdown_connections 2021-10-20T23:20:13.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 --2- 172.21.15.12:0/955972738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7940b9d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 -- 172.21.15.12:0/955972738 >> 172.21.15.12:0/955972738 conn(0x7fc79406adf0 msgr2=0x7fc79405f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:13.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 -- 172.21.15.12:0/955972738 shutdown_connections 2021-10-20T23:20:13.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.167+0000 7fc79359e700 1 -- 172.21.15.12:0/955972738 wait complete. 2021-10-20T23:20:13.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 Processor -- start 2021-10-20T23:20:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 -- start start 2021-10-20T23:20:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7941128a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7941439a0 0x7fc794146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7940aec70 0x7fc794143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940ae0b0 con 0x7fc7940aec70 2021-10-20T23:20:13.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940af630 con 0x7fc7941439a0 2021-10-20T23:20:13.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940b0520 con 0x7fc794061680 2021-10-20T23:20:13.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc792d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7940aec70 0x7fc794143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7941128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc791d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7941439a0 0x7fc794146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc792d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7940aec70 0x7fc794143fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37272/0 (socket says 172.21.15.12:37272) 2021-10-20T23:20:13.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7941128a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:43026/0 (socket says 172.21.15.12:43026) 2021-10-20T23:20:13.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc792d9d700 1 -- 172.21.15.12:0/895330672 learned_addr learned my addr 172.21.15.12:0/895330672 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc791d9b700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7941439a0 0x7fc794146770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:52244/0 (socket says 172.21.15.12:52244) 2021-10-20T23:20:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc792d9d700 1 -- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 msgr2=0x7fc7941128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc792d9d700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7941128a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc792d9d700 1 -- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7941439a0 msgr2=0x7fc794146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc792d9d700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7941439a0 0x7fc794146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc792d9d700 1 -- 172.21.15.12:0/895330672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c00b180 con 0x7fc7940aec70 2021-10-20T23:20:13.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc792d9d700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7940aec70 0x7fc794143fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc78c001490 tx=0x7fc78c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:13.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc78b7fe700 1 -- 172.21.15.12:0/895330672 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc78c005ba0 con 0x7fc7940aec70 2021-10-20T23:20:13.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc78b7fe700 1 -- 172.21.15.12:0/895330672 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c005d00 con 0x7fc7940aec70 2021-10-20T23:20:13.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7940b07c0 con 0x7fc7940aec70 2021-10-20T23:20:13.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc78b7fe700 1 -- 172.21.15.12:0/895330672 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc78c0072c0 con 0x7fc7940aec70 2021-10-20T23:20:13.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.171+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7940ae740 con 0x7fc7940aec70 2021-10-20T23:20:13.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.175+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc794057350 con 0x7fc7940aec70 2021-10-20T23:20:13.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.175+0000 7fc78b7fe700 1 -- 172.21.15.12:0/895330672 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc78c01a060 con 0x7fc7940aec70 2021-10-20T23:20:13.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.175+0000 7fc78b7fe700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc7780535b0 0x7fc778055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.175+0000 7fc78b7fe700 1 -- 172.21.15.12:0/895330672 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc78c06b150 con 0x7fc7940aec70 2021-10-20T23:20:13.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.175+0000 7fc79259c700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc7780535b0 0x7fc778055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.179+0000 7fc79259c700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc7780535b0 0x7fc778055a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc77c018000 tx=0x7fc77c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:13.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.179+0000 7fc78b7fe700 1 -- 172.21.15.12:0/895330672 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc78c042040 con 0x7fc7940aec70 2021-10-20T23:20:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.307+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc7940008d0 con 0x7fc7940aec70 2021-10-20T23:20:13.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.307+0000 7fc78b7fe700 1 -- 172.21.15.12:0/895330672 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc78c0180a0 con 0x7fc7940aec70 2021-10-20T23:20:13.311 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc7780535b0 msgr2=0x7fc778055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc7780535b0 0x7fc778055a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc77c018000 tx=0x7fc77c014000).stop 2021-10-20T23:20:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7940aec70 msgr2=0x7fc794143fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7940aec70 0x7fc794143fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc78c001490 tx=0x7fc78c007de0).stop 2021-10-20T23:20:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 shutdown_connections 2021-10-20T23:20:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc7780535b0 0x7fc778055a70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7940aec70 0x7fc794143fa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7941439a0 0x7fc794146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 --2- 172.21.15.12:0/895330672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc794061680 0x7fc7941128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 >> 172.21.15.12:0/895330672 conn(0x7fc79406adf0 msgr2=0x7fc79405f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 shutdown_connections 2021-10-20T23:20:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.311+0000 7fc79359e700 1 -- 172.21.15.12:0/895330672 wait complete. 2021-10-20T23:20:13.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:20:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.439+0000 7fc9b4806700 1 Processor -- start 2021-10-20T23:20:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.439+0000 7fc9b4806700 1 -- start start 2021-10-20T23:20:13.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.439+0000 7fc9b4806700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc9b00b4060 0x7fc9b0061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.439+0000 7fc9b4806700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b00b5f50 con 0x7fc9b00b6290 2021-10-20T23:20:13.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.439+0000 7fc9b4806700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b00b1f70 con 0x7fc9b0142e60 2021-10-20T23:20:13.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.439+0000 7fc9b4806700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b00b2210 con 0x7fc9b00b4060 2021-10-20T23:20:13.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.439+0000 7fc9aed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc9b00b6290 0x7fc9b0061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35870/0 (socket says 172.21.15.12:35870) 2021-10-20T23:20:13.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.439+0000 7fc9aed9d700 1 -- 172.21.15.12:0/584712417 learned_addr learned my addr 172.21.15.12:0/584712417 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:13.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9ae59c700 1 --2- 172.21.15.12:0/584712417 >> v2:172.21.15.31:3300/0 conn(0x7fc9b00b4060 0x7fc9b0061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9add9b700 1 -- 172.21.15.12:0/584712417 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975611447 0 0) 0x7fc9a0001110 con 0x7fc9b00b6290 2021-10-20T23:20:13.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9add9b700 1 -- 172.21.15.12:0/584712417 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc990003260 con 0x7fc9b00b6290 2021-10-20T23:20:13.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9add9b700 1 -- 172.21.15.12:0/584712417 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060616244 0 0) 0x7fc9b00b1f70 con 0x7fc9b0142e60 2021-10-20T23:20:13.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9add9b700 1 -- 172.21.15.12:0/584712417 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a0001110 con 0x7fc9b0142e60 2021-10-20T23:20:13.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9ae59c700 1 -- 172.21.15.12:0/584712417 >> v1:172.21.15.31:6789/0 conn(0x7fc9b0142e60 legacy=0x7fc9b01432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9ae59c700 1 -- 172.21.15.12:0/584712417 >> v1:172.21.15.12:6789/0 conn(0x7fc9b00b6290 legacy=0x7fc9b0061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9ae59c700 1 -- 172.21.15.12:0/584712417 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b00b24b0 con 0x7fc9b00b4060 2021-10-20T23:20:13.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9ae59c700 1 --2- 172.21.15.12:0/584712417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b4060 0x7fc9b0061b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc9a00019b0 tx=0x7fc998006df0).ready entity=mon.1 client_cookie=10e8c0107d904944 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9add9b700 1 -- 172.21.15.12:0/584712417 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a0001810 con 0x7fc9b00b4060 2021-10-20T23:20:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9add9b700 1 -- 172.21.15.12:0/584712417 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998000e90 con 0x7fc9b00b4060 2021-10-20T23:20:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9add9b700 1 -- 172.21.15.12:0/584712417 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc998011400 con 0x7fc9b00b4060 2021-10-20T23:20:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9b4806700 1 -- 172.21.15.12:0/584712417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b4060 msgr2=0x7fc9b0061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9b4806700 1 --2- 172.21.15.12:0/584712417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b4060 0x7fc9b0061b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc9a00019b0 tx=0x7fc998006df0).stop 2021-10-20T23:20:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9b4806700 1 -- 172.21.15.12:0/584712417 shutdown_connections 2021-10-20T23:20:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9b4806700 1 --2- 172.21.15.12:0/584712417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b4060 0x7fc9b0061b80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9b4806700 1 -- 172.21.15.12:0/584712417 >> 172.21.15.12:0/584712417 conn(0x7fc9b005c490 msgr2=0x7fc9b005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9b4806700 1 -- 172.21.15.12:0/584712417 shutdown_connections 2021-10-20T23:20:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9b4806700 1 -- 172.21.15.12:0/584712417 wait complete. 2021-10-20T23:20:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.443+0000 7fc9b4806700 1 Processor -- start 2021-10-20T23:20:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9b4806700 1 -- start start 2021-10-20T23:20:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9b4806700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b00b4060 0x7fc9b0146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9b4806700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b6290 0x7fc9b01531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9b4806700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0142e60 0x7fc9b0145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9b4806700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00b0b70 con 0x7fc9b0142e60 2021-10-20T23:20:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9b4806700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b01536c0 con 0x7fc9b00b6290 2021-10-20T23:20:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9b4806700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00b0160 con 0x7fc9b00b4060 2021-10-20T23:20:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0142e60 0x7fc9b0145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9aed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b00b4060 0x7fc9b0146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9ae59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b6290 0x7fc9b01531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9aed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b00b4060 0x7fc9b0146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:43040/0 (socket says 172.21.15.12:43040) 2021-10-20T23:20:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9ae59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b6290 0x7fc9b01531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:52258/0 (socket says 172.21.15.12:52258) 2021-10-20T23:20:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9aed9d700 1 -- 172.21.15.12:0/3334859695 learned_addr learned my addr 172.21.15.12:0/3334859695 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0142e60 0x7fc9b0145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37286/0 (socket says 172.21.15.12:37286) 2021-10-20T23:20:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9af59e700 1 -- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b00b4060 msgr2=0x7fc9b0146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9af59e700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b00b4060 0x7fc9b0146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9af59e700 1 -- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b6290 msgr2=0x7fc9b01531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9af59e700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b6290 0x7fc9b01531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9af59e700 1 -- 172.21.15.12:0/3334859695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99800b180 con 0x7fc9b0142e60 2021-10-20T23:20:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9aed9d700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b00b4060 0x7fc9b0146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:13.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9af59e700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0142e60 0x7fc9b0145250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fc9a8001490 tx=0x7fc9a8007cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:13.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9a7fff700 1 -- 172.21.15.12:0/3334859695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a800ce00 con 0x7fc9b0142e60 2021-10-20T23:20:13.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9a7fff700 1 -- 172.21.15.12:0/3334859695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a800f470 con 0x7fc9b0142e60 2021-10-20T23:20:13.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b00b0390 con 0x7fc9b0142e60 2021-10-20T23:20:13.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9a7fff700 1 -- 172.21.15.12:0/3334859695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a800f7d0 con 0x7fc9b0142e60 2021-10-20T23:20:13.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.447+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b00b08d0 con 0x7fc9b0142e60 2021-10-20T23:20:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.451+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b00ad660 con 0x7fc9b0142e60 2021-10-20T23:20:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.451+0000 7fc9a7fff700 1 -- 172.21.15.12:0/3334859695 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc9a8019030 con 0x7fc9b0142e60 2021-10-20T23:20:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.451+0000 7fc9a7fff700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc994053610 0x7fc994055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.451+0000 7fc9a7fff700 1 -- 172.21.15.12:0/3334859695 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc9a806afb0 con 0x7fc9b0142e60 2021-10-20T23:20:13.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.451+0000 7fc9aed9d700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc994053610 0x7fc994055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.451+0000 7fc9aed9d700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc994053610 0x7fc994055ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc9a000d000 tx=0x7fc9a0001c40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.459+0000 7fc9a7fff700 1 -- 172.21.15.12:0/3334859695 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9a8041fb0 con 0x7fc9b0142e60 2021-10-20T23:20:13.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.591+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9b00b2750 con 0x7fc9b0142e60 2021-10-20T23:20:13.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.591+0000 7fc9a7fff700 1 -- 172.21.15.12:0/3334859695 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc9a80455d0 con 0x7fc9b0142e60 2021-10-20T23:20:13.593 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:13.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc994053610 msgr2=0x7fc994055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc994053610 0x7fc994055ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc9a000d000 tx=0x7fc9a0001c40).stop 2021-10-20T23:20:13.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0142e60 msgr2=0x7fc9b0145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0142e60 0x7fc9b0145250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fc9a8001490 tx=0x7fc9a8007cd0).stop 2021-10-20T23:20:13.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 shutdown_connections 2021-10-20T23:20:13.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc994053610 0x7fc994055ad0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0142e60 0x7fc9b0145250 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b00b6290 0x7fc9b01531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 --2- 172.21.15.12:0/3334859695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b00b4060 0x7fc9b0146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 >> 172.21.15.12:0/3334859695 conn(0x7fc9b005c490 msgr2=0x7fc9b00b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:13.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 shutdown_connections 2021-10-20T23:20:13.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.595+0000 7fc9b4806700 1 -- 172.21.15.12:0/3334859695 wait complete. 2021-10-20T23:20:13.611 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:20:13.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:13.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd889ed4700 1 Processor -- start 2021-10-20T23:20:13.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd889ed4700 1 -- start start 2021-10-20T23:20:13.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd889ed4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 0x7fd8840b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd889ed4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd884064a20 0x7fd884066500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd889ed4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8840b8090 con 0x7fd8840b4aa0 2021-10-20T23:20:13.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd889ed4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd884142f40 con 0x7fd884064a20 2021-10-20T23:20:13.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd889ed4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd884143130 con 0x7fd884064640 2021-10-20T23:20:13.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd8896d3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd884064a20 0x7fd884066500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd8896d3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd884064a20 0x7fd884066500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37294/0 (socket says 172.21.15.12:37294) 2021-10-20T23:20:13.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd8896d3700 1 -- 172.21.15.12:0/989402089 learned_addr learned my addr 172.21.15.12:0/989402089 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:13.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd888ed2700 1 --2- 172.21.15.12:0/989402089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 0x7fd8840b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd8896d3700 1 -- 172.21.15.12:0/989402089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 msgr2=0x7fd8840b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:13.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd8896d3700 1 --2- 172.21.15.12:0/989402089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 0x7fd8840b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd8896d3700 1 -- 172.21.15.12:0/989402089 >> v1:172.21.15.31:6789/0 conn(0x7fd8840b4aa0 legacy=0x7fd884143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd8896d3700 1 -- 172.21.15.12:0/989402089 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8841433d0 con 0x7fd884064a20 2021-10-20T23:20:13.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd888ed2700 1 --2- 172.21.15.12:0/989402089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 0x7fd8840b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:13.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.707+0000 7fd8896d3700 1 --2- 172.21.15.12:0/989402089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd884064a20 0x7fd884066500 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fd87c0032f0 tx=0x7fd87c009290).ready entity=mon.0 client_cookie=2d551371238b2376 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:13.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd8837fe700 1 -- 172.21.15.12:0/989402089 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c00b8a0 con 0x7fd884064a20 2021-10-20T23:20:13.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd8837fe700 1 -- 172.21.15.12:0/989402089 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c00ba00 con 0x7fd884064a20 2021-10-20T23:20:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd8837fe700 1 -- 172.21.15.12:0/989402089 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c00bb70 con 0x7fd884064a20 2021-10-20T23:20:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 -- 172.21.15.12:0/989402089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd884064a20 msgr2=0x7fd884066500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 --2- 172.21.15.12:0/989402089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd884064a20 0x7fd884066500 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fd87c0032f0 tx=0x7fd87c009290).stop 2021-10-20T23:20:13.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 -- 172.21.15.12:0/989402089 shutdown_connections 2021-10-20T23:20:13.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 --2- 172.21.15.12:0/989402089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd884064a20 0x7fd884066500 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 --2- 172.21.15.12:0/989402089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 0x7fd8840b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 -- 172.21.15.12:0/989402089 >> 172.21.15.12:0/989402089 conn(0x7fd88405f6b0 msgr2=0x7fd88405fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:13.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 -- 172.21.15.12:0/989402089 shutdown_connections 2021-10-20T23:20:13.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 -- 172.21.15.12:0/989402089 wait complete. 2021-10-20T23:20:13.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 Processor -- start 2021-10-20T23:20:13.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.711+0000 7fd889ed4700 1 -- start start 2021-10-20T23:20:13.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd889ed4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 0x7fd8840af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd889ed4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd884064a20 0x7fd884148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd889ed4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8840b4aa0 0x7fd884155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd889ed4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840b1610 con 0x7fd8840b4aa0 2021-10-20T23:20:13.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd889ed4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd884145b50 con 0x7fd884064a20 2021-10-20T23:20:13.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd889ed4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840b0980 con 0x7fd884064640 2021-10-20T23:20:13.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd8896d3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8840b4aa0 0x7fd884155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd8896d3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8840b4aa0 0x7fd884155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37296/0 (socket says 172.21.15.12:37296) 2021-10-20T23:20:13.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd8896d3700 1 -- 172.21.15.12:0/3614710444 learned_addr learned my addr 172.21.15.12:0/3614710444 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:13.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd888ed2700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 0x7fd8840af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd883fff700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd884064a20 0x7fd884148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd8896d3700 1 -- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 msgr2=0x7fd8840af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd8896d3700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 0x7fd8840af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd8896d3700 1 -- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd884064a20 msgr2=0x7fd884148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd8896d3700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd884064a20 0x7fd884148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd8896d3700 1 -- 172.21.15.12:0/3614710444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c009530 con 0x7fd8840b4aa0 2021-10-20T23:20:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd8896d3700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8840b4aa0 0x7fd884155970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fd87c0032f0 tx=0x7fd87c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd881ffb700 1 -- 172.21.15.12:0/3614710444 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c00bde0 con 0x7fd8840b4aa0 2021-10-20T23:20:13.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd881ffb700 1 -- 172.21.15.12:0/3614710444 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c020430 con 0x7fd8840b4aa0 2021-10-20T23:20:13.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8840b0c20 con 0x7fd8840b4aa0 2021-10-20T23:20:13.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd881ffb700 1 -- 172.21.15.12:0/3614710444 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c020790 con 0x7fd8840b4aa0 2021-10-20T23:20:13.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8840b12e0 con 0x7fd8840b4aa0 2021-10-20T23:20:13.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.715+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8840b0db0 con 0x7fd8840b4aa0 2021-10-20T23:20:13.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.719+0000 7fd881ffb700 1 -- 172.21.15.12:0/3614710444 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd87c028070 con 0x7fd8840b4aa0 2021-10-20T23:20:13.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.719+0000 7fd881ffb700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8640536d0 0x7fd864055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:13.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.719+0000 7fd881ffb700 1 -- 172.21.15.12:0/3614710444 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd87c06c5c0 con 0x7fd8840b4aa0 2021-10-20T23:20:13.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.719+0000 7fd888ed2700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8640536d0 0x7fd864055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:13.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.719+0000 7fd888ed2700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8640536d0 0x7fd864055b90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fd87800c000 tx=0x7fd878008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:13.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.727+0000 7fd881ffb700 1 -- 172.21.15.12:0/3614710444 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd87c0435c0 con 0x7fd8840b4aa0 2021-10-20T23:20:13.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.891+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8840b7d40 con 0x7fd8840b4aa0 2021-10-20T23:20:13.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.891+0000 7fd881ffb700 1 -- 172.21.15.12:0/3614710444 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7fd87c015020 con 0x7fd8840b4aa0 2021-10-20T23:20:13.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:13.895 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1996246041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1996246041},{"type":"v1","addr":"172.21.15.31:6835","nonce":1996246041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/2770105392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2770105392},{"type":"v1","addr":"172.21.15.12:6833","nonce":2770105392}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:19:56.508295+0000","modified":"2021-10-20T23:19:58.195517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/2162960241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2162960241},{"type":"v1","addr":"172.21.15.12:6835","nonce":2162960241}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-20T23:20:13.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8640536d0 msgr2=0x7fd864055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8640536d0 0x7fd864055b90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fd87800c000 tx=0x7fd878008040).stop 2021-10-20T23:20:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8840b4aa0 msgr2=0x7fd884155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8840b4aa0 0x7fd884155970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fd87c0032f0 tx=0x7fd87c016000).stop 2021-10-20T23:20:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 shutdown_connections 2021-10-20T23:20:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd8640536d0 0x7fd864055b90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8840b4aa0 0x7fd884155970 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd884064a20 0x7fd884148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 --2- 172.21.15.12:0/3614710444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd884064640 0x7fd8840af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 >> 172.21.15.12:0/3614710444 conn(0x7fd88405f6b0 msgr2=0x7fd884066d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 shutdown_connections 2021-10-20T23:20:13.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:13.895+0000 7fd889ed4700 1 -- 172.21.15.12:0/3614710444 wait complete. 2021-10-20T23:20:13.901 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2021-10-20T23:20:14.214 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:19:56.508295+0000', 'modified': '2021-10-20T23:19:58.195517+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/2162960241', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 2162960241}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 2162960241}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:20:14.214 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:20:14.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:20:14.335 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":4272,"want_state":"up:active","state":"up:active","rank_uptime":17.814405141999998,"mdsmap_epoch":7,"osdmap_epoch":25,"osdmap_epoch_barrier":25,"uptime":24.172871421} 2021-10-20T23:20:14.336 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 4272, "mdsmap_epoch": 7, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "rank_uptime": 17.814405142, "state": "up:active", "uptime": 24.172871421, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:20:14.336 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:20:14.337 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:20:14.337 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:20:14.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:14.338 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:14.346 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:20:14.362 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:20:14.363 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:20:14.418 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:20:14.421 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:20:14.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:14.422 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:20:14.428 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:20:14.428 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:14.432 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:20:14.448 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:20:14.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:20:14.510 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:20:14.511 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:20:14.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:14.512 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:20:14.519 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-10-20T23:20:14.513+0000 7f9e9e4b4080 -1 init, newargv = 0x55b9ce7b1b80 newargc=9 2021-10-20T23:20:14.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13772]: starting ceph client 2021-10-20T23:20:14.530 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13772]: starting fuse 2021-10-20T23:20:15.623 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:20:15.643 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:20:15.643 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:20:15.700 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:20:15.701 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:20:15.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:15.702 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:20:15.711 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:20:15.711 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:20:15.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:15.712 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:20:15.713 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:20:15.713 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:20:15.713 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:20:15.714 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:20:15.714 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:20:15.714 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:20:15.715 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:20:15.715 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:20:15.715 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:20:15.715 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:20:15.716 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:20:15.716 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:20:15.716 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:20:15.717 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:20:15.717 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:20:15.717 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:20:15.718 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:20:15.718 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:20:15.719 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:20:15.719 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:20:15.719 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:20:15.720 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:20:15.766 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13772.asok 2021-10-20T23:20:15.771 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13772.asok 2021-10-20T23:20:15.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:15.773 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13772.asok status 2021-10-20T23:20:15.875 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:20:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:20:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:20:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:20:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:20:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:20:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:20:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13772", 2021-10-20T23:20:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:20:15.878 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:20:15.878 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:20:15.878 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:20:15.878 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4514, 2021-10-20T23:20:15.878 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:20:15.879 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:20:15.879 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:20:15.879 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 4514 2021-10-20T23:20:15.879 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:20:15.880 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:20:15.881 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:20:15.881 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:20:15.882 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 4037742155 2021-10-20T23:20:15.882 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:20:15.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:20:15.885 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:20:15.885 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:20:15.886 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:20:15.886 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 4037742155 2021-10-20T23:20:15.886 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:20:15.887 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.4514 172.21.15.136:0/4037742155", 2021-10-20T23:20:15.887 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/4037742155", 2021-10-20T23:20:15.887 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:20:15.887 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 7, 2021-10-20T23:20:15.887 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 25, 2021-10-20T23:20:15.888 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:20:15.888 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:20:15.888 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:20:15.888 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:20:15.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:15.890 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:15.890 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:15.899 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:20:15.901 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:20:15.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:15.902 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:15.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:15.923 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:15.923 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:15.932 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:20:15.933 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:20:15.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:15.934 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:15.959 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-10-20T23:20:15.987 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.095+0000 7f5e89fd2700 1 Processor -- start 2021-10-20T23:20:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.095+0000 7f5e89fd2700 1 -- start start 2021-10-20T23:20:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e840b1db0 0x7f5e840b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e841483a0 0x7f5e840b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e840b0350 con 0x7f5e840a70c0 2021-10-20T23:20:16.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840a90c0 con 0x7f5e840b1db0 2021-10-20T23:20:16.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b05f0 con 0x7f5e841483a0 2021-10-20T23:20:16.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e837fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e840b1db0 0x7f5e840b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e837fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e840b1db0 0x7f5e840b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37306/0 (socket says 172.21.15.12:37306) 2021-10-20T23:20:16.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e837fe700 1 -- 172.21.15.12:0/3444893237 learned_addr learned my addr 172.21.15.12:0/3444893237 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e82ffd700 1 --2- 172.21.15.12:0/3444893237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e841483a0 0x7f5e840b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e837fe700 1 -- 172.21.15.12:0/3444893237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e841483a0 msgr2=0x7f5e840b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e837fe700 1 --2- 172.21.15.12:0/3444893237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e841483a0 0x7f5e840b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e837fe700 1 -- 172.21.15.12:0/3444893237 >> v1:172.21.15.31:6789/0 conn(0x7f5e840a70c0 legacy=0x7f5e84144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e837fe700 1 -- 172.21.15.12:0/3444893237 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840b0890 con 0x7f5e840b1db0 2021-10-20T23:20:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e837fe700 1 --2- 172.21.15.12:0/3444893237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840b1db0 0x7f5e840b0fd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f5e78002f70 tx=0x7f5e78006eb0).ready entity=mon.0 client_cookie=36652c46fee7dc9e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e827fc700 1 -- 172.21.15.12:0/3444893237 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e7800d570 con 0x7f5e840b1db0 2021-10-20T23:20:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e827fc700 1 -- 172.21.15.12:0/3444893237 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78000e90 con 0x7f5e840b1db0 2021-10-20T23:20:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e827fc700 1 -- 172.21.15.12:0/3444893237 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e7800d900 con 0x7f5e840b1db0 2021-10-20T23:20:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 -- 172.21.15.12:0/3444893237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840b1db0 msgr2=0x7f5e840b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 --2- 172.21.15.12:0/3444893237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840b1db0 0x7f5e840b0fd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f5e78002f70 tx=0x7f5e78006eb0).stop 2021-10-20T23:20:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 -- 172.21.15.12:0/3444893237 shutdown_connections 2021-10-20T23:20:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 --2- 172.21.15.12:0/3444893237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e841483a0 0x7f5e840b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 --2- 172.21.15.12:0/3444893237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840b1db0 0x7f5e840b0fd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 -- 172.21.15.12:0/3444893237 >> 172.21.15.12:0/3444893237 conn(0x7f5e8405f6b0 msgr2=0x7f5e8405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 -- 172.21.15.12:0/3444893237 shutdown_connections 2021-10-20T23:20:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.099+0000 7f5e89fd2700 1 -- 172.21.15.12:0/3444893237 wait complete. 2021-10-20T23:20:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.103+0000 7f5e89fd2700 1 Processor -- start 2021-10-20T23:20:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.103+0000 7f5e89fd2700 1 -- start start 2021-10-20T23:20:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.103+0000 7f5e89fd2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840a70c0 0x7f5e8413f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.103+0000 7f5e89fd2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e840b1db0 0x7f5e84140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.103+0000 7f5e89fd2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e841483a0 0x7f5e8413d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.103+0000 7f5e89fd2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840aa390 con 0x7f5e840a70c0 2021-10-20T23:20:16.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.103+0000 7f5e89fd2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840aa630 con 0x7f5e841483a0 2021-10-20T23:20:16.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.103+0000 7f5e89fd2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840aa8d0 con 0x7f5e840b1db0 2021-10-20T23:20:16.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.103+0000 7f5e837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840a70c0 0x7f5e8413f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840a70c0 0x7f5e8413f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37310/0 (socket says 172.21.15.12:37310) 2021-10-20T23:20:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e837fe700 1 -- 172.21.15.12:0/2584737289 learned_addr learned my addr 172.21.15.12:0/2584737289 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e82ffd700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e840b1db0 0x7f5e84140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e83fff700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e841483a0 0x7f5e8413d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e837fe700 1 -- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e840b1db0 msgr2=0x7f5e84140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e837fe700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e840b1db0 0x7f5e84140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e837fe700 1 -- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e841483a0 msgr2=0x7f5e8413d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e837fe700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e841483a0 0x7f5e8413d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e837fe700 1 -- 172.21.15.12:0/2584737289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7800b1e0 con 0x7f5e840a70c0 2021-10-20T23:20:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e837fe700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840a70c0 0x7f5e8413f210 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5e78002f70 tx=0x7f5e78015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e80ff9700 1 -- 172.21.15.12:0/2584737289 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e78011610 con 0x7f5e840a70c0 2021-10-20T23:20:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e80ff9700 1 -- 172.21.15.12:0/2584737289 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78011770 con 0x7f5e840a70c0 2021-10-20T23:20:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e840aab70 con 0x7f5e840a70c0 2021-10-20T23:20:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e80ff9700 1 -- 172.21.15.12:0/2584737289 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e78011ad0 con 0x7f5e840a70c0 2021-10-20T23:20:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e84142420 con 0x7f5e840a70c0 2021-10-20T23:20:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.107+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e840b0b30 con 0x7f5e840a70c0 2021-10-20T23:20:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.111+0000 7f5e80ff9700 1 -- 172.21.15.12:0/2584737289 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5e78025030 con 0x7f5e840a70c0 2021-10-20T23:20:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.111+0000 7f5e80ff9700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e640536a0 0x7f5e64055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.111+0000 7f5e80ff9700 1 -- 172.21.15.12:0/2584737289 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5e7806ca00 con 0x7f5e840a70c0 2021-10-20T23:20:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.111+0000 7f5e82ffd700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e640536a0 0x7f5e64055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.111+0000 7f5e82ffd700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e640536a0 0x7f5e64055b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5e7400b000 tx=0x7f5e74006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.115+0000 7f5e80ff9700 1 -- 172.21.15.12:0/2584737289 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5e78043a00 con 0x7f5e840a70c0 2021-10-20T23:20:16.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.247+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e84057350 con 0x7f5e840a70c0 2021-10-20T23:20:16.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e80ff9700 1 -- 172.21.15.12:0/2584737289 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f5e78023020 con 0x7f5e840a70c0 2021-10-20T23:20:16.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:16.253 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e640536a0 msgr2=0x7f5e64055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e640536a0 0x7f5e64055b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5e7400b000 tx=0x7f5e74006df0).stop 2021-10-20T23:20:16.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840a70c0 msgr2=0x7f5e8413f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840a70c0 0x7f5e8413f210 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5e78002f70 tx=0x7f5e78015000).stop 2021-10-20T23:20:16.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 shutdown_connections 2021-10-20T23:20:16.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e640536a0 0x7f5e64055b60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e841483a0 0x7f5e8413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e840b1db0 0x7f5e84140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 --2- 172.21.15.12:0/2584737289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e840a70c0 0x7f5e8413f210 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 >> 172.21.15.12:0/2584737289 conn(0x7f5e8405f6b0 msgr2=0x7f5e84147770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 shutdown_connections 2021-10-20T23:20:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.251+0000 7f5e89fd2700 1 -- 172.21.15.12:0/2584737289 wait complete. 2021-10-20T23:20:16.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:19:51.434642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:19:54.214563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:20:16.267 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:20:16.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac61325700 1 Processor -- start 2021-10-20T23:20:16.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac61325700 1 -- start start 2021-10-20T23:20:16.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac61325700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac5c0a9ec0 0x7fac5c0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac61325700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fac5c0603d0 0x7fac5c13ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac61325700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 0x7fac5c13f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac61325700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c061990 con 0x7fac5c0603d0 2021-10-20T23:20:16.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac61325700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c061c30 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac61325700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c060b90 con 0x7fac5c13d1c0 2021-10-20T23:20:16.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fac5c0603d0 0x7fac5c13ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fac5c0603d0 0x7fac5c13ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37322/0 (socket says 172.21.15.12:37322) 2021-10-20T23:20:16.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5a7fc700 1 -- 172.21.15.12:0/1262265771 learned_addr learned my addr 172.21.15.12:0/1262265771 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:16.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5b7fe700 1 --2- 172.21.15.12:0/1262265771 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 0x7fac5c13f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5affd700 1 --2- 172.21.15.12:0/1262265771 >> v2:172.21.15.31:3300/0 conn(0x7fac5c0a9ec0 0x7fac5c0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5a7fc700 1 -- 172.21.15.12:0/1262265771 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 msgr2=0x7fac5c13f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5a7fc700 1 --2- 172.21.15.12:0/1262265771 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 0x7fac5c13f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5a7fc700 1 -- 172.21.15.12:0/1262265771 >> v2:172.21.15.31:3300/0 conn(0x7fac5c0a9ec0 msgr2=0x7fac5c0aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5a7fc700 1 --2- 172.21.15.12:0/1262265771 >> v2:172.21.15.31:3300/0 conn(0x7fac5c0a9ec0 0x7fac5c0aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5a7fc700 1 -- 172.21.15.12:0/1262265771 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c060e30 con 0x7fac5c0603d0 2021-10-20T23:20:16.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.375+0000 7fac5affd700 1 --2- 172.21.15.12:0/1262265771 >> v2:172.21.15.31:3300/0 conn(0x7fac5c0a9ec0 0x7fac5c0aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:16.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac5a7fc700 1 --2- 172.21.15.12:0/1262265771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0603d0 0x7fac5c13ccd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fac44002f70 tx=0x7fac44006eb0).ready entity=mon.0 client_cookie=5af1eaf21529657c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac59ffb700 1 -- 172.21.15.12:0/1262265771 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac4400d570 con 0x7fac5c0603d0 2021-10-20T23:20:16.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac59ffb700 1 -- 172.21.15.12:0/1262265771 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac44000e90 con 0x7fac5c0603d0 2021-10-20T23:20:16.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac59ffb700 1 -- 172.21.15.12:0/1262265771 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac4400d900 con 0x7fac5c0603d0 2021-10-20T23:20:16.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac61325700 1 -- 172.21.15.12:0/1262265771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0603d0 msgr2=0x7fac5c13ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac61325700 1 --2- 172.21.15.12:0/1262265771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0603d0 0x7fac5c13ccd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fac44002f70 tx=0x7fac44006eb0).stop 2021-10-20T23:20:16.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac61325700 1 -- 172.21.15.12:0/1262265771 shutdown_connections 2021-10-20T23:20:16.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac61325700 1 --2- 172.21.15.12:0/1262265771 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 0x7fac5c13f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac61325700 1 --2- 172.21.15.12:0/1262265771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0603d0 0x7fac5c13ccd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac61325700 1 --2- 172.21.15.12:0/1262265771 >> v2:172.21.15.31:3300/0 conn(0x7fac5c0a9ec0 0x7fac5c0aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac61325700 1 -- 172.21.15.12:0/1262265771 >> 172.21.15.12:0/1262265771 conn(0x7fac5c0b2970 msgr2=0x7fac5c0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:16.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac61325700 1 -- 172.21.15.12:0/1262265771 shutdown_connections 2021-10-20T23:20:16.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.379+0000 7fac61325700 1 -- 172.21.15.12:0/1262265771 wait complete. 2021-10-20T23:20:16.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac61325700 1 Processor -- start 2021-10-20T23:20:16.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac61325700 1 -- start start 2021-10-20T23:20:16.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac61325700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c0603d0 0x7fac5c143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac61325700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0a9ec0 0x7fac5c0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac61325700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 0x7fac5c152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac61325700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0ad3c0 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac61325700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c153000 con 0x7fac5c0603d0 2021-10-20T23:20:16.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac61325700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0ad730 con 0x7fac5c13d1c0 2021-10-20T23:20:16.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0a9ec0 0x7fac5c0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c0603d0 0x7fac5c143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0a9ec0 0x7fac5c0ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37326/0 (socket says 172.21.15.12:37326) 2021-10-20T23:20:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5a7fc700 1 -- 172.21.15.12:0/2176995491 learned_addr learned my addr 172.21.15.12:0/2176995491 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5b7fe700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 0x7fac5c152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5a7fc700 1 -- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 msgr2=0x7fac5c152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5a7fc700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 0x7fac5c152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5a7fc700 1 -- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c0603d0 msgr2=0x7fac5c143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5a7fc700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c0603d0 0x7fac5c143180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5a7fc700 1 -- 172.21.15.12:0/2176995491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c009470 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.383+0000 7fac5affd700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c0603d0 0x7fac5c143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.387+0000 7fac5a7fc700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0a9ec0 0x7fac5c0ae8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fac44002f70 tx=0x7fac44015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.387+0000 7fac53fff700 1 -- 172.21.15.12:0/2176995491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac440117e0 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.387+0000 7fac53fff700 1 -- 172.21.15.12:0/2176995491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac44011940 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.387+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4400b1e0 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.387+0000 7fac53fff700 1 -- 172.21.15.12:0/2176995491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac44011ca0 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.387+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c143670 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.387+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c0610d0 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.387+0000 7fac53fff700 1 -- 172.21.15.12:0/2176995491 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac44025030 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.391+0000 7fac53fff700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac400534f0 0x7fac400559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.391+0000 7fac53fff700 1 -- 172.21.15.12:0/2176995491 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fac4406cb30 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.391+0000 7fac5affd700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac400534f0 0x7fac400559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.391+0000 7fac5affd700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac400534f0 0x7fac400559b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fac4c00b000 tx=0x7fac4c0091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.395+0000 7fac53fff700 1 -- 172.21.15.12:0/2176995491 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac44043b30 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.527+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fac5c057350 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.527+0000 7fac53fff700 1 -- 172.21.15.12:0/2176995491 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fac44023020 con 0x7fac5c0a9ec0 2021-10-20T23:20:16.533 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:20:16.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.527+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac400534f0 msgr2=0x7fac400559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.527+0000 7fac61325700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac400534f0 0x7fac400559b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fac4c00b000 tx=0x7fac4c0091d0).stop 2021-10-20T23:20:16.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0a9ec0 msgr2=0x7fac5c0ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0a9ec0 0x7fac5c0ae8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fac44002f70 tx=0x7fac44015000).stop 2021-10-20T23:20:16.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 shutdown_connections 2021-10-20T23:20:16.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac400534f0 0x7fac400559b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c13d1c0 0x7fac5c152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac5c0a9ec0 0x7fac5c0ae8f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 --2- 172.21.15.12:0/2176995491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c0603d0 0x7fac5c143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 >> 172.21.15.12:0/2176995491 conn(0x7fac5c0b2970 msgr2=0x7fac5c13ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 shutdown_connections 2021-10-20T23:20:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.531+0000 7fac61325700 1 -- 172.21.15.12:0/2176995491 wait complete. 2021-10-20T23:20:16.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:20:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 Processor -- start 2021-10-20T23:20:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 -- start start 2021-10-20T23:20:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fda680b2580 0x7fda6814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680b0010 0x7fda6814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680a70c0 con 0x7fda680afbd0 2021-10-20T23:20:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda680a72f0 con 0x7fda680b2580 2021-10-20T23:20:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680a7590 con 0x7fda680b0010 2021-10-20T23:20:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6d58f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fda680b2580 0x7fda6814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6d58f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fda680b2580 0x7fda6814ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37332/0 (socket says 172.21.15.12:37332) 2021-10-20T23:20:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6dd90700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fda680afbd0 0x7fda680a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35930/0 (socket says 172.21.15.12:35930) 2021-10-20T23:20:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6d58f700 1 -- 172.21.15.12:0/2815932597 learned_addr learned my addr 172.21.15.12:0/2815932597 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6cd8e700 1 --2- 172.21.15.12:0/2815932597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680b0010 0x7fda6814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6d58f700 1 -- 172.21.15.12:0/2815932597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680b0010 msgr2=0x7fda6814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6d58f700 1 --2- 172.21.15.12:0/2815932597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680b0010 0x7fda6814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6d58f700 1 -- 172.21.15.12:0/2815932597 >> v1:172.21.15.12:6789/0 conn(0x7fda680afbd0 legacy=0x7fda680a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda67fff700 1 -- 172.21.15.12:0/2815932597 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113077609 0 0) 0x7fda680a70c0 con 0x7fda680afbd0 2021-10-20T23:20:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6d58f700 1 -- 172.21.15.12:0/2815932597 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680a7830 con 0x7fda680b2580 2021-10-20T23:20:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6d58f700 1 --2- 172.21.15.12:0/2815932597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 0x7fda6814ae40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fda5c002f70 tx=0x7fda5c006eb0).ready entity=mon.0 client_cookie=9b6a7f2c6bdef353 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda67fff700 1 -- 172.21.15.12:0/2815932597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5c00d5c0 con 0x7fda680b2580 2021-10-20T23:20:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda67fff700 1 -- 172.21.15.12:0/2815932597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c000e90 con 0x7fda680b2580 2021-10-20T23:20:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda67fff700 1 -- 172.21.15.12:0/2815932597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5c00d910 con 0x7fda680b2580 2021-10-20T23:20:16.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 -- 172.21.15.12:0/2815932597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 msgr2=0x7fda6814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 --2- 172.21.15.12:0/2815932597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 0x7fda6814ae40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fda5c002f70 tx=0x7fda5c006eb0).stop 2021-10-20T23:20:16.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 -- 172.21.15.12:0/2815932597 shutdown_connections 2021-10-20T23:20:16.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 --2- 172.21.15.12:0/2815932597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680b0010 0x7fda6814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.647+0000 7fda6e591700 1 --2- 172.21.15.12:0/2815932597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 0x7fda6814ae40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 -- 172.21.15.12:0/2815932597 >> 172.21.15.12:0/2815932597 conn(0x7fda68060180 msgr2=0x7fda680b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:16.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 -- 172.21.15.12:0/2815932597 shutdown_connections 2021-10-20T23:20:16.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 -- 172.21.15.12:0/2815932597 wait complete. 2021-10-20T23:20:16.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 Processor -- start 2021-10-20T23:20:16.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 -- start start 2021-10-20T23:20:16.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680afbd0 0x7fda680abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda680b0010 0x7fda68142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 0x7fda6814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680ab2e0 con 0x7fda680b2580 2021-10-20T23:20:16.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680b2dd0 con 0x7fda680b0010 2021-10-20T23:20:16.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680b32a0 con 0x7fda680afbd0 2021-10-20T23:20:16.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6dd90700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 0x7fda6814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6dd90700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 0x7fda6814d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37342/0 (socket says 172.21.15.12:37342) 2021-10-20T23:20:16.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6dd90700 1 -- 172.21.15.12:0/1411341612 learned_addr learned my addr 172.21.15.12:0/1411341612 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:16.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6d58f700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680afbd0 0x7fda680abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6cd8e700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda680b0010 0x7fda68142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6dd90700 1 -- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680afbd0 msgr2=0x7fda680abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6dd90700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680afbd0 0x7fda680abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6dd90700 1 -- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda680b0010 msgr2=0x7fda68142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6dd90700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda680b0010 0x7fda68142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6dd90700 1 -- 172.21.15.12:0/1411341612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c00b1e0 con 0x7fda680b2580 2021-10-20T23:20:16.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6cd8e700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda680b0010 0x7fda68142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:16.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6dd90700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 0x7fda6814d340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fda680aba50 tx=0x7fda580079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda667fc700 1 -- 172.21.15.12:0/1411341612 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda580070d0 con 0x7fda680b2580 2021-10-20T23:20:16.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda667fc700 1 -- 172.21.15.12:0/1411341612 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58007230 con 0x7fda680b2580 2021-10-20T23:20:16.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda667fc700 1 -- 172.21.15.12:0/1411341612 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda58005740 con 0x7fda680b2580 2021-10-20T23:20:16.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda680b3000 con 0x7fda680b2580 2021-10-20T23:20:16.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.651+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda681570e0 con 0x7fda680b2580 2021-10-20T23:20:16.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.655+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda68057350 con 0x7fda680b2580 2021-10-20T23:20:16.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.655+0000 7fda667fc700 1 -- 172.21.15.12:0/1411341612 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda58010070 con 0x7fda680b2580 2021-10-20T23:20:16.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.655+0000 7fda667fc700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda480536d0 0x7fda48055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.655+0000 7fda667fc700 1 -- 172.21.15.12:0/1411341612 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fda5806b0f0 con 0x7fda680b2580 2021-10-20T23:20:16.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.655+0000 7fda6d58f700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda480536d0 0x7fda48055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.655+0000 7fda6d58f700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda480536d0 0x7fda48055b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fda5c01c000 tx=0x7fda5c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.663+0000 7fda667fc700 1 -- 172.21.15.12:0/1411341612 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda580420f0 con 0x7fda680b2580 2021-10-20T23:20:16.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.791+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda680698e0 con 0x7fda680b2580 2021-10-20T23:20:16.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.791+0000 7fda667fc700 1 -- 172.21.15.12:0/1411341612 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda58045710 con 0x7fda680b2580 2021-10-20T23:20:16.794 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.791+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda480536d0 msgr2=0x7fda48055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.791+0000 7fda6e591700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda480536d0 0x7fda48055b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fda5c01c000 tx=0x7fda5c015000).stop 2021-10-20T23:20:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.791+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 msgr2=0x7fda6814d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.791+0000 7fda6e591700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 0x7fda6814d340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fda680aba50 tx=0x7fda580079e0).stop 2021-10-20T23:20:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.795+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 shutdown_connections 2021-10-20T23:20:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.795+0000 7fda6e591700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fda480536d0 0x7fda48055b90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.795+0000 7fda6e591700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda680b2580 0x7fda6814d340 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.795+0000 7fda6e591700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda680b0010 0x7fda68142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.795+0000 7fda6e591700 1 --2- 172.21.15.12:0/1411341612 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda680afbd0 0x7fda680abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.795+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 >> 172.21.15.12:0/1411341612 conn(0x7fda68060180 msgr2=0x7fda680673e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:16.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.795+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 shutdown_connections 2021-10-20T23:20:16.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.795+0000 7fda6e591700 1 -- 172.21.15.12:0/1411341612 wait complete. 2021-10-20T23:20:16.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:20:16.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7bfff700 1 Processor -- start 2021-10-20T23:20:16.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7bfff700 1 -- start start 2021-10-20T23:20:16.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c061680 0x7fbd7c0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbd7c1439a0 0x7fbd7c1404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7c0b6910 con 0x7fbd7c0b4710 2021-10-20T23:20:16.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7c0b9680 con 0x7fbd7c1439a0 2021-10-20T23:20:16.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0b6bb0 con 0x7fbd7c061680 2021-10-20T23:20:16.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbd7c1439a0 0x7fbd7c1404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7a7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbd7c0b4710 0x7fbd7c13fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35942/0 (socket says 172.21.15.12:35942) 2021-10-20T23:20:16.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbd7c1439a0 0x7fbd7c1404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37350/0 (socket says 172.21.15.12:37350) 2021-10-20T23:20:16.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7b7fe700 1 -- 172.21.15.12:0/299869875 learned_addr learned my addr 172.21.15.12:0/299869875 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:16.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7affd700 1 --2- 172.21.15.12:0/299869875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c061680 0x7fbd7c0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7b7fe700 1 -- 172.21.15.12:0/299869875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c061680 msgr2=0x7fbd7c0b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7b7fe700 1 --2- 172.21.15.12:0/299869875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c061680 0x7fbd7c0b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7b7fe700 1 -- 172.21.15.12:0/299869875 >> v1:172.21.15.12:6789/0 conn(0x7fbd7c0b4710 legacy=0x7fbd7c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7b7fe700 1 -- 172.21.15.12:0/299869875 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c0b6e50 con 0x7fbd7c1439a0 2021-10-20T23:20:16.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd7b7fe700 1 --2- 172.21.15.12:0/299869875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 0x7fbd7c1404b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbd740032f0 tx=0x7fbd74009290).ready entity=mon.0 client_cookie=38821621e6ee8917 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd79ffb700 1 -- 172.21.15.12:0/299869875 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd7400b8a0 con 0x7fbd7c1439a0 2021-10-20T23:20:16.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd79ffb700 1 -- 172.21.15.12:0/299869875 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7400ba00 con 0x7fbd7c1439a0 2021-10-20T23:20:16.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.911+0000 7fbd79ffb700 1 -- 172.21.15.12:0/299869875 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd7400bb70 con 0x7fbd7c1439a0 2021-10-20T23:20:16.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 -- 172.21.15.12:0/299869875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 msgr2=0x7fbd7c1404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 --2- 172.21.15.12:0/299869875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 0x7fbd7c1404b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbd740032f0 tx=0x7fbd74009290).stop 2021-10-20T23:20:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 -- 172.21.15.12:0/299869875 shutdown_connections 2021-10-20T23:20:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 --2- 172.21.15.12:0/299869875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 0x7fbd7c1404b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 --2- 172.21.15.12:0/299869875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c061680 0x7fbd7c0b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 -- 172.21.15.12:0/299869875 >> 172.21.15.12:0/299869875 conn(0x7fbd7c06adf0 msgr2=0x7fbd7c05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 -- 172.21.15.12:0/299869875 shutdown_connections 2021-10-20T23:20:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 -- 172.21.15.12:0/299869875 wait complete. 2021-10-20T23:20:16.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 Processor -- start 2021-10-20T23:20:16.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.915+0000 7fbd7bfff700 1 -- start start 2021-10-20T23:20:16.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7c061680 0x7fbd7c112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 0x7fbd7c0ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c146ab0 0x7fbd7c0ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0ada20 con 0x7fbd7c1439a0 2021-10-20T23:20:16.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c152ff0 con 0x7fbd7c061680 2021-10-20T23:20:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c153250 con 0x7fbd7c146ab0 2021-10-20T23:20:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 0x7fbd7c0ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 0x7fbd7c0ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37354/0 (socket says 172.21.15.12:37354) 2021-10-20T23:20:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7a7fc700 1 -- 172.21.15.12:0/4208866349 learned_addr learned my addr 172.21.15.12:0/4208866349 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7affd700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7c061680 0x7fbd7c112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7b7fe700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c146ab0 0x7fbd7c0ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7a7fc700 1 -- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c146ab0 msgr2=0x7fbd7c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7a7fc700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c146ab0 0x7fbd7c0ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7a7fc700 1 -- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7c061680 msgr2=0x7fbd7c112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:16.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7a7fc700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7c061680 0x7fbd7c112a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:16.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7a7fc700 1 -- 172.21.15.12:0/4208866349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd74009530 con 0x7fbd7c1439a0 2021-10-20T23:20:16.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7a7fc700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 0x7fbd7c0ae290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fbd7c062100 tx=0x7fbd70007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd6bfff700 1 -- 172.21.15.12:0/4208866349 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd700070d0 con 0x7fbd7c1439a0 2021-10-20T23:20:16.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd6bfff700 1 -- 172.21.15.12:0/4208866349 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70007230 con 0x7fbd7c1439a0 2021-10-20T23:20:16.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd6bfff700 1 -- 172.21.15.12:0/4208866349 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd70005550 con 0x7fbd7c1439a0 2021-10-20T23:20:16.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c146610 con 0x7fbd7c1439a0 2021-10-20T23:20:16.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c0b05c0 con 0x7fbd7c1439a0 2021-10-20T23:20:16.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd6bfff700 1 -- 172.21.15.12:0/4208866349 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbd7001a070 con 0x7fbd7c1439a0 2021-10-20T23:20:16.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.919+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c0ad840 con 0x7fbd7c1439a0 2021-10-20T23:20:16.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.923+0000 7fbd6bfff700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd58053610 0x7fbd58055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:16.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.923+0000 7fbd6bfff700 1 -- 172.21.15.12:0/4208866349 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbd7006acb0 con 0x7fbd7c1439a0 2021-10-20T23:20:16.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.923+0000 7fbd7affd700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd58053610 0x7fbd58055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:16.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.923+0000 7fbd7affd700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd58053610 0x7fbd58055ad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbd6c00b000 tx=0x7fbd6c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:16.931+0000 7fbd6bfff700 1 -- 172.21.15.12:0/4208866349 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbd70041cb0 con 0x7fbd7c1439a0 2021-10-20T23:20:17.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd7c1467a0 con 0x7fbd7c1439a0 2021-10-20T23:20:17.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd6bfff700 1 -- 172.21.15.12:0/4208866349 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbd700452d0 con 0x7fbd7c1439a0 2021-10-20T23:20:17.057 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:17.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd58053610 msgr2=0x7fbd58055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd58053610 0x7fbd58055ad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbd6c00b000 tx=0x7fbd6c006df0).stop 2021-10-20T23:20:17.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 msgr2=0x7fbd7c0ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 0x7fbd7c0ae290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fbd7c062100 tx=0x7fbd70007c40).stop 2021-10-20T23:20:17.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 shutdown_connections 2021-10-20T23:20:17.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd58053610 0x7fbd58055ad0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd7c146ab0 0x7fbd7c0ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd7c1439a0 0x7fbd7c0ae290 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 --2- 172.21.15.12:0/4208866349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7c061680 0x7fbd7c112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 >> 172.21.15.12:0/4208866349 conn(0x7fbd7c06adf0 msgr2=0x7fbd7c0b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:17.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 shutdown_connections 2021-10-20T23:20:17.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.055+0000 7fbd7bfff700 1 -- 172.21.15.12:0/4208866349 wait complete. 2021-10-20T23:20:17.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:20:17.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.175+0000 7f6feb2a8700 1 Processor -- start 2021-10-20T23:20:17.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.175+0000 7f6feb2a8700 1 -- start start 2021-10-20T23:20:17.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6feb2a8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6fe4060100 0x7f6fe4064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6feb2a8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe40604e0 con 0x7f6fe4144440 2021-10-20T23:20:17.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6feb2a8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe40b23b0 con 0x7f6fe40b38d0 2021-10-20T23:20:17.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6feb2a8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe4065c80 con 0x7f6fe4060100 2021-10-20T23:20:17.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe8843700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6fe4144440 0x7f6fe4144970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35954/0 (socket says 172.21.15.12:35954) 2021-10-20T23:20:17.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe8843700 1 -- 172.21.15.12:0/1045838719 learned_addr learned my addr 172.21.15.12:0/1045838719 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:17.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe9044700 1 --2- 172.21.15.12:0/1045838719 >> v2:172.21.15.31:3300/0 conn(0x7f6fe4060100 0x7f6fe4064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721333530 0 0) 0x7f6fe40604e0 con 0x7f6fe4144440 2021-10-20T23:20:17.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fcc003260 con 0x7f6fe4144440 2021-10-20T23:20:17.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117261836 0 0) 0x7f6fe40b23b0 con 0x7f6fe40b38d0 2021-10-20T23:20:17.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe40604e0 con 0x7f6fe40b38d0 2021-10-20T23:20:17.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1005750393 0 0) 0x7f6fcc003260 con 0x7f6fe4144440 2021-10-20T23:20:17.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 >> v2:172.21.15.31:3300/0 conn(0x7f6fe4060100 msgr2=0x7f6fe4064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:17.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 --2- 172.21.15.12:0/1045838719 >> v2:172.21.15.31:3300/0 conn(0x7f6fe4060100 0x7f6fe4064d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 >> v1:172.21.15.31:6789/0 conn(0x7f6fe40b38d0 legacy=0x7f6fe414b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40b2650 con 0x7f6fe4144440 2021-10-20T23:20:17.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f6fd4001660 con 0x7f6fe4144440 2021-10-20T23:20:17.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 >> v1:172.21.15.12:6789/0 conn(0x7f6fe4144440 legacy=0x7f6fe4144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fcc0038e0 0x7f6fcc003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fcc004500 0x7f6fcc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004e70 0x7f6fcc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe4065c80 con 0x7f6fcc004500 2021-10-20T23:20:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc00bcf0 con 0x7f6fcc004e70 2021-10-20T23:20:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc00beb0 con 0x7f6fcc0038e0 2021-10-20T23:20:17.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe8843700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fcc004500 0x7f6fcc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe9044700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fcc0038e0 0x7f6fcc003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe9845700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004e70 0x7f6fcc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe8843700 1 -- 172.21.15.12:0/1045838719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fcc0038e0 msgr2=0x7f6fcc003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:17.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe8843700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fcc0038e0 0x7f6fcc003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe8843700 1 -- 172.21.15.12:0/1045838719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004e70 msgr2=0x7f6fcc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:17.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe8843700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004e70 0x7f6fcc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe8843700 1 -- 172.21.15.12:0/1045838719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc003260 con 0x7f6fcc004500 2021-10-20T23:20:17.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe9845700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004e70 0x7f6fcc00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe9845700 1 -- 172.21.15.12:0/1045838719 reap_dead start 2021-10-20T23:20:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fe8843700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fcc004500 0x7f6fcc004980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f6fd4001430 tx=0x7f6fd4001dd0).ready entity=mon.0 client_cookie=56369186583f4369 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd40070d0 con 0x7f6fcc004500 2021-10-20T23:20:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd4007230 con 0x7f6fcc004500 2021-10-20T23:20:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.179+0000 7f6fd3fff700 1 -- 172.21.15.12:0/1045838719 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd400c8c0 con 0x7f6fcc004500 2021-10-20T23:20:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 -- 172.21.15.12:0/1045838719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fcc004500 msgr2=0x7f6fcc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fcc004500 0x7f6fcc004980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f6fd4001430 tx=0x7f6fd4001dd0).stop 2021-10-20T23:20:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 -- 172.21.15.12:0/1045838719 shutdown_connections 2021-10-20T23:20:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 --2- 172.21.15.12:0/1045838719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fcc004500 0x7f6fcc004980 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 -- 172.21.15.12:0/1045838719 >> 172.21.15.12:0/1045838719 conn(0x7f6fe405cf60 msgr2=0x7f6fe405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 -- 172.21.15.12:0/1045838719 shutdown_connections 2021-10-20T23:20:17.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 -- 172.21.15.12:0/1045838719 wait complete. 2021-10-20T23:20:17.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 Processor -- start 2021-10-20T23:20:17.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 -- start start 2021-10-20T23:20:17.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004500 0x7f6fe4147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe40b0160 0x7f6fe4155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fe4147d80 0x7f6fe4156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40af060 con 0x7f6fe40b0160 2021-10-20T23:20:17.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe4147000 con 0x7f6fcc004500 2021-10-20T23:20:17.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6feb2a8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe41483a0 con 0x7f6fe4147d80 2021-10-20T23:20:17.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6fe8843700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe40b0160 0x7f6fe4155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6fe8843700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe40b0160 0x7f6fe4155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37374/0 (socket says 172.21.15.12:37374) 2021-10-20T23:20:17.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6fe8843700 1 -- 172.21.15.12:0/3651589545 learned_addr learned my addr 172.21.15.12:0/3651589545 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:17.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6fe9044700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004500 0x7f6fe4147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.183+0000 7f6fe9845700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fe4147d80 0x7f6fe4156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fe8843700 1 -- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fe4147d80 msgr2=0x7f6fe4156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fe8843700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fe4147d80 0x7f6fe4156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fe8843700 1 -- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004500 msgr2=0x7f6fe4147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fe8843700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004500 0x7f6fe4147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fe8843700 1 -- 172.21.15.12:0/3651589545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4147230 con 0x7f6fe40b0160 2021-10-20T23:20:17.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fe8843700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe40b0160 0x7f6fe4155da0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f6fd4001430 tx=0x7f6fd4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fd27fc700 1 -- 172.21.15.12:0/3651589545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd40070d0 con 0x7f6fe40b0160 2021-10-20T23:20:17.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fd27fc700 1 -- 172.21.15.12:0/3651589545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd4000e90 con 0x7f6fe40b0160 2021-10-20T23:20:17.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fd27fc700 1 -- 172.21.15.12:0/3651589545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd4004710 con 0x7f6fe40b0160 2021-10-20T23:20:17.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe4146980 con 0x7f6fe40b0160 2021-10-20T23:20:17.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe4146170 con 0x7f6fe40b0160 2021-10-20T23:20:17.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fd27fc700 1 -- 172.21.15.12:0/3651589545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6fd4026070 con 0x7f6fe40b0160 2021-10-20T23:20:17.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe4057350 con 0x7f6fe40b0160 2021-10-20T23:20:17.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fd27fc700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fc4053610 0x7f6fc4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fd27fc700 1 -- 172.21.15.12:0/3651589545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6fd406bf60 con 0x7f6fe40b0160 2021-10-20T23:20:17.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fe9044700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fc4053610 0x7f6fc4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.187+0000 7f6fe9044700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fc4053610 0x7f6fc4055ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f6fe000b000 tx=0x7f6fe0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.191+0000 7f6fd27fc700 1 -- 172.21.15.12:0/3651589545 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6fd4042e50 con 0x7f6fe40b0160 2021-10-20T23:20:17.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.315+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6fe413b610 con 0x7f6fe40b0160 2021-10-20T23:20:17.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.315+0000 7f6fd27fc700 1 -- 172.21.15.12:0/3651589545 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6fd4046470 con 0x7f6fe40b0160 2021-10-20T23:20:17.318 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.315+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fc4053610 msgr2=0x7f6fc4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.315+0000 7f6feb2a8700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fc4053610 0x7f6fc4055ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f6fe000b000 tx=0x7f6fe0006df0).stop 2021-10-20T23:20:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.315+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe40b0160 msgr2=0x7f6fe4155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.315+0000 7f6feb2a8700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe40b0160 0x7f6fe4155da0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f6fd4001430 tx=0x7f6fd4015000).stop 2021-10-20T23:20:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.319+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 shutdown_connections 2021-10-20T23:20:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.319+0000 7f6feb2a8700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fc4053610 0x7f6fc4055ad0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.319+0000 7f6feb2a8700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fe4147d80 0x7f6fe4156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.319+0000 7f6feb2a8700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe40b0160 0x7f6fe4155da0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.319+0000 7f6feb2a8700 1 --2- 172.21.15.12:0/3651589545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fcc004500 0x7f6fe4147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.319+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 >> 172.21.15.12:0/3651589545 conn(0x7f6fe405cf60 msgr2=0x7f6fe4064c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.319+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 shutdown_connections 2021-10-20T23:20:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.319+0000 7f6feb2a8700 1 -- 172.21.15.12:0/3651589545 wait complete. 2021-10-20T23:20:17.331 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:17.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.431+0000 7ff41dafb700 1 Processor -- start 2021-10-20T23:20:17.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41dafb700 1 -- start start 2021-10-20T23:20:17.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41dafb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff41805c7d0 0x7ff4180b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41dafb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 0x7ff4180aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41dafb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41805cbb0 con 0x7ff41805d0b0 2021-10-20T23:20:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41dafb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4180ad540 con 0x7ff41805c7d0 2021-10-20T23:20:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41dafb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff418067d70 con 0x7ff41813f390 2021-10-20T23:20:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41caf9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff41805c7d0 0x7ff4180b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff417fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff41805d0b0 0x7ff4180ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:43038/0 (socket says 172.21.15.12:43038) 2021-10-20T23:20:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff417fff700 1 -- 172.21.15.12:0/3504797324 learned_addr learned my addr 172.21.15.12:0/3504797324 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:17.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41d2fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 0x7ff4180aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff4177fe700 1 -- 172.21.15.12:0/3504797324 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084243335 0 0) 0x7ff41805cbb0 con 0x7ff41805d0b0 2021-10-20T23:20:17.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff4177fe700 1 -- 172.21.15.12:0/3504797324 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3fc003260 con 0x7ff41805d0b0 2021-10-20T23:20:17.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41caf9700 1 -- 172.21.15.12:0/3504797324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 msgr2=0x7ff4180aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:17.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41caf9700 1 --2- 172.21.15.12:0/3504797324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 0x7ff4180aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41caf9700 1 -- 172.21.15.12:0/3504797324 >> v1:172.21.15.31:6789/0 conn(0x7ff41805d0b0 legacy=0x7ff4180ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41caf9700 1 -- 172.21.15.12:0/3504797324 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180b1790 con 0x7ff41805c7d0 2021-10-20T23:20:17.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff41caf9700 1 --2- 172.21.15.12:0/3504797324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff41805c7d0 0x7ff4180b10f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff40c002f70 tx=0x7ff40c006df0).ready entity=mon.1 client_cookie=9a87498265bb7146 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff4177fe700 1 -- 172.21.15.12:0/3504797324 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c00d4a0 con 0x7ff41805c7d0 2021-10-20T23:20:17.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff4177fe700 1 -- 172.21.15.12:0/3504797324 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c000e90 con 0x7ff41805c7d0 2021-10-20T23:20:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.435+0000 7ff4177fe700 1 -- 172.21.15.12:0/3504797324 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c00d7f0 con 0x7ff41805c7d0 2021-10-20T23:20:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 -- 172.21.15.12:0/3504797324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff41805c7d0 msgr2=0x7ff4180b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 --2- 172.21.15.12:0/3504797324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff41805c7d0 0x7ff4180b10f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff40c002f70 tx=0x7ff40c006df0).stop 2021-10-20T23:20:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 -- 172.21.15.12:0/3504797324 shutdown_connections 2021-10-20T23:20:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 --2- 172.21.15.12:0/3504797324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 0x7ff4180aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 --2- 172.21.15.12:0/3504797324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff41805c7d0 0x7ff4180b10f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 -- 172.21.15.12:0/3504797324 >> 172.21.15.12:0/3504797324 conn(0x7ff418060180 msgr2=0x7ff4180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 -- 172.21.15.12:0/3504797324 shutdown_connections 2021-10-20T23:20:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 -- 172.21.15.12:0/3504797324 wait complete. 2021-10-20T23:20:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 Processor -- start 2021-10-20T23:20:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 -- start start 2021-10-20T23:20:17.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41805c7d0 0x7ff4180a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff41805d0b0 0x7ff4181505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 0x7ff418150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180b5bb0 con 0x7ff41805c7d0 2021-10-20T23:20:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4181501f0 con 0x7ff41805d0b0 2021-10-20T23:20:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41dafb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180b5070 con 0x7ff41813f390 2021-10-20T23:20:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41caf9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41805c7d0 0x7ff4180a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41caf9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41805c7d0 0x7ff4180a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37386/0 (socket says 172.21.15.12:37386) 2021-10-20T23:20:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41d2fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 0x7ff418150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41caf9700 1 -- 172.21.15.12:0/4069976355 learned_addr learned my addr 172.21.15.12:0/4069976355 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff417fff700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff41805d0b0 0x7ff4181505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41caf9700 1 -- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 msgr2=0x7ff418150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41caf9700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 0x7ff418150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41caf9700 1 -- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff41805d0b0 msgr2=0x7ff4181505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41caf9700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff41805d0b0 0x7ff4181505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41caf9700 1 -- 172.21.15.12:0/4069976355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c00b180 con 0x7ff41805c7d0 2021-10-20T23:20:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff41caf9700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41805c7d0 0x7ff4180a94a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff4180ab620 tx=0x7ff40c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff415ffb700 1 -- 172.21.15.12:0/4069976355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c012930 con 0x7ff41805c7d0 2021-10-20T23:20:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.439+0000 7ff415ffb700 1 -- 172.21.15.12:0/4069976355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c012a90 con 0x7ff41805c7d0 2021-10-20T23:20:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.443+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4180aa560 con 0x7ff41805c7d0 2021-10-20T23:20:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.443+0000 7ff415ffb700 1 -- 172.21.15.12:0/4069976355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c012df0 con 0x7ff41805c7d0 2021-10-20T23:20:17.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.443+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff418150fc0 con 0x7ff41805c7d0 2021-10-20T23:20:17.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.443+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4180b5270 con 0x7ff41805c7d0 2021-10-20T23:20:17.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.443+0000 7ff415ffb700 1 -- 172.21.15.12:0/4069976355 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff40c01c070 con 0x7ff41805c7d0 2021-10-20T23:20:17.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.443+0000 7ff415ffb700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff3f80536d0 0x7ff3f8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.443+0000 7ff415ffb700 1 -- 172.21.15.12:0/4069976355 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff40c06c5a0 con 0x7ff41805c7d0 2021-10-20T23:20:17.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.443+0000 7ff417fff700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff3f80536d0 0x7ff3f8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.443+0000 7ff417fff700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff3f80536d0 0x7ff3f8055b90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff40400d000 tx=0x7ff404009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.451+0000 7ff415ffb700 1 -- 172.21.15.12:0/4069976355 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff40c0435a0 con 0x7ff41805c7d0 2021-10-20T23:20:17.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.579+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4180b1a30 con 0x7ff41805c7d0 2021-10-20T23:20:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.579+0000 7ff415ffb700 1 -- 172.21.15.12:0/4069976355 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7ff40c02ffc0 con 0x7ff41805c7d0 2021-10-20T23:20:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:17.585 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:17.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff3f80536d0 msgr2=0x7ff3f8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff3f80536d0 0x7ff3f8055b90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff40400d000 tx=0x7ff404009040).stop 2021-10-20T23:20:17.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41805c7d0 msgr2=0x7ff4180a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41805c7d0 0x7ff4180a94a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff4180ab620 tx=0x7ff40c014000).stop 2021-10-20T23:20:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 shutdown_connections 2021-10-20T23:20:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff3f80536d0 0x7ff3f8055b90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff41813f390 0x7ff418150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff41805d0b0 0x7ff4181505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 --2- 172.21.15.12:0/4069976355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41805c7d0 0x7ff4180a94a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 >> 172.21.15.12:0/4069976355 conn(0x7ff418060180 msgr2=0x7ff4180af960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 shutdown_connections 2021-10-20T23:20:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.583+0000 7ff41dafb700 1 -- 172.21.15.12:0/4069976355 wait complete. 2021-10-20T23:20:17.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:19:51.434642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:19:54.214563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:20:17.600 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:20:17.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.703+0000 7ff08bfff700 1 Processor -- start 2021-10-20T23:20:17.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.703+0000 7ff08bfff700 1 -- start start 2021-10-20T23:20:17.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff08c0ad320 0x7ff08c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08c0afda0 con 0x7ff08c0ad850 2021-10-20T23:20:17.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08c05c610 con 0x7ff08c0af2c0 2021-10-20T23:20:17.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08c140800 con 0x7ff08c0ad320 2021-10-20T23:20:17.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff08c0ad320 0x7ff08c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff08c0ad850 0x7ff08c0a8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35992/0 (socket says 172.21.15.12:35992) 2021-10-20T23:20:17.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08b7fe700 1 -- 172.21.15.12:0/3188321047 learned_addr learned my addr 172.21.15.12:0/3188321047 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08a7fc700 1 -- 172.21.15.12:0/3188321047 >> v1:172.21.15.31:6789/0 conn(0x7ff08c0af2c0 legacy=0x7ff08c143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08a7fc700 1 -- 172.21.15.12:0/3188321047 >> v1:172.21.15.12:6789/0 conn(0x7ff08c0ad850 legacy=0x7ff08c0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff089ffb700 1 -- 172.21.15.12:0/3188321047 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472802319 0 0) 0x7ff08c0afda0 con 0x7ff08c0ad850 2021-10-20T23:20:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08a7fc700 1 -- 172.21.15.12:0/3188321047 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c143860 con 0x7ff08c0ad320 2021-10-20T23:20:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08a7fc700 1 --2- 172.21.15.12:0/3188321047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad320 0x7ff08c0af6a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ff08c0ad770 tx=0x7ff07c006df0).ready entity=mon.0 client_cookie=a20bf02c735ca420 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff089ffb700 1 -- 172.21.15.12:0/3188321047 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff07c00d610 con 0x7ff08c0ad320 2021-10-20T23:20:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff089ffb700 1 -- 172.21.15.12:0/3188321047 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c000e90 con 0x7ff08c0ad320 2021-10-20T23:20:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff089ffb700 1 -- 172.21.15.12:0/3188321047 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff07c00d960 con 0x7ff08c0ad320 2021-10-20T23:20:17.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 -- 172.21.15.12:0/3188321047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad320 msgr2=0x7ff08c0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 --2- 172.21.15.12:0/3188321047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad320 0x7ff08c0af6a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ff08c0ad770 tx=0x7ff07c006df0).stop 2021-10-20T23:20:17.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 -- 172.21.15.12:0/3188321047 shutdown_connections 2021-10-20T23:20:17.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 --2- 172.21.15.12:0/3188321047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad320 0x7ff08c0af6a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 -- 172.21.15.12:0/3188321047 >> 172.21.15.12:0/3188321047 conn(0x7ff08c061140 msgr2=0x7ff08c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 -- 172.21.15.12:0/3188321047 shutdown_connections 2021-10-20T23:20:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.707+0000 7ff08bfff700 1 -- 172.21.15.12:0/3188321047 wait complete. 2021-10-20T23:20:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 Processor -- start 2021-10-20T23:20:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 -- start start 2021-10-20T23:20:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff08c0ad320 0x7ff08c13efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad850 0x7ff08c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff08c0af2c0 0x7ff08c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c154670 con 0x7ff08c0ad850 2021-10-20T23:20:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c0aa1b0 con 0x7ff08c0af2c0 2021-10-20T23:20:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c0a99f0 con 0x7ff08c0ad320 2021-10-20T23:20:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad850 0x7ff08c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad850 0x7ff08c153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37402/0 (socket says 172.21.15.12:37402) 2021-10-20T23:20:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08a7fc700 1 -- 172.21.15.12:0/861497792 learned_addr learned my addr 172.21.15.12:0/861497792 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08affd700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff08c0ad320 0x7ff08c13efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08b7fe700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff08c0af2c0 0x7ff08c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08a7fc700 1 -- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff08c0ad320 msgr2=0x7ff08c13efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08a7fc700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff08c0ad320 0x7ff08c13efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08a7fc700 1 -- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff08c0af2c0 msgr2=0x7ff08c154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08a7fc700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff08c0af2c0 0x7ff08c154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08a7fc700 1 -- 172.21.15.12:0/861497792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c00b180 con 0x7ff08c0ad850 2021-10-20T23:20:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08a7fc700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad850 0x7ff08c153c90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ff08c0ad770 tx=0x7ff07c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff07bfff700 1 -- 172.21.15.12:0/861497792 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff07c00bec0 con 0x7ff08c0ad850 2021-10-20T23:20:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff07bfff700 1 -- 172.21.15.12:0/861497792 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c011b40 con 0x7ff08c0ad850 2021-10-20T23:20:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c0aa3e0 con 0x7ff08c0ad850 2021-10-20T23:20:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff07bfff700 1 -- 172.21.15.12:0/861497792 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff07c011ea0 con 0x7ff08c0ad850 2021-10-20T23:20:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.711+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c13f530 con 0x7ff08c0ad850 2021-10-20T23:20:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.715+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08c057350 con 0x7ff08c0ad850 2021-10-20T23:20:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.715+0000 7ff07bfff700 1 -- 172.21.15.12:0/861497792 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff07c025030 con 0x7ff08c0ad850 2021-10-20T23:20:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.715+0000 7ff07bfff700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0680536a0 0x7ff068055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.715+0000 7ff07bfff700 1 -- 172.21.15.12:0/861497792 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff07c06cc20 con 0x7ff08c0ad850 2021-10-20T23:20:17.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.715+0000 7ff08affd700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0680536a0 0x7ff068055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.715+0000 7ff08affd700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0680536a0 0x7ff068055b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff08000d000 tx=0x7ff080007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.719+0000 7ff07bfff700 1 -- 172.21.15.12:0/861497792 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff07c043c20 con 0x7ff08c0ad850 2021-10-20T23:20:17.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff08c061990 con 0x7ff08c0ad850 2021-10-20T23:20:17.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff07bfff700 1 -- 172.21.15.12:0/861497792 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff07c023020 con 0x7ff08c0ad850 2021-10-20T23:20:17.853 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:20:17.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0680536a0 msgr2=0x7ff068055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0680536a0 0x7ff068055b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff08000d000 tx=0x7ff080007b90).stop 2021-10-20T23:20:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad850 msgr2=0x7ff08c153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad850 0x7ff08c153c90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ff08c0ad770 tx=0x7ff07c015000).stop 2021-10-20T23:20:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 shutdown_connections 2021-10-20T23:20:17.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0680536a0 0x7ff068055b60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff08c0af2c0 0x7ff08c154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08c0ad850 0x7ff08c153c90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 --2- 172.21.15.12:0/861497792 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff08c0ad320 0x7ff08c13efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 >> 172.21.15.12:0/861497792 conn(0x7ff08c061140 msgr2=0x7ff08c143ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:17.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 shutdown_connections 2021-10-20T23:20:17.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.851+0000 7ff08bfff700 1 -- 172.21.15.12:0/861497792 wait complete. 2021-10-20T23:20:17.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:20:17.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6db5e2e700 1 Processor -- start 2021-10-20T23:20:17.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6db5e2e700 1 -- start start 2021-10-20T23:20:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6db5e2e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6db0061700 0x7f6db0146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6db5e2e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db00aecf0 con 0x7f6db00ad5c0 2021-10-20T23:20:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6db5e2e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db00b6f20 con 0x7f6db0061320 2021-10-20T23:20:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6db5e2e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db00aef20 con 0x7f6db0061700 2021-10-20T23:20:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6db562d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6db0061700 0x7f6db0146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6db562d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6db0061700 0x7f6db0146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37412/0 (socket says 172.21.15.12:37412) 2021-10-20T23:20:17.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6db562d700 1 -- 172.21.15.12:0/860487520 learned_addr learned my addr 172.21.15.12:0/860487520 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:17.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.979+0000 7f6daffff700 1 --1- 172.21.15.12:0/860487520 >> v1:172.21.15.12:6789/0 conn(0x7f6db00ad5c0 0x7f6db0140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36004/0 (socket says 172.21.15.12:36004) 2021-10-20T23:20:17.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db562d700 1 -- 172.21.15.12:0/860487520 >> v1:172.21.15.31:6789/0 conn(0x7f6db0061320 legacy=0x7f6db00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:17.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db562d700 1 -- 172.21.15.12:0/860487520 >> v1:172.21.15.12:6789/0 conn(0x7f6db00ad5c0 legacy=0x7f6db0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db562d700 1 -- 172.21.15.12:0/860487520 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00af1c0 con 0x7f6db0061700 2021-10-20T23:20:17.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db562d700 1 --2- 172.21.15.12:0/860487520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db0061700 0x7f6db0146520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f6da80032f0 tx=0x7f6da8009290).ready entity=mon.0 client_cookie=2c9eba4a1f366875 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:17.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6daf7fe700 1 -- 172.21.15.12:0/860487520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da800b8a0 con 0x7f6db0061700 2021-10-20T23:20:17.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6daf7fe700 1 -- 172.21.15.12:0/860487520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800ba00 con 0x7f6db0061700 2021-10-20T23:20:17.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6daf7fe700 1 -- 172.21.15.12:0/860487520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da800bb70 con 0x7f6db0061700 2021-10-20T23:20:17.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db5e2e700 1 -- 172.21.15.12:0/860487520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db0061700 msgr2=0x7f6db0146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db5e2e700 1 --2- 172.21.15.12:0/860487520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db0061700 0x7f6db0146520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f6da80032f0 tx=0x7f6da8009290).stop 2021-10-20T23:20:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db5e2e700 1 -- 172.21.15.12:0/860487520 shutdown_connections 2021-10-20T23:20:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db5e2e700 1 --2- 172.21.15.12:0/860487520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db0061700 0x7f6db0146520 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db5e2e700 1 -- 172.21.15.12:0/860487520 >> 172.21.15.12:0/860487520 conn(0x7f6db0066de0 msgr2=0x7f6db00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db5e2e700 1 -- 172.21.15.12:0/860487520 shutdown_connections 2021-10-20T23:20:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db5e2e700 1 -- 172.21.15.12:0/860487520 wait complete. 2021-10-20T23:20:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db5e2e700 1 Processor -- start 2021-10-20T23:20:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.983+0000 7f6db5e2e700 1 -- start start 2021-10-20T23:20:17.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db5e2e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db0061320 0x7f6db0144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db5e2e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db0061700 0x7f6db0141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db5e2e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db00ad5c0 0x7f6db0146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db5e2e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b3dc0 con 0x7f6db00ad5c0 2021-10-20T23:20:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db5e2e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b33e0 con 0x7f6db0061320 2021-10-20T23:20:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db5e2e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b3680 con 0x7f6db0061700 2021-10-20T23:20:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db562d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db00ad5c0 0x7f6db0146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6daffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db0061700 0x7f6db0141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db562d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db00ad5c0 0x7f6db0146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37418/0 (socket says 172.21.15.12:37418) 2021-10-20T23:20:17.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db562d700 1 -- 172.21.15.12:0/511856766 learned_addr learned my addr 172.21.15.12:0/511856766 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:17.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db4e2c700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db0061320 0x7f6db0144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:17.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db562d700 1 -- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db0061700 msgr2=0x7f6db0141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:17.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db562d700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db0061700 0x7f6db0141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db562d700 1 -- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db0061320 msgr2=0x7f6db0144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db562d700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db0061320 0x7f6db0144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db562d700 1 -- 172.21.15.12:0/511856766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8009530 con 0x7f6db00ad5c0 2021-10-20T23:20:18.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db562d700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db00ad5c0 0x7f6db0146500 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f6da80032f0 tx=0x7f6da8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6dadffb700 1 -- 172.21.15.12:0/511856766 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da800bde0 con 0x7f6db00ad5c0 2021-10-20T23:20:18.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6dadffb700 1 -- 172.21.15.12:0/511856766 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da801f3f0 con 0x7f6db00ad5c0 2021-10-20T23:20:18.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db00b3920 con 0x7f6db00ad5c0 2021-10-20T23:20:18.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6dadffb700 1 -- 172.21.15.12:0/511856766 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da801f750 con 0x7f6db00ad5c0 2021-10-20T23:20:18.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db01455b0 con 0x7f6db00ad5c0 2021-10-20T23:20:18.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.987+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db00af460 con 0x7f6db00ad5c0 2021-10-20T23:20:18.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.991+0000 7f6dadffb700 1 -- 172.21.15.12:0/511856766 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6da8026030 con 0x7f6db00ad5c0 2021-10-20T23:20:18.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.991+0000 7f6dadffb700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d90053610 0x7f6d90055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.991+0000 7f6dadffb700 1 -- 172.21.15.12:0/511856766 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6da806c850 con 0x7f6db00ad5c0 2021-10-20T23:20:18.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.991+0000 7f6db4e2c700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d90053610 0x7f6d90055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.991+0000 7f6db4e2c700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d90053610 0x7f6d90055ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6da400d000 tx=0x7f6da4000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:17.995+0000 7f6dadffb700 1 -- 172.21.15.12:0/511856766 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6da8043850 con 0x7f6db00ad5c0 2021-10-20T23:20:18.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.123+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6db0057350 con 0x7f6db00ad5c0 2021-10-20T23:20:18.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6dadffb700 1 -- 172.21.15.12:0/511856766 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6da80240a0 con 0x7f6db00ad5c0 2021-10-20T23:20:18.128 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:18.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d90053610 msgr2=0x7f6d90055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d90053610 0x7f6d90055ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6da400d000 tx=0x7f6da4000bc0).stop 2021-10-20T23:20:18.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db00ad5c0 msgr2=0x7f6db0146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db00ad5c0 0x7f6db0146500 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f6da80032f0 tx=0x7f6da8016000).stop 2021-10-20T23:20:18.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 shutdown_connections 2021-10-20T23:20:18.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d90053610 0x7f6d90055ad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db00ad5c0 0x7f6db0146500 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db0061700 0x7f6db0141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 --2- 172.21.15.12:0/511856766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db0061320 0x7f6db0144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 >> 172.21.15.12:0/511856766 conn(0x7f6db0066de0 msgr2=0x7f6db013fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:18.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 shutdown_connections 2021-10-20T23:20:18.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.127+0000 7f6db5e2e700 1 -- 172.21.15.12:0/511856766 wait complete. 2021-10-20T23:20:18.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:20:18.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ea13700 1 Processor -- start 2021-10-20T23:20:18.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ea13700 1 -- start start 2021-10-20T23:20:18.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ea13700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe728061680 0x7fe7280b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ea13700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281439a0 0x7fe7281404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ea13700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7280b6910 con 0x7fe7280b4710 2021-10-20T23:20:18.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ea13700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280b9680 con 0x7fe728061680 2021-10-20T23:20:18.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ea13700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b6bb0 con 0x7fe7281439a0 2021-10-20T23:20:18.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72d210700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe7280b4710 0x7fe72813fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36016/0 (socket says 172.21.15.12:36016) 2021-10-20T23:20:18.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72d210700 1 -- 172.21.15.12:0/3007476165 learned_addr learned my addr 172.21.15.12:0/3007476165 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:18.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72e212700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281439a0 0x7fe7281404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72da11700 1 --2- 172.21.15.12:0/3007476165 >> v2:172.21.15.31:3300/0 conn(0x7fe728061680 0x7fe7280b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578943872 0 0) 0x7fe7280b6910 con 0x7fe7280b4710 2021-10-20T23:20:18.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe710003260 con 0x7fe7280b4710 2021-10-20T23:20:18.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1160252464 0 0) 0x7fe710003260 con 0x7fe7280b4710 2021-10-20T23:20:18.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281439a0 msgr2=0x7fe7281404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:18.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281439a0 0x7fe7281404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 >> v2:172.21.15.31:3300/0 conn(0x7fe728061680 msgr2=0x7fe7280b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:18.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 --2- 172.21.15.12:0/3007476165 >> v2:172.21.15.31:3300/0 conn(0x7fe728061680 0x7fe7280b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280b6e50 con 0x7fe7280b4710 2021-10-20T23:20:18.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fe714001660 con 0x7fe7280b4710 2021-10-20T23:20:18.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 >> v1:172.21.15.12:6789/0 conn(0x7fe7280b4710 legacy=0x7fe72813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe710003750 0x7fe710003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe710004500 0x7fe710004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281439a0 0x7fe710004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b6bb0 con 0x7fe710004500 2021-10-20T23:20:18.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710004320 con 0x7fe710003750 2021-10-20T23:20:18.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71000b780 con 0x7fe7281439a0 2021-10-20T23:20:18.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72d210700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe710004500 0x7fe710004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72e212700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281439a0 0x7fe710004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72da11700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe710003750 0x7fe710003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72d210700 1 -- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281439a0 msgr2=0x7fe710004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:18.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72d210700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281439a0 0x7fe710004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72d210700 1 -- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe710003750 msgr2=0x7fe710003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:18.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72d210700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe710003750 0x7fe710003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72d210700 1 -- 172.21.15.12:0/3007476165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710003260 con 0x7fe710004500 2021-10-20T23:20:18.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72d210700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe710004500 0x7fe710004980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fe714001370 tx=0x7fe728067700).ready entity=mon.0 client_cookie=ae7d718ca16036b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.247+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7140071a0 con 0x7fe710004500 2021-10-20T23:20:18.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe714007300 con 0x7fe710004500 2021-10-20T23:20:18.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72ca0f700 1 -- 172.21.15.12:0/3007476165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe71400cbb0 con 0x7fe710004500 2021-10-20T23:20:18.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72ea13700 1 -- 172.21.15.12:0/3007476165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe710004500 msgr2=0x7fe710004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72ea13700 1 --2- 172.21.15.12:0/3007476165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe710004500 0x7fe710004980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fe714001370 tx=0x7fe728067700).stop 2021-10-20T23:20:18.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72e212700 1 -- 172.21.15.12:0/3007476165 reap_dead start 2021-10-20T23:20:18.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72ea13700 1 -- 172.21.15.12:0/3007476165 shutdown_connections 2021-10-20T23:20:18.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72ea13700 1 -- 172.21.15.12:0/3007476165 >> 172.21.15.12:0/3007476165 conn(0x7fe72806adf0 msgr2=0x7fe72805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:18.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72ea13700 1 -- 172.21.15.12:0/3007476165 shutdown_connections 2021-10-20T23:20:18.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72ea13700 1 -- 172.21.15.12:0/3007476165 wait complete. 2021-10-20T23:20:18.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.251+0000 7fe72ea13700 1 Processor -- start 2021-10-20T23:20:18.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72ea13700 1 -- start start 2021-10-20T23:20:18.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72ea13700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7280b8560 0x7fe7280b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72ea13700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281524c0 0x7fe72813ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72ea13700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7280b0610 0x7fe72813f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72ea13700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281534b0 con 0x7fe7280b8560 2021-10-20T23:20:18.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72ea13700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728146170 con 0x7fe7280b0610 2021-10-20T23:20:18.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72ea13700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe728146840 con 0x7fe7281524c0 2021-10-20T23:20:18.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72da11700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7280b8560 0x7fe7280b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72da11700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7280b8560 0x7fe7280b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37432/0 (socket says 172.21.15.12:37432) 2021-10-20T23:20:18.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72da11700 1 -- 172.21.15.12:0/2871291656 learned_addr learned my addr 172.21.15.12:0/2871291656 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:18.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72e212700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7280b0610 0x7fe72813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72d210700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281524c0 0x7fe72813ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72da11700 1 -- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281524c0 msgr2=0x7fe72813ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72da11700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281524c0 0x7fe72813ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72da11700 1 -- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7280b0610 msgr2=0x7fe72813f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72da11700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7280b0610 0x7fe72813f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72da11700 1 -- 172.21.15.12:0/2871291656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7281564c0 con 0x7fe7280b8560 2021-10-20T23:20:18.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72e212700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7280b0610 0x7fe72813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:18.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72da11700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7280b8560 0x7fe7280b0120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe718003430 tx=0x7fe718008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe726ffd700 1 -- 172.21.15.12:0/2871291656 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe718011e70 con 0x7fe7280b8560 2021-10-20T23:20:18.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe726ffd700 1 -- 172.21.15.12:0/2871291656 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71800f8e0 con 0x7fe7280b8560 2021-10-20T23:20:18.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe728156760 con 0x7fe7280b8560 2021-10-20T23:20:18.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe726ffd700 1 -- 172.21.15.12:0/2871291656 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe71800fa50 con 0x7fe7280b8560 2021-10-20T23:20:18.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.255+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72813f990 con 0x7fe7280b8560 2021-10-20T23:20:18.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.259+0000 7fe726ffd700 1 -- 172.21.15.12:0/2871291656 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe718025070 con 0x7fe7280b8560 2021-10-20T23:20:18.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.259+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe728112a40 con 0x7fe7280b8560 2021-10-20T23:20:18.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.259+0000 7fe726ffd700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe704053610 0x7fe704055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.259+0000 7fe726ffd700 1 -- 172.21.15.12:0/2871291656 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe71806c5e0 con 0x7fe7280b8560 2021-10-20T23:20:18.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.259+0000 7fe72d210700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe704053610 0x7fe704055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.259+0000 7fe72d210700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe704053610 0x7fe704055ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe714017000 tx=0x7fe714013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.263+0000 7fe726ffd700 1 -- 172.21.15.12:0/2871291656 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe7180434d0 con 0x7fe7280b8560 2021-10-20T23:20:18.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.391+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe728057350 con 0x7fe7280b8560 2021-10-20T23:20:18.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.391+0000 7fe726ffd700 1 -- 172.21.15.12:0/2871291656 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe718046af0 con 0x7fe7280b8560 2021-10-20T23:20:18.396 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe704053610 msgr2=0x7fe704055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe704053610 0x7fe704055ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe714017000 tx=0x7fe714013000).stop 2021-10-20T23:20:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7280b8560 msgr2=0x7fe7280b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7280b8560 0x7fe7280b0120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe718003430 tx=0x7fe718008040).stop 2021-10-20T23:20:18.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 shutdown_connections 2021-10-20T23:20:18.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe704053610 0x7fe704055ad0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7280b0610 0x7fe72813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7281524c0 0x7fe72813ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 --2- 172.21.15.12:0/2871291656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7280b8560 0x7fe7280b0120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 >> 172.21.15.12:0/2871291656 conn(0x7fe72806adf0 msgr2=0x7fe72813fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 shutdown_connections 2021-10-20T23:20:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.395+0000 7fe72ea13700 1 -- 172.21.15.12:0/2871291656 wait complete. 2021-10-20T23:20:18.413 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:20:18.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.523+0000 7fc86aabe700 1 Processor -- start 2021-10-20T23:20:18.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.523+0000 7fc86aabe700 1 -- start start 2021-10-20T23:20:18.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc864066c30 0x7fc86414e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc864065330 con 0x7fc8640b3000 2021-10-20T23:20:18.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8640b33e0 con 0x7fc8640b25a0 2021-10-20T23:20:18.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc864062000 con 0x7fc864066c30 2021-10-20T23:20:18.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc869abc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc8640b3000 0x7fc864060b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36034/0 (socket says 172.21.15.12:36034) 2021-10-20T23:20:18.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc869abc700 1 -- 172.21.15.12:0/2976002986 learned_addr learned my addr 172.21.15.12:0/2976002986 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:18.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86a2bd700 1 --2- 172.21.15.12:0/2976002986 >> v2:172.21.15.31:3300/0 conn(0x7fc864066c30 0x7fc86414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc868aba700 1 -- 172.21.15.12:0/2976002986 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444083643 0 0) 0x7fc864065330 con 0x7fc8640b3000 2021-10-20T23:20:18.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86a2bd700 1 -- 172.21.15.12:0/2976002986 >> v1:172.21.15.31:6789/0 conn(0x7fc8640b25a0 legacy=0x7fc864066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86a2bd700 1 -- 172.21.15.12:0/2976002986 >> v1:172.21.15.12:6789/0 conn(0x7fc8640b3000 legacy=0x7fc864060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86a2bd700 1 -- 172.21.15.12:0/2976002986 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86405fa60 con 0x7fc864066c30 2021-10-20T23:20:18.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86a2bd700 1 --2- 172.21.15.12:0/2976002986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc864066c30 0x7fc86414e930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc85c0032f0 tx=0x7fc85c0091d0).ready entity=mon.1 client_cookie=61571f53b83874ba server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc868aba700 1 -- 172.21.15.12:0/2976002986 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc85c009ea0 con 0x7fc864066c30 2021-10-20T23:20:18.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc868aba700 1 -- 172.21.15.12:0/2976002986 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c00b8a0 con 0x7fc864066c30 2021-10-20T23:20:18.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc868aba700 1 -- 172.21.15.12:0/2976002986 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc85c00ba10 con 0x7fc864066c30 2021-10-20T23:20:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 -- 172.21.15.12:0/2976002986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc864066c30 msgr2=0x7fc86414e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 --2- 172.21.15.12:0/2976002986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc864066c30 0x7fc86414e930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc85c0032f0 tx=0x7fc85c0091d0).stop 2021-10-20T23:20:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 -- 172.21.15.12:0/2976002986 shutdown_connections 2021-10-20T23:20:18.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 --2- 172.21.15.12:0/2976002986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc864066c30 0x7fc86414e930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 -- 172.21.15.12:0/2976002986 >> 172.21.15.12:0/2976002986 conn(0x7fc8640636e0 msgr2=0x7fc864063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 -- 172.21.15.12:0/2976002986 shutdown_connections 2021-10-20T23:20:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.527+0000 7fc86aabe700 1 -- 172.21.15.12:0/2976002986 wait complete. 2021-10-20T23:20:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86aabe700 1 Processor -- start 2021-10-20T23:20:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86aabe700 1 -- start start 2021-10-20T23:20:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86aabe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc864066c30 0x7fc864144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86aabe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8640b25a0 0x7fc8640a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86aabe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8640b3000 0x7fc8640b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86aabe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640a5b80 con 0x7fc8640b3000 2021-10-20T23:20:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86aabe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc864155620 con 0x7fc864066c30 2021-10-20T23:20:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86aabe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640a5d60 con 0x7fc8640b25a0 2021-10-20T23:20:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86a2bd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8640b3000 0x7fc8640b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86a2bd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8640b3000 0x7fc8640b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37450/0 (socket says 172.21.15.12:37450) 2021-10-20T23:20:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc86a2bd700 1 -- 172.21.15.12:0/1194600120 learned_addr learned my addr 172.21.15.12:0/1194600120 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc869abc700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc864066c30 0x7fc864144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.531+0000 7fc8692bb700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8640b25a0 0x7fc8640a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc86a2bd700 1 -- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8640b25a0 msgr2=0x7fc8640a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc86a2bd700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8640b25a0 0x7fc8640a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc86a2bd700 1 -- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc864066c30 msgr2=0x7fc864144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc86a2bd700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc864066c30 0x7fc864144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc86a2bd700 1 -- 172.21.15.12:0/1194600120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c009470 con 0x7fc8640b3000 2021-10-20T23:20:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc86a2bd700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8640b3000 0x7fc8640b6b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fc85c0032f0 tx=0x7fc85c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc852ffd700 1 -- 172.21.15.12:0/1194600120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc85c009ea0 con 0x7fc8640b3000 2021-10-20T23:20:18.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc852ffd700 1 -- 172.21.15.12:0/1194600120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c011e60 con 0x7fc8640b3000 2021-10-20T23:20:18.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc852ffd700 1 -- 172.21.15.12:0/1194600120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc85c01f5e0 con 0x7fc8640b3000 2021-10-20T23:20:18.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8640a6000 con 0x7fc8640b3000 2021-10-20T23:20:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8640b70a0 con 0x7fc8640b3000 2021-10-20T23:20:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc864155a50 con 0x7fc8640b3000 2021-10-20T23:20:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc852ffd700 1 -- 172.21.15.12:0/1194600120 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc85c026030 con 0x7fc8640b3000 2021-10-20T23:20:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc852ffd700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc844053610 0x7fc844055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.535+0000 7fc852ffd700 1 -- 172.21.15.12:0/1194600120 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc85c06c720 con 0x7fc8640b3000 2021-10-20T23:20:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.539+0000 7fc869abc700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc844053610 0x7fc844055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.539+0000 7fc869abc700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc844053610 0x7fc844055ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc86000d000 tx=0x7fc860007c00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.539+0000 7fc852ffd700 1 -- 172.21.15.12:0/1194600120 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc864155a50 con 0x7fc8640b3000 2021-10-20T23:20:18.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc864155a50 con 0x7fc8640b3000 2021-10-20T23:20:18.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc852ffd700 1 -- 172.21.15.12:0/1194600120 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc864155a50 con 0x7fc8640b3000 2021-10-20T23:20:18.669 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc844053610 msgr2=0x7fc844055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc86aabe700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc844053610 0x7fc844055ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc86000d000 tx=0x7fc860007c00).stop 2021-10-20T23:20:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8640b3000 msgr2=0x7fc8640b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc86aabe700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8640b3000 0x7fc8640b6b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fc85c0032f0 tx=0x7fc85c016000).stop 2021-10-20T23:20:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 shutdown_connections 2021-10-20T23:20:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc86aabe700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc844053610 0x7fc844055ad0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc86aabe700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8640b3000 0x7fc8640b6b30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.667+0000 7fc86aabe700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8640b25a0 0x7fc8640a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.671+0000 7fc86aabe700 1 --2- 172.21.15.12:0/1194600120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc864066c30 0x7fc864144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.671+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 >> 172.21.15.12:0/1194600120 conn(0x7fc8640636e0 msgr2=0x7fc864147660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.671+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 shutdown_connections 2021-10-20T23:20:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.671+0000 7fc86aabe700 1 -- 172.21.15.12:0/1194600120 wait complete. 2021-10-20T23:20:18.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:18.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 Processor -- start 2021-10-20T23:20:18.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 -- start start 2021-10-20T23:20:18.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04fc061320 0x7f04fc061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 0x7f04fc1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04fc0aecf0 con 0x7f04fc0ad5c0 2021-10-20T23:20:18.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04fc0b6f20 con 0x7f04fc061320 2021-10-20T23:20:18.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0aef20 con 0x7f04fc140440 2021-10-20T23:20:18.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f0501ced700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f04fc0ad5c0 0x7f04fc0b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36050/0 (socket says 172.21.15.12:36050) 2021-10-20T23:20:18.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f0501ced700 1 -- 172.21.15.12:0/168347617 learned_addr learned my addr 172.21.15.12:0/168347617 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:18.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05024ee700 1 --2- 172.21.15.12:0/168347617 >> v2:172.21.15.31:3300/0 conn(0x7f04fc061320 0x7f04fc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f0502cef700 1 --2- 172.21.15.12:0/168347617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 0x7f04fc1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05014ec700 1 -- 172.21.15.12:0/168347617 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843408644 0 0) 0x7f04fc0aecf0 con 0x7f04fc0ad5c0 2021-10-20T23:20:18.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05014ec700 1 -- 172.21.15.12:0/168347617 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04e4003260 con 0x7f04fc0ad5c0 2021-10-20T23:20:18.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05024ee700 1 -- 172.21.15.12:0/168347617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 msgr2=0x7f04fc1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:18.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05024ee700 1 --2- 172.21.15.12:0/168347617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 0x7f04fc1408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05024ee700 1 -- 172.21.15.12:0/168347617 >> v1:172.21.15.12:6789/0 conn(0x7f04fc0ad5c0 legacy=0x7f04fc0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05024ee700 1 -- 172.21.15.12:0/168347617 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc0af1c0 con 0x7f04fc061320 2021-10-20T23:20:18.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05024ee700 1 --2- 172.21.15.12:0/168347617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04fc061320 0x7f04fc061700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f04fc0aeba0 tx=0x7f04f8006df0).ready entity=mon.1 client_cookie=e69eff358691e4a9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05014ec700 1 -- 172.21.15.12:0/168347617 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04f800d570 con 0x7f04fc061320 2021-10-20T23:20:18.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05014ec700 1 -- 172.21.15.12:0/168347617 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8000e90 con 0x7f04fc061320 2021-10-20T23:20:18.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05014ec700 1 -- 172.21.15.12:0/168347617 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04f800d8c0 con 0x7f04fc061320 2021-10-20T23:20:18.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 -- 172.21.15.12:0/168347617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04fc061320 msgr2=0x7f04fc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 --2- 172.21.15.12:0/168347617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04fc061320 0x7f04fc061700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f04fc0aeba0 tx=0x7f04f8006df0).stop 2021-10-20T23:20:18.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 -- 172.21.15.12:0/168347617 shutdown_connections 2021-10-20T23:20:18.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 --2- 172.21.15.12:0/168347617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 0x7f04fc1408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 --2- 172.21.15.12:0/168347617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04fc061320 0x7f04fc061700 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 -- 172.21.15.12:0/168347617 >> 172.21.15.12:0/168347617 conn(0x7f04fc066de0 msgr2=0x7f04fc0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:18.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 -- 172.21.15.12:0/168347617 shutdown_connections 2021-10-20T23:20:18.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.783+0000 7f05034f0700 1 -- 172.21.15.12:0/168347617 wait complete. 2021-10-20T23:20:18.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05034f0700 1 Processor -- start 2021-10-20T23:20:18.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05034f0700 1 -- start start 2021-10-20T23:20:18.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05034f0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04fc061320 0x7f04fc0ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05034f0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04fc0ad5c0 0x7f04fc0abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05034f0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 0x7f04fc0b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05034f0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc152c40 con 0x7f04fc061320 2021-10-20T23:20:18.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05034f0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0ab880 con 0x7f04fc0ad5c0 2021-10-20T23:20:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05034f0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0aacf0 con 0x7f04fc140440 2021-10-20T23:20:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05024ee700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04fc061320 0x7f04fc0ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05024ee700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04fc061320 0x7f04fc0ab390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37460/0 (socket says 172.21.15.12:37460) 2021-10-20T23:20:18.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05024ee700 1 -- 172.21.15.12:0/1253278234 learned_addr learned my addr 172.21.15.12:0/1253278234 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:18.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f0501ced700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04fc0ad5c0 0x7f04fc0abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f0502cef700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 0x7f04fc0b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05024ee700 1 -- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 msgr2=0x7f04fc0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05024ee700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 0x7f04fc0b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05024ee700 1 -- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04fc0ad5c0 msgr2=0x7f04fc0abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05024ee700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04fc0ad5c0 0x7f04fc0abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05024ee700 1 -- 172.21.15.12:0/1253278234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f800b180 con 0x7f04fc061320 2021-10-20T23:20:18.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.787+0000 7f05024ee700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04fc061320 0x7f04fc0ab390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f04fc0aeba0 tx=0x7f04f8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f04eb7fe700 1 -- 172.21.15.12:0/1253278234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04f8013de0 con 0x7f04fc061320 2021-10-20T23:20:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f04eb7fe700 1 -- 172.21.15.12:0/1253278234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8002f70 con 0x7f04fc061320 2021-10-20T23:20:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f04eb7fe700 1 -- 172.21.15.12:0/1253278234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04f801e5f0 con 0x7f04fc061320 2021-10-20T23:20:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc152e70 con 0x7f04fc061320 2021-10-20T23:20:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc0ac1c0 con 0x7f04fc061320 2021-10-20T23:20:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc0af460 con 0x7f04fc061320 2021-10-20T23:20:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f04eb7fe700 1 -- 172.21.15.12:0/1253278234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f04f8025030 con 0x7f04fc061320 2021-10-20T23:20:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f04eb7fe700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04dc0536a0 0x7f04dc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f04eb7fe700 1 -- 172.21.15.12:0/1253278234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f04f806c900 con 0x7f04fc061320 2021-10-20T23:20:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.791+0000 7f0501ced700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04dc0536a0 0x7f04dc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.795+0000 7f0501ced700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04dc0536a0 0x7f04dc055b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f04ec00d000 tx=0x7f04ec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.799+0000 7f04eb7fe700 1 -- 172.21.15.12:0/1253278234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04f8043900 con 0x7f04fc061320 2021-10-20T23:20:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.927+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04fc057350 con 0x7f04fc061320 2021-10-20T23:20:18.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.927+0000 7f04eb7fe700 1 -- 172.21.15.12:0/1253278234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f04f8023020 con 0x7f04fc061320 2021-10-20T23:20:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:18.933 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:18.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04dc0536a0 msgr2=0x7f04dc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04dc0536a0 0x7f04dc055b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f04ec00d000 tx=0x7f04ec009040).stop 2021-10-20T23:20:18.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04fc061320 msgr2=0x7f04fc0ab390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:18.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04fc061320 0x7f04fc0ab390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f04fc0aeba0 tx=0x7f04f8014000).stop 2021-10-20T23:20:18.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 shutdown_connections 2021-10-20T23:20:18.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04dc0536a0 0x7f04dc055b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04fc140440 0x7f04fc0b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04fc0ad5c0 0x7f04fc0abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 --2- 172.21.15.12:0/1253278234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04fc061320 0x7f04fc0ab390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 >> 172.21.15.12:0/1253278234 conn(0x7f04fc066de0 msgr2=0x7f04fc0b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 shutdown_connections 2021-10-20T23:20:18.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:18.931+0000 7f05034f0700 1 -- 172.21.15.12:0/1253278234 wait complete. 2021-10-20T23:20:18.944 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:19:51.434642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:19:54.214563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:20:18.945 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:20:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 Processor -- start 2021-10-20T23:20:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- start start 2021-10-20T23:20:19.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb080b3550 0x7fdb08067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb08144ce0 0x7fdb08141130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb08066500 con 0x7fdb08064980 2021-10-20T23:20:19.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb080b3ea0 con 0x7fdb080b3550 2021-10-20T23:20:19.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb08140d40 con 0x7fdb08144ce0 2021-10-20T23:20:19.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb07fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb080b3550 0x7fdb08067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb07fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb080b3550 0x7fdb08067110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37470/0 (socket says 172.21.15.12:37470) 2021-10-20T23:20:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb07fff700 1 -- 172.21.15.12:0/1654873103 learned_addr learned my addr 172.21.15.12:0/1654873103 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0d472700 1 --2- 172.21.15.12:0/1654873103 >> v2:172.21.15.31:3300/0 conn(0x7fdb08144ce0 0x7fdb08141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb07fff700 1 -- 172.21.15.12:0/1654873103 >> v2:172.21.15.31:3300/0 conn(0x7fdb08144ce0 msgr2=0x7fdb08141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:19.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb07fff700 1 --2- 172.21.15.12:0/1654873103 >> v2:172.21.15.31:3300/0 conn(0x7fdb08144ce0 0x7fdb08141130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb07fff700 1 -- 172.21.15.12:0/1654873103 >> v1:172.21.15.31:6789/0 conn(0x7fdb08064980 legacy=0x7fdb08066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb07fff700 1 -- 172.21.15.12:0/1654873103 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb080b46c0 con 0x7fdb080b3550 2021-10-20T23:20:19.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb07fff700 1 --2- 172.21.15.12:0/1654873103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 0x7fdb08067110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fdaf8002f70 tx=0x7fdaf8006eb0).ready entity=mon.0 client_cookie=268bb8ae23e51722 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb077fe700 1 -- 172.21.15.12:0/1654873103 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf800d5c0 con 0x7fdb080b3550 2021-10-20T23:20:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb077fe700 1 -- 172.21.15.12:0/1654873103 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf8000e90 con 0x7fdb080b3550 2021-10-20T23:20:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb077fe700 1 -- 172.21.15.12:0/1654873103 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf800d950 con 0x7fdb080b3550 2021-10-20T23:20:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- 172.21.15.12:0/1654873103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 msgr2=0x7fdb08067110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 --2- 172.21.15.12:0/1654873103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 0x7fdb08067110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fdaf8002f70 tx=0x7fdaf8006eb0).stop 2021-10-20T23:20:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- 172.21.15.12:0/1654873103 shutdown_connections 2021-10-20T23:20:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 --2- 172.21.15.12:0/1654873103 >> v2:172.21.15.31:3300/0 conn(0x7fdb08144ce0 0x7fdb08141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 --2- 172.21.15.12:0/1654873103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 0x7fdb08067110 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- 172.21.15.12:0/1654873103 >> 172.21.15.12:0/1654873103 conn(0x7fdb0805f6b0 msgr2=0x7fdb0805fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:19.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- 172.21.15.12:0/1654873103 shutdown_connections 2021-10-20T23:20:19.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- 172.21.15.12:0/1654873103 wait complete. 2021-10-20T23:20:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 Processor -- start 2021-10-20T23:20:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.055+0000 7fdb0dc73700 1 -- start start 2021-10-20T23:20:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0dc73700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb08064980 0x7fdb080b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0dc73700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 0x7fdb081537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0dc73700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb08144ce0 0x7fdb08153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0dc73700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080affb0 con 0x7fdb080b3550 2021-10-20T23:20:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0dc73700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08154300 con 0x7fdb08144ce0 2021-10-20T23:20:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0dc73700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081545a0 con 0x7fdb08064980 2021-10-20T23:20:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb07fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 0x7fdb081537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb07fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 0x7fdb081537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37474/0 (socket says 172.21.15.12:37474) 2021-10-20T23:20:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb07fff700 1 -- 172.21.15.12:0/3592737494 learned_addr learned my addr 172.21.15.12:0/3592737494 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0d472700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb08144ce0 0x7fdb08153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0cc71700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb08064980 0x7fdb080b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb07fff700 1 -- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb08064980 msgr2=0x7fdb080b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb07fff700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb08064980 0x7fdb080b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb07fff700 1 -- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb08144ce0 msgr2=0x7fdb08153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb07fff700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb08144ce0 0x7fdb08153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb07fff700 1 -- 172.21.15.12:0/3592737494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf800b1e0 con 0x7fdb080b3550 2021-10-20T23:20:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0cc71700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb08064980 0x7fdb080b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0d472700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb08144ce0 0x7fdb08153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb07fff700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 0x7fdb081537f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fdaf8002f70 tx=0x7fdaf8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb05ffb700 1 -- 172.21.15.12:0/3592737494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf8011990 con 0x7fdb080b3550 2021-10-20T23:20:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb05ffb700 1 -- 172.21.15.12:0/3592737494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf8011af0 con 0x7fdb080b3550 2021-10-20T23:20:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb080a7d70 con 0x7fdb080b3550 2021-10-20T23:20:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb05ffb700 1 -- 172.21.15.12:0/3592737494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf8011e50 con 0x7fdb080b3550 2021-10-20T23:20:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb080b0d20 con 0x7fdb080b3550 2021-10-20T23:20:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.059+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb08057350 con 0x7fdb080b3550 2021-10-20T23:20:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.063+0000 7fdb05ffb700 1 -- 172.21.15.12:0/3592737494 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdaf8025030 con 0x7fdb080b3550 2021-10-20T23:20:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.063+0000 7fdb05ffb700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdae40534f0 0x7fdae40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.063+0000 7fdb05ffb700 1 -- 172.21.15.12:0/3592737494 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdaf806cc70 con 0x7fdb080b3550 2021-10-20T23:20:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.063+0000 7fdb0cc71700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdae40534f0 0x7fdae40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.063+0000 7fdb0cc71700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdae40534f0 0x7fdae40559b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fdaf400b000 tx=0x7fdaf4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.067+0000 7fdb05ffb700 1 -- 172.21.15.12:0/3592737494 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdaf8043c70 con 0x7fdb080b3550 2021-10-20T23:20:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.196+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdb08069c00 con 0x7fdb080b3550 2021-10-20T23:20:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb05ffb700 1 -- 172.21.15.12:0/3592737494 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdaf8023020 con 0x7fdb080b3550 2021-10-20T23:20:19.204 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:20:19.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdae40534f0 msgr2=0x7fdae40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdae40534f0 0x7fdae40559b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fdaf400b000 tx=0x7fdaf4009040).stop 2021-10-20T23:20:19.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 msgr2=0x7fdb081537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 0x7fdb081537f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fdaf8002f70 tx=0x7fdaf8015000).stop 2021-10-20T23:20:19.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 shutdown_connections 2021-10-20T23:20:19.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdae40534f0 0x7fdae40559b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb08144ce0 0x7fdb08153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb080b3550 0x7fdb081537f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 --2- 172.21.15.12:0/3592737494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb08064980 0x7fdb080b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 >> 172.21.15.12:0/3592737494 conn(0x7fdb0805f6b0 msgr2=0x7fdb08144150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:19.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 shutdown_connections 2021-10-20T23:20:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.200+0000 7fdb0dc73700 1 -- 172.21.15.12:0/3592737494 wait complete. 2021-10-20T23:20:19.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:20:19.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.320+0000 7f8736363700 1 Processor -- start 2021-10-20T23:20:19.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.320+0000 7f8736363700 1 -- start start 2021-10-20T23:20:19.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87300b2580 0x7f873014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300b0010 0x7f873014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87300a70c0 con 0x7f87300afbd0 2021-10-20T23:20:19.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87300a72f0 con 0x7f87300b2580 2021-10-20T23:20:19.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87300a7590 con 0x7f87300b0010 2021-10-20T23:20:19.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8735b62700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f87300afbd0 0x7f87300a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36080/0 (socket says 172.21.15.12:36080) 2021-10-20T23:20:19.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8735b62700 1 -- 172.21.15.12:0/174064044 learned_addr learned my addr 172.21.15.12:0/174064044 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:19.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8735361700 1 --2- 172.21.15.12:0/174064044 >> v2:172.21.15.31:3300/0 conn(0x7f87300b2580 0x7f873014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8734b60700 1 --2- 172.21.15.12:0/174064044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300b0010 0x7f873014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8727fff700 1 -- 172.21.15.12:0/174064044 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693185106 0 0) 0x7f87300a70c0 con 0x7f87300afbd0 2021-10-20T23:20:19.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8727fff700 1 -- 172.21.15.12:0/174064044 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8714003260 con 0x7f87300afbd0 2021-10-20T23:20:19.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8735361700 1 -- 172.21.15.12:0/174064044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300b0010 msgr2=0x7f873014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:19.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8735361700 1 --2- 172.21.15.12:0/174064044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300b0010 0x7f873014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8727fff700 1 -- 172.21.15.12:0/174064044 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2596574374 0 0) 0x7f8714003260 con 0x7f87300afbd0 2021-10-20T23:20:19.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8735361700 1 -- 172.21.15.12:0/174064044 >> v1:172.21.15.12:6789/0 conn(0x7f87300afbd0 legacy=0x7f87300a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8735361700 1 -- 172.21.15.12:0/174064044 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300a7830 con 0x7f87300b2580 2021-10-20T23:20:19.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8735361700 1 --2- 172.21.15.12:0/174064044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87300b2580 0x7f873014ae40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8728001b80 tx=0x7f8720006df0).ready entity=mon.1 client_cookie=9621506371c68ccd server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8727fff700 1 -- 172.21.15.12:0/174064044 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87280019e0 con 0x7f87300b2580 2021-10-20T23:20:19.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8727fff700 1 -- 172.21.15.12:0/174064044 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720000e90 con 0x7f87300b2580 2021-10-20T23:20:19.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8727fff700 1 -- 172.21.15.12:0/174064044 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8720012460 con 0x7f87300b2580 2021-10-20T23:20:19.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 -- 172.21.15.12:0/174064044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87300b2580 msgr2=0x7f873014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 --2- 172.21.15.12:0/174064044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87300b2580 0x7f873014ae40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8728001b80 tx=0x7f8720006df0).stop 2021-10-20T23:20:19.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 -- 172.21.15.12:0/174064044 shutdown_connections 2021-10-20T23:20:19.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 --2- 172.21.15.12:0/174064044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300b0010 0x7f873014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 --2- 172.21.15.12:0/174064044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87300b2580 0x7f873014ae40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 -- 172.21.15.12:0/174064044 >> 172.21.15.12:0/174064044 conn(0x7f8730060180 msgr2=0x7f87300b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:19.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 -- 172.21.15.12:0/174064044 shutdown_connections 2021-10-20T23:20:19.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.324+0000 7f8736363700 1 -- 172.21.15.12:0/174064044 wait complete. 2021-10-20T23:20:19.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8736363700 1 Processor -- start 2021-10-20T23:20:19.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8736363700 1 -- start start 2021-10-20T23:20:19.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8736363700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300afbd0 0x7f87300b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8736363700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87300b0010 0x7f873015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8736363700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87300b2580 0x7f873014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8736363700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8730159800 con 0x7f87300b2580 2021-10-20T23:20:19.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8736363700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87300b3470 con 0x7f87300b0010 2021-10-20T23:20:19.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8736363700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8730159a60 con 0x7f87300afbd0 2021-10-20T23:20:19.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8735b62700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87300b2580 0x7f873014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8735b62700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87300b2580 0x7f873014ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37492/0 (socket says 172.21.15.12:37492) 2021-10-20T23:20:19.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8735b62700 1 -- 172.21.15.12:0/128344650 learned_addr learned my addr 172.21.15.12:0/128344650 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:19.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8734b60700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87300b0010 0x7f873015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8735361700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300afbd0 0x7f87300b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8735b62700 1 -- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300afbd0 msgr2=0x7f87300b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8735b62700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300afbd0 0x7f87300b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8735b62700 1 -- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87300b0010 msgr2=0x7f873015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8735b62700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87300b0010 0x7f873015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.328+0000 7f8735b62700 1 -- 172.21.15.12:0/128344650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872000b180 con 0x7f87300b2580 2021-10-20T23:20:19.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f8735b62700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87300b2580 0x7f873014ca40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8728001bc0 tx=0x7f8728001a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f87267fc700 1 -- 172.21.15.12:0/128344650 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8728004ab0 con 0x7f87300b2580 2021-10-20T23:20:19.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f87267fc700 1 -- 172.21.15.12:0/128344650 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728004c10 con 0x7f87300b2580 2021-10-20T23:20:19.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8730159d00 con 0x7f87300b2580 2021-10-20T23:20:19.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f87267fc700 1 -- 172.21.15.12:0/128344650 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8728007170 con 0x7f87300b2580 2021-10-20T23:20:19.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873014cf30 con 0x7f87300b2580 2021-10-20T23:20:19.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87300b3bb0 con 0x7f87300b2580 2021-10-20T23:20:19.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f87267fc700 1 -- 172.21.15.12:0/128344650 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f872801b070 con 0x7f87300b2580 2021-10-20T23:20:19.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f87267fc700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8718053610 0x7f8718055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.332+0000 7f87267fc700 1 -- 172.21.15.12:0/128344650 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f872806b410 con 0x7f87300b2580 2021-10-20T23:20:19.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.336+0000 7f8735361700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8718053610 0x7f8718055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.336+0000 7f8735361700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8718053610 0x7f8718055ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f872001a000 tx=0x7f8720014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.340+0000 7f87267fc700 1 -- 172.21.15.12:0/128344650 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8728042410 con 0x7f87300b2580 2021-10-20T23:20:19.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.464+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8730159e90 con 0x7f87300b2580 2021-10-20T23:20:19.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f87267fc700 1 -- 172.21.15.12:0/128344650 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8728045a30 con 0x7f87300b2580 2021-10-20T23:20:19.472 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8718053610 msgr2=0x7f8718055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8718053610 0x7f8718055ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f872001a000 tx=0x7f8720014000).stop 2021-10-20T23:20:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87300b2580 msgr2=0x7f873014ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87300b2580 0x7f873014ca40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8728001bc0 tx=0x7f8728001a80).stop 2021-10-20T23:20:19.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 shutdown_connections 2021-10-20T23:20:19.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8718053610 0x7f8718055ad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87300b2580 0x7f873014ca40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87300b0010 0x7f873015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 --2- 172.21.15.12:0/128344650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87300afbd0 0x7f87300b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 >> 172.21.15.12:0/128344650 conn(0x7f8730060180 msgr2=0x7f8730146680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:19.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 shutdown_connections 2021-10-20T23:20:19.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.468+0000 7f8736363700 1 -- 172.21.15.12:0/128344650 wait complete. 2021-10-20T23:20:19.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:20:19.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e6659b700 1 Processor -- start 2021-10-20T23:20:19.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e6659b700 1 -- start start 2021-10-20T23:20:19.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e6659b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6e600b6560 0x7f6e600b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e6659b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b5990 0x7f6e600b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e6659b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e60143f60 con 0x7f6e6005fc00 2021-10-20T23:20:19.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e6659b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e600ba6b0 con 0x7f6e600b6560 2021-10-20T23:20:19.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e6659b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6005ffe0 con 0x7f6e600b5990 2021-10-20T23:20:19.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e5f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6e600b6560 0x7f6e600b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e64b38700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b5990 0x7f6e600b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e5f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6e600b6560 0x7f6e600b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:52472/0 (socket says 172.21.15.12:52472) 2021-10-20T23:20:19.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e5f7fe700 1 -- 172.21.15.12:0/1545327778 learned_addr learned my addr 172.21.15.12:0/1545327778 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:19.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.588+0000 7f6e5ffff700 1 --1- 172.21.15.12:0/1545327778 >> v1:172.21.15.31:6789/0 conn(0x7f6e6005fc00 0x7f6e600b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:43154/0 (socket says 172.21.15.12:43154) 2021-10-20T23:20:19.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5f7fe700 1 -- 172.21.15.12:0/1545327778 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b5990 msgr2=0x7f6e600b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:19.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5f7fe700 1 --2- 172.21.15.12:0/1545327778 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b5990 0x7f6e600b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5f7fe700 1 -- 172.21.15.12:0/1545327778 >> v1:172.21.15.31:6789/0 conn(0x7f6e6005fc00 legacy=0x7f6e600b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5f7fe700 1 -- 172.21.15.12:0/1545327778 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60143a50 con 0x7f6e600b6560 2021-10-20T23:20:19.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5f7fe700 1 --2- 172.21.15.12:0/1545327778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b6560 0x7f6e600b41b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6e48002f70 tx=0x7f6e48006eb0).ready entity=mon.1 client_cookie=7f67bc86e9775ef4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5effd700 1 -- 172.21.15.12:0/1545327778 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e4800d570 con 0x7f6e600b6560 2021-10-20T23:20:19.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5effd700 1 -- 172.21.15.12:0/1545327778 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48000e90 con 0x7f6e600b6560 2021-10-20T23:20:19.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5effd700 1 -- 172.21.15.12:0/1545327778 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e4800d900 con 0x7f6e600b6560 2021-10-20T23:20:19.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 -- 172.21.15.12:0/1545327778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b6560 msgr2=0x7f6e600b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 --2- 172.21.15.12:0/1545327778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b6560 0x7f6e600b41b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6e48002f70 tx=0x7f6e48006eb0).stop 2021-10-20T23:20:19.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 -- 172.21.15.12:0/1545327778 shutdown_connections 2021-10-20T23:20:19.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 --2- 172.21.15.12:0/1545327778 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b5990 0x7f6e600b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 --2- 172.21.15.12:0/1545327778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b6560 0x7f6e600b41b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 -- 172.21.15.12:0/1545327778 >> 172.21.15.12:0/1545327778 conn(0x7f6e600623a0 msgr2=0x7f6e60066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:19.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 -- 172.21.15.12:0/1545327778 shutdown_connections 2021-10-20T23:20:19.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 -- 172.21.15.12:0/1545327778 wait complete. 2021-10-20T23:20:19.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 Processor -- start 2021-10-20T23:20:19.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 -- start start 2021-10-20T23:20:19.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e6005fc00 0x7f6e6013ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b5990 0x7f6e60141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b6560 0x7f6e60146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60142830 con 0x7f6e6005fc00 2021-10-20T23:20:19.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6013f6e0 con 0x7f6e600b5990 2021-10-20T23:20:19.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e6659b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6013f980 con 0x7f6e600b6560 2021-10-20T23:20:19.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e6005fc00 0x7f6e6013ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b5990 0x7f6e60141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e6005fc00 0x7f6e6013ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37502/0 (socket says 172.21.15.12:37502) 2021-10-20T23:20:19.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e5ffff700 1 -- 172.21.15.12:0/651519753 learned_addr learned my addr 172.21.15.12:0/651519753 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:19.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.592+0000 7f6e64b38700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b6560 0x7f6e60146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5ffff700 1 -- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b6560 msgr2=0x7f6e60146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5ffff700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b6560 0x7f6e60146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5ffff700 1 -- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b5990 msgr2=0x7f6e60141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5ffff700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b5990 0x7f6e60141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5ffff700 1 -- 172.21.15.12:0/651519753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4800b1e0 con 0x7f6e6005fc00 2021-10-20T23:20:19.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5f7fe700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b5990 0x7f6e60141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:19.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5ffff700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e6005fc00 0x7f6e6013ecb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6e600b19e0 tx=0x7f6e50007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5d7fa700 1 -- 172.21.15.12:0/651519753 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e500070d0 con 0x7f6e6005fc00 2021-10-20T23:20:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5d7fa700 1 -- 172.21.15.12:0/651519753 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50007230 con 0x7f6e6005fc00 2021-10-20T23:20:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e5d7fa700 1 -- 172.21.15.12:0/651519753 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e50005550 con 0x7f6e6005fc00 2021-10-20T23:20:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6013fc20 con 0x7f6e6005fc00 2021-10-20T23:20:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e601400c0 con 0x7f6e6005fc00 2021-10-20T23:20:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.596+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e60143cc0 con 0x7f6e6005fc00 2021-10-20T23:20:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.600+0000 7f6e5d7fa700 1 -- 172.21.15.12:0/651519753 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6e5001a070 con 0x7f6e6005fc00 2021-10-20T23:20:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.600+0000 7f6e5d7fa700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e440536a0 0x7f6e44055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.600+0000 7f6e5d7fa700 1 -- 172.21.15.12:0/651519753 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6e5006ac70 con 0x7f6e6005fc00 2021-10-20T23:20:19.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.600+0000 7f6e5f7fe700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e440536a0 0x7f6e44055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.600+0000 7f6e5f7fe700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e440536a0 0x7f6e44055b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f6e4801c000 tx=0x7f6e48015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.604+0000 7f6e5d7fa700 1 -- 172.21.15.12:0/651519753 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e50041c70 con 0x7f6e6005fc00 2021-10-20T23:20:19.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e60057350 con 0x7f6e6005fc00 2021-10-20T23:20:19.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e5d7fa700 1 -- 172.21.15.12:0/651519753 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6e50045290 con 0x7f6e6005fc00 2021-10-20T23:20:19.737 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:19.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e440536a0 msgr2=0x7f6e44055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e440536a0 0x7f6e44055b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f6e4801c000 tx=0x7f6e48015000).stop 2021-10-20T23:20:19.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e6005fc00 msgr2=0x7f6e6013ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e6005fc00 0x7f6e6013ecb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6e600b19e0 tx=0x7f6e50007c40).stop 2021-10-20T23:20:19.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 shutdown_connections 2021-10-20T23:20:19.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e440536a0 0x7f6e44055b60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6e600b6560 0x7f6e60146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e600b5990 0x7f6e60141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 --2- 172.21.15.12:0/651519753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e6005fc00 0x7f6e6013ecb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.732+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 >> 172.21.15.12:0/651519753 conn(0x7f6e600623a0 msgr2=0x7f6e600b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:19.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.736+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 shutdown_connections 2021-10-20T23:20:19.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.736+0000 7f6e6659b700 1 -- 172.21.15.12:0/651519753 wait complete. 2021-10-20T23:20:19.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:20:19.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.856+0000 7f94f5592700 1 Processor -- start 2021-10-20T23:20:19.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.856+0000 7f94f5592700 1 -- start start 2021-10-20T23:20:19.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.856+0000 7f94f5592700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94f0146950 0x7f94f0140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.856+0000 7f94f5592700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f0143b60 con 0x7f94f00b4690 2021-10-20T23:20:19.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.856+0000 7f94f5592700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f0143e00 con 0x7f94f00b4180 2021-10-20T23:20:19.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.856+0000 7f94f5592700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f0147510 con 0x7f94f0146950 2021-10-20T23:20:19.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.856+0000 7f94ef7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f94f00b4690 0x7f94f00b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36108/0 (socket says 172.21.15.12:36108) 2021-10-20T23:20:19.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.856+0000 7f94ef7fe700 1 -- 172.21.15.12:0/229849329 learned_addr learned my addr 172.21.15.12:0/229849329 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:19.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94eeffd700 1 --2- 172.21.15.12:0/229849329 >> v2:172.21.15.31:3300/0 conn(0x7f94f0146950 0x7f94f0140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94edffb700 1 -- 172.21.15.12:0/229849329 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845694951 0 0) 0x7f94f0143b60 con 0x7f94f00b4690 2021-10-20T23:20:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94edffb700 1 -- 172.21.15.12:0/229849329 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d4003260 con 0x7f94f00b4690 2021-10-20T23:20:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94eeffd700 1 -- 172.21.15.12:0/229849329 >> v1:172.21.15.31:6789/0 conn(0x7f94f00b4180 legacy=0x7f94f0140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94eeffd700 1 -- 172.21.15.12:0/229849329 >> v1:172.21.15.12:6789/0 conn(0x7f94f00b4690 legacy=0x7f94f00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94eeffd700 1 -- 172.21.15.12:0/229849329 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f00b0c90 con 0x7f94f0146950 2021-10-20T23:20:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94eeffd700 1 --2- 172.21.15.12:0/229849329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f0146950 0x7f94f0140230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f94e4002f70 tx=0x7f94e4006df0).ready entity=mon.1 client_cookie=7c2215c8d301eead server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94edffb700 1 -- 172.21.15.12:0/229849329 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e400d610 con 0x7f94f0146950 2021-10-20T23:20:19.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94edffb700 1 -- 172.21.15.12:0/229849329 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e4000e90 con 0x7f94f0146950 2021-10-20T23:20:19.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94edffb700 1 -- 172.21.15.12:0/229849329 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e400d960 con 0x7f94f0146950 2021-10-20T23:20:19.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94f5592700 1 -- 172.21.15.12:0/229849329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f0146950 msgr2=0x7f94f0140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94f5592700 1 --2- 172.21.15.12:0/229849329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f0146950 0x7f94f0140230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f94e4002f70 tx=0x7f94e4006df0).stop 2021-10-20T23:20:19.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94f5592700 1 -- 172.21.15.12:0/229849329 shutdown_connections 2021-10-20T23:20:19.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94f5592700 1 --2- 172.21.15.12:0/229849329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f0146950 0x7f94f0140230 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94f5592700 1 -- 172.21.15.12:0/229849329 >> 172.21.15.12:0/229849329 conn(0x7f94f005c490 msgr2=0x7f94f005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:19.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94f5592700 1 -- 172.21.15.12:0/229849329 shutdown_connections 2021-10-20T23:20:19.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94f5592700 1 -- 172.21.15.12:0/229849329 wait complete. 2021-10-20T23:20:19.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94f5592700 1 Processor -- start 2021-10-20T23:20:19.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.860+0000 7f94f5592700 1 -- start start 2021-10-20T23:20:19.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94f5592700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f00b4180 0x7f94f00adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94f5592700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f00b4690 0x7f94f00ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94f5592700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94f0146950 0x7f94f0152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94f5592700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00af0a0 con 0x7f94f0146950 2021-10-20T23:20:19.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94f5592700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00af2f0 con 0x7f94f00b4690 2021-10-20T23:20:19.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94f5592700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00af590 con 0x7f94f00b4180 2021-10-20T23:20:19.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ef7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94f0146950 0x7f94f0152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ef7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94f0146950 0x7f94f0152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37518/0 (socket says 172.21.15.12:37518) 2021-10-20T23:20:19.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ef7fe700 1 -- 172.21.15.12:0/1843361623 learned_addr learned my addr 172.21.15.12:0/1843361623 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:19.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94eeffd700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f00b4180 0x7f94f00adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ee7fc700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f00b4690 0x7f94f00ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ef7fe700 1 -- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f00b4180 msgr2=0x7f94f00adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ef7fe700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f00b4180 0x7f94f00adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ef7fe700 1 -- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f00b4690 msgr2=0x7f94f00ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:19.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ef7fe700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f00b4690 0x7f94f00ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:19.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ef7fe700 1 -- 172.21.15.12:0/1843361623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e400b180 con 0x7f94f0146950 2021-10-20T23:20:19.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94eeffd700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f00b4180 0x7f94f00adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:19.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ee7fc700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f00b4690 0x7f94f00ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:19.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94ef7fe700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94f0146950 0x7f94f0152e80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f94e8001490 tx=0x7f94e8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94dffff700 1 -- 172.21.15.12:0/1843361623 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e8005ba0 con 0x7f94f0146950 2021-10-20T23:20:19.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94dffff700 1 -- 172.21.15.12:0/1843361623 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e8005d00 con 0x7f94f0146950 2021-10-20T23:20:19.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94dffff700 1 -- 172.21.15.12:0/1843361623 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e80072c0 con 0x7f94f0146950 2021-10-20T23:20:19.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f00af830 con 0x7f94f0146950 2021-10-20T23:20:19.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.864+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f00afef0 con 0x7f94f0146950 2021-10-20T23:20:19.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.868+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f00af9c0 con 0x7f94f0146950 2021-10-20T23:20:19.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.868+0000 7f94dffff700 1 -- 172.21.15.12:0/1843361623 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f94e8010070 con 0x7f94f0146950 2021-10-20T23:20:19.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.868+0000 7f94dffff700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94cc0536a0 0x7f94cc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:19.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.868+0000 7f94dffff700 1 -- 172.21.15.12:0/1843361623 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f94e806b5e0 con 0x7f94f0146950 2021-10-20T23:20:19.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.868+0000 7f94eeffd700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94cc0536a0 0x7f94cc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:19.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.868+0000 7f94eeffd700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94cc0536a0 0x7f94cc055b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f94e4018000 tx=0x7f94e4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:19.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:19.872+0000 7f94dffff700 1 -- 172.21.15.12:0/1843361623 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f94e8042540 con 0x7f94f0146950 2021-10-20T23:20:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94f0057350 con 0x7f94f0146950 2021-10-20T23:20:20.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94dffff700 1 -- 172.21.15.12:0/1843361623 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f94e8045b60 con 0x7f94f0146950 2021-10-20T23:20:20.005 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94cc0536a0 msgr2=0x7f94cc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94cc0536a0 0x7f94cc055b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f94e4018000 tx=0x7f94e4014000).stop 2021-10-20T23:20:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94f0146950 msgr2=0x7f94f0152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94f0146950 0x7f94f0152e80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f94e8001490 tx=0x7f94e8007e00).stop 2021-10-20T23:20:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 shutdown_connections 2021-10-20T23:20:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94cc0536a0 0x7f94cc055b60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94f0146950 0x7f94f0152e80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f00b4690 0x7f94f00ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 --2- 172.21.15.12:0/1843361623 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f00b4180 0x7f94f00adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 >> 172.21.15.12:0/1843361623 conn(0x7f94f005c490 msgr2=0x7f94f013b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 shutdown_connections 2021-10-20T23:20:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.000+0000 7f94f5592700 1 -- 172.21.15.12:0/1843361623 wait complete. 2021-10-20T23:20:20.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2902135700 1 Processor -- start 2021-10-20T23:20:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2902135700 1 -- start start 2021-10-20T23:20:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2902135700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28fc0b0010 0x7f28fc0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2902135700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28fc0a70c0 con 0x7f28fc0afbd0 2021-10-20T23:20:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2902135700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28fc0a72f0 con 0x7f28fc0b2580 2021-10-20T23:20:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2902135700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0a7590 con 0x7f28fc0b0010 2021-10-20T23:20:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2901934700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f28fc0afbd0 0x7f28fc151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36122/0 (socket says 172.21.15.12:36122) 2021-10-20T23:20:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2901934700 1 -- 172.21.15.12:0/3204231020 learned_addr learned my addr 172.21.15.12:0/3204231020 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2900932700 1 --2- 172.21.15.12:0/3204231020 >> v2:172.21.15.31:3300/0 conn(0x7f28fc0b0010 0x7f28fc0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f28f3fff700 1 -- 172.21.15.12:0/3204231020 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920775766 0 0) 0x7f28fc0a70c0 con 0x7f28fc0afbd0 2021-10-20T23:20:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f28f3fff700 1 -- 172.21.15.12:0/3204231020 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e0003260 con 0x7f28fc0afbd0 2021-10-20T23:20:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2900932700 1 -- 172.21.15.12:0/3204231020 >> v1:172.21.15.31:6789/0 conn(0x7f28fc0b2580 legacy=0x7f28fc14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2900932700 1 -- 172.21.15.12:0/3204231020 >> v1:172.21.15.12:6789/0 conn(0x7f28fc0afbd0 legacy=0x7f28fc151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f28f3fff700 1 -- 172.21.15.12:0/3204231020 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 230179390 0 0) 0x7f28e0003260 con 0x7f28fc0afbd0 2021-10-20T23:20:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2900932700 1 -- 172.21.15.12:0/3204231020 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0a7830 con 0x7f28fc0b0010 2021-10-20T23:20:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.116+0000 7f2900932700 1 --2- 172.21.15.12:0/3204231020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0b0010 0x7f28fc0a83b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f28f4001800 tx=0x7f28f80091d0).ready entity=mon.1 client_cookie=9de668d50c41fbba server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f28f3fff700 1 -- 172.21.15.12:0/3204231020 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f4001660 con 0x7f28fc0b0010 2021-10-20T23:20:20.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f28f3fff700 1 -- 172.21.15.12:0/3204231020 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800b580 con 0x7f28fc0b0010 2021-10-20T23:20:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f28f3fff700 1 -- 172.21.15.12:0/3204231020 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f800b6f0 con 0x7f28fc0b0010 2021-10-20T23:20:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 -- 172.21.15.12:0/3204231020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0b0010 msgr2=0x7f28fc0a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 --2- 172.21.15.12:0/3204231020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0b0010 0x7f28fc0a83b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f28f4001800 tx=0x7f28f80091d0).stop 2021-10-20T23:20:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 -- 172.21.15.12:0/3204231020 shutdown_connections 2021-10-20T23:20:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 --2- 172.21.15.12:0/3204231020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0b0010 0x7f28fc0a83b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 -- 172.21.15.12:0/3204231020 >> 172.21.15.12:0/3204231020 conn(0x7f28fc060180 msgr2=0x7f28fc0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 -- 172.21.15.12:0/3204231020 shutdown_connections 2021-10-20T23:20:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 -- 172.21.15.12:0/3204231020 wait complete. 2021-10-20T23:20:20.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 Processor -- start 2021-10-20T23:20:20.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 -- start start 2021-10-20T23:20:20.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0afbd0 0x7f28fc0aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28fc0b0010 0x7f28fc148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28fc0b2580 0x7f28fc159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc15ab70 con 0x7f28fc0b2580 2021-10-20T23:20:20.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc149810 con 0x7f28fc0afbd0 2021-10-20T23:20:20.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2902135700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc149ab0 con 0x7f28fc0b0010 2021-10-20T23:20:20.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2901934700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28fc0b2580 0x7f28fc159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2901934700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28fc0b2580 0x7f28fc159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37534/0 (socket says 172.21.15.12:37534) 2021-10-20T23:20:20.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2900932700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28fc0b0010 0x7f28fc148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2901934700 1 -- 172.21.15.12:0/3599065448 learned_addr learned my addr 172.21.15.12:0/3599065448 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:20.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.120+0000 7f2901133700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0afbd0 0x7f28fc0aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f2901934700 1 -- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28fc0b0010 msgr2=0x7f28fc148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f2901934700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28fc0b0010 0x7f28fc148970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f2901934700 1 -- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0afbd0 msgr2=0x7f28fc0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f2901934700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0afbd0 0x7f28fc0aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f2901934700 1 -- 172.21.15.12:0/3599065448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8009470 con 0x7f28fc0b2580 2021-10-20T23:20:20.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f2901934700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28fc0b2580 0x7f28fc159fe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f28f40018c0 tx=0x7f28f40019f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f28f27fc700 1 -- 172.21.15.12:0/3599065448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f4007170 con 0x7f28fc0b2580 2021-10-20T23:20:20.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f28f27fc700 1 -- 172.21.15.12:0/3599065448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f40072d0 con 0x7f28fc0b2580 2021-10-20T23:20:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc14ac80 con 0x7f28fc0b2580 2021-10-20T23:20:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f28f27fc700 1 -- 172.21.15.12:0/3599065448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f4004920 con 0x7f28fc0b2580 2021-10-20T23:20:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc154280 con 0x7f28fc0b2580 2021-10-20T23:20:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc14b120 con 0x7f28fc0b2580 2021-10-20T23:20:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f28f27fc700 1 -- 172.21.15.12:0/3599065448 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f28f401b070 con 0x7f28fc0b2580 2021-10-20T23:20:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f28f27fc700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28e40536a0 0x7f28e4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.124+0000 7f28f27fc700 1 -- 172.21.15.12:0/3599065448 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f28f406b1c0 con 0x7f28fc0b2580 2021-10-20T23:20:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.128+0000 7f2901133700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28e40536a0 0x7f28e4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.128+0000 7f2901133700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28e40536a0 0x7f28e4055b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f28ec00d000 tx=0x7f28ec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.132+0000 7f28f27fc700 1 -- 172.21.15.12:0/3599065448 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28fc14b120 con 0x7f28fc0b2580 2021-10-20T23:20:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.260+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28fc14b120 con 0x7f28fc0b2580 2021-10-20T23:20:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f28f27fc700 1 -- 172.21.15.12:0/3599065448 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f28fc14b120 con 0x7f28fc0b2580 2021-10-20T23:20:20.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:20.270 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:19:56.508005+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:19:51.434642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-20T23:19:54.214563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:20.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28e40536a0 msgr2=0x7f28e4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28e40536a0 0x7f28e4055b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f28ec00d000 tx=0x7f28ec009040).stop 2021-10-20T23:20:20.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28fc0b2580 msgr2=0x7f28fc159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28fc0b2580 0x7f28fc159fe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f28f40018c0 tx=0x7f28f40019f0).stop 2021-10-20T23:20:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 shutdown_connections 2021-10-20T23:20:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28e40536a0 0x7f28e4055b60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28fc0b2580 0x7f28fc159fe0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28fc0b0010 0x7f28fc148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 --2- 172.21.15.12:0/3599065448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0afbd0 0x7f28fc0aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 >> 172.21.15.12:0/3599065448 conn(0x7f28fc060180 msgr2=0x7f28fc0b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:20.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 shutdown_connections 2021-10-20T23:20:20.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.264+0000 7f2902135700 1 -- 172.21.15.12:0/3599065448 wait complete. 2021-10-20T23:20:20.282 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:19:51.434642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:19:54.214563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:20:20.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:20:20.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.388+0000 7f93e759e700 1 Processor -- start 2021-10-20T23:20:20.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.388+0000 7f93e759e700 1 -- start start 2021-10-20T23:20:20.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.388+0000 7f93e759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 0x7f93e8060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.388+0000 7f93e759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f93e80b25a0 0x7f93e8061000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.388+0000 7f93e759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93e8066520 0x7f93e8066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.388+0000 7f93e759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e8062000 con 0x7f93e80b25a0 2021-10-20T23:20:20.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.388+0000 7f93e759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e8065330 con 0x7f93e8066520 2021-10-20T23:20:20.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.388+0000 7f93e759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80b33e0 con 0x7f93e80b3000 2021-10-20T23:20:20.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f93e80b25a0 0x7f93e8061000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e6d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93e8066520 0x7f93e8066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f93e80b25a0 0x7f93e8061000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37540/0 (socket says 172.21.15.12:37540) 2021-10-20T23:20:20.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e5d9b700 1 -- 172.21.15.12:0/2263326486 learned_addr learned my addr 172.21.15.12:0/2263326486 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:20.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e659c700 1 --2- 172.21.15.12:0/2263326486 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 0x7f93e8060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e6d9d700 1 -- 172.21.15.12:0/2263326486 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 msgr2=0x7f93e8060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:20.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e6d9d700 1 --2- 172.21.15.12:0/2263326486 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 0x7f93e8060b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e6d9d700 1 -- 172.21.15.12:0/2263326486 >> v2:172.21.15.12:3300/0 conn(0x7f93e80b25a0 msgr2=0x7f93e8061000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:20.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e6d9d700 1 --2- 172.21.15.12:0/2263326486 >> v2:172.21.15.12:3300/0 conn(0x7f93e80b25a0 0x7f93e8061000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e6d9d700 1 -- 172.21.15.12:0/2263326486 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e805fa60 con 0x7f93e8066520 2021-10-20T23:20:20.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e6d9d700 1 --2- 172.21.15.12:0/2263326486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e8066520 0x7f93e8066990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f93e00032f0 tx=0x7f93e00091d0).ready entity=mon.1 client_cookie=641949d8e01ad100 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e559a700 1 -- 172.21.15.12:0/2263326486 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e000b600 con 0x7f93e8066520 2021-10-20T23:20:20.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e559a700 1 -- 172.21.15.12:0/2263326486 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e000b760 con 0x7f93e8066520 2021-10-20T23:20:20.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e559a700 1 -- 172.21.15.12:0/2263326486 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e000b8d0 con 0x7f93e8066520 2021-10-20T23:20:20.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e759e700 1 -- 172.21.15.12:0/2263326486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e8066520 msgr2=0x7f93e8066990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e759e700 1 --2- 172.21.15.12:0/2263326486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e8066520 0x7f93e8066990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f93e00032f0 tx=0x7f93e00091d0).stop 2021-10-20T23:20:20.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e759e700 1 -- 172.21.15.12:0/2263326486 shutdown_connections 2021-10-20T23:20:20.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e759e700 1 --2- 172.21.15.12:0/2263326486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e8066520 0x7f93e8066990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e759e700 1 --2- 172.21.15.12:0/2263326486 >> v2:172.21.15.12:3300/0 conn(0x7f93e80b25a0 0x7f93e8061000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e759e700 1 --2- 172.21.15.12:0/2263326486 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 0x7f93e8060b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e759e700 1 -- 172.21.15.12:0/2263326486 >> 172.21.15.12:0/2263326486 conn(0x7f93e80636e0 msgr2=0x7f93e8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:20.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e759e700 1 -- 172.21.15.12:0/2263326486 shutdown_connections 2021-10-20T23:20:20.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.392+0000 7f93e759e700 1 -- 172.21.15.12:0/2263326486 wait complete. 2021-10-20T23:20:20.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 Processor -- start 2021-10-20T23:20:20.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 -- start start 2021-10-20T23:20:20.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93e8066520 0x7f93e80ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e80b25a0 0x7f93e81456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 0x7f93e81433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80af740 con 0x7f93e8066520 2021-10-20T23:20:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80ae820 con 0x7f93e80b25a0 2021-10-20T23:20:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80adb00 con 0x7f93e80b3000 2021-10-20T23:20:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93e8066520 0x7f93e80ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93e8066520 0x7f93e80ac560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37546/0 (socket says 172.21.15.12:37546) 2021-10-20T23:20:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e659c700 1 -- 172.21.15.12:0/2379643489 learned_addr learned my addr 172.21.15.12:0/2379643489 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e80b25a0 0x7f93e81456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e6d9d700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 0x7f93e81433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e659c700 1 -- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 msgr2=0x7f93e81433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e659c700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 0x7f93e81433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e659c700 1 -- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e80b25a0 msgr2=0x7f93e81456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e659c700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e80b25a0 0x7f93e81456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e659c700 1 -- 172.21.15.12:0/2379643489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e0009470 con 0x7f93e8066520 2021-10-20T23:20:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e6d9d700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 0x7f93e81433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e5d9b700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e80b25a0 0x7f93e81456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e659c700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93e8066520 0x7f93e80ac560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f93d000c000 tx=0x7f93d0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93df7fe700 1 -- 172.21.15.12:0/2379643489 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d0010780 con 0x7f93e8066520 2021-10-20T23:20:20.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93df7fe700 1 -- 172.21.15.12:0/2379643489 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d00108e0 con 0x7f93e8066520 2021-10-20T23:20:20.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e80adf30 con 0x7f93e8066520 2021-10-20T23:20:20.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93df7fe700 1 -- 172.21.15.12:0/2379643489 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d0010c40 con 0x7f93e8066520 2021-10-20T23:20:20.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.396+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e80ae1a0 con 0x7f93e8066520 2021-10-20T23:20:20.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.400+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e805fd00 con 0x7f93e8066520 2021-10-20T23:20:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.400+0000 7f93df7fe700 1 -- 172.21.15.12:0/2379643489 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f93d001c460 con 0x7f93e8066520 2021-10-20T23:20:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.400+0000 7f93df7fe700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f93cc0536a0 0x7f93cc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.400+0000 7f93df7fe700 1 -- 172.21.15.12:0/2379643489 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f93d006bfe0 con 0x7f93e8066520 2021-10-20T23:20:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.400+0000 7f93e5d9b700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f93cc0536a0 0x7f93cc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.400+0000 7f93e5d9b700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f93cc0536a0 0x7f93cc055b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f93d8008000 tx=0x7f93d8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.408+0000 7f93df7fe700 1 -- 172.21.15.12:0/2379643489 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f93d0042e30 con 0x7f93e8066520 2021-10-20T23:20:20.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f93e8057350 con 0x7f93e8066520 2021-10-20T23:20:20.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93df7fe700 1 -- 172.21.15.12:0/2379643489 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f93d0046450 con 0x7f93e8066520 2021-10-20T23:20:20.537 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:20:20.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f93cc0536a0 msgr2=0x7f93cc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f93cc0536a0 0x7f93cc055b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f93d8008000 tx=0x7f93d8008040).stop 2021-10-20T23:20:20.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93e8066520 msgr2=0x7f93e80ac560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93e8066520 0x7f93e80ac560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f93d000c000 tx=0x7f93d0006df0).stop 2021-10-20T23:20:20.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 shutdown_connections 2021-10-20T23:20:20.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f93cc0536a0 0x7f93cc055b60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e80b3000 0x7f93e81433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e80b25a0 0x7f93e81456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 --2- 172.21.15.12:0/2379643489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93e8066520 0x7f93e80ac560 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 >> 172.21.15.12:0/2379643489 conn(0x7f93e80636e0 msgr2=0x7f93e81461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 shutdown_connections 2021-10-20T23:20:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.532+0000 7f93e759e700 1 -- 172.21.15.12:0/2379643489 wait complete. 2021-10-20T23:20:20.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:20:20.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9374133700 1 Processor -- start 2021-10-20T23:20:20.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9374133700 1 -- start start 2021-10-20T23:20:20.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9374133700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f936c0b1ec0 0x7f936c0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9374133700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f936c0affb0 0x7f936c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9374133700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 0x7f936c141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9374133700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c0b0420 con 0x7f936c0affb0 2021-10-20T23:20:20.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9374133700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c0b2790 con 0x7f936c0b1ec0 2021-10-20T23:20:20.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9374133700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0b0650 con 0x7f936c0a70c0 2021-10-20T23:20:20.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93716ce700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f936c0affb0 0x7f936c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93716ce700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f936c0affb0 0x7f936c0b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37552/0 (socket says 172.21.15.12:37552) 2021-10-20T23:20:20.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93716ce700 1 -- 172.21.15.12:0/2749534160 learned_addr learned my addr 172.21.15.12:0/2749534160 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:20.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9371ecf700 1 --2- 172.21.15.12:0/2749534160 >> v2:172.21.15.31:3300/0 conn(0x7f936c0b1ec0 0x7f936c0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93726d0700 1 --2- 172.21.15.12:0/2749534160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 0x7f936c141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93716ce700 1 -- 172.21.15.12:0/2749534160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 msgr2=0x7f936c141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:20.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93716ce700 1 --2- 172.21.15.12:0/2749534160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 0x7f936c141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93716ce700 1 -- 172.21.15.12:0/2749534160 >> v2:172.21.15.31:3300/0 conn(0x7f936c0b1ec0 msgr2=0x7f936c0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:20.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93716ce700 1 --2- 172.21.15.12:0/2749534160 >> v2:172.21.15.31:3300/0 conn(0x7f936c0b1ec0 0x7f936c0b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93716ce700 1 -- 172.21.15.12:0/2749534160 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0b08f0 con 0x7f936c0affb0 2021-10-20T23:20:20.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9371ecf700 1 --2- 172.21.15.12:0/2749534160 >> v2:172.21.15.31:3300/0 conn(0x7f936c0b1ec0 0x7f936c0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:20.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f93716ce700 1 --2- 172.21.15.12:0/2749534160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 0x7f936c0b22a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9368002f70 tx=0x7f9368006eb0).ready entity=mon.0 client_cookie=32b6af4fa48512cc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9370ecd700 1 -- 172.21.15.12:0/2749534160 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f936800d570 con 0x7f936c0affb0 2021-10-20T23:20:20.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9370ecd700 1 -- 172.21.15.12:0/2749534160 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9368000e90 con 0x7f936c0affb0 2021-10-20T23:20:20.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.652+0000 7f9370ecd700 1 -- 172.21.15.12:0/2749534160 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f936800d900 con 0x7f936c0affb0 2021-10-20T23:20:20.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 -- 172.21.15.12:0/2749534160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 msgr2=0x7f936c0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 --2- 172.21.15.12:0/2749534160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 0x7f936c0b22a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9368002f70 tx=0x7f9368006eb0).stop 2021-10-20T23:20:20.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 -- 172.21.15.12:0/2749534160 shutdown_connections 2021-10-20T23:20:20.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 --2- 172.21.15.12:0/2749534160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 0x7f936c141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 --2- 172.21.15.12:0/2749534160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 0x7f936c0b22a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 --2- 172.21.15.12:0/2749534160 >> v2:172.21.15.31:3300/0 conn(0x7f936c0b1ec0 0x7f936c0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 -- 172.21.15.12:0/2749534160 >> 172.21.15.12:0/2749534160 conn(0x7f936c05f6b0 msgr2=0x7f936c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:20.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 -- 172.21.15.12:0/2749534160 shutdown_connections 2021-10-20T23:20:20.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 -- 172.21.15.12:0/2749534160 wait complete. 2021-10-20T23:20:20.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 Processor -- start 2021-10-20T23:20:20.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 -- start start 2021-10-20T23:20:20.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 0x7f936c14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 0x7f936c14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f936c0b1ec0 0x7f936c14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c149370 con 0x7f936c0affb0 2021-10-20T23:20:20.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c156970 con 0x7f936c0b1ec0 2021-10-20T23:20:20.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9374133700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c14efa0 con 0x7f936c0a70c0 2021-10-20T23:20:20.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f93716ce700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 0x7f936c14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f93716ce700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 0x7f936c14eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37560/0 (socket says 172.21.15.12:37560) 2021-10-20T23:20:20.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f93716ce700 1 -- 172.21.15.12:0/1133989046 learned_addr learned my addr 172.21.15.12:0/1133989046 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:20.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9371ecf700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 0x7f936c14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f93726d0700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f936c0b1ec0 0x7f936c14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f93716ce700 1 -- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 msgr2=0x7f936c14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f93716ce700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 0x7f936c14e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f93716ce700 1 -- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f936c0b1ec0 msgr2=0x7f936c14cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f93716ce700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f936c0b1ec0 0x7f936c14cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f93716ce700 1 -- 172.21.15.12:0/1133989046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936800b1e0 con 0x7f936c0affb0 2021-10-20T23:20:20.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.656+0000 7f9371ecf700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 0x7f936c14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:20.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f93716ce700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 0x7f936c14eab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9368002f70 tx=0x7f9368015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f935effd700 1 -- 172.21.15.12:0/1133989046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9368011a00 con 0x7f936c0affb0 2021-10-20T23:20:20.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f935effd700 1 -- 172.21.15.12:0/1133989046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9368011b60 con 0x7f936c0affb0 2021-10-20T23:20:20.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c156bc0 con 0x7f936c0affb0 2021-10-20T23:20:20.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f935effd700 1 -- 172.21.15.12:0/1133989046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f936801e460 con 0x7f936c0affb0 2021-10-20T23:20:20.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c0ac020 con 0x7f936c0affb0 2021-10-20T23:20:20.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f935effd700 1 -- 172.21.15.12:0/1133989046 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9368025030 con 0x7f936c0affb0 2021-10-20T23:20:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c0b0b90 con 0x7f936c0affb0 2021-10-20T23:20:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f935effd700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f934c0535b0 0x7f934c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f935effd700 1 -- 172.21.15.12:0/1133989046 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f936806cc70 con 0x7f936c0affb0 2021-10-20T23:20:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f9371ecf700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f934c0535b0 0x7f934c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.660+0000 7f9371ecf700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f934c0535b0 0x7f934c055a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f936000b000 tx=0x7f9360008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.668+0000 7f935effd700 1 -- 172.21.15.12:0/1133989046 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9368043c70 con 0x7f936c0affb0 2021-10-20T23:20:20.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.796+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f936c057350 con 0x7f936c0affb0 2021-10-20T23:20:20.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.796+0000 7f935effd700 1 -- 172.21.15.12:0/1133989046 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9368023020 con 0x7f936c0affb0 2021-10-20T23:20:20.804 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.796+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f934c0535b0 msgr2=0x7f934c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.796+0000 7f9374133700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f934c0535b0 0x7f934c055a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f936000b000 tx=0x7f9360008040).stop 2021-10-20T23:20:20.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.796+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 msgr2=0x7f936c14eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.800+0000 7f9374133700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 0x7f936c14eab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9368002f70 tx=0x7f9368015000).stop 2021-10-20T23:20:20.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.800+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 shutdown_connections 2021-10-20T23:20:20.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.800+0000 7f9374133700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f934c0535b0 0x7f934c055a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.800+0000 7f9374133700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f936c0b1ec0 0x7f936c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.800+0000 7f9374133700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f936c0affb0 0x7f936c14eab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.800+0000 7f9374133700 1 --2- 172.21.15.12:0/1133989046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f936c0a70c0 0x7f936c14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.800+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 >> 172.21.15.12:0/1133989046 conn(0x7f936c05f6b0 msgr2=0x7f936c146140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.800+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 shutdown_connections 2021-10-20T23:20:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.800+0000 7f9374133700 1 -- 172.21.15.12:0/1133989046 wait complete. 2021-10-20T23:20:20.815 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:20:20.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25acc0e700 1 Processor -- start 2021-10-20T23:20:20.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25acc0e700 1 -- start start 2021-10-20T23:20:20.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25acc0e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f25a80afca0 0x7f25a813e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25acc0e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25a80af130 0x7f25a8144500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25acc0e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a80671d0 con 0x7f25a80b2850 2021-10-20T23:20:20.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25acc0e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a80b2c30 con 0x7f25a80afca0 2021-10-20T23:20:20.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25acc0e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a8067400 con 0x7f25a80af130 2021-10-20T23:20:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25a6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f25a80afca0 0x7f25a813e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25a6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f25a80afca0 0x7f25a813e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37568/0 (socket says 172.21.15.12:37568) 2021-10-20T23:20:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25a6ffd700 1 -- 172.21.15.12:0/72302258 learned_addr learned my addr 172.21.15.12:0/72302258 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25a7fff700 1 --2- 172.21.15.12:0/72302258 >> v2:172.21.15.31:3300/0 conn(0x7f25a80af130 0x7f25a8144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25a6ffd700 1 -- 172.21.15.12:0/72302258 >> v2:172.21.15.31:3300/0 conn(0x7f25a80af130 msgr2=0x7f25a8144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25a6ffd700 1 --2- 172.21.15.12:0/72302258 >> v2:172.21.15.31:3300/0 conn(0x7f25a80af130 0x7f25a8144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25a6ffd700 1 -- 172.21.15.12:0/72302258 >> v1:172.21.15.31:6789/0 conn(0x7f25a80b2850 legacy=0x7f25a813e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.924+0000 7f25a6ffd700 1 -- 172.21.15.12:0/72302258 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a80676a0 con 0x7f25a80afca0 2021-10-20T23:20:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25a6ffd700 1 --2- 172.21.15.12:0/72302258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80afca0 0x7f25a813e8c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f25980032f0 tx=0x7f2598009290).ready entity=mon.0 client_cookie=57cb09d246b8ef00 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25a67fc700 1 -- 172.21.15.12:0/72302258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f259800b870 con 0x7f25a80afca0 2021-10-20T23:20:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25a67fc700 1 -- 172.21.15.12:0/72302258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259800b9d0 con 0x7f25a80afca0 2021-10-20T23:20:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25a67fc700 1 -- 172.21.15.12:0/72302258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f259800bb40 con 0x7f25a80afca0 2021-10-20T23:20:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 -- 172.21.15.12:0/72302258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80afca0 msgr2=0x7f25a813e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 --2- 172.21.15.12:0/72302258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80afca0 0x7f25a813e8c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f25980032f0 tx=0x7f2598009290).stop 2021-10-20T23:20:20.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 -- 172.21.15.12:0/72302258 shutdown_connections 2021-10-20T23:20:20.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 --2- 172.21.15.12:0/72302258 >> v2:172.21.15.31:3300/0 conn(0x7f25a80af130 0x7f25a8144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 --2- 172.21.15.12:0/72302258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80afca0 0x7f25a813e8c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 -- 172.21.15.12:0/72302258 >> 172.21.15.12:0/72302258 conn(0x7f25a8061230 msgr2=0x7f25a8062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:20.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 -- 172.21.15.12:0/72302258 shutdown_connections 2021-10-20T23:20:20.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 -- 172.21.15.12:0/72302258 wait complete. 2021-10-20T23:20:20.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 Processor -- start 2021-10-20T23:20:20.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 -- start start 2021-10-20T23:20:20.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25a80af130 0x7f25a809f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a80afca0 0x7f25a809fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80b2850 0x7f25a81539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80b4850 con 0x7f25a80b2850 2021-10-20T23:20:20.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80a01c0 con 0x7f25a80afca0 2021-10-20T23:20:20.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25acc0e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80b4030 con 0x7f25a80af130 2021-10-20T23:20:20.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.928+0000 7f25a7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80b2850 0x7f25a81539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a80afca0 0x7f25a809fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a77fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25a80af130 0x7f25a809f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a80afca0 0x7f25a809fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:52548/0 (socket says 172.21.15.12:52548) 2021-10-20T23:20:20.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a6ffd700 1 -- 172.21.15.12:0/945553756 learned_addr learned my addr 172.21.15.12:0/945553756 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:20.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a6ffd700 1 -- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25a80af130 msgr2=0x7f25a809f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a6ffd700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25a80af130 0x7f25a809f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a6ffd700 1 -- 172.21.15.12:0/945553756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80b2850 msgr2=0x7f25a81539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:20.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a6ffd700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80b2850 0x7f25a81539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:20.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a6ffd700 1 -- 172.21.15.12:0/945553756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598009530 con 0x7f25a80afca0 2021-10-20T23:20:20.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a77fe700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25a80af130 0x7f25a809f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:20.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a7fff700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80b2850 0x7f25a81539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:20.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a6ffd700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a80afca0 0x7f25a809fcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f25a8150440 tx=0x7f2598016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a4ff9700 1 -- 172.21.15.12:0/945553756 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f259800b870 con 0x7f25a80afca0 2021-10-20T23:20:20.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a4ff9700 1 -- 172.21.15.12:0/945553756 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598021440 con 0x7f25a80afca0 2021-10-20T23:20:20.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a80b4260 con 0x7f25a80afca0 2021-10-20T23:20:20.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a4ff9700 1 -- 172.21.15.12:0/945553756 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25980217a0 con 0x7f25a80afca0 2021-10-20T23:20:20.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a8150d90 con 0x7f25a80afca0 2021-10-20T23:20:20.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a80b3d30 con 0x7f25a80afca0 2021-10-20T23:20:20.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a4ff9700 1 -- 172.21.15.12:0/945553756 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f259800f070 con 0x7f25a80afca0 2021-10-20T23:20:20.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a4ff9700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f258c0534f0 0x7f258c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:20.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a4ff9700 1 -- 172.21.15.12:0/945553756 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f259806d010 con 0x7f25a80afca0 2021-10-20T23:20:20.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.932+0000 7f25a77fe700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f258c0534f0 0x7f258c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:20.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.936+0000 7f25a77fe700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f258c0534f0 0x7f258c0559b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f259000d000 tx=0x7f2590007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:20.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:20.944+0000 7f25a4ff9700 1 -- 172.21.15.12:0/945553756 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2598044010 con 0x7f25a80afca0 2021-10-20T23:20:21.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.072+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25a80b4640 con 0x7f25a80afca0 2021-10-20T23:20:21.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.072+0000 7f25a4ff9700 1 -- 172.21.15.12:0/945553756 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2598015020 con 0x7f25a80afca0 2021-10-20T23:20:21.079 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:21.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f258c0534f0 msgr2=0x7f258c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f258c0534f0 0x7f258c0559b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f259000d000 tx=0x7f2590007b70).stop 2021-10-20T23:20:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a80afca0 msgr2=0x7f25a809fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a80afca0 0x7f25a809fcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f25a8150440 tx=0x7f2598016000).stop 2021-10-20T23:20:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 shutdown_connections 2021-10-20T23:20:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f258c0534f0 0x7f258c0559b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a80b2850 0x7f25a81539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a80afca0 0x7f25a809fcd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 --2- 172.21.15.12:0/945553756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25a80af130 0x7f25a809f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 >> 172.21.15.12:0/945553756 conn(0x7f25a8061230 msgr2=0x7f25a813b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 shutdown_connections 2021-10-20T23:20:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.076+0000 7f25acc0e700 1 -- 172.21.15.12:0/945553756 wait complete. 2021-10-20T23:20:21.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:20:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.196+0000 7fdb47fff700 1 Processor -- start 2021-10-20T23:20:21.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.196+0000 7fdb47fff700 1 -- start start 2021-10-20T23:20:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb48061320 0x7fdb48061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48140440 0x7fdb481408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb480aecf0 con 0x7fdb480ad5c0 2021-10-20T23:20:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb480b6f20 con 0x7fdb48061320 2021-10-20T23:20:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480aef20 con 0x7fdb48140440 2021-10-20T23:20:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb467fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdb480ad5c0 0x7fdb480b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36174/0 (socket says 172.21.15.12:36174) 2021-10-20T23:20:21.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb467fc700 1 -- 172.21.15.12:0/1217188264 learned_addr learned my addr 172.21.15.12:0/1217188264 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:21.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb46ffd700 1 --2- 172.21.15.12:0/1217188264 >> v2:172.21.15.12:3300/0 conn(0x7fdb48061320 0x7fdb48061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb477fe700 1 --2- 172.21.15.12:0/1217188264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48140440 0x7fdb481408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb45ffb700 1 -- 172.21.15.12:0/1217188264 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470266578 0 0) 0x7fdb480aecf0 con 0x7fdb480ad5c0 2021-10-20T23:20:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb45ffb700 1 -- 172.21.15.12:0/1217188264 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb28003260 con 0x7fdb480ad5c0 2021-10-20T23:20:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb46ffd700 1 -- 172.21.15.12:0/1217188264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48140440 msgr2=0x7fdb481408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb46ffd700 1 --2- 172.21.15.12:0/1217188264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48140440 0x7fdb481408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb46ffd700 1 -- 172.21.15.12:0/1217188264 >> v1:172.21.15.12:6789/0 conn(0x7fdb480ad5c0 legacy=0x7fdb480b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb46ffd700 1 -- 172.21.15.12:0/1217188264 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480af1c0 con 0x7fdb48061320 2021-10-20T23:20:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb477fe700 1 --2- 172.21.15.12:0/1217188264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48140440 0x7fdb481408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb46ffd700 1 --2- 172.21.15.12:0/1217188264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48061320 0x7fdb48061700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fdb480aeba0 tx=0x7fdb38006df0).ready entity=mon.0 client_cookie=890ce75db82211a6 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb45ffb700 1 -- 172.21.15.12:0/1217188264 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb3800d570 con 0x7fdb48061320 2021-10-20T23:20:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb45ffb700 1 -- 172.21.15.12:0/1217188264 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb38000e90 con 0x7fdb48061320 2021-10-20T23:20:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb45ffb700 1 -- 172.21.15.12:0/1217188264 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb3800d8c0 con 0x7fdb48061320 2021-10-20T23:20:21.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 -- 172.21.15.12:0/1217188264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48061320 msgr2=0x7fdb48061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 --2- 172.21.15.12:0/1217188264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48061320 0x7fdb48061700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fdb480aeba0 tx=0x7fdb38006df0).stop 2021-10-20T23:20:21.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 -- 172.21.15.12:0/1217188264 shutdown_connections 2021-10-20T23:20:21.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 --2- 172.21.15.12:0/1217188264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48140440 0x7fdb481408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 --2- 172.21.15.12:0/1217188264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48061320 0x7fdb48061700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 -- 172.21.15.12:0/1217188264 >> 172.21.15.12:0/1217188264 conn(0x7fdb48066de0 msgr2=0x7fdb480671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:21.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 -- 172.21.15.12:0/1217188264 shutdown_connections 2021-10-20T23:20:21.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.200+0000 7fdb47fff700 1 -- 172.21.15.12:0/1217188264 wait complete. 2021-10-20T23:20:21.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb47fff700 1 Processor -- start 2021-10-20T23:20:21.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb47fff700 1 -- start start 2021-10-20T23:20:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb47fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48061320 0x7fdb480b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb47fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb480ad5c0 0x7fdb480b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb47fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48140440 0x7fdb480b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb47fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480b3ee0 con 0x7fdb48140440 2021-10-20T23:20:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb47fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48142560 con 0x7fdb480ad5c0 2021-10-20T23:20:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb47fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48142800 con 0x7fdb48061320 2021-10-20T23:20:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48140440 0x7fdb480b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48140440 0x7fdb480b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37590/0 (socket says 172.21.15.12:37590) 2021-10-20T23:20:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb477fe700 1 -- 172.21.15.12:0/2367591935 learned_addr learned my addr 172.21.15.12:0/2367591935 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:21.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb46ffd700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48061320 0x7fdb480b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb467fc700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb480ad5c0 0x7fdb480b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb477fe700 1 -- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48061320 msgr2=0x7fdb480b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb477fe700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48061320 0x7fdb480b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb477fe700 1 -- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb480ad5c0 msgr2=0x7fdb480b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb477fe700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb480ad5c0 0x7fdb480b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb477fe700 1 -- 172.21.15.12:0/2367591935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3800b180 con 0x7fdb48140440 2021-10-20T23:20:21.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb477fe700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48140440 0x7fdb480b39f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fdb40006cc0 tx=0x7fdb40008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:21.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb3ffff700 1 -- 172.21.15.12:0/2367591935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb4000f710 con 0x7fdb48140440 2021-10-20T23:20:21.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb3ffff700 1 -- 172.21.15.12:0/2367591935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4000f870 con 0x7fdb48140440 2021-10-20T23:20:21.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb480acac0 con 0x7fdb48140440 2021-10-20T23:20:21.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.204+0000 7fdb3ffff700 1 -- 172.21.15.12:0/2367591935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb4000fbd0 con 0x7fdb48140440 2021-10-20T23:20:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.208+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb481409f0 con 0x7fdb48140440 2021-10-20T23:20:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.208+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb480af460 con 0x7fdb48140440 2021-10-20T23:20:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.208+0000 7fdb3ffff700 1 -- 172.21.15.12:0/2367591935 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb4001a030 con 0x7fdb48140440 2021-10-20T23:20:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.208+0000 7fdb3ffff700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb2c0534f0 0x7fdb2c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.208+0000 7fdb3ffff700 1 -- 172.21.15.12:0/2367591935 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdb4006bb60 con 0x7fdb48140440 2021-10-20T23:20:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.208+0000 7fdb46ffd700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb2c0534f0 0x7fdb2c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.208+0000 7fdb46ffd700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb2c0534f0 0x7fdb2c0559b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fdb3801a000 tx=0x7fdb38014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:21.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.212+0000 7fdb3ffff700 1 -- 172.21.15.12:0/2367591935 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb40042a50 con 0x7fdb48140440 2021-10-20T23:20:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.340+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb48062100 con 0x7fdb48140440 2021-10-20T23:20:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.340+0000 7fdb3ffff700 1 -- 172.21.15.12:0/2367591935 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fdb40046070 con 0x7fdb48140440 2021-10-20T23:20:21.347 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb2c0534f0 msgr2=0x7fdb2c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb2c0534f0 0x7fdb2c0559b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fdb3801a000 tx=0x7fdb38014000).stop 2021-10-20T23:20:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48140440 msgr2=0x7fdb480b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48140440 0x7fdb480b39f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fdb40006cc0 tx=0x7fdb40008040).stop 2021-10-20T23:20:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 shutdown_connections 2021-10-20T23:20:21.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb2c0534f0 0x7fdb2c0559b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb48140440 0x7fdb480b39f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb480ad5c0 0x7fdb480b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 --2- 172.21.15.12:0/2367591935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb48061320 0x7fdb480b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 >> 172.21.15.12:0/2367591935 conn(0x7fdb48066de0 msgr2=0x7fdb480671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 shutdown_connections 2021-10-20T23:20:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.344+0000 7fdb47fff700 1 -- 172.21.15.12:0/2367591935 wait complete. 2021-10-20T23:20:21.368 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-10-20T23:20:21.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-10-20T23:20:21.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 Processor -- start 2021-10-20T23:20:21.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 -- start start 2021-10-20T23:20:21.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b1db0 0x7fab540b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab540a70c0 0x7fab54144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab540b0350 con 0x7fab541483a0 2021-10-20T23:20:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab540a90c0 con 0x7fab540a70c0 2021-10-20T23:20:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b05f0 con 0x7fab540b1db0 2021-10-20T23:20:21.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab4affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fab541483a0 0x7fab540b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36190/0 (socket says 172.21.15.12:36190) 2021-10-20T23:20:21.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab4affd700 1 -- 172.21.15.12:0/681365562 learned_addr learned my addr 172.21.15.12:0/681365562 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:21.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab53fff700 1 --2- 172.21.15.12:0/681365562 >> v2:172.21.15.12:3300/0 conn(0x7fab540a70c0 0x7fab54144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab537fe700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b1db0 0x7fab540b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383335423 0 0) 0x7fab540b0350 con 0x7fab541483a0 2021-10-20T23:20:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab34003260 con 0x7fab541483a0 2021-10-20T23:20:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3404281867 0 0) 0x7fab34003260 con 0x7fab541483a0 2021-10-20T23:20:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b1db0 msgr2=0x7fab540b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b1db0 0x7fab540b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 >> v2:172.21.15.12:3300/0 conn(0x7fab540a70c0 msgr2=0x7fab54144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 --2- 172.21.15.12:0/681365562 >> v2:172.21.15.12:3300/0 conn(0x7fab540a70c0 0x7fab54144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540b0890 con 0x7fab541483a0 2021-10-20T23:20:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fab3c001660 con 0x7fab541483a0 2021-10-20T23:20:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 >> v1:172.21.15.12:6789/0 conn(0x7fab541483a0 legacy=0x7fab540b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b1db0 0x7fab34003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34003c80 0x7fab34004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab340049f0 0x7fab34004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b05f0 con 0x7fab34003c80 2021-10-20T23:20:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3400b750 con 0x7fab340049f0 2021-10-20T23:20:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3400b890 con 0x7fab540b1db0 2021-10-20T23:20:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab4affd700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34003c80 0x7fab34004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab537fe700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b1db0 0x7fab34003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab53fff700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab340049f0 0x7fab34004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab4affd700 1 -- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b1db0 msgr2=0x7fab34003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:21.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab4affd700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab540b1db0 0x7fab34003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab4affd700 1 -- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab340049f0 msgr2=0x7fab34004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:21.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab4affd700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab340049f0 0x7fab34004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab4affd700 1 -- 172.21.15.12:0/681365562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34003260 con 0x7fab34003c80 2021-10-20T23:20:21.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab53fff700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab340049f0 0x7fab34004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:21.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab4affd700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34003c80 0x7fab34004500 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fab340054d0 tx=0x7fab540b0a20).ready entity=mon.0 client_cookie=e865770b1942cab2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:21.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab3c0071a0 con 0x7fab34003c80 2021-10-20T23:20:21.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c007300 con 0x7fab34003c80 2021-10-20T23:20:21.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab52ffd700 1 -- 172.21.15.12:0/681365562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab3c00cb70 con 0x7fab34003c80 2021-10-20T23:20:21.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 -- 172.21.15.12:0/681365562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34003c80 msgr2=0x7fab34004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 --2- 172.21.15.12:0/681365562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34003c80 0x7fab34004500 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fab340054d0 tx=0x7fab540b0a20).stop 2021-10-20T23:20:21.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab53fff700 1 -- 172.21.15.12:0/681365562 reap_dead start 2021-10-20T23:20:21.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 -- 172.21.15.12:0/681365562 shutdown_connections 2021-10-20T23:20:21.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 -- 172.21.15.12:0/681365562 >> 172.21.15.12:0/681365562 conn(0x7fab5405f6b0 msgr2=0x7fab5405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:21.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 -- 172.21.15.12:0/681365562 shutdown_connections 2021-10-20T23:20:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.472+0000 7fab59a73700 1 -- 172.21.15.12:0/681365562 wait complete. 2021-10-20T23:20:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 Processor -- start 2021-10-20T23:20:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 -- start start 2021-10-20T23:20:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab34003c80 0x7fab54067370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540a9e80 0x7fab541568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab5415a5b0 0x7fab540ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab54064920 con 0x7fab540a9e80 2021-10-20T23:20:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab54064bc0 con 0x7fab34003c80 2021-10-20T23:20:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab54159e70 con 0x7fab5415a5b0 2021-10-20T23:20:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540a9e80 0x7fab541568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540a9e80 0x7fab541568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37608/0 (socket says 172.21.15.12:37608) 2021-10-20T23:20:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab4affd700 1 -- 172.21.15.12:0/396727638 learned_addr learned my addr 172.21.15.12:0/396727638 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab537fe700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab34003c80 0x7fab54067370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab53fff700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab5415a5b0 0x7fab540ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab4affd700 1 -- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab5415a5b0 msgr2=0x7fab540ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab4affd700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab5415a5b0 0x7fab540ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab4affd700 1 -- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab34003c80 msgr2=0x7fab54067370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab4affd700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab34003c80 0x7fab54067370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab4affd700 1 -- 172.21.15.12:0/396727638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5415a110 con 0x7fab540a9e80 2021-10-20T23:20:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab4affd700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540a9e80 0x7fab541568a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fab340054d0 tx=0x7fab3c013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab517fa700 1 -- 172.21.15.12:0/396727638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab3c007470 con 0x7fab540a9e80 2021-10-20T23:20:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab540644f0 con 0x7fab540a9e80 2021-10-20T23:20:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab54065550 con 0x7fab540a9e80 2021-10-20T23:20:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab517fa700 1 -- 172.21.15.12:0/396727638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c001c50 con 0x7fab540a9e80 2021-10-20T23:20:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.476+0000 7fab517fa700 1 -- 172.21.15.12:0/396727638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab3c004920 con 0x7fab540a9e80 2021-10-20T23:20:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.480+0000 7fab517fa700 1 -- 172.21.15.12:0/396727638 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab3c026070 con 0x7fab540a9e80 2021-10-20T23:20:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.480+0000 7fab517fa700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab38053580 0x7fab38055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:21.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.480+0000 7fab517fa700 1 -- 172.21.15.12:0/396727638 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fab3c06c1a0 con 0x7fab540a9e80 2021-10-20T23:20:21.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.480+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab54057350 con 0x7fab540a9e80 2021-10-20T23:20:21.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.480+0000 7fab537fe700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab38053580 0x7fab38055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:21.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.480+0000 7fab537fe700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab38053580 0x7fab38055a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fab4400b000 tx=0x7fab44006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:21.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.488+0000 7fab517fa700 1 -- 172.21.15.12:0/396727638 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab3c043090 con 0x7fab540a9e80 2021-10-20T23:20:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:21.656+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7fab540a7ce0 con 0x7fab540a9e80 2021-10-20T23:20:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.060+0000 7fab517fa700 1 -- 172.21.15.12:0/396727638 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v43) v1 ==== 142+0+0 (secure 0 0 0) 0x7fab3c0466b0 con 0x7fab540a9e80 2021-10-20T23:20:22.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab38053580 msgr2=0x7fab38055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab38053580 0x7fab38055a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fab4400b000 tx=0x7fab44006df0).stop 2021-10-20T23:20:22.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540a9e80 msgr2=0x7fab541568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540a9e80 0x7fab541568a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fab340054d0 tx=0x7fab3c013000).stop 2021-10-20T23:20:22.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 shutdown_connections 2021-10-20T23:20:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab38053580 0x7fab38055a40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab5415a5b0 0x7fab540ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab540a9e80 0x7fab541568a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 --2- 172.21.15.12:0/396727638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab34003c80 0x7fab54067370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 >> 172.21.15.12:0/396727638 conn(0x7fab5405f6b0 msgr2=0x7fab54144930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 shutdown_connections 2021-10-20T23:20:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.064+0000 7fab59a73700 1 -- 172.21.15.12:0/396727638 wait complete. 2021-10-20T23:20:22.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:20:22.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec3852700 1 Processor -- start 2021-10-20T23:20:22.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec3852700 1 -- start start 2021-10-20T23:20:22.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec3852700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc05fc00 0x7fcebc0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec3852700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcebc0b6560 0x7fcebc0b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec3852700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcebc0b5990 0x7fcebc0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec3852700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc143f60 con 0x7fcebc0b6560 2021-10-20T23:20:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec3852700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc05ffe0 con 0x7fcebc0b5990 2021-10-20T23:20:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec3852700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc143a50 con 0x7fcebc05fc00 2021-10-20T23:20:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec0ded700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcebc0b6560 0x7fcebc0b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec0ded700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcebc0b6560 0x7fcebc0b9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37616/0 (socket says 172.21.15.12:37616) 2021-10-20T23:20:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec0ded700 1 -- 172.21.15.12:0/2317094225 learned_addr learned my addr 172.21.15.12:0/2317094225 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec15ee700 1 --2- 172.21.15.12:0/2317094225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc05fc00 0x7fcebc0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec1def700 1 --2- 172.21.15.12:0/2317094225 >> v2:172.21.15.31:3300/0 conn(0x7fcebc0b5990 0x7fcebc0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec0ded700 1 -- 172.21.15.12:0/2317094225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc05fc00 msgr2=0x7fcebc0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:22.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec0ded700 1 --2- 172.21.15.12:0/2317094225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc05fc00 0x7fcebc0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec0ded700 1 -- 172.21.15.12:0/2317094225 >> v2:172.21.15.31:3300/0 conn(0x7fcebc0b5990 msgr2=0x7fcebc0b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:22.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec0ded700 1 --2- 172.21.15.12:0/2317094225 >> v2:172.21.15.31:3300/0 conn(0x7fcebc0b5990 0x7fcebc0b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec0ded700 1 -- 172.21.15.12:0/2317094225 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc143cc0 con 0x7fcebc0b6560 2021-10-20T23:20:22.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec15ee700 1 --2- 172.21.15.12:0/2317094225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc05fc00 0x7fcebc0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:22.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec1def700 1 --2- 172.21.15.12:0/2317094225 >> v2:172.21.15.31:3300/0 conn(0x7fcebc0b5990 0x7fcebc0b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:22.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fcec0ded700 1 --2- 172.21.15.12:0/2317094225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc0b6560 0x7fcebc0b9fa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fceac002f70 tx=0x7fceac006eb0).ready entity=mon.0 client_cookie=f67ab3cb097ca8a4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:22.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fceb3fff700 1 -- 172.21.15.12:0/2317094225 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceac00d570 con 0x7fcebc0b6560 2021-10-20T23:20:22.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fceb3fff700 1 -- 172.21.15.12:0/2317094225 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac000e90 con 0x7fcebc0b6560 2021-10-20T23:20:22.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.200+0000 7fceb3fff700 1 -- 172.21.15.12:0/2317094225 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceac00d900 con 0x7fcebc0b6560 2021-10-20T23:20:22.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- 172.21.15.12:0/2317094225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc0b6560 msgr2=0x7fcebc0b9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 --2- 172.21.15.12:0/2317094225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc0b6560 0x7fcebc0b9fa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fceac002f70 tx=0x7fceac006eb0).stop 2021-10-20T23:20:22.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- 172.21.15.12:0/2317094225 shutdown_connections 2021-10-20T23:20:22.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 --2- 172.21.15.12:0/2317094225 >> v2:172.21.15.31:3300/0 conn(0x7fcebc0b5990 0x7fcebc0b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 --2- 172.21.15.12:0/2317094225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc0b6560 0x7fcebc0b9fa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 --2- 172.21.15.12:0/2317094225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc05fc00 0x7fcebc0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- 172.21.15.12:0/2317094225 >> 172.21.15.12:0/2317094225 conn(0x7fcebc0623a0 msgr2=0x7fcebc066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- 172.21.15.12:0/2317094225 shutdown_connections 2021-10-20T23:20:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- 172.21.15.12:0/2317094225 wait complete. 2021-10-20T23:20:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 Processor -- start 2021-10-20T23:20:22.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- start start 2021-10-20T23:20:22.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc05fc00 0x7fcebc152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcebc0b5990 0x7fcebc152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc0b6560 0x7fcebc155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0ada90 con 0x7fcebc05fc00 2021-10-20T23:20:22.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc153500 con 0x7fcebc0b5990 2021-10-20T23:20:22.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0adcd0 con 0x7fcebc0b6560 2021-10-20T23:20:22.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec15ee700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc05fc00 0x7fcebc152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec15ee700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc05fc00 0x7fcebc152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37620/0 (socket says 172.21.15.12:37620) 2021-10-20T23:20:22.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec15ee700 1 -- 172.21.15.12:0/2369310085 learned_addr learned my addr 172.21.15.12:0/2369310085 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:22.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec0ded700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcebc0b5990 0x7fcebc152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec1def700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc0b6560 0x7fcebc155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec15ee700 1 -- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc0b6560 msgr2=0x7fcebc155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec15ee700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc0b6560 0x7fcebc155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec15ee700 1 -- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcebc0b5990 msgr2=0x7fcebc152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec15ee700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcebc0b5990 0x7fcebc152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec15ee700 1 -- 172.21.15.12:0/2369310085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac00b1e0 con 0x7fcebc05fc00 2021-10-20T23:20:22.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec15ee700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc05fc00 0x7fcebc152650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fceb8006940 tx=0x7fceb8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:22.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fceb27fc700 1 -- 172.21.15.12:0/2369310085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb8011780 con 0x7fcebc05fc00 2021-10-20T23:20:22.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fceb27fc700 1 -- 172.21.15.12:0/2369310085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb80118e0 con 0x7fcebc05fc00 2021-10-20T23:20:22.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc0adf70 con 0x7fcebc05fc00 2021-10-20T23:20:22.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fceb27fc700 1 -- 172.21.15.12:0/2369310085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb8011c40 con 0x7fcebc05fc00 2021-10-20T23:20:22.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.204+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc0b34b0 con 0x7fcebc05fc00 2021-10-20T23:20:22.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.208+0000 7fceb27fc700 1 -- 172.21.15.12:0/2369310085 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fceb8012420 con 0x7fcebc05fc00 2021-10-20T23:20:22.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.208+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc0ae410 con 0x7fcebc05fc00 2021-10-20T23:20:22.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.208+0000 7fceb27fc700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcea4053580 0x7fcea4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.208+0000 7fceb27fc700 1 -- 172.21.15.12:0/2369310085 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fceb806bab0 con 0x7fcebc05fc00 2021-10-20T23:20:22.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.208+0000 7fcec0ded700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcea4053580 0x7fcea4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.208+0000 7fcec0ded700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcea4053580 0x7fcea4055a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fceac01a000 tx=0x7fceac015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:22.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.216+0000 7fceb27fc700 1 -- 172.21.15.12:0/2369310085 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcebc0ae410 con 0x7fcebc05fc00 2021-10-20T23:20:22.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.340+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcebc0ae410 con 0x7fcebc05fc00 2021-10-20T23:20:22.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fceb27fc700 1 -- 172.21.15.12:0/2369310085 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcebc0ae410 con 0x7fcebc05fc00 2021-10-20T23:20:22.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcea4053580 msgr2=0x7fcea4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcea4053580 0x7fcea4055a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fceac01a000 tx=0x7fceac015000).stop 2021-10-20T23:20:22.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc05fc00 msgr2=0x7fcebc152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc05fc00 0x7fcebc152650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fceb8006940 tx=0x7fceb8008040).stop 2021-10-20T23:20:22.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 shutdown_connections 2021-10-20T23:20:22.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcea4053580 0x7fcea4055a40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcebc0b6560 0x7fcebc155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcebc0b5990 0x7fcebc152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 --2- 172.21.15.12:0/2369310085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc05fc00 0x7fcebc152650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 >> 172.21.15.12:0/2369310085 conn(0x7fcebc0623a0 msgr2=0x7fcebc127d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 shutdown_connections 2021-10-20T23:20:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.348+0000 7fcec3852700 1 -- 172.21.15.12:0/2369310085 wait complete. 2021-10-20T23:20:22.365 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:20:22.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:20:22.386 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:20:22.409 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:20:22.430 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:20:22.454 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:20:22.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:22.455 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:22.456 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:22.464 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:20:22.465 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:20:22.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:22.466 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:22.467 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:22.475 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:20:22.476 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:20:22.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:22.477 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:22.478 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:22.485 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-10-20T23:20:22.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:20:22.487 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-10-20T23:20:22.488 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:20:22.488 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:20:22.489 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:22.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:22.572 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:22.573 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:22.580 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:20:22.581 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:20:22.582 INFO:teuthology.orchestra.run:waiting for 900 2021-10-20T23:20:22.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:20:22.583 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:22.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:22.642 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:22.642 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:22.651 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:20:22.652 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:20:22.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:22.652 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:22.653 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:22.660 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:20:22.662 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:20:22.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:22.664 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:22.665 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:22.672 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-10-20T23:20:22.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:20:22.674 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-10-20T23:20:22.674 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:20:22.675 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:20:22.675 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:22.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:22.742 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:22.743 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:22.750 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:20:22.751 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:20:22.751 INFO:teuthology.orchestra.run:waiting for 900 2021-10-20T23:20:22.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:20:22.752 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:20:22.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:20:22.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.872+0000 7f104962d700 1 Processor -- start 2021-10-20T23:20:22.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.872+0000 7f104962d700 1 -- start start 2021-10-20T23:20:22.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1044061320 0x7f1044061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10440aecf0 con 0x7f10440ad5c0 2021-10-20T23:20:22.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10440b6f20 con 0x7f1044140440 2021-10-20T23:20:22.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10440aef20 con 0x7f1044061320 2021-10-20T23:20:22.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f1043fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1044061320 0x7f1044061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f10437fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f10440ad5c0 0x7f10440b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36222/0 (socket says 172.21.15.12:36222) 2021-10-20T23:20:22.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f10437fe700 1 -- 172.21.15.12:0/3023853319 learned_addr learned my addr 172.21.15.12:0/3023853319 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:22.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f1043fff700 1 -- 172.21.15.12:0/3023853319 >> v1:172.21.15.31:6789/0 conn(0x7f1044140440 legacy=0x7f1044146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f1043fff700 1 -- 172.21.15.12:0/3023853319 >> v1:172.21.15.12:6789/0 conn(0x7f10440ad5c0 legacy=0x7f10440b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f1043fff700 1 -- 172.21.15.12:0/3023853319 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10440af1c0 con 0x7f1044061320 2021-10-20T23:20:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f1043fff700 1 --2- 172.21.15.12:0/3023853319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044061320 0x7f1044061700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f10440aeba0 tx=0x7f1038006df0).ready entity=mon.0 client_cookie=cd4522c9b6cc8dca server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:22.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f1042ffd700 1 -- 172.21.15.12:0/3023853319 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f103800d610 con 0x7f1044061320 2021-10-20T23:20:22.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f1042ffd700 1 -- 172.21.15.12:0/3023853319 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1038000e90 con 0x7f1044061320 2021-10-20T23:20:22.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f1042ffd700 1 -- 172.21.15.12:0/3023853319 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f103800d960 con 0x7f1044061320 2021-10-20T23:20:22.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 -- 172.21.15.12:0/3023853319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044061320 msgr2=0x7f1044061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 --2- 172.21.15.12:0/3023853319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044061320 0x7f1044061700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f10440aeba0 tx=0x7f1038006df0).stop 2021-10-20T23:20:22.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 -- 172.21.15.12:0/3023853319 shutdown_connections 2021-10-20T23:20:22.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 --2- 172.21.15.12:0/3023853319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044061320 0x7f1044061700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 -- 172.21.15.12:0/3023853319 >> 172.21.15.12:0/3023853319 conn(0x7f1044066de0 msgr2=0x7f10440671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:22.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 -- 172.21.15.12:0/3023853319 shutdown_connections 2021-10-20T23:20:22.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.876+0000 7f104962d700 1 -- 172.21.15.12:0/3023853319 wait complete. 2021-10-20T23:20:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.880+0000 7f104962d700 1 Processor -- start 2021-10-20T23:20:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.880+0000 7f104962d700 1 -- start start 2021-10-20T23:20:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.880+0000 7f104962d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1044061320 0x7f104413fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.880+0000 7f104962d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10440ad5c0 0x7f1044155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.880+0000 7f104962d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044140440 0x7f1044156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.880+0000 7f104962d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10440a9c10 con 0x7f1044140440 2021-10-20T23:20:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.880+0000 7f104962d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10440a9e40 con 0x7f1044061320 2021-10-20T23:20:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.880+0000 7f104962d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10440ac220 con 0x7f10440ad5c0 2021-10-20T23:20:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1048e2c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044140440 0x7f1044156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f10437fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10440ad5c0 0x7f1044155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1043fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1044061320 0x7f104413fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1048e2c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044140440 0x7f1044156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37638/0 (socket says 172.21.15.12:37638) 2021-10-20T23:20:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f10437fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10440ad5c0 0x7f1044155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:43394/0 (socket says 172.21.15.12:43394) 2021-10-20T23:20:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1043fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1044061320 0x7f104413fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:52608/0 (socket says 172.21.15.12:52608) 2021-10-20T23:20:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f10437fe700 1 -- 172.21.15.12:0/3951120080 learned_addr learned my addr 172.21.15.12:0/3951120080 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:22.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1048e2c700 1 -- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10440ad5c0 msgr2=0x7f1044155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1048e2c700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10440ad5c0 0x7f1044155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1048e2c700 1 -- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1044061320 msgr2=0x7f104413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:22.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1048e2c700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1044061320 0x7f104413fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1048e2c700 1 -- 172.21.15.12:0/3951120080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103800b180 con 0x7f1044140440 2021-10-20T23:20:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f1048e2c700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044140440 0x7f1044156310 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f10440af7e0 tx=0x7f103c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f10417fa700 1 -- 172.21.15.12:0/3951120080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f103c00ce10 con 0x7f1044140440 2021-10-20T23:20:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f10417fa700 1 -- 172.21.15.12:0/3951120080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c006aa0 con 0x7f1044140440 2021-10-20T23:20:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f10417fa700 1 -- 172.21.15.12:0/3951120080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f103c006e00 con 0x7f1044140440 2021-10-20T23:20:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10441524d0 con 0x7f1044140440 2021-10-20T23:20:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10440acc20 con 0x7f1044140440 2021-10-20T23:20:22.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10440af460 con 0x7f1044140440 2021-10-20T23:20:22.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.884+0000 7f10417fa700 1 -- 172.21.15.12:0/3951120080 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f103c010030 con 0x7f1044140440 2021-10-20T23:20:22.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.888+0000 7f10417fa700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1024053520 0x7f10240559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:22.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.888+0000 7f10417fa700 1 -- 172.21.15.12:0/3951120080 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f103c06b8d0 con 0x7f1044140440 2021-10-20T23:20:22.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.888+0000 7f1043fff700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1024053520 0x7f10240559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:22.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.888+0000 7f1043fff700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1024053520 0x7f10240559e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f103801c000 tx=0x7f1038015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:22.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:22.892+0000 7f10417fa700 1 -- 172.21.15.12:0/3951120080 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f103c042760 con 0x7f1044140440 2021-10-20T23:20:23.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.020+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1044057350 con 0x7f1044140440 2021-10-20T23:20:23.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.020+0000 7f10417fa700 1 -- 172.21.15.12:0/3951120080 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+34065 (secure 0 0 0) 0x7f103c045d80 con 0x7f1044140440 2021-10-20T23:20:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:23.026 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:20:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 25, 2021-10-20T23:20:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:20:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:20:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:19:56.508005+0000", 2021-10-20T23:20:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:20:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:20:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:20:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:20:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:20:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:20:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:20:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:20:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:20:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:20:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:20:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:20:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:20:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:20:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:20:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 4, 2021-10-20T23:20:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:20:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:20:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:20:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:20:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:20:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:20:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:20:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:20:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:20:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:20:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:20:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:20:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:20:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:20:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:20:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:20:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:20:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:20:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:20:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:20:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:20:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:20:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:20:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:20:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:20:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:20:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:20:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:20:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:20:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:20:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:20:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:20:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:20:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:20:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:20:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:20:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:20:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:20:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:20:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:20:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:20:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:20:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:20:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:20:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:20:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:20:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:20:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:20:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:20:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:20:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:20:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:20:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:20:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:20:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:20:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:20:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:20:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:20:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:20:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:20:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:20:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:20:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:20:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:20:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:20:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:20:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:20:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:20:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:20:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:20:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:20:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:20:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:20:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:20:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:20:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:20:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:20:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:20:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:20:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:20:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:20:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:20:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:20:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:20:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:20:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:20:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:20:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:20:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:20:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:20:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:20:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:20:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:20:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:20:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:20:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:20:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:20:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:20:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:20:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:20:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:20:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:20:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:20:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:20:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:20:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:20:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:20:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:20:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:20:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:20:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:20:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:20:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:20:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:20:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:20:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:20:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:20:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:20:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:20:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:20:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:20:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:20:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:20:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:20:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:20:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:20:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:20:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:20:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:20:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:20:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:20:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:20:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:20:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:20:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2021-10-20T23:20:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:20:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:51.434642+0000", 2021-10-20T23:20:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:20:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:20:23.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:20:23.068 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:20:23.068 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:20:23.068 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:20:23.068 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:20:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:20:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:20:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:20:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:20:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:20:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:20:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:20:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:20:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:20:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:20:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:20:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:20:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:20:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "25", 2021-10-20T23:20:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:20:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:20:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:20:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:20:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:20:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:20:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:20:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:20:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:20:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:20:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:20:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:20:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:20:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:20:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:20:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:20:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:20:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:20:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:20:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:20:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:20:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:20:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:20:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:20:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:20:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:20:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:20:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:20:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:20:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:20:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:20:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:20:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:20:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:20:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:20:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:20:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:20:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:20:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:20:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:20:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:20:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:20:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:20:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:20:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 4, 2021-10-20T23:20:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:20:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:54.214563+0000", 2021-10-20T23:20:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 5, 2021-10-20T23:20:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,ec_overwrites", 2021-10-20T23:20:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 3, 2021-10-20T23:20:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 4, 2021-10-20T23:20:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 3, 2021-10-20T23:20:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 1, 2021-10-20T23:20:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:20:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:20:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:20:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:20:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:20:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:20:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:20:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:20:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:20:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:20:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:20:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:20:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:20:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:20:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "25", 2021-10-20T23:20:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:20:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:20:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:20:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:20:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:20:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:20:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:20:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:20:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:20:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:20:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:20:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:20:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:20:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:20:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:20:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:20:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:20:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:20:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:20:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:20:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:20:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:20:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:20:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "cephfs_data", 2021-10-20T23:20:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:20:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:20:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:20:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:20:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:20:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:20:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:20:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:20:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:20:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:20:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 8192, 2021-10-20T23:20:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:20:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:20:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:20:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:20:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:20:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:20:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:20:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:20:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:20:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:20:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:20:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:20:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:20:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:20:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:20:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:20:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:20:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 23, 2021-10-20T23:20:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:20:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:20:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:20:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:20:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:20:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:20:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:20:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:20:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:20:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:20:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:20:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:20:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:20:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:20:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:20:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:20:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:20:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:20:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:20:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:20:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:20:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:20:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:20:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:20:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:20:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:20:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:20:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:20:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:20:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:20:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:20:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:20:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:20:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:20:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:20:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:20:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:20:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:20:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 23, 2021-10-20T23:20:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:20:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:20:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:20:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:20:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:20:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:20:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:20:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:20:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:20:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:20:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:20:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:20:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:20:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:20:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:20:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:20:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:20:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:20:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:20:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:20:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:20:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:20:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:20:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:20:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:20:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:20:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:20:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:20:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:20:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:20:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:20:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:20:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:20:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:20:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:20:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:20:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:20:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:20:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 17, 2021-10-20T23:20:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:20:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:20:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:20:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:20:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:20:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:20:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:20:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:20:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:20:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:20:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:20:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:20:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:20:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:20:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:20:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:20:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:20:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:20:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:20:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:20:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:20:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:20:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:20:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:20:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:20:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:20:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:20:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:20:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:20:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:20:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:20:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:20:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:20:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:20:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:20:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:20:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:20:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:20:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 23, 2021-10-20T23:20:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:20:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:20:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:20:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:20:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:20:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:20:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:20:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:20:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:20:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:20:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:20:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:20:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:20:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:20:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:20:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:20:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:20:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:20:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:20:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:20:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:20:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:20:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:20:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:20:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:20:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:20:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:20:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:20:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:20:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:20:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:20:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:20:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:20:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:20:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:20:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:20:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:20:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:20:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 23, 2021-10-20T23:20:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:20:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:20:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:20:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:20:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:20:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:20:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:20:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:20:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:20:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:20:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:20:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:20:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:20:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:20:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:20:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:20:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:20:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:20:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:20:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:20:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:20:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:20:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:20:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:20:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:20:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:20:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:20:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:20:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:20:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:20:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:20:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:20:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:20:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:20:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:20:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:20:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:20:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:20:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 20, 2021-10-20T23:20:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:20:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:20:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:20:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:20:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:20:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:20:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:20:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:20:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:20:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:20:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:20:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:20:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:20:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:20:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:20:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:20:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:20:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:20:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:20:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:20:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:20:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:20:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:20:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:20:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:20:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:20:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:20:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:20:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:20:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:20:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:20:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:20:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:20:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:20:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:20:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:20:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:20:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:20:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 23, 2021-10-20T23:20:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:20:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:20:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:20:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:20:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:20:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:20:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:20:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:20:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:20:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:20:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:20:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:20:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:20:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:20:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:20:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:20:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:20:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:20:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:20:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:20:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:20:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:20:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:20:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:20:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:20:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:20:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:20:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:20:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:20:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:20:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:20:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:20:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:20:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:20:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:20:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:20:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:20:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:20:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 17, 2021-10-20T23:20:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:20:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:20:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:20:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:20:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:20:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:20:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:20:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:20:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:20:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:20:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:20:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:20:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:20:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:20:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:20:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:20:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:20:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:20:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:20:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:20:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:20:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:20:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:20:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:20:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:20:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:20:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:20:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:20:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:20:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:20:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:20:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:20:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:20:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:20:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:20:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:20:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:20:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:20:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:20:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:20:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:20:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:20:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:20:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:20:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:20:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:20:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:20:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:20:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:20:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:20:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:20:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:20:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:20:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:20:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:20:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:20:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:20:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:20:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:20:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:20:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:20:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:20:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:20:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:20:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:20:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:20:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:20:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:20:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:20:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:20:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:20:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:20:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:20:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:20:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:20:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:20:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:20:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:20:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:20:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:20:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:20:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:20:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:20:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:20:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:20:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:20:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:20:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:20:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:20:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:20:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:20:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:20:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:20:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:20:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:20:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:20:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:20:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:20:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:20:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:20:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:20:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:20:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:20:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:20:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:20:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:20:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:20:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:20:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:20:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:20:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:20:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:20:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:20:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:20:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:20:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:20:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:20:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:20:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:20:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:20:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:20:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:20:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:20:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:20:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:20:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:20:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:20:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:20:23.290 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:20:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.020+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1024053520 msgr2=0x7f10240559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.020+0000 7f104962d700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1024053520 0x7f10240559e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f103801c000 tx=0x7f1038015000).stop 2021-10-20T23:20:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.020+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044140440 msgr2=0x7f1044156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.024+0000 7f104962d700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044140440 0x7f1044156310 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f10440af7e0 tx=0x7f103c007f10).stop 2021-10-20T23:20:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.024+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 shutdown_connections 2021-10-20T23:20:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.024+0000 7f104962d700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1024053520 0x7f10240559e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.024+0000 7f104962d700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044140440 0x7f1044156310 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.024+0000 7f104962d700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10440ad5c0 0x7f1044155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.024+0000 7f104962d700 1 --2- 172.21.15.12:0/3951120080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1044061320 0x7f104413fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.024+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 >> 172.21.15.12:0/3951120080 conn(0x7f1044066de0 msgr2=0x7f10440b8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.024+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 shutdown_connections 2021-10-20T23:20:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.024+0000 7f104962d700 1 -- 172.21.15.12:0/3951120080 wait complete. 2021-10-20T23:20:23.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:23.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.404+0000 7f9a88eb8700 1 Processor -- start 2021-10-20T23:20:23.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.404+0000 7f9a88eb8700 1 -- start start 2021-10-20T23:20:23.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.404+0000 7f9a88eb8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9a840b4060 0x7f9a84061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.404+0000 7f9a88eb8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a840b5f50 con 0x7f9a84142e60 2021-10-20T23:20:23.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.404+0000 7f9a88eb8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a840b1f70 con 0x7f9a840b6290 2021-10-20T23:20:23.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.404+0000 7f9a88eb8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a840b2210 con 0x7f9a840b4060 2021-10-20T23:20:23.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.404+0000 7f9a82ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9a840b4060 0x7f9a84061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a83fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9a84142e60 0x7f9a841432f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36240/0 (socket says 172.21.15.12:36240) 2021-10-20T23:20:23.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a83fff700 1 -- 172.21.15.12:0/2376234355 learned_addr learned my addr 172.21.15.12:0/2376234355 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:23.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a82ffd700 1 -- 172.21.15.12:0/2376234355 >> v1:172.21.15.31:6789/0 conn(0x7f9a840b6290 legacy=0x7f9a84061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a82ffd700 1 -- 172.21.15.12:0/2376234355 >> v1:172.21.15.12:6789/0 conn(0x7f9a84142e60 legacy=0x7f9a841432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a827fc700 1 -- 172.21.15.12:0/2376234355 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5113792 0 0) 0x7f9a7c001110 con 0x7f9a84142e60 2021-10-20T23:20:23.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a82ffd700 1 -- 172.21.15.12:0/2376234355 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a840b24b0 con 0x7f9a840b4060 2021-10-20T23:20:23.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a82ffd700 1 --2- 172.21.15.12:0/2376234355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 0x7f9a84061b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f9a6c002f70 tx=0x7f9a6c006df0).ready entity=mon.0 client_cookie=513ea0780839249f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:23.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a827fc700 1 -- 172.21.15.12:0/2376234355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a6c00d610 con 0x7f9a840b4060 2021-10-20T23:20:23.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a827fc700 1 -- 172.21.15.12:0/2376234355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c000e90 con 0x7f9a840b4060 2021-10-20T23:20:23.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a827fc700 1 -- 172.21.15.12:0/2376234355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a6c00d960 con 0x7f9a840b4060 2021-10-20T23:20:23.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a88eb8700 1 -- 172.21.15.12:0/2376234355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 msgr2=0x7f9a84061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a88eb8700 1 --2- 172.21.15.12:0/2376234355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 0x7f9a84061b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f9a6c002f70 tx=0x7f9a6c006df0).stop 2021-10-20T23:20:23.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a88eb8700 1 -- 172.21.15.12:0/2376234355 shutdown_connections 2021-10-20T23:20:23.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a88eb8700 1 --2- 172.21.15.12:0/2376234355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 0x7f9a84061b80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a88eb8700 1 -- 172.21.15.12:0/2376234355 >> 172.21.15.12:0/2376234355 conn(0x7f9a8405c490 msgr2=0x7f9a8405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:23.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a88eb8700 1 -- 172.21.15.12:0/2376234355 shutdown_connections 2021-10-20T23:20:23.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.408+0000 7f9a88eb8700 1 -- 172.21.15.12:0/2376234355 wait complete. 2021-10-20T23:20:23.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a88eb8700 1 Processor -- start 2021-10-20T23:20:23.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a88eb8700 1 -- start start 2021-10-20T23:20:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a88eb8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 0x7f9a840b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a88eb8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a840b6290 0x7f9a8412acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a88eb8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a84142e60 0x7f9a8412b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a88eb8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8413f070 con 0x7f9a840b4060 2021-10-20T23:20:23.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a88eb8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840afef0 con 0x7f9a84142e60 2021-10-20T23:20:23.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a88eb8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840b0190 con 0x7f9a840b6290 2021-10-20T23:20:23.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 0x7f9a840b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 0x7f9a840b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37648/0 (socket says 172.21.15.12:37648) 2021-10-20T23:20:23.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a837fe700 1 -- 172.21.15.12:0/1808626750 learned_addr learned my addr 172.21.15.12:0/1808626750 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:23.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a83fff700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a84142e60 0x7f9a8412b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a82ffd700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a840b6290 0x7f9a8412acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a837fe700 1 -- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a840b6290 msgr2=0x7f9a8412acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a837fe700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a840b6290 0x7f9a8412acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a837fe700 1 -- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a84142e60 msgr2=0x7f9a8412b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a837fe700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a84142e60 0x7f9a8412b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a837fe700 1 -- 172.21.15.12:0/1808626750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c00b180 con 0x7f9a840b4060 2021-10-20T23:20:23.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.412+0000 7f9a837fe700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 0x7f9a840b3750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9a84060190 tx=0x7f9a740014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:23.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a80ff9700 1 -- 172.21.15.12:0/1808626750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a7400e4a0 con 0x7f9a840b4060 2021-10-20T23:20:23.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a80ff9700 1 -- 172.21.15.12:0/1808626750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7400e600 con 0x7f9a840b4060 2021-10-20T23:20:23.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a840b0430 con 0x7f9a840b4060 2021-10-20T23:20:23.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a80ff9700 1 -- 172.21.15.12:0/1808626750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a7400e960 con 0x7f9a840b4060 2021-10-20T23:20:23.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a840b0970 con 0x7f9a840b4060 2021-10-20T23:20:23.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a840b2750 con 0x7f9a840b4060 2021-10-20T23:20:23.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a80ff9700 1 -- 172.21.15.12:0/1808626750 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9a74019030 con 0x7f9a840b4060 2021-10-20T23:20:23.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a80ff9700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9a68053610 0x7f9a68055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a80ff9700 1 -- 172.21.15.12:0/1808626750 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9a7406b180 con 0x7f9a840b4060 2021-10-20T23:20:23.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.416+0000 7f9a82ffd700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9a68053610 0x7f9a68055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.420+0000 7f9a82ffd700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9a68053610 0x7f9a68055ad0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9a6c01c000 tx=0x7f9a6c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:23.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.420+0000 7f9a80ff9700 1 -- 172.21.15.12:0/1808626750 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9a74042180 con 0x7f9a840b4060 2021-10-20T23:20:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.588+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a84057350 con 0x7f9a840b4060 2021-10-20T23:20:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.588+0000 7f9a80ff9700 1 -- 172.21.15.12:0/1808626750 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f9a740457a0 con 0x7f9a840b4060 2021-10-20T23:20:23.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:23.594 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1996246041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1996246041},{"type":"v1","addr":"172.21.15.31:6835","nonce":1996246041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/2770105392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2770105392},{"type":"v1","addr":"172.21.15.12:6833","nonce":2770105392}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:19:56.508295+0000","modified":"2021-10-20T23:19:58.195517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/2162960241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2162960241},{"type":"v1","addr":"172.21.15.12:6835","nonce":2162960241}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-20T23:20:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9a68053610 msgr2=0x7f9a68055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9a68053610 0x7f9a68055ad0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9a6c01c000 tx=0x7f9a6c015000).stop 2021-10-20T23:20:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 msgr2=0x7f9a840b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 0x7f9a840b3750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9a84060190 tx=0x7f9a740014a0).stop 2021-10-20T23:20:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 shutdown_connections 2021-10-20T23:20:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9a68053610 0x7f9a68055ad0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a84142e60 0x7f9a8412b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a840b6290 0x7f9a8412acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 --2- 172.21.15.12:0/1808626750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a840b4060 0x7f9a840b3750 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 >> 172.21.15.12:0/1808626750 conn(0x7f9a8405c490 msgr2=0x7f9a840b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 shutdown_connections 2021-10-20T23:20:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.592+0000 7f9a88eb8700 1 -- 172.21.15.12:0/1808626750 wait complete. 2021-10-20T23:20:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2021-10-20T23:20:23.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:20:23.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcc4b06700 1 Processor -- start 2021-10-20T23:20:23.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcc4b06700 1 -- start start 2021-10-20T23:20:23.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcc4b06700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00af780 0x7efcc0143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcc4b06700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efcc00a9f40 0x7efcc0140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcc4b06700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc00b3880 con 0x7efcc00b34a0 2021-10-20T23:20:23.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcc4b06700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc0144260 con 0x7efcc00a9f40 2021-10-20T23:20:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcc4b06700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01469b0 con 0x7efcc00af780 2021-10-20T23:20:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcbed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efcc00a9f40 0x7efcc0140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcbed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efcc00a9f40 0x7efcc0140110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37660/0 (socket says 172.21.15.12:37660) 2021-10-20T23:20:23.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.712+0000 7efcbed9d700 1 -- 172.21.15.12:0/4004957024 learned_addr learned my addr 172.21.15.12:0/4004957024 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:23.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcbdd9b700 1 --2- 172.21.15.12:0/4004957024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00af780 0x7efcc0143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcbed9d700 1 -- 172.21.15.12:0/4004957024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00af780 msgr2=0x7efcc0143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcbed9d700 1 --2- 172.21.15.12:0/4004957024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00af780 0x7efcc0143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcbed9d700 1 -- 172.21.15.12:0/4004957024 >> v1:172.21.15.31:6789/0 conn(0x7efcc00b34a0 legacy=0x7efcc00af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcbed9d700 1 -- 172.21.15.12:0/4004957024 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0146c50 con 0x7efcc00a9f40 2021-10-20T23:20:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcbed9d700 1 --2- 172.21.15.12:0/4004957024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00a9f40 0x7efcc0140110 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7efcb80032f0 tx=0x7efcb8009290).ready entity=mon.0 client_cookie=ede764752d4eaefc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:23.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcbd59a700 1 -- 172.21.15.12:0/4004957024 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcb800b8a0 con 0x7efcc00a9f40 2021-10-20T23:20:23.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcbd59a700 1 -- 172.21.15.12:0/4004957024 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb800ba00 con 0x7efcc00a9f40 2021-10-20T23:20:23.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcbd59a700 1 -- 172.21.15.12:0/4004957024 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcb800bb70 con 0x7efcc00a9f40 2021-10-20T23:20:23.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 -- 172.21.15.12:0/4004957024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00a9f40 msgr2=0x7efcc0140110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 --2- 172.21.15.12:0/4004957024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00a9f40 0x7efcc0140110 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7efcb80032f0 tx=0x7efcb8009290).stop 2021-10-20T23:20:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 -- 172.21.15.12:0/4004957024 shutdown_connections 2021-10-20T23:20:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 --2- 172.21.15.12:0/4004957024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00a9f40 0x7efcc0140110 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 --2- 172.21.15.12:0/4004957024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00af780 0x7efcc0143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 -- 172.21.15.12:0/4004957024 >> 172.21.15.12:0/4004957024 conn(0x7efcc00607c0 msgr2=0x7efcc0060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 -- 172.21.15.12:0/4004957024 shutdown_connections 2021-10-20T23:20:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 -- 172.21.15.12:0/4004957024 wait complete. 2021-10-20T23:20:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 Processor -- start 2021-10-20T23:20:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.716+0000 7efcc4b06700 1 -- start start 2021-10-20T23:20:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcc4b06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc00a9f40 0x7efcc01455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcc4b06700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00af780 0x7efcc0144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcc4b06700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00b34a0 0x7efcc0153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcc4b06700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01483b0 con 0x7efcc00af780 2021-10-20T23:20:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcc4b06700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc0148650 con 0x7efcc00a9f40 2021-10-20T23:20:23.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcc4b06700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc0152900 con 0x7efcc00b34a0 2021-10-20T23:20:23.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00af780 0x7efcc0144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00af780 0x7efcc0144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37664/0 (socket says 172.21.15.12:37664) 2021-10-20T23:20:23.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbdd9b700 1 -- 172.21.15.12:0/3118014926 learned_addr learned my addr 172.21.15.12:0/3118014926 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:23.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbed9d700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00b34a0 0x7efcc0153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbe59c700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc00a9f40 0x7efcc01455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbdd9b700 1 -- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00b34a0 msgr2=0x7efcc0153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbdd9b700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00b34a0 0x7efcc0153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbdd9b700 1 -- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc00a9f40 msgr2=0x7efcc01455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:23.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbdd9b700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc00a9f40 0x7efcc01455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:23.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbdd9b700 1 -- 172.21.15.12:0/3118014926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb8009530 con 0x7efcc00af780 2021-10-20T23:20:23.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbe59c700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc00a9f40 0x7efcc01455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:23.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcbdd9b700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00af780 0x7efcc0144e50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7efca800c000 tx=0x7efca8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:23.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcb77fe700 1 -- 172.21.15.12:0/3118014926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca8010780 con 0x7efcc00af780 2021-10-20T23:20:23.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcb77fe700 1 -- 172.21.15.12:0/3118014926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca80108e0 con 0x7efcc00af780 2021-10-20T23:20:23.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc0152ba0 con 0x7efcc00af780 2021-10-20T23:20:23.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcb77fe700 1 -- 172.21.15.12:0/3118014926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca8010c40 con 0x7efcc00af780 2021-10-20T23:20:23.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc0144940 con 0x7efcc00af780 2021-10-20T23:20:23.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.720+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc0146ef0 con 0x7efcc00af780 2021-10-20T23:20:23.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.724+0000 7efcb77fe700 1 -- 172.21.15.12:0/3118014926 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efca801c460 con 0x7efcc00af780 2021-10-20T23:20:23.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.724+0000 7efcb77fe700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efca40536a0 0x7efca4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:23.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.724+0000 7efcb77fe700 1 -- 172.21.15.12:0/3118014926 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efca806be10 con 0x7efcc00af780 2021-10-20T23:20:23.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.724+0000 7efcbe59c700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efca40536a0 0x7efca4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:23.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.724+0000 7efcbe59c700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efca40536a0 0x7efca4055b60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7efcb000b000 tx=0x7efcb0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:23.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.728+0000 7efcb77fe700 1 -- 172.21.15.12:0/3118014926 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efca8042db0 con 0x7efcc00af780 2021-10-20T23:20:23.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:23.892+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efcc0057350 con 0x7efcc00af780 2021-10-20T23:20:24.063 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:20:24.060+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:20:24.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.076+0000 7efcb77fe700 1 -- 172.21.15.12:0/3118014926 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7efca80463d0 con 0x7efcc00af780 2021-10-20T23:20:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efca40536a0 msgr2=0x7efca4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efca40536a0 0x7efca4055b60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7efcb000b000 tx=0x7efcb0009040).stop 2021-10-20T23:20:24.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00af780 msgr2=0x7efcc0144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00af780 0x7efcc0144e50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7efca800c000 tx=0x7efca8006df0).stop 2021-10-20T23:20:24.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 shutdown_connections 2021-10-20T23:20:24.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efca40536a0 0x7efca4055b60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcc00b34a0 0x7efcc0153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcc00af780 0x7efcc0144e50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 --2- 172.21.15.12:0/3118014926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc00a9f40 0x7efcc01455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 >> 172.21.15.12:0/3118014926 conn(0x7efcc00607c0 msgr2=0x7efcc01409c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 shutdown_connections 2021-10-20T23:20:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.080+0000 7efcc4b06700 1 -- 172.21.15.12:0/3118014926 wait complete. 2021-10-20T23:20:24.091 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:20:24.102 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:24.106 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:20:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 Processor -- start 2021-10-20T23:20:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 -- start start 2021-10-20T23:20:24.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f64b80b6580 0x7f64b80b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 0x7f64b80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b81440b0 con 0x7f64b8061d30 2021-10-20T23:20:24.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b80b6e50 con 0x7f64b80b6580 2021-10-20T23:20:24.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b8143b70 con 0x7f64b80b43c0 2021-10-20T23:20:24.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64bce1a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f64b8061d30 0x7f64b81466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36280/0 (socket says 172.21.15.12:36280) 2021-10-20T23:20:24.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64bce1a700 1 -- 172.21.15.12:0/1266595156 learned_addr learned my addr 172.21.15.12:0/1266595156 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:24.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f64b80b6580 0x7f64b80b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b77fe700 1 --2- 172.21.15.12:0/1266595156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 0x7f64b80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b6ffd700 1 -- 172.21.15.12:0/1266595156 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706215984 0 0) 0x7f64b81440b0 con 0x7f64b8061d30 2021-10-20T23:20:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b6ffd700 1 -- 172.21.15.12:0/1266595156 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f649c003260 con 0x7f64b8061d30 2021-10-20T23:20:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b7fff700 1 -- 172.21.15.12:0/1266595156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 msgr2=0x7f64b80b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b7fff700 1 --2- 172.21.15.12:0/1266595156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 0x7f64b80b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b7fff700 1 -- 172.21.15.12:0/1266595156 >> v1:172.21.15.12:6789/0 conn(0x7f64b8061d30 legacy=0x7f64b81466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b7fff700 1 -- 172.21.15.12:0/1266595156 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8143e10 con 0x7f64b80b6580 2021-10-20T23:20:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b7fff700 1 --2- 172.21.15.12:0/1266595156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 0x7f64b80b5bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f64a0002f70 tx=0x7f64a0006df0).ready entity=mon.0 client_cookie=33b7f446152d2695 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b6ffd700 1 -- 172.21.15.12:0/1266595156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a000d4a0 con 0x7f64b80b6580 2021-10-20T23:20:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b6ffd700 1 -- 172.21.15.12:0/1266595156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a0000e90 con 0x7f64b80b6580 2021-10-20T23:20:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64b6ffd700 1 -- 172.21.15.12:0/1266595156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a000d7f0 con 0x7f64b80b6580 2021-10-20T23:20:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 -- 172.21.15.12:0/1266595156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 msgr2=0x7f64b80b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 --2- 172.21.15.12:0/1266595156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 0x7f64b80b5bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f64a0002f70 tx=0x7f64a0006df0).stop 2021-10-20T23:20:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 -- 172.21.15.12:0/1266595156 shutdown_connections 2021-10-20T23:20:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 --2- 172.21.15.12:0/1266595156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 0x7f64b80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 --2- 172.21.15.12:0/1266595156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 0x7f64b80b5bf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 -- 172.21.15.12:0/1266595156 >> 172.21.15.12:0/1266595156 conn(0x7f64b805c490 msgr2=0x7f64b805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 -- 172.21.15.12:0/1266595156 shutdown_connections 2021-10-20T23:20:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.200+0000 7f64be87d700 1 -- 172.21.15.12:0/1266595156 wait complete. 2021-10-20T23:20:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64be87d700 1 Processor -- start 2021-10-20T23:20:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64be87d700 1 -- start start 2021-10-20T23:20:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64be87d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64b8061d30 0x7f64b80b9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64be87d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 0x7f64b8152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64be87d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 0x7f64b8152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64be87d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80b37f0 con 0x7f64b80b6580 2021-10-20T23:20:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64be87d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80b8540 con 0x7f64b8061d30 2021-10-20T23:20:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64be87d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80b3550 con 0x7f64b80b43c0 2021-10-20T23:20:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64bce1a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 0x7f64b8152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64b7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64b8061d30 0x7f64b80b9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64bce1a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 0x7f64b8152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37692/0 (socket says 172.21.15.12:37692) 2021-10-20T23:20:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64bce1a700 1 -- 172.21.15.12:0/1569551749 learned_addr learned my addr 172.21.15.12:0/1569551749 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64b77fe700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 0x7f64b8152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64bce1a700 1 -- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 msgr2=0x7f64b8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64bce1a700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 0x7f64b8152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64bce1a700 1 -- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64b8061d30 msgr2=0x7f64b80b9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64bce1a700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64b8061d30 0x7f64b80b9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64bce1a700 1 -- 172.21.15.12:0/1569551749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a000b180 con 0x7f64b80b6580 2021-10-20T23:20:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64bce1a700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 0x7f64b8152610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f64a8001110 tx=0x7f64a8007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64b57fa700 1 -- 172.21.15.12:0/1569551749 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a800ce80 con 0x7f64b80b6580 2021-10-20T23:20:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64b57fa700 1 -- 172.21.15.12:0/1569551749 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a80070d0 con 0x7f64b80b6580 2021-10-20T23:20:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64b57fa700 1 -- 172.21.15.12:0/1569551749 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a8007430 con 0x7f64b80b6580 2021-10-20T23:20:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.204+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b80b1d70 con 0x7f64b80b6580 2021-10-20T23:20:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.208+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b80b7410 con 0x7f64b80b6580 2021-10-20T23:20:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.208+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b80615f0 con 0x7f64b80b6580 2021-10-20T23:20:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.208+0000 7f64b57fa700 1 -- 172.21.15.12:0/1569551749 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f64a8010070 con 0x7f64b80b6580 2021-10-20T23:20:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.208+0000 7f64b57fa700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6490053610 0x7f6490055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.208+0000 7f64b57fa700 1 -- 172.21.15.12:0/1569551749 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f64a806afc0 con 0x7f64b80b6580 2021-10-20T23:20:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.208+0000 7f64b7fff700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6490053610 0x7f6490055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.208+0000 7f64b7fff700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6490053610 0x7f6490055ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f64a001a000 tx=0x7f64a0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.212+0000 7f64b57fa700 1 -- 172.21.15.12:0/1569551749 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64a8041f00 con 0x7f64b80b6580 2021-10-20T23:20:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64b8057350 con 0x7f64b80b6580 2021-10-20T23:20:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64b57fa700 1 -- 172.21.15.12:0/1569551749 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2126 (secure 0 0 0) 0x7f64a8018030 con 0x7f64b80b6580 2021-10-20T23:20:24.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:24.385 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1996246041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1996246041},{"type":"v1","addr":"172.21.15.31:6835","nonce":1996246041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/2770105392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2770105392},{"type":"v1","addr":"172.21.15.12:6833","nonce":2770105392}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:19:56.508295+0000","modified":"2021-10-20T23:20:24.064452+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-20T23:20:24.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6490053610 msgr2=0x7f6490055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6490053610 0x7f6490055ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f64a001a000 tx=0x7f64a0014000).stop 2021-10-20T23:20:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 msgr2=0x7f64b8152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 0x7f64b8152610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f64a8001110 tx=0x7f64a8007a20).stop 2021-10-20T23:20:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 shutdown_connections 2021-10-20T23:20:24.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6490053610 0x7f6490055ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64b80b6580 0x7f64b8152610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b80b43c0 0x7f64b8152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 --2- 172.21.15.12:0/1569551749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64b8061d30 0x7f64b80b9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 >> 172.21.15.12:0/1569551749 conn(0x7f64b805c490 msgr2=0x7f64b8127060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:24.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 shutdown_connections 2021-10-20T23:20:24.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.380+0000 7f64be87d700 1 -- 172.21.15.12:0/1569551749 wait complete. 2021-10-20T23:20:24.392 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2021-10-20T23:20:24.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:20:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.496+0000 7fdd75885700 1 Processor -- start 2021-10-20T23:20:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.496+0000 7fdd75885700 1 -- start start 2021-10-20T23:20:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.496+0000 7fdd75885700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd700b2580 0x7fdd7014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.496+0000 7fdd75885700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 0x7fdd7014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.496+0000 7fdd75885700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd700afbd0 0x7fdd700a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.496+0000 7fdd75885700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd700a70c0 con 0x7fdd700b2580 2021-10-20T23:20:24.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.496+0000 7fdd75885700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd700a72f0 con 0x7fdd700afbd0 2021-10-20T23:20:24.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.496+0000 7fdd75885700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700a7590 con 0x7fdd700b0010 2021-10-20T23:20:24.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd74883700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd700b2580 0x7fdd7014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd74883700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd700b2580 0x7fdd7014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37698/0 (socket says 172.21.15.12:37698) 2021-10-20T23:20:24.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75084700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd700afbd0 0x7fdd700a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd74883700 1 -- 172.21.15.12:0/2082320392 learned_addr learned my addr 172.21.15.12:0/2082320392 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:24.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd67fff700 1 --2- 172.21.15.12:0/2082320392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 0x7fdd7014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75084700 1 -- 172.21.15.12:0/2082320392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 msgr2=0x7fdd7014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:24.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75084700 1 --2- 172.21.15.12:0/2082320392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 0x7fdd7014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75084700 1 -- 172.21.15.12:0/2082320392 >> v2:172.21.15.12:3300/0 conn(0x7fdd700b2580 msgr2=0x7fdd7014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:24.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75084700 1 --2- 172.21.15.12:0/2082320392 >> v2:172.21.15.12:3300/0 conn(0x7fdd700b2580 0x7fdd7014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75084700 1 -- 172.21.15.12:0/2082320392 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700a7830 con 0x7fdd700afbd0 2021-10-20T23:20:24.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75084700 1 --2- 172.21.15.12:0/2082320392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700afbd0 0x7fdd700a83b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fdd680032f0 tx=0x7fdd680091d0).ready entity=mon.1 client_cookie=65067ccb05bda38d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:24.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd677fe700 1 -- 172.21.15.12:0/2082320392 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6800b600 con 0x7fdd700afbd0 2021-10-20T23:20:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd677fe700 1 -- 172.21.15.12:0/2082320392 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6800b760 con 0x7fdd700afbd0 2021-10-20T23:20:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd677fe700 1 -- 172.21.15.12:0/2082320392 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6800b8d0 con 0x7fdd700afbd0 2021-10-20T23:20:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 -- 172.21.15.12:0/2082320392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700afbd0 msgr2=0x7fdd700a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 --2- 172.21.15.12:0/2082320392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700afbd0 0x7fdd700a83b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fdd680032f0 tx=0x7fdd680091d0).stop 2021-10-20T23:20:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 -- 172.21.15.12:0/2082320392 shutdown_connections 2021-10-20T23:20:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 --2- 172.21.15.12:0/2082320392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700afbd0 0x7fdd700a83b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 --2- 172.21.15.12:0/2082320392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 0x7fdd7014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 --2- 172.21.15.12:0/2082320392 >> v2:172.21.15.12:3300/0 conn(0x7fdd700b2580 0x7fdd7014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 -- 172.21.15.12:0/2082320392 >> 172.21.15.12:0/2082320392 conn(0x7fdd70060180 msgr2=0x7fdd700b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 -- 172.21.15.12:0/2082320392 shutdown_connections 2021-10-20T23:20:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 -- 172.21.15.12:0/2082320392 wait complete. 2021-10-20T23:20:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 Processor -- start 2021-10-20T23:20:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.500+0000 7fdd75885700 1 -- start start 2021-10-20T23:20:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75885700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd700afbd0 0x7fdd700b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75885700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 0x7fdd70149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75885700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700b2580 0x7fdd700aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75885700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700a9fb0 con 0x7fdd700afbd0 2021-10-20T23:20:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75885700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700b4360 con 0x7fdd700b2580 2021-10-20T23:20:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75885700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700aa1e0 con 0x7fdd700b0010 2021-10-20T23:20:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd74883700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd700afbd0 0x7fdd700b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75084700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700b2580 0x7fdd700aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd74883700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd700afbd0 0x7fdd700b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37702/0 (socket says 172.21.15.12:37702) 2021-10-20T23:20:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 0x7fdd70149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd74883700 1 -- 172.21.15.12:0/1701721161 learned_addr learned my addr 172.21.15.12:0/1701721161 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd74883700 1 -- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 msgr2=0x7fdd70149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd74883700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 0x7fdd70149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd74883700 1 -- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700b2580 msgr2=0x7fdd700aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:24.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd74883700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700b2580 0x7fdd700aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:24.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd74883700 1 -- 172.21.15.12:0/1701721161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68009470 con 0x7fdd700afbd0 2021-10-20T23:20:24.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75084700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700b2580 0x7fdd700aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:24.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd74883700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd700afbd0 0x7fdd700b3dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fdd6000c000 tx=0x7fdd60008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:24.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd65ffb700 1 -- 172.21.15.12:0/1701721161 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd60013610 con 0x7fdd700afbd0 2021-10-20T23:20:24.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd65ffb700 1 -- 172.21.15.12:0/1701721161 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd60013770 con 0x7fdd700afbd0 2021-10-20T23:20:24.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd700aa480 con 0x7fdd700afbd0 2021-10-20T23:20:24.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd65ffb700 1 -- 172.21.15.12:0/1701721161 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd60013ad0 con 0x7fdd700afbd0 2021-10-20T23:20:24.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.504+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd70149f00 con 0x7fdd700afbd0 2021-10-20T23:20:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.508+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd70057350 con 0x7fdd700afbd0 2021-10-20T23:20:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.508+0000 7fdd65ffb700 1 -- 172.21.15.12:0/1701721161 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd60013c30 con 0x7fdd700afbd0 2021-10-20T23:20:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.508+0000 7fdd65ffb700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd50053610 0x7fdd50055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.508+0000 7fdd65ffb700 1 -- 172.21.15.12:0/1701721161 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fdd6006bdf0 con 0x7fdd700afbd0 2021-10-20T23:20:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.508+0000 7fdd67fff700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd50053610 0x7fdd50055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:24.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.508+0000 7fdd67fff700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd50053610 0x7fdd50055ad0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fdd6c00b000 tx=0x7fdd6c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:24.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.512+0000 7fdd65ffb700 1 -- 172.21.15.12:0/1701721161 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd60042c80 con 0x7fdd700afbd0 2021-10-20T23:20:24.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:24.676+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdd700aa610 con 0x7fdd700afbd0 2021-10-20T23:20:25.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.080+0000 7fdd65ffb700 1 -- 172.21.15.12:0/1701721161 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdd600462a0 con 0x7fdd700afbd0 2021-10-20T23:20:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd50053610 msgr2=0x7fdd50055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd50053610 0x7fdd50055ad0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fdd6c00b000 tx=0x7fdd6c006df0).stop 2021-10-20T23:20:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd700afbd0 msgr2=0x7fdd700b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd700afbd0 0x7fdd700b3dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fdd6000c000 tx=0x7fdd60008040).stop 2021-10-20T23:20:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 shutdown_connections 2021-10-20T23:20:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd50053610 0x7fdd50055ad0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd700b2580 0x7fdd700aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd700b0010 0x7fdd70149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 --2- 172.21.15.12:0/1701721161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd700afbd0 0x7fdd700b3dc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 >> 172.21.15.12:0/1701721161 conn(0x7fdd70060180 msgr2=0x7fdd701486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 shutdown_connections 2021-10-20T23:20:25.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.084+0000 7fdd75885700 1 -- 172.21.15.12:0/1701721161 wait complete. 2021-10-20T23:20:25.107 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:20:25.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e9164700 1 Processor -- start 2021-10-20T23:20:25.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e9164700 1 -- start start 2021-10-20T23:20:25.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e9164700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f18e40b6580 0x7f18e40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:25.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e9164700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6960 0x7f18e412ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:25.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e9164700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e41440b0 con 0x7f18e40b43c0 2021-10-20T23:20:25.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e9164700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e4143b70 con 0x7f18e40b6580 2021-10-20T23:20:25.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e9164700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4143e10 con 0x7f18e40b6960 2021-10-20T23:20:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f18e40b6580 0x7f18e40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f18e40b6580 0x7f18e40b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37712/0 (socket says 172.21.15.12:37712) 2021-10-20T23:20:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e2d9d700 1 -- 172.21.15.12:0/698763424 learned_addr learned my addr 172.21.15.12:0/698763424 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18da59c700 1 --1- 172.21.15.12:0/698763424 >> v1:172.21.15.31:6789/0 conn(0x7f18e40b43c0 0x7f18e4061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:43370/0 (socket says 172.21.15.12:43370) 2021-10-20T23:20:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e359e700 1 --2- 172.21.15.12:0/698763424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6960 0x7f18e412ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:25.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e259c700 1 -- 172.21.15.12:0/698763424 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689941375 0 0) 0x7f18e41440b0 con 0x7f18e40b43c0 2021-10-20T23:20:25.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e259c700 1 -- 172.21.15.12:0/698763424 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c4003260 con 0x7f18e40b43c0 2021-10-20T23:20:25.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e2d9d700 1 -- 172.21.15.12:0/698763424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6960 msgr2=0x7f18e412ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:25.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e2d9d700 1 --2- 172.21.15.12:0/698763424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6960 0x7f18e412ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e2d9d700 1 -- 172.21.15.12:0/698763424 >> v1:172.21.15.31:6789/0 conn(0x7f18e40b43c0 legacy=0x7f18e4061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e2d9d700 1 -- 172.21.15.12:0/698763424 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e40615f0 con 0x7f18e40b6580 2021-10-20T23:20:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e2d9d700 1 --2- 172.21.15.12:0/698763424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b6580 0x7f18e40b5bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f18e4143120 tx=0x7f18d4006eb0).ready entity=mon.0 client_cookie=6b79a0034e0b805a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e259c700 1 -- 172.21.15.12:0/698763424 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d400d5c0 con 0x7f18e40b6580 2021-10-20T23:20:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e259c700 1 -- 172.21.15.12:0/698763424 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4000e90 con 0x7f18e40b6580 2021-10-20T23:20:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.220+0000 7f18e259c700 1 -- 172.21.15.12:0/698763424 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d400d950 con 0x7f18e40b6580 2021-10-20T23:20:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 -- 172.21.15.12:0/698763424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b6580 msgr2=0x7f18e40b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 --2- 172.21.15.12:0/698763424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b6580 0x7f18e40b5bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f18e4143120 tx=0x7f18d4006eb0).stop 2021-10-20T23:20:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 -- 172.21.15.12:0/698763424 shutdown_connections 2021-10-20T23:20:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 --2- 172.21.15.12:0/698763424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6960 0x7f18e412ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 --2- 172.21.15.12:0/698763424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b6580 0x7f18e40b5bf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 -- 172.21.15.12:0/698763424 >> 172.21.15.12:0/698763424 conn(0x7f18e405c490 msgr2=0x7f18e405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 -- 172.21.15.12:0/698763424 shutdown_connections 2021-10-20T23:20:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 -- 172.21.15.12:0/698763424 wait complete. 2021-10-20T23:20:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 Processor -- start 2021-10-20T23:20:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 -- start start 2021-10-20T23:20:25.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b43c0 0x7f18e412b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:25.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6580 0x7f18e4147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18e40b6960 0x7f18e4147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4152de0 con 0x7f18e40b43c0 2021-10-20T23:20:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4129d30 con 0x7f18e40b6960 2021-10-20T23:20:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e9164700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4152ff0 con 0x7f18e40b6580 2021-10-20T23:20:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.224+0000 7f18e2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b43c0 0x7f18e412b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18e40b6960 0x7f18e4147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18da59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6580 0x7f18e4147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18e40b6960 0x7f18e4147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:52696/0 (socket says 172.21.15.12:52696) 2021-10-20T23:20:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e359e700 1 -- 172.21.15.12:0/1183585840 learned_addr learned my addr 172.21.15.12:0/1183585840 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e359e700 1 -- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6580 msgr2=0x7f18e4147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e359e700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6580 0x7f18e4147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e359e700 1 -- 172.21.15.12:0/1183585840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b43c0 msgr2=0x7f18e412b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e359e700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b43c0 0x7f18e412b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e359e700 1 -- 172.21.15.12:0/1183585840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d400b1e0 con 0x7f18e40b6960 2021-10-20T23:20:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e2d9d700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b43c0 0x7f18e412b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e359e700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18e40b6960 0x7f18e4147d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f18dc006e00 tx=0x7f18dc0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e0d99700 1 -- 172.21.15.12:0/1183585840 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18dc00c640 con 0x7f18e40b6960 2021-10-20T23:20:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e0d99700 1 -- 172.21.15.12:0/1183585840 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc00c7a0 con 0x7f18e40b6960 2021-10-20T23:20:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e40b3720 con 0x7f18e40b6960 2021-10-20T23:20:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e0d99700 1 -- 172.21.15.12:0/1183585840 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18dc00cb00 con 0x7f18e40b6960 2021-10-20T23:20:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e412c560 con 0x7f18e40b6960 2021-10-20T23:20:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e4061890 con 0x7f18e40b6960 2021-10-20T23:20:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.228+0000 7f18e0d99700 1 -- 172.21.15.12:0/1183585840 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f18dc022070 con 0x7f18e40b6960 2021-10-20T23:20:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.232+0000 7f18e0d99700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18c80536d0 0x7f18c8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.232+0000 7f18e0d99700 1 -- 172.21.15.12:0/1183585840 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f18dc06c460 con 0x7f18e40b6960 2021-10-20T23:20:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.232+0000 7f18e2d9d700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18c80536d0 0x7f18c8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.232+0000 7f18e2d9d700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18c80536d0 0x7f18c8055b90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f18d401c000 tx=0x7f18d4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:25.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.240+0000 7f18e0d99700 1 -- 172.21.15.12:0/1183585840 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f18dc0432f0 con 0x7f18e40b6960 2021-10-20T23:20:25.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:25.368+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f18e4057350 con 0x7f18e40b6960 2021-10-20T23:20:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.096+0000 7f18e0d99700 1 -- 172.21.15.12:0/1183585840 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 185+0+0 (secure 0 0 0) 0x7f18dc046910 con 0x7f18e40b6960 2021-10-20T23:20:26.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.096+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18c80536d0 msgr2=0x7f18c8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:26.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.096+0000 7f18e9164700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18c80536d0 0x7f18c8055b90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f18d401c000 tx=0x7f18d4015000).stop 2021-10-20T23:20:26.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.096+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18e40b6960 msgr2=0x7f18e4147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:26.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.100+0000 7f18e9164700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18e40b6960 0x7f18e4147d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f18dc006e00 tx=0x7f18dc0091d0).stop 2021-10-20T23:20:26.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.100+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 shutdown_connections 2021-10-20T23:20:26.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.100+0000 7f18e9164700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18c80536d0 0x7f18c8055b90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.100+0000 7f18e9164700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18e40b6960 0x7f18e4147d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.100+0000 7f18e9164700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18e40b6580 0x7f18e4147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.100+0000 7f18e9164700 1 --2- 172.21.15.12:0/1183585840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e40b43c0 0x7f18e412b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.100+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 >> 172.21.15.12:0/1183585840 conn(0x7f18e405c490 msgr2=0x7f18e4140f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.100+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 shutdown_connections 2021-10-20T23:20:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.100+0000 7f18e9164700 1 -- 172.21.15.12:0/1183585840 wait complete. 2021-10-20T23:20:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:20:26.117 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:20:26.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe6749700 1 Processor -- start 2021-10-20T23:20:26.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe6749700 1 -- start start 2021-10-20T23:20:26.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe6749700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b2580 0x7effe00abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:26.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe6749700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7effe00b02e0 0x7effe00ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:26.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe6749700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe00add80 con 0x7effe00b1260 2021-10-20T23:20:26.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe6749700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe00ae020 con 0x7effe00b02e0 2021-10-20T23:20:26.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe6749700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe00a9390 con 0x7effe00b2580 2021-10-20T23:20:26.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe5f48700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7effe00b02e0 0x7effe00ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:26.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe5747700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b2580 0x7effe00abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:26.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe4f46700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7effe00b1260 0x7effe00afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:43384/0 (socket says 172.21.15.12:43384) 2021-10-20T23:20:26.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effe4f46700 1 -- 172.21.15.12:0/2748263013 learned_addr learned my addr 172.21.15.12:0/2748263013 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:26.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.228+0000 7effcbfff700 1 -- 172.21.15.12:0/2748263013 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117175000 0 0) 0x7effe00add80 con 0x7effe00b1260 2021-10-20T23:20:26.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effcbfff700 1 -- 172.21.15.12:0/2748263013 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effc4003260 con 0x7effe00b1260 2021-10-20T23:20:26.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe5747700 1 -- 172.21.15.12:0/2748263013 >> v2:172.21.15.31:3300/0 conn(0x7effe00b02e0 msgr2=0x7effe00ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:26.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe5747700 1 --2- 172.21.15.12:0/2748263013 >> v2:172.21.15.31:3300/0 conn(0x7effe00b02e0 0x7effe00ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:26.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe5747700 1 -- 172.21.15.12:0/2748263013 >> v1:172.21.15.31:6789/0 conn(0x7effe00b1260 legacy=0x7effe00afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:26.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe5747700 1 -- 172.21.15.12:0/2748263013 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00a9830 con 0x7effe00b2580 2021-10-20T23:20:26.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe5f48700 1 --2- 172.21.15.12:0/2748263013 >> v2:172.21.15.31:3300/0 conn(0x7effe00b02e0 0x7effe00ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:26.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe5747700 1 --2- 172.21.15.12:0/2748263013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b2580 0x7effe00abb10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7effd4002f70 tx=0x7effd4006df0).ready entity=mon.2 client_cookie=e8e9ce72783e05a5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:26.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effcbfff700 1 -- 172.21.15.12:0/2748263013 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd400d4a0 con 0x7effe00b2580 2021-10-20T23:20:26.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effcbfff700 1 -- 172.21.15.12:0/2748263013 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4000e90 con 0x7effe00b2580 2021-10-20T23:20:26.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effcbfff700 1 -- 172.21.15.12:0/2748263013 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd400d7f0 con 0x7effe00b2580 2021-10-20T23:20:26.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 -- 172.21.15.12:0/2748263013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b2580 msgr2=0x7effe00abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:26.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 --2- 172.21.15.12:0/2748263013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b2580 0x7effe00abb10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7effd4002f70 tx=0x7effd4006df0).stop 2021-10-20T23:20:26.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 -- 172.21.15.12:0/2748263013 shutdown_connections 2021-10-20T23:20:26.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 --2- 172.21.15.12:0/2748263013 >> v2:172.21.15.31:3300/0 conn(0x7effe00b02e0 0x7effe00ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:26.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 --2- 172.21.15.12:0/2748263013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b2580 0x7effe00abb10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:26.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 -- 172.21.15.12:0/2748263013 >> 172.21.15.12:0/2748263013 conn(0x7effe0060180 msgr2=0x7effe00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:26.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 -- 172.21.15.12:0/2748263013 shutdown_connections 2021-10-20T23:20:26.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 -- 172.21.15.12:0/2748263013 wait complete. 2021-10-20T23:20:26.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 Processor -- start 2021-10-20T23:20:26.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.232+0000 7effe6749700 1 -- start start 2021-10-20T23:20:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe6749700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b02e0 0x7effe0140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe6749700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effe00b1260 0x7effe0063000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe6749700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effe00b2580 0x7effe005c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe6749700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00ab980 con 0x7effe00b2580 2021-10-20T23:20:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe6749700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00aaa00 con 0x7effe00b1260 2021-10-20T23:20:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe6749700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe00aae60 con 0x7effe00b02e0 2021-10-20T23:20:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5f48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effe00b2580 0x7effe005c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:26.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5f48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effe00b2580 0x7effe005c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37736/0 (socket says 172.21.15.12:37736) 2021-10-20T23:20:26.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5f48700 1 -- 172.21.15.12:0/4039257528 learned_addr learned my addr 172.21.15.12:0/4039257528 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:26.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5747700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b02e0 0x7effe0140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:26.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe4f46700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effe00b1260 0x7effe0063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:26.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5f48700 1 -- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b02e0 msgr2=0x7effe0140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:26.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5f48700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b02e0 0x7effe0140f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:26.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5f48700 1 -- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effe00b1260 msgr2=0x7effe0063000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:26.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5f48700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effe00b1260 0x7effe0063000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:26.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5f48700 1 -- 172.21.15.12:0/4039257528 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd8009470 con 0x7effe00b2580 2021-10-20T23:20:26.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe5f48700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effe00b2580 0x7effe005c490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7effd800c000 tx=0x7effd80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:26.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effd2ffd700 1 -- 172.21.15.12:0/4039257528 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd800c850 con 0x7effe00b2580 2021-10-20T23:20:26.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effd2ffd700 1 -- 172.21.15.12:0/4039257528 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd800c9b0 con 0x7effe00b2580 2021-10-20T23:20:26.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd400b180 con 0x7effe00b2580 2021-10-20T23:20:26.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effd2ffd700 1 -- 172.21.15.12:0/4039257528 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd800cd10 con 0x7effe00b2580 2021-10-20T23:20:26.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.236+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe00ab6e0 con 0x7effe00b2580 2021-10-20T23:20:26.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.240+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe0057350 con 0x7effe00b2580 2021-10-20T23:20:26.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.240+0000 7effd2ffd700 1 -- 172.21.15.12:0/4039257528 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7effd80123f0 con 0x7effe00b2580 2021-10-20T23:20:26.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.240+0000 7effd2ffd700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7effbc053610 0x7effbc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:26.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.240+0000 7effd2ffd700 1 -- 172.21.15.12:0/4039257528 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6079+0+0 (secure 0 0 0) 0x7effd806bcd0 con 0x7effe00b2580 2021-10-20T23:20:26.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.240+0000 7effe5747700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7effbc053610 0x7effbc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:26.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.240+0000 7effe5747700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7effbc053610 0x7effbc055ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7effd401a000 tx=0x7effd4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:26.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.244+0000 7effd2ffd700 1 -- 172.21.15.12:0/4039257528 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7effd8042dd0 con 0x7effe00b2580 2021-10-20T23:20:26.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:26.372+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7effe00698e0 con 0x7effe00b2580 2021-10-20T23:20:27.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.100+0000 7effd2ffd700 1 -- 172.21.15.12:0/4039257528 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7effd8016070 con 0x7effe00b2580 2021-10-20T23:20:27.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7effbc053610 msgr2=0x7effbc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:27.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7effbc053610 0x7effbc055ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7effd401a000 tx=0x7effd4014000).stop 2021-10-20T23:20:27.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effe00b2580 msgr2=0x7effe005c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:27.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effe00b2580 0x7effe005c490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7effd800c000 tx=0x7effd80091d0).stop 2021-10-20T23:20:27.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 shutdown_connections 2021-10-20T23:20:27.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7effbc053610 0x7effbc055ad0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:27.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effe00b2580 0x7effe005c490 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:27.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effe00b1260 0x7effe0063000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:27.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 --2- 172.21.15.12:0/4039257528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effe00b02e0 0x7effe0140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:27.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 >> 172.21.15.12:0/4039257528 conn(0x7effe0060180 msgr2=0x7effe00b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:27.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 shutdown_connections 2021-10-20T23:20:27.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.108+0000 7effe6749700 1 -- 172.21.15.12:0/4039257528 wait complete. 2021-10-20T23:20:27.116 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:20:27.126 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:20:27.126 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:20:27.127 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:20:27.127 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:20:27.127 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:20:27.128 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:20:27.128 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:20:27.128 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:20:27.129 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:20:27.129 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:20:27.129 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:20:27.130 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:20:27.140 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:20:27.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:20:27.143 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:20:27.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:20:27.147 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:20:27.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:20:27.186 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:20:27.186 DEBUG:teuthology.parallel:result is None 2021-10-20T23:20:27.187 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:20:27.188 DEBUG:teuthology.parallel:result is None 2021-10-20T23:20:27.189 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:20:27.190 DEBUG:teuthology.parallel:result is None 2021-10-20T23:20:27.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:20:27.262 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:20:27.267 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:20:27.286 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:20:27.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.316+0000 7fb784ef1700 1 Processor -- start 2021-10-20T23:20:27.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.316+0000 7fb784ef1700 1 -- start start 2021-10-20T23:20:27.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.316+0000 7fb784ef1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb7800af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.316+0000 7fb784ef1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7801424d0 0x7fb780142960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.316+0000 7fb784ef1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7800acf10 con 0x7fb7800affd0 2021-10-20T23:20:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.316+0000 7fb784ef1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7800ad1b0 con 0x7fb7801424d0 2021-10-20T23:20:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.316+0000 7fb784ef1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800af3a0 con 0x7fb780066e50 2021-10-20T23:20:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77dd9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb7800affd0 0x7fb7800ae520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36358/0 (socket says 172.21.15.12:36358) 2021-10-20T23:20:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77dd9b700 1 -- 172.21.15.12:0/1274989634 learned_addr learned my addr 172.21.15.12:0/1274989634 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77e59c700 1 --2- 172.21.15.12:0/1274989634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb7800af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77ed9d700 1 --2- 172.21.15.12:0/1274989634 >> v2:172.21.15.31:3300/0 conn(0x7fb7801424d0 0x7fb780142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77d59a700 1 -- 172.21.15.12:0/1274989634 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799021427 0 0) 0x7fb7800acf10 con 0x7fb7800affd0 2021-10-20T23:20:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77d59a700 1 -- 172.21.15.12:0/1274989634 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb760003260 con 0x7fb7800affd0 2021-10-20T23:20:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77ed9d700 1 -- 172.21.15.12:0/1274989634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 msgr2=0x7fb7800af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77ed9d700 1 --2- 172.21.15.12:0/1274989634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb7800af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77ed9d700 1 -- 172.21.15.12:0/1274989634 >> v1:172.21.15.12:6789/0 conn(0x7fb7800affd0 legacy=0x7fb7800ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77d59a700 1 -- 172.21.15.12:0/1274989634 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887603634 0 0) 0x7fb760003260 con 0x7fb7800affd0 2021-10-20T23:20:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77ed9d700 1 -- 172.21.15.12:0/1274989634 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7800aec30 con 0x7fb7801424d0 2021-10-20T23:20:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77e59c700 1 --2- 172.21.15.12:0/1274989634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb7800af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77ed9d700 1 --2- 172.21.15.12:0/1274989634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7801424d0 0x7fb780142960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb770001800 tx=0x7fb768006df0).ready entity=mon.1 client_cookie=3aea68edfb74de87 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77d59a700 1 -- 172.21.15.12:0/1274989634 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb770001660 con 0x7fb7801424d0 2021-10-20T23:20:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77d59a700 1 -- 172.21.15.12:0/1274989634 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768000e90 con 0x7fb7801424d0 2021-10-20T23:20:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb77d59a700 1 -- 172.21.15.12:0/1274989634 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb768012460 con 0x7fb7801424d0 2021-10-20T23:20:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb784ef1700 1 -- 172.21.15.12:0/1274989634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7801424d0 msgr2=0x7fb780142960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb784ef1700 1 --2- 172.21.15.12:0/1274989634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7801424d0 0x7fb780142960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb770001800 tx=0x7fb768006df0).stop 2021-10-20T23:20:27.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb784ef1700 1 -- 172.21.15.12:0/1274989634 shutdown_connections 2021-10-20T23:20:27.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb784ef1700 1 --2- 172.21.15.12:0/1274989634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7801424d0 0x7fb780142960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:27.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb784ef1700 1 --2- 172.21.15.12:0/1274989634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb7800af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:27.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb784ef1700 1 -- 172.21.15.12:0/1274989634 >> 172.21.15.12:0/1274989634 conn(0x7fb7800608d0 msgr2=0x7fb780060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:27.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb784ef1700 1 -- 172.21.15.12:0/1274989634 shutdown_connections 2021-10-20T23:20:27.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.320+0000 7fb784ef1700 1 -- 172.21.15.12:0/1274989634 wait complete. 2021-10-20T23:20:27.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb784ef1700 1 Processor -- start 2021-10-20T23:20:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb784ef1700 1 -- start start 2021-10-20T23:20:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb784ef1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb780155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb784ef1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7800affd0 0x7fb78013e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb784ef1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7801424d0 0x7fb78013d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb784ef1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800b5ab0 con 0x7fb7800affd0 2021-10-20T23:20:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb784ef1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800b5d50 con 0x7fb7801424d0 2021-10-20T23:20:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb784ef1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800b5ff0 con 0x7fb780066e50 2021-10-20T23:20:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7800affd0 0x7fb78013e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7800affd0 0x7fb78013e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37770/0 (socket says 172.21.15.12:37770) 2021-10-20T23:20:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77dd9b700 1 -- 172.21.15.12:0/3613542494 learned_addr learned my addr 172.21.15.12:0/3613542494 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:27.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77e59c700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb780155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:27.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77ed9d700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7801424d0 0x7fb78013d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:27.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77dd9b700 1 -- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 msgr2=0x7fb780155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:27.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77dd9b700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb780155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77dd9b700 1 -- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7801424d0 msgr2=0x7fb78013d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77dd9b700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7801424d0 0x7fb78013d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77dd9b700 1 -- 172.21.15.12:0/3613542494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778009470 con 0x7fb7800affd0 2021-10-20T23:20:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77e59c700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb780155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.324+0000 7fb77dd9b700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7800affd0 0x7fb78013e3f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb7700018c0 tx=0x7fb770001230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb7777fe700 1 -- 172.21.15.12:0/3613542494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb770007170 con 0x7fb7800affd0 2021-10-20T23:20:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb7777fe700 1 -- 172.21.15.12:0/3613542494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7700072d0 con 0x7fb7800affd0 2021-10-20T23:20:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76800b180 con 0x7fb7800affd0 2021-10-20T23:20:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb7777fe700 1 -- 172.21.15.12:0/3613542494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb770004920 con 0x7fb7800affd0 2021-10-20T23:20:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7800b32b0 con 0x7fb7800affd0 2021-10-20T23:20:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb780057350 con 0x7fb7800affd0 2021-10-20T23:20:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb7777fe700 1 -- 172.21.15.12:0/3613542494 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb770004a80 con 0x7fb7800affd0 2021-10-20T23:20:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb7777fe700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb764053610 0x7fb764055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb7777fe700 1 -- 172.21.15.12:0/3613542494 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb77006b370 con 0x7fb7800affd0 2021-10-20T23:20:27.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.328+0000 7fb77e59c700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb764053610 0x7fb764055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:27.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.332+0000 7fb77e59c700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb764053610 0x7fb764055ad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb77800b000 tx=0x7fb778008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:27.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.336+0000 7fb7777fe700 1 -- 172.21.15.12:0/3613542494 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb770042650 con 0x7fb7800affd0 2021-10-20T23:20:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:27.472+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fb7800b0e90 con 0x7fb7800affd0 2021-10-20T23:20:28.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.308+0000 7fb7777fe700 1 -- 172.21.15.12:0/3613542494 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb770045c70 con 0x7fb7800affd0 2021-10-20T23:20:28.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb764053610 msgr2=0x7fb764055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb764053610 0x7fb764055ad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb77800b000 tx=0x7fb778008040).stop 2021-10-20T23:20:28.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7800affd0 msgr2=0x7fb78013e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7800affd0 0x7fb78013e3f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb7700018c0 tx=0x7fb770001230).stop 2021-10-20T23:20:28.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 shutdown_connections 2021-10-20T23:20:28.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb764053610 0x7fb764055ad0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7801424d0 0x7fb78013d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7800affd0 0x7fb78013e3f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 --2- 172.21.15.12:0/3613542494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb780066e50 0x7fb780155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 >> 172.21.15.12:0/3613542494 conn(0x7fb7800608d0 msgr2=0x7fb7801457b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 shutdown_connections 2021-10-20T23:20:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.312+0000 7fb784ef1700 1 -- 172.21.15.12:0/3613542494 wait complete. 2021-10-20T23:20:28.321 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:20:28.332 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:20:28.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:20:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.436+0000 7fa864a2a700 1 Processor -- start 2021-10-20T23:20:28.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.436+0000 7fa864a2a700 1 -- start start 2021-10-20T23:20:28.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600a9c10 0x7fa8600607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa860140140 0x7fa8601405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa860066ea0 con 0x7fa8600b3040 2021-10-20T23:20:28.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600648e0 con 0x7fa860140140 2021-10-20T23:20:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa860061dd0 con 0x7fa8600a9c10 2021-10-20T23:20:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85ed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa8600b3040 0x7fa860065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36376/0 (socket says 172.21.15.12:36376) 2021-10-20T23:20:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85ed9d700 1 -- 172.21.15.12:0/867069579 learned_addr learned my addr 172.21.15.12:0/867069579 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85f59e700 1 --2- 172.21.15.12:0/867069579 >> v2:172.21.15.31:3300/0 conn(0x7fa860140140 0x7fa8601405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85e59c700 1 --2- 172.21.15.12:0/867069579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600a9c10 0x7fa8600607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85dd9b700 1 -- 172.21.15.12:0/867069579 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614997376 0 0) 0x7fa860066ea0 con 0x7fa8600b3040 2021-10-20T23:20:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85dd9b700 1 -- 172.21.15.12:0/867069579 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa840003260 con 0x7fa8600b3040 2021-10-20T23:20:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85e59c700 1 -- 172.21.15.12:0/867069579 >> v2:172.21.15.31:3300/0 conn(0x7fa860140140 msgr2=0x7fa8601405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85e59c700 1 --2- 172.21.15.12:0/867069579 >> v2:172.21.15.31:3300/0 conn(0x7fa860140140 0x7fa8601405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85e59c700 1 -- 172.21.15.12:0/867069579 >> v1:172.21.15.12:6789/0 conn(0x7fa8600b3040 legacy=0x7fa860065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85e59c700 1 -- 172.21.15.12:0/867069579 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600b3420 con 0x7fa8600a9c10 2021-10-20T23:20:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85e59c700 1 --2- 172.21.15.12:0/867069579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600a9c10 0x7fa8600607c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa848002f70 tx=0x7fa848006df0).ready entity=mon.2 client_cookie=c84900c1c0809a5d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85dd9b700 1 -- 172.21.15.12:0/867069579 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa84800d4a0 con 0x7fa8600a9c10 2021-10-20T23:20:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85dd9b700 1 -- 172.21.15.12:0/867069579 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848000e90 con 0x7fa8600a9c10 2021-10-20T23:20:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa85dd9b700 1 -- 172.21.15.12:0/867069579 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa84800d830 con 0x7fa8600a9c10 2021-10-20T23:20:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 -- 172.21.15.12:0/867069579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600a9c10 msgr2=0x7fa8600607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 --2- 172.21.15.12:0/867069579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600a9c10 0x7fa8600607c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa848002f70 tx=0x7fa848006df0).stop 2021-10-20T23:20:28.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 -- 172.21.15.12:0/867069579 shutdown_connections 2021-10-20T23:20:28.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 --2- 172.21.15.12:0/867069579 >> v2:172.21.15.31:3300/0 conn(0x7fa860140140 0x7fa8601405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 --2- 172.21.15.12:0/867069579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600a9c10 0x7fa8600607c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 -- 172.21.15.12:0/867069579 >> 172.21.15.12:0/867069579 conn(0x7fa8600636e0 msgr2=0x7fa860063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:28.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 -- 172.21.15.12:0/867069579 shutdown_connections 2021-10-20T23:20:28.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.440+0000 7fa864a2a700 1 -- 172.21.15.12:0/867069579 wait complete. 2021-10-20T23:20:28.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 Processor -- start 2021-10-20T23:20:28.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 -- start start 2021-10-20T23:20:28.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600a9c10 0x7fa8600b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600b3040 0x7fa860155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa860140140 0x7fa860139d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600aab50 con 0x7fa860140140 2021-10-20T23:20:28.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860134240 con 0x7fa8600a9c10 2021-10-20T23:20:28.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa860141a60 con 0x7fa8600b3040 2021-10-20T23:20:28.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa860140140 0x7fa860139d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa860140140 0x7fa860139d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37790/0 (socket says 172.21.15.12:37790) 2021-10-20T23:20:28.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85f59e700 1 -- 172.21.15.12:0/106845039 learned_addr learned my addr 172.21.15.12:0/106845039 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:28.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85ed9d700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600a9c10 0x7fa8600b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85e59c700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600b3040 0x7fa860155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85f59e700 1 -- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600b3040 msgr2=0x7fa860155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85f59e700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600b3040 0x7fa860155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85f59e700 1 -- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600a9c10 msgr2=0x7fa8600b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85f59e700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600a9c10 0x7fa8600b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85f59e700 1 -- 172.21.15.12:0/106845039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84800b180 con 0x7fa860140140 2021-10-20T23:20:28.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa85f59e700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa860140140 0x7fa860139d70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa860134380 tx=0x7fa8580091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:28.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa857fff700 1 -- 172.21.15.12:0/106845039 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa858012600 con 0x7fa860140140 2021-10-20T23:20:28.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa857fff700 1 -- 172.21.15.12:0/106845039 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858012760 con 0x7fa860140140 2021-10-20T23:20:28.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8601417c0 con 0x7fa860140140 2021-10-20T23:20:28.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa857fff700 1 -- 172.21.15.12:0/106845039 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa858012ac0 con 0x7fa860140140 2021-10-20T23:20:28.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.444+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8601558e0 con 0x7fa860140140 2021-10-20T23:20:28.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.448+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa860155ae0 con 0x7fa860140140 2021-10-20T23:20:28.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.448+0000 7fa857fff700 1 -- 172.21.15.12:0/106845039 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa858022070 con 0x7fa860140140 2021-10-20T23:20:28.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.448+0000 7fa857fff700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa844053610 0x7fa844055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.448+0000 7fa857fff700 1 -- 172.21.15.12:0/106845039 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa85806bd80 con 0x7fa860140140 2021-10-20T23:20:28.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.448+0000 7fa85ed9d700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa844053610 0x7fa844055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.448+0000 7fa85ed9d700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa844053610 0x7fa844055ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa85000d000 tx=0x7fa850009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:28.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.456+0000 7fa857fff700 1 -- 172.21.15.12:0/106845039 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa860155ae0 con 0x7fa860140140 2021-10-20T23:20:28.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.624+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa860155ae0 con 0x7fa860140140 2021-10-20T23:20:28.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.624+0000 7fa857fff700 1 -- 172.21.15.12:0/106845039 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5621 (secure 0 0 0) 0x7fa860155ae0 con 0x7fa860140140 2021-10-20T23:20:28.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:28.630 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:20:28.630 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:20:28.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.631 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:20:28.631 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:20:28.631 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.631 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:20:28.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.632 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.632 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.633 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:20:28.633 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:20:28.634 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.634 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:20:28.634 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.634 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.634 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:20:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:20:28.636 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.636 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:20:28.636 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.636 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:20:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:20:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:20:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:20:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.641 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.641 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:20:28.642 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:20:28.642 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.642 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.642 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.642 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.643 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:20:28.643 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:20:28.644 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.644 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.644 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.644 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:20:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:20:28.646 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.646 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.646 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.646 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.646 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.647 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:20:28.647 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:20:28.648 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.648 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.648 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.648 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.648 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:20:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:20:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.651 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:20:28.651 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:20:28.651 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:20:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:20:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:20:28.654 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2021-10-20T23:20:28.654 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2021-10-20T23:20:28.654 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2021-10-20T23:20:28.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.655 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:20:28.655 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:20:28.655 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:20:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2021-10-20T23:20:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2021-10-20T23:20:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2021-10-20T23:20:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.657 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:20:28.657 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:20:28.657 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.658 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:20:28.658 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:20:28.658 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:20:28.658 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mds", 2021-10-20T23:20:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAJpHBhrcQoARAAmd3JY0Wb0uZ3h5ENB5MjuA==", 2021-10-20T23:20:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mds" 2021-10-20T23:20:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.661 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mgr", 2021-10-20T23:20:28.661 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAJpHBhHdooARAAs9+874XBjwJKeJn23Vsq8g==", 2021-10-20T23:20:28.661 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.661 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mgr" 2021-10-20T23:20:28.661 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.662 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-osd", 2021-10-20T23:20:28.662 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAJpHBh6usoARAArJ/aG62u0J8/rXz6Y5DGYw==", 2021-10-20T23:20:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-osd" 2021-10-20T23:20:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd", 2021-10-20T23:20:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAJpHBhF/0oARAAjn3CZ8LIGM7geQ+1IgoaVg==", 2021-10-20T23:20:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd" 2021-10-20T23:20:28.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.665 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-10-20T23:20:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAJpHBhGhApARAAjcoQVjcPnXxHnzAJS/UNAQ==", 2021-10-20T23:20:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-10-20T23:20:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rgw", 2021-10-20T23:20:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAJpHBheCYpARAAjJ2iQxpPP9XDPPFohzj/Rg==", 2021-10-20T23:20:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rgw" 2021-10-20T23:20:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:20:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:20:28.669 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.669 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:20:28.669 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:20:28.669 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:20:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:20:28.671 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:20:28.671 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:20:28.671 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:20:28.671 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:20:28.672 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.672 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:28.672 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:20:28.672 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:20:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa844053610 msgr2=0x7fa844055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa844053610 0x7fa844055ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa85000d000 tx=0x7fa850009040).stop 2021-10-20T23:20:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa860140140 msgr2=0x7fa860139d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa860140140 0x7fa860139d70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa860134380 tx=0x7fa8580091d0).stop 2021-10-20T23:20:28.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 shutdown_connections 2021-10-20T23:20:28.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa844053610 0x7fa844055ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa860140140 0x7fa860139d70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8600b3040 0x7fa860155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 --2- 172.21.15.12:0/106845039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600a9c10 0x7fa8600b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 >> 172.21.15.12:0/106845039 conn(0x7fa8600636e0 msgr2=0x7fa8600b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 shutdown_connections 2021-10-20T23:20:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.628+0000 7fa864a2a700 1 -- 172.21.15.12:0/106845039 wait complete. 2021-10-20T23:20:28.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2021-10-20T23:20:28.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d3fff700 1 Processor -- start 2021-10-20T23:20:28.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d3fff700 1 -- start start 2021-10-20T23:20:28.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19d40b2580 0x7f19d414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40a8ac0 0x7f19d414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d3fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d40a70c0 con 0x7f19d40b0010 2021-10-20T23:20:28.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d3fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40a72f0 con 0x7f19d40b2580 2021-10-20T23:20:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40a7590 con 0x7f19d40a8ac0 2021-10-20T23:20:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40a8ac0 0x7f19d414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19d40b2580 0x7f19d414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19d40b2580 0x7f19d414ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:52768/0 (socket says 172.21.15.12:52768) 2021-10-20T23:20:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d2ffd700 1 -- 172.21.15.12:0/3776408075 learned_addr learned my addr 172.21.15.12:0/3776408075 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40a8ac0 0x7f19d414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:43556/0 (socket says 172.21.15.12:43556) 2021-10-20T23:20:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d2ffd700 1 -- 172.21.15.12:0/3776408075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40a8ac0 msgr2=0x7f19d414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d2ffd700 1 --2- 172.21.15.12:0/3776408075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40a8ac0 0x7f19d414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d2ffd700 1 -- 172.21.15.12:0/3776408075 >> v1:172.21.15.31:6789/0 conn(0x7f19d40b0010 legacy=0x7f19d40a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d1ffb700 1 -- 172.21.15.12:0/3776408075 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914514319 0 0) 0x7f19d40a70c0 con 0x7f19d40b0010 2021-10-20T23:20:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d2ffd700 1 -- 172.21.15.12:0/3776408075 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d40a7830 con 0x7f19d40b2580 2021-10-20T23:20:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d37fe700 1 --2- 172.21.15.12:0/3776408075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40a8ac0 0x7f19d414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d2ffd700 1 --2- 172.21.15.12:0/3776408075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19d40b2580 0x7f19d414ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f19bc002f70 tx=0x7f19bc006eb0).ready entity=mon.1 client_cookie=74a85e2c60ddbe45 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d1ffb700 1 -- 172.21.15.12:0/3776408075 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19bc00d570 con 0x7f19d40b2580 2021-10-20T23:20:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d1ffb700 1 -- 172.21.15.12:0/3776408075 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc000e90 con 0x7f19d40b2580 2021-10-20T23:20:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d1ffb700 1 -- 172.21.15.12:0/3776408075 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19bc00d8c0 con 0x7f19d40b2580 2021-10-20T23:20:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d3fff700 1 -- 172.21.15.12:0/3776408075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19d40b2580 msgr2=0x7f19d414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.788+0000 7f19d3fff700 1 --2- 172.21.15.12:0/3776408075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19d40b2580 0x7f19d414ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f19bc002f70 tx=0x7f19bc006eb0).stop 2021-10-20T23:20:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 -- 172.21.15.12:0/3776408075 shutdown_connections 2021-10-20T23:20:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 --2- 172.21.15.12:0/3776408075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40a8ac0 0x7f19d414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 --2- 172.21.15.12:0/3776408075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19d40b2580 0x7f19d414ae40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 -- 172.21.15.12:0/3776408075 >> 172.21.15.12:0/3776408075 conn(0x7f19d4060180 msgr2=0x7f19d40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 -- 172.21.15.12:0/3776408075 shutdown_connections 2021-10-20T23:20:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 -- 172.21.15.12:0/3776408075 wait complete. 2021-10-20T23:20:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 Processor -- start 2021-10-20T23:20:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 -- start start 2021-10-20T23:20:28.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19d40a8ac0 0x7f19d41562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19d40b0010 0x7f19d411cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40b2580 0x7f19d40b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40ab620 con 0x7f19d40b0010 2021-10-20T23:20:28.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40ac050 con 0x7f19d40a8ac0 2021-10-20T23:20:28.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d415a610 con 0x7f19d40b2580 2021-10-20T23:20:28.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19d40b0010 0x7f19d411cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19d40b0010 0x7f19d411cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37802/0 (socket says 172.21.15.12:37802) 2021-10-20T23:20:28.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d27fc700 1 -- 172.21.15.12:0/3995299353 learned_addr learned my addr 172.21.15.12:0/3995299353 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:28.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d2ffd700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19d40a8ac0 0x7f19d41562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d37fe700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40b2580 0x7f19d40b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d27fc700 1 -- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40b2580 msgr2=0x7f19d40b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d27fc700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40b2580 0x7f19d40b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d27fc700 1 -- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19d40a8ac0 msgr2=0x7f19d41562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d27fc700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19d40a8ac0 0x7f19d41562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d27fc700 1 -- 172.21.15.12:0/3995299353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c400b180 con 0x7f19d40b0010 2021-10-20T23:20:28.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d37fe700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40b2580 0x7f19d40b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:28.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d27fc700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19d40b0010 0x7f19d411cf00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f19cc001250 tx=0x7f19cc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:28.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19cbfff700 1 -- 172.21.15.12:0/3995299353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19cc00f470 con 0x7f19d40b0010 2021-10-20T23:20:28.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19cbfff700 1 -- 172.21.15.12:0/3995299353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc00f5d0 con 0x7f19d40b0010 2021-10-20T23:20:28.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.792+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc00b1e0 con 0x7f19d40b0010 2021-10-20T23:20:28.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.796+0000 7f19cbfff700 1 -- 172.21.15.12:0/3995299353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19cc00f930 con 0x7f19d40b0010 2021-10-20T23:20:28.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.796+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d40abaf0 con 0x7f19d40b0010 2021-10-20T23:20:28.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.796+0000 7f19cbfff700 1 -- 172.21.15.12:0/3995299353 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f19cc019030 con 0x7f19d40b0010 2021-10-20T23:20:28.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.796+0000 7f19cbfff700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19b8053610 0x7f19b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:28.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.796+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d40abcb0 con 0x7f19d40b0010 2021-10-20T23:20:28.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.796+0000 7f19cbfff700 1 -- 172.21.15.12:0/3995299353 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f19cc06b140 con 0x7f19d40b0010 2021-10-20T23:20:28.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.796+0000 7f19d2ffd700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19b8053610 0x7f19b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:28.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.796+0000 7f19d2ffd700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19b8053610 0x7f19b8055ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f19bc01c000 tx=0x7f19bc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:28.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.800+0000 7f19cbfff700 1 -- 172.21.15.12:0/3995299353 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f19cc045eb0 con 0x7f19d40b0010 2021-10-20T23:20:28.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.968+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f19d4057350 con 0x7f19d40b0010 2021-10-20T23:20:28.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19cbfff700 1 -- 172.21.15.12:0/3995299353 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f19cc0170a0 con 0x7f19d40b0010 2021-10-20T23:20:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19b8053610 msgr2=0x7f19b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19b8053610 0x7f19b8055ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f19bc01c000 tx=0x7f19bc015000).stop 2021-10-20T23:20:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19d40b0010 msgr2=0x7f19d411cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19d40b0010 0x7f19d411cf00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f19cc001250 tx=0x7f19cc007de0).stop 2021-10-20T23:20:28.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 shutdown_connections 2021-10-20T23:20:28.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19b8053610 0x7f19b8055ad0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19d40b2580 0x7f19d40b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19d40b0010 0x7f19d411cf00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 --2- 172.21.15.12:0/3995299353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19d40a8ac0 0x7f19d41562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:28.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 >> 172.21.15.12:0/3995299353 conn(0x7f19d4060180 msgr2=0x7f19d40af210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:28.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 shutdown_connections 2021-10-20T23:20:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:28.976+0000 7f19d3fff700 1 -- 172.21.15.12:0/3995299353 wait complete. 2021-10-20T23:20:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:updated 2021-10-20T23:20:28.994 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2021-10-20T23:20:29.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.100+0000 7f380e374700 1 Processor -- start 2021-10-20T23:20:29.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.100+0000 7f380e374700 1 -- start start 2021-10-20T23:20:29.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38080b2580 0x7f38080abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b02e0 0x7f38080ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38080add80 con 0x7f38080b1260 2021-10-20T23:20:29.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080ae020 con 0x7f38080b2580 2021-10-20T23:20:29.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38080a9390 con 0x7f38080b02e0 2021-10-20T23:20:29.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380cb71700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f38080b1260 0x7f38080afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36404/0 (socket says 172.21.15.12:36404) 2021-10-20T23:20:29.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380cb71700 1 -- 172.21.15.12:0/3883217383 learned_addr learned my addr 172.21.15.12:0/3883217383 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:29.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380d372700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38080b2580 0x7f38080abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380db73700 1 --2- 172.21.15.12:0/3883217383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b02e0 0x7f38080ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f37f3fff700 1 -- 172.21.15.12:0/3883217383 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212155525 0 0) 0x7f38080add80 con 0x7f38080b1260 2021-10-20T23:20:29.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f37f3fff700 1 -- 172.21.15.12:0/3883217383 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37ec003260 con 0x7f38080b1260 2021-10-20T23:20:29.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380d372700 1 -- 172.21.15.12:0/3883217383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b02e0 msgr2=0x7f38080ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:29.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380d372700 1 --2- 172.21.15.12:0/3883217383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b02e0 0x7f38080ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380d372700 1 -- 172.21.15.12:0/3883217383 >> v1:172.21.15.12:6789/0 conn(0x7f38080b1260 legacy=0x7f38080afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380d372700 1 -- 172.21.15.12:0/3883217383 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080a9830 con 0x7f38080b2580 2021-10-20T23:20:29.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380d372700 1 --2- 172.21.15.12:0/3883217383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b2580 0x7f38080abb10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f3804002f70 tx=0x7f3804006df0).ready entity=mon.0 client_cookie=316817998c2b14d9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:29.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f37f3fff700 1 -- 172.21.15.12:0/3883217383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f380400d4a0 con 0x7f38080b2580 2021-10-20T23:20:29.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f37f3fff700 1 -- 172.21.15.12:0/3883217383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804000e90 con 0x7f38080b2580 2021-10-20T23:20:29.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f37f3fff700 1 -- 172.21.15.12:0/3883217383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f380400d7f0 con 0x7f38080b2580 2021-10-20T23:20:29.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 -- 172.21.15.12:0/3883217383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b2580 msgr2=0x7f38080abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 --2- 172.21.15.12:0/3883217383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b2580 0x7f38080abb10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f3804002f70 tx=0x7f3804006df0).stop 2021-10-20T23:20:29.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 -- 172.21.15.12:0/3883217383 shutdown_connections 2021-10-20T23:20:29.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 --2- 172.21.15.12:0/3883217383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b02e0 0x7f38080ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 --2- 172.21.15.12:0/3883217383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b2580 0x7f38080abb10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 -- 172.21.15.12:0/3883217383 >> 172.21.15.12:0/3883217383 conn(0x7f3808060180 msgr2=0x7f38080b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:29.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 -- 172.21.15.12:0/3883217383 shutdown_connections 2021-10-20T23:20:29.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.104+0000 7f380e374700 1 -- 172.21.15.12:0/3883217383 wait complete. 2021-10-20T23:20:29.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380e374700 1 Processor -- start 2021-10-20T23:20:29.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380e374700 1 -- start start 2021-10-20T23:20:29.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380e374700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38080b02e0 0x7f38080ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380e374700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b1260 0x7f3808155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380e374700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b2580 0x7f3808155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380e374700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3808155f50 con 0x7f38080b1260 2021-10-20T23:20:29.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380e374700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3808144650 con 0x7f38080b02e0 2021-10-20T23:20:29.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380e374700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3808145560 con 0x7f38080b2580 2021-10-20T23:20:29.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380cb71700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b1260 0x7f3808155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380cb71700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b1260 0x7f3808155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37816/0 (socket says 172.21.15.12:37816) 2021-10-20T23:20:29.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380d372700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38080b02e0 0x7f38080ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380cb71700 1 -- 172.21.15.12:0/4071888393 learned_addr learned my addr 172.21.15.12:0/4071888393 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:29.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380db73700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b2580 0x7f3808155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380cb71700 1 -- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b2580 msgr2=0x7f3808155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380cb71700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b2580 0x7f3808155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380cb71700 1 -- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38080b02e0 msgr2=0x7f38080ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380cb71700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38080b02e0 0x7f38080ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380cb71700 1 -- 172.21.15.12:0/4071888393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380400b180 con 0x7f38080b1260 2021-10-20T23:20:29.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.108+0000 7f380cb71700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b1260 0x7f3808155570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f37fc001110 tx=0x7f37fc007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f37faffd700 1 -- 172.21.15.12:0/4071888393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37fc0070d0 con 0x7f38080b1260 2021-10-20T23:20:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f37faffd700 1 -- 172.21.15.12:0/4071888393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc007230 con 0x7f38080b1260 2021-10-20T23:20:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3808145800 con 0x7f38080b1260 2021-10-20T23:20:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f37faffd700 1 -- 172.21.15.12:0/4071888393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37fc005610 con 0x7f38080b1260 2021-10-20T23:20:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38080abf70 con 0x7f38080b1260 2021-10-20T23:20:29.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f37faffd700 1 -- 172.21.15.12:0/4071888393 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f37fc01a060 con 0x7f38080b1260 2021-10-20T23:20:29.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e8003410 con 0x7f38080b1260 2021-10-20T23:20:29.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f37faffd700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37e4053610 0x7f37e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f37faffd700 1 -- 172.21.15.12:0/4071888393 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f37fc06aa40 con 0x7f38080b1260 2021-10-20T23:20:29.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f380d372700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37e4053610 0x7f37e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.112+0000 7f380d372700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37e4053610 0x7f37e4055ad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f380401a000 tx=0x7f3804014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:29.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.124+0000 7f37faffd700 1 -- 172.21.15.12:0/4071888393 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f37fc041d80 con 0x7f38080b1260 2021-10-20T23:20:29.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.292+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f37e8003c40 con 0x7f38080b1260 2021-10-20T23:20:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f37faffd700 1 -- 172.21.15.12:0/4071888393 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f37fc018070 con 0x7f38080b1260 2021-10-20T23:20:29.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37e4053610 msgr2=0x7f37e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37e4053610 0x7f37e4055ad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f380401a000 tx=0x7f3804014000).stop 2021-10-20T23:20:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b1260 msgr2=0x7f3808155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b1260 0x7f3808155570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f37fc001110 tx=0x7f37fc007aa0).stop 2021-10-20T23:20:29.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 shutdown_connections 2021-10-20T23:20:29.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37e4053610 0x7f37e4055ad0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38080b2580 0x7f3808155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38080b1260 0x7f3808155570 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 --2- 172.21.15.12:0/4071888393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38080b02e0 0x7f38080ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 >> 172.21.15.12:0/4071888393 conn(0x7f3808060180 msgr2=0x7f38080b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 shutdown_connections 2021-10-20T23:20:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.300+0000 7f380e374700 1 -- 172.21.15.12:0/4071888393 wait complete. 2021-10-20T23:20:29.310 INFO:teuthology.orchestra.run.smithi012.stderr:updated 2021-10-20T23:20:29.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2021-10-20T23:20:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.420+0000 7ff2f09a5700 1 Processor -- start 2021-10-20T23:20:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.420+0000 7ff2f09a5700 1 -- start start 2021-10-20T23:20:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 0x7ff2ec13e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2ec141790 0x7ff2ec13e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec0aaa90 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec141c20 con 0x7ff2ec141790 2021-10-20T23:20:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec140c90 con 0x7ff2ec0b2720 2021-10-20T23:20:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ebfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2ec141790 0x7ff2ec13e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2eaffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff2ec0b0ff0 0x7ff2ec141080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:43482/0 (socket says 172.21.15.12:43482) 2021-10-20T23:20:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 0x7ff2ec13e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2eaffd700 1 -- 172.21.15.12:0/4139008772 learned_addr learned my addr 172.21.15.12:0/4139008772 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ebfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2ec141790 0x7ff2ec13e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37826/0 (socket says 172.21.15.12:37826) 2021-10-20T23:20:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ebfff700 1 -- 172.21.15.12:0/4139008772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 msgr2=0x7ff2ec13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ebfff700 1 --2- 172.21.15.12:0/4139008772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 0x7ff2ec13e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ebfff700 1 -- 172.21.15.12:0/4139008772 >> v1:172.21.15.31:6789/0 conn(0x7ff2ec0b0ff0 legacy=0x7ff2ec141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/4139008772 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584200398 0 0) 0x7ff2e0001110 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ebfff700 1 -- 172.21.15.12:0/4139008772 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec0b2b00 con 0x7ff2ec141790 2021-10-20T23:20:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ebfff700 1 --2- 172.21.15.12:0/4139008772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec141790 0x7ff2ec13e520 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7ff2e40032f0 tx=0x7ff2e40091d0).ready entity=mon.0 client_cookie=777c4e07a5de691f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/4139008772 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e400b6c0 con 0x7ff2ec141790 2021-10-20T23:20:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/4139008772 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e400b820 con 0x7ff2ec141790 2021-10-20T23:20:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/4139008772 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e400b990 con 0x7ff2ec141790 2021-10-20T23:20:29.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 -- 172.21.15.12:0/4139008772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec141790 msgr2=0x7ff2ec13e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 --2- 172.21.15.12:0/4139008772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec141790 0x7ff2ec13e520 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7ff2e40032f0 tx=0x7ff2e40091d0).stop 2021-10-20T23:20:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 -- 172.21.15.12:0/4139008772 shutdown_connections 2021-10-20T23:20:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 --2- 172.21.15.12:0/4139008772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec141790 0x7ff2ec13e520 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 --2- 172.21.15.12:0/4139008772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 0x7ff2ec13e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 -- 172.21.15.12:0/4139008772 >> 172.21.15.12:0/4139008772 conn(0x7ff2ec060180 msgr2=0x7ff2ec0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 -- 172.21.15.12:0/4139008772 shutdown_connections 2021-10-20T23:20:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.424+0000 7ff2f09a5700 1 -- 172.21.15.12:0/4139008772 wait complete. 2021-10-20T23:20:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2f09a5700 1 Processor -- start 2021-10-20T23:20:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2f09a5700 1 -- start start 2021-10-20T23:20:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2f09a5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec0b0ff0 0x7ff2ec0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2f09a5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 0x7ff2ec142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2f09a5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ec141790 0x7ff2ec0b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2f09a5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec13c870 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2f09a5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec143c60 con 0x7ff2ec141790 2021-10-20T23:20:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2f09a5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec143f00 con 0x7ff2ec0b2720 2021-10-20T23:20:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec0b0ff0 0x7ff2ec0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec0b0ff0 0x7ff2ec0b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37828/0 (socket says 172.21.15.12:37828) 2021-10-20T23:20:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eb7fe700 1 -- 172.21.15.12:0/1386079734 learned_addr learned my addr 172.21.15.12:0/1386079734 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2ebfff700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ec141790 0x7ff2ec0b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eaffd700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 0x7ff2ec142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eb7fe700 1 -- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 msgr2=0x7ff2ec142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eb7fe700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 0x7ff2ec142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eb7fe700 1 -- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ec141790 msgr2=0x7ff2ec0b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eb7fe700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ec141790 0x7ff2ec0b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eb7fe700 1 -- 172.21.15.12:0/1386079734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4009470 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.428+0000 7ff2eb7fe700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec0b0ff0 0x7ff2ec0b4990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff2dc00c000 tx=0x7ff2dc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2e8ff9700 1 -- 172.21.15.12:0/1386079734 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2dc010780 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2e8ff9700 1 -- 172.21.15.12:0/1386079734 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc0108e0 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec1441a0 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2e8ff9700 1 -- 172.21.15.12:0/1386079734 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2dc010c40 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec14fef0 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec057350 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2e8ff9700 1 -- 172.21.15.12:0/1386079734 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2dc01c460 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2e8ff9700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2cc053640 0x7ff2cc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2e8ff9700 1 -- 172.21.15.12:0/1386079734 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ff2dc06bb50 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.432+0000 7ff2eaffd700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2cc053640 0x7ff2cc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.436+0000 7ff2eaffd700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2cc053640 0x7ff2cc055b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7ff2e000d000 tx=0x7ff2e0007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:29.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.440+0000 7ff2e8ff9700 1 -- 172.21.15.12:0/1386079734 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2dc042d90 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.608+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff2ec0698e0 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2e8ff9700 1 -- 172.21.15.12:0/1386079734 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff2dc0463b0 con 0x7ff2ec0b0ff0 2021-10-20T23:20:29.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2cc053640 msgr2=0x7ff2cc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2cc053640 0x7ff2cc055b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7ff2e000d000 tx=0x7ff2e0007860).stop 2021-10-20T23:20:29.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec0b0ff0 msgr2=0x7ff2ec0b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec0b0ff0 0x7ff2ec0b4990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff2dc00c000 tx=0x7ff2dc006df0).stop 2021-10-20T23:20:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 shutdown_connections 2021-10-20T23:20:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2cc053640 0x7ff2cc055b00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ec141790 0x7ff2ec0b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0b2720 0x7ff2ec142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 --2- 172.21.15.12:0/1386079734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2ec0b0ff0 0x7ff2ec0b4990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 >> 172.21.15.12:0/1386079734 conn(0x7ff2ec060180 msgr2=0x7ff2ec0aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:29.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 shutdown_connections 2021-10-20T23:20:29.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.616+0000 7ff2f09a5700 1 -- 172.21.15.12:0/1386079734 wait complete. 2021-10-20T23:20:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:updated 2021-10-20T23:20:29.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2021-10-20T23:20:29.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.740+0000 7f45deda3700 1 Processor -- start 2021-10-20T23:20:29.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.740+0000 7f45deda3700 1 -- start start 2021-10-20T23:20:29.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80ad5c0 0x7f45d8061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d80aecf0 con 0x7f45d8140440 2021-10-20T23:20:29.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d80b6f20 con 0x7f45d8061320 2021-10-20T23:20:29.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80aef20 con 0x7f45d80ad5c0 2021-10-20T23:20:29.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45de5a2700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f45d8140440 0x7f45d8146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36434/0 (socket says 172.21.15.12:36434) 2021-10-20T23:20:29.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45de5a2700 1 -- 172.21.15.12:0/1206387757 learned_addr learned my addr 172.21.15.12:0/1206387757 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:29.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dd5a0700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80ad5c0 0x7f45d8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141643040 0 0) 0x7f45d80aecf0 con 0x7f45d8140440 2021-10-20T23:20:29.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c0003260 con 0x7f45d8140440 2021-10-20T23:20:29.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2036497207 0 0) 0x7f45c0003260 con 0x7f45d8140440 2021-10-20T23:20:29.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80ad5c0 msgr2=0x7f45d8061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:29.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80ad5c0 0x7f45d8061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 >> v1:172.21.15.31:6789/0 conn(0x7f45d8061320 legacy=0x7f45d80b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80af1c0 con 0x7f45d8140440 2021-10-20T23:20:29.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f45d00019e0 con 0x7f45d8140440 2021-10-20T23:20:29.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 >> v1:172.21.15.12:6789/0 conn(0x7f45d8140440 legacy=0x7f45d8146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45c0003780 0x7f45c0003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45c0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80ad5c0 0x7f45c0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80aef20 con 0x7f45c0004500 2021-10-20T23:20:29.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c000b800 con 0x7f45c0003780 2021-10-20T23:20:29.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c000b9c0 con 0x7f45d80ad5c0 2021-10-20T23:20:29.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dd5a0700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45c0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45ddda1700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45c0003780 0x7f45c0003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45de5a2700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80ad5c0 0x7f45c0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dd5a0700 1 -- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80ad5c0 msgr2=0x7f45c0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:29.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dd5a0700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80ad5c0 0x7f45c0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dd5a0700 1 -- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45c0003780 msgr2=0x7f45c0003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:29.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dd5a0700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45c0003780 0x7f45c0003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dd5a0700 1 -- 172.21.15.12:0/1206387757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c0003260 con 0x7f45c0004500 2021-10-20T23:20:29.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45de5a2700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80ad5c0 0x7f45c0004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:29.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dd5a0700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45c0004980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f45d400c000 tx=0x7f45d4006df0).ready entity=mon.0 client_cookie=dc5afac740a406b0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:29.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d400e830 con 0x7f45c0004500 2021-10-20T23:20:29.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d400e990 con 0x7f45c0004500 2021-10-20T23:20:29.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45dcd9f700 1 -- 172.21.15.12:0/1206387757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d400ecf0 con 0x7f45c0004500 2021-10-20T23:20:29.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 -- 172.21.15.12:0/1206387757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 msgr2=0x7f45c0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 --2- 172.21.15.12:0/1206387757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45c0004980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f45d400c000 tx=0x7f45d4006df0).stop 2021-10-20T23:20:29.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45de5a2700 1 -- 172.21.15.12:0/1206387757 reap_dead start 2021-10-20T23:20:29.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 -- 172.21.15.12:0/1206387757 shutdown_connections 2021-10-20T23:20:29.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 -- 172.21.15.12:0/1206387757 >> 172.21.15.12:0/1206387757 conn(0x7f45d8066de0 msgr2=0x7f45d80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:29.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 -- 172.21.15.12:0/1206387757 shutdown_connections 2021-10-20T23:20:29.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.744+0000 7f45deda3700 1 -- 172.21.15.12:0/1206387757 wait complete. 2021-10-20T23:20:29.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 Processor -- start 2021-10-20T23:20:29.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 -- start start 2021-10-20T23:20:29.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45d80b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80aff10 0x7f45d8155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45d813e780 0x7f45d813ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80b3a70 con 0x7f45c0004500 2021-10-20T23:20:29.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80abc10 con 0x7f45d813e780 2021-10-20T23:20:29.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80b3ca0 con 0x7f45d80aff10 2021-10-20T23:20:29.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45ddda1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45d80b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45ddda1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45d80b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37848/0 (socket says 172.21.15.12:37848) 2021-10-20T23:20:29.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45ddda1700 1 -- 172.21.15.12:0/2714580895 learned_addr learned my addr 172.21.15.12:0/2714580895 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:29.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45dd5a0700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80aff10 0x7f45d8155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45de5a2700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45d813e780 0x7f45d813ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45ddda1700 1 -- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80aff10 msgr2=0x7f45d8155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45ddda1700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80aff10 0x7f45d8155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45ddda1700 1 -- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45d813e780 msgr2=0x7f45d813ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:29.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45ddda1700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45d813e780 0x7f45d813ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:29.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45ddda1700 1 -- 172.21.15.12:0/2714580895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80ac4e0 con 0x7f45c0004500 2021-10-20T23:20:29.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45de5a2700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45d813e780 0x7f45d813ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:29.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45ddda1700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45d80b7c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f45c800b000 tx=0x7f45c8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:29.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45c6ffd700 1 -- 172.21.15.12:0/2714580895 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45c8014620 con 0x7f45c0004500 2021-10-20T23:20:29.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45c6ffd700 1 -- 172.21.15.12:0/2714580895 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c8014780 con 0x7f45c0004500 2021-10-20T23:20:29.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d80ac780 con 0x7f45c0004500 2021-10-20T23:20:29.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45c6ffd700 1 -- 172.21.15.12:0/2714580895 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45c8014ae0 con 0x7f45c0004500 2021-10-20T23:20:29.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d80b33e0 con 0x7f45c0004500 2021-10-20T23:20:29.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45c6ffd700 1 -- 172.21.15.12:0/2714580895 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45c8014c40 con 0x7f45c0004500 2021-10-20T23:20:29.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.748+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d80b02f0 con 0x7f45c0004500 2021-10-20T23:20:29.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.752+0000 7f45c6ffd700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45b8053640 0x7f45b8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:29.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.752+0000 7f45c6ffd700 1 -- 172.21.15.12:0/2714580895 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f45c806b8b0 con 0x7f45c0004500 2021-10-20T23:20:29.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.752+0000 7f45dd5a0700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45b8053640 0x7f45b8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:29.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.752+0000 7f45dd5a0700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45b8053640 0x7f45b8055b00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f45d400c000 tx=0x7f45d4019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:29.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.752+0000 7f45c6ffd700 1 -- 172.21.15.12:0/2714580895 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45c8042ae0 con 0x7f45c0004500 2021-10-20T23:20:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.924+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f45d80af460 con 0x7f45c0004500 2021-10-20T23:20:30.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.928+0000 7f45c6ffd700 1 -- 172.21.15.12:0/2714580895 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f45c8046100 con 0x7f45c0004500 2021-10-20T23:20:30.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45b8053640 msgr2=0x7f45b8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45b8053640 0x7f45b8055b00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f45d400c000 tx=0x7f45d4019000).stop 2021-10-20T23:20:30.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 msgr2=0x7f45d80b7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45d80b7c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f45c800b000 tx=0x7f45c8009040).stop 2021-10-20T23:20:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 shutdown_connections 2021-10-20T23:20:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45b8053640 0x7f45b8055b00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45d813e780 0x7f45d813ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45d80aff10 0x7f45d8155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 --2- 172.21.15.12:0/2714580895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c0004500 0x7f45d80b7c60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 >> 172.21.15.12:0/2714580895 conn(0x7f45d8066de0 msgr2=0x7f45d813fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:30.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 shutdown_connections 2021-10-20T23:20:30.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:29.932+0000 7f45deda3700 1 -- 172.21.15.12:0/2714580895 wait complete. 2021-10-20T23:20:30.162 INFO:teuthology.orchestra.run.smithi012.stderr:updated 2021-10-20T23:20:30.162 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2021-10-20T23:20:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f827584f700 1 Processor -- start 2021-10-20T23:20:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f827584f700 1 -- start start 2021-10-20T23:20:30.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f827584f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700b1db0 0x7f82700b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f827584f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82701483a0 0x7f82700b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f827584f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82700b0350 con 0x7f82700a70c0 2021-10-20T23:20:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f827584f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82700a90c0 con 0x7f82701483a0 2021-10-20T23:20:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f827584f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82700b05f0 con 0x7f82700b1db0 2021-10-20T23:20:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82701483a0 0x7f82700b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82701483a0 0x7f82700b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37856/0 (socket says 172.21.15.12:37856) 2021-10-20T23:20:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826e7fc700 1 -- 172.21.15.12:0/4099631570 learned_addr learned my addr 172.21.15.12:0/4099631570 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826f7fe700 1 --1- 172.21.15.12:0/4099631570 >> v1:172.21.15.12:6789/0 conn(0x7f82700a70c0 0x7f8270144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36452/0 (socket says 172.21.15.12:36452) 2021-10-20T23:20:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826effd700 1 --2- 172.21.15.12:0/4099631570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700b1db0 0x7f82700b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826e7fc700 1 -- 172.21.15.12:0/4099631570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700b1db0 msgr2=0x7f82700b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:30.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826e7fc700 1 --2- 172.21.15.12:0/4099631570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700b1db0 0x7f82700b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826e7fc700 1 -- 172.21.15.12:0/4099631570 >> v1:172.21.15.12:6789/0 conn(0x7f82700a70c0 legacy=0x7f8270144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826e7fc700 1 -- 172.21.15.12:0/4099631570 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82700b0890 con 0x7f82701483a0 2021-10-20T23:20:30.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826dffb700 1 -- 172.21.15.12:0/4099631570 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707729250 0 0) 0x7f82700b0350 con 0x7f82700a70c0 2021-10-20T23:20:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.273+0000 7f826e7fc700 1 --2- 172.21.15.12:0/4099631570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 0x7f82700b2190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f82600032f0 tx=0x7f8260009290).ready entity=mon.0 client_cookie=dfc9131214e570e3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f826dffb700 1 -- 172.21.15.12:0/4099631570 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f826000b8a0 con 0x7f82701483a0 2021-10-20T23:20:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f826dffb700 1 -- 172.21.15.12:0/4099631570 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826000ba00 con 0x7f82701483a0 2021-10-20T23:20:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f826dffb700 1 -- 172.21.15.12:0/4099631570 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f826000bb70 con 0x7f82701483a0 2021-10-20T23:20:30.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 -- 172.21.15.12:0/4099631570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 msgr2=0x7f82700b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 --2- 172.21.15.12:0/4099631570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 0x7f82700b2190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f82600032f0 tx=0x7f8260009290).stop 2021-10-20T23:20:30.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 -- 172.21.15.12:0/4099631570 shutdown_connections 2021-10-20T23:20:30.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 --2- 172.21.15.12:0/4099631570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 0x7f82700b2190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 --2- 172.21.15.12:0/4099631570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700b1db0 0x7f82700b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 -- 172.21.15.12:0/4099631570 >> 172.21.15.12:0/4099631570 conn(0x7f827005f6b0 msgr2=0x7f827005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 -- 172.21.15.12:0/4099631570 shutdown_connections 2021-10-20T23:20:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 -- 172.21.15.12:0/4099631570 wait complete. 2021-10-20T23:20:30.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 Processor -- start 2021-10-20T23:20:30.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 -- start start 2021-10-20T23:20:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700a70c0 0x7f82700ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82700b1db0 0x7f82700ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 0x7f8270159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700aad30 con 0x7f82701483a0 2021-10-20T23:20:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700a9440 con 0x7f82700b1db0 2021-10-20T23:20:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.277+0000 7f827584f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82700aaf60 con 0x7f82700a70c0 2021-10-20T23:20:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 0x7f8270159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 0x7f8270159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37866/0 (socket says 172.21.15.12:37866) 2021-10-20T23:20:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826f7fe700 1 -- 172.21.15.12:0/614045770 learned_addr learned my addr 172.21.15.12:0/614045770 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826effd700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700a70c0 0x7f82700ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826e7fc700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82700b1db0 0x7f82700ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826f7fe700 1 -- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700a70c0 msgr2=0x7f82700ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826f7fe700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700a70c0 0x7f82700ab400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826f7fe700 1 -- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82700b1db0 msgr2=0x7f82700ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826f7fe700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82700b1db0 0x7f82700ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826f7fe700 1 -- 172.21.15.12:0/614045770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8260009530 con 0x7f82701483a0 2021-10-20T23:20:30.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826f7fe700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 0x7f8270159f00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f8268000bc0 tx=0x7f82680079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:30.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f825ffff700 1 -- 172.21.15.12:0/614045770 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82680070d0 con 0x7f82701483a0 2021-10-20T23:20:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f825ffff700 1 -- 172.21.15.12:0/614045770 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268007230 con 0x7f82701483a0 2021-10-20T23:20:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f825ffff700 1 -- 172.21.15.12:0/614045770 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8268005740 con 0x7f82701483a0 2021-10-20T23:20:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8270060350 con 0x7f82701483a0 2021-10-20T23:20:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827014a720 con 0x7f82701483a0 2021-10-20T23:20:30.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82700b0b30 con 0x7f82701483a0 2021-10-20T23:20:30.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f825ffff700 1 -- 172.21.15.12:0/614045770 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8268010070 con 0x7f82701483a0 2021-10-20T23:20:30.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f825ffff700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f824c053610 0x7f824c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f825ffff700 1 -- 172.21.15.12:0/614045770 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f826806ae90 con 0x7f82701483a0 2021-10-20T23:20:30.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.281+0000 7f826effd700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f824c053610 0x7f824c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.285+0000 7f826effd700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f824c053610 0x7f824c055ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f826400c000 tx=0x7f8264008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:30.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.289+0000 7f825ffff700 1 -- 172.21.15.12:0/614045770 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f82680421d0 con 0x7f82701483a0 2021-10-20T23:20:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.457+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f8270057350 con 0x7f82701483a0 2021-10-20T23:20:30.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.461+0000 7f825ffff700 1 -- 172.21.15.12:0/614045770 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f82680457f0 con 0x7f82701483a0 2021-10-20T23:20:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f824c053610 msgr2=0x7f824c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f824c053610 0x7f824c055ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f826400c000 tx=0x7f8264008040).stop 2021-10-20T23:20:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 msgr2=0x7f8270159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 0x7f8270159f00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f8268000bc0 tx=0x7f82680079e0).stop 2021-10-20T23:20:30.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 shutdown_connections 2021-10-20T23:20:30.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f824c053610 0x7f824c055ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82701483a0 0x7f8270159f00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82700b1db0 0x7f82700ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 --2- 172.21.15.12:0/614045770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82700a70c0 0x7f82700ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 >> 172.21.15.12:0/614045770 conn(0x7f827005f6b0 msgr2=0x7f82700b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:30.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 shutdown_connections 2021-10-20T23:20:30.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.465+0000 7f827584f700 1 -- 172.21.15.12:0/614045770 wait complete. 2021-10-20T23:20:30.473 INFO:teuthology.orchestra.run.smithi012.stderr:updated 2021-10-20T23:20:30.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2021-10-20T23:20:30.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28fdf44700 1 Processor -- start 2021-10-20T23:20:30.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28fdf44700 1 -- start start 2021-10-20T23:20:30.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28fdf44700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28f80b6900 0x7f28f81447c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28fdf44700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28f80aa080 0x7f28f8144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28fdf44700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f80b6ce0 con 0x7f28f805fdd0 2021-10-20T23:20:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28fdf44700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f80ac550 con 0x7f28f80aa080 2021-10-20T23:20:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28fdf44700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f80ac7f0 con 0x7f28f80b6900 2021-10-20T23:20:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28f80aa080 0x7f28f8144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28f80aa080 0x7f28f8144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37870/0 (socket says 172.21.15.12:37870) 2021-10-20T23:20:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f6ffd700 1 -- 172.21.15.12:0/3664948 learned_addr learned my addr 172.21.15.12:0/3664948 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f77fe700 1 --2- 172.21.15.12:0/3664948 >> v2:172.21.15.31:3300/0 conn(0x7f28f80b6900 0x7f28f81447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f6ffd700 1 -- 172.21.15.12:0/3664948 >> v2:172.21.15.31:3300/0 conn(0x7f28f80b6900 msgr2=0x7f28f81447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f6ffd700 1 --2- 172.21.15.12:0/3664948 >> v2:172.21.15.31:3300/0 conn(0x7f28f80b6900 0x7f28f81447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f6ffd700 1 -- 172.21.15.12:0/3664948 >> v1:172.21.15.31:6789/0 conn(0x7f28f805fdd0 legacy=0x7f28f814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f6ffd700 1 -- 172.21.15.12:0/3664948 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80aca90 con 0x7f28f80aa080 2021-10-20T23:20:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f6ffd700 1 --2- 172.21.15.12:0/3664948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80aa080 0x7f28f8144cb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f28e0002f70 tx=0x7f28e0006eb0).ready entity=mon.0 client_cookie=76da81792b6c5bc8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.581+0000 7f28f67fc700 1 -- 172.21.15.12:0/3664948 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e000d610 con 0x7f28f80aa080 2021-10-20T23:20:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28f67fc700 1 -- 172.21.15.12:0/3664948 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e0000e90 con 0x7f28f80aa080 2021-10-20T23:20:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28f67fc700 1 -- 172.21.15.12:0/3664948 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e000d9a0 con 0x7f28f80aa080 2021-10-20T23:20:30.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 -- 172.21.15.12:0/3664948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80aa080 msgr2=0x7f28f8144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 --2- 172.21.15.12:0/3664948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80aa080 0x7f28f8144cb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f28e0002f70 tx=0x7f28e0006eb0).stop 2021-10-20T23:20:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 -- 172.21.15.12:0/3664948 shutdown_connections 2021-10-20T23:20:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 --2- 172.21.15.12:0/3664948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80aa080 0x7f28f8144cb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 --2- 172.21.15.12:0/3664948 >> v2:172.21.15.31:3300/0 conn(0x7f28f80b6900 0x7f28f81447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 -- 172.21.15.12:0/3664948 >> 172.21.15.12:0/3664948 conn(0x7f28f80b3480 msgr2=0x7f28f80b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 -- 172.21.15.12:0/3664948 shutdown_connections 2021-10-20T23:20:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 -- 172.21.15.12:0/3664948 wait complete. 2021-10-20T23:20:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 Processor -- start 2021-10-20T23:20:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 -- start start 2021-10-20T23:20:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28f805fdd0 0x7f28f8149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28f80aa080 0x7f28f80af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80b6900 0x7f28f815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f814a610 con 0x7f28f80b6900 2021-10-20T23:20:30.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f8159fe0 con 0x7f28f80aa080 2021-10-20T23:20:30.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.585+0000 7f28fdf44700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f815a280 con 0x7f28f805fdd0 2021-10-20T23:20:30.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80b6900 0x7f28f815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80b6900 0x7f28f815a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37880/0 (socket says 172.21.15.12:37880) 2021-10-20T23:20:30.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f7fff700 1 -- 172.21.15.12:0/3084519739 learned_addr learned my addr 172.21.15.12:0/3084519739 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:30.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f77fe700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28f805fdd0 0x7f28f8149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f6ffd700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28f80aa080 0x7f28f80af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f7fff700 1 -- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28f805fdd0 msgr2=0x7f28f8149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f7fff700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28f805fdd0 0x7f28f8149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f7fff700 1 -- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28f80aa080 msgr2=0x7f28f80af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f7fff700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28f80aa080 0x7f28f80af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f7fff700 1 -- 172.21.15.12:0/3084519739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e000b1e0 con 0x7f28f80b6900 2021-10-20T23:20:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f7fff700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80b6900 0x7f28f815a720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f28f80b5dc0 tx=0x7f28f0007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f4ff9700 1 -- 172.21.15.12:0/3084519739 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f0002490 con 0x7f28f80b6900 2021-10-20T23:20:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f4ff9700 1 -- 172.21.15.12:0/3084519739 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f00025f0 con 0x7f28f80b6900 2021-10-20T23:20:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f814a360 con 0x7f28f80b6900 2021-10-20T23:20:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f4ff9700 1 -- 172.21.15.12:0/3084519739 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f0002950 con 0x7f28f80b6900 2021-10-20T23:20:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f80afa60 con 0x7f28f80b6900 2021-10-20T23:20:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f815a440 con 0x7f28f80b6900 2021-10-20T23:20:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.589+0000 7f28f4ff9700 1 -- 172.21.15.12:0/3084519739 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f28f0010030 con 0x7f28f80b6900 2021-10-20T23:20:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.593+0000 7f28f4ff9700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28dc0534f0 0x7f28dc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.593+0000 7f28f4ff9700 1 -- 172.21.15.12:0/3084519739 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f28f006b8a0 con 0x7f28f80b6900 2021-10-20T23:20:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.593+0000 7f28f77fe700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28dc0534f0 0x7f28dc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.593+0000 7f28f77fe700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28dc0534f0 0x7f28dc0559b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f28e800c000 tx=0x7f28e8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.597+0000 7f28f4ff9700 1 -- 172.21.15.12:0/3084519739 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28f0042b80 con 0x7f28f80b6900 2021-10-20T23:20:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.765+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f28f8064d40 con 0x7f28f80b6900 2021-10-20T23:20:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.773+0000 7f28f4ff9700 1 -- 172.21.15.12:0/3084519739 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f28f00461a0 con 0x7f28f80b6900 2021-10-20T23:20:30.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28dc0534f0 msgr2=0x7f28dc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28dc0534f0 0x7f28dc0559b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f28e800c000 tx=0x7f28e8008040).stop 2021-10-20T23:20:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80b6900 msgr2=0x7f28f815a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80b6900 0x7f28f815a720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f28f80b5dc0 tx=0x7f28f0007f40).stop 2021-10-20T23:20:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 shutdown_connections 2021-10-20T23:20:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28dc0534f0 0x7f28dc0559b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f80b6900 0x7f28f815a720 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28f80aa080 0x7f28f80af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 --2- 172.21.15.12:0/3084519739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28f805fdd0 0x7f28f8149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 >> 172.21.15.12:0/3084519739 conn(0x7f28f80b3480 msgr2=0x7f28f8142dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 shutdown_connections 2021-10-20T23:20:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.777+0000 7f28fdf44700 1 -- 172.21.15.12:0/3084519739 wait complete. 2021-10-20T23:20:30.783 INFO:teuthology.orchestra.run.smithi012.stderr:updated 2021-10-20T23:20:30.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:30.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5ddec7700 1 Processor -- start 2021-10-20T23:20:30.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5ddec7700 1 -- start start 2021-10-20T23:20:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5ddec7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d805fc90 0x7fa5d813e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5ddec7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d80b1570 con 0x7fa5d80668c0 2021-10-20T23:20:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5ddec7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d8066ca0 con 0x7fa5d80b0cd0 2021-10-20T23:20:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5ddec7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d80b1370 con 0x7fa5d805fc90 2021-10-20T23:20:30.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5dcec5700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa5d80668c0 0x7fa5d80b21a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36480/0 (socket says 172.21.15.12:36480) 2021-10-20T23:20:30.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5dcec5700 1 -- 172.21.15.12:0/1233924497 learned_addr learned my addr 172.21.15.12:0/1233924497 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:30.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5dd6c6700 1 --2- 172.21.15.12:0/1233924497 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d805fc90 0x7fa5d813e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5d77fe700 1 -- 172.21.15.12:0/1233924497 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708735847 0 0) 0x7fa5d80b1570 con 0x7fa5d80668c0 2021-10-20T23:20:30.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5d77fe700 1 -- 172.21.15.12:0/1233924497 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c4003260 con 0x7fa5d80668c0 2021-10-20T23:20:30.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5d77fe700 1 -- 172.21.15.12:0/1233924497 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811548495 0 0) 0x7fa5d8066ca0 con 0x7fa5d80b0cd0 2021-10-20T23:20:30.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5dd6c6700 1 -- 172.21.15.12:0/1233924497 >> v1:172.21.15.31:6789/0 conn(0x7fa5d80b0cd0 legacy=0x7fa5d813daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5dd6c6700 1 -- 172.21.15.12:0/1233924497 >> v1:172.21.15.12:6789/0 conn(0x7fa5d80668c0 legacy=0x7fa5d80b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.893+0000 7fa5dd6c6700 1 -- 172.21.15.12:0/1233924497 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d805f830 con 0x7fa5d805fc90 2021-10-20T23:20:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5dd6c6700 1 --2- 172.21.15.12:0/1233924497 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d805fc90 0x7fa5d813e200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa5d00032f0 tx=0x7fa5d00091d0).ready entity=mon.2 client_cookie=ce4e9300d7f36566 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5d77fe700 1 -- 172.21.15.12:0/1233924497 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5d000b6c0 con 0x7fa5d805fc90 2021-10-20T23:20:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5d77fe700 1 -- 172.21.15.12:0/1233924497 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d000b820 con 0x7fa5d805fc90 2021-10-20T23:20:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5d77fe700 1 -- 172.21.15.12:0/1233924497 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5d000b990 con 0x7fa5d805fc90 2021-10-20T23:20:30.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5ddec7700 1 -- 172.21.15.12:0/1233924497 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d805fc90 msgr2=0x7fa5d813e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5ddec7700 1 --2- 172.21.15.12:0/1233924497 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d805fc90 0x7fa5d813e200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa5d00032f0 tx=0x7fa5d00091d0).stop 2021-10-20T23:20:30.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5ddec7700 1 -- 172.21.15.12:0/1233924497 shutdown_connections 2021-10-20T23:20:30.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5ddec7700 1 --2- 172.21.15.12:0/1233924497 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d805fc90 0x7fa5d813e200 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5ddec7700 1 -- 172.21.15.12:0/1233924497 >> 172.21.15.12:0/1233924497 conn(0x7fa5d8063670 msgr2=0x7fa5d8063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:30.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5ddec7700 1 -- 172.21.15.12:0/1233924497 shutdown_connections 2021-10-20T23:20:30.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5ddec7700 1 -- 172.21.15.12:0/1233924497 wait complete. 2021-10-20T23:20:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5ddec7700 1 Processor -- start 2021-10-20T23:20:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.897+0000 7fa5ddec7700 1 -- start start 2021-10-20T23:20:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5ddec7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d805fc90 0x7fa5d80accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5ddec7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5d80668c0 0x7fa5d80ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5ddec7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d80b0cd0 0x7fa5d8144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5ddec7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d8142c40 con 0x7fa5d80668c0 2021-10-20T23:20:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5ddec7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d8142000 con 0x7fa5d805fc90 2021-10-20T23:20:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5ddec7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d8142260 con 0x7fa5d80b0cd0 2021-10-20T23:20:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5d80668c0 0x7fa5d80ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5d80668c0 0x7fa5d80ac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37890/0 (socket says 172.21.15.12:37890) 2021-10-20T23:20:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d7fff700 1 -- 172.21.15.12:0/3406762429 learned_addr learned my addr 172.21.15.12:0/3406762429 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5dd6c6700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d80b0cd0 0x7fa5d8144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5dcec5700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d805fc90 0x7fa5d80accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d7fff700 1 -- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d80b0cd0 msgr2=0x7fa5d8144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d7fff700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d80b0cd0 0x7fa5d8144070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d7fff700 1 -- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d805fc90 msgr2=0x7fa5d80accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d7fff700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d805fc90 0x7fa5d80accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d7fff700 1 -- 172.21.15.12:0/3406762429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0009470 con 0x7fa5d80668c0 2021-10-20T23:20:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5dd6c6700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d80b0cd0 0x7fa5d8144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d7fff700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5d80668c0 0x7fa5d80ac080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fa5c8000bc0 tx=0x7fa5c8007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d5ffb700 1 -- 172.21.15.12:0/3406762429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5c8012400 con 0x7fa5d80668c0 2021-10-20T23:20:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d5ffb700 1 -- 172.21.15.12:0/3406762429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8012560 con 0x7fa5d80668c0 2021-10-20T23:20:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d8142500 con 0x7fa5d80668c0 2021-10-20T23:20:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5d5ffb700 1 -- 172.21.15.12:0/3406762429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5c80128c0 con 0x7fa5d80668c0 2021-10-20T23:20:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.901+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d80ac570 con 0x7fa5d80668c0 2021-10-20T23:20:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.905+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d80abaa0 con 0x7fa5d80668c0 2021-10-20T23:20:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.905+0000 7fa5d5ffb700 1 -- 172.21.15.12:0/3406762429 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa5c8019030 con 0x7fa5d80668c0 2021-10-20T23:20:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.905+0000 7fa5d5ffb700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5b80536d0 0x7fa5b8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.905+0000 7fa5d5ffb700 1 -- 172.21.15.12:0/3406762429 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa5c806a890 con 0x7fa5d80668c0 2021-10-20T23:20:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.905+0000 7fa5dcec5700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5b80536d0 0x7fa5b8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.905+0000 7fa5dcec5700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5b80536d0 0x7fa5b8055b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fa5cc00d000 tx=0x7fa5cc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:30.909+0000 7fa5d5ffb700 1 -- 172.21.15.12:0/3406762429 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa5d80abaa0 con 0x7fa5d80668c0 2021-10-20T23:20:31.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.037+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5d80abaa0 con 0x7fa5d80668c0 2021-10-20T23:20:31.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.037+0000 7fa5d5ffb700 1 -- 172.21.15.12:0/3406762429 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+13414 (secure 0 0 0) 0x7fa5c8024480 con 0x7fa5d80668c0 2021-10-20T23:20:31.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:31.041 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:20:28.301922+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:31.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.037+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5b80536d0 msgr2=0x7fa5b8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.037+0000 7fa5ddec7700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5b80536d0 0x7fa5b8055b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fa5cc00d000 tx=0x7fa5cc009040).stop 2021-10-20T23:20:31.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5d80668c0 msgr2=0x7fa5d80ac080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5d80668c0 0x7fa5d80ac080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fa5c8000bc0 tx=0x7fa5c8007a40).stop 2021-10-20T23:20:31.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 shutdown_connections 2021-10-20T23:20:31.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5b80536d0 0x7fa5b8055b90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d80b0cd0 0x7fa5d8144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5d80668c0 0x7fa5d80ac080 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 --2- 172.21.15.12:0/3406762429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d805fc90 0x7fa5d80accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 >> 172.21.15.12:0/3406762429 conn(0x7fa5d8063670 msgr2=0x7fa5d8063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:31.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 shutdown_connections 2021-10-20T23:20:31.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.041+0000 7fa5ddec7700 1 -- 172.21.15.12:0/3406762429 wait complete. 2021-10-20T23:20:31.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:20:31.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:20:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a359e700 1 Processor -- start 2021-10-20T23:20:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a359e700 1 -- start start 2021-10-20T23:20:31.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55a40b6290 0x7f55a4061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f55a40b4060 0x7f55a4061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a40b5f50 con 0x7f55a4061e50 2021-10-20T23:20:31.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40b1f70 con 0x7f55a40b6290 2021-10-20T23:20:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40b2210 con 0x7f55a40b4060 2021-10-20T23:20:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55a40b6290 0x7f55a4061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55a40b6290 0x7f55a4061470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37898/0 (socket says 172.21.15.12:37898) 2021-10-20T23:20:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a259c700 1 -- 172.21.15.12:0/1187647010 learned_addr learned my addr 172.21.15.12:0/1187647010 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a1d9b700 1 --2- 172.21.15.12:0/1187647010 >> v2:172.21.15.31:3300/0 conn(0x7f55a40b4060 0x7f55a4061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a259c700 1 -- 172.21.15.12:0/1187647010 >> v2:172.21.15.31:3300/0 conn(0x7f55a40b4060 msgr2=0x7f55a4061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.165+0000 7f55a259c700 1 --2- 172.21.15.12:0/1187647010 >> v2:172.21.15.31:3300/0 conn(0x7f55a40b4060 0x7f55a4061960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a259c700 1 -- 172.21.15.12:0/1187647010 >> v1:172.21.15.31:6789/0 conn(0x7f55a4061e50 legacy=0x7f55a4146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a259c700 1 -- 172.21.15.12:0/1187647010 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40b24b0 con 0x7f55a40b6290 2021-10-20T23:20:31.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a259c700 1 --2- 172.21.15.12:0/1187647010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 0x7f55a4061470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f5594002f70 tx=0x7f5594006eb0).ready entity=mon.0 client_cookie=7e2726d28030b9fe server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a159a700 1 -- 172.21.15.12:0/1187647010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559400d5c0 con 0x7f55a40b6290 2021-10-20T23:20:31.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a159a700 1 -- 172.21.15.12:0/1187647010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5594000e90 con 0x7f55a40b6290 2021-10-20T23:20:31.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a159a700 1 -- 172.21.15.12:0/1187647010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559400d950 con 0x7f55a40b6290 2021-10-20T23:20:31.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 -- 172.21.15.12:0/1187647010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 msgr2=0x7f55a4061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 --2- 172.21.15.12:0/1187647010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 0x7f55a4061470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f5594002f70 tx=0x7f5594006eb0).stop 2021-10-20T23:20:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 -- 172.21.15.12:0/1187647010 shutdown_connections 2021-10-20T23:20:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 --2- 172.21.15.12:0/1187647010 >> v2:172.21.15.31:3300/0 conn(0x7f55a40b4060 0x7f55a4061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 --2- 172.21.15.12:0/1187647010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 0x7f55a4061470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 -- 172.21.15.12:0/1187647010 >> 172.21.15.12:0/1187647010 conn(0x7f55a405c490 msgr2=0x7f55a405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:31.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 -- 172.21.15.12:0/1187647010 shutdown_connections 2021-10-20T23:20:31.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 -- 172.21.15.12:0/1187647010 wait complete. 2021-10-20T23:20:31.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 Processor -- start 2021-10-20T23:20:31.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.169+0000 7f55a359e700 1 -- start start 2021-10-20T23:20:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55a4061e50 0x7f55a40b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55a40b4060 0x7f55a413f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 0x7f55a412ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4143440 con 0x7f55a40b6290 2021-10-20T23:20:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41436e0 con 0x7f55a40b4060 2021-10-20T23:20:31.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4143980 con 0x7f55a4061e50 2021-10-20T23:20:31.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 0x7f55a412ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 0x7f55a412ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37908/0 (socket says 172.21.15.12:37908) 2021-10-20T23:20:31.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a2d9d700 1 -- 172.21.15.12:0/239199439 learned_addr learned my addr 172.21.15.12:0/239199439 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a1d9b700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55a40b4060 0x7f55a413f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a259c700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55a4061e50 0x7f55a40b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a2d9d700 1 -- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55a4061e50 msgr2=0x7f55a40b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a2d9d700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55a4061e50 0x7f55a40b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a2d9d700 1 -- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55a40b4060 msgr2=0x7f55a413f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a2d9d700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55a40b4060 0x7f55a413f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a2d9d700 1 -- 172.21.15.12:0/239199439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559400b1e0 con 0x7f55a40b6290 2021-10-20T23:20:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a259c700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55a4061e50 0x7f55a40b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a2d9d700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 0x7f55a412ab80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f55a40b2ad0 tx=0x7f559c007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f559b7fe700 1 -- 172.21.15.12:0/239199439 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559c013450 con 0x7f55a40b6290 2021-10-20T23:20:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f559b7fe700 1 -- 172.21.15.12:0/239199439 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c0135b0 con 0x7f55a40b6290 2021-10-20T23:20:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a4143c20 con 0x7f55a40b6290 2021-10-20T23:20:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f559b7fe700 1 -- 172.21.15.12:0/239199439 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559c013910 con 0x7f55a40b6290 2021-10-20T23:20:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a413f820 con 0x7f55a40b6290 2021-10-20T23:20:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.173+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a40b2750 con 0x7f55a40b6290 2021-10-20T23:20:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.177+0000 7f559b7fe700 1 -- 172.21.15.12:0/239199439 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f559c010070 con 0x7f55a40b6290 2021-10-20T23:20:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.177+0000 7f559b7fe700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f557c053640 0x7f557c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.177+0000 7f559b7fe700 1 -- 172.21.15.12:0/239199439 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f559c06ac60 con 0x7f55a40b6290 2021-10-20T23:20:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.177+0000 7f55a259c700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f557c053640 0x7f557c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.177+0000 7f55a259c700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f557c053640 0x7f557c055b00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f559401a000 tx=0x7f5594015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.181+0000 7f559b7fe700 1 -- 172.21.15.12:0/239199439 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f559c041f00 con 0x7f55a40b6290 2021-10-20T23:20:31.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.309+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f55a40b5f50 con 0x7f55a40b6290 2021-10-20T23:20:31.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f559b7fe700 1 -- 172.21.15.12:0/239199439 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v32) v1 ==== 110+0+10 (secure 0 0 0) 0x7f55a40b5f50 con 0x7f55a40b6290 2021-10-20T23:20:31.316 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:20:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f557c053640 msgr2=0x7f557c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f557c053640 0x7f557c055b00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f559401a000 tx=0x7f5594015000).stop 2021-10-20T23:20:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 msgr2=0x7f55a412ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 0x7f55a412ab80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f55a40b2ad0 tx=0x7f559c007bc0).stop 2021-10-20T23:20:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 shutdown_connections 2021-10-20T23:20:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f557c053640 0x7f557c055b00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a40b6290 0x7f55a412ab80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55a40b4060 0x7f55a413f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 --2- 172.21.15.12:0/239199439 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55a4061e50 0x7f55a40b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 >> 172.21.15.12:0/239199439 conn(0x7f55a405c490 msgr2=0x7f55a40b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:31.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 shutdown_connections 2021-10-20T23:20:31.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.313+0000 7f55a359e700 1 -- 172.21.15.12:0/239199439 wait complete. 2021-10-20T23:20:31.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:20:31.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63d65b8700 1 Processor -- start 2021-10-20T23:20:31.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63d65b8700 1 -- start start 2021-10-20T23:20:31.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63d65b8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f63d0146950 0x7f63d0140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63d65b8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63d00b4180 0x7f63d0140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63d65b8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d0143b60 con 0x7f63d00b4690 2021-10-20T23:20:31.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63d65b8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d0147510 con 0x7f63d00b4180 2021-10-20T23:20:31.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63d65b8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d0143e00 con 0x7f63d0146950 2021-10-20T23:20:31.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63c77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63d00b4180 0x7f63d0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63c77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63d00b4180 0x7f63d0140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37914/0 (socket says 172.21.15.12:37914) 2021-10-20T23:20:31.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63c77fe700 1 -- 172.21.15.12:0/3167280520 learned_addr learned my addr 172.21.15.12:0/3167280520 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:31.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63cffff700 1 --2- 172.21.15.12:0/3167280520 >> v2:172.21.15.31:3300/0 conn(0x7f63d0146950 0x7f63d0140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63c77fe700 1 -- 172.21.15.12:0/3167280520 >> v2:172.21.15.31:3300/0 conn(0x7f63d0146950 msgr2=0x7f63d0140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:31.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63c77fe700 1 --2- 172.21.15.12:0/3167280520 >> v2:172.21.15.31:3300/0 conn(0x7f63d0146950 0x7f63d0140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63c77fe700 1 -- 172.21.15.12:0/3167280520 >> v1:172.21.15.31:6789/0 conn(0x7f63d00b4690 legacy=0x7f63d00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63c77fe700 1 -- 172.21.15.12:0/3167280520 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00b0c90 con 0x7f63d00b4180 2021-10-20T23:20:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63c77fe700 1 --2- 172.21.15.12:0/3167280520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 0x7f63d0140720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f63b8002f70 tx=0x7f63b8006eb0).ready entity=mon.0 client_cookie=b6d3dd5743848a85 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63cf7fe700 1 -- 172.21.15.12:0/3167280520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b800d5c0 con 0x7f63d00b4180 2021-10-20T23:20:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63cf7fe700 1 -- 172.21.15.12:0/3167280520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8000e90 con 0x7f63d00b4180 2021-10-20T23:20:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.433+0000 7f63cf7fe700 1 -- 172.21.15.12:0/3167280520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b800d950 con 0x7f63d00b4180 2021-10-20T23:20:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 -- 172.21.15.12:0/3167280520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 msgr2=0x7f63d0140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 --2- 172.21.15.12:0/3167280520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 0x7f63d0140720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f63b8002f70 tx=0x7f63b8006eb0).stop 2021-10-20T23:20:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 -- 172.21.15.12:0/3167280520 shutdown_connections 2021-10-20T23:20:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 --2- 172.21.15.12:0/3167280520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 0x7f63d0140720 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 --2- 172.21.15.12:0/3167280520 >> v2:172.21.15.31:3300/0 conn(0x7f63d0146950 0x7f63d0140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 -- 172.21.15.12:0/3167280520 >> 172.21.15.12:0/3167280520 conn(0x7f63d005c490 msgr2=0x7f63d005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:31.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 -- 172.21.15.12:0/3167280520 shutdown_connections 2021-10-20T23:20:31.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 -- 172.21.15.12:0/3167280520 wait complete. 2021-10-20T23:20:31.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 Processor -- start 2021-10-20T23:20:31.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 -- start start 2021-10-20T23:20:31.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 0x7f63d00b8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00b4690 0x7f63d01455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d0146950 0x7f63d0145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0145fd0 con 0x7f63d00b4180 2021-10-20T23:20:31.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0155960 con 0x7f63d00b4690 2021-10-20T23:20:31.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d65b8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0155c00 con 0x7f63d0146950 2021-10-20T23:20:31.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63cffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 0x7f63d00b8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63cffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 0x7f63d00b8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37920/0 (socket says 172.21.15.12:37920) 2021-10-20T23:20:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63cffff700 1 -- 172.21.15.12:0/993366984 learned_addr learned my addr 172.21.15.12:0/993366984 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63c77fe700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00b4690 0x7f63d01455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63d4b55700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d0146950 0x7f63d0145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63cffff700 1 -- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d0146950 msgr2=0x7f63d0145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.437+0000 7f63cffff700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d0146950 0x7f63d0145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cffff700 1 -- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00b4690 msgr2=0x7f63d01455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cffff700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00b4690 0x7f63d01455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cffff700 1 -- 172.21.15.12:0/993366984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b800b1e0 con 0x7f63d00b4180 2021-10-20T23:20:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cffff700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 0x7f63d00b8680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f63c000c000 tx=0x7f63c0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cdffb700 1 -- 172.21.15.12:0/993366984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c0010780 con 0x7f63d00b4180 2021-10-20T23:20:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cdffb700 1 -- 172.21.15.12:0/993366984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c00108e0 con 0x7f63d00b4180 2021-10-20T23:20:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d0155ea0 con 0x7f63d00b4180 2021-10-20T23:20:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cdffb700 1 -- 172.21.15.12:0/993366984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c0010c40 con 0x7f63d00b4180 2021-10-20T23:20:31.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d00aed50 con 0x7f63d00b4180 2021-10-20T23:20:31.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d0057350 con 0x7f63d00b4180 2021-10-20T23:20:31.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cdffb700 1 -- 172.21.15.12:0/993366984 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63c001c460 con 0x7f63d00b4180 2021-10-20T23:20:31.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cdffb700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63b4053610 0x7f63b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63cdffb700 1 -- 172.21.15.12:0/993366984 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f63c006bbe0 con 0x7f63d00b4180 2021-10-20T23:20:31.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.441+0000 7f63c77fe700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63b4053610 0x7f63b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.445+0000 7f63c77fe700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63b4053610 0x7f63b4055ad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f63b801c000 tx=0x7f63b8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.445+0000 7f63cdffb700 1 -- 172.21.15.12:0/993366984 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63c0042e20 con 0x7f63d00b4180 2021-10-20T23:20:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.573+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f63d00698e0 con 0x7f63d00b4180 2021-10-20T23:20:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.573+0000 7f63cdffb700 1 -- 172.21.15.12:0/993366984 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63c0046440 con 0x7f63d00b4180 2021-10-20T23:20:31.578 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63b4053610 msgr2=0x7f63b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63b4053610 0x7f63b4055ad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f63b801c000 tx=0x7f63b8015000).stop 2021-10-20T23:20:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 msgr2=0x7f63d00b8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 0x7f63d00b8680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f63c000c000 tx=0x7f63c0006df0).stop 2021-10-20T23:20:31.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 shutdown_connections 2021-10-20T23:20:31.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63b4053610 0x7f63b4055ad0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d0146950 0x7f63d0145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00b4690 0x7f63d01455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 --2- 172.21.15.12:0/993366984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d00b4180 0x7f63d00b8680 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 >> 172.21.15.12:0/993366984 conn(0x7f63d005c490 msgr2=0x7f63d013b160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:31.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 shutdown_connections 2021-10-20T23:20:31.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.577+0000 7f63d65b8700 1 -- 172.21.15.12:0/993366984 wait complete. 2021-10-20T23:20:31.593 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:20:31.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.689+0000 7efc973e0700 1 Processor -- start 2021-10-20T23:20:31.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.689+0000 7efc973e0700 1 -- start start 2021-10-20T23:20:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc90061320 0x7efc90061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc900aecf0 con 0x7efc90140440 2021-10-20T23:20:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc900b6f20 con 0x7efc900ad5c0 2021-10-20T23:20:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc900aef20 con 0x7efc90061320 2021-10-20T23:20:31.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc96bdf700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efc90140440 0x7efc90146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36524/0 (socket says 172.21.15.12:36524) 2021-10-20T23:20:31.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc96bdf700 1 -- 172.21.15.12:0/3914234632 learned_addr learned my addr 172.21.15.12:0/3914234632 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:31.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc963de700 1 --2- 172.21.15.12:0/3914234632 >> v2:172.21.15.31:3300/0 conn(0x7efc90061320 0x7efc90061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc953dc700 1 -- 172.21.15.12:0/3914234632 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606023240 0 0) 0x7efc900aecf0 con 0x7efc90140440 2021-10-20T23:20:31.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc953dc700 1 -- 172.21.15.12:0/3914234632 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc78003260 con 0x7efc90140440 2021-10-20T23:20:31.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc963de700 1 -- 172.21.15.12:0/3914234632 >> v1:172.21.15.31:6789/0 conn(0x7efc900ad5c0 legacy=0x7efc900b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc963de700 1 -- 172.21.15.12:0/3914234632 >> v1:172.21.15.12:6789/0 conn(0x7efc90140440 legacy=0x7efc90146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc963de700 1 -- 172.21.15.12:0/3914234632 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900af1c0 con 0x7efc90061320 2021-10-20T23:20:31.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc963de700 1 --2- 172.21.15.12:0/3914234632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc90061320 0x7efc90061700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7efc900aeba0 tx=0x7efc8c006df0).ready entity=mon.1 client_cookie=8852b34639a6fb9c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc953dc700 1 -- 172.21.15.12:0/3914234632 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8c00d610 con 0x7efc90061320 2021-10-20T23:20:31.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc953dc700 1 -- 172.21.15.12:0/3914234632 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c000e90 con 0x7efc90061320 2021-10-20T23:20:31.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc953dc700 1 -- 172.21.15.12:0/3914234632 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8c00d960 con 0x7efc90061320 2021-10-20T23:20:31.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 -- 172.21.15.12:0/3914234632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc90061320 msgr2=0x7efc90061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 --2- 172.21.15.12:0/3914234632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc90061320 0x7efc90061700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7efc900aeba0 tx=0x7efc8c006df0).stop 2021-10-20T23:20:31.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 -- 172.21.15.12:0/3914234632 shutdown_connections 2021-10-20T23:20:31.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 --2- 172.21.15.12:0/3914234632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc90061320 0x7efc90061700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 -- 172.21.15.12:0/3914234632 >> 172.21.15.12:0/3914234632 conn(0x7efc90066de0 msgr2=0x7efc900671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:31.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 -- 172.21.15.12:0/3914234632 shutdown_connections 2021-10-20T23:20:31.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.693+0000 7efc973e0700 1 -- 172.21.15.12:0/3914234632 wait complete. 2021-10-20T23:20:31.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 Processor -- start 2021-10-20T23:20:31.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 -- start start 2021-10-20T23:20:31.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc90061320 0x7efc900b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc900ad5c0 0x7efc900b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc90140440 0x7efc900b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc900aaaa0 con 0x7efc900ad5c0 2021-10-20T23:20:31.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc900ab2b0 con 0x7efc90140440 2021-10-20T23:20:31.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc90143bd0 con 0x7efc90061320 2021-10-20T23:20:31.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc95bdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc900ad5c0 0x7efc900b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc963de700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc90061320 0x7efc900b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc95bdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc900ad5c0 0x7efc900b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37934/0 (socket says 172.21.15.12:37934) 2021-10-20T23:20:31.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc95bdd700 1 -- 172.21.15.12:0/1316921185 learned_addr learned my addr 172.21.15.12:0/1316921185 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:31.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc96bdf700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc90140440 0x7efc900b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc95bdd700 1 -- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc90061320 msgr2=0x7efc900b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc95bdd700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc90061320 0x7efc900b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc95bdd700 1 -- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc90140440 msgr2=0x7efc900b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc95bdd700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc90140440 0x7efc900b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc95bdd700 1 -- 172.21.15.12:0/1316921185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c00b180 con 0x7efc900ad5c0 2021-10-20T23:20:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc963de700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc90061320 0x7efc900b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc95bdd700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc900ad5c0 0x7efc900b33e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7efc900af7e0 tx=0x7efc80007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc7f7fe700 1 -- 172.21.15.12:0/1316921185 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc80007030 con 0x7efc900ad5c0 2021-10-20T23:20:31.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc7f7fe700 1 -- 172.21.15.12:0/1316921185 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80007190 con 0x7efc900ad5c0 2021-10-20T23:20:31.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc900ab010 con 0x7efc900ad5c0 2021-10-20T23:20:31.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc7f7fe700 1 -- 172.21.15.12:0/1316921185 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc80006510 con 0x7efc900ad5c0 2021-10-20T23:20:31.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.697+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc900aa720 con 0x7efc900ad5c0 2021-10-20T23:20:31.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.701+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc900af460 con 0x7efc900ad5c0 2021-10-20T23:20:31.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.701+0000 7efc7f7fe700 1 -- 172.21.15.12:0/1316921185 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc80010030 con 0x7efc900ad5c0 2021-10-20T23:20:31.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.701+0000 7efc7f7fe700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc700534f0 0x7efc700559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.701+0000 7efc7f7fe700 1 -- 172.21.15.12:0/1316921185 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5600+0+0 (secure 0 0 0) 0x7efc8006b3d0 con 0x7efc900ad5c0 2021-10-20T23:20:31.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.701+0000 7efc963de700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc700534f0 0x7efc700559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.701+0000 7efc963de700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc700534f0 0x7efc700559b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7efc8c01a000 tx=0x7efc8c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.705+0000 7efc7f7fe700 1 -- 172.21.15.12:0/1316921185 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc80042600 con 0x7efc900ad5c0 2021-10-20T23:20:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efc90057350 con 0x7efc900ad5c0 2021-10-20T23:20:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc7f7fe700 1 -- 172.21.15.12:0/1316921185 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+143 (secure 0 0 0) 0x7efc80045c20 con 0x7efc900ad5c0 2021-10-20T23:20:31.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:31.840 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:20:31.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:31.841 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:20:31.841 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:20:31.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:20:31.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:20:31.842 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:20:31.842 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:20:31.843 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:20:31.843 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:20:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc700534f0 msgr2=0x7efc700559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc700534f0 0x7efc700559b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7efc8c01a000 tx=0x7efc8c014000).stop 2021-10-20T23:20:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc900ad5c0 msgr2=0x7efc900b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc900ad5c0 0x7efc900b33e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7efc900af7e0 tx=0x7efc80007bb0).stop 2021-10-20T23:20:31.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 shutdown_connections 2021-10-20T23:20:31.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc700534f0 0x7efc700559b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc90140440 0x7efc900b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc900ad5c0 0x7efc900b33e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 --2- 172.21.15.12:0/1316921185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc90061320 0x7efc900b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 >> 172.21.15.12:0/1316921185 conn(0x7efc90066de0 msgr2=0x7efc900671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 shutdown_connections 2021-10-20T23:20:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.837+0000 7efc973e0700 1 -- 172.21.15.12:0/1316921185 wait complete. 2021-10-20T23:20:31.853 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:20:31.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:20:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e5ad0700 1 Processor -- start 2021-10-20T23:20:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e5ad0700 1 -- start start 2021-10-20T23:20:31.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e5ad0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f83e0061680 0x7f83e00b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e5ad0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f83e00b4710 0x7f83e00ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e5ad0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e00b6910 con 0x7f83e01439a0 2021-10-20T23:20:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e5ad0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e00b9680 con 0x7f83e0061680 2021-10-20T23:20:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e5ad0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e00b6bb0 con 0x7f83e00b4710 2021-10-20T23:20:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e4ace700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f83e0061680 0x7f83e00b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e4ace700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f83e0061680 0x7f83e00b9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37940/0 (socket says 172.21.15.12:37940) 2021-10-20T23:20:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83e4ace700 1 -- 172.21.15.12:0/4271933590 learned_addr learned my addr 172.21.15.12:0/4271933590 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.961+0000 7f83dffff700 1 --2- 172.21.15.12:0/4271933590 >> v2:172.21.15.31:3300/0 conn(0x7f83e00b4710 0x7f83e00ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e4ace700 1 -- 172.21.15.12:0/4271933590 >> v2:172.21.15.31:3300/0 conn(0x7f83e00b4710 msgr2=0x7f83e00ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e4ace700 1 --2- 172.21.15.12:0/4271933590 >> v2:172.21.15.31:3300/0 conn(0x7f83e00b4710 0x7f83e00ba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e4ace700 1 -- 172.21.15.12:0/4271933590 >> v1:172.21.15.31:6789/0 conn(0x7f83e01439a0 legacy=0x7f83e013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e4ace700 1 -- 172.21.15.12:0/4271933590 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00b6e50 con 0x7f83e0061680 2021-10-20T23:20:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83dffff700 1 --2- 172.21.15.12:0/4271933590 >> v2:172.21.15.31:3300/0 conn(0x7f83e00b4710 0x7f83e00ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e4ace700 1 --2- 172.21.15.12:0/4271933590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 0x7f83e00b9d10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f83d4002f70 tx=0x7f83d4006eb0).ready entity=mon.0 client_cookie=f55088591f10c27e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83df7fe700 1 -- 172.21.15.12:0/4271933590 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d400d610 con 0x7f83e0061680 2021-10-20T23:20:31.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83df7fe700 1 -- 172.21.15.12:0/4271933590 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4000e90 con 0x7f83e0061680 2021-10-20T23:20:31.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83df7fe700 1 -- 172.21.15.12:0/4271933590 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d400d9a0 con 0x7f83e0061680 2021-10-20T23:20:31.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 -- 172.21.15.12:0/4271933590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 msgr2=0x7f83e00b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 --2- 172.21.15.12:0/4271933590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 0x7f83e00b9d10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f83d4002f70 tx=0x7f83d4006eb0).stop 2021-10-20T23:20:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 -- 172.21.15.12:0/4271933590 shutdown_connections 2021-10-20T23:20:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 --2- 172.21.15.12:0/4271933590 >> v2:172.21.15.31:3300/0 conn(0x7f83e00b4710 0x7f83e00ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 --2- 172.21.15.12:0/4271933590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 0x7f83e00b9d10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 -- 172.21.15.12:0/4271933590 >> 172.21.15.12:0/4271933590 conn(0x7f83e006adf0 msgr2=0x7f83e005f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 -- 172.21.15.12:0/4271933590 shutdown_connections 2021-10-20T23:20:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 -- 172.21.15.12:0/4271933590 wait complete. 2021-10-20T23:20:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 Processor -- start 2021-10-20T23:20:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.965+0000 7f83e5ad0700 1 -- start start 2021-10-20T23:20:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e5ad0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 0x7f83e0155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e5ad0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83e01439a0 0x7f83e013eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e5ad0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83e0146820 0x7f83e013f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e5ad0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0145f30 con 0x7f83e0061680 2021-10-20T23:20:31.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e5ad0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e00af9a0 con 0x7f83e0146820 2021-10-20T23:20:31.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e5ad0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e01565c0 con 0x7f83e01439a0 2021-10-20T23:20:31.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e4ace700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 0x7f83e0155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e4ace700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 0x7f83e0155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37946/0 (socket says 172.21.15.12:37946) 2021-10-20T23:20:31.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e4ace700 1 -- 172.21.15.12:0/1630677797 learned_addr learned my addr 172.21.15.12:0/1630677797 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:31.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e52cf700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83e0146820 0x7f83e013f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83dffff700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83e01439a0 0x7f83e013eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e4ace700 1 -- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83e01439a0 msgr2=0x7f83e013eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e4ace700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83e01439a0 0x7f83e013eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e4ace700 1 -- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83e0146820 msgr2=0x7f83e013f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:31.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e4ace700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83e0146820 0x7f83e013f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:31.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e4ace700 1 -- 172.21.15.12:0/1630677797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d400b1e0 con 0x7f83e0061680 2021-10-20T23:20:31.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e4ace700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 0x7f83e0155d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f83e00b03a0 tx=0x7f83d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83ddffb700 1 -- 172.21.15.12:0/1630677797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d4011760 con 0x7f83e0061680 2021-10-20T23:20:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83ddffb700 1 -- 172.21.15.12:0/1630677797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d40118c0 con 0x7f83e0061680 2021-10-20T23:20:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83ddffb700 1 -- 172.21.15.12:0/1630677797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d4011c20 con 0x7f83e0061680 2021-10-20T23:20:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e0156860 con 0x7f83e0061680 2021-10-20T23:20:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e00b0790 con 0x7f83e0061680 2021-10-20T23:20:31.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.969+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e0057350 con 0x7f83e0061680 2021-10-20T23:20:31.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.973+0000 7f83ddffb700 1 -- 172.21.15.12:0/1630677797 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f83d401a040 con 0x7f83e0061680 2021-10-20T23:20:31.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.973+0000 7f83ddffb700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f83c0053640 0x7f83c0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:31.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.973+0000 7f83ddffb700 1 -- 172.21.15.12:0/1630677797 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f83d406c510 con 0x7f83e0061680 2021-10-20T23:20:31.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.973+0000 7f83dffff700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f83c0053640 0x7f83c0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:31.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.973+0000 7f83dffff700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f83c0053640 0x7f83c0055b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f83d000c000 tx=0x7f83d0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:31.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:31.981+0000 7f83ddffb700 1 -- 172.21.15.12:0/1630677797 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83d4043950 con 0x7f83e0061680 2021-10-20T23:20:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.109+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f83e005d9d0 con 0x7f83e0061680 2021-10-20T23:20:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.797+0000 7f83ddffb700 1 -- 172.21.15.12:0/1630677797 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v33) v1 ==== 133+0+0 (secure 0 0 0) 0x7f83d4046e70 con 0x7f83e0061680 2021-10-20T23:20:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f83c0053640 msgr2=0x7f83c0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f83c0053640 0x7f83c0055b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f83d000c000 tx=0x7f83d0008040).stop 2021-10-20T23:20:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 msgr2=0x7f83e0155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 0x7f83e0155d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f83e00b03a0 tx=0x7f83d4015000).stop 2021-10-20T23:20:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 shutdown_connections 2021-10-20T23:20:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f83c0053640 0x7f83c0055b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83e0146820 0x7f83e013f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83e01439a0 0x7f83e013eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 --2- 172.21.15.12:0/1630677797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83e0061680 0x7f83e0155d80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:32.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 >> 172.21.15.12:0/1630677797 conn(0x7f83e006adf0 msgr2=0x7f83e013ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.801+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 shutdown_connections 2021-10-20T23:20:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.805+0000 7f83e5ad0700 1 -- 172.21.15.12:0/1630677797 wait complete. 2021-10-20T23:20:32.817 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:20:32.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:20:32.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f6897098700 1 Processor -- start 2021-10-20T23:20:32.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f6897098700 1 -- start start 2021-10-20T23:20:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f6897098700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f68900affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f6897098700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68900a77d0 con 0x7f68900b1ec0 2021-10-20T23:20:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f6897098700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68900b0650 con 0x7f68900b22a0 2021-10-20T23:20:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f6897098700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68900b1740 con 0x7f68900b12d0 2021-10-20T23:20:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f6894e34700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f68900b1ec0 0x7f68900a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36548/0 (socket says 172.21.15.12:36548) 2021-10-20T23:20:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f6894e34700 1 -- 172.21.15.12:0/516603961 learned_addr learned my addr 172.21.15.12:0/516603961 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290501175 0 0) 0x7f68900a77d0 con 0x7f68900b1ec0 2021-10-20T23:20:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688ffff700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f68900affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f687c003260 con 0x7f68900b1ec0 2021-10-20T23:20:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251259933 0 0) 0x7f68900b0650 con 0x7f68900b22a0 2021-10-20T23:20:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68900a77d0 con 0x7f68900b22a0 2021-10-20T23:20:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3280146658 0 0) 0x7f687c003260 con 0x7f68900b1ec0 2021-10-20T23:20:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 msgr2=0x7f68900affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688f7fe700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f68900affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 >> v1:172.21.15.31:6789/0 conn(0x7f68900b22a0 legacy=0x7f6890141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.925+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900b08f0 con 0x7f68900b1ec0 2021-10-20T23:20:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f68880019e0 con 0x7f68900b1ec0 2021-10-20T23:20:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 >> v1:172.21.15.12:6789/0 conn(0x7f68900b1ec0 legacy=0x7f68900a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f687c003910 0x7f687c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f687c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f687c0049f0 0x7f687c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900b1740 con 0x7f687c0049f0 2021-10-20T23:20:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c00b800 con 0x7f687c003910 2021-10-20T23:20:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c00b9c0 con 0x7f68900b12d0 2021-10-20T23:20:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6894e34700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f687c003910 0x7f687c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688ffff700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f687c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6895635700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f687c0049f0 0x7f687c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688ffff700 1 -- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f687c003910 msgr2=0x7f687c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688ffff700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f687c003910 0x7f687c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688ffff700 1 -- 172.21.15.12:0/516603961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f687c0049f0 msgr2=0x7f687c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688ffff700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f687c0049f0 0x7f687c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688ffff700 1 -- 172.21.15.12:0/516603961 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c003260 con 0x7f68900b12d0 2021-10-20T23:20:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6894e34700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f687c003910 0x7f687c003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688ffff700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f687c004500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f688400c000 tx=0x7f6884006df0).ready entity=mon.2 client_cookie=9c927e24b8e7d1d8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688400e830 con 0x7f68900b12d0 2021-10-20T23:20:32.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688400e990 con 0x7f68900b12d0 2021-10-20T23:20:32.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f688f7fe700 1 -- 172.21.15.12:0/516603961 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688400ecf0 con 0x7f68900b12d0 2021-10-20T23:20:32.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6897098700 1 -- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 msgr2=0x7f687c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:32.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6897098700 1 --2- 172.21.15.12:0/516603961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f687c004500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f688400c000 tx=0x7f6884006df0).stop 2021-10-20T23:20:32.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6895635700 1 -- 172.21.15.12:0/516603961 reap_dead start 2021-10-20T23:20:32.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6897098700 1 -- 172.21.15.12:0/516603961 shutdown_connections 2021-10-20T23:20:32.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6897098700 1 -- 172.21.15.12:0/516603961 >> 172.21.15.12:0/516603961 conn(0x7f689005f6b0 msgr2=0x7f689005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:32.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6897098700 1 -- 172.21.15.12:0/516603961 shutdown_connections 2021-10-20T23:20:32.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6897098700 1 -- 172.21.15.12:0/516603961 wait complete. 2021-10-20T23:20:32.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6897098700 1 Processor -- start 2021-10-20T23:20:32.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.929+0000 7f6897098700 1 -- start start 2021-10-20T23:20:32.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6897098700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f68900aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:32.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6897098700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f689015a210 0x7f689015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:32.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6897098700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6890138410 0x7f6890138890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:32.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6897098700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900ac240 con 0x7f6890138410 2021-10-20T23:20:32.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6897098700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900ad2d0 con 0x7f689015a210 2021-10-20T23:20:32.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6897098700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68900afb40 con 0x7f68900b12d0 2021-10-20T23:20:32.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6895635700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6890138410 0x7f6890138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:32.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6894e34700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f68900aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:32.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6895635700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6890138410 0x7f6890138890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37970/0 (socket says 172.21.15.12:37970) 2021-10-20T23:20:32.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6895635700 1 -- 172.21.15.12:0/4053213757 learned_addr learned my addr 172.21.15.12:0/4053213757 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:32.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f688ffff700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f689015a210 0x7f689015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:32.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6894e34700 1 -- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f689015a210 msgr2=0x7f689015a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:32.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6894e34700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f689015a210 0x7f689015a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:32.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6894e34700 1 -- 172.21.15.12:0/4053213757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6890138410 msgr2=0x7f6890138890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:32.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6894e34700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6890138410 0x7f6890138890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:32.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6894e34700 1 -- 172.21.15.12:0/4053213757 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689015ab80 con 0x7f68900b12d0 2021-10-20T23:20:32.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6894e34700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f68900aaf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f688800d000 tx=0x7f68900b07e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:32.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f688dffb700 1 -- 172.21.15.12:0/4053213757 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688800fb30 con 0x7f68900b12d0 2021-10-20T23:20:32.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f688dffb700 1 -- 172.21.15.12:0/4053213757 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688800fc90 con 0x7f68900b12d0 2021-10-20T23:20:32.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68900afdb0 con 0x7f68900b12d0 2021-10-20T23:20:32.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f688dffb700 1 -- 172.21.15.12:0/4053213757 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6888012350 con 0x7f68900b12d0 2021-10-20T23:20:32.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68900abba0 con 0x7f68900b12d0 2021-10-20T23:20:32.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68900b0b90 con 0x7f68900b12d0 2021-10-20T23:20:32.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.933+0000 7f688dffb700 1 -- 172.21.15.12:0/4053213757 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f688801b030 con 0x7f68900b12d0 2021-10-20T23:20:32.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.937+0000 7f688dffb700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68700536a0 0x7f6870055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:32.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.937+0000 7f688dffb700 1 -- 172.21.15.12:0/4053213757 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f688806b6e0 con 0x7f68900b12d0 2021-10-20T23:20:32.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.937+0000 7f688ffff700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68700536a0 0x7f6870055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:32.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.937+0000 7f688ffff700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68700536a0 0x7f6870055b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f688401e000 tx=0x7f6884019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:32.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:32.941+0000 7f688dffb700 1 -- 172.21.15.12:0/4053213757 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f68880427a0 con 0x7f68900b12d0 2021-10-20T23:20:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.073+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6890057350 con 0x7f68900b12d0 2021-10-20T23:20:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.805+0000 7f688dffb700 1 -- 172.21.15.12:0/4053213757 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v34) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6888019030 con 0x7f68900b12d0 2021-10-20T23:20:33.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68700536a0 msgr2=0x7f6870055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68700536a0 0x7f6870055b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f688401e000 tx=0x7f6884019000).stop 2021-10-20T23:20:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 msgr2=0x7f68900aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f68900aaf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f688800d000 tx=0x7f68900b07e0).stop 2021-10-20T23:20:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 shutdown_connections 2021-10-20T23:20:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68700536a0 0x7f6870055b60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6890138410 0x7f6890138890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f689015a210 0x7f689015a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 --2- 172.21.15.12:0/4053213757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68900b12d0 0x7f68900aaf10 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0x7f688800d000 tx=0x7f68900b07e0).stop 2021-10-20T23:20:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 >> 172.21.15.12:0/4053213757 conn(0x7f689005f6b0 msgr2=0x7f6890146df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 shutdown_connections 2021-10-20T23:20:33.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.813+0000 7f6897098700 1 -- 172.21.15.12:0/4053213757 wait complete. 2021-10-20T23:20:33.819 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:20:33.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:20:33.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff919393700 1 Processor -- start 2021-10-20T23:20:33.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff919393700 1 -- start start 2021-10-20T23:20:33.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff919393700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9140b2580 0x7ff91414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:33.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff919393700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9140a8ac0 0x7ff91414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:33.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff919393700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9140a70c0 con 0x7ff9140b0010 2021-10-20T23:20:33.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff919393700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9140a72f0 con 0x7ff9140a8ac0 2021-10-20T23:20:33.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff919393700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9140a7590 con 0x7ff9140b2580 2021-10-20T23:20:33.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff918b92700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9140a8ac0 0x7ff91414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:33.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff9137fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff9140b0010 0x7ff9140a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36568/0 (socket says 172.21.15.12:36568) 2021-10-20T23:20:33.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff9137fe700 1 -- 172.21.15.12:0/1090857940 learned_addr learned my addr 172.21.15.12:0/1090857940 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:33.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff913fff700 1 --2- 172.21.15.12:0/1090857940 >> v2:172.21.15.31:3300/0 conn(0x7ff9140b2580 0x7ff91414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:33.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.937+0000 7ff918b92700 1 -- 172.21.15.12:0/1090857940 >> v2:172.21.15.31:3300/0 conn(0x7ff9140b2580 msgr2=0x7ff91414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:33.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff918b92700 1 --2- 172.21.15.12:0/1090857940 >> v2:172.21.15.31:3300/0 conn(0x7ff9140b2580 0x7ff91414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:33.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff918b92700 1 -- 172.21.15.12:0/1090857940 >> v1:172.21.15.12:6789/0 conn(0x7ff9140b0010 legacy=0x7ff9140a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:33.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff912ffd700 1 -- 172.21.15.12:0/1090857940 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777947644 0 0) 0x7ff9140a70c0 con 0x7ff9140b0010 2021-10-20T23:20:33.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff918b92700 1 -- 172.21.15.12:0/1090857940 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9140a7830 con 0x7ff9140a8ac0 2021-10-20T23:20:33.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff913fff700 1 --2- 172.21.15.12:0/1090857940 >> v2:172.21.15.31:3300/0 conn(0x7ff9140b2580 0x7ff91414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:33.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff918b92700 1 --2- 172.21.15.12:0/1090857940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140a8ac0 0x7ff91414b330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff90c0032f0 tx=0x7ff90c0091d0).ready entity=mon.0 client_cookie=4fb9b8f395556943 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:33.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff912ffd700 1 -- 172.21.15.12:0/1090857940 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90c00b680 con 0x7ff9140a8ac0 2021-10-20T23:20:33.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff912ffd700 1 -- 172.21.15.12:0/1090857940 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c00b7e0 con 0x7ff9140a8ac0 2021-10-20T23:20:33.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff912ffd700 1 -- 172.21.15.12:0/1090857940 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90c00b950 con 0x7ff9140a8ac0 2021-10-20T23:20:33.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 -- 172.21.15.12:0/1090857940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140a8ac0 msgr2=0x7ff91414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:33.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 --2- 172.21.15.12:0/1090857940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140a8ac0 0x7ff91414b330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff90c0032f0 tx=0x7ff90c0091d0).stop 2021-10-20T23:20:33.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 -- 172.21.15.12:0/1090857940 shutdown_connections 2021-10-20T23:20:33.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 --2- 172.21.15.12:0/1090857940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140a8ac0 0x7ff91414b330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:33.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 --2- 172.21.15.12:0/1090857940 >> v2:172.21.15.31:3300/0 conn(0x7ff9140b2580 0x7ff91414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:33.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 -- 172.21.15.12:0/1090857940 >> 172.21.15.12:0/1090857940 conn(0x7ff914060180 msgr2=0x7ff9140b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:33.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 -- 172.21.15.12:0/1090857940 shutdown_connections 2021-10-20T23:20:33.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 -- 172.21.15.12:0/1090857940 wait complete. 2021-10-20T23:20:33.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 Processor -- start 2021-10-20T23:20:33.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.941+0000 7ff919393700 1 -- start start 2021-10-20T23:20:33.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff919393700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9140a8ac0 0x7ff9140a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:33.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff919393700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9140b0010 0x7ff914156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:33.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff919393700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140b2580 0x7ff9140aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:33.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff919393700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140b57f0 con 0x7ff9140b2580 2021-10-20T23:20:33.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff919393700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff914157210 con 0x7ff9140b0010 2021-10-20T23:20:33.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff919393700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140b5a50 con 0x7ff9140a8ac0 2021-10-20T23:20:33.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff918b92700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140b2580 0x7ff9140aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:33.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff913fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9140a8ac0 0x7ff9140a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:33.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff913fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9140a8ac0 0x7ff9140a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:43738/0 (socket says 172.21.15.12:43738) 2021-10-20T23:20:33.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff918b92700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140b2580 0x7ff9140aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37984/0 (socket says 172.21.15.12:37984) 2021-10-20T23:20:33.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff913fff700 1 -- 172.21.15.12:0/3530969321 learned_addr learned my addr 172.21.15.12:0/3530969321 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:33.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff9137fe700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9140b0010 0x7ff914156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:33.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff913fff700 1 -- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9140b0010 msgr2=0x7ff914156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:33.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff913fff700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9140b0010 0x7ff914156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:33.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff913fff700 1 -- 172.21.15.12:0/3530969321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140b2580 msgr2=0x7ff9140aa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:33.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff913fff700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140b2580 0x7ff9140aa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:33.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff913fff700 1 -- 172.21.15.12:0/3530969321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90800b180 con 0x7ff9140a8ac0 2021-10-20T23:20:33.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff918b92700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140b2580 0x7ff9140aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:33.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff913fff700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9140a8ac0 0x7ff9140a9480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff9140abac0 tx=0x7ff908006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:33.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff9117fa700 1 -- 172.21.15.12:0/3530969321 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff908010590 con 0x7ff9140a8ac0 2021-10-20T23:20:33.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff9117fa700 1 -- 172.21.15.12:0/3530969321 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9080106f0 con 0x7ff9140a8ac0 2021-10-20T23:20:33.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90c009470 con 0x7ff9140a8ac0 2021-10-20T23:20:33.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff9117fa700 1 -- 172.21.15.12:0/3530969321 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff908010a50 con 0x7ff9140a8ac0 2021-10-20T23:20:33.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff914063d60 con 0x7ff9140a8ac0 2021-10-20T23:20:33.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.945+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9140aa460 con 0x7ff9140a8ac0 2021-10-20T23:20:33.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.949+0000 7ff9117fa700 1 -- 172.21.15.12:0/3530969321 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff908010bb0 con 0x7ff9140a8ac0 2021-10-20T23:20:33.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.949+0000 7ff9117fa700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8f40536d0 0x7ff8f4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:33.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.949+0000 7ff9117fa700 1 -- 172.21.15.12:0/3530969321 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6304+0+0 (secure 0 0 0) 0x7ff90806bff0 con 0x7ff9140a8ac0 2021-10-20T23:20:33.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.949+0000 7ff9137fe700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8f40536d0 0x7ff8f4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:33.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.949+0000 7ff9137fe700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8f40536d0 0x7ff8f4055b90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7ff90400d000 tx=0x7ff9040011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:33.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:33.957+0000 7ff9117fa700 1 -- 172.21.15.12:0/3530969321 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff908042ee0 con 0x7ff9140a8ac0 2021-10-20T23:20:34.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.125+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7ff914057350 con 0x7ff9140a8ac0 2021-10-20T23:20:34.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.141+0000 7ff9117fa700 1 -- 172.21.15.12:0/3530969321 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 187+0+0 (secure 0 0 0) 0x7ff908046500 con 0x7ff9140a8ac0 2021-10-20T23:20:34.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.145+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8f40536d0 msgr2=0x7ff8f4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.145+0000 7ff919393700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8f40536d0 0x7ff8f4055b90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7ff90400d000 tx=0x7ff9040011a0).stop 2021-10-20T23:20:34.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9140a8ac0 msgr2=0x7ff9140a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9140a8ac0 0x7ff9140a9480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff9140abac0 tx=0x7ff908006df0).stop 2021-10-20T23:20:34.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 shutdown_connections 2021-10-20T23:20:34.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8f40536d0 0x7ff8f4055b90 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0x7ff90400d000 tx=0x7ff9040011a0).stop 2021-10-20T23:20:34.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9140b2580 0x7ff9140aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9140b0010 0x7ff914156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 --2- 172.21.15.12:0/3530969321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9140a8ac0 0x7ff9140a9480 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0x7ff9140abac0 tx=0x7ff908006df0).stop 2021-10-20T23:20:34.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 >> 172.21.15.12:0/3530969321 conn(0x7ff914060180 msgr2=0x7ff91414afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:34.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 shutdown_connections 2021-10-20T23:20:34.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.149+0000 7ff919393700 1 -- 172.21.15.12:0/3530969321 wait complete. 2021-10-20T23:20:34.153 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 5 and data pool 6 2021-10-20T23:20:34.164 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:34.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0aba54700 1 Processor -- start 2021-10-20T23:20:34.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0aba54700 1 -- start start 2021-10-20T23:20:34.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0aba54700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff0a4060100 0x7ff0a40b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0aba54700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff0a40b4c40 0x7ff0a414b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0aba54700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a40aabb0 con 0x7ff0a4067300 2021-10-20T23:20:34.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0aba54700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a40604e0 con 0x7ff0a4060100 2021-10-20T23:20:34.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0aba54700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a4066ea0 con 0x7ff0a40b4c40 2021-10-20T23:20:34.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a97f0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff0a4060100 0x7ff0a40b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a8fef700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff0a4067300 0x7ff0a41438f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36596/0 (socket says 172.21.15.12:36596) 2021-10-20T23:20:34.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a97f0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff0a4060100 0x7ff0a40b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38000/0 (socket says 172.21.15.12:38000) 2021-10-20T23:20:34.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a8fef700 1 -- 172.21.15.12:0/1939780214 learned_addr learned my addr 172.21.15.12:0/1939780214 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:34.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a9ff1700 1 --2- 172.21.15.12:0/1939780214 >> v2:172.21.15.31:3300/0 conn(0x7ff0a40b4c40 0x7ff0a414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a97f0700 1 -- 172.21.15.12:0/1939780214 >> v2:172.21.15.31:3300/0 conn(0x7ff0a40b4c40 msgr2=0x7ff0a414b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:34.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a97f0700 1 --2- 172.21.15.12:0/1939780214 >> v2:172.21.15.31:3300/0 conn(0x7ff0a40b4c40 0x7ff0a414b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a97f0700 1 -- 172.21.15.12:0/1939780214 >> v1:172.21.15.12:6789/0 conn(0x7ff0a4067300 legacy=0x7ff0a41438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a97f0700 1 -- 172.21.15.12:0/1939780214 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40b33b0 con 0x7ff0a4060100 2021-10-20T23:20:34.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.253+0000 7ff0a9ff1700 1 --2- 172.21.15.12:0/1939780214 >> v2:172.21.15.31:3300/0 conn(0x7ff0a40b4c40 0x7ff0a414b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:34.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0a97f0700 1 --2- 172.21.15.12:0/1939780214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a4060100 0x7ff0a40b4750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ff0940032f0 tx=0x7ff0940091d0).ready entity=mon.0 client_cookie=fb6781452315c29b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:34.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0a3fff700 1 -- 172.21.15.12:0/1939780214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff094009ea0 con 0x7ff0a4060100 2021-10-20T23:20:34.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0a3fff700 1 -- 172.21.15.12:0/1939780214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09400b870 con 0x7ff0a4060100 2021-10-20T23:20:34.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0a3fff700 1 -- 172.21.15.12:0/1939780214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff09400b9e0 con 0x7ff0a4060100 2021-10-20T23:20:34.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0aba54700 1 -- 172.21.15.12:0/1939780214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a4060100 msgr2=0x7ff0a40b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0aba54700 1 --2- 172.21.15.12:0/1939780214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a4060100 0x7ff0a40b4750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ff0940032f0 tx=0x7ff0940091d0).stop 2021-10-20T23:20:34.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0aba54700 1 -- 172.21.15.12:0/1939780214 shutdown_connections 2021-10-20T23:20:34.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0aba54700 1 --2- 172.21.15.12:0/1939780214 >> v2:172.21.15.31:3300/0 conn(0x7ff0a40b4c40 0x7ff0a414b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0aba54700 1 --2- 172.21.15.12:0/1939780214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a4060100 0x7ff0a40b4750 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0aba54700 1 -- 172.21.15.12:0/1939780214 >> 172.21.15.12:0/1939780214 conn(0x7ff0a405cf30 msgr2=0x7ff0a405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:34.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0aba54700 1 -- 172.21.15.12:0/1939780214 shutdown_connections 2021-10-20T23:20:34.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.257+0000 7ff0aba54700 1 -- 172.21.15.12:0/1939780214 wait complete. 2021-10-20T23:20:34.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 Processor -- start 2021-10-20T23:20:34.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 -- start start 2021-10-20T23:20:34.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0a4060100 0x7ff0a40b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0a4067300 0x7ff0a40adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a40b4c40 0x7ff0a40ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40ac740 con 0x7ff0a40b4c40 2021-10-20T23:20:34.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40ad260 con 0x7ff0a4060100 2021-10-20T23:20:34.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40ac970 con 0x7ff0a4067300 2021-10-20T23:20:34.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a9ff1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a40b4c40 0x7ff0a40ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a9ff1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a40b4c40 0x7ff0a40ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38010/0 (socket says 172.21.15.12:38010) 2021-10-20T23:20:34.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a9ff1700 1 -- 172.21.15.12:0/114651091 learned_addr learned my addr 172.21.15.12:0/114651091 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:34.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a97f0700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0a4060100 0x7ff0a40b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a8fef700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0a4067300 0x7ff0a40adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a9ff1700 1 -- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0a4067300 msgr2=0x7ff0a40adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a9ff1700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0a4067300 0x7ff0a40adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a9ff1700 1 -- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0a4060100 msgr2=0x7ff0a40b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a9ff1700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0a4060100 0x7ff0a40b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a9ff1700 1 -- 172.21.15.12:0/114651091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff094009470 con 0x7ff0a40b4c40 2021-10-20T23:20:34.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a97f0700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0a4060100 0x7ff0a40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:34.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a9ff1700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a40b4c40 0x7ff0a40ae3e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7ff09c006940 tx=0x7ff09c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:34.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a27fc700 1 -- 172.21.15.12:0/114651091 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff09c011780 con 0x7ff0a40b4c40 2021-10-20T23:20:34.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a27fc700 1 -- 172.21.15.12:0/114651091 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c0118e0 con 0x7ff0a40b4c40 2021-10-20T23:20:34.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a40ad4c0 con 0x7ff0a40b4c40 2021-10-20T23:20:34.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0a27fc700 1 -- 172.21.15.12:0/114651091 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff09c011c40 con 0x7ff0a40b4c40 2021-10-20T23:20:34.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.261+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a40a0950 con 0x7ff0a40b4c40 2021-10-20T23:20:34.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.265+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a4057350 con 0x7ff0a40b4c40 2021-10-20T23:20:34.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.265+0000 7ff0a27fc700 1 -- 172.21.15.12:0/114651091 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff09c01c460 con 0x7ff0a40b4c40 2021-10-20T23:20:34.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.265+0000 7ff0a27fc700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff084053610 0x7ff084055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.265+0000 7ff0a27fc700 1 -- 172.21.15.12:0/114651091 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff09c06bea0 con 0x7ff0a40b4c40 2021-10-20T23:20:34.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.265+0000 7ff0a97f0700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff084053610 0x7ff084055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.265+0000 7ff0a97f0700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff084053610 0x7ff084055ad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ff094019000 tx=0x7ff094016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:34.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.273+0000 7ff0a27fc700 1 -- 172.21.15.12:0/114651091 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff09c042e40 con 0x7ff0a40b4c40 2021-10-20T23:20:34.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.393+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0a40698e0 con 0x7ff0a40b4c40 2021-10-20T23:20:34.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.393+0000 7ff0a27fc700 1 -- 172.21.15.12:0/114651091 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16284 (secure 0 0 0) 0x7ff09c046460 con 0x7ff0a40b4c40 2021-10-20T23:20:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:34.399 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:20:34.132512+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:20:32.169677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-10-20T23:20:33.133690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:34.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff084053610 msgr2=0x7ff084055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff084053610 0x7ff084055ad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ff094019000 tx=0x7ff094016000).stop 2021-10-20T23:20:34.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a40b4c40 msgr2=0x7ff0a40ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a40b4c40 0x7ff0a40ae3e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7ff09c006940 tx=0x7ff09c008040).stop 2021-10-20T23:20:34.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 shutdown_connections 2021-10-20T23:20:34.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff084053610 0x7ff084055ad0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0a40b4c40 0x7ff0a40ae3e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0a4067300 0x7ff0a40adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 --2- 172.21.15.12:0/114651091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0a4060100 0x7ff0a40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 >> 172.21.15.12:0/114651091 conn(0x7ff0a405cf30 msgr2=0x7ff0a4143f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:34.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 shutdown_connections 2021-10-20T23:20:34.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.397+0000 7ff0aba54700 1 -- 172.21.15.12:0/114651091 wait complete. 2021-10-20T23:20:34.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:34.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 Processor -- start 2021-10-20T23:20:34.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- start start 2021-10-20T23:20:34.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1cf00b2580 0x7f1cf014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1cf00b0010 0x7f1cf014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf00a70c0 con 0x7f1cf00afbd0 2021-10-20T23:20:34.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00a72f0 con 0x7f1cf00b0010 2021-10-20T23:20:34.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00a7590 con 0x7f1cf00b2580 2021-10-20T23:20:34.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf4991700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1cf00b0010 0x7f1cf014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf4991700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1cf00b0010 0x7f1cf014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38014/0 (socket says 172.21.15.12:38014) 2021-10-20T23:20:34.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf4991700 1 -- 172.21.15.12:0/537009685 learned_addr learned my addr 172.21.15.12:0/537009685 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:34.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf5192700 1 --2- 172.21.15.12:0/537009685 >> v2:172.21.15.31:3300/0 conn(0x7f1cf00b2580 0x7f1cf014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf4991700 1 -- 172.21.15.12:0/537009685 >> v2:172.21.15.31:3300/0 conn(0x7f1cf00b2580 msgr2=0x7f1cf014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:34.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf4991700 1 --2- 172.21.15.12:0/537009685 >> v2:172.21.15.31:3300/0 conn(0x7f1cf00b2580 0x7f1cf014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf4991700 1 -- 172.21.15.12:0/537009685 >> v1:172.21.15.12:6789/0 conn(0x7f1cf00afbd0 legacy=0x7f1cf00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf4991700 1 -- 172.21.15.12:0/537009685 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf00a7830 con 0x7f1cf00b0010 2021-10-20T23:20:34.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf5192700 1 --2- 172.21.15.12:0/537009685 >> v2:172.21.15.31:3300/0 conn(0x7f1cf00b2580 0x7f1cf014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:20:34.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf4991700 1 --2- 172.21.15.12:0/537009685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00b0010 0x7f1cf014b330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f1ce00032f0 tx=0x7f1ce0009290).ready entity=mon.0 client_cookie=cd69d1bc86ed792e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:34.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1ce7fff700 1 -- 172.21.15.12:0/537009685 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce000b870 con 0x7f1cf00b0010 2021-10-20T23:20:34.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1ce7fff700 1 -- 172.21.15.12:0/537009685 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000b9d0 con 0x7f1cf00b0010 2021-10-20T23:20:34.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1ce7fff700 1 -- 172.21.15.12:0/537009685 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce000bb40 con 0x7f1cf00b0010 2021-10-20T23:20:34.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- 172.21.15.12:0/537009685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00b0010 msgr2=0x7f1cf014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 --2- 172.21.15.12:0/537009685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00b0010 0x7f1cf014b330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f1ce00032f0 tx=0x7f1ce0009290).stop 2021-10-20T23:20:34.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- 172.21.15.12:0/537009685 shutdown_connections 2021-10-20T23:20:34.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 --2- 172.21.15.12:0/537009685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00b0010 0x7f1cf014b330 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 --2- 172.21.15.12:0/537009685 >> v2:172.21.15.31:3300/0 conn(0x7f1cf00b2580 0x7f1cf014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- 172.21.15.12:0/537009685 >> 172.21.15.12:0/537009685 conn(0x7f1cf0060180 msgr2=0x7f1cf00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:34.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- 172.21.15.12:0/537009685 shutdown_connections 2021-10-20T23:20:34.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- 172.21.15.12:0/537009685 wait complete. 2021-10-20T23:20:34.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 Processor -- start 2021-10-20T23:20:34.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.521+0000 7f1cf6194700 1 -- start start 2021-10-20T23:20:34.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf6194700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00afbd0 0x7f1cf014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf6194700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cf00b0010 0x7f1cf00b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf6194700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf00b2580 0x7f1cf0159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf6194700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00b5af0 con 0x7f1cf00afbd0 2021-10-20T23:20:34.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf6194700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0064ab0 con 0x7f1cf00b2580 2021-10-20T23:20:34.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf6194700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0064d50 con 0x7f1cf00b0010 2021-10-20T23:20:34.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5192700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00afbd0 0x7f1cf014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5192700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00afbd0 0x7f1cf014a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38020/0 (socket says 172.21.15.12:38020) 2021-10-20T23:20:34.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5192700 1 -- 172.21.15.12:0/2696875259 learned_addr learned my addr 172.21.15.12:0/2696875259 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:34.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf4991700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cf00b0010 0x7f1cf00b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5993700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf00b2580 0x7f1cf0159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5192700 1 -- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cf00b0010 msgr2=0x7f1cf00b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5192700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cf00b0010 0x7f1cf00b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5192700 1 -- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf00b2580 msgr2=0x7f1cf0159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5192700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf00b2580 0x7f1cf0159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5192700 1 -- 172.21.15.12:0/2696875259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0009530 con 0x7f1cf00afbd0 2021-10-20T23:20:34.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf4991700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cf00b0010 0x7f1cf00b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:34.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5993700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf00b2580 0x7f1cf0159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:34.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf5192700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00afbd0 0x7f1cf014a760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f1cec007000 tx=0x7f1cec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:34.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1ce67fc700 1 -- 172.21.15.12:0/2696875259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cec010580 con 0x7f1cf00afbd0 2021-10-20T23:20:34.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1ce67fc700 1 -- 172.21.15.12:0/2696875259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec0106e0 con 0x7f1cf00afbd0 2021-10-20T23:20:34.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf00639d0 con 0x7f1cf00afbd0 2021-10-20T23:20:34.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1ce67fc700 1 -- 172.21.15.12:0/2696875259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cec010a40 con 0x7f1cf00afbd0 2021-10-20T23:20:34.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf00b4b20 con 0x7f1cf00afbd0 2021-10-20T23:20:34.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf0064f10 con 0x7f1cf00afbd0 2021-10-20T23:20:34.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.525+0000 7f1ce67fc700 1 -- 172.21.15.12:0/2696875259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1cec010ba0 con 0x7f1cf00afbd0 2021-10-20T23:20:34.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.529+0000 7f1ce67fc700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1cd0053610 0x7f1cd0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.529+0000 7f1ce67fc700 1 -- 172.21.15.12:0/2696875259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1cec06b9c0 con 0x7f1cf00afbd0 2021-10-20T23:20:34.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.529+0000 7f1cf4991700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1cd0053610 0x7f1cd0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.529+0000 7f1cf4991700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1cd0053610 0x7f1cd0055ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1ce0019000 tx=0x7f1ce0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:34.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.533+0000 7f1ce67fc700 1 -- 172.21.15.12:0/2696875259 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1cec0428e0 con 0x7f1cf00afbd0 2021-10-20T23:20:34.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.657+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cf0057350 con 0x7f1cf00afbd0 2021-10-20T23:20:34.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.657+0000 7f1ce67fc700 1 -- 172.21.15.12:0/2696875259 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16284 (secure 0 0 0) 0x7f1cec045f00 con 0x7f1cf00afbd0 2021-10-20T23:20:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:34.663 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:20:34.132512+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:20:32.169677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-10-20T23:20:33.133690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:34.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1cd0053610 msgr2=0x7f1cd0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1cd0053610 0x7f1cd0055ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1ce0019000 tx=0x7f1ce0016000).stop 2021-10-20T23:20:34.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00afbd0 msgr2=0x7f1cf014a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00afbd0 0x7f1cf014a760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f1cec007000 tx=0x7f1cec008040).stop 2021-10-20T23:20:34.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 shutdown_connections 2021-10-20T23:20:34.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1cd0053610 0x7f1cd0055ad0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf00b2580 0x7f1cf0159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cf00b0010 0x7f1cf00b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 --2- 172.21.15.12:0/2696875259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cf00afbd0 0x7f1cf014a760 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 >> 172.21.15.12:0/2696875259 conn(0x7f1cf0060180 msgr2=0x7f1cf00ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:34.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 shutdown_connections 2021-10-20T23:20:34.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.661+0000 7f1cf6194700 1 -- 172.21.15.12:0/2696875259 wait complete. 2021-10-20T23:20:34.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:20:34.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1489bcc700 1 Processor -- start 2021-10-20T23:20:34.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1489bcc700 1 -- start start 2021-10-20T23:20:34.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1489bcc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14840b27a0 0x7f1484147470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1489bcc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b1d10 0x7f148414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1489bcc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14840b2b80 con 0x7f148405c490 2021-10-20T23:20:34.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1489bcc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14841451b0 con 0x7f14840b27a0 2021-10-20T23:20:34.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1489bcc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148414aad0 con 0x7f14840b1d10 2021-10-20T23:20:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1483fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b1d10 0x7f148414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1488bca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14840b27a0 0x7f1484147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1488bca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14840b27a0 0x7f1484147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:53002/0 (socket says 172.21.15.12:53002) 2021-10-20T23:20:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1483fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b1d10 0x7f148414b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:43786/0 (socket says 172.21.15.12:43786) 2021-10-20T23:20:34.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1488bca700 1 -- 172.21.15.12:0/4221434064 learned_addr learned my addr 172.21.15.12:0/4221434064 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:34.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f14893cb700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f148405c490 0x7f14840a8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:43690/0 (socket says 172.21.15.12:43690) 2021-10-20T23:20:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1483fff700 1 -- 172.21.15.12:0/4221434064 >> v2:172.21.15.31:3300/0 conn(0x7f14840b27a0 msgr2=0x7f1484147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1483fff700 1 --2- 172.21.15.12:0/4221434064 >> v2:172.21.15.31:3300/0 conn(0x7f14840b27a0 0x7f1484147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1483fff700 1 -- 172.21.15.12:0/4221434064 >> v1:172.21.15.31:6789/0 conn(0x7f148405c490 legacy=0x7f14840a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1483fff700 1 -- 172.21.15.12:0/4221434064 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840b0ec0 con 0x7f14840b1d10 2021-10-20T23:20:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f1483fff700 1 --2- 172.21.15.12:0/4221434064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b1d10 0x7f148414b1d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1474002f70 tx=0x7f1474006df0).ready entity=mon.2 client_cookie=5dbf44aaf96ec130 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f14837fe700 1 -- 172.21.15.12:0/4221434064 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147400d570 con 0x7f14840b1d10 2021-10-20T23:20:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f14837fe700 1 -- 172.21.15.12:0/4221434064 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474000e90 con 0x7f14840b1d10 2021-10-20T23:20:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.785+0000 7f14837fe700 1 -- 172.21.15.12:0/4221434064 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147400d8c0 con 0x7f14840b1d10 2021-10-20T23:20:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 -- 172.21.15.12:0/4221434064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b1d10 msgr2=0x7f148414b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 --2- 172.21.15.12:0/4221434064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b1d10 0x7f148414b1d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1474002f70 tx=0x7f1474006df0).stop 2021-10-20T23:20:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 -- 172.21.15.12:0/4221434064 shutdown_connections 2021-10-20T23:20:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 --2- 172.21.15.12:0/4221434064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b1d10 0x7f148414b1d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 --2- 172.21.15.12:0/4221434064 >> v2:172.21.15.31:3300/0 conn(0x7f14840b27a0 0x7f1484147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 -- 172.21.15.12:0/4221434064 >> 172.21.15.12:0/4221434064 conn(0x7f1484061140 msgr2=0x7f1484062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:34.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 -- 172.21.15.12:0/4221434064 shutdown_connections 2021-10-20T23:20:34.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 -- 172.21.15.12:0/4221434064 wait complete. 2021-10-20T23:20:34.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 Processor -- start 2021-10-20T23:20:34.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 -- start start 2021-10-20T23:20:34.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148405c490 0x7f148414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14840b1d10 0x7f14840637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b27a0 0x7f1484067180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840aaba0 con 0x7f14840b1d10 2021-10-20T23:20:34.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14841473b0 con 0x7f148405c490 2021-10-20T23:20:34.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1489bcc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1484063cc0 con 0x7f14840b27a0 2021-10-20T23:20:34.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1483fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14840b1d10 0x7f14840637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1488bca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148405c490 0x7f148414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1483fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14840b1d10 0x7f14840637d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38036/0 (socket says 172.21.15.12:38036) 2021-10-20T23:20:34.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1483fff700 1 -- 172.21.15.12:0/3741238593 learned_addr learned my addr 172.21.15.12:0/3741238593 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f14893cb700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b27a0 0x7f1484067180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1483fff700 1 -- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b27a0 msgr2=0x7f1484067180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1483fff700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b27a0 0x7f1484067180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1483fff700 1 -- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148405c490 msgr2=0x7f148414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1483fff700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148405c490 0x7f148414e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:34.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.789+0000 7f1483fff700 1 -- 172.21.15.12:0/3741238593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147400b180 con 0x7f14840b1d10 2021-10-20T23:20:34.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1483fff700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14840b1d10 0x7f14840637d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1474002f70 tx=0x7f1474014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:34.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1481ffb700 1 -- 172.21.15.12:0/3741238593 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147400dea0 con 0x7f14840b1d10 2021-10-20T23:20:34.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1481ffb700 1 -- 172.21.15.12:0/3741238593 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474013e90 con 0x7f14840b1d10 2021-10-20T23:20:34.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14840aaed0 con 0x7f14840b1d10 2021-10-20T23:20:34.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1481ffb700 1 -- 172.21.15.12:0/3741238593 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147401e5f0 con 0x7f14840b1d10 2021-10-20T23:20:34.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1484146c00 con 0x7f14840b1d10 2021-10-20T23:20:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1484057350 con 0x7f14840b1d10 2021-10-20T23:20:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1481ffb700 1 -- 172.21.15.12:0/3741238593 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f147401c070 con 0x7f14840b1d10 2021-10-20T23:20:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1481ffb700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1464053580 0x7f1464055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1481ffb700 1 -- 172.21.15.12:0/3741238593 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f147406c6e0 con 0x7f14840b1d10 2021-10-20T23:20:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1488bca700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1464053580 0x7f1464055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:34.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.793+0000 7f1488bca700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1464053580 0x7f1464055a40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f1478008000 tx=0x7f1478008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:34.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.797+0000 7f1481ffb700 1 -- 172.21.15.12:0/3741238593 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1474043620 con 0x7f14840b1d10 2021-10-20T23:20:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:34.957+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f14840698e0 con 0x7f14840b1d10 2021-10-20T23:20:35.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.149+0000 7f1481ffb700 1 -- 172.21.15.12:0/3741238593 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1474023020 con 0x7f14840b1d10 2021-10-20T23:20:35.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1464053580 msgr2=0x7f1464055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1464053580 0x7f1464055a40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f1478008000 tx=0x7f1478008040).stop 2021-10-20T23:20:35.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14840b1d10 msgr2=0x7f14840637d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14840b1d10 0x7f14840637d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1474002f70 tx=0x7f1474014000).stop 2021-10-20T23:20:35.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 shutdown_connections 2021-10-20T23:20:35.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1464053580 0x7f1464055a40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14840b27a0 0x7f1484067180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14840b1d10 0x7f14840637d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 --2- 172.21.15.12:0/3741238593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148405c490 0x7f148414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 >> 172.21.15.12:0/3741238593 conn(0x7f1484061140 msgr2=0x7f148414bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:35.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 shutdown_connections 2021-10-20T23:20:35.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.153+0000 7f1489bcc700 1 -- 172.21.15.12:0/3741238593 wait complete. 2021-10-20T23:20:35.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f84040700 1 Processor -- start 2021-10-20T23:20:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f84040700 1 -- start start 2021-10-20T23:20:35.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f84040700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f7c1483a0 0x7f1f7c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f84040700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c0b0350 con 0x7f1f7c0a70c0 2021-10-20T23:20:35.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f84040700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c0b05f0 con 0x7f1f7c0b1db0 2021-10-20T23:20:35.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f84040700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c0a90c0 con 0x7f1f7c1483a0 2021-10-20T23:20:35.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f815db700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f7c1483a0 0x7f1f7c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f825dd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1f7c0a70c0 0x7f1f7c144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36640/0 (socket says 172.21.15.12:36640) 2021-10-20T23:20:35.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f825dd700 1 -- 172.21.15.12:0/2255127149 learned_addr learned my addr 172.21.15.12:0/2255127149 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:35.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f815db700 1 -- 172.21.15.12:0/2255127149 >> v1:172.21.15.31:6789/0 conn(0x7f1f7c0b1db0 legacy=0x7f1f7c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f815db700 1 -- 172.21.15.12:0/2255127149 >> v1:172.21.15.12:6789/0 conn(0x7f1f7c0a70c0 legacy=0x7f1f7c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f80dda700 1 -- 172.21.15.12:0/2255127149 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760018784 0 0) 0x7f1f7c0b05f0 con 0x7f1f7c0b1db0 2021-10-20T23:20:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f815db700 1 -- 172.21.15.12:0/2255127149 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c0b0890 con 0x7f1f7c1483a0 2021-10-20T23:20:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f815db700 1 --2- 172.21.15.12:0/2255127149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 0x7f1f7c0b0fd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f1f74001490 tx=0x7f1f78006df0).ready entity=mon.0 client_cookie=a53916d5f932d287 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f80dda700 1 -- 172.21.15.12:0/2255127149 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f7800d5c0 con 0x7f1f7c1483a0 2021-10-20T23:20:35.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f80dda700 1 -- 172.21.15.12:0/2255127149 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f78000e90 con 0x7f1f7c1483a0 2021-10-20T23:20:35.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.285+0000 7f1f80dda700 1 -- 172.21.15.12:0/2255127149 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f7800d910 con 0x7f1f7c1483a0 2021-10-20T23:20:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.289+0000 7f1f84040700 1 -- 172.21.15.12:0/2255127149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 msgr2=0x7f1f7c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.289+0000 7f1f84040700 1 --2- 172.21.15.12:0/2255127149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 0x7f1f7c0b0fd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f1f74001490 tx=0x7f1f78006df0).stop 2021-10-20T23:20:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.289+0000 7f1f84040700 1 -- 172.21.15.12:0/2255127149 shutdown_connections 2021-10-20T23:20:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.289+0000 7f1f84040700 1 --2- 172.21.15.12:0/2255127149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 0x7f1f7c0b0fd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.289+0000 7f1f84040700 1 -- 172.21.15.12:0/2255127149 >> 172.21.15.12:0/2255127149 conn(0x7f1f7c05f6b0 msgr2=0x7f1f7c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.289+0000 7f1f84040700 1 -- 172.21.15.12:0/2255127149 shutdown_connections 2021-10-20T23:20:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.289+0000 7f1f84040700 1 -- 172.21.15.12:0/2255127149 wait complete. 2021-10-20T23:20:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.289+0000 7f1f84040700 1 Processor -- start 2021-10-20T23:20:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.289+0000 7f1f84040700 1 -- start start 2021-10-20T23:20:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f84040700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f7c0a70c0 0x7f1f7c0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f84040700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7c0b1db0 0x7f1f7c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f84040700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 0x7f1f7c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f84040700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0acaf0 con 0x7f1f7c1483a0 2021-10-20T23:20:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f84040700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c156730 con 0x7f1f7c0b1db0 2021-10-20T23:20:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f84040700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c14b970 con 0x7f1f7c0a70c0 2021-10-20T23:20:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f825dd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 0x7f1f7c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f825dd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 0x7f1f7c156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38052/0 (socket says 172.21.15.12:38052) 2021-10-20T23:20:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f825dd700 1 -- 172.21.15.12:0/1073099859 learned_addr learned my addr 172.21.15.12:0/1073099859 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f81ddc700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f7c0a70c0 0x7f1f7c0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f815db700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7c0b1db0 0x7f1f7c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f825dd700 1 -- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f7c0a70c0 msgr2=0x7f1f7c0aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f825dd700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f7c0a70c0 0x7f1f7c0aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f825dd700 1 -- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7c0b1db0 msgr2=0x7f1f7c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f825dd700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7c0b1db0 0x7f1f7c14b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f825dd700 1 -- 172.21.15.12:0/1073099859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7800b180 con 0x7f1f7c1483a0 2021-10-20T23:20:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f825dd700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 0x7f1f7c156b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f1f74001550 tx=0x7f1f74007f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f6effd700 1 -- 172.21.15.12:0/1073099859 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f74005ba0 con 0x7f1f7c1483a0 2021-10-20T23:20:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f6effd700 1 -- 172.21.15.12:0/1073099859 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f74005d00 con 0x7f1f7c1483a0 2021-10-20T23:20:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c149bd0 con 0x7f1f7c1483a0 2021-10-20T23:20:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f6effd700 1 -- 172.21.15.12:0/1073099859 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f74007300 con 0x7f1f7c1483a0 2021-10-20T23:20:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.293+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c14a110 con 0x7f1f7c1483a0 2021-10-20T23:20:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.297+0000 7f1f6effd700 1 -- 172.21.15.12:0/1073099859 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1f74010030 con 0x7f1f7c1483a0 2021-10-20T23:20:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.297+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c14a820 con 0x7f1f7c1483a0 2021-10-20T23:20:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.297+0000 7f1f6effd700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f64053640 0x7f1f64055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.297+0000 7f1f6effd700 1 -- 172.21.15.12:0/1073099859 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1f7406baf0 con 0x7f1f7c1483a0 2021-10-20T23:20:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.297+0000 7f1f81ddc700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f64053640 0x7f1f64055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.297+0000 7f1f81ddc700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f64053640 0x7f1f64055b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f1f7000d000 tx=0x7f1f700079b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.301+0000 7f1f6effd700 1 -- 172.21.15.12:0/1073099859 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f7c14a820 con 0x7f1f7c1483a0 2021-10-20T23:20:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.465+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f7c14a820 con 0x7f1f7c1483a0 2021-10-20T23:20:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.465+0000 7f1f6effd700 1 -- 172.21.15.12:0/1073099859 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f1f7c14a820 con 0x7f1f7c1483a0 2021-10-20T23:20:35.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:35.470 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:20:34.132895+0000","modified":"2021-10-20T23:20:35.137040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/655661573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":655661573},{"type":"v1","addr":"172.21.15.12:6835","nonce":655661573}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-20T23:20:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f64053640 msgr2=0x7f1f64055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f64053640 0x7f1f64055b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f1f7000d000 tx=0x7f1f700079b0).stop 2021-10-20T23:20:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 msgr2=0x7f1f7c156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 0x7f1f7c156b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f1f74001550 tx=0x7f1f74007f00).stop 2021-10-20T23:20:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 shutdown_connections 2021-10-20T23:20:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f64053640 0x7f1f64055b00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f7c1483a0 0x7f1f7c156b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7c0b1db0 0x7f1f7c14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 --2- 172.21.15.12:0/1073099859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f7c0a70c0 0x7f1f7c0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 >> 172.21.15.12:0/1073099859 conn(0x7f1f7c05f6b0 msgr2=0x7f1f7c0b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 shutdown_connections 2021-10-20T23:20:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.469+0000 7f1f84040700 1 -- 172.21.15.12:0/1073099859 wait complete. 2021-10-20T23:20:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2021-10-20T23:20:35.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.585+0000 7f5adbfff700 1 Processor -- start 2021-10-20T23:20:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.585+0000 7f5adbfff700 1 -- start start 2021-10-20T23:20:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5adc05c7d0 0x7f5adc0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc05d0b0 0x7f5adc13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5adc0ace30 0x7f5adc0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc067d70 con 0x7f5adc05c7d0 2021-10-20T23:20:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc13f880 con 0x7f5adc0ace30 2021-10-20T23:20:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc05cbb0 con 0x7f5adc05d0b0 2021-10-20T23:20:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5adc05c7d0 0x7f5adc0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5adc05c7d0 0x7f5adc0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38056/0 (socket says 172.21.15.12:38056) 2021-10-20T23:20:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adaffd700 1 -- 172.21.15.12:0/990673215 learned_addr learned my addr 172.21.15.12:0/990673215 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5ad3fff700 1 --2- 172.21.15.12:0/990673215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc05d0b0 0x7f5adc13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adb7fe700 1 --2- 172.21.15.12:0/990673215 >> v2:172.21.15.31:3300/0 conn(0x7f5adc0ace30 0x7f5adc0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adaffd700 1 -- 172.21.15.12:0/990673215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc05d0b0 msgr2=0x7f5adc13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adaffd700 1 --2- 172.21.15.12:0/990673215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc05d0b0 0x7f5adc13f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adaffd700 1 -- 172.21.15.12:0/990673215 >> v2:172.21.15.31:3300/0 conn(0x7f5adc0ace30 msgr2=0x7f5adc0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adaffd700 1 --2- 172.21.15.12:0/990673215 >> v2:172.21.15.31:3300/0 conn(0x7f5adc0ace30 0x7f5adc0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adaffd700 1 -- 172.21.15.12:0/990673215 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0b1790 con 0x7f5adc05c7d0 2021-10-20T23:20:35.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5ad3fff700 1 --2- 172.21.15.12:0/990673215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc05d0b0 0x7f5adc13f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:35.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adaffd700 1 --2- 172.21.15.12:0/990673215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05c7d0 0x7f5adc0b10f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f5acc002f70 tx=0x7f5acc006eb0).ready entity=mon.0 client_cookie=98e8f4746870af91 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:35.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5ada7fc700 1 -- 172.21.15.12:0/990673215 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc00d570 con 0x7f5adc05c7d0 2021-10-20T23:20:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5ada7fc700 1 -- 172.21.15.12:0/990673215 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc000e90 con 0x7f5adc05c7d0 2021-10-20T23:20:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5ada7fc700 1 -- 172.21.15.12:0/990673215 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc00d900 con 0x7f5adc05c7d0 2021-10-20T23:20:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 -- 172.21.15.12:0/990673215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05c7d0 msgr2=0x7f5adc0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 --2- 172.21.15.12:0/990673215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05c7d0 0x7f5adc0b10f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f5acc002f70 tx=0x7f5acc006eb0).stop 2021-10-20T23:20:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 -- 172.21.15.12:0/990673215 shutdown_connections 2021-10-20T23:20:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 --2- 172.21.15.12:0/990673215 >> v2:172.21.15.31:3300/0 conn(0x7f5adc0ace30 0x7f5adc0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 --2- 172.21.15.12:0/990673215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc05d0b0 0x7f5adc13f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 --2- 172.21.15.12:0/990673215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05c7d0 0x7f5adc0b10f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 -- 172.21.15.12:0/990673215 >> 172.21.15.12:0/990673215 conn(0x7f5adc060180 msgr2=0x7f5adc0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:35.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 -- 172.21.15.12:0/990673215 shutdown_connections 2021-10-20T23:20:35.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.589+0000 7f5adbfff700 1 -- 172.21.15.12:0/990673215 wait complete. 2021-10-20T23:20:35.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 Processor -- start 2021-10-20T23:20:35.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 -- start start 2021-10-20T23:20:35.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5adc05c7d0 0x7f5adc0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05d0b0 0x7f5adc0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc0ace30 0x7f5adc153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc14ab40 con 0x7f5adc05d0b0 2021-10-20T23:20:35.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0b2dd0 con 0x7f5adc05c7d0 2021-10-20T23:20:35.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc1327c0 con 0x7f5adc0ace30 2021-10-20T23:20:35.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05d0b0 0x7f5adc0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05d0b0 0x7f5adc0b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38060/0 (socket says 172.21.15.12:38060) 2021-10-20T23:20:35.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad3fff700 1 -- 172.21.15.12:0/2644819213 learned_addr learned my addr 172.21.15.12:0/2644819213 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:35.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adb7fe700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc0ace30 0x7f5adc153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adaffd700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5adc05c7d0 0x7f5adc0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad3fff700 1 -- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc0ace30 msgr2=0x7f5adc153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad3fff700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc0ace30 0x7f5adc153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad3fff700 1 -- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5adc05c7d0 msgr2=0x7f5adc0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad3fff700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5adc05c7d0 0x7f5adc0b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad3fff700 1 -- 172.21.15.12:0/2644819213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac400b180 con 0x7f5adc05d0b0 2021-10-20T23:20:35.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad3fff700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05d0b0 0x7f5adc0b4180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f5ac400c000 tx=0x7f5ac4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad8ff9700 1 -- 172.21.15.12:0/2644819213 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac400ca40 con 0x7f5adc05d0b0 2021-10-20T23:20:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad8ff9700 1 -- 172.21.15.12:0/2644819213 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac400cba0 con 0x7f5adc05d0b0 2021-10-20T23:20:35.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc00b1e0 con 0x7f5adc05d0b0 2021-10-20T23:20:35.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5ad8ff9700 1 -- 172.21.15.12:0/2644819213 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac40123f0 con 0x7f5adc05d0b0 2021-10-20T23:20:35.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.593+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc132d00 con 0x7f5adc05d0b0 2021-10-20T23:20:35.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.597+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc0b2f40 con 0x7f5adc05d0b0 2021-10-20T23:20:35.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.597+0000 7f5ad8ff9700 1 -- 172.21.15.12:0/2644819213 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ac4012550 con 0x7f5adc05d0b0 2021-10-20T23:20:35.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.597+0000 7f5ad8ff9700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ab4053580 0x7f5ab4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.597+0000 7f5ad8ff9700 1 -- 172.21.15.12:0/2644819213 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5ac406c1f0 con 0x7f5adc05d0b0 2021-10-20T23:20:35.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.597+0000 7f5adaffd700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ab4053580 0x7f5ab4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.597+0000 7f5adaffd700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ab4053580 0x7f5ab4055a40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f5acc01a000 tx=0x7f5acc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:35.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.601+0000 7f5ad8ff9700 1 -- 172.21.15.12:0/2644819213 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5adc0b2f40 con 0x7f5adc05d0b0 2021-10-20T23:20:35.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.729+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5adc0b2f40 con 0x7f5adc05d0b0 2021-10-20T23:20:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.729+0000 7f5ad8ff9700 1 -- 172.21.15.12:0/2644819213 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f5adc0b2f40 con 0x7f5adc05d0b0 2021-10-20T23:20:35.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:35.734 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":36,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:20:35.135886+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:20:32.169677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-10-20T23:20:33.133690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:35.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ab4053580 msgr2=0x7f5ab4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ab4053580 0x7f5ab4055a40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f5acc01a000 tx=0x7f5acc015000).stop 2021-10-20T23:20:35.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05d0b0 msgr2=0x7f5adc0b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05d0b0 0x7f5adc0b4180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f5ac400c000 tx=0x7f5ac4006df0).stop 2021-10-20T23:20:35.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 shutdown_connections 2021-10-20T23:20:35.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ab4053580 0x7f5ab4055a40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5adc0ace30 0x7f5adc153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5adc05d0b0 0x7f5adc0b4180 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 --2- 172.21.15.12:0/2644819213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5adc05c7d0 0x7f5adc0b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 >> 172.21.15.12:0/2644819213 conn(0x7f5adc060180 msgr2=0x7f5adc0b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:35.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 shutdown_connections 2021-10-20T23:20:35.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.733+0000 7f5adbfff700 1 -- 172.21.15.12:0/2644819213 wait complete. 2021-10-20T23:20:35.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:20:35.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08da56e700 1 Processor -- start 2021-10-20T23:20:35.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08da56e700 1 -- start start 2021-10-20T23:20:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08da56e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08d40b6580 0x7f08d40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08da56e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 0x7f08d40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08da56e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08d4061d30 0x7f08d40621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08da56e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d41440b0 con 0x7f08d40b6580 2021-10-20T23:20:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08da56e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d40b6e50 con 0x7f08d4061d30 2021-10-20T23:20:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08da56e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4143b70 con 0x7f08d40b43c0 2021-10-20T23:20:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08d40b6580 0x7f08d40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08d40b6580 0x7f08d40b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38068/0 (socket says 172.21.15.12:38068) 2021-10-20T23:20:35.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d3fff700 1 -- 172.21.15.12:0/646907999 learned_addr learned my addr 172.21.15.12:0/646907999 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:35.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d8b0b700 1 --2- 172.21.15.12:0/646907999 >> v2:172.21.15.31:3300/0 conn(0x7f08d4061d30 0x7f08d40621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08cb7fe700 1 --2- 172.21.15.12:0/646907999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 0x7f08d40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d3fff700 1 -- 172.21.15.12:0/646907999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 msgr2=0x7f08d40b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d3fff700 1 --2- 172.21.15.12:0/646907999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 0x7f08d40b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d3fff700 1 -- 172.21.15.12:0/646907999 >> v2:172.21.15.31:3300/0 conn(0x7f08d4061d30 msgr2=0x7f08d40621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d3fff700 1 --2- 172.21.15.12:0/646907999 >> v2:172.21.15.31:3300/0 conn(0x7f08d4061d30 0x7f08d40621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d3fff700 1 -- 172.21.15.12:0/646907999 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d4143e10 con 0x7f08d40b6580 2021-10-20T23:20:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08cb7fe700 1 --2- 172.21.15.12:0/646907999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 0x7f08d40b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d3fff700 1 --2- 172.21.15.12:0/646907999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 0x7f08d40b5bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f08c4002f70 tx=0x7f08c4006eb0).ready entity=mon.0 client_cookie=b7b2e5362503eee0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d37fe700 1 -- 172.21.15.12:0/646907999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08c400d570 con 0x7f08d40b6580 2021-10-20T23:20:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d37fe700 1 -- 172.21.15.12:0/646907999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c4000e90 con 0x7f08d40b6580 2021-10-20T23:20:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.857+0000 7f08d37fe700 1 -- 172.21.15.12:0/646907999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08c400d900 con 0x7f08d40b6580 2021-10-20T23:20:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 -- 172.21.15.12:0/646907999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 msgr2=0x7f08d40b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 --2- 172.21.15.12:0/646907999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 0x7f08d40b5bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f08c4002f70 tx=0x7f08c4006eb0).stop 2021-10-20T23:20:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 -- 172.21.15.12:0/646907999 shutdown_connections 2021-10-20T23:20:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 --2- 172.21.15.12:0/646907999 >> v2:172.21.15.31:3300/0 conn(0x7f08d4061d30 0x7f08d40621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 --2- 172.21.15.12:0/646907999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 0x7f08d40b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 --2- 172.21.15.12:0/646907999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 0x7f08d40b5bf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 -- 172.21.15.12:0/646907999 >> 172.21.15.12:0/646907999 conn(0x7f08d405c490 msgr2=0x7f08d405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 -- 172.21.15.12:0/646907999 shutdown_connections 2021-10-20T23:20:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 -- 172.21.15.12:0/646907999 wait complete. 2021-10-20T23:20:35.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 Processor -- start 2021-10-20T23:20:35.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.861+0000 7f08da56e700 1 -- start start 2021-10-20T23:20:35.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08da56e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08d4061d30 0x7f08d4142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08da56e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 0x7f08d40b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08da56e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 0x7f08d41557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08da56e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40b38c0 con 0x7f08d40b6580 2021-10-20T23:20:35.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08da56e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40b3b50 con 0x7f08d4061d30 2021-10-20T23:20:35.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08da56e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4141cb0 con 0x7f08d40b43c0 2021-10-20T23:20:35.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d8b0b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 0x7f08d41557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d8b0b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 0x7f08d41557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38076/0 (socket says 172.21.15.12:38076) 2021-10-20T23:20:35.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d8b0b700 1 -- 172.21.15.12:0/3181083205 learned_addr learned my addr 172.21.15.12:0/3181083205 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:35.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08cb7fe700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 0x7f08d40b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d3fff700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08d4061d30 0x7f08d4142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d8b0b700 1 -- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 msgr2=0x7f08d40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d8b0b700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 0x7f08d40b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d8b0b700 1 -- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08d4061d30 msgr2=0x7f08d4142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d8b0b700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08d4061d30 0x7f08d4142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d8b0b700 1 -- 172.21.15.12:0/3181083205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c400b1e0 con 0x7f08d40b6580 2021-10-20T23:20:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d8b0b700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 0x7f08d41557b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f08cc006e00 tx=0x7f08cc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d1ffb700 1 -- 172.21.15.12:0/3181083205 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08cc012600 con 0x7f08d40b6580 2021-10-20T23:20:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d1ffb700 1 -- 172.21.15.12:0/3181083205 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc012760 con 0x7f08d40b6580 2021-10-20T23:20:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d4141f50 con 0x7f08d40b6580 2021-10-20T23:20:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d1ffb700 1 -- 172.21.15.12:0/3181083205 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08cc012ac0 con 0x7f08d40b6580 2021-10-20T23:20:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d4142690 con 0x7f08d40b6580 2021-10-20T23:20:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.865+0000 7f08d1ffb700 1 -- 172.21.15.12:0/3181083205 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f08cc022070 con 0x7f08d40b6580 2021-10-20T23:20:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.869+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d412b900 con 0x7f08d40b6580 2021-10-20T23:20:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.869+0000 7f08d1ffb700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08b80535b0 0x7f08b8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.869+0000 7f08d1ffb700 1 -- 172.21.15.12:0/3181083205 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f08cc06c060 con 0x7f08d40b6580 2021-10-20T23:20:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.869+0000 7f08d3fff700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08b80535b0 0x7f08b8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.869+0000 7f08d3fff700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08b80535b0 0x7f08b8055a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f08c401c000 tx=0x7f08c4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:35.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:35.873+0000 7f08d1ffb700 1 -- 172.21.15.12:0/3181083205 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08d412b900 con 0x7f08d40b6580 2021-10-20T23:20:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.041+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f08d412b900 con 0x7f08d40b6580 2021-10-20T23:20:36.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.049+0000 7f08d1ffb700 1 -- 172.21.15.12:0/3181083205 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f08d412b900 con 0x7f08d40b6580 2021-10-20T23:20:36.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08b80535b0 msgr2=0x7f08b8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08b80535b0 0x7f08b8055a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f08c401c000 tx=0x7f08c4015000).stop 2021-10-20T23:20:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 msgr2=0x7f08d41557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 0x7f08d41557b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f08cc006e00 tx=0x7f08cc0091d0).stop 2021-10-20T23:20:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 shutdown_connections 2021-10-20T23:20:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f08b80535b0 0x7f08b8055a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08d40b6580 0x7f08d41557b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08d40b43c0 0x7f08d40b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 --2- 172.21.15.12:0/3181083205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08d4061d30 0x7f08d4142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 >> 172.21.15.12:0/3181083205 conn(0x7f08d405c490 msgr2=0x7f08d4126fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:36.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 shutdown_connections 2021-10-20T23:20:36.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.053+0000 7f08da56e700 1 -- 172.21.15.12:0/3181083205 wait complete. 2021-10-20T23:20:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:20:36.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:20:36.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:20:36.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:20:36.082 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:20:36.085 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:20:36.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.177+0000 7f4db2fff700 1 Processor -- start 2021-10-20T23:20:36.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.177+0000 7f4db2fff700 1 -- start start 2021-10-20T23:20:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4dac0b7370 0x7f4dac0b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0aac20 0x7f4dac064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac0b2380 con 0x7f4dac0b3060 2021-10-20T23:20:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac144250 con 0x7f4dac0b7370 2021-10-20T23:20:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0b3570 con 0x7f4dac0aac20 2021-10-20T23:20:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db27fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0aac20 0x7f4dac064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db27fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0aac20 0x7f4dac064ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:43840/0 (socket says 172.21.15.12:43840) 2021-10-20T23:20:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db27fe700 1 -- 172.21.15.12:0/3638050038 learned_addr learned my addr 172.21.15.12:0/3638050038 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db1ffd700 1 --2- 172.21.15.12:0/3638050038 >> v2:172.21.15.31:3300/0 conn(0x7f4dac0b7370 0x7f4dac0b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db27fe700 1 -- 172.21.15.12:0/3638050038 >> v2:172.21.15.31:3300/0 conn(0x7f4dac0b7370 msgr2=0x7f4dac0b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db27fe700 1 --2- 172.21.15.12:0/3638050038 >> v2:172.21.15.31:3300/0 conn(0x7f4dac0b7370 0x7f4dac0b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db27fe700 1 -- 172.21.15.12:0/3638050038 >> v1:172.21.15.31:6789/0 conn(0x7f4dac0b3060 legacy=0x7f4dac13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db27fe700 1 -- 172.21.15.12:0/3638050038 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0b25b0 con 0x7f4dac0aac20 2021-10-20T23:20:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db0ffb700 1 -- 172.21.15.12:0/3638050038 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420409046 0 0) 0x7f4dac0b2380 con 0x7f4dac0b3060 2021-10-20T23:20:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db27fe700 1 --2- 172.21.15.12:0/3638050038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0aac20 0x7f4dac064ba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4da40032f0 tx=0x7f4da4009290).ready entity=mon.2 client_cookie=9b5448c7879d8b0a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db0ffb700 1 -- 172.21.15.12:0/3638050038 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da400b8a0 con 0x7f4dac0aac20 2021-10-20T23:20:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db0ffb700 1 -- 172.21.15.12:0/3638050038 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da400ba00 con 0x7f4dac0aac20 2021-10-20T23:20:36.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db0ffb700 1 -- 172.21.15.12:0/3638050038 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da400bb70 con 0x7f4dac0aac20 2021-10-20T23:20:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 -- 172.21.15.12:0/3638050038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0aac20 msgr2=0x7f4dac064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 --2- 172.21.15.12:0/3638050038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0aac20 0x7f4dac064ba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4da40032f0 tx=0x7f4da4009290).stop 2021-10-20T23:20:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 -- 172.21.15.12:0/3638050038 shutdown_connections 2021-10-20T23:20:36.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 --2- 172.21.15.12:0/3638050038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0aac20 0x7f4dac064ba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 --2- 172.21.15.12:0/3638050038 >> v2:172.21.15.31:3300/0 conn(0x7f4dac0b7370 0x7f4dac0b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 -- 172.21.15.12:0/3638050038 >> 172.21.15.12:0/3638050038 conn(0x7f4dac05f6b0 msgr2=0x7f4dac05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:36.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 -- 172.21.15.12:0/3638050038 shutdown_connections 2021-10-20T23:20:36.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.181+0000 7f4db2fff700 1 -- 172.21.15.12:0/3638050038 wait complete. 2021-10-20T23:20:36.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 Processor -- start 2021-10-20T23:20:36.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 -- start start 2021-10-20T23:20:36.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dac0aac20 0x7f4dac061740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dac0b3060 0x7f4dac0ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0b7370 0x7f4dac060d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac13e0d0 con 0x7f4dac0b3060 2021-10-20T23:20:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac061c30 con 0x7f4dac0aac20 2021-10-20T23:20:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac062110 con 0x7f4dac0b7370 2021-10-20T23:20:36.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db17fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dac0b3060 0x7f4dac0ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db17fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dac0b3060 0x7f4dac0ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38090/0 (socket says 172.21.15.12:38090) 2021-10-20T23:20:36.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db17fc700 1 -- 172.21.15.12:0/924383773 learned_addr learned my addr 172.21.15.12:0/924383773 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:36.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db27fe700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0b7370 0x7f4dac060d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db1ffd700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dac0aac20 0x7f4dac061740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db17fc700 1 -- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0b7370 msgr2=0x7f4dac060d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db17fc700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0b7370 0x7f4dac060d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db17fc700 1 -- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dac0aac20 msgr2=0x7f4dac061740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db17fc700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dac0aac20 0x7f4dac061740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db17fc700 1 -- 172.21.15.12:0/924383773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da4009530 con 0x7f4dac0b3060 2021-10-20T23:20:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db27fe700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0b7370 0x7f4dac060d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db17fc700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dac0b3060 0x7f4dac0ab7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f4dac061dc0 tx=0x7f4da8007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4d9affd700 1 -- 172.21.15.12:0/924383773 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da8012400 con 0x7f4dac0b3060 2021-10-20T23:20:36.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4d9affd700 1 -- 172.21.15.12:0/924383773 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da8012560 con 0x7f4dac0b3060 2021-10-20T23:20:36.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac0ab100 con 0x7f4dac0b3060 2021-10-20T23:20:36.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4d9affd700 1 -- 172.21.15.12:0/924383773 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da80128c0 con 0x7f4dac0b3060 2021-10-20T23:20:36.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.185+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac0abc90 con 0x7f4dac0b3060 2021-10-20T23:20:36.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.189+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac057350 con 0x7f4dac0b3060 2021-10-20T23:20:36.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.189+0000 7f4d9affd700 1 -- 172.21.15.12:0/924383773 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4da8019030 con 0x7f4dac0b3060 2021-10-20T23:20:36.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.189+0000 7f4d9affd700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4d8c053610 0x7f4d8c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.189+0000 7f4d9affd700 1 -- 172.21.15.12:0/924383773 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4da806af10 con 0x7f4dac0b3060 2021-10-20T23:20:36.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.189+0000 7f4db1ffd700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4d8c053610 0x7f4d8c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.193+0000 7f4db1ffd700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4d8c053610 0x7f4d8c055ad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f4d9c006000 tx=0x7f4d9c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:36.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.193+0000 7f4d9affd700 1 -- 172.21.15.12:0/924383773 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4da8041fc0 con 0x7f4dac0b3060 2021-10-20T23:20:36.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.361+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4dac0601a0 con 0x7f4dac0b3060 2021-10-20T23:20:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.369+0000 7f4d9affd700 1 -- 172.21.15.12:0/924383773 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4da80455e0 con 0x7f4dac0b3060 2021-10-20T23:20:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4d8c053610 msgr2=0x7f4d8c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4d8c053610 0x7f4d8c055ad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f4d9c006000 tx=0x7f4d9c008040).stop 2021-10-20T23:20:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dac0b3060 msgr2=0x7f4dac0ab7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dac0b3060 0x7f4dac0ab7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f4dac061dc0 tx=0x7f4da8007ab0).stop 2021-10-20T23:20:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 shutdown_connections 2021-10-20T23:20:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4d8c053610 0x7f4d8c055ad0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4dac0b7370 0x7f4dac060d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dac0b3060 0x7f4dac0ab7a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 --2- 172.21.15.12:0/924383773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dac0aac20 0x7f4dac061740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 >> 172.21.15.12:0/924383773 conn(0x7f4dac05f6b0 msgr2=0x7f4dac0b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 shutdown_connections 2021-10-20T23:20:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.373+0000 7f4db2fff700 1 -- 172.21.15.12:0/924383773 wait complete. 2021-10-20T23:20:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:20:36.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.493+0000 7f89bffff700 1 Processor -- start 2021-10-20T23:20:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.493+0000 7f89bffff700 1 -- start start 2021-10-20T23:20:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.493+0000 7f89bffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f89c00b25a0 0x7f89c0066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c0066a10 0x7f89c0066e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c0065330 con 0x7f89c00b3000 2021-10-20T23:20:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c0062000 con 0x7f89c00b25a0 2021-10-20T23:20:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00b33e0 con 0x7f89c0066a10 2021-10-20T23:20:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89beffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f89c00b3000 0x7f89c0060b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36690/0 (socket says 172.21.15.12:36690) 2021-10-20T23:20:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89beffd700 1 -- 172.21.15.12:0/654619799 learned_addr learned my addr 172.21.15.12:0/654619799 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bf7fe700 1 --2- 172.21.15.12:0/654619799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c0066a10 0x7f89c0066e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89b7fff700 1 --2- 172.21.15.12:0/654619799 >> v2:172.21.15.31:3300/0 conn(0x7f89c00b25a0 0x7f89c0066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89be7fc700 1 -- 172.21.15.12:0/654619799 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974995541 0 0) 0x7f89c0065330 con 0x7f89c00b3000 2021-10-20T23:20:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89be7fc700 1 -- 172.21.15.12:0/654619799 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89a0003260 con 0x7f89c00b3000 2021-10-20T23:20:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89be7fc700 1 -- 172.21.15.12:0/654619799 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807184127 0 0) 0x7f89a0003260 con 0x7f89c00b3000 2021-10-20T23:20:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bf7fe700 1 -- 172.21.15.12:0/654619799 >> v2:172.21.15.31:3300/0 conn(0x7f89c00b25a0 msgr2=0x7f89c0066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bf7fe700 1 --2- 172.21.15.12:0/654619799 >> v2:172.21.15.31:3300/0 conn(0x7f89c00b25a0 0x7f89c0066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bf7fe700 1 -- 172.21.15.12:0/654619799 >> v1:172.21.15.12:6789/0 conn(0x7f89c00b3000 legacy=0x7f89c0060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bf7fe700 1 -- 172.21.15.12:0/654619799 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c005fa60 con 0x7f89c0066a10 2021-10-20T23:20:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89b7fff700 1 --2- 172.21.15.12:0/654619799 >> v2:172.21.15.31:3300/0 conn(0x7f89c00b25a0 0x7f89c0066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:20:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bf7fe700 1 --2- 172.21.15.12:0/654619799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c0066a10 0x7f89c0066e50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f89b0001800 tx=0x7f89b80091d0).ready entity=mon.2 client_cookie=14a4fe2c65c29531 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89be7fc700 1 -- 172.21.15.12:0/654619799 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89b0001660 con 0x7f89c0066a10 2021-10-20T23:20:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89be7fc700 1 -- 172.21.15.12:0/654619799 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b800f510 con 0x7f89c0066a10 2021-10-20T23:20:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89be7fc700 1 -- 172.21.15.12:0/654619799 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89b800f680 con 0x7f89c0066a10 2021-10-20T23:20:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 -- 172.21.15.12:0/654619799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c0066a10 msgr2=0x7f89c0066e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 --2- 172.21.15.12:0/654619799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c0066a10 0x7f89c0066e50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f89b0001800 tx=0x7f89b80091d0).stop 2021-10-20T23:20:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 -- 172.21.15.12:0/654619799 shutdown_connections 2021-10-20T23:20:36.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 --2- 172.21.15.12:0/654619799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c0066a10 0x7f89c0066e50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 --2- 172.21.15.12:0/654619799 >> v2:172.21.15.31:3300/0 conn(0x7f89c00b25a0 0x7f89c0066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 -- 172.21.15.12:0/654619799 >> 172.21.15.12:0/654619799 conn(0x7f89c00636e0 msgr2=0x7f89c0063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:36.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 -- 172.21.15.12:0/654619799 shutdown_connections 2021-10-20T23:20:36.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.497+0000 7f89bffff700 1 -- 172.21.15.12:0/654619799 wait complete. 2021-10-20T23:20:36.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.501+0000 7f89bffff700 1 Processor -- start 2021-10-20T23:20:36.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.501+0000 7f89bffff700 1 -- start start 2021-10-20T23:20:36.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.501+0000 7f89bffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89c0066a10 0x7f89c00a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.501+0000 7f89bffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c00b25a0 0x7f89c00a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.501+0000 7f89bffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c00b3000 0x7f89c00a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.501+0000 7f89bffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00a4a90 con 0x7f89c00b25a0 2021-10-20T23:20:36.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.501+0000 7f89bffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00a79e0 con 0x7f89c0066a10 2021-10-20T23:20:36.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89bffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00a7c80 con 0x7f89c00b3000 2021-10-20T23:20:36.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c00b25a0 0x7f89c00a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c00b25a0 0x7f89c00a45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38104/0 (socket says 172.21.15.12:38104) 2021-10-20T23:20:36.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89b7fff700 1 -- 172.21.15.12:0/3446734787 learned_addr learned my addr 172.21.15.12:0/3446734787 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:36.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89beffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89c0066a10 0x7f89c00a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89bf7fe700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c00b3000 0x7f89c00a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89b7fff700 1 -- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c00b3000 msgr2=0x7f89c00a86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89b7fff700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c00b3000 0x7f89c00a86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89b7fff700 1 -- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89c0066a10 msgr2=0x7f89c00a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89b7fff700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89c0066a10 0x7f89c00a40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89b7fff700 1 -- 172.21.15.12:0/3446734787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a800b180 con 0x7f89c00b25a0 2021-10-20T23:20:36.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89b7fff700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c00b25a0 0x7f89c00a45a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f89a800c000 tx=0x7f89a8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:36.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89bcff9700 1 -- 172.21.15.12:0/3446734787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89a8010780 con 0x7f89c00b25a0 2021-10-20T23:20:36.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89bcff9700 1 -- 172.21.15.12:0/3446734787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a80108e0 con 0x7f89c00b25a0 2021-10-20T23:20:36.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b8009470 con 0x7f89c00b25a0 2021-10-20T23:20:36.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89bcff9700 1 -- 172.21.15.12:0/3446734787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89a8010c40 con 0x7f89c00b25a0 2021-10-20T23:20:36.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c00a81c0 con 0x7f89c00b25a0 2021-10-20T23:20:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c00a8380 con 0x7f89c00b25a0 2021-10-20T23:20:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.505+0000 7f89bcff9700 1 -- 172.21.15.12:0/3446734787 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f89a801c460 con 0x7f89c00b25a0 2021-10-20T23:20:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.509+0000 7f89bcff9700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89a4053610 0x7f89a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.509+0000 7f89bcff9700 1 -- 172.21.15.12:0/3446734787 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f89a806c110 con 0x7f89c00b25a0 2021-10-20T23:20:36.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.509+0000 7f89beffd700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89a4053610 0x7f89a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:36.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.509+0000 7f89beffd700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89a4053610 0x7f89a4055ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f89b000d000 tx=0x7f89b00019e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:36.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.513+0000 7f89bcff9700 1 -- 172.21.15.12:0/3446734787 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f89a8042fa0 con 0x7f89c00b25a0 2021-10-20T23:20:36.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.677+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89c005fd00 con 0x7f89c00b25a0 2021-10-20T23:20:36.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.677+0000 7f89bcff9700 1 -- 172.21.15.12:0/3446734787 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f89a80465c0 con 0x7f89c00b25a0 2021-10-20T23:20:36.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:36.681 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:20:34.132895+0000","modified":"2021-10-20T23:20:35.137040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/655661573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":655661573},{"type":"v1","addr":"172.21.15.12:6835","nonce":655661573}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-20T23:20:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89a4053610 msgr2=0x7f89a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89a4053610 0x7f89a4055ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f89b000d000 tx=0x7f89b00019e0).stop 2021-10-20T23:20:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c00b25a0 msgr2=0x7f89c00a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c00b25a0 0x7f89c00a45a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f89a800c000 tx=0x7f89a8006df0).stop 2021-10-20T23:20:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 shutdown_connections 2021-10-20T23:20:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89a4053610 0x7f89a4055ad0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89c00b3000 0x7f89c00a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c00b25a0 0x7f89c00a45a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 --2- 172.21.15.12:0/3446734787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89c0066a10 0x7f89c00a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 >> 172.21.15.12:0/3446734787 conn(0x7f89c00636e0 msgr2=0x7f89c00b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 shutdown_connections 2021-10-20T23:20:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:36.681+0000 7f89bffff700 1 -- 172.21.15.12:0/3446734787 wait complete. 2021-10-20T23:20:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2021-10-20T23:20:36.995 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:20:34.132895+0000', 'modified': '2021-10-20T23:20:35.137040+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4890}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4890': {'gid': 4890, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/655661573', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 655661573}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 655661573}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:20:36.996 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:20:36.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:20:37.118 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":4890,"want_state":"up:active","state":"up:active","rank_uptime":2.9724784550000001,"mdsmap_epoch":13,"osdmap_epoch":36,"osdmap_epoch_barrier":36,"uptime":9.8196691489999992} 2021-10-20T23:20:37.118 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 4890, "mdsmap_epoch": 13, "osdmap_epoch": 36, "osdmap_epoch_barrier": 36, "rank_uptime": 2.972478455, "state": "up:active", "uptime": 9.819669149, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:20:37.120 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:20:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc84884700 1 Processor -- start 2021-10-20T23:20:37.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc84884700 1 -- start start 2021-10-20T23:20:37.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc84884700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc800b0710 0x7fbc80142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc84884700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 0x7fbc8005c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc84884700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc80143920 con 0x7fbc800ace70 2021-10-20T23:20:37.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc84884700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc800b0af0 con 0x7fbc800b0710 2021-10-20T23:20:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc84884700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800ae680 con 0x7fbc800b30d0 2021-10-20T23:20:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc7f59e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbc800ace70 0x7fbc80143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36706/0 (socket says 172.21.15.12:36706) 2021-10-20T23:20:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc7ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc800b0710 0x7fbc80142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc7f59e700 1 -- 172.21.15.12:0/2994332420 learned_addr learned my addr 172.21.15.12:0/2994332420 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc7e59c700 1 --2- 172.21.15.12:0/2994332420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 0x7fbc8005c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc7dd9b700 1 -- 172.21.15.12:0/2994332420 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806266045 0 0) 0x7fbc80143920 con 0x7fbc800ace70 2021-10-20T23:20:37.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc7ed9d700 1 -- 172.21.15.12:0/2994332420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 msgr2=0x7fbc8005c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:37.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc7ed9d700 1 --2- 172.21.15.12:0/2994332420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 0x7fbc8005c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc7ed9d700 1 -- 172.21.15.12:0/2994332420 >> v1:172.21.15.12:6789/0 conn(0x7fbc800ace70 legacy=0x7fbc80143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.225+0000 7fbc7ed9d700 1 -- 172.21.15.12:0/2994332420 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800ae920 con 0x7fbc800b0710 2021-10-20T23:20:37.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc7ed9d700 1 --2- 172.21.15.12:0/2994332420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 0x7fbc80142d20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fbc70002f70 tx=0x7fbc70006df0).ready entity=mon.0 client_cookie=143aad335f97c1ca server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:37.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc7dd9b700 1 -- 172.21.15.12:0/2994332420 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc7000d570 con 0x7fbc800b0710 2021-10-20T23:20:37.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc7dd9b700 1 -- 172.21.15.12:0/2994332420 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc70000e90 con 0x7fbc800b0710 2021-10-20T23:20:37.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc7dd9b700 1 -- 172.21.15.12:0/2994332420 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc7000d8c0 con 0x7fbc800b0710 2021-10-20T23:20:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 -- 172.21.15.12:0/2994332420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 msgr2=0x7fbc80142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 --2- 172.21.15.12:0/2994332420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 0x7fbc80142d20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fbc70002f70 tx=0x7fbc70006df0).stop 2021-10-20T23:20:37.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 -- 172.21.15.12:0/2994332420 shutdown_connections 2021-10-20T23:20:37.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 --2- 172.21.15.12:0/2994332420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 0x7fbc8005c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 --2- 172.21.15.12:0/2994332420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 0x7fbc80142d20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 -- 172.21.15.12:0/2994332420 >> 172.21.15.12:0/2994332420 conn(0x7fbc80061140 msgr2=0x7fbc80062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:37.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 -- 172.21.15.12:0/2994332420 shutdown_connections 2021-10-20T23:20:37.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 -- 172.21.15.12:0/2994332420 wait complete. 2021-10-20T23:20:37.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 Processor -- start 2021-10-20T23:20:37.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.229+0000 7fbc84884700 1 -- start start 2021-10-20T23:20:37.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc84884700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc800ace70 0x7fbc80063c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc84884700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 0x7fbc80066f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc84884700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 0x7fbc80153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc84884700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc80066400 con 0x7fbc800b0710 2021-10-20T23:20:37.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc84884700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc80140c00 con 0x7fbc800ace70 2021-10-20T23:20:37.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc84884700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800ac570 con 0x7fbc800b30d0 2021-10-20T23:20:37.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 0x7fbc80066f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 0x7fbc80066f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38116/0 (socket says 172.21.15.12:38116) 2021-10-20T23:20:37.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7e59c700 1 -- 172.21.15.12:0/3519841073 learned_addr learned my addr 172.21.15.12:0/3519841073 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:37.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7ed9d700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc800ace70 0x7fbc80063c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7f59e700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 0x7fbc80153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7e59c700 1 -- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 msgr2=0x7fbc80153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7e59c700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 0x7fbc80153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7e59c700 1 -- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc800ace70 msgr2=0x7fbc80063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7e59c700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc800ace70 0x7fbc80063c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7e59c700 1 -- 172.21.15.12:0/3519841073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7000b180 con 0x7fbc800b0710 2021-10-20T23:20:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc7e59c700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 0x7fbc80066f50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fbc80140d40 tx=0x7fbc680091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc77fff700 1 -- 172.21.15.12:0/3519841073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc68012600 con 0x7fbc800b0710 2021-10-20T23:20:37.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc77fff700 1 -- 172.21.15.12:0/3519841073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc68012760 con 0x7fbc800b0710 2021-10-20T23:20:37.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc80064c60 con 0x7fbc800b0710 2021-10-20T23:20:37.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc77fff700 1 -- 172.21.15.12:0/3519841073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc68012ac0 con 0x7fbc800b0710 2021-10-20T23:20:37.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.233+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc800ac1f0 con 0x7fbc800b0710 2021-10-20T23:20:37.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.237+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc80064df0 con 0x7fbc800b0710 2021-10-20T23:20:37.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.237+0000 7fbc77fff700 1 -- 172.21.15.12:0/3519841073 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc68018020 con 0x7fbc800b0710 2021-10-20T23:20:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.237+0000 7fbc77fff700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc640536f0 0x7fbc64055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.237+0000 7fbc77fff700 1 -- 172.21.15.12:0/3519841073 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbc6806bf50 con 0x7fbc800b0710 2021-10-20T23:20:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.237+0000 7fbc7ed9d700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc640536f0 0x7fbc64055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.237+0000 7fbc7ed9d700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc640536f0 0x7fbc64055bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbc7001a000 tx=0x7fbc70014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:37.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.241+0000 7fbc77fff700 1 -- 172.21.15.12:0/3519841073 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc68042ef0 con 0x7fbc800b0710 2021-10-20T23:20:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.369+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc80067700 con 0x7fbc800b0710 2021-10-20T23:20:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc77fff700 1 -- 172.21.15.12:0/3519841073 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16271 (secure 0 0 0) 0x7fbc68046510 con 0x7fbc800b0710 2021-10-20T23:20:37.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:37.375 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":36,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:20:35.135886+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:20:32.169677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-10-20T23:20:33.133690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:20:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc640536f0 msgr2=0x7fbc64055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc640536f0 0x7fbc64055bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbc7001a000 tx=0x7fbc70014000).stop 2021-10-20T23:20:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 msgr2=0x7fbc80066f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 0x7fbc80066f50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fbc80140d40 tx=0x7fbc680091d0).stop 2021-10-20T23:20:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 shutdown_connections 2021-10-20T23:20:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc640536f0 0x7fbc64055bb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc800b30d0 0x7fbc80153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800b0710 0x7fbc80066f50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 --2- 172.21.15.12:0/3519841073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc800ace70 0x7fbc80063c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.373+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 >> 172.21.15.12:0/3519841073 conn(0x7fbc80061140 msgr2=0x7fbc80142300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:37.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.377+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 shutdown_connections 2021-10-20T23:20:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.377+0000 7fbc84884700 1 -- 172.21.15.12:0/3519841073 wait complete. 2021-10-20T23:20:37.392 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:20:32.169677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:20:33.133690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:20:37.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:20:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 Processor -- start 2021-10-20T23:20:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 -- start start 2021-10-20T23:20:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45c00b4180 0x7f45c0140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f45c00b4690 0x7f45c00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c0143b60 con 0x7f45c0146950 2021-10-20T23:20:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c0147510 con 0x7f45c00b4180 2021-10-20T23:20:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c0143e00 con 0x7f45c00b4690 2021-10-20T23:20:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c53b3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45c00b4180 0x7f45c0140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c53b3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45c00b4180 0x7f45c0140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38124/0 (socket says 172.21.15.12:38124) 2021-10-20T23:20:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c53b3700 1 -- 172.21.15.12:0/3000887695 learned_addr learned my addr 172.21.15.12:0/3000887695 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c63b5700 1 --2- 172.21.15.12:0/3000887695 >> v2:172.21.15.31:3300/0 conn(0x7f45c00b4690 0x7f45c00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c53b3700 1 -- 172.21.15.12:0/3000887695 >> v2:172.21.15.31:3300/0 conn(0x7f45c00b4690 msgr2=0x7f45c00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c53b3700 1 --2- 172.21.15.12:0/3000887695 >> v2:172.21.15.31:3300/0 conn(0x7f45c00b4690 0x7f45c00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c53b3700 1 -- 172.21.15.12:0/3000887695 >> v1:172.21.15.31:6789/0 conn(0x7f45c0146950 legacy=0x7f45c0140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:37.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c53b3700 1 -- 172.21.15.12:0/3000887695 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c00b0c90 con 0x7f45c00b4180 2021-10-20T23:20:37.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c53b3700 1 --2- 172.21.15.12:0/3000887695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 0x7f45c0140940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f45c0060c50 tx=0x7f45b0006eb0).ready entity=mon.0 client_cookie=280e5a7b6c740696 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c4bb2700 1 -- 172.21.15.12:0/3000887695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b000d5c0 con 0x7f45c00b4180 2021-10-20T23:20:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c4bb2700 1 -- 172.21.15.12:0/3000887695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0000e90 con 0x7f45c00b4180 2021-10-20T23:20:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c4bb2700 1 -- 172.21.15.12:0/3000887695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b000d910 con 0x7f45c00b4180 2021-10-20T23:20:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 -- 172.21.15.12:0/3000887695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 msgr2=0x7f45c0140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 --2- 172.21.15.12:0/3000887695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 0x7f45c0140940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f45c0060c50 tx=0x7f45b0006eb0).stop 2021-10-20T23:20:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 -- 172.21.15.12:0/3000887695 shutdown_connections 2021-10-20T23:20:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 --2- 172.21.15.12:0/3000887695 >> v2:172.21.15.31:3300/0 conn(0x7f45c00b4690 0x7f45c00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 --2- 172.21.15.12:0/3000887695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 0x7f45c0140940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 -- 172.21.15.12:0/3000887695 >> 172.21.15.12:0/3000887695 conn(0x7f45c005c490 msgr2=0x7f45c005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 -- 172.21.15.12:0/3000887695 shutdown_connections 2021-10-20T23:20:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.501+0000 7f45c7e18700 1 -- 172.21.15.12:0/3000887695 wait complete. 2021-10-20T23:20:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c7e18700 1 Processor -- start 2021-10-20T23:20:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c7e18700 1 -- start start 2021-10-20T23:20:37.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c7e18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 0x7f45c00ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c7e18700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45c00b4690 0x7f45c00b9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c7e18700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45c0146950 0x7f45c00b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c7e18700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c014ffa0 con 0x7f45c00b4180 2021-10-20T23:20:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c7e18700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00ba3c0 con 0x7f45c00b4690 2021-10-20T23:20:37.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c7e18700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00ba660 con 0x7f45c0146950 2021-10-20T23:20:37.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c5bb4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 0x7f45c00ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c5bb4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 0x7f45c00ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38128/0 (socket says 172.21.15.12:38128) 2021-10-20T23:20:37.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c53b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45c00b4690 0x7f45c00b9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c5bb4700 1 -- 172.21.15.12:0/2925620809 learned_addr learned my addr 172.21.15.12:0/2925620809 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:37.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c63b5700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45c0146950 0x7f45c00b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c5bb4700 1 -- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45c0146950 msgr2=0x7f45c00b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c5bb4700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45c0146950 0x7f45c00b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.505+0000 7f45c5bb4700 1 -- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45c00b4690 msgr2=0x7f45c00b9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45c5bb4700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45c00b4690 0x7f45c00b9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45c5bb4700 1 -- 172.21.15.12:0/2925620809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b000b1e0 con 0x7f45c00b4180 2021-10-20T23:20:37.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45c5bb4700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 0x7f45c00ae680 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f45bc001fa0 tx=0x7f45bc007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:37.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45aeffd700 1 -- 172.21.15.12:0/2925620809 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45bc007030 con 0x7f45c00b4180 2021-10-20T23:20:37.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45aeffd700 1 -- 172.21.15.12:0/2925620809 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc007190 con 0x7f45c00b4180 2021-10-20T23:20:37.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45aeffd700 1 -- 172.21.15.12:0/2925620809 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45bc006510 con 0x7f45c00b4180 2021-10-20T23:20:37.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c0152da0 con 0x7f45c00b4180 2021-10-20T23:20:37.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c00b9e40 con 0x7f45c00b4180 2021-10-20T23:20:37.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c0057350 con 0x7f45c00b4180 2021-10-20T23:20:37.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45aeffd700 1 -- 172.21.15.12:0/2925620809 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45bc010030 con 0x7f45c00b4180 2021-10-20T23:20:37.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45aeffd700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45a0053640 0x7f45a0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45aeffd700 1 -- 172.21.15.12:0/2925620809 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f45bc06b7c0 con 0x7f45c00b4180 2021-10-20T23:20:37.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.509+0000 7f45c53b3700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45a0053640 0x7f45a0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.513+0000 7f45c53b3700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45a0053640 0x7f45a0055b00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f45b001c000 tx=0x7f45b0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:37.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.517+0000 7f45aeffd700 1 -- 172.21.15.12:0/2925620809 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45bc0426b0 con 0x7f45c00b4180 2021-10-20T23:20:37.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.645+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f45c00698e0 con 0x7f45c00b4180 2021-10-20T23:20:37.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.645+0000 7f45aeffd700 1 -- 172.21.15.12:0/2925620809 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v36) v1 ==== 110+0+10 (secure 0 0 0) 0x7f45bc045cd0 con 0x7f45c00b4180 2021-10-20T23:20:37.650 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:20:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45a0053640 msgr2=0x7f45a0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45a0053640 0x7f45a0055b00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f45b001c000 tx=0x7f45b0015000).stop 2021-10-20T23:20:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 msgr2=0x7f45c00ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 0x7f45c00ae680 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f45bc001fa0 tx=0x7f45bc007c30).stop 2021-10-20T23:20:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 shutdown_connections 2021-10-20T23:20:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45a0053640 0x7f45a0055b00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45c0146950 0x7f45c00b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45c00b4690 0x7f45c00b9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 --2- 172.21.15.12:0/2925620809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00b4180 0x7f45c00ae680 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 >> 172.21.15.12:0/2925620809 conn(0x7f45c005c490 msgr2=0x7f45c013b320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 shutdown_connections 2021-10-20T23:20:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.649+0000 7f45c7e18700 1 -- 172.21.15.12:0/2925620809 wait complete. 2021-10-20T23:20:37.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:20:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.769+0000 7f34e15ba700 1 Processor -- start 2021-10-20T23:20:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.769+0000 7f34e15ba700 1 -- start start 2021-10-20T23:20:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 0x7f34dc0abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34dc0a9ec0 0x7f34dc13e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34dc144d20 con 0x7f34dc144940 2021-10-20T23:20:37.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc0ac200 con 0x7f34dc0a9ec0 2021-10-20T23:20:37.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc144f80 con 0x7f34dc0b0f80 2021-10-20T23:20:37.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34db7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34dc0a9ec0 0x7f34dc13e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34db7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34dc0a9ec0 0x7f34dc13e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38138/0 (socket says 172.21.15.12:38138) 2021-10-20T23:20:37.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34db7fe700 1 -- 172.21.15.12:0/1564338281 learned_addr learned my addr 172.21.15.12:0/1564338281 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:37.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34d3fff700 1 --2- 172.21.15.12:0/1564338281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 0x7f34dc0abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34db7fe700 1 -- 172.21.15.12:0/1564338281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 msgr2=0x7f34dc0abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:37.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34db7fe700 1 --2- 172.21.15.12:0/1564338281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 0x7f34dc0abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34db7fe700 1 -- 172.21.15.12:0/1564338281 >> v1:172.21.15.31:6789/0 conn(0x7f34dc144940 legacy=0x7f34dc0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34db7fe700 1 -- 172.21.15.12:0/1564338281 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc145220 con 0x7f34dc0a9ec0 2021-10-20T23:20:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34d3fff700 1 --2- 172.21.15.12:0/1564338281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 0x7f34dc0abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34db7fe700 1 --2- 172.21.15.12:0/1564338281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc0a9ec0 0x7f34dc13e120 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f34d40032f0 tx=0x7f34d4009290).ready entity=mon.0 client_cookie=6011e280ec14e56e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34da7fc700 1 -- 172.21.15.12:0/1564338281 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34d400b8a0 con 0x7f34dc0a9ec0 2021-10-20T23:20:37.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34da7fc700 1 -- 172.21.15.12:0/1564338281 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d400ba00 con 0x7f34dc0a9ec0 2021-10-20T23:20:37.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34da7fc700 1 -- 172.21.15.12:0/1564338281 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34d400bb70 con 0x7f34dc0a9ec0 2021-10-20T23:20:37.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 -- 172.21.15.12:0/1564338281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc0a9ec0 msgr2=0x7f34dc13e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 --2- 172.21.15.12:0/1564338281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc0a9ec0 0x7f34dc13e120 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f34d40032f0 tx=0x7f34d4009290).stop 2021-10-20T23:20:37.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 -- 172.21.15.12:0/1564338281 shutdown_connections 2021-10-20T23:20:37.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 --2- 172.21.15.12:0/1564338281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc0a9ec0 0x7f34dc13e120 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 --2- 172.21.15.12:0/1564338281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 0x7f34dc0abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 -- 172.21.15.12:0/1564338281 >> 172.21.15.12:0/1564338281 conn(0x7f34dc0b2970 msgr2=0x7f34dc0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:37.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 -- 172.21.15.12:0/1564338281 shutdown_connections 2021-10-20T23:20:37.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.773+0000 7f34e15ba700 1 -- 172.21.15.12:0/1564338281 wait complete. 2021-10-20T23:20:37.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 Processor -- start 2021-10-20T23:20:37.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 -- start start 2021-10-20T23:20:37.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0a9ec0 0x7f34dc136320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 0x7f34dc0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc144940 0x7f34dc0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0aeca0 con 0x7f34dc144940 2021-10-20T23:20:37.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0ada40 con 0x7f34dc0a9ec0 2021-10-20T23:20:37.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0b4450 con 0x7f34dc0b0f80 2021-10-20T23:20:37.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34db7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc144940 0x7f34dc0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34db7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc144940 0x7f34dc0ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38146/0 (socket says 172.21.15.12:38146) 2021-10-20T23:20:37.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34db7fe700 1 -- 172.21.15.12:0/699690513 learned_addr learned my addr 172.21.15.12:0/699690513 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:37.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34daffd700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0a9ec0 0x7f34dc136320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34d3fff700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 0x7f34dc0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34db7fe700 1 -- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 msgr2=0x7f34dc0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34db7fe700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 0x7f34dc0ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34db7fe700 1 -- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0a9ec0 msgr2=0x7f34dc136320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34db7fe700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0a9ec0 0x7f34dc136320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34db7fe700 1 -- 172.21.15.12:0/699690513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d4009530 con 0x7f34dc144940 2021-10-20T23:20:37.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34daffd700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0a9ec0 0x7f34dc136320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:37.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34db7fe700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc144940 0x7f34dc0ae7b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f34d40032f0 tx=0x7f34d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:37.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34d8ff9700 1 -- 172.21.15.12:0/699690513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34d400b8a0 con 0x7f34dc144940 2021-10-20T23:20:37.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34d8ff9700 1 -- 172.21.15.12:0/699690513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d400bde0 con 0x7f34dc144940 2021-10-20T23:20:37.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc0b5640 con 0x7f34dc144940 2021-10-20T23:20:37.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34d8ff9700 1 -- 172.21.15.12:0/699690513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34d4020620 con 0x7f34dc144940 2021-10-20T23:20:37.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.777+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc0adf30 con 0x7f34dc144940 2021-10-20T23:20:37.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.781+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc0b4610 con 0x7f34dc144940 2021-10-20T23:20:37.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.781+0000 7f34d8ff9700 1 -- 172.21.15.12:0/699690513 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f34d4028070 con 0x7f34dc144940 2021-10-20T23:20:37.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.781+0000 7f34d8ff9700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f34b40536d0 0x7f34b4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:37.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.781+0000 7f34d8ff9700 1 -- 172.21.15.12:0/699690513 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f34d406c530 con 0x7f34dc144940 2021-10-20T23:20:37.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.781+0000 7f34daffd700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f34b40536d0 0x7f34b4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:37.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.781+0000 7f34daffd700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f34b40536d0 0x7f34b4055b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f34cc00b000 tx=0x7f34cc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:37.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.789+0000 7f34d8ff9700 1 -- 172.21.15.12:0/699690513 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f34dc0b4610 con 0x7f34dc144940 2021-10-20T23:20:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34dc0b4610 con 0x7f34dc144940 2021-10-20T23:20:37.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34d8ff9700 1 -- 172.21.15.12:0/699690513 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34dc0b4610 con 0x7f34dc144940 2021-10-20T23:20:37.923 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:37.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f34b40536d0 msgr2=0x7f34b4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f34b40536d0 0x7f34b4055b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f34cc00b000 tx=0x7f34cc009040).stop 2021-10-20T23:20:37.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc144940 msgr2=0x7f34dc0ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:37.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc144940 0x7f34dc0ae7b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f34d40032f0 tx=0x7f34d4016000).stop 2021-10-20T23:20:37.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 shutdown_connections 2021-10-20T23:20:37.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f34b40536d0 0x7f34b4055b90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34dc144940 0x7f34dc0ae7b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34dc0b0f80 0x7f34dc0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 --2- 172.21.15.12:0/699690513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0a9ec0 0x7f34dc136320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:37.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 >> 172.21.15.12:0/699690513 conn(0x7f34dc0b2970 msgr2=0x7f34dc0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:37.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 shutdown_connections 2021-10-20T23:20:37.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:37.921+0000 7f34e15ba700 1 -- 172.21.15.12:0/699690513 wait complete. 2021-10-20T23:20:37.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:20:38.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f7170c62700 1 Processor -- start 2021-10-20T23:20:38.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f7170c62700 1 -- start start 2021-10-20T23:20:38.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f7170c62700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f716c0b0990 0x7f716c0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f7170c62700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0ae6e0 0x7f716c0aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f7170c62700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716c0ac390 con 0x7f716c0b1230 2021-10-20T23:20:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f7170c62700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c0b1610 con 0x7f716c0b0990 2021-10-20T23:20:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f7170c62700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0b02c0 con 0x7f716c0ae6e0 2021-10-20T23:20:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0ae6e0 0x7f716c0aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0ae6e0 0x7f716c0aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:43912/0 (socket says 172.21.15.12:43912) 2021-10-20T23:20:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716bfff700 1 -- 172.21.15.12:0/3500254091 learned_addr learned my addr 172.21.15.12:0/3500254091 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716affd700 1 --2- 172.21.15.12:0/3500254091 >> v2:172.21.15.31:3300/0 conn(0x7f716c0b0990 0x7f716c0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716bfff700 1 -- 172.21.15.12:0/3500254091 >> v2:172.21.15.31:3300/0 conn(0x7f716c0b0990 msgr2=0x7f716c0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:38.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716bfff700 1 --2- 172.21.15.12:0/3500254091 >> v2:172.21.15.31:3300/0 conn(0x7f716c0b0990 0x7f716c0afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716bfff700 1 -- 172.21.15.12:0/3500254091 >> v1:172.21.15.31:6789/0 conn(0x7f716c0b1230 legacy=0x7f716c142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716bfff700 1 -- 172.21.15.12:0/3500254091 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0b0560 con 0x7f716c0ae6e0 2021-10-20T23:20:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716bfff700 1 --2- 172.21.15.12:0/3500254091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0ae6e0 0x7f716c0aeb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7154002f70 tx=0x7f7154006eb0).ready entity=mon.2 client_cookie=c57a96d550a1f39f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716a7fc700 1 -- 172.21.15.12:0/3500254091 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f715400d570 con 0x7f716c0ae6e0 2021-10-20T23:20:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716a7fc700 1 -- 172.21.15.12:0/3500254091 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154000e90 con 0x7f716c0ae6e0 2021-10-20T23:20:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.045+0000 7f716a7fc700 1 -- 172.21.15.12:0/3500254091 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f715400d900 con 0x7f716c0ae6e0 2021-10-20T23:20:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 -- 172.21.15.12:0/3500254091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0ae6e0 msgr2=0x7f716c0aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 --2- 172.21.15.12:0/3500254091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0ae6e0 0x7f716c0aeb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7154002f70 tx=0x7f7154006eb0).stop 2021-10-20T23:20:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 -- 172.21.15.12:0/3500254091 shutdown_connections 2021-10-20T23:20:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 --2- 172.21.15.12:0/3500254091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0ae6e0 0x7f716c0aeb30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 --2- 172.21.15.12:0/3500254091 >> v2:172.21.15.31:3300/0 conn(0x7f716c0b0990 0x7f716c0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 -- 172.21.15.12:0/3500254091 >> 172.21.15.12:0/3500254091 conn(0x7f716c062560 msgr2=0x7f716c062940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 -- 172.21.15.12:0/3500254091 shutdown_connections 2021-10-20T23:20:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 -- 172.21.15.12:0/3500254091 wait complete. 2021-10-20T23:20:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 Processor -- start 2021-10-20T23:20:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.049+0000 7f7170c62700 1 -- start start 2021-10-20T23:20:38.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7170c62700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c0ae6e0 0x7f716c0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7170c62700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0b0990 0x7f716c0a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7170c62700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c0b1230 0x7f716c0a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7170c62700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0b5610 con 0x7f716c0ae6e0 2021-10-20T23:20:38.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7170c62700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c145760 con 0x7f716c0b1230 2021-10-20T23:20:38.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7170c62700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c145e80 con 0x7f716c0b0990 2021-10-20T23:20:38.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c0ae6e0 0x7f716c0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c0ae6e0 0x7f716c0b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38156/0 (socket says 172.21.15.12:38156) 2021-10-20T23:20:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716b7fe700 1 -- 172.21.15.12:0/949776094 learned_addr learned my addr 172.21.15.12:0/949776094 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716affd700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0b0990 0x7f716c0a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716bfff700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c0b1230 0x7f716c0a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716b7fe700 1 -- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0b0990 msgr2=0x7f716c0a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716b7fe700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0b0990 0x7f716c0a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716b7fe700 1 -- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c0b1230 msgr2=0x7f716c0a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716b7fe700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c0b1230 0x7f716c0a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716b7fe700 1 -- 172.21.15.12:0/949776094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715400b1e0 con 0x7f716c0ae6e0 2021-10-20T23:20:38.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f716b7fe700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c0ae6e0 0x7f716c0b49c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f716c069d90 tx=0x7f7164007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7168ff9700 1 -- 172.21.15.12:0/949776094 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7164012400 con 0x7f716c0ae6e0 2021-10-20T23:20:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7168ff9700 1 -- 172.21.15.12:0/949776094 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164012560 con 0x7f716c0ae6e0 2021-10-20T23:20:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c1454c0 con 0x7f716c0ae6e0 2021-10-20T23:20:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7168ff9700 1 -- 172.21.15.12:0/949776094 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71640128c0 con 0x7f716c0ae6e0 2021-10-20T23:20:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c0b2750 con 0x7f716c0ae6e0 2021-10-20T23:20:38.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.053+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c0ae240 con 0x7f716c0ae6e0 2021-10-20T23:20:38.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.057+0000 7f7168ff9700 1 -- 172.21.15.12:0/949776094 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7164019030 con 0x7f716c0ae6e0 2021-10-20T23:20:38.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.057+0000 7f7168ff9700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7150053640 0x7f7150055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.057+0000 7f7168ff9700 1 -- 172.21.15.12:0/949776094 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f716406ae00 con 0x7f716c0ae6e0 2021-10-20T23:20:38.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.057+0000 7f716affd700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7150053640 0x7f7150055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.057+0000 7f716affd700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7150053640 0x7f7150055b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f715c00b000 tx=0x7f715c0091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.061+0000 7f7168ff9700 1 -- 172.21.15.12:0/949776094 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7164041cf0 con 0x7f716c0ae6e0 2021-10-20T23:20:38.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.189+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f716c057350 con 0x7f716c0ae6e0 2021-10-20T23:20:38.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.189+0000 7f7168ff9700 1 -- 172.21.15.12:0/949776094 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7164045310 con 0x7f716c0ae6e0 2021-10-20T23:20:38.193 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:38.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7150053640 msgr2=0x7f7150055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7150053640 0x7f7150055b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f715c00b000 tx=0x7f715c0091d0).stop 2021-10-20T23:20:38.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c0ae6e0 msgr2=0x7f716c0b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c0ae6e0 0x7f716c0b49c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f716c069d90 tx=0x7f7164007c50).stop 2021-10-20T23:20:38.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 shutdown_connections 2021-10-20T23:20:38.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7150053640 0x7f7150055b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c0b1230 0x7f716c0a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f716c0b0990 0x7f716c0a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 --2- 172.21.15.12:0/949776094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c0ae6e0 0x7f716c0b49c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 >> 172.21.15.12:0/949776094 conn(0x7f716c062560 msgr2=0x7f716c143070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:38.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 shutdown_connections 2021-10-20T23:20:38.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.193+0000 7f7170c62700 1 -- 172.21.15.12:0/949776094 wait complete. 2021-10-20T23:20:38.206 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:20:38.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4297408700 1 Processor -- start 2021-10-20T23:20:38.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4297408700 1 -- start start 2021-10-20T23:20:38.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4297408700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900601a0 0x7f42900b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4297408700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42900aa4a0 con 0x7f429005c560 2021-10-20T23:20:38.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4297408700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429005fb80 con 0x7f42900af3c0 2021-10-20T23:20:38.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4297408700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900b1450 con 0x7f42900601a0 2021-10-20T23:20:38.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4296c07700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f429005c560 0x7f42900a8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36760/0 (socket says 172.21.15.12:36760) 2021-10-20T23:20:38.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4296c07700 1 -- 172.21.15.12:0/3520588251 learned_addr learned my addr 172.21.15.12:0/3520588251 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:38.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4295c05700 1 --2- 172.21.15.12:0/3520588251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900601a0 0x7f42900b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.317+0000 7f4295404700 1 -- 172.21.15.12:0/3520588251 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868617725 0 0) 0x7f42900aa4a0 con 0x7f429005c560 2021-10-20T23:20:38.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295404700 1 -- 172.21.15.12:0/3520588251 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4278003260 con 0x7f429005c560 2021-10-20T23:20:38.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295404700 1 -- 172.21.15.12:0/3520588251 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019237890 0 0) 0x7f429005fb80 con 0x7f42900af3c0 2021-10-20T23:20:38.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295404700 1 -- 172.21.15.12:0/3520588251 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42900aa4a0 con 0x7f42900af3c0 2021-10-20T23:20:38.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295c05700 1 -- 172.21.15.12:0/3520588251 >> v1:172.21.15.31:6789/0 conn(0x7f42900af3c0 legacy=0x7f4290144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295c05700 1 -- 172.21.15.12:0/3520588251 >> v1:172.21.15.12:6789/0 conn(0x7f429005c560 legacy=0x7f42900a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295c05700 1 -- 172.21.15.12:0/3520588251 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429005f6b0 con 0x7f42900601a0 2021-10-20T23:20:38.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295c05700 1 --2- 172.21.15.12:0/3520588251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900601a0 0x7f42900b0cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4280002f70 tx=0x7f4280006df0).ready entity=mon.2 client_cookie=c6e1c30c8415239b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:38.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295404700 1 -- 172.21.15.12:0/3520588251 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f428000d5c0 con 0x7f42900601a0 2021-10-20T23:20:38.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295404700 1 -- 172.21.15.12:0/3520588251 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280000e90 con 0x7f42900601a0 2021-10-20T23:20:38.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4295404700 1 -- 172.21.15.12:0/3520588251 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f428000d910 con 0x7f42900601a0 2021-10-20T23:20:38.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4297408700 1 -- 172.21.15.12:0/3520588251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900601a0 msgr2=0x7f42900b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4297408700 1 --2- 172.21.15.12:0/3520588251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900601a0 0x7f42900b0cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4280002f70 tx=0x7f4280006df0).stop 2021-10-20T23:20:38.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4297408700 1 -- 172.21.15.12:0/3520588251 shutdown_connections 2021-10-20T23:20:38.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4297408700 1 --2- 172.21.15.12:0/3520588251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900601a0 0x7f42900b0cb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4297408700 1 -- 172.21.15.12:0/3520588251 >> 172.21.15.12:0/3520588251 conn(0x7f4290061140 msgr2=0x7f4290062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:38.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4297408700 1 -- 172.21.15.12:0/3520588251 shutdown_connections 2021-10-20T23:20:38.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4297408700 1 -- 172.21.15.12:0/3520588251 wait complete. 2021-10-20T23:20:38.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.321+0000 7f4297408700 1 Processor -- start 2021-10-20T23:20:38.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4297408700 1 -- start start 2021-10-20T23:20:38.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4297408700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f429005c560 0x7f42900b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4297408700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42900601a0 0x7f4290153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4297408700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900af3c0 0x7f4290153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4297408700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290067970 con 0x7f42900601a0 2021-10-20T23:20:38.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4297408700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290140920 con 0x7f429005c560 2021-10-20T23:20:38.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4297408700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4290066bd0 con 0x7f42900af3c0 2021-10-20T23:20:38.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4295c05700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42900601a0 0x7f4290153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4295c05700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42900601a0 0x7f4290153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38170/0 (socket says 172.21.15.12:38170) 2021-10-20T23:20:38.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4295c05700 1 -- 172.21.15.12:0/3533984234 learned_addr learned my addr 172.21.15.12:0/3533984234 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:38.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4296c07700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900af3c0 0x7f4290153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4296406700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f429005c560 0x7f42900b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4295c05700 1 -- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900af3c0 msgr2=0x7f4290153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4295c05700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900af3c0 0x7f4290153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4295c05700 1 -- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f429005c560 msgr2=0x7f42900b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4295c05700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f429005c560 0x7f42900b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4295c05700 1 -- 172.21.15.12:0/3533984234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428000b180 con 0x7f42900601a0 2021-10-20T23:20:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4296406700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f429005c560 0x7f42900b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:38.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4295c05700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42900601a0 0x7f4290153610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f4280002f70 tx=0x7f4280014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:38.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f427f7fe700 1 -- 172.21.15.12:0/3533984234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4280016070 con 0x7f42900601a0 2021-10-20T23:20:38.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f427f7fe700 1 -- 172.21.15.12:0/3533984234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280013850 con 0x7f42900601a0 2021-10-20T23:20:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4290153ff0 con 0x7f42900601a0 2021-10-20T23:20:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f427f7fe700 1 -- 172.21.15.12:0/3533984234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4280013bb0 con 0x7f42900601a0 2021-10-20T23:20:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4290066e80 con 0x7f42900601a0 2021-10-20T23:20:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f427f7fe700 1 -- 172.21.15.12:0/3533984234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4280025030 con 0x7f42900601a0 2021-10-20T23:20:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f427f7fe700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4270053640 0x7f4270055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.325+0000 7f427f7fe700 1 -- 172.21.15.12:0/3533984234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f428006c9f0 con 0x7f42900601a0 2021-10-20T23:20:38.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.329+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4290057350 con 0x7f42900601a0 2021-10-20T23:20:38.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.329+0000 7f4296406700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4270053640 0x7f4270055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.329+0000 7f4296406700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4270053640 0x7f4270055b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f428c00b000 tx=0x7f428c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.337+0000 7f427f7fe700 1 -- 172.21.15.12:0/3533984234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4280023080 con 0x7f42900601a0 2021-10-20T23:20:38.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.465+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4290067040 con 0x7f42900601a0 2021-10-20T23:20:38.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f427f7fe700 1 -- 172.21.15.12:0/3533984234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4280043950 con 0x7f42900601a0 2021-10-20T23:20:38.470 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:20:38.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4270053640 msgr2=0x7f4270055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4270053640 0x7f4270055b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f428c00b000 tx=0x7f428c009040).stop 2021-10-20T23:20:38.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42900601a0 msgr2=0x7f4290153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42900601a0 0x7f4290153610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f4280002f70 tx=0x7f4280014000).stop 2021-10-20T23:20:38.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 shutdown_connections 2021-10-20T23:20:38.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4270053640 0x7f4270055b00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42900af3c0 0x7f4290153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42900601a0 0x7f4290153610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 --2- 172.21.15.12:0/3533984234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f429005c560 0x7f42900b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 >> 172.21.15.12:0/3533984234 conn(0x7f4290061140 msgr2=0x7f42900aab60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:38.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 shutdown_connections 2021-10-20T23:20:38.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.469+0000 7f4297408700 1 -- 172.21.15.12:0/3533984234 wait complete. 2021-10-20T23:20:38.483 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:20:38.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 Processor -- start 2021-10-20T23:20:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 -- start start 2021-10-20T23:20:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5b40b36e0 0x7fd5b40b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40af070 0x7fd5b4144480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b40aa290 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40ae300 con 0x7fd5b40b36e0 2021-10-20T23:20:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4148170 con 0x7fd5b40af070 2021-10-20T23:20:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b91bb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40af070 0x7fd5b4144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5b40b36e0 0x7fd5b40b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5b40b36e0 0x7fd5b40b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:53154/0 (socket says 172.21.15.12:53154) 2021-10-20T23:20:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b3fff700 1 -- 172.21.15.12:0/763449866 learned_addr learned my addr 172.21.15.12:0/763449866 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b3fff700 1 -- 172.21.15.12:0/763449866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40af070 msgr2=0x7fd5b4144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b3fff700 1 --2- 172.21.15.12:0/763449866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40af070 0x7fd5b4144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b3fff700 1 -- 172.21.15.12:0/763449866 >> v1:172.21.15.31:6789/0 conn(0x7fd5b40a9eb0 legacy=0x7fd5b414b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b3fff700 1 -- 172.21.15.12:0/763449866 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b4148410 con 0x7fd5b40b36e0 2021-10-20T23:20:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b3fff700 1 --2- 172.21.15.12:0/763449866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40b36e0 0x7fd5b40b3130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd59c002f70 tx=0x7fd59c006eb0).ready entity=mon.1 client_cookie=48e01ec9408b1273 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b37fe700 1 -- 172.21.15.12:0/763449866 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd59c00d570 con 0x7fd5b40b36e0 2021-10-20T23:20:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b37fe700 1 -- 172.21.15.12:0/763449866 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c000e90 con 0x7fd5b40b36e0 2021-10-20T23:20:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5b37fe700 1 -- 172.21.15.12:0/763449866 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd59c00d900 con 0x7fd5b40b36e0 2021-10-20T23:20:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 -- 172.21.15.12:0/763449866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40b36e0 msgr2=0x7fd5b40b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 --2- 172.21.15.12:0/763449866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40b36e0 0x7fd5b40b3130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd59c002f70 tx=0x7fd59c006eb0).stop 2021-10-20T23:20:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 -- 172.21.15.12:0/763449866 shutdown_connections 2021-10-20T23:20:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 --2- 172.21.15.12:0/763449866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40af070 0x7fd5b4144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 --2- 172.21.15.12:0/763449866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40b36e0 0x7fd5b40b3130 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.589+0000 7fd5bac1e700 1 -- 172.21.15.12:0/763449866 >> 172.21.15.12:0/763449866 conn(0x7fd5b40607c0 msgr2=0x7fd5b4060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 -- 172.21.15.12:0/763449866 shutdown_connections 2021-10-20T23:20:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 -- 172.21.15.12:0/763449866 wait complete. 2021-10-20T23:20:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 Processor -- start 2021-10-20T23:20:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 -- start start 2021-10-20T23:20:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5b40a9eb0 0x7fd5b4157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40af070 0x7fd5b4144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40b36e0 0x7fd5b4142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b41433d0 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4144140 con 0x7fd5b40af070 2021-10-20T23:20:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5bac1e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4156c60 con 0x7fd5b40b36e0 2021-10-20T23:20:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b89ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5b40a9eb0 0x7fd5b4157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b89ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5b40a9eb0 0x7fd5b4157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38184/0 (socket says 172.21.15.12:38184) 2021-10-20T23:20:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b89ba700 1 -- 172.21.15.12:0/479059844 learned_addr learned my addr 172.21.15.12:0/479059844 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b3fff700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40af070 0x7fd5b4144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b91bb700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40b36e0 0x7fd5b4142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b89ba700 1 -- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40b36e0 msgr2=0x7fd5b4142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b89ba700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40b36e0 0x7fd5b4142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b89ba700 1 -- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40af070 msgr2=0x7fd5b4144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b89ba700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40af070 0x7fd5b4144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b89ba700 1 -- 172.21.15.12:0/479059844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c00b1e0 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b3fff700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40af070 0x7fd5b4144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.593+0000 7fd5b89ba700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5b40a9eb0 0x7fd5b4157640 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fd5b40b7770 tx=0x7fd5a4007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5b1ffb700 1 -- 172.21.15.12:0/479059844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a400ce30 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5b1ffb700 1 -- 172.21.15.12:0/479059844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4007240 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b4156f00 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5b1ffb700 1 -- 172.21.15.12:0/479059844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a4006510 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b4144a60 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5b1ffb700 1 -- 172.21.15.12:0/479059844 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd5a401b070 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b414ae20 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5b1ffb700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5980536a0 0x7fd598055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:38.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5b1ffb700 1 -- 172.21.15.12:0/479059844 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd5a406b0f0 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5b3fff700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5980536a0 0x7fd598055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:38.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.597+0000 7fd5b3fff700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5980536a0 0x7fd598055b60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fd59c01a000 tx=0x7fd59c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:38.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.605+0000 7fd5b1ffb700 1 -- 172.21.15.12:0/479059844 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5a40420f0 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5b4057350 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5b1ffb700 1 -- 172.21.15.12:0/479059844 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2485 (secure 0 0 0) 0x7fd5a4045710 con 0x7fd5b40a9eb0 2021-10-20T23:20:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:38.772 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:20:34.132895+0000","modified":"2021-10-20T23:20:35.137040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/655661573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":655661573},{"type":"v1","addr":"172.21.15.12:6835","nonce":655661573}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-20T23:20:38.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5980536a0 msgr2=0x7fd598055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5980536a0 0x7fd598055b60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fd59c01a000 tx=0x7fd59c015000).stop 2021-10-20T23:20:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5b40a9eb0 msgr2=0x7fd5b4157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5b40a9eb0 0x7fd5b4157640 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fd5b40b7770 tx=0x7fd5a4007c00).stop 2021-10-20T23:20:38.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 shutdown_connections 2021-10-20T23:20:38.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5980536a0 0x7fd598055b60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5b40b36e0 0x7fd5b4142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5b40af070 0x7fd5b4144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 --2- 172.21.15.12:0/479059844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5b40a9eb0 0x7fd5b4157640 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:38.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 >> 172.21.15.12:0/479059844 conn(0x7fd5b40607c0 msgr2=0x7fd5b4060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:38.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 shutdown_connections 2021-10-20T23:20:38.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:38.769+0000 7fd5bac1e700 1 -- 172.21.15.12:0/479059844 wait complete. 2021-10-20T23:20:38.777 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2021-10-20T23:20:39.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:20:34.132895+0000', 'modified': '2021-10-20T23:20:35.137040+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4890}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4890': {'gid': 4890, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/655661573', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 655661573}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 655661573}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:20:39.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:20:39.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:20:39.206 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":4890,"want_state":"up:active","state":"up:active","rank_uptime":5.0613940079999997,"mdsmap_epoch":13,"osdmap_epoch":36,"osdmap_epoch_barrier":36,"uptime":11.908584939000001} 2021-10-20T23:20:39.206 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 4890, "mdsmap_epoch": 13, "osdmap_epoch": 36, "osdmap_epoch_barrier": 36, "rank_uptime": 5.061394008, "state": "up:active", "uptime": 11.908584939, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:20:39.207 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:20:39.207 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:20:39.208 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:20:39.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:39.209 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:39.222 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:20:39.281 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:20:39.281 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:20:39.295 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:20:39.296 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:20:39.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:39.298 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:20:39.304 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:20:39.304 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:39.308 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:20:39.323 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:20:39.324 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:20:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:20:39.379 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:20:39.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:39.380 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:20:39.381 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:20:39.373+0000 7f5b39878080 -1 init, newargv = 0x5591e188dc40 newargc=9ceph-fuse[13821]: starting ceph client 2021-10-20T23:20:39.381 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr: 2021-10-20T23:20:39.390 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[13821]: starting fuse 2021-10-20T23:20:40.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:20:40.508 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:20:40.509 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:20:40.567 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:20:40.568 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:20:40.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:40.570 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:20:40.575 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:20:40.575 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:20:40.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:40.576 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:20:40.576 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:20:40.577 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:20:40.577 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:20:40.578 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:20:40.578 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:40.579 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:20:40.579 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:20:40.580 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:20:40.580 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:40.581 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:20:40.581 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:20:40.581 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:20:40.582 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:20:40.582 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:40.583 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:20:40.583 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:20:40.584 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:20:40.584 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:20:40.584 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:20:40.585 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:40.585 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:20:40.586 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:20:40.625 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.13821.asok 2021-10-20T23:20:40.630 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13821.asok 2021-10-20T23:20:40.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:40.631 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13821.asok status 2021-10-20T23:20:40.720 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:20:40.721 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:20:40.721 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:20:40.721 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:20:40.722 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:20:40.722 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:20:40.722 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:20:40.722 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "13821", 2021-10-20T23:20:40.723 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:20:40.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:20:40.723 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:20:40.723 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:20:40.724 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5076, 2021-10-20T23:20:40.724 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:20:40.724 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:20:40.724 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:20:40.725 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5076 2021-10-20T23:20:40.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:20:40.725 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:20:40.725 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:20:40.726 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:20:40.726 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 4162896704 2021-10-20T23:20:40.726 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:20:40.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:20:40.727 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:20:40.727 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:20:40.727 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:20:40.727 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 4162896704 2021-10-20T23:20:40.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:20:40.728 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5076 172.21.15.119:0/4162896704", 2021-10-20T23:20:40.728 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/4162896704", 2021-10-20T23:20:40.728 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:20:40.728 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 13, 2021-10-20T23:20:40.729 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 36, 2021-10-20T23:20:40.729 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:20:40.729 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:20:40.729 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:20:40.730 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:20:40.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:40.732 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:40.732 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:40.739 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:20:40.740 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:20:40.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:40.741 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:40.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2021-10-20T23:20:40.868 INFO:teuthology.orchestra.run.smithi012.stdout:{"mds_min_caps_per_client":"100"} 2021-10-20T23:20:40.868 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2021-10-20T23:20:40.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:20:40.869 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:20:40.870 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:20:40.878 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:20:40.879 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:20:40.880 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-20T23:20:40.880 DEBUG:teuthology.orchestra.run.smithi119:> import sys 2021-10-20T23:20:40.880 DEBUG:teuthology.orchestra.run.smithi119:> import time 2021-10-20T23:20:40.881 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:20:40.881 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:40.882 DEBUG:teuthology.orchestra.run.smithi119:> n = 1000 2021-10-20T23:20:40.882 DEBUG:teuthology.orchestra.run.smithi119:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-10-20T23:20:40.883 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:40.883 DEBUG:teuthology.orchestra.run.smithi119:> if not os.path.exists(os.path.dirname(abs_path)): 2021-10-20T23:20:40.883 DEBUG:teuthology.orchestra.run.smithi119:> os.makedirs(os.path.dirname(abs_path)) 2021-10-20T23:20:40.884 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:20:40.884 DEBUG:teuthology.orchestra.run.smithi119:> for i in range(0, n): 2021-10-20T23:20:40.884 DEBUG:teuthology.orchestra.run.smithi119:> fname = "{0}_{1}".format(abs_path, i) 2021-10-20T23:20:40.885 DEBUG:teuthology.orchestra.run.smithi119:> with open(fname, '"'"'w'"'"') as f: 2021-10-20T23:20:40.885 DEBUG:teuthology.orchestra.run.smithi119:> f.write('"'"'content'"'"') 2021-10-20T23:20:40.886 DEBUG:teuthology.orchestra.run.smithi119:> if True: 2021-10-20T23:20:40.886 DEBUG:teuthology.orchestra.run.smithi119:> f.flush() 2021-10-20T23:20:40.887 DEBUG:teuthology.orchestra.run.smithi119:> os.fsync(f.fileno()) 2021-10-20T23:20:40.887 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:20:51.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:52.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 Processor -- start 2021-10-20T23:20:52.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 -- start start 2021-10-20T23:20:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec2c0b3040 0x7fec2c065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec2c0a9c10 0x7fec2c0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c066ea0 con 0x7fec2c143320 2021-10-20T23:20:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c0648e0 con 0x7fec2c0b3040 2021-10-20T23:20:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c061dd0 con 0x7fec2c0a9c10 2021-10-20T23:20:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec31932700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec2c0b3040 0x7fec2c065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec31131700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec2c0a9c10 0x7fec2c0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec31131700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec2c0a9c10 0x7fec2c0607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:53168/0 (socket says 172.21.15.12:53168) 2021-10-20T23:20:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec31131700 1 -- 172.21.15.12:0/2250090313 learned_addr learned my addr 172.21.15.12:0/2250090313 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32133700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fec2c143320 0x7fec2c143770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:43856/0 (socket says 172.21.15.12:43856) 2021-10-20T23:20:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec31131700 1 -- 172.21.15.12:0/2250090313 >> v2:172.21.15.12:3300/0 conn(0x7fec2c0b3040 msgr2=0x7fec2c065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec31131700 1 --2- 172.21.15.12:0/2250090313 >> v2:172.21.15.12:3300/0 conn(0x7fec2c0b3040 0x7fec2c065e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec31131700 1 -- 172.21.15.12:0/2250090313 >> v1:172.21.15.31:6789/0 conn(0x7fec2c143320 legacy=0x7fec2c143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec31131700 1 -- 172.21.15.12:0/2250090313 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0b3420 con 0x7fec2c0a9c10 2021-10-20T23:20:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec30930700 1 -- 172.21.15.12:0/2250090313 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609975829 0 0) 0x7fec2c066ea0 con 0x7fec2c143320 2021-10-20T23:20:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec31131700 1 --2- 172.21.15.12:0/2250090313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0a9c10 0x7fec2c0607c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fec1c002f70 tx=0x7fec1c006eb0).ready entity=mon.1 client_cookie=e70221c0dde7023c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec30930700 1 -- 172.21.15.12:0/2250090313 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c00d5c0 con 0x7fec2c0a9c10 2021-10-20T23:20:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec30930700 1 -- 172.21.15.12:0/2250090313 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c000e90 con 0x7fec2c0a9c10 2021-10-20T23:20:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec30930700 1 -- 172.21.15.12:0/2250090313 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c00d910 con 0x7fec2c0a9c10 2021-10-20T23:20:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 -- 172.21.15.12:0/2250090313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0a9c10 msgr2=0x7fec2c0607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 --2- 172.21.15.12:0/2250090313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0a9c10 0x7fec2c0607c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fec1c002f70 tx=0x7fec1c006eb0).stop 2021-10-20T23:20:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 -- 172.21.15.12:0/2250090313 shutdown_connections 2021-10-20T23:20:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 --2- 172.21.15.12:0/2250090313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0a9c10 0x7fec2c0607c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 --2- 172.21.15.12:0/2250090313 >> v2:172.21.15.12:3300/0 conn(0x7fec2c0b3040 0x7fec2c065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.085+0000 7fec32934700 1 -- 172.21.15.12:0/2250090313 >> 172.21.15.12:0/2250090313 conn(0x7fec2c0636e0 msgr2=0x7fec2c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.089+0000 7fec32934700 1 -- 172.21.15.12:0/2250090313 shutdown_connections 2021-10-20T23:20:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.089+0000 7fec32934700 1 -- 172.21.15.12:0/2250090313 wait complete. 2021-10-20T23:20:52.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.089+0000 7fec32934700 1 Processor -- start 2021-10-20T23:20:52.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.089+0000 7fec32934700 1 -- start start 2021-10-20T23:20:52.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32934700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec2c0a9c10 0x7fec2c05f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32934700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0b3040 0x7fec2c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32934700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec2c143320 0x7fec2c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32934700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c150e70 con 0x7fec2c143320 2021-10-20T23:20:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32934700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c09fae0 con 0x7fec2c0b3040 2021-10-20T23:20:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32934700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0adfb0 con 0x7fec2c0a9c10 2021-10-20T23:20:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32133700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec2c143320 0x7fec2c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31131700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0b3040 0x7fec2c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31131700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0b3040 0x7fec2c14fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:53176/0 (socket says 172.21.15.12:53176) 2021-10-20T23:20:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31131700 1 -- 172.21.15.12:0/786483548 learned_addr learned my addr 172.21.15.12:0/786483548 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32133700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec2c143320 0x7fec2c153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38204/0 (socket says 172.21.15.12:38204) 2021-10-20T23:20:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31932700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec2c0a9c10 0x7fec2c05f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31131700 1 -- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec2c0a9c10 msgr2=0x7fec2c05f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31131700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec2c0a9c10 0x7fec2c05f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31131700 1 -- 172.21.15.12:0/786483548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec2c143320 msgr2=0x7fec2c153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31131700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec2c143320 0x7fec2c153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31131700 1 -- 172.21.15.12:0/786483548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c00b1e0 con 0x7fec2c0b3040 2021-10-20T23:20:52.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec31131700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0b3040 0x7fec2c14fe00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fec1c002f70 tx=0x7fec1c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:52.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec1affd700 1 -- 172.21.15.12:0/786483548 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c011860 con 0x7fec2c0b3040 2021-10-20T23:20:52.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec1affd700 1 -- 172.21.15.12:0/786483548 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c0119c0 con 0x7fec2c0b3040 2021-10-20T23:20:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c0ae250 con 0x7fec2c0b3040 2021-10-20T23:20:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec1affd700 1 -- 172.21.15.12:0/786483548 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c011d20 con 0x7fec2c0b3040 2021-10-20T23:20:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.093+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c1533d0 con 0x7fec2c0b3040 2021-10-20T23:20:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.097+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c153810 con 0x7fec2c0b3040 2021-10-20T23:20:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.097+0000 7fec1affd700 1 -- 172.21.15.12:0/786483548 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec1c025030 con 0x7fec2c0b3040 2021-10-20T23:20:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.097+0000 7fec1affd700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec0c053610 0x7fec0c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.097+0000 7fec1affd700 1 -- 172.21.15.12:0/786483548 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fec1c06cc10 con 0x7fec2c0b3040 2021-10-20T23:20:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.097+0000 7fec31932700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec0c053610 0x7fec0c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.097+0000 7fec31932700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec0c053610 0x7fec0c055ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fec2800b000 tx=0x7fec28006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.105+0000 7fec1affd700 1 -- 172.21.15.12:0/786483548 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec1c043b00 con 0x7fec2c0b3040 2021-10-20T23:20:52.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec2c066960 con 0x7fec2c0b3040 2021-10-20T23:20:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec1affd700 1 -- 172.21.15.12:0/786483548 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2485 (secure 0 0 0) 0x7fec1c023070 con 0x7fec2c0b3040 2021-10-20T23:20:52.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:52.279 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:20:34.132895+0000","modified":"2021-10-20T23:20:35.137040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/655661573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":655661573},{"type":"v1","addr":"172.21.15.12:6835","nonce":655661573}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-20T23:20:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec0c053610 msgr2=0x7fec0c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec0c053610 0x7fec0c055ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fec2800b000 tx=0x7fec28006df0).stop 2021-10-20T23:20:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0b3040 msgr2=0x7fec2c14fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0b3040 0x7fec2c14fe00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fec1c002f70 tx=0x7fec1c015000).stop 2021-10-20T23:20:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 shutdown_connections 2021-10-20T23:20:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec0c053610 0x7fec0c055ad0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec2c143320 0x7fec2c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec2c0b3040 0x7fec2c14fe00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 --2- 172.21.15.12:0/786483548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec2c0a9c10 0x7fec2c05f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 >> 172.21.15.12:0/786483548 conn(0x7fec2c0636e0 msgr2=0x7fec2c142920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 shutdown_connections 2021-10-20T23:20:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.277+0000 7fec32934700 1 -- 172.21.15.12:0/786483548 wait complete. 2021-10-20T23:20:52.284 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2021-10-20T23:20:52.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-10-20T23:20:52.394 INFO:teuthology.orchestra.run.smithi012.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-10-20T23:20:52.394 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-10-20T23:20:52.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.493+0000 7ffa5b59e700 1 Processor -- start 2021-10-20T23:20:52.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.493+0000 7ffa5b59e700 1 -- start start 2021-10-20T23:20:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c0ad5c0 0x7ffa5c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0aecf0 con 0x7ffa5c140440 2021-10-20T23:20:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0b6f20 con 0x7ffa5c061320 2021-10-20T23:20:52.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0aef20 con 0x7ffa5c0ad5c0 2021-10-20T23:20:52.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5ad9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffa5c140440 0x7ffa5c146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36806/0 (socket says 172.21.15.12:36806) 2021-10-20T23:20:52.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5ad9d700 1 -- 172.21.15.12:0/3736837658 learned_addr learned my addr 172.21.15.12:0/3736837658 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:20:52.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa59d9b700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c0ad5c0 0x7ffa5c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570748768 0 0) 0x7ffa5c0aecf0 con 0x7ffa5c140440 2021-10-20T23:20:52.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa3c003260 con 0x7ffa5c140440 2021-10-20T23:20:52.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226806281 0 0) 0x7ffa5c0b6f20 con 0x7ffa5c061320 2021-10-20T23:20:52.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa5c0aecf0 con 0x7ffa5c061320 2021-10-20T23:20:52.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729067006 0 0) 0x7ffa3c003260 con 0x7ffa5c140440 2021-10-20T23:20:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c0ad5c0 msgr2=0x7ffa5c061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c0ad5c0 0x7ffa5c061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 >> v1:172.21.15.31:6789/0 conn(0x7ffa5c061320 legacy=0x7ffa5c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0af1c0 con 0x7ffa5c140440 2021-10-20T23:20:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7ffa540019e0 con 0x7ffa5c140440 2021-10-20T23:20:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 >> v1:172.21.15.12:6789/0 conn(0x7ffa5c140440 legacy=0x7ffa5c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c0ad5c0 0x7ffa3c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa3c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa3c0049f0 0x7ffa3c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0aef20 con 0x7ffa3c003e70 2021-10-20T23:20:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c00b830 con 0x7ffa3c0049f0 2021-10-20T23:20:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c00b9f0 con 0x7ffa5c0ad5c0 2021-10-20T23:20:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa59d9b700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa3c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5a59c700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c0ad5c0 0x7ffa3c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5ad9d700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa3c0049f0 0x7ffa3c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa59d9b700 1 -- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c0ad5c0 msgr2=0x7ffa3c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa59d9b700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c0ad5c0 0x7ffa3c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa59d9b700 1 -- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa3c0049f0 msgr2=0x7ffa3c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa59d9b700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa3c0049f0 0x7ffa3c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa59d9b700 1 -- 172.21.15.12:0/3736837658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c003260 con 0x7ffa3c003e70 2021-10-20T23:20:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5ad9d700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa3c0049f0 0x7ffa3c004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:52.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa59d9b700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa3c004500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7ffa4400c000 tx=0x7ffa44006df0).ready entity=mon.0 client_cookie=27f3f267e18ff658 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:52.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa4400e800 con 0x7ffa3c003e70 2021-10-20T23:20:52.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4400e960 con 0x7ffa3c003e70 2021-10-20T23:20:52.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5959a700 1 -- 172.21.15.12:0/3736837658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa4400ecc0 con 0x7ffa3c003e70 2021-10-20T23:20:52.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 -- 172.21.15.12:0/3736837658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 msgr2=0x7ffa3c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 --2- 172.21.15.12:0/3736837658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa3c004500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7ffa4400c000 tx=0x7ffa44006df0).stop 2021-10-20T23:20:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5ad9d700 1 -- 172.21.15.12:0/3736837658 reap_dead start 2021-10-20T23:20:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 -- 172.21.15.12:0/3736837658 shutdown_connections 2021-10-20T23:20:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 -- 172.21.15.12:0/3736837658 >> 172.21.15.12:0/3736837658 conn(0x7ffa5c066de0 msgr2=0x7ffa5c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 -- 172.21.15.12:0/3736837658 shutdown_connections 2021-10-20T23:20:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.497+0000 7ffa5b59e700 1 -- 172.21.15.12:0/3736837658 wait complete. 2021-10-20T23:20:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 Processor -- start 2021-10-20T23:20:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 -- start start 2021-10-20T23:20:52.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa5c0aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa5c14a6b0 0x7ffa5c155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c156290 0x7ffa5c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c155970 con 0x7ffa3c003e70 2021-10-20T23:20:52.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0aadc0 con 0x7ffa5c14a6b0 2021-10-20T23:20:52.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0ab020 con 0x7ffa5c156290 2021-10-20T23:20:52.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa5c0aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa5c0aa6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38220/0 (socket says 172.21.15.12:38220) 2021-10-20T23:20:52.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5a59c700 1 -- 172.21.15.12:0/4206831098 learned_addr learned my addr 172.21.15.12:0/4206831098 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:52.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa59d9b700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa5c14a6b0 0x7ffa5c155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5ad9d700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c156290 0x7ffa5c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5a59c700 1 -- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c156290 msgr2=0x7ffa5c152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5a59c700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c156290 0x7ffa5c152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5a59c700 1 -- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa5c14a6b0 msgr2=0x7ffa5c155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5a59c700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa5c14a6b0 0x7ffa5c155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5a59c700 1 -- 172.21.15.12:0/4206831098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0ab2c0 con 0x7ffa3c003e70 2021-10-20T23:20:52.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5a59c700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa5c0aa6d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ffa4c00d000 tx=0x7ffa4c007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:52.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa537fe700 1 -- 172.21.15.12:0/4206831098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa4c011590 con 0x7ffa3c003e70 2021-10-20T23:20:52.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa537fe700 1 -- 172.21.15.12:0/4206831098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c0116f0 con 0x7ffa3c003e70 2021-10-20T23:20:52.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c1523a0 con 0x7ffa3c003e70 2021-10-20T23:20:52.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa537fe700 1 -- 172.21.15.12:0/4206831098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa4c011a50 con 0x7ffa3c003e70 2021-10-20T23:20:52.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c156710 con 0x7ffa3c003e70 2021-10-20T23:20:52.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.501+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c14aa90 con 0x7ffa3c003e70 2021-10-20T23:20:52.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.505+0000 7ffa537fe700 1 -- 172.21.15.12:0/4206831098 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffa4c01a030 con 0x7ffa3c003e70 2021-10-20T23:20:52.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.505+0000 7ffa537fe700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa40053520 0x7ffa400559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.505+0000 7ffa537fe700 1 -- 172.21.15.12:0/4206831098 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ffa4c06b6a0 con 0x7ffa3c003e70 2021-10-20T23:20:52.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.505+0000 7ffa59d9b700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa40053520 0x7ffa400559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.505+0000 7ffa59d9b700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa40053520 0x7ffa400559e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7ffa4401e000 tx=0x7ffa44019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:52.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.509+0000 7ffa537fe700 1 -- 172.21.15.12:0/4206831098 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa4c0426a0 con 0x7ffa3c003e70 2021-10-20T23:20:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.673+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa5c0af460 con 0x7ffa3c003e70 2021-10-20T23:20:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.673+0000 7ffa537fe700 1 -- 172.21.15.12:0/4206831098 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2485 (secure 0 0 0) 0x7ffa4c018020 con 0x7ffa3c003e70 2021-10-20T23:20:52.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:52.676 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:20:34.132895+0000","modified":"2021-10-20T23:20:35.137040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/655661573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":655661573},{"type":"v1","addr":"172.21.15.12:6835","nonce":655661573}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-20T23:20:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.673+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa40053520 msgr2=0x7ffa400559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.673+0000 7ffa5b59e700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa40053520 0x7ffa400559e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7ffa4401e000 tx=0x7ffa44019000).stop 2021-10-20T23:20:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.673+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 msgr2=0x7ffa5c0aa6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.673+0000 7ffa5b59e700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa5c0aa6d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ffa4c00d000 tx=0x7ffa4c007a00).stop 2021-10-20T23:20:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.677+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 shutdown_connections 2021-10-20T23:20:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.677+0000 7ffa5b59e700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa40053520 0x7ffa400559e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.677+0000 7ffa5b59e700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa5c156290 0x7ffa5c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.677+0000 7ffa5b59e700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa5c14a6b0 0x7ffa5c155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.677+0000 7ffa5b59e700 1 --2- 172.21.15.12:0/4206831098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa3c003e70 0x7ffa5c0aa6d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.677+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 >> 172.21.15.12:0/4206831098 conn(0x7ffa5c066de0 msgr2=0x7ffa5c143770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.677+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 shutdown_connections 2021-10-20T23:20:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.677+0000 7ffa5b59e700 1 -- 172.21.15.12:0/4206831098 wait complete. 2021-10-20T23:20:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2021-10-20T23:20:52.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-10-20T23:20:52.793 INFO:teuthology.orchestra.run.smithi012.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-10-20T23:20:52.793 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-10-20T23:20:52.794 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:20:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 Processor -- start 2021-10-20T23:20:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 -- start start 2021-10-20T23:20:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36180b6900 0x7f36180acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3618060910 0x7f36180a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36180aa3b0 0x7f36180aa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36180b6ce0 con 0x7f36180b6900 2021-10-20T23:20:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36180611e0 con 0x7f3618060910 2021-10-20T23:20:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3618061480 con 0x7f36180aa3b0 2021-10-20T23:20:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361cfe9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36180b6900 0x7f36180acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361cfe9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36180b6900 0x7f36180acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38228/0 (socket says 172.21.15.12:38228) 2021-10-20T23:20:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361cfe9700 1 -- 172.21.15.12:0/1337129530 learned_addr learned my addr 172.21.15.12:0/1337129530 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f3617fff700 1 --2- 172.21.15.12:0/1337129530 >> v2:172.21.15.31:3300/0 conn(0x7f3618060910 0x7f36180a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361d7ea700 1 --2- 172.21.15.12:0/1337129530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36180aa3b0 0x7f36180aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361cfe9700 1 -- 172.21.15.12:0/1337129530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36180aa3b0 msgr2=0x7f36180aa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361cfe9700 1 --2- 172.21.15.12:0/1337129530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36180aa3b0 0x7f36180aa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361cfe9700 1 -- 172.21.15.12:0/1337129530 >> v2:172.21.15.31:3300/0 conn(0x7f3618060910 msgr2=0x7f36180a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361cfe9700 1 --2- 172.21.15.12:0/1337129530 >> v2:172.21.15.31:3300/0 conn(0x7f3618060910 0x7f36180a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361cfe9700 1 -- 172.21.15.12:0/1337129530 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618061720 con 0x7f36180b6900 2021-10-20T23:20:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361cfe9700 1 --2- 172.21.15.12:0/1337129530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180b6900 0x7f36180acd50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f360c002f70 tx=0x7f360c006eb0).ready entity=mon.0 client_cookie=30bd05f850b298a0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f36177fe700 1 -- 172.21.15.12:0/1337129530 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f360c00d570 con 0x7f36180b6900 2021-10-20T23:20:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f36177fe700 1 -- 172.21.15.12:0/1337129530 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c000e90 con 0x7f36180b6900 2021-10-20T23:20:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f36177fe700 1 -- 172.21.15.12:0/1337129530 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f360c00d900 con 0x7f36180b6900 2021-10-20T23:20:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 -- 172.21.15.12:0/1337129530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180b6900 msgr2=0x7f36180acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 --2- 172.21.15.12:0/1337129530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180b6900 0x7f36180acd50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f360c002f70 tx=0x7f360c006eb0).stop 2021-10-20T23:20:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 -- 172.21.15.12:0/1337129530 shutdown_connections 2021-10-20T23:20:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 --2- 172.21.15.12:0/1337129530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36180aa3b0 0x7f36180aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 --2- 172.21.15.12:0/1337129530 >> v2:172.21.15.31:3300/0 conn(0x7f3618060910 0x7f36180a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 --2- 172.21.15.12:0/1337129530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180b6900 0x7f36180acd50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 -- 172.21.15.12:0/1337129530 >> 172.21.15.12:0/1337129530 conn(0x7f36180b3480 msgr2=0x7f36180b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 -- 172.21.15.12:0/1337129530 shutdown_connections 2021-10-20T23:20:52.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.897+0000 7f361f24d700 1 -- 172.21.15.12:0/1337129530 wait complete. 2021-10-20T23:20:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 Processor -- start 2021-10-20T23:20:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 -- start start 2021-10-20T23:20:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3618060910 0x7f36181436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180aa3b0 0x7f361813fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36180b6900 0x7f3618155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618155a80 con 0x7f36180aa3b0 2021-10-20T23:20:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361813e5a0 con 0x7f36180b6900 2021-10-20T23:20:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3618140c20 con 0x7f3618060910 2021-10-20T23:20:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3617fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180aa3b0 0x7f361813fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3617fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180aa3b0 0x7f361813fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38236/0 (socket says 172.21.15.12:38236) 2021-10-20T23:20:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3617fff700 1 -- 172.21.15.12:0/1141807284 learned_addr learned my addr 172.21.15.12:0/1141807284 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361cfe9700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3618060910 0x7f36181436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361d7ea700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36180b6900 0x7f3618155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3617fff700 1 -- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3618060910 msgr2=0x7f36181436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3617fff700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3618060910 0x7f36181436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3617fff700 1 -- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36180b6900 msgr2=0x7f3618155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3617fff700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36180b6900 0x7f3618155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3617fff700 1 -- 172.21.15.12:0/1141807284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c00b1e0 con 0x7f36180aa3b0 2021-10-20T23:20:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3617fff700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180aa3b0 0x7f361813fde0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f360400c000 tx=0x7f3604006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3615ffb700 1 -- 172.21.15.12:0/1141807284 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3604011750 con 0x7f36180aa3b0 2021-10-20T23:20:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3615ffb700 1 -- 172.21.15.12:0/1141807284 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36040118b0 con 0x7f36180aa3b0 2021-10-20T23:20:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f3615ffb700 1 -- 172.21.15.12:0/1141807284 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3604011c10 con 0x7f36180aa3b0 2021-10-20T23:20:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3618140ec0 con 0x7f36180aa3b0 2021-10-20T23:20:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.901+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36181430f0 con 0x7f36180aa3b0 2021-10-20T23:20:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.905+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36180619c0 con 0x7f36180aa3b0 2021-10-20T23:20:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.905+0000 7f3615ffb700 1 -- 172.21.15.12:0/1141807284 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3604011d70 con 0x7f36180aa3b0 2021-10-20T23:20:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.905+0000 7f3615ffb700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35f8053580 0x7f35f8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.905+0000 7f3615ffb700 1 -- 172.21.15.12:0/1141807284 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f360406be80 con 0x7f36180aa3b0 2021-10-20T23:20:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.905+0000 7f361cfe9700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35f8053580 0x7f35f8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.905+0000 7f361cfe9700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35f8053580 0x7f35f8055a40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f360c01c000 tx=0x7f360c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:52.913+0000 7f3615ffb700 1 -- 172.21.15.12:0/1141807284 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3604042e20 con 0x7f36180aa3b0 2021-10-20T23:20:53.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.077+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3618057350 con 0x7f36180aa3b0 2021-10-20T23:20:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f3615ffb700 1 -- 172.21.15.12:0/1141807284 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f3604046440 con 0x7f36180aa3b0 2021-10-20T23:20:53.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:20:53.082 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:20:34.132895+0000","modified":"2021-10-20T23:20:35.137040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/655661573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":655661573},{"type":"v1","addr":"172.21.15.12:6835","nonce":655661573}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-20T23:20:53.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35f8053580 msgr2=0x7f35f8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:53.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35f8053580 0x7f35f8055a40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f360c01c000 tx=0x7f360c015000).stop 2021-10-20T23:20:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180aa3b0 msgr2=0x7f361813fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180aa3b0 0x7f361813fde0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f360400c000 tx=0x7f3604006df0).stop 2021-10-20T23:20:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 shutdown_connections 2021-10-20T23:20:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35f8053580 0x7f35f8055a40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36180b6900 0x7f3618155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36180aa3b0 0x7f361813fde0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 --2- 172.21.15.12:0/1141807284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3618060910 0x7f36181436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 >> 172.21.15.12:0/1141807284 conn(0x7f36180b3480 msgr2=0x7f361813b290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 shutdown_connections 2021-10-20T23:20:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.081+0000 7f361f24d700 1 -- 172.21.15.12:0/1141807284 wait complete. 2021-10-20T23:20:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2021-10-20T23:20:53.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-10-20T23:20:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 Processor -- start 2021-10-20T23:20:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 -- start start 2021-10-20T23:20:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 0x7f8fcc0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fcc0b4aa0 0x7f8fcc064a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc0b8090 con 0x7f8fcc143870 2021-10-20T23:20:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc067510 con 0x7f8fcc0b4aa0 2021-10-20T23:20:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc142f40 con 0x7f8fcc064640 2021-10-20T23:20:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcb7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fcc0b4aa0 0x7f8fcc064a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcb7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fcc0b4aa0 0x7f8fcc064a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38242/0 (socket says 172.21.15.12:38242) 2021-10-20T23:20:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcb7fe700 1 -- 172.21.15.12:0/1575219097 learned_addr learned my addr 172.21.15.12:0/1575219097 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd0937700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8fcc143870 0x7f8fcc146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36840/0 (socket says 172.21.15.12:36840) 2021-10-20T23:20:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/1575219097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 0x7f8fcc0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcb7fe700 1 -- 172.21.15.12:0/1575219097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 msgr2=0x7f8fcc0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/1575219097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 0x7f8fcc0b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcaffd700 1 -- 172.21.15.12:0/1575219097 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272773286 0 0) 0x7f8fcc0b8090 con 0x7f8fcc143870 2021-10-20T23:20:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcb7fe700 1 -- 172.21.15.12:0/1575219097 >> v1:172.21.15.12:6789/0 conn(0x7f8fcc143870 legacy=0x7f8fcc146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcb7fe700 1 -- 172.21.15.12:0/1575219097 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc143130 con 0x7f8fcc0b4aa0 2021-10-20T23:20:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/1575219097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc0b4aa0 0x7f8fcc064a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f8fb4002f70 tx=0x7f8fb4006eb0).ready entity=mon.0 client_cookie=3c5d4ec8b24a6252 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcaffd700 1 -- 172.21.15.12:0/1575219097 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fb400d5c0 con 0x7f8fcc0b4aa0 2021-10-20T23:20:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcaffd700 1 -- 172.21.15.12:0/1575219097 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4000e90 con 0x7f8fcc0b4aa0 2021-10-20T23:20:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fcaffd700 1 -- 172.21.15.12:0/1575219097 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fb400d910 con 0x7f8fcc0b4aa0 2021-10-20T23:20:53.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 -- 172.21.15.12:0/1575219097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc0b4aa0 msgr2=0x7f8fcc064a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:53.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 --2- 172.21.15.12:0/1575219097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc0b4aa0 0x7f8fcc064a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f8fb4002f70 tx=0x7f8fb4006eb0).stop 2021-10-20T23:20:53.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 -- 172.21.15.12:0/1575219097 shutdown_connections 2021-10-20T23:20:53.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 --2- 172.21.15.12:0/1575219097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc0b4aa0 0x7f8fcc064a20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 --2- 172.21.15.12:0/1575219097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 0x7f8fcc0b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 -- 172.21.15.12:0/1575219097 >> 172.21.15.12:0/1575219097 conn(0x7f8fcc05f6b0 msgr2=0x7f8fcc05fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:53.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 -- 172.21.15.12:0/1575219097 shutdown_connections 2021-10-20T23:20:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.201+0000 7f8fd1138700 1 -- 172.21.15.12:0/1575219097 wait complete. 2021-10-20T23:20:53.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 Processor -- start 2021-10-20T23:20:53.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 -- start start 2021-10-20T23:20:53.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 0x7f8fcc0aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc0b4aa0 0x7f8fcc0b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc143870 0x7f8fcc0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0b11e0 con 0x7f8fcc143870 2021-10-20T23:20:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc13f750 con 0x7f8fcc0b4aa0 2021-10-20T23:20:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc061ac0 con 0x7f8fcc064640 2021-10-20T23:20:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd0937700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc143870 0x7f8fcc0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd0937700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc143870 0x7f8fcc0b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38250/0 (socket says 172.21.15.12:38250) 2021-10-20T23:20:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd0937700 1 -- 172.21.15.12:0/106597519 learned_addr learned my addr 172.21.15.12:0/106597519 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 0x7f8fcc0aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc0b4aa0 0x7f8fcc0b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd0937700 1 -- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 msgr2=0x7f8fcc0aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd0937700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 0x7f8fcc0aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd0937700 1 -- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc0b4aa0 msgr2=0x7f8fcc0b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd0937700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc0b4aa0 0x7f8fcc0b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd0937700 1 -- 172.21.15.12:0/106597519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb400b1e0 con 0x7f8fcc143870 2021-10-20T23:20:53.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc0b4aa0 0x7f8fcc0b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:53.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd0937700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc143870 0x7f8fcc0b0cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f8fbc001250 tx=0x7f8fbc001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:53.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fc97fa700 1 -- 172.21.15.12:0/106597519 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fbc005ae0 con 0x7f8fcc143870 2021-10-20T23:20:53.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fc97fa700 1 -- 172.21.15.12:0/106597519 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc005c40 con 0x7f8fcc143870 2021-10-20T23:20:53.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fc97fa700 1 -- 172.21.15.12:0/106597519 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fbc0070d0 con 0x7f8fcc143870 2021-10-20T23:20:53.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 -- 172.21.15.12:0/106597519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc061d60 con 0x7f8fcc143870 2021-10-20T23:20:53.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.205+0000 7f8fd1138700 1 -- 172.21.15.12:0/106597519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc0af270 con 0x7f8fcc143870 2021-10-20T23:20:53.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fc97fa700 1 -- 172.21.15.12:0/106597519 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8fbc010070 con 0x7f8fcc143870 2021-10-20T23:20:53.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fc97fa700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8fb00534f0 0x7f8fb00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fdc5de740 1 Processor -- start 2021-10-20T23:20:53.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fdc5de740 1 -- start start 2021-10-20T23:20:53.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fc97fa700 1 -- 172.21.15.12:0/106597519 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8fbc06b520 con 0x7f8fcc143870 2021-10-20T23:20:53.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8fb00534f0 0x7f8fb00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 0x1afc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8fb00534f0 0x7f8fb00559b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f8fc400c000 tx=0x7f8fc4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 0x1afd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6b190 con 0x1afa4c0 2021-10-20T23:20:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a4b820 con 0x1afd340 2021-10-20T23:20:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x1af96f0 con 0x1afb000 2021-10-20T23:20:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38258/0 (socket says 172.21.15.12:38258) 2021-10-20T23:20:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcb7fe700 1 -- 172.21.15.12:0/1180097898 learned_addr learned my addr 172.21.15.12:0/1180097898 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 0x1afc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fd0937700 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 0x1afd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcb7fe700 1 -- 172.21.15.12:0/1180097898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 msgr2=0x1afd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 0x1afd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcb7fe700 1 -- 172.21.15.12:0/1180097898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 msgr2=0x1afc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 0x1afc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcb7fe700 1 -- 172.21.15.12:0/1180097898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1aa36e0 con 0x1afa4c0 2021-10-20T23:20:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.209+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 0x1afc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af9c00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f8fb401a000 tx=0x7f8fb4015000).ready entity=mon.0 client_cookie=6a53489f5a4165c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:53.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fd1138700 1 -- 172.21.15.12:0/1180097898 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fb400dc50 con 0x1afa4c0 2021-10-20T23:20:53.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fd1138700 1 -- 172.21.15.12:0/1180097898 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb400ddb0 con 0x1afa4c0 2021-10-20T23:20:53.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fd1138700 1 -- 172.21.15.12:0/1180097898 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fb400d5c0 con 0x1afa4c0 2021-10-20T23:20:53.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1180097898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 msgr2=0x1af9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:53.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af9c00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f8fb401a000 tx=0x7f8fb4015000).stop 2021-10-20T23:20:53.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1180097898 shutdown_connections 2021-10-20T23:20:53.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 0x1afd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af9c00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1180097898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 0x1afc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1180097898 >> 172.21.15.12:0/1180097898 conn(0x1a83870 msgr2=0x1afb960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:53.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1180097898 shutdown_connections 2021-10-20T23:20:53.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1180097898 wait complete. 2021-10-20T23:20:53.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 -- start start 2021-10-20T23:20:53.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 Processor -- start 2021-10-20T23:20:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 0x1b2f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 0x1b27bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b2d460 con 0x1afa4c0 2021-10-20T23:20:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b2b120 con 0x1afd340 2021-10-20T23:20:53.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b2b350 con 0x1afb000 2021-10-20T23:20:53.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fcbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fdc5de740 10 client.0 ll_register_callbacks cb 0x1a39410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-20T23:20:53.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fcbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38262/0 (socket says 172.21.15.12:38262) 2021-10-20T23:20:53.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fcbfff700 1 -- 172.21.15.12:0/3577053825 learned_addr learned my addr 172.21.15.12:0/3577053825 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:53.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fd0937700 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 0x1b27bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.213+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 0x1b2f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fcbfff700 1 -- 172.21.15.12:0/3577053825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 msgr2=0x1b2f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:53.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 0x1b2f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fcbfff700 1 -- 172.21.15.12:0/3577053825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 msgr2=0x1b27bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 0x1b27bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fcbfff700 1 -- 172.21.15.12:0/3577053825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc143130 con 0x1afa4c0 2021-10-20T23:20:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af6b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f8fc4018000 tx=0x7f8fc4017040).ready entity=mon.0 client_cookie=85ada38efee5c900 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2021-10-20T23:20:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 1 -- 172.21.15.12:0/3577053825 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fc4014e40 con 0x1afa4c0 2021-10-20T23:20:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 1 -- 172.21.15.12:0/3577053825 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8fc401f410 con 0x1afa4c0 2021-10-20T23:20:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3577053825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a61170 con 0x1afa4c0 2021-10-20T23:20:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 1 -- 172.21.15.12:0/3577053825 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fc401f5d0 con 0x1afa4c0 2021-10-20T23:20:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 10 client.5109 fetch_fsmap learned FSMap version 13 2021-10-20T23:20:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3577053825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x1a5aa50 con 0x1afa4c0 2021-10-20T23:20:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 1 -- 172.21.15.12:0/3577053825 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a61170 con 0x1afa4c0 2021-10-20T23:20:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 1 -- 172.21.15.12:0/3577053825 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 13) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f8fc401e070 con 0x1afa4c0 2021-10-20T23:20:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 10 client.5109 fetch_fsmap finished waiting for FSMap version 13 2021-10-20T23:20:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 10 client.5109 resolve_mds: resolved ID 'a' to GID 4890 2021-10-20T23:20:53.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 20 client.5109 populate_metadata read hostname 'smithi012' 2021-10-20T23:20:53.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] conn(0x1b280c0 0x1b284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 4 client.5109 mds_command: new command op to 4890 tid=0[{"prefix": "get_command_descriptions"}] 2021-10-20T23:20:53.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3577053825 --> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a594e0 con 0x1b280c0 2021-10-20T23:20:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] conn(0x1b280c0 0x1b284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 10 client.5109 ms_handle_connect on v2:172.21.15.12:6834/655661573 2021-10-20T23:20:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] conn(0x1b280c0 0x1b284a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=42827bc9ff117136 server_cookie=a3a8ad5a9f7a20b9 in_seq=0 out_seq=0 2021-10-20T23:20:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 1 -- 172.21.15.12:0/3577053825 <== mds.0 v2:172.21.15.12:6834/655661573 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1a594e0 con 0x1b280c0 2021-10-20T23:20:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 10 client.5109 handle_command_reply: tid=0 2021-10-20T23:20:53.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 client.5109 shutdown 2021-10-20T23:20:53.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3577053825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 msgr2=0x1af6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:53.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af6b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f8fc4018000 tx=0x7f8fc4017040).stop 2021-10-20T23:20:53.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3577053825 shutdown_connections 2021-10-20T23:20:53.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] conn(0x1b280c0 0x1b284a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afd340 0x1b27bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8faaffd700 0 client.5109 ms_handle_reset on v2:172.21.15.12:6834/655661573 2021-10-20T23:20:53.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afb000 0x1b2f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3577053825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1af6b20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.217+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3577053825 >> 172.21.15.12:0/3577053825 conn(0x1a83870 msgr2=0x1af9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:53.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.221+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3577053825 shutdown_connections 2021-10-20T23:20:53.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.221+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3577053825 wait complete. 2021-10-20T23:20:53.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.221+0000 7f8fdc5de740 20 client.5109 trim_cache size 0 max 16384 2021-10-20T23:20:53.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fdc5de740 1 Processor -- start 2021-10-20T23:20:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fdc5de740 1 -- start start 2021-10-20T23:20:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afa4c0 0x1afc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 0x1b24d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afd340 0x1b251f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a987b0 con 0x1afd340 2021-10-20T23:20:53.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b2ac60 con 0x1afb000 2021-10-20T23:20:53.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b31fa0 con 0x1afa4c0 2021-10-20T23:20:53.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fd0937700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afd340 0x1b251f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fd0937700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afd340 0x1b251f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38274/0 (socket says 172.21.15.12:38274) 2021-10-20T23:20:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fd0937700 1 -- 172.21.15.12:0/3466084076 learned_addr learned my addr 172.21.15.12:0/3466084076 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/3466084076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 0x1b24d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.233+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/3466084076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afa4c0 0x1afc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fd0937700 1 -- 172.21.15.12:0/3466084076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afa4c0 msgr2=0x1afc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fd0937700 1 --2- 172.21.15.12:0/3466084076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afa4c0 0x1afc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fd0937700 1 -- 172.21.15.12:0/3466084076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 msgr2=0x1b24d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:53.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fd0937700 1 --2- 172.21.15.12:0/3466084076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 0x1b24d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fd0937700 1 -- 172.21.15.12:0/3466084076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a5fd40 con 0x1afd340 2021-10-20T23:20:53.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fd0937700 1 --2- 172.21.15.12:0/3466084076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afd340 0x1b251f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8fbc037000 tx=0x7f8fbc0012f0).ready entity=mon.0 client_cookie=539a0729fc31ec7e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:53.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fc17fa700 1 -- 172.21.15.12:0/3466084076 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fbc0443a0 con 0x1afd340 2021-10-20T23:20:53.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fc17fa700 1 -- 172.21.15.12:0/3466084076 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc0456d0 con 0x1afd340 2021-10-20T23:20:53.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fc17fa700 1 -- 172.21.15.12:0/3466084076 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fbc01bb80 con 0x1afd340 2021-10-20T23:20:53.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3466084076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afd340 msgr2=0x1b251f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:20:53.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3466084076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afd340 0x1b251f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8fbc037000 tx=0x7f8fbc0012f0).stop 2021-10-20T23:20:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3466084076 shutdown_connections 2021-10-20T23:20:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3466084076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afd340 0x1b251f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3466084076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 0x1b24d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/3466084076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afa4c0 0x1afc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3466084076 >> 172.21.15.12:0/3466084076 conn(0x1a83870 msgr2=0x1afd720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:20:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3466084076 shutdown_connections 2021-10-20T23:20:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 -- 172.21.15.12:0/3466084076 wait complete. 2021-10-20T23:20:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 -- start start 2021-10-20T23:20:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 Processor -- start 2021-10-20T23:20:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1b8fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 0x1b90390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afd340 0x1b92c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b90880 con 0x1afa4c0 2021-10-20T23:20:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b29d40 con 0x1afb000 2021-10-20T23:20:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b29f70 con 0x1afd340 2021-10-20T23:20:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1b8fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1b8fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38276/0 (socket says 172.21.15.12:38276) 2021-10-20T23:20:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcbfff700 1 -- 172.21.15.12:0/1480465548 learned_addr learned my addr 172.21.15.12:0/1480465548 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:20:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fdc5de740 10 client.0 ll_register_callbacks cb 0x1af6340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-20T23:20:53.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 0x1b90390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fd0937700 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afd340 0x1b92c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcbfff700 1 -- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afd340 msgr2=0x1b92c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:53.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afd340 0x1b92c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcbfff700 1 -- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 msgr2=0x1b90390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:20:53.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 0x1b90390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:20:53.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcbfff700 1 -- 172.21.15.12:0/1480465548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc0af270 con 0x1afa4c0 2021-10-20T23:20:53.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 0x1b90390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:53.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fd0937700 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afd340 0x1b92c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:20:53.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fabfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2021-10-20T23:20:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.237+0000 7f8fcbfff700 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1b8fea0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x1b92b70 tx=0x7f8fc4021000).ready entity=mon.0 client_cookie=5a6afdbee2cb10b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:20:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fabfff700 1 -- 172.21.15.12:0/1480465548 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fc4036070 con 0x1afa4c0 2021-10-20T23:20:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fabfff700 1 -- 172.21.15.12:0/1480465548 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8fc4014aa0 con 0x1afa4c0 2021-10-20T23:20:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1480465548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fb400ddb0 con 0x1afa4c0 2021-10-20T23:20:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fabfff700 1 -- 172.21.15.12:0/1480465548 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fc4014c60 con 0x1afa4c0 2021-10-20T23:20:53.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fdc5de740 10 client.5115 fetch_fsmap learned FSMap version 13 2021-10-20T23:20:53.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1480465548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x1a353f0 con 0x1afa4c0 2021-10-20T23:20:53.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fabfff700 1 -- 172.21.15.12:0/1480465548 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb400ddb0 con 0x1afa4c0 2021-10-20T23:20:53.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fabfff700 1 -- 172.21.15.12:0/1480465548 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 13) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f8fc4039070 con 0x1afa4c0 2021-10-20T23:20:53.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fdc5de740 10 client.5115 fetch_fsmap finished waiting for FSMap version 13 2021-10-20T23:20:53.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fdc5de740 10 client.5115 resolve_mds: resolved ID 'a' to GID 4890 2021-10-20T23:20:53.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fdc5de740 20 client.5115 populate_metadata read hostname 'smithi012' 2021-10-20T23:20:53.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] conn(0x1b93110 0x1b934f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:20:53.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fdc5de740 4 client.5115 mds_command: new command op to 4890 tid=0[{"prefix": "cache drop"}] 2021-10-20T23:20:53.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1480465548 --> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x194f590 con 0x1b93110 2021-10-20T23:20:53.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] conn(0x1b93110 0x1b934f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:20:53.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fabfff700 10 client.5115 ms_handle_connect on v2:172.21.15.12:6834/655661573 2021-10-20T23:20:53.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:20:53.241+0000 7f8fcb7fe700 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] conn(0x1b93110 0x1b934f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=58b48a3e06ef1182 server_cookie=fde44cad374159c in_seq=0 out_seq=0 2021-10-20T23:21:06.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:21:06.140 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:21:06.143 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:21:06.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:21:36.206 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:21:36.209 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:21:36.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:21:36.214 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:21:37.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fabfff700 1 -- 172.21.15.12:0/1480465548 <== mds.0 v2:172.21.15.12:6834/655661573 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x194f590 con 0x1b93110 2021-10-20T23:21:37.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fabfff700 10 client.5115 handle_command_reply: tid=0 2021-10-20T23:21:37.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 client.5115 shutdown 2021-10-20T23:21:37.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1480465548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 msgr2=0x1b8fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:37.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1b8fea0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x1b92b70 tx=0x7f8fc4021000).stop 2021-10-20T23:21:37.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1480465548 shutdown_connections 2021-10-20T23:21:37.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.12:6834/655661573,v1:172.21.15.12:6835/655661573] conn(0x1b93110 0x1b934f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:37.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x1afd340 0x1b92c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:37.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x1afb000 0x1b90390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:37.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 --2- 172.21.15.12:0/1480465548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x1afa4c0 0x1b8fea0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1480465548 >> 172.21.15.12:0/1480465548 conn(0x1a83870 msgr2=0x1af6840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fabfff700 0 client.5115 ms_handle_reset on v2:172.21.15.12:6834/655661573 2021-10-20T23:21:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1480465548 shutdown_connections 2021-10-20T23:21:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 1 -- 172.21.15.12:0/1480465548 wait complete. 2021-10-20T23:21:37.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fdc5de740 20 client.5115 trim_cache size 0 max 16384 2021-10-20T23:21:37.591 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:21:37.591 INFO:teuthology.orchestra.run.smithi012.stdout: "client_recall": { 2021-10-20T23:21:37.592 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2021-10-20T23:21:37.592 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "(0) Success", 2021-10-20T23:21:37.592 INFO:teuthology.orchestra.run.smithi012.stdout: "recalled": 920 2021-10-20T23:21:37.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:37.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flush_journal": { 2021-10-20T23:21:37.593 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2021-10-20T23:21:37.593 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "" 2021-10-20T23:21:37.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:37.594 INFO:teuthology.orchestra.run.smithi012.stdout: "trim_cache": { 2021-10-20T23:21:37.594 INFO:teuthology.orchestra.run.smithi012.stdout: "trimmed": 900 2021-10-20T23:21:37.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:37.594 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2021-10-20T23:21:37.595 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": { 2021-10-20T23:21:37.595 INFO:teuthology.orchestra.run.smithi012.stdout: "items": 2529, 2021-10-20T23:21:37.595 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes": 431952 2021-10-20T23:21:37.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:37.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:37.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 44.342482893000003 2021-10-20T23:21:37.596 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:21:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 -- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8fb00534f0 msgr2=0x7f8fb00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8fb00534f0 0x7f8fb00559b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f8fc400c000 tx=0x7f8fc4008040).stop 2021-10-20T23:21:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 -- 172.21.15.12:0/106597519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc143870 msgr2=0x7f8fcc0b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc143870 0x7f8fcc0b0cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f8fbc001250 tx=0x7f8fbc001360).stop 2021-10-20T23:21:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 -- 172.21.15.12:0/106597519 shutdown_connections 2021-10-20T23:21:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8fb00534f0 0x7f8fb00559b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fcc143870 0x7f8fcc0b0cf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc0b4aa0 0x7f8fcc0b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 --2- 172.21.15.12:0/106597519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fcc064640 0x7f8fcc0aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 -- 172.21.15.12:0/106597519 >> 172.21.15.12:0/106597519 conn(0x7f8fcc05f6b0 msgr2=0x7f8fcc0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 -- 172.21.15.12:0/106597519 shutdown_connections 2021-10-20T23:21:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:37.585+0000 7f8fd1138700 1 -- 172.21.15.12:0/106597519 wait complete. 2021-10-20T23:21:37.601 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:21:37.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:21:37.619 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:21:37.640 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:21:37.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:21:37.683 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:21:37.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:37.685 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:21:37.685 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:37.694 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:21:37.695 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:21:37.696 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:21:37.697 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:21:37.698 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:37.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[13821]: fuse finished with error 0 and tester_r 0 2021-10-20T23:21:37.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:37.754 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:21:37.755 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:37.762 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:21:37.763 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:21:37.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:21:37.857 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:37.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:37.864 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:21:37.864 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:21:37.871 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:21:37.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:21:37.873 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:21:37.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:21:37.874 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:21:37.922 INFO:teuthology.orchestra.run.smithi136.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:21:37.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:21:37.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:21:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 Processor -- start 2021-10-20T23:21:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 -- start start 2021-10-20T23:21:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80b2580 0x7fa7e814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7e80a8ac0 0x7fa7e814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80a70c0 con 0x7fa7e80b0010 2021-10-20T23:21:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e80a72f0 con 0x7fa7e80a8ac0 2021-10-20T23:21:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80a7590 con 0x7fa7e80b2580 2021-10-20T23:21:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7ed6b5700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa7e80b0010 0x7fa7e80a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36880/0 (socket says 172.21.15.12:36880) 2021-10-20T23:21:38.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7ed6b5700 1 -- 172.21.15.12:0/2720910901 learned_addr learned my addr 172.21.15.12:0/2720910901 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:38.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7ee6b7700 1 --2- 172.21.15.12:0/2720910901 >> v2:172.21.15.12:3300/0 conn(0x7fa7e80a8ac0 0x7fa7e814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7edeb6700 1 --2- 172.21.15.12:0/2720910901 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80b2580 0x7fa7e814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eceb4700 1 -- 172.21.15.12:0/2720910901 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383893369 0 0) 0x7fa7e80a70c0 con 0x7fa7e80b0010 2021-10-20T23:21:38.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eceb4700 1 -- 172.21.15.12:0/2720910901 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7cc003260 con 0x7fa7e80b0010 2021-10-20T23:21:38.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7ee6b7700 1 -- 172.21.15.12:0/2720910901 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80b2580 msgr2=0x7fa7e814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:38.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7ee6b7700 1 --2- 172.21.15.12:0/2720910901 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80b2580 0x7fa7e814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7ee6b7700 1 -- 172.21.15.12:0/2720910901 >> v1:172.21.15.12:6789/0 conn(0x7fa7e80b0010 legacy=0x7fa7e80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7ee6b7700 1 -- 172.21.15.12:0/2720910901 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80a7830 con 0x7fa7e80a8ac0 2021-10-20T23:21:38.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7edeb6700 1 --2- 172.21.15.12:0/2720910901 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80b2580 0x7fa7e814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:38.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7ee6b7700 1 --2- 172.21.15.12:0/2720910901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80a8ac0 0x7fa7e814b330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fa7e00032f0 tx=0x7fa7e00091d0).ready entity=mon.0 client_cookie=1a817fe1eddffa2b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:38.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eceb4700 1 -- 172.21.15.12:0/2720910901 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7e000b600 con 0x7fa7e80a8ac0 2021-10-20T23:21:38.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eceb4700 1 -- 172.21.15.12:0/2720910901 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e000b760 con 0x7fa7e80a8ac0 2021-10-20T23:21:38.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eceb4700 1 -- 172.21.15.12:0/2720910901 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7e000b8d0 con 0x7fa7e80a8ac0 2021-10-20T23:21:38.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/2720910901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80a8ac0 msgr2=0x7fa7e814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 --2- 172.21.15.12:0/2720910901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80a8ac0 0x7fa7e814b330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fa7e00032f0 tx=0x7fa7e00091d0).stop 2021-10-20T23:21:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/2720910901 shutdown_connections 2021-10-20T23:21:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 --2- 172.21.15.12:0/2720910901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80a8ac0 0x7fa7e814b330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 --2- 172.21.15.12:0/2720910901 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80b2580 0x7fa7e814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/2720910901 >> 172.21.15.12:0/2720910901 conn(0x7fa7e8060180 msgr2=0x7fa7e80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/2720910901 shutdown_connections 2021-10-20T23:21:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.037+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/2720910901 wait complete. 2021-10-20T23:21:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 Processor -- start 2021-10-20T23:21:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 -- start start 2021-10-20T23:21:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80a8ac0 0x7fa7e80b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80b0010 0x7fa7e80a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7e80b2580 0x7fa7e80aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e814cc90 con 0x7fa7e80b0010 2021-10-20T23:21:38.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80b3e00 con 0x7fa7e80b2580 2021-10-20T23:21:38.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e814c550 con 0x7fa7e80a8ac0 2021-10-20T23:21:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ed6b5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80b0010 0x7fa7e80a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ed6b5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80b0010 0x7fa7e80a9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38294/0 (socket says 172.21.15.12:38294) 2021-10-20T23:21:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ed6b5700 1 -- 172.21.15.12:0/3752227722 learned_addr learned my addr 172.21.15.12:0/3752227722 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7edeb6700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80a8ac0 0x7fa7e80b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ee6b7700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7e80b2580 0x7fa7e80aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ed6b5700 1 -- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80a8ac0 msgr2=0x7fa7e80b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ed6b5700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80a8ac0 0x7fa7e80b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ed6b5700 1 -- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7e80b2580 msgr2=0x7fa7e80aa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ed6b5700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7e80b2580 0x7fa7e80aa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ed6b5700 1 -- 172.21.15.12:0/3752227722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d800b180 con 0x7fa7e80b0010 2021-10-20T23:21:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7ed6b5700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80b0010 0x7fa7e80a9bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fa7e4001110 tx=0x7fa7e4007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7deffd700 1 -- 172.21.15.12:0/3752227722 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7e40070d0 con 0x7fa7e80b0010 2021-10-20T23:21:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7deffd700 1 -- 172.21.15.12:0/3752227722 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e4007230 con 0x7fa7e80b0010 2021-10-20T23:21:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e0009470 con 0x7fa7e80b0010 2021-10-20T23:21:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7deffd700 1 -- 172.21.15.12:0/3752227722 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7e4005610 con 0x7fa7e80b0010 2021-10-20T23:21:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.041+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80b40a0 con 0x7fa7e80b0010 2021-10-20T23:21:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.045+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e8057350 con 0x7fa7e80b0010 2021-10-20T23:21:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.045+0000 7fa7deffd700 1 -- 172.21.15.12:0/3752227722 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa7e4010070 con 0x7fa7e80b0010 2021-10-20T23:21:38.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.045+0000 7fa7deffd700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa7d00535b0 0x7fa7d0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.045+0000 7fa7deffd700 1 -- 172.21.15.12:0/3752227722 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa7e406b070 con 0x7fa7e80b0010 2021-10-20T23:21:38.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.045+0000 7fa7edeb6700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa7d00535b0 0x7fa7d0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.045+0000 7fa7edeb6700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa7d00535b0 0x7fa7d0055a70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fa7d800b000 tx=0x7fa7d8006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:38.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.053+0000 7fa7deffd700 1 -- 172.21.15.12:0/3752227722 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa7e4042070 con 0x7fa7e80b0010 2021-10-20T23:21:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa7e814c9f0 con 0x7fa7e80b0010 2021-10-20T23:21:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7deffd700 1 -- 172.21.15.12:0/3752227722 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v36) v1 ==== 81+0+34037 (secure 0 0 0) 0x7fa7e4045690 con 0x7fa7e80b0010 2021-10-20T23:21:38.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:38.188 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:21:38.188 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 36, 2021-10-20T23:21:38.188 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:21:38.189 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:21:38.189 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:20:35.135886+0000", 2021-10-20T23:21:38.189 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:21:38.189 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:21:38.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:21:38.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:21:38.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:21:38.190 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:21:38.190 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:21:38.191 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:21:38.191 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:21:38.191 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:21:38.191 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:21:38.192 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:21:38.192 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:21:38.192 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:21:38.192 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:21:38.192 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 6, 2021-10-20T23:21:38.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:21:38.193 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:21:38.193 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:21:38.193 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:21:38.194 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:21:38.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.194 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:21:38.194 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:21:38.196 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:21:38.196 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:21:38.196 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:21:38.196 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:21:38.197 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:21:38.197 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:21:38.197 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:21:38.197 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:21:38.198 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:21:38.198 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:21:38.198 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:21:38.198 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:21:38.199 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:21:38.199 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:21:38.199 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:21:38.200 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:21:38.200 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:21:38.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.200 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:21:38.200 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:21:38.201 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:21:38.201 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:21:38.201 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:21:38.201 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:21:38.201 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:21:38.202 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:21:38.202 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:21:38.202 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:21:38.202 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:21:38.203 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:21:38.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:21:38.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:21:38.203 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:21:38.203 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:21:38.204 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:21:38.204 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:21:38.204 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:21:38.204 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:21:38.205 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:21:38.205 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:21:38.205 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:21:38.205 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:21:38.205 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:21:38.206 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:21:38.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:21:38.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.206 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:21:38.206 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:21:38.207 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:21:38.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:21:38.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:21:38.207 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:21:38.208 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:21:38.208 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:21:38.208 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:21:38.208 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:21:38.208 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:21:38.209 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:21:38.209 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:21:38.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.209 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:21:38.209 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:21:38.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.210 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:21:38.211 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:21:38.211 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:21:38.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:21:38.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:21:38.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:21:38.212 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:21:38.212 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:21:38.212 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:21:38.212 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:21:38.213 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:21:38.213 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:21:38.213 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:21:38.213 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:21:38.213 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:21:38.214 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:21:38.214 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:21:38.214 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:21:38.214 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:21:38.214 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:21:38.215 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:21:38.215 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:21:38.215 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:21:38.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.216 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:21:38.216 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:21:38.216 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:21:38.216 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:21:38.216 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:21:38.217 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:21:38.217 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:21:38.217 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:21:38.217 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:21:38.218 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:21:38.218 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:21:38.218 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:21:38.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:21:38.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:21:38.219 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:21:38.219 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:21:38.219 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:21:38.219 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:21:38.220 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:21:38.220 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:21:38.220 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:21:38.220 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:21:38.220 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:21:38.221 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:21:38.221 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:21:38.221 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:21:38.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:21:38.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.222 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:21:38.222 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:21:38.222 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:21:38.222 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:21:38.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:21:38.223 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:21:38.223 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:21:38.223 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:21:38.224 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:21:38.224 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:21:38.224 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:21:38.224 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:21:38.224 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:21:38.225 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:21:38.225 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.225 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 5, 2021-10-20T23:21:38.226 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:21:38.226 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:20:32.169677+0000", 2021-10-20T23:21:38.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:21:38.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:21:38.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:21:38.227 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:21:38.227 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:21:38.227 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:21:38.227 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:21:38.228 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:21:38.228 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:21:38.228 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:21:38.228 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:21:38.228 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:21:38.229 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:21:38.229 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:21:38.229 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:21:38.229 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:21:38.229 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:21:38.230 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:21:38.230 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:21:38.230 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:21:38.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.231 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "35", 2021-10-20T23:21:38.231 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:21:38.231 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:21:38.231 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:21:38.231 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:21:38.232 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:21:38.232 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:21:38.232 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:21:38.232 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:21:38.232 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:21:38.233 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:21:38.233 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:21:38.233 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:21:38.233 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:21:38.233 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:21:38.234 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:21:38.234 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:21:38.234 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:21:38.234 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:21:38.235 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:21:38.235 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:21:38.235 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:21:38.235 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:21:38.235 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:21:38.236 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:21:38.236 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:21:38.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:21:38.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.236 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:21:38.237 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:21:38.237 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:21:38.237 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:21:38.238 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:21:38.238 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:21:38.238 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:21:38.238 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:21:38.239 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:21:38.239 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:21:38.239 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:21:38.239 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:21:38.239 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:21:38.240 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:21:38.240 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:21:38.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.240 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:21:38.240 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:21:38.241 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:21:38.241 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.241 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.242 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 6, 2021-10-20T23:21:38.242 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:21:38.242 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:20:33.133690+0000", 2021-10-20T23:21:38.242 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:21:38.243 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:21:38.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:21:38.243 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:21:38.243 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:21:38.243 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:21:38.244 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:21:38.244 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:21:38.244 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:21:38.244 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:21:38.245 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:21:38.245 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:21:38.245 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:21:38.245 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:21:38.245 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:21:38.246 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:21:38.246 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:21:38.246 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:21:38.246 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:21:38.246 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:21:38.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.247 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "36", 2021-10-20T23:21:38.247 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:21:38.247 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:21:38.247 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:21:38.248 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:21:38.248 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:21:38.248 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:21:38.248 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:21:38.249 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:21:38.249 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:21:38.249 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:21:38.249 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:21:38.249 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:21:38.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:21:38.250 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:21:38.250 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:21:38.250 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:21:38.251 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:21:38.251 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:21:38.251 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:21:38.251 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:21:38.251 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:21:38.252 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:21:38.252 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:21:38.252 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:21:38.252 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:21:38.252 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:21:38.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.253 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:21:38.253 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:21:38.253 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:21:38.253 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:21:38.254 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:21:38.254 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:21:38.254 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:21:38.254 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:21:38.255 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:21:38.255 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:21:38.255 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:21:38.255 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:21:38.255 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:21:38.256 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:21:38.256 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:21:38.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.257 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:21:38.257 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:21:38.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.257 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:21:38.258 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:21:38.258 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:38.258 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:38.258 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:38.259 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:38.259 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:38.259 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:38.259 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:38.260 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:38.260 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:38.260 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:38.261 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:38.261 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.261 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.261 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:21:38.262 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:38.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.262 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:21:38.263 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:38.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.263 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.263 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:38.264 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.264 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:21:38.265 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:38.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.265 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.266 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:21:38.266 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:38.266 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.266 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.267 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:38.267 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.267 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:21:38.268 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:38.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.268 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:21:38.269 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:38.269 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.269 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.269 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:38.270 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.270 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:21:38.271 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:38.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.271 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.271 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:21:38.272 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:38.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.272 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.272 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:21:38.273 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:21:38.273 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:21:38.273 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:21:38.273 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:38.274 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:38.274 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:38.274 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.275 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:21:38.275 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:21:38.275 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:38.275 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:38.275 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:38.276 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:38.276 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:38.276 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:38.276 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:38.276 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:38.277 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:38.277 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:38.277 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:38.277 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.278 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.278 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:21:38.278 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:38.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.279 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:21:38.279 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:38.279 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.280 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.280 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:38.280 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.281 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:21:38.281 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:38.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.282 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:21:38.282 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:38.282 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.283 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.283 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:38.283 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.284 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:21:38.284 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:38.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.285 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:21:38.285 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:38.285 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.286 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.286 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:38.286 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.287 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.287 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:21:38.287 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:38.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.288 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:21:38.288 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:38.288 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.289 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.289 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:21:38.289 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:21:38.289 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:21:38.290 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:21:38.290 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:38.290 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:38.290 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:38.291 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.291 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:21:38.291 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:21:38.292 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:38.292 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:38.292 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:38.292 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:38.292 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:38.293 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:38.293 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:38.293 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 33, 2021-10-20T23:21:38.293 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:38.294 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:38.294 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:38.294 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.295 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:21:38.295 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:38.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.296 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:21:38.296 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:38.296 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.296 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.297 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:38.297 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.297 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.298 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:21:38.298 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:38.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.299 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:21:38.299 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:38.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.299 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.300 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:38.300 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.300 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.301 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:21:38.301 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:38.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.302 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:21:38.302 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:38.302 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.302 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.303 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:38.303 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.304 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:21:38.304 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:38.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.305 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:21:38.305 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:38.305 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.305 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.306 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:21:38.306 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:21:38.306 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:21:38.306 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:21:38.307 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:38.307 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:38.307 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:38.307 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.308 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:21:38.308 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:21:38.308 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:38.309 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:38.309 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:38.309 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:38.309 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:38.310 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:38.310 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:38.310 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:38.310 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:38.310 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:38.311 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:38.311 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.311 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.312 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:21:38.312 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:38.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.313 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:21:38.313 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:38.313 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.313 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.314 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:38.314 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.315 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:21:38.315 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:38.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.315 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.316 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:21:38.316 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:38.316 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.316 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.317 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:38.317 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.318 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:21:38.318 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:38.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.319 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:21:38.319 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:38.319 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.319 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.320 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:38.320 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.321 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:21:38.321 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:38.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.322 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:21:38.322 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:38.322 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.322 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.323 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:21:38.323 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:21:38.323 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:21:38.324 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:21:38.324 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:38.324 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:38.324 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:38.324 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.325 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:21:38.325 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:21:38.325 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:38.326 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:38.326 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:38.326 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:38.326 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:38.327 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:38.327 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:38.327 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:38.327 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:38.327 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:38.328 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:38.328 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.328 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:21:38.329 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:38.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.329 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.330 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:21:38.330 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:38.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.330 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.331 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:38.331 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.331 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:21:38.332 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:38.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.333 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:21:38.333 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:38.333 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.333 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.334 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:38.334 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.334 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.335 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:21:38.335 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:38.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.335 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.336 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:21:38.336 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:38.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.336 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.337 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:38.337 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.338 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:21:38.338 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:38.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.339 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:21:38.339 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:38.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.340 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.340 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:21:38.340 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:21:38.341 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:21:38.341 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:21:38.341 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:38.341 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:38.342 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:38.342 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.342 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:21:38.343 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:21:38.343 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:38.343 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:38.343 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:38.344 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:38.344 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:38.344 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:38.344 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:38.344 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:38.345 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:38.345 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:38.345 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:38.345 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.346 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.346 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:21:38.346 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:38.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.347 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.347 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:21:38.347 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:38.347 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.348 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.348 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:38.348 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.349 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.349 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:21:38.349 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:38.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.350 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.350 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:21:38.350 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:38.351 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.351 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.351 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:38.351 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.352 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.352 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:21:38.352 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:38.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.353 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.353 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:21:38.354 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:38.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.354 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.354 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:38.355 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.355 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:21:38.356 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:38.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.356 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.356 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:21:38.357 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:38.357 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.357 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.357 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:21:38.358 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:21:38.358 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:21:38.358 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:21:38.358 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:38.359 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:38.359 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:38.359 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.360 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:21:38.360 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:21:38.360 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:38.360 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:38.360 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:38.361 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:38.361 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:38.361 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:38.361 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:38.362 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 33, 2021-10-20T23:21:38.362 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:38.362 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:38.362 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:38.362 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.363 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:21:38.363 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:38.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.364 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.364 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:21:38.364 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:38.365 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.365 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.365 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:38.365 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.366 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.366 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:21:38.366 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:38.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.367 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.367 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:21:38.367 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:38.368 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.368 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.368 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:38.369 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.369 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.369 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:21:38.369 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:38.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.370 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.370 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:21:38.371 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:38.371 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.371 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.371 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:38.372 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.372 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.372 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:21:38.373 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:38.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.373 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.373 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:21:38.374 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:38.374 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.374 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.375 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:21:38.375 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:21:38.375 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:21:38.375 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:21:38.375 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:38.376 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:38.376 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:38.376 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.377 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:21:38.377 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:21:38.377 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:38.377 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:38.378 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:38.378 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:38.378 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:38.378 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:38.379 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:38.379 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:38.379 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:38.379 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:38.379 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:38.380 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.380 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.380 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:21:38.381 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:38.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.381 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:21:38.382 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:38.382 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.382 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.383 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:38.383 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.383 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.383 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:21:38.384 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:38.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.384 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.384 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:21:38.385 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:38.385 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.385 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.385 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:21:38.387 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:38.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.387 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.387 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:21:38.388 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:38.388 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.388 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.388 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:38.389 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:38.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:38.389 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:21:38.390 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:38.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.390 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:38.390 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:21:38.391 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:38.391 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.391 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.392 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:21:38.392 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:21:38.392 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:21:38.392 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:21:38.392 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:38.393 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:38.393 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:38.393 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:38.393 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.393 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:21:38.394 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:21:38.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.394 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:21:38.394 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:38.395 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:38.395 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:38.395 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:38.395 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:38.396 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:21:38.396 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:38.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.396 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:21:38.397 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:38.397 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:38.397 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:38.397 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:38.398 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:38.398 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:21:38.398 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:38.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.399 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:21:38.399 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:38.399 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:38.399 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:38.399 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:38.400 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:38.400 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:21:38.400 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:38.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.401 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:21:38.401 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:38.401 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:38.401 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:38.402 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:38.402 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:38.402 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:21:38.402 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:38.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.403 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:21:38.403 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:38.403 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:38.404 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:38.404 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:38.404 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:38.404 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:21:38.404 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:38.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.405 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:21:38.405 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:38.405 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:38.406 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:38.406 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:38.406 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:38.406 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:21:38.407 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:38.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.407 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:21:38.407 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:38.408 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:38.408 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:38.408 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:38.408 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:38.409 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:21:38.409 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:38.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:38.410 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:21:38.410 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:38.410 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:38.410 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:38.410 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:38.411 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:38.411 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:21:38.411 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:38.411 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.411 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:21:38.412 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:21:38.412 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:21:38.412 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:21:38.412 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:21:38.413 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:21:38.413 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:21:38.413 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:21:38.413 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:21:38.413 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:21:38.414 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:21:38.414 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:21:38.414 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:21:38.414 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:21:38.415 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:21:38.415 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:21:38.415 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:21:38.415 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:21:38.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.416 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:21:38.416 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:21:38.416 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:21:38.416 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:21:38.416 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:21:38.417 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:21:38.417 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:21:38.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:38.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:38.417 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:21:38.418 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:21:38.418 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:21:38.418 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:21:38.418 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:21:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:21:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa7d00535b0 msgr2=0x7fa7d0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa7d00535b0 0x7fa7d0055a70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fa7d800b000 tx=0x7fa7d8006df0).stop 2021-10-20T23:21:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80b0010 msgr2=0x7fa7e80a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80b0010 0x7fa7e80a9bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fa7e4001110 tx=0x7fa7e4007ad0).stop 2021-10-20T23:21:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 shutdown_connections 2021-10-20T23:21:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa7d00535b0 0x7fa7d0055a70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7e80b2580 0x7fa7e80aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e80b0010 0x7fa7e80a9bf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 --2- 172.21.15.12:0/3752227722 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7e80a8ac0 0x7fa7e80b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 >> 172.21.15.12:0/3752227722 conn(0x7fa7e8060180 msgr2=0x7fa7e81486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 shutdown_connections 2021-10-20T23:21:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.185+0000 7fa7eeeb8700 1 -- 172.21.15.12:0/3752227722 wait complete. 2021-10-20T23:21:38.424 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:21:38.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.533+0000 7f73263bd700 1 Processor -- start 2021-10-20T23:21:38.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.533+0000 7f73263bd700 1 -- start start 2021-10-20T23:21:38.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f73263bd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f73200b30d0 0x7f7320143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f73263bd700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7320143920 con 0x7f73200b0710 2021-10-20T23:21:38.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f73263bd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73200b0af0 con 0x7f73200ace70 2021-10-20T23:21:38.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f73263bd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73200ae680 con 0x7f73200b30d0 2021-10-20T23:21:38.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f73253bb700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f73200b0710 0x7f7320142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36894/0 (socket says 172.21.15.12:36894) 2021-10-20T23:21:38.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f73253bb700 1 -- 172.21.15.12:0/1187192161 learned_addr learned my addr 172.21.15.12:0/1187192161 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:38.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f7324bba700 1 --2- 172.21.15.12:0/1187192161 >> v2:172.21.15.31:3300/0 conn(0x7f73200b30d0 0x7f7320143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f730ffff700 1 -- 172.21.15.12:0/1187192161 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920976036 0 0) 0x7f7320143920 con 0x7f73200b0710 2021-10-20T23:21:38.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f730ffff700 1 -- 172.21.15.12:0/1187192161 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7308003260 con 0x7f73200b0710 2021-10-20T23:21:38.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f7324bba700 1 -- 172.21.15.12:0/1187192161 >> v1:172.21.15.31:6789/0 conn(0x7f73200ace70 legacy=0x7f732013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f730ffff700 1 -- 172.21.15.12:0/1187192161 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3615413776 0 0) 0x7f7308003260 con 0x7f73200b0710 2021-10-20T23:21:38.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f7324bba700 1 -- 172.21.15.12:0/1187192161 >> v1:172.21.15.12:6789/0 conn(0x7f73200b0710 legacy=0x7f7320142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f7324bba700 1 -- 172.21.15.12:0/1187192161 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73200ae920 con 0x7f73200b30d0 2021-10-20T23:21:38.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f7324bba700 1 --2- 172.21.15.12:0/1187192161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73200b30d0 0x7f7320143430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f731c001800 tx=0x7f7310006e80).ready entity=mon.1 client_cookie=7bb93ef88ec7247c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:38.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f730ffff700 1 -- 172.21.15.12:0/1187192161 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f731c001660 con 0x7f73200b30d0 2021-10-20T23:21:38.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f730ffff700 1 -- 172.21.15.12:0/1187192161 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7310000e90 con 0x7f73200b30d0 2021-10-20T23:21:38.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.537+0000 7f730ffff700 1 -- 172.21.15.12:0/1187192161 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f731000f940 con 0x7f73200b30d0 2021-10-20T23:21:38.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 -- 172.21.15.12:0/1187192161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73200b30d0 msgr2=0x7f7320143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 --2- 172.21.15.12:0/1187192161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73200b30d0 0x7f7320143430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f731c001800 tx=0x7f7310006e80).stop 2021-10-20T23:21:38.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 -- 172.21.15.12:0/1187192161 shutdown_connections 2021-10-20T23:21:38.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 --2- 172.21.15.12:0/1187192161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73200b30d0 0x7f7320143430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 -- 172.21.15.12:0/1187192161 >> 172.21.15.12:0/1187192161 conn(0x7f7320061140 msgr2=0x7f7320062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:38.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 -- 172.21.15.12:0/1187192161 shutdown_connections 2021-10-20T23:21:38.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 -- 172.21.15.12:0/1187192161 wait complete. 2021-10-20T23:21:38.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 Processor -- start 2021-10-20T23:21:38.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 -- start start 2021-10-20T23:21:38.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73200ace70 0x7f732014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73200b0710 0x7f7320065330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73200b30d0 0x7f7320065820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7320067800 con 0x7f73200b30d0 2021-10-20T23:21:38.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7320065d10 con 0x7f73200ace70 2021-10-20T23:21:38.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73263bd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73200b3860 con 0x7f73200b0710 2021-10-20T23:21:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f7325bbc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73200b30d0 0x7f7320065820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f7325bbc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73200b30d0 0x7f7320065820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38310/0 (socket says 172.21.15.12:38310) 2021-10-20T23:21:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f7325bbc700 1 -- 172.21.15.12:0/3835815595 learned_addr learned my addr 172.21.15.12:0/3835815595 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f7324bba700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73200b0710 0x7f7320065330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.541+0000 7f73253bb700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73200ace70 0x7f732014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f7325bbc700 1 -- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73200b0710 msgr2=0x7f7320065330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f7325bbc700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73200b0710 0x7f7320065330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f7325bbc700 1 -- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73200ace70 msgr2=0x7f732014e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f7325bbc700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73200ace70 0x7f732014e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f7325bbc700 1 -- 172.21.15.12:0/3835815595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731000c310 con 0x7f73200b30d0 2021-10-20T23:21:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f7325bbc700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73200b30d0 0x7f7320065820 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f73200b0290 tx=0x7f7318007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f730e7fc700 1 -- 172.21.15.12:0/3835815595 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f731800f470 con 0x7f73200b30d0 2021-10-20T23:21:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f730e7fc700 1 -- 172.21.15.12:0/3835815595 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731800f5d0 con 0x7f73200b30d0 2021-10-20T23:21:38.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f730e7fc700 1 -- 172.21.15.12:0/3835815595 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f731800f930 con 0x7f73200b30d0 2021-10-20T23:21:38.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7320067a30 con 0x7f73200b30d0 2021-10-20T23:21:38.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732014e890 con 0x7f73200b30d0 2021-10-20T23:21:38.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7320057350 con 0x7f73200b30d0 2021-10-20T23:21:38.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.545+0000 7f730e7fc700 1 -- 172.21.15.12:0/3835815595 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7318019030 con 0x7f73200b30d0 2021-10-20T23:21:38.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.549+0000 7f730e7fc700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7300053640 0x7f7300055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.549+0000 7f730e7fc700 1 -- 172.21.15.12:0/3835815595 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f731806b080 con 0x7f73200b30d0 2021-10-20T23:21:38.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.549+0000 7f73253bb700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7300053640 0x7f7300055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.549+0000 7f73253bb700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7300053640 0x7f7300055b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f731c00d000 tx=0x7f731c001e40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:38.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.553+0000 7f730e7fc700 1 -- 172.21.15.12:0/3835815595 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7318042080 con 0x7f73200b30d0 2021-10-20T23:21:38.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.713+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73200b2c70 con 0x7f73200b30d0 2021-10-20T23:21:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.713+0000 7f730e7fc700 1 -- 172.21.15.12:0/3835815595 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f73180456a0 con 0x7f73200b30d0 2021-10-20T23:21:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:38.716 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:20:34.132895+0000","modified":"2021-10-20T23:20:35.137040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/655661573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":655661573},{"type":"v1","addr":"172.21.15.12:6835","nonce":655661573}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-20T23:21:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.713+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7300053640 msgr2=0x7f7300055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7300053640 0x7f7300055b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f731c00d000 tx=0x7f731c001e40).stop 2021-10-20T23:21:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73200b30d0 msgr2=0x7f7320065820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73200b30d0 0x7f7320065820 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f73200b0290 tx=0x7f7318007f40).stop 2021-10-20T23:21:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 shutdown_connections 2021-10-20T23:21:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7300053640 0x7f7300055b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73200b30d0 0x7f7320065820 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73200b0710 0x7f7320065330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 --2- 172.21.15.12:0/3835815595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73200ace70 0x7f732014e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 >> 172.21.15.12:0/3835815595 conn(0x7f7320061140 msgr2=0x7f73200b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 shutdown_connections 2021-10-20T23:21:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.717+0000 7f73263bd700 1 -- 172.21.15.12:0/3835815595 wait complete. 2021-10-20T23:21:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2021-10-20T23:21:38.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:21:38.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a097ef700 1 Processor -- start 2021-10-20T23:21:38.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a097ef700 1 -- start start 2021-10-20T23:21:38.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a097ef700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0a040b1db0 0x7f0a040b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a097ef700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a040a70c0 0x7f0a04144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a097ef700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a040b0350 con 0x7f0a041483a0 2021-10-20T23:21:38.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a097ef700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a040a90c0 con 0x7f0a040b1db0 2021-10-20T23:21:38.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a097ef700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a040b05f0 con 0x7f0a040a70c0 2021-10-20T23:21:38.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a037fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a040a70c0 0x7f0a04144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a02ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0a040b1db0 0x7f0a040b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a02ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0a040b1db0 0x7f0a040b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:53288/0 (socket says 172.21.15.12:53288) 2021-10-20T23:21:38.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a027fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0a041483a0 0x7f0a040b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:43972/0 (socket says 172.21.15.12:43972) 2021-10-20T23:21:38.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a02ffd700 1 -- 172.21.15.12:0/1131052855 learned_addr learned my addr 172.21.15.12:0/1131052855 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:38.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a037fe700 1 --2- 172.21.15.12:0/1131052855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a040a70c0 0x7f0a04144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:44076/0 (socket says 172.21.15.12:44076) 2021-10-20T23:21:38.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a02ffd700 1 -- 172.21.15.12:0/1131052855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a040a70c0 msgr2=0x7f0a04144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:38.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a02ffd700 1 --2- 172.21.15.12:0/1131052855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a040a70c0 0x7f0a04144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a02ffd700 1 -- 172.21.15.12:0/1131052855 >> v1:172.21.15.31:6789/0 conn(0x7f0a041483a0 legacy=0x7f0a040b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a02ffd700 1 -- 172.21.15.12:0/1131052855 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a040b0890 con 0x7f0a040b1db0 2021-10-20T23:21:38.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.829+0000 7f0a037fe700 1 --2- 172.21.15.12:0/1131052855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a040a70c0 0x7f0a04144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:38.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a02ffd700 1 --2- 172.21.15.12:0/1131052855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a040b1db0 0x7f0a040b0fd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f0a04147730 tx=0x7f09f8006eb0).ready entity=mon.1 client_cookie=5b395560b544b536 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:38.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a01ffb700 1 -- 172.21.15.12:0/1131052855 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09f800d5c0 con 0x7f0a040b1db0 2021-10-20T23:21:38.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a01ffb700 1 -- 172.21.15.12:0/1131052855 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8000e90 con 0x7f0a040b1db0 2021-10-20T23:21:38.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a01ffb700 1 -- 172.21.15.12:0/1131052855 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09f800d950 con 0x7f0a040b1db0 2021-10-20T23:21:38.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a097ef700 1 -- 172.21.15.12:0/1131052855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a040b1db0 msgr2=0x7f0a040b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a097ef700 1 --2- 172.21.15.12:0/1131052855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a040b1db0 0x7f0a040b0fd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f0a04147730 tx=0x7f09f8006eb0).stop 2021-10-20T23:21:38.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a097ef700 1 -- 172.21.15.12:0/1131052855 shutdown_connections 2021-10-20T23:21:38.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a097ef700 1 --2- 172.21.15.12:0/1131052855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a040a70c0 0x7f0a04144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a097ef700 1 --2- 172.21.15.12:0/1131052855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a040b1db0 0x7f0a040b0fd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a097ef700 1 -- 172.21.15.12:0/1131052855 >> 172.21.15.12:0/1131052855 conn(0x7f0a0405f6b0 msgr2=0x7f0a0405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:38.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a097ef700 1 -- 172.21.15.12:0/1131052855 shutdown_connections 2021-10-20T23:21:38.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a097ef700 1 -- 172.21.15.12:0/1131052855 wait complete. 2021-10-20T23:21:38.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.833+0000 7f0a097ef700 1 Processor -- start 2021-10-20T23:21:38.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a097ef700 1 -- start start 2021-10-20T23:21:38.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a097ef700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a040a70c0 0x7f0a040abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a097ef700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a040b1db0 0x7f0a040ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a097ef700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a041483a0 0x7f0a040a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a097ef700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0414a760 con 0x7f0a040a70c0 2021-10-20T23:21:38.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a097ef700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0414b460 con 0x7f0a040b1db0 2021-10-20T23:21:38.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a097ef700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0414b700 con 0x7f0a041483a0 2021-10-20T23:21:38.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a02ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a040a70c0 0x7f0a040abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a02ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a040a70c0 0x7f0a040abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38320/0 (socket says 172.21.15.12:38320) 2021-10-20T23:21:38.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a02ffd700 1 -- 172.21.15.12:0/2360123214 learned_addr learned my addr 172.21.15.12:0/2360123214 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:38.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a027fc700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a040b1db0 0x7f0a040ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a037fe700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a041483a0 0x7f0a040a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a02ffd700 1 -- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a041483a0 msgr2=0x7f0a040a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a02ffd700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a041483a0 0x7f0a040a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a02ffd700 1 -- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a040b1db0 msgr2=0x7f0a040ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:38.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a02ffd700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a040b1db0 0x7f0a040ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:38.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a02ffd700 1 -- 172.21.15.12:0/2360123214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc00b180 con 0x7f0a040a70c0 2021-10-20T23:21:38.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a02ffd700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a040a70c0 0x7f0a040abc80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f0a04147730 tx=0x7f09f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:38.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f09f3fff700 1 -- 172.21.15.12:0/2360123214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09f8011610 con 0x7f0a040a70c0 2021-10-20T23:21:38.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f09f3fff700 1 -- 172.21.15.12:0/2360123214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8011770 con 0x7f0a040a70c0 2021-10-20T23:21:38.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f800b1e0 con 0x7f0a040a70c0 2021-10-20T23:21:38.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f09f3fff700 1 -- 172.21.15.12:0/2360123214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09f8011ad0 con 0x7f0a040a70c0 2021-10-20T23:21:38.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.837+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a04149ac0 con 0x7f0a040a70c0 2021-10-20T23:21:38.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.841+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0414b8c0 con 0x7f0a040a70c0 2021-10-20T23:21:38.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.841+0000 7f09f3fff700 1 -- 172.21.15.12:0/2360123214 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f09f8025030 con 0x7f0a040a70c0 2021-10-20T23:21:38.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.841+0000 7f09f3fff700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f09e0053610 0x7f09e0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:38.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.841+0000 7f09f3fff700 1 -- 172.21.15.12:0/2360123214 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f09f806ccf0 con 0x7f0a040a70c0 2021-10-20T23:21:38.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.841+0000 7f0a027fc700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f09e0053610 0x7f09e0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:38.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.841+0000 7f0a027fc700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f09e0053610 0x7f09e0055ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f09f400d000 tx=0x7f09f4007f90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:38.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:38.845+0000 7f09f3fff700 1 -- 172.21.15.12:0/2360123214 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f09f8043b60 con 0x7f0a040a70c0 2021-10-20T23:21:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.017+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0a04057350 con 0x7f0a040a70c0 2021-10-20T23:21:39.060 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:21:39.057+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:21:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.073+0000 7f09f3fff700 1 -- 172.21.15.12:0/2360123214 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f09f8023070 con 0x7f0a040a70c0 2021-10-20T23:21:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f09e0053610 msgr2=0x7f09e0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f09e0053610 0x7f09e0055ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f09f400d000 tx=0x7f09f4007f90).stop 2021-10-20T23:21:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a040a70c0 msgr2=0x7f0a040abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a040a70c0 0x7f0a040abc80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f0a04147730 tx=0x7f09f8015000).stop 2021-10-20T23:21:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 shutdown_connections 2021-10-20T23:21:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f09e0053610 0x7f09e0055ad0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a041483a0 0x7f0a040a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a040b1db0 0x7f0a040ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 --2- 172.21.15.12:0/2360123214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a040a70c0 0x7f0a040abc80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 >> 172.21.15.12:0/2360123214 conn(0x7f0a0405f6b0 msgr2=0x7f0a041448c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 shutdown_connections 2021-10-20T23:21:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.077+0000 7f0a097ef700 1 -- 172.21.15.12:0/2360123214 wait complete. 2021-10-20T23:21:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:21:39.094 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:21:39.109 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:21:39.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 Processor -- start 2021-10-20T23:21:39.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 -- start start 2021-10-20T23:21:39.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd100b1db0 0x7fbd100b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd100b0350 con 0x7fbd101483a0 2021-10-20T23:21:39.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd100b05f0 con 0x7fbd100a70c0 2021-10-20T23:21:39.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100a90c0 con 0x7fbd100b1db0 2021-10-20T23:21:39.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0dd9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbd101483a0 0x7fbd100b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36934/0 (socket says 172.21.15.12:36934) 2021-10-20T23:21:39.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0dd9b700 1 -- 172.21.15.12:0/1443355552 learned_addr learned my addr 172.21.15.12:0/1443355552 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:39.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0e59c700 1 --2- 172.21.15.12:0/1443355552 >> v2:172.21.15.31:3300/0 conn(0x7fbd100b1db0 0x7fbd100b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0d59a700 1 -- 172.21.15.12:0/1443355552 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170360906 0 0) 0x7fbd100b0350 con 0x7fbd101483a0 2021-10-20T23:21:39.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0d59a700 1 -- 172.21.15.12:0/1443355552 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf0003260 con 0x7fbd101483a0 2021-10-20T23:21:39.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0e59c700 1 -- 172.21.15.12:0/1443355552 >> v1:172.21.15.31:6789/0 conn(0x7fbd100a70c0 legacy=0x7fbd10144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0e59c700 1 -- 172.21.15.12:0/1443355552 >> v1:172.21.15.12:6789/0 conn(0x7fbd101483a0 legacy=0x7fbd100b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0d59a700 1 -- 172.21.15.12:0/1443355552 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412635896 0 0) 0x7fbcf0003260 con 0x7fbd101483a0 2021-10-20T23:21:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0e59c700 1 -- 172.21.15.12:0/1443355552 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd100b0890 con 0x7fbd100b1db0 2021-10-20T23:21:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0e59c700 1 --2- 172.21.15.12:0/1443355552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd100b1db0 0x7fbd100b0fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fbd10147730 tx=0x7fbcf8006df0).ready entity=mon.1 client_cookie=89806442726d5b4f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0d59a700 1 -- 172.21.15.12:0/1443355552 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd080019e0 con 0x7fbd100b1db0 2021-10-20T23:21:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0d59a700 1 -- 172.21.15.12:0/1443355552 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8000e90 con 0x7fbd100b1db0 2021-10-20T23:21:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd0d59a700 1 -- 172.21.15.12:0/1443355552 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf800d4f0 con 0x7fbd100b1db0 2021-10-20T23:21:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 -- 172.21.15.12:0/1443355552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd100b1db0 msgr2=0x7fbd100b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 --2- 172.21.15.12:0/1443355552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd100b1db0 0x7fbd100b0fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fbd10147730 tx=0x7fbcf8006df0).stop 2021-10-20T23:21:39.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 -- 172.21.15.12:0/1443355552 shutdown_connections 2021-10-20T23:21:39.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 --2- 172.21.15.12:0/1443355552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd100b1db0 0x7fbd100b0fd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.193+0000 7fbd14c62700 1 -- 172.21.15.12:0/1443355552 >> 172.21.15.12:0/1443355552 conn(0x7fbd1005f6b0 msgr2=0x7fbd1005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:39.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 -- 172.21.15.12:0/1443355552 shutdown_connections 2021-10-20T23:21:39.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 -- 172.21.15.12:0/1443355552 wait complete. 2021-10-20T23:21:39.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 Processor -- start 2021-10-20T23:21:39.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 -- start start 2021-10-20T23:21:39.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd100a70c0 0x7fbd100aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd100b1db0 0x7fbd10143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd101483a0 0x7fbd10143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1014b9b0 con 0x7fbd101483a0 2021-10-20T23:21:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100a9550 con 0x7fbd100b1db0 2021-10-20T23:21:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd14c62700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100a97f0 con 0x7fbd100a70c0 2021-10-20T23:21:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd101483a0 0x7fbd10143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd101483a0 0x7fbd10143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38348/0 (socket says 172.21.15.12:38348) 2021-10-20T23:21:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0ed9d700 1 -- 172.21.15.12:0/762135116 learned_addr learned my addr 172.21.15.12:0/762135116 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0dd9b700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd100b1db0 0x7fbd10143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0e59c700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd100a70c0 0x7fbd100aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0e59c700 1 -- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd100b1db0 msgr2=0x7fbd10143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0e59c700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd100b1db0 0x7fbd10143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0e59c700 1 -- 172.21.15.12:0/762135116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd101483a0 msgr2=0x7fbd10143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0e59c700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd101483a0 0x7fbd10143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0e59c700 1 -- 172.21.15.12:0/762135116 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf800b180 con 0x7fbd100a70c0 2021-10-20T23:21:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0ed9d700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd101483a0 0x7fbd10143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd0e59c700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd100a70c0 0x7fbd100aeb00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbd10147730 tx=0x7fbcf8014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.197+0000 7fbd077fe700 1 -- 172.21.15.12:0/762135116 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf8016070 con 0x7fbd100a70c0 2021-10-20T23:21:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.201+0000 7fbd077fe700 1 -- 172.21.15.12:0/762135116 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8013b10 con 0x7fbd100a70c0 2021-10-20T23:21:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.201+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd100a9a90 con 0x7fbd100a70c0 2021-10-20T23:21:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.201+0000 7fbd077fe700 1 -- 172.21.15.12:0/762135116 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf800d4f0 con 0x7fbd100a70c0 2021-10-20T23:21:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.201+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd100af790 con 0x7fbd100a70c0 2021-10-20T23:21:39.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.201+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd100a9c20 con 0x7fbd100a70c0 2021-10-20T23:21:39.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.201+0000 7fbd077fe700 1 -- 172.21.15.12:0/762135116 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbcf800f030 con 0x7fbd100a70c0 2021-10-20T23:21:39.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.201+0000 7fbd077fe700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcf40536d0 0x7fbcf4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.201+0000 7fbd077fe700 1 -- 172.21.15.12:0/762135116 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fbcf806ceb0 con 0x7fbd100a70c0 2021-10-20T23:21:39.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.201+0000 7fbd0dd9b700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcf40536d0 0x7fbcf4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.205+0000 7fbd0dd9b700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcf40536d0 0x7fbcf4055b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fbd0800d000 tx=0x7fbd08007c00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.209+0000 7fbd077fe700 1 -- 172.21.15.12:0/762135116 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbcf8043f10 con 0x7fbd100a70c0 2021-10-20T23:21:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.377+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd100b0b30 con 0x7fbd100a70c0 2021-10-20T23:21:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd077fe700 1 -- 172.21.15.12:0/762135116 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2127 (secure 0 0 0) 0x7fbcf8047530 con 0x7fbd100a70c0 2021-10-20T23:21:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:39.383 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:20:34.132895+0000","modified":"2021-10-20T23:21:39.062990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-20T23:21:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcf40536d0 msgr2=0x7fbcf4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd14c62700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcf40536d0 0x7fbcf4055b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fbd0800d000 tx=0x7fbd08007c00).stop 2021-10-20T23:21:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd100a70c0 msgr2=0x7fbd100aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd14c62700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd100a70c0 0x7fbd100aeb00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbd10147730 tx=0x7fbcf8014000).stop 2021-10-20T23:21:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 shutdown_connections 2021-10-20T23:21:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd14c62700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcf40536d0 0x7fbcf4055b90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd14c62700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd101483a0 0x7fbd10143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd14c62700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd100b1db0 0x7fbd10143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.381+0000 7fbd14c62700 1 --2- 172.21.15.12:0/762135116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd100a70c0 0x7fbd100aeb00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.385+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 >> 172.21.15.12:0/762135116 conn(0x7fbd1005f6b0 msgr2=0x7fbd101455a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:39.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.385+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 shutdown_connections 2021-10-20T23:21:39.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.385+0000 7fbd14c62700 1 -- 172.21.15.12:0/762135116 wait complete. 2021-10-20T23:21:39.389 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 14 2021-10-20T23:21:39.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:21:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.505+0000 7f11ea008700 1 Processor -- start 2021-10-20T23:21:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11ea008700 1 -- start start 2021-10-20T23:21:39.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11ea008700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f11e40b6380 0x7f11e413d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11ea008700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 0x7f11e413d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11ea008700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e413daf0 con 0x7f11e40b0cd0 2021-10-20T23:21:39.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11ea008700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e4066960 con 0x7f11e40b6380 2021-10-20T23:21:39.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11ea008700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4066c00 con 0x7f11e4064370 2021-10-20T23:21:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11e9006700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f11e40b6380 0x7f11e413d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11e8805700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f11e40b0cd0 0x7f11e4060830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:44012/0 (socket says 172.21.15.12:44012) 2021-10-20T23:21:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11e9807700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 0x7f11e413d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11e8805700 1 -- 172.21.15.12:0/3410977745 learned_addr learned my addr 172.21.15.12:0/3410977745 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11e9006700 1 -- 172.21.15.12:0/3410977745 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 msgr2=0x7f11e413d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11e9006700 1 --2- 172.21.15.12:0/3410977745 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 0x7f11e413d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11e9006700 1 -- 172.21.15.12:0/3410977745 >> v1:172.21.15.31:6789/0 conn(0x7f11e40b0cd0 legacy=0x7f11e4060830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11e9006700 1 -- 172.21.15.12:0/3410977745 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4066ea0 con 0x7f11e40b6380 2021-10-20T23:21:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11e9006700 1 --2- 172.21.15.12:0/3410977745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b6380 0x7f11e413d110 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f11e0002f70 tx=0x7f11e0006df0).ready entity=mon.0 client_cookie=efda95472f9643b0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11d3fff700 1 -- 172.21.15.12:0/3410977745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11e000d570 con 0x7f11e40b6380 2021-10-20T23:21:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11d3fff700 1 -- 172.21.15.12:0/3410977745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0000e90 con 0x7f11e40b6380 2021-10-20T23:21:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.509+0000 7f11d3fff700 1 -- 172.21.15.12:0/3410977745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11e000d8c0 con 0x7f11e40b6380 2021-10-20T23:21:39.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 -- 172.21.15.12:0/3410977745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b6380 msgr2=0x7f11e413d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 --2- 172.21.15.12:0/3410977745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b6380 0x7f11e413d110 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f11e0002f70 tx=0x7f11e0006df0).stop 2021-10-20T23:21:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 -- 172.21.15.12:0/3410977745 shutdown_connections 2021-10-20T23:21:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 --2- 172.21.15.12:0/3410977745 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 0x7f11e413d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 --2- 172.21.15.12:0/3410977745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b6380 0x7f11e413d110 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 -- 172.21.15.12:0/3410977745 >> 172.21.15.12:0/3410977745 conn(0x7f11e4063670 msgr2=0x7f11e4063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 -- 172.21.15.12:0/3410977745 shutdown_connections 2021-10-20T23:21:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 -- 172.21.15.12:0/3410977745 wait complete. 2021-10-20T23:21:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 Processor -- start 2021-10-20T23:21:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 -- start start 2021-10-20T23:21:39.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 0x7f11e41565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.513+0000 7f11ea008700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b0cd0 0x7f11e41403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11ea008700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b6380 0x7f11e41451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11ea008700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4140e40 con 0x7f11e40b0cd0 2021-10-20T23:21:39.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11ea008700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4144840 con 0x7f11e40b6380 2021-10-20T23:21:39.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11ea008700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4155bc0 con 0x7f11e4064370 2021-10-20T23:21:39.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e8805700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b0cd0 0x7f11e41403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e8805700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b0cd0 0x7f11e41403b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38362/0 (socket says 172.21.15.12:38362) 2021-10-20T23:21:39.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e8805700 1 -- 172.21.15.12:0/2614778222 learned_addr learned my addr 172.21.15.12:0/2614778222 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:39.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e9807700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b6380 0x7f11e41451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e9006700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 0x7f11e41565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e8805700 1 -- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 msgr2=0x7f11e41565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e8805700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 0x7f11e41565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e8805700 1 -- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b6380 msgr2=0x7f11e41451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e8805700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b6380 0x7f11e41451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e8805700 1 -- 172.21.15.12:0/2614778222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e000b180 con 0x7f11e40b0cd0 2021-10-20T23:21:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11e8805700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b0cd0 0x7f11e41403b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f11e4146d00 tx=0x7f11d4007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:39.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11d27fc700 1 -- 172.21.15.12:0/2614778222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d400ce20 con 0x7f11e40b0cd0 2021-10-20T23:21:39.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11d27fc700 1 -- 172.21.15.12:0/2614778222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d40072e0 con 0x7f11e40b0cd0 2021-10-20T23:21:39.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e4155e60 con 0x7f11e40b0cd0 2021-10-20T23:21:39.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11d27fc700 1 -- 172.21.15.12:0/2614778222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d4005800 con 0x7f11e40b0cd0 2021-10-20T23:21:39.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e40b0470 con 0x7f11e40b0cd0 2021-10-20T23:21:39.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e4057350 con 0x7f11e40b0cd0 2021-10-20T23:21:39.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.517+0000 7f11d27fc700 1 -- 172.21.15.12:0/2614778222 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f11d4010070 con 0x7f11e40b0cd0 2021-10-20T23:21:39.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.521+0000 7f11d27fc700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f11c4053610 0x7f11c4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.521+0000 7f11d27fc700 1 -- 172.21.15.12:0/2614778222 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f11d406b240 con 0x7f11e40b0cd0 2021-10-20T23:21:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.521+0000 7f11e9006700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f11c4053610 0x7f11c4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.521+0000 7f11e9006700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f11c4053610 0x7f11c4055ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f11e0018000 tx=0x7f11e0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.529+0000 7f11d27fc700 1 -- 172.21.15.12:0/2614778222 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f11d40420e0 con 0x7f11e40b0cd0 2021-10-20T23:21:39.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:39.681+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f11e406aaf0 con 0x7f11e40b0cd0 2021-10-20T23:21:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.081+0000 7f11d27fc700 1 -- 172.21.15.12:0/2614778222 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f11d4045700 con 0x7f11e40b0cd0 2021-10-20T23:21:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.081+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f11c4053610 msgr2=0x7f11c4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.081+0000 7f11ea008700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f11c4053610 0x7f11c4055ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f11e0018000 tx=0x7f11e0014000).stop 2021-10-20T23:21:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.081+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b0cd0 msgr2=0x7f11e41403b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.081+0000 7f11ea008700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b0cd0 0x7f11e41403b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f11e4146d00 tx=0x7f11d4007c40).stop 2021-10-20T23:21:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.085+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 shutdown_connections 2021-10-20T23:21:40.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.085+0000 7f11ea008700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f11c4053610 0x7f11c4055ad0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:40.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.085+0000 7f11ea008700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b6380 0x7f11e41451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:40.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.085+0000 7f11ea008700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e40b0cd0 0x7f11e41403b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:40.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.085+0000 7f11ea008700 1 --2- 172.21.15.12:0/2614778222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11e4064370 0x7f11e41565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:40.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.085+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 >> 172.21.15.12:0/2614778222 conn(0x7f11e4063670 msgr2=0x7f11e40b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:40.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.085+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 shutdown_connections 2021-10-20T23:21:40.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.085+0000 7f11ea008700 1 -- 172.21.15.12:0/2614778222 wait complete. 2021-10-20T23:21:40.102 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:21:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.217+0000 7fdb9759e700 1 Processor -- start 2021-10-20T23:21:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.217+0000 7fdb9759e700 1 -- start start 2021-10-20T23:21:40.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb980b3060 0x7fdb980b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:40.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb98064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:40.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb980b2380 con 0x7fdb980b7370 2021-10-20T23:21:40.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb98144250 con 0x7fdb980b3060 2021-10-20T23:21:40.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980b3570 con 0x7fdb980aac20 2021-10-20T23:21:40.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdb980b7370 0x7fdb9813e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36962/0 (socket says 172.21.15.12:36962) 2021-10-20T23:21:40.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9659c700 1 -- 172.21.15.12:0/388994343 learned_addr learned my addr 172.21.15.12:0/388994343 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:40.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb96d9d700 1 --2- 172.21.15.12:0/388994343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb98064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb95d9b700 1 --2- 172.21.15.12:0/388994343 >> v2:172.21.15.31:3300/0 conn(0x7fdb980b3060 0x7fdb980b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb96d9d700 1 -- 172.21.15.12:0/388994343 >> v2:172.21.15.31:3300/0 conn(0x7fdb980b3060 msgr2=0x7fdb980b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:40.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb96d9d700 1 --2- 172.21.15.12:0/388994343 >> v2:172.21.15.31:3300/0 conn(0x7fdb980b3060 0x7fdb980b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:40.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb96d9d700 1 -- 172.21.15.12:0/388994343 >> v1:172.21.15.12:6789/0 conn(0x7fdb980b7370 legacy=0x7fdb9813e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:40.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb96d9d700 1 -- 172.21.15.12:0/388994343 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980b25b0 con 0x7fdb980aac20 2021-10-20T23:21:40.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9559a700 1 -- 172.21.15.12:0/388994343 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128347494 0 0) 0x7fdb980b2380 con 0x7fdb980b7370 2021-10-20T23:21:40.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb96d9d700 1 --2- 172.21.15.12:0/388994343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb98064ba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdb900032f0 tx=0x7fdb900091d0).ready entity=mon.2 client_cookie=db439718f7dee9a0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:40.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9559a700 1 -- 172.21.15.12:0/388994343 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb9000b6c0 con 0x7fdb980aac20 2021-10-20T23:21:40.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9559a700 1 -- 172.21.15.12:0/388994343 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9000b820 con 0x7fdb980aac20 2021-10-20T23:21:40.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9559a700 1 -- 172.21.15.12:0/388994343 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb9000b990 con 0x7fdb980aac20 2021-10-20T23:21:40.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 -- 172.21.15.12:0/388994343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 msgr2=0x7fdb98064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:40.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 --2- 172.21.15.12:0/388994343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb98064ba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdb900032f0 tx=0x7fdb900091d0).stop 2021-10-20T23:21:40.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 -- 172.21.15.12:0/388994343 shutdown_connections 2021-10-20T23:21:40.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 --2- 172.21.15.12:0/388994343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb98064ba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:40.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 --2- 172.21.15.12:0/388994343 >> v2:172.21.15.31:3300/0 conn(0x7fdb980b3060 0x7fdb980b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:40.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 -- 172.21.15.12:0/388994343 >> 172.21.15.12:0/388994343 conn(0x7fdb9805f6b0 msgr2=0x7fdb9805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:40.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 -- 172.21.15.12:0/388994343 shutdown_connections 2021-10-20T23:21:40.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.221+0000 7fdb9759e700 1 -- 172.21.15.12:0/388994343 wait complete. 2021-10-20T23:21:40.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 Processor -- start 2021-10-20T23:21:40.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 -- start start 2021-10-20T23:21:40.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb980adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:40.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb980b3060 0x7fdb9814ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:40.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb980b7370 0x7fdb980af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:40.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980ae060 con 0x7fdb980b3060 2021-10-20T23:21:40.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980acd10 con 0x7fdb980b7370 2021-10-20T23:21:40.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980ad430 con 0x7fdb980aac20 2021-10-20T23:21:40.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb96d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb980b7370 0x7fdb980af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:40.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb95d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb980b3060 0x7fdb9814ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:40.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb96d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb980b7370 0x7fdb980af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:53350/0 (socket says 172.21.15.12:53350) 2021-10-20T23:21:40.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb96d9d700 1 -- 172.21.15.12:0/346602611 learned_addr learned my addr 172.21.15.12:0/346602611 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:40.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9659c700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb980adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:40.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb95d9b700 1 -- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 msgr2=0x7fdb980adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:40.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb95d9b700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb980adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:40.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb95d9b700 1 -- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb980b7370 msgr2=0x7fdb980af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:40.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb95d9b700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb980b7370 0x7fdb980af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:40.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb95d9b700 1 -- 172.21.15.12:0/346602611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90009470 con 0x7fdb980b3060 2021-10-20T23:21:40.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9659c700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb980adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:40.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb96d9d700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb980b7370 0x7fdb980af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:40.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb95d9b700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb980b3060 0x7fdb9814ffc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fdb8800c000 tx=0x7fdb88006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:40.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb8f7fe700 1 -- 172.21.15.12:0/346602611 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb88010780 con 0x7fdb980b3060 2021-10-20T23:21:40.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb8f7fe700 1 -- 172.21.15.12:0/346602611 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb880108e0 con 0x7fdb980b3060 2021-10-20T23:21:40.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb980ad6d0 con 0x7fdb980b3060 2021-10-20T23:21:40.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb8f7fe700 1 -- 172.21.15.12:0/346602611 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb88010c40 con 0x7fdb980b3060 2021-10-20T23:21:40.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.225+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb98143b70 con 0x7fdb980b3060 2021-10-20T23:21:40.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.229+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb98057350 con 0x7fdb980b3060 2021-10-20T23:21:40.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.229+0000 7fdb8f7fe700 1 -- 172.21.15.12:0/346602611 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb8801b400 con 0x7fdb980b3060 2021-10-20T23:21:40.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.229+0000 7fdb8f7fe700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb7c0534f0 0x7fdb7c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:40.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.229+0000 7fdb8f7fe700 1 -- 172.21.15.12:0/346602611 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fdb8806bb40 con 0x7fdb980b3060 2021-10-20T23:21:40.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.229+0000 7fdb9659c700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb7c0534f0 0x7fdb7c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:40.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.229+0000 7fdb9659c700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb7c0534f0 0x7fdb7c0559b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fdb8000d000 tx=0x7fdb80007bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.237+0000 7fdb8f7fe700 1 -- 172.21.15.12:0/346602611 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb88042a90 con 0x7fdb980b3060 2021-10-20T23:21:40.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:40.361+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdb980601a0 con 0x7fdb980b3060 2021-10-20T23:21:41.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.089+0000 7fdb8f7fe700 1 -- 172.21.15.12:0/346602611 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 185+0+0 (secure 0 0 0) 0x7fdb880460b0 con 0x7fdb980b3060 2021-10-20T23:21:41.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.097+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb7c0534f0 msgr2=0x7fdb7c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:41.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.097+0000 7fdb9759e700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb7c0534f0 0x7fdb7c0559b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fdb8000d000 tx=0x7fdb80007bc0).stop 2021-10-20T23:21:41.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.097+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb980b3060 msgr2=0x7fdb9814ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:41.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.097+0000 7fdb9759e700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb980b3060 0x7fdb9814ffc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fdb8800c000 tx=0x7fdb88006df0).stop 2021-10-20T23:21:41.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.101+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 shutdown_connections 2021-10-20T23:21:41.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.101+0000 7fdb9759e700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb7c0534f0 0x7fdb7c0559b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:41.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.101+0000 7fdb9759e700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb980b7370 0x7fdb980af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:41.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.101+0000 7fdb9759e700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb980b3060 0x7fdb9814ffc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:41.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.101+0000 7fdb9759e700 1 --2- 172.21.15.12:0/346602611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb980aac20 0x7fdb980adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:41.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.101+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 >> 172.21.15.12:0/346602611 conn(0x7fdb9805f6b0 msgr2=0x7fdb98140d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:41.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.101+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 shutdown_connections 2021-10-20T23:21:41.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.101+0000 7fdb9759e700 1 -- 172.21.15.12:0/346602611 wait complete. 2021-10-20T23:21:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:21:41.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:21:41.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.229+0000 7f3c4c723700 1 Processor -- start 2021-10-20T23:21:41.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.229+0000 7f3c4c723700 1 -- start start 2021-10-20T23:21:41.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.229+0000 7f3c4c723700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c440b6580 0x7f3c440b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:41.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.229+0000 7f3c4c723700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c440b43c0 0x7f3c440b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:41.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.229+0000 7f3c4c723700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c441440b0 con 0x7f3c44061d30 2021-10-20T23:21:41.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.229+0000 7f3c4c723700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c440b6e50 con 0x7f3c440b43c0 2021-10-20T23:21:41.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.229+0000 7f3c4c723700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44143b70 con 0x7f3c440b6580 2021-10-20T23:21:41.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c49cbe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c440b43c0 0x7f3c440b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4acc0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3c44061d30 0x7f3c441466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36976/0 (socket says 172.21.15.12:36976) 2021-10-20T23:21:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4acc0700 1 -- 172.21.15.12:0/820210033 learned_addr learned my addr 172.21.15.12:0/820210033 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4a4bf700 1 --2- 172.21.15.12:0/820210033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c440b6580 0x7f3c440b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:41.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c49cbe700 1 -- 172.21.15.12:0/820210033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c440b6580 msgr2=0x7f3c440b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:41.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c49cbe700 1 --2- 172.21.15.12:0/820210033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c440b6580 0x7f3c440b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c49cbe700 1 -- 172.21.15.12:0/820210033 >> v1:172.21.15.12:6789/0 conn(0x7f3c44061d30 legacy=0x7f3c441466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c49cbe700 1 -- 172.21.15.12:0/820210033 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44143e10 con 0x7f3c440b43c0 2021-10-20T23:21:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c494bd700 1 -- 172.21.15.12:0/820210033 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906509816 0 0) 0x7f3c441440b0 con 0x7f3c44061d30 2021-10-20T23:21:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c49cbe700 1 --2- 172.21.15.12:0/820210033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c440b43c0 0x7f3c440b6960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f3c40002f70 tx=0x7f3c40006df0).ready entity=mon.0 client_cookie=227333cae8ce3eab server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c494bd700 1 -- 172.21.15.12:0/820210033 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c4000d570 con 0x7f3c440b43c0 2021-10-20T23:21:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c494bd700 1 -- 172.21.15.12:0/820210033 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c40000e90 con 0x7f3c440b43c0 2021-10-20T23:21:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c494bd700 1 -- 172.21.15.12:0/820210033 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c4000d8c0 con 0x7f3c440b43c0 2021-10-20T23:21:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4c723700 1 -- 172.21.15.12:0/820210033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c440b43c0 msgr2=0x7f3c440b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4c723700 1 --2- 172.21.15.12:0/820210033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c440b43c0 0x7f3c440b6960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f3c40002f70 tx=0x7f3c40006df0).stop 2021-10-20T23:21:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4c723700 1 -- 172.21.15.12:0/820210033 shutdown_connections 2021-10-20T23:21:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4c723700 1 --2- 172.21.15.12:0/820210033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c440b43c0 0x7f3c440b6960 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4c723700 1 --2- 172.21.15.12:0/820210033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c440b6580 0x7f3c440b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4c723700 1 -- 172.21.15.12:0/820210033 >> 172.21.15.12:0/820210033 conn(0x7f3c4405c490 msgr2=0x7f3c4405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:41.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4c723700 1 -- 172.21.15.12:0/820210033 shutdown_connections 2021-10-20T23:21:41.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.233+0000 7f3c4c723700 1 -- 172.21.15.12:0/820210033 wait complete. 2021-10-20T23:21:41.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4c723700 1 Processor -- start 2021-10-20T23:21:41.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4c723700 1 -- start start 2021-10-20T23:21:41.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4c723700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c44061d30 0x7f3c441412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:41.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4c723700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440b43c0 0x7f3c441556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:41.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4c723700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c440b6580 0x7f3c44155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:41.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4c723700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44126dd0 con 0x7f3c440b6580 2021-10-20T23:21:41.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4c723700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4412afc0 con 0x7f3c440b43c0 2021-10-20T23:21:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4c723700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44126320 con 0x7f3c44061d30 2021-10-20T23:21:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4acc0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c440b6580 0x7f3c44155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4a4bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c44061d30 0x7f3c441412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c49cbe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440b43c0 0x7f3c441556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:41.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4a4bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c44061d30 0x7f3c441412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:44144/0 (socket says 172.21.15.12:44144) 2021-10-20T23:21:41.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4a4bf700 1 -- 172.21.15.12:0/3691378163 learned_addr learned my addr 172.21.15.12:0/3691378163 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:41.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4a4bf700 1 -- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440b43c0 msgr2=0x7f3c441556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:41.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.237+0000 7f3c4a4bf700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440b43c0 0x7f3c441556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c4a4bf700 1 -- 172.21.15.12:0/3691378163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c440b6580 msgr2=0x7f3c44155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c4a4bf700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c440b6580 0x7f3c44155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c4a4bf700 1 -- 172.21.15.12:0/3691378163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4000b180 con 0x7f3c44061d30 2021-10-20T23:21:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c4a4bf700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c44061d30 0x7f3c441412d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3c44126f10 tx=0x7f3c34006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c337fe700 1 -- 172.21.15.12:0/3691378163 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c34010780 con 0x7f3c44061d30 2021-10-20T23:21:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c337fe700 1 -- 172.21.15.12:0/3691378163 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c340108e0 con 0x7f3c44061d30 2021-10-20T23:21:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4412b4e0 con 0x7f3c44061d30 2021-10-20T23:21:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c337fe700 1 -- 172.21.15.12:0/3691378163 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c34010c40 con 0x7f3c44061d30 2021-10-20T23:21:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4412b1b0 con 0x7f3c44061d30 2021-10-20T23:21:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c441264e0 con 0x7f3c44061d30 2021-10-20T23:21:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.241+0000 7f3c337fe700 1 -- 172.21.15.12:0/3691378163 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3c3401c460 con 0x7f3c44061d30 2021-10-20T23:21:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.245+0000 7f3c337fe700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c240535b0 0x7f3c24055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:41.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.245+0000 7f3c337fe700 1 -- 172.21.15.12:0/3691378163 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f3c3406bd30 con 0x7f3c44061d30 2021-10-20T23:21:41.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.245+0000 7f3c49cbe700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c240535b0 0x7f3c24055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:41.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.245+0000 7f3c49cbe700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c240535b0 0x7f3c24055a70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3c4001a000 tx=0x7f3c40014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:41.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.249+0000 7f3c337fe700 1 -- 172.21.15.12:0/3691378163 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c34042d90 con 0x7f3c44061d30 2021-10-20T23:21:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:41.381+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c440615f0 con 0x7f3c44061d30 2021-10-20T23:21:42.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.101+0000 7f3c337fe700 1 -- 172.21.15.12:0/3691378163 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3c340463b0 con 0x7f3c44061d30 2021-10-20T23:21:42.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c240535b0 msgr2=0x7f3c24055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c240535b0 0x7f3c24055a70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3c4001a000 tx=0x7f3c40014000).stop 2021-10-20T23:21:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c44061d30 msgr2=0x7f3c441412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c44061d30 0x7f3c441412d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3c44126f10 tx=0x7f3c34006df0).stop 2021-10-20T23:21:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 shutdown_connections 2021-10-20T23:21:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c240535b0 0x7f3c24055a70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c440b6580 0x7f3c44155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440b43c0 0x7f3c441556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 --2- 172.21.15.12:0/3691378163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c44061d30 0x7f3c441412d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 >> 172.21.15.12:0/3691378163 conn(0x7f3c4405c490 msgr2=0x7f3c44128910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:42.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 shutdown_connections 2021-10-20T23:21:42.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.105+0000 7f3c4c723700 1 -- 172.21.15.12:0/3691378163 wait complete. 2021-10-20T23:21:42.110 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:21:42.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:21:42.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33b373700 1 Processor -- start 2021-10-20T23:21:42.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33b373700 1 -- start start 2021-10-20T23:21:42.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33b373700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb3340b2cf0 0x7fb3340b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33b373700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 0x7fb3340b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33b373700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3340b2270 con 0x7fb334064b40 2021-10-20T23:21:42.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33b373700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb334062230 con 0x7fb3340b2cf0 2021-10-20T23:21:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33b373700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb334064f20 con 0x7fb334143fb0 2021-10-20T23:21:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb339b70700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb3340b2cf0 0x7fb3340b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb339b70700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb3340b2cf0 0x7fb3340b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38396/0 (socket says 172.21.15.12:38396) 2021-10-20T23:21:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb339b70700 1 -- 172.21.15.12:0/3779842357 learned_addr learned my addr 172.21.15.12:0/3779842357 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33ab72700 1 --2- 172.21.15.12:0/3779842357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 0x7fb3340b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb339b70700 1 -- 172.21.15.12:0/3779842357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 msgr2=0x7fb3340b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb339b70700 1 --2- 172.21.15.12:0/3779842357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 0x7fb3340b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb339b70700 1 -- 172.21.15.12:0/3779842357 >> v1:172.21.15.31:6789/0 conn(0x7fb334064b40 legacy=0x7fb3341438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb339b70700 1 -- 172.21.15.12:0/3779842357 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb334065760 con 0x7fb3340b2cf0 2021-10-20T23:21:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33ab72700 1 --2- 172.21.15.12:0/3779842357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 0x7fb3340b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb339b70700 1 --2- 172.21.15.12:0/3779842357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340b2cf0 0x7fb3340b3230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fb3300032f0 tx=0x7fb330009250).ready entity=mon.0 client_cookie=93df4f17040804df server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33936f700 1 -- 172.21.15.12:0/3779842357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb33000b8a0 con 0x7fb3340b2cf0 2021-10-20T23:21:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33936f700 1 -- 172.21.15.12:0/3779842357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33000ba00 con 0x7fb3340b2cf0 2021-10-20T23:21:42.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.221+0000 7fb33936f700 1 -- 172.21.15.12:0/3779842357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb33000bb70 con 0x7fb3340b2cf0 2021-10-20T23:21:42.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 -- 172.21.15.12:0/3779842357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340b2cf0 msgr2=0x7fb3340b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 --2- 172.21.15.12:0/3779842357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340b2cf0 0x7fb3340b3230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fb3300032f0 tx=0x7fb330009250).stop 2021-10-20T23:21:42.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 -- 172.21.15.12:0/3779842357 shutdown_connections 2021-10-20T23:21:42.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 --2- 172.21.15.12:0/3779842357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 0x7fb3340b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 --2- 172.21.15.12:0/3779842357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340b2cf0 0x7fb3340b3230 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 -- 172.21.15.12:0/3779842357 >> 172.21.15.12:0/3779842357 conn(0x7fb334062be0 msgr2=0x7fb33405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:42.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 -- 172.21.15.12:0/3779842357 shutdown_connections 2021-10-20T23:21:42.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 -- 172.21.15.12:0/3779842357 wait complete. 2021-10-20T23:21:42.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 Processor -- start 2021-10-20T23:21:42.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.225+0000 7fb33b373700 1 -- start start 2021-10-20T23:21:42.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33b373700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334064b40 0x7fb334155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33b373700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3340b2cf0 0x7fb334155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33b373700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 0x7fb3341403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33b373700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340b1820 con 0x7fb334064b40 2021-10-20T23:21:42.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33b373700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340b7f80 con 0x7fb3340b2cf0 2021-10-20T23:21:42.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33b373700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340b8220 con 0x7fb334143fb0 2021-10-20T23:21:42.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33a371700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334064b40 0x7fb334155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33a371700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334064b40 0x7fb334155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38400/0 (socket says 172.21.15.12:38400) 2021-10-20T23:21:42.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33a371700 1 -- 172.21.15.12:0/1494133790 learned_addr learned my addr 172.21.15.12:0/1494133790 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:42.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb339b70700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3340b2cf0 0x7fb334155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33ab72700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 0x7fb3341403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33a371700 1 -- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 msgr2=0x7fb3341403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33a371700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 0x7fb3341403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33a371700 1 -- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3340b2cf0 msgr2=0x7fb334155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33a371700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3340b2cf0 0x7fb334155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33a371700 1 -- 172.21.15.12:0/1494133790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3300094d0 con 0x7fb334064b40 2021-10-20T23:21:42.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33a371700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334064b40 0x7fb334155af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fb3340654b0 tx=0x7fb324007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:42.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb3237fe700 1 -- 172.21.15.12:0/1494133790 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb324012400 con 0x7fb334064b40 2021-10-20T23:21:42.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb3237fe700 1 -- 172.21.15.12:0/1494133790 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324012560 con 0x7fb334064b40 2021-10-20T23:21:42.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb3237fe700 1 -- 172.21.15.12:0/1494133790 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3240128c0 con 0x7fb334064b40 2021-10-20T23:21:42.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33405c960 con 0x7fb334064b40 2021-10-20T23:21:42.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.229+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3340b0b80 con 0x7fb334064b40 2021-10-20T23:21:42.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.233+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3340b1a20 con 0x7fb334064b40 2021-10-20T23:21:42.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.233+0000 7fb3237fe700 1 -- 172.21.15.12:0/1494133790 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb324019030 con 0x7fb334064b40 2021-10-20T23:21:42.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.233+0000 7fb3237fe700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3140534f0 0x7fb3140559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.233+0000 7fb3237fe700 1 -- 172.21.15.12:0/1494133790 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb32406aa30 con 0x7fb334064b40 2021-10-20T23:21:42.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.233+0000 7fb339b70700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3140534f0 0x7fb3140559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.233+0000 7fb339b70700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3140534f0 0x7fb3140559b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb33001a000 tx=0x7fb330016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:42.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.237+0000 7fb3237fe700 1 -- 172.21.15.12:0/1494133790 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb324041d10 con 0x7fb334064b40 2021-10-20T23:21:42.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.365+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb334057350 con 0x7fb334064b40 2021-10-20T23:21:42.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.373+0000 7fb3237fe700 1 -- 172.21.15.12:0/1494133790 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb324045330 con 0x7fb334064b40 2021-10-20T23:21:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3140534f0 msgr2=0x7fb3140559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3140534f0 0x7fb3140559b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb33001a000 tx=0x7fb330016000).stop 2021-10-20T23:21:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334064b40 msgr2=0x7fb334155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334064b40 0x7fb334155af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fb3340654b0 tx=0x7fb324007c50).stop 2021-10-20T23:21:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 shutdown_connections 2021-10-20T23:21:42.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3140534f0 0x7fb3140559b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb334143fb0 0x7fb3341403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3340b2cf0 0x7fb334155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 --2- 172.21.15.12:0/1494133790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334064b40 0x7fb334155af0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 >> 172.21.15.12:0/1494133790 conn(0x7fb334062be0 msgr2=0x7fb334066b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:42.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 shutdown_connections 2021-10-20T23:21:42.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.377+0000 7fb33b373700 1 -- 172.21.15.12:0/1494133790 wait complete. 2021-10-20T23:21:42.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-10-20T23:21:42.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.493+0000 7fae1d5c7700 1 Processor -- start 2021-10-20T23:21:42.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.493+0000 7fae1d5c7700 1 -- start start 2021-10-20T23:21:42.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.493+0000 7fae1d5c7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae180b26e0 0x7fae180ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.493+0000 7fae1d5c7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1805c490 con 0x7fae18143240 2021-10-20T23:21:42.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.493+0000 7fae1d5c7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae181436d0 con 0x7fae180b1e30 2021-10-20T23:21:42.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.493+0000 7fae1d5c7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1813da50 con 0x7fae180b26e0 2021-10-20T23:21:42.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae17fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae180b26e0 0x7fae180ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae1cdc6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae18143240 0x7fae180a8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37006/0 (socket says 172.21.15.12:37006) 2021-10-20T23:21:42.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae1cdc6700 1 -- 172.21.15.12:0/1382415783 learned_addr learned my addr 172.21.15.12:0/1382415783 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:42.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae16ffd700 1 -- 172.21.15.12:0/1382415783 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015689390 0 0) 0x7fae181436d0 con 0x7fae180b1e30 2021-10-20T23:21:42.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae16ffd700 1 -- 172.21.15.12:0/1382415783 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae04003260 con 0x7fae180b1e30 2021-10-20T23:21:42.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae17fff700 1 -- 172.21.15.12:0/1382415783 >> v1:172.21.15.31:6789/0 conn(0x7fae180b1e30 legacy=0x7fae18140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae17fff700 1 -- 172.21.15.12:0/1382415783 >> v1:172.21.15.12:6789/0 conn(0x7fae18143240 legacy=0x7fae180a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae17fff700 1 -- 172.21.15.12:0/1382415783 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180b2ac0 con 0x7fae180b26e0 2021-10-20T23:21:42.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae17fff700 1 --2- 172.21.15.12:0/1382415783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae180b26e0 0x7fae180ad850 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fae08002f70 tx=0x7fae08006df0).ready entity=mon.0 client_cookie=f16040eb070ecea8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:42.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae16ffd700 1 -- 172.21.15.12:0/1382415783 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae0800d5c0 con 0x7fae180b26e0 2021-10-20T23:21:42.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae16ffd700 1 -- 172.21.15.12:0/1382415783 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08000e90 con 0x7fae180b26e0 2021-10-20T23:21:42.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae16ffd700 1 -- 172.21.15.12:0/1382415783 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae0800d910 con 0x7fae180b26e0 2021-10-20T23:21:42.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae1d5c7700 1 -- 172.21.15.12:0/1382415783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae180b26e0 msgr2=0x7fae180ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae1d5c7700 1 --2- 172.21.15.12:0/1382415783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae180b26e0 0x7fae180ad850 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fae08002f70 tx=0x7fae08006df0).stop 2021-10-20T23:21:42.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae1d5c7700 1 -- 172.21.15.12:0/1382415783 shutdown_connections 2021-10-20T23:21:42.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae1d5c7700 1 --2- 172.21.15.12:0/1382415783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae180b26e0 0x7fae180ad850 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae1d5c7700 1 -- 172.21.15.12:0/1382415783 >> 172.21.15.12:0/1382415783 conn(0x7fae180611d0 msgr2=0x7fae18062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:42.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae1d5c7700 1 -- 172.21.15.12:0/1382415783 shutdown_connections 2021-10-20T23:21:42.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.497+0000 7fae1d5c7700 1 -- 172.21.15.12:0/1382415783 wait complete. 2021-10-20T23:21:42.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 Processor -- start 2021-10-20T23:21:42.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 -- start start 2021-10-20T23:21:42.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae180b1e30 0x7fae1805f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae180b26e0 0x7fae18155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae18143240 0x7fae181563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180b5620 con 0x7fae18143240 2021-10-20T23:21:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180653e0 con 0x7fae180b1e30 2021-10-20T23:21:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae180b4e40 con 0x7fae180b26e0 2021-10-20T23:21:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1cdc6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae18143240 0x7fae181563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1cdc6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae18143240 0x7fae181563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38418/0 (socket says 172.21.15.12:38418) 2021-10-20T23:21:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1cdc6700 1 -- 172.21.15.12:0/3982289759 learned_addr learned my addr 172.21.15.12:0/3982289759 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae17fff700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae180b1e30 0x7fae1805f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae177fe700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae180b26e0 0x7fae18155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1cdc6700 1 -- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae180b26e0 msgr2=0x7fae18155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1cdc6700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae180b26e0 0x7fae18155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1cdc6700 1 -- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae180b1e30 msgr2=0x7fae1805f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1cdc6700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae180b1e30 0x7fae1805f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:42.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1cdc6700 1 -- 172.21.15.12:0/3982289759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0800b180 con 0x7fae18143240 2021-10-20T23:21:42.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae177fe700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae180b26e0 0x7fae18155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:42.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1cdc6700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae18143240 0x7fae181563a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fae18062c70 tx=0x7fae100013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:42.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae157fa700 1 -- 172.21.15.12:0/3982289759 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae10005ba0 con 0x7fae18143240 2021-10-20T23:21:42.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae157fa700 1 -- 172.21.15.12:0/3982289759 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae10005d00 con 0x7fae18143240 2021-10-20T23:21:42.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae180b50e0 con 0x7fae18143240 2021-10-20T23:21:42.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae157fa700 1 -- 172.21.15.12:0/3982289759 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae100072c0 con 0x7fae18143240 2021-10-20T23:21:42.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.501+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae18156890 con 0x7fae18143240 2021-10-20T23:21:42.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.505+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae180b3f00 con 0x7fae18143240 2021-10-20T23:21:42.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.505+0000 7fae157fa700 1 -- 172.21.15.12:0/3982289759 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fae10010070 con 0x7fae18143240 2021-10-20T23:21:42.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.505+0000 7fae157fa700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fadf8053580 0x7fadf8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:42.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.505+0000 7fae157fa700 1 -- 172.21.15.12:0/3982289759 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fae1006b1d0 con 0x7fae18143240 2021-10-20T23:21:42.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.505+0000 7fae17fff700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fadf8053580 0x7fadf8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:42.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.505+0000 7fae17fff700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fadf8053580 0x7fadf8055a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fae0801a000 tx=0x7fae08014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:42.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.509+0000 7fae157fa700 1 -- 172.21.15.12:0/3982289759 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae10042340 con 0x7fae18143240 2021-10-20T23:21:42.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:42.681+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7fae18057350 con 0x7fae18143240 2021-10-20T23:21:43.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.109+0000 7fae157fa700 1 -- 172.21.15.12:0/3982289759 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v94) v1 ==== 139+0+0 (secure 0 0 0) 0x7fae10045960 con 0x7fae18143240 2021-10-20T23:21:43.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fadf8053580 msgr2=0x7fadf8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:43.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fadf8053580 0x7fadf8055a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fae0801a000 tx=0x7fae08014000).stop 2021-10-20T23:21:43.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae18143240 msgr2=0x7fae181563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:43.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae18143240 0x7fae181563a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fae18062c70 tx=0x7fae100013a0).stop 2021-10-20T23:21:43.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 shutdown_connections 2021-10-20T23:21:43.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fadf8053580 0x7fadf8055a40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae18143240 0x7fae181563a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae180b26e0 0x7fae18155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 --2- 172.21.15.12:0/3982289759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae180b1e30 0x7fae1805f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 >> 172.21.15.12:0/3982289759 conn(0x7fae180611d0 msgr2=0x7fae1813e570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:43.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 shutdown_connections 2021-10-20T23:21:43.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.113+0000 7fae1d5c7700 1 -- 172.21.15.12:0/3982289759 wait complete. 2021-10-20T23:21:43.135 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-10-20T23:21:43.135 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-10-20T23:21:43.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-10-20T23:21:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 Processor -- start 2021-10-20T23:21:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 -- start start 2021-10-20T23:21:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23440b1db0 0x7f23440b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23441483a0 0x7f23440b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 0x7f2344144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440a90c0 con 0x7f23441483a0 2021-10-20T23:21:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440b0350 con 0x7f23440b1db0 2021-10-20T23:21:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440b05f0 con 0x7f23440a70c0 2021-10-20T23:21:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2343fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23441483a0 0x7f23440b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2343fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23441483a0 0x7f23440b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38422/0 (socket says 172.21.15.12:38422) 2021-10-20T23:21:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2343fff700 1 -- 172.21.15.12:0/2835714461 learned_addr learned my addr 172.21.15.12:0/2835714461 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2348e73700 1 --2- 172.21.15.12:0/2835714461 >> v2:172.21.15.31:3300/0 conn(0x7f23440b1db0 0x7f23440b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2349674700 1 --2- 172.21.15.12:0/2835714461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 0x7f2344144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2343fff700 1 -- 172.21.15.12:0/2835714461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 msgr2=0x7f2344144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2343fff700 1 --2- 172.21.15.12:0/2835714461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 0x7f2344144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2343fff700 1 -- 172.21.15.12:0/2835714461 >> v2:172.21.15.31:3300/0 conn(0x7f23440b1db0 msgr2=0x7f23440b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2343fff700 1 --2- 172.21.15.12:0/2835714461 >> v2:172.21.15.31:3300/0 conn(0x7f23440b1db0 0x7f23440b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2343fff700 1 -- 172.21.15.12:0/2835714461 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440b0890 con 0x7f23441483a0 2021-10-20T23:21:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f2343fff700 1 --2- 172.21.15.12:0/2835714461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 0x7f23440b2190 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f2344147730 tx=0x7f233c009290).ready entity=mon.0 client_cookie=8b263a4dc8e4dd2d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f23437fe700 1 -- 172.21.15.12:0/2835714461 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f233c00b860 con 0x7f23441483a0 2021-10-20T23:21:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f23437fe700 1 -- 172.21.15.12:0/2835714461 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00b9c0 con 0x7f23441483a0 2021-10-20T23:21:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f23437fe700 1 -- 172.21.15.12:0/2835714461 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f233c00bb30 con 0x7f23441483a0 2021-10-20T23:21:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 -- 172.21.15.12:0/2835714461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 msgr2=0x7f23440b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 --2- 172.21.15.12:0/2835714461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 0x7f23440b2190 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f2344147730 tx=0x7f233c009290).stop 2021-10-20T23:21:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 -- 172.21.15.12:0/2835714461 shutdown_connections 2021-10-20T23:21:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 --2- 172.21.15.12:0/2835714461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 0x7f2344144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 --2- 172.21.15.12:0/2835714461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 0x7f23440b2190 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 --2- 172.21.15.12:0/2835714461 >> v2:172.21.15.31:3300/0 conn(0x7f23440b1db0 0x7f23440b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 -- 172.21.15.12:0/2835714461 >> 172.21.15.12:0/2835714461 conn(0x7f234405f6b0 msgr2=0x7f234405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 -- 172.21.15.12:0/2835714461 shutdown_connections 2021-10-20T23:21:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.241+0000 7f234b0d7700 1 -- 172.21.15.12:0/2835714461 wait complete. 2021-10-20T23:21:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 Processor -- start 2021-10-20T23:21:43.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 -- start start 2021-10-20T23:21:43.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 0x7f234415a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:43.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23440b1db0 0x7f23441574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:43.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 0x7f234414ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344062a90 con 0x7f23441483a0 2021-10-20T23:21:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23441568e0 con 0x7f23440b1db0 2021-10-20T23:21:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440af0c0 con 0x7f23440a70c0 2021-10-20T23:21:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2349674700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 0x7f234414ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2349674700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 0x7f234414ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38432/0 (socket says 172.21.15.12:38432) 2021-10-20T23:21:43.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2349674700 1 -- 172.21.15.12:0/1434052498 learned_addr learned my addr 172.21.15.12:0/1434052498 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:43.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2348e73700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 0x7f234415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:43.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2343fff700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23440b1db0 0x7f23441574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:43.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2349674700 1 -- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 msgr2=0x7f234415a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:43.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2349674700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 0x7f234415a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2349674700 1 -- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23440b1db0 msgr2=0x7f23441574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:43.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2349674700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23440b1db0 0x7f23441574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:43.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2349674700 1 -- 172.21.15.12:0/1434052498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009530 con 0x7f23441483a0 2021-10-20T23:21:43.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2348e73700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 0x7f234415a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:43.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2349674700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 0x7f234414ae10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f232c00a000 tx=0x7f232c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:43.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2341ffb700 1 -- 172.21.15.12:0/1434052498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232c0106e0 con 0x7f23441483a0 2021-10-20T23:21:43.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2341ffb700 1 -- 172.21.15.12:0/1434052498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c010840 con 0x7f23441483a0 2021-10-20T23:21:43.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f2341ffb700 1 -- 172.21.15.12:0/1434052498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232c010ba0 con 0x7f23441483a0 2021-10-20T23:21:43.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2344156ad0 con 0x7f23441483a0 2021-10-20T23:21:43.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.245+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2344157010 con 0x7f23441483a0 2021-10-20T23:21:43.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.249+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23440b0b30 con 0x7f23441483a0 2021-10-20T23:21:43.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.249+0000 7f2341ffb700 1 -- 172.21.15.12:0/1434052498 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f232c01a030 con 0x7f23441483a0 2021-10-20T23:21:43.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.249+0000 7f2341ffb700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23280534f0 0x7f23280559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:43.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.249+0000 7f2341ffb700 1 -- 172.21.15.12:0/1434052498 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f232c06b4c0 con 0x7f23441483a0 2021-10-20T23:21:43.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.249+0000 7f2348e73700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23280534f0 0x7f23280559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:43.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.249+0000 7f2348e73700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23280534f0 0x7f23280559b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f233400c000 tx=0x7f2334008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:43.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.257+0000 7f2341ffb700 1 -- 172.21.15.12:0/1434052498 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f232c0426a0 con 0x7f23441483a0 2021-10-20T23:21:43.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:43.425+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f2344057350 con 0x7f23441483a0 2021-10-20T23:21:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.121+0000 7f2341ffb700 1 -- 172.21.15.12:0/1434052498 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v95) v1 ==== 147+0+0 (secure 0 0 0) 0x7f232c045cc0 con 0x7f23441483a0 2021-10-20T23:21:44.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23280534f0 msgr2=0x7f23280559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23280534f0 0x7f23280559b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f233400c000 tx=0x7f2334008040).stop 2021-10-20T23:21:44.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 msgr2=0x7f234414ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 0x7f234414ae10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f232c00a000 tx=0x7f232c008040).stop 2021-10-20T23:21:44.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 shutdown_connections 2021-10-20T23:21:44.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23280534f0 0x7f23280559b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23441483a0 0x7f234414ae10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23440b1db0 0x7f23441574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 --2- 172.21.15.12:0/1434052498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23440a70c0 0x7f234415a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 >> 172.21.15.12:0/1434052498 conn(0x7f234405f6b0 msgr2=0x7f2344143d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:44.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 shutdown_connections 2021-10-20T23:21:44.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.125+0000 7f234b0d7700 1 -- 172.21.15.12:0/1434052498 wait complete. 2021-10-20T23:21:44.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:21:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.245+0000 7f962d2f5700 1 Processor -- start 2021-10-20T23:21:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.245+0000 7f962d2f5700 1 -- start start 2021-10-20T23:21:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962d2f5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96280acf20 0x7f96280ad340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962d2f5700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96280b2c30 con 0x7f962813c6e0 2021-10-20T23:21:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962d2f5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96280b1660 con 0x7f96280b2850 2021-10-20T23:21:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962d2f5700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96280b11b0 con 0x7f96280acf20 2021-10-20T23:21:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962caf4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96280acf20 0x7f96280ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f96277fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f962813c6e0 0x7f962813cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37032/0 (socket says 172.21.15.12:37032) 2021-10-20T23:21:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f96277fe700 1 -- 172.21.15.12:0/4021773201 learned_addr learned my addr 172.21.15.12:0/4021773201 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f9626ffd700 1 -- 172.21.15.12:0/4021773201 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062039882 0 0) 0x7f96280b2c30 con 0x7f962813c6e0 2021-10-20T23:21:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f9626ffd700 1 -- 172.21.15.12:0/4021773201 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9608003260 con 0x7f962813c6e0 2021-10-20T23:21:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f9626ffd700 1 -- 172.21.15.12:0/4021773201 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047349767 0 0) 0x7f96280b1660 con 0x7f96280b2850 2021-10-20T23:21:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f9626ffd700 1 -- 172.21.15.12:0/4021773201 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96280b2c30 con 0x7f96280b2850 2021-10-20T23:21:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962caf4700 1 -- 172.21.15.12:0/4021773201 >> v1:172.21.15.31:6789/0 conn(0x7f96280b2850 legacy=0x7f96280b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962caf4700 1 -- 172.21.15.12:0/4021773201 >> v1:172.21.15.12:6789/0 conn(0x7f962813c6e0 legacy=0x7f962813cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962caf4700 1 -- 172.21.15.12:0/4021773201 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96280b1900 con 0x7f96280acf20 2021-10-20T23:21:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962caf4700 1 --2- 172.21.15.12:0/4021773201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 0x7f96280ad340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f96200032f0 tx=0x7f96200091d0).ready entity=mon.0 client_cookie=4b2308cfa5a40e26 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f9626ffd700 1 -- 172.21.15.12:0/4021773201 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f962000b600 con 0x7f96280acf20 2021-10-20T23:21:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f9626ffd700 1 -- 172.21.15.12:0/4021773201 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000b760 con 0x7f96280acf20 2021-10-20T23:21:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f9626ffd700 1 -- 172.21.15.12:0/4021773201 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f962000b8d0 con 0x7f96280acf20 2021-10-20T23:21:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962d2f5700 1 -- 172.21.15.12:0/4021773201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 msgr2=0x7f96280ad340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962d2f5700 1 --2- 172.21.15.12:0/4021773201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 0x7f96280ad340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f96200032f0 tx=0x7f96200091d0).stop 2021-10-20T23:21:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962d2f5700 1 -- 172.21.15.12:0/4021773201 shutdown_connections 2021-10-20T23:21:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.249+0000 7f962d2f5700 1 --2- 172.21.15.12:0/4021773201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 0x7f96280ad340 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.253+0000 7f962d2f5700 1 -- 172.21.15.12:0/4021773201 >> 172.21.15.12:0/4021773201 conn(0x7f9628061230 msgr2=0x7f9628062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.253+0000 7f962d2f5700 1 -- 172.21.15.12:0/4021773201 shutdown_connections 2021-10-20T23:21:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.253+0000 7f962d2f5700 1 -- 172.21.15.12:0/4021773201 wait complete. 2021-10-20T23:21:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.253+0000 7f962d2f5700 1 Processor -- start 2021-10-20T23:21:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.253+0000 7f962d2f5700 1 -- start start 2021-10-20T23:21:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f962d2f5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 0x7f96281516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f962d2f5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96280b2850 0x7f9628135ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f962d2f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f962813c6e0 0x7f9628136190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f962d2f5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9628152260 con 0x7f96280acf20 2021-10-20T23:21:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f962d2f5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9628151ff0 con 0x7f962813c6e0 2021-10-20T23:21:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f962d2f5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9628137b10 con 0x7f96280b2850 2021-10-20T23:21:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f9627fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 0x7f96281516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f9627fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 0x7f96281516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38442/0 (socket says 172.21.15.12:38442) 2021-10-20T23:21:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f9627fff700 1 -- 172.21.15.12:0/102473361 learned_addr learned my addr 172.21.15.12:0/102473361 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f962caf4700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f962813c6e0 0x7f9628136190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f96277fe700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96280b2850 0x7f9628135ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f9627fff700 1 -- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96280b2850 msgr2=0x7f9628135ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f9627fff700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96280b2850 0x7f9628135ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f9627fff700 1 -- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f962813c6e0 msgr2=0x7f9628136190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f9627fff700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f962813c6e0 0x7f9628136190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f9627fff700 1 -- 172.21.15.12:0/102473361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9620009470 con 0x7f96280acf20 2021-10-20T23:21:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f96277fe700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96280b2850 0x7f9628135ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f9627fff700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 0x7f96281516d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f9610001110 tx=0x7f9610007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f96257fa700 1 -- 172.21.15.12:0/102473361 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f961000ce50 con 0x7f96280acf20 2021-10-20T23:21:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f96257fa700 1 -- 172.21.15.12:0/102473361 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961000f470 con 0x7f96280acf20 2021-10-20T23:21:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9628137db0 con 0x7f96280acf20 2021-10-20T23:21:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f96257fa700 1 -- 172.21.15.12:0/102473361 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f961000f7d0 con 0x7f96280acf20 2021-10-20T23:21:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.257+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9628138050 con 0x7f96280acf20 2021-10-20T23:21:44.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.261+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9628151d60 con 0x7f96280acf20 2021-10-20T23:21:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.261+0000 7f96257fa700 1 -- 172.21.15.12:0/102473361 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9610019030 con 0x7f96280acf20 2021-10-20T23:21:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.261+0000 7f96257fa700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f960c0536a0 0x7f960c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.261+0000 7f96257fa700 1 -- 172.21.15.12:0/102473361 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f961006ac30 con 0x7f96280acf20 2021-10-20T23:21:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.261+0000 7f96277fe700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f960c0536a0 0x7f960c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.261+0000 7f96277fe700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f960c0536a0 0x7f960c055b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f961800b000 tx=0x7f9618009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:44.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.265+0000 7f96257fa700 1 -- 172.21.15.12:0/102473361 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9610041f10 con 0x7f96280acf20 2021-10-20T23:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.393+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9628057350 con 0x7f96280acf20 2021-10-20T23:21:44.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.401+0000 7f96257fa700 1 -- 172.21.15.12:0/102473361 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9610045530 con 0x7f96280acf20 2021-10-20T23:21:44.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f960c0536a0 msgr2=0x7f960c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f960c0536a0 0x7f960c055b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f961800b000 tx=0x7f9618009040).stop 2021-10-20T23:21:44.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 msgr2=0x7f96281516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 0x7f96281516d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f9610001110 tx=0x7f9610007ae0).stop 2021-10-20T23:21:44.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 shutdown_connections 2021-10-20T23:21:44.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f960c0536a0 0x7f960c055b60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f962813c6e0 0x7f9628136190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96280b2850 0x7f9628135ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 --2- 172.21.15.12:0/102473361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96280acf20 0x7f96281516d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 >> 172.21.15.12:0/102473361 conn(0x7f9628061230 msgr2=0x7f96280af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:44.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 shutdown_connections 2021-10-20T23:21:44.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.405+0000 7f962d2f5700 1 -- 172.21.15.12:0/102473361 wait complete. 2021-10-20T23:21:44.420 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:21:44.421 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:21:44.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:21:44.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:21:44.481 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:21:44.502 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:21:44.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:44.503 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:21:44.503 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:44.510 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:21:44.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:21:44.512 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:21:44.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:44.513 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:21:44.513 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:21:44.520 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:21:44.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:21:44.522 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:21:44.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:21:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 Processor -- start 2021-10-20T23:21:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 -- start start 2021-10-20T23:21:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 0x7fcf7414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf740b2af0 con 0x7fcf740b04a0 2021-10-20T23:21:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf740b2770 con 0x7fcf740aa120 2021-10-20T23:21:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740b2d20 con 0x7fcf740b0880 2021-10-20T23:21:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf79264700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcf740b04a0 0x7fcf740add30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37044/0 (socket says 172.21.15.12:37044) 2021-10-20T23:21:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf79264700 1 -- 172.21.15.12:0/2978354749 learned_addr learned my addr 172.21.15.12:0/2978354749 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf79a65700 1 --2- 172.21.15.12:0/2978354749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 0x7fcf7414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf63fff700 1 -- 172.21.15.12:0/2978354749 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240497225 0 0) 0x7fcf740b2af0 con 0x7fcf740b04a0 2021-10-20T23:21:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf63fff700 1 -- 172.21.15.12:0/2978354749 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf5c003260 con 0x7fcf740b04a0 2021-10-20T23:21:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf63fff700 1 -- 172.21.15.12:0/2978354749 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206380474 0 0) 0x7fcf740b2770 con 0x7fcf740aa120 2021-10-20T23:21:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf63fff700 1 -- 172.21.15.12:0/2978354749 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf740b2af0 con 0x7fcf740aa120 2021-10-20T23:21:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf79a65700 1 -- 172.21.15.12:0/2978354749 >> v1:172.21.15.31:6789/0 conn(0x7fcf740aa120 legacy=0x7fcf740ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf79a65700 1 -- 172.21.15.12:0/2978354749 >> v1:172.21.15.12:6789/0 conn(0x7fcf740b04a0 legacy=0x7fcf740add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf79a65700 1 -- 172.21.15.12:0/2978354749 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740a9b70 con 0x7fcf740b0880 2021-10-20T23:21:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf79a65700 1 --2- 172.21.15.12:0/2978354749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 0x7fcf7414ac60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcf740ad3d0 tx=0x7fcf6c006df0).ready entity=mon.2 client_cookie=5c3a1ef7e6a740e3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf63fff700 1 -- 172.21.15.12:0/2978354749 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf6c00d5c0 con 0x7fcf740b0880 2021-10-20T23:21:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf63fff700 1 -- 172.21.15.12:0/2978354749 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c000e90 con 0x7fcf740b0880 2021-10-20T23:21:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf63fff700 1 -- 172.21.15.12:0/2978354749 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf6c00d910 con 0x7fcf740b0880 2021-10-20T23:21:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2978354749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 msgr2=0x7fcf7414ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 --2- 172.21.15.12:0/2978354749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 0x7fcf7414ac60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcf740ad3d0 tx=0x7fcf6c006df0).stop 2021-10-20T23:21:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2978354749 shutdown_connections 2021-10-20T23:21:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 --2- 172.21.15.12:0/2978354749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 0x7fcf7414ac60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2978354749 >> 172.21.15.12:0/2978354749 conn(0x7fcf740607c0 msgr2=0x7fcf74060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2978354749 shutdown_connections 2021-10-20T23:21:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.637+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2978354749 wait complete. 2021-10-20T23:21:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf7b4c8700 1 Processor -- start 2021-10-20T23:21:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf7b4c8700 1 -- start start 2021-10-20T23:21:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf7b4c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740aa120 0x7fcf740ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf7b4c8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf740b04a0 0x7fcf74155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf7b4c8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 0x7fcf74144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf7b4c8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74066ea0 con 0x7fcf740b04a0 2021-10-20T23:21:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf7b4c8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74065d50 con 0x7fcf740aa120 2021-10-20T23:21:44.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf7b4c8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74144940 con 0x7fcf740b0880 2021-10-20T23:21:44.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf78a63700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf740b04a0 0x7fcf74155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf79a65700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 0x7fcf74144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf79264700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740aa120 0x7fcf740ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf78a63700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf740b04a0 0x7fcf74155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38456/0 (socket says 172.21.15.12:38456) 2021-10-20T23:21:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf78a63700 1 -- 172.21.15.12:0/2471276529 learned_addr learned my addr 172.21.15.12:0/2471276529 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf78a63700 1 -- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 msgr2=0x7fcf74144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf78a63700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 0x7fcf74144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf78a63700 1 -- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740aa120 msgr2=0x7fcf740ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf78a63700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740aa120 0x7fcf740ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf78a63700 1 -- 172.21.15.12:0/2471276529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c00b180 con 0x7fcf740b04a0 2021-10-20T23:21:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.641+0000 7fcf78a63700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf740b04a0 0x7fcf74155c70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fcf64001110 tx=0x7fcf64007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.645+0000 7fcf627fc700 1 -- 172.21.15.12:0/2471276529 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf64012400 con 0x7fcf740b04a0 2021-10-20T23:21:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.645+0000 7fcf627fc700 1 -- 172.21.15.12:0/2471276529 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf64012560 con 0x7fcf740b04a0 2021-10-20T23:21:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.645+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf74066840 con 0x7fcf740b04a0 2021-10-20T23:21:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.645+0000 7fcf627fc700 1 -- 172.21.15.12:0/2471276529 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf640128c0 con 0x7fcf740b04a0 2021-10-20T23:21:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.645+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74144610 con 0x7fcf740b04a0 2021-10-20T23:21:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.645+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf74057350 con 0x7fcf740b04a0 2021-10-20T23:21:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.645+0000 7fcf627fc700 1 -- 172.21.15.12:0/2471276529 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf64019030 con 0x7fcf740b04a0 2021-10-20T23:21:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.649+0000 7fcf627fc700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf54053640 0x7fcf54055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.649+0000 7fcf627fc700 1 -- 172.21.15.12:0/2471276529 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fcf6406abe0 con 0x7fcf740b04a0 2021-10-20T23:21:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.649+0000 7fcf79264700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf54053640 0x7fcf54055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.649+0000 7fcf79264700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf54053640 0x7fcf54055b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fcf7000d000 tx=0x7fcf70009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:44.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.653+0000 7fcf627fc700 1 -- 172.21.15.12:0/2471276529 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf64041ec0 con 0x7fcf740b04a0 2021-10-20T23:21:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.785+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcf74044650 con 0x7fcf740b04a0 2021-10-20T23:21:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf627fc700 1 -- 172.21.15.12:0/2471276529 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v39) v1 ==== 81+0+29217 (secure 0 0 0) 0x7fcf640454e0 con 0x7fcf740b04a0 2021-10-20T23:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 39, 2021-10-20T23:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:21:42.091305+0000", 2021-10-20T23:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 6, 2021-10-20T23:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:21:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:21:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:21:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:21:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:21:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:21:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:21:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:21:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:21:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:21:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:21:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:21:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:21:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:21:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:21:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:21:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:21:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:21:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:21:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:21:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:21:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:21:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:21:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:21:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:21:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:21:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:21:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:21:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:21:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:21:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:21:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:21:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:21:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:21:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:21:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:21:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:21:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 33, 2021-10-20T23:21:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:21:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:21:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:21:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:21:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.870 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:44.870 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.871 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:21:44.871 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:44.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.872 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:21:44.872 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:44.872 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.872 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.873 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:44.873 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.874 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:21:44.874 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:44.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.875 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:21:44.875 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:21:44.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.875 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.876 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:21:44.876 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:21:44.876 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:21:44.876 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:21:44.877 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:44.877 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:44.877 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:44.877 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.878 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:21:44.878 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:21:44.878 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:44.878 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:44.879 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:44.879 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:44.879 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:44.879 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:44.880 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:44.880 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:44.880 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:44.880 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:44.880 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:44.881 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.881 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:21:44.881 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:44.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.882 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:21:44.883 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:44.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.883 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.883 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:44.884 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.884 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:21:44.885 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:44.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.885 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:21:44.886 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:44.886 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.886 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.886 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:44.887 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.887 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:21:44.887 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:44.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.888 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:21:44.888 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:44.889 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.889 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.889 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:44.889 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.890 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:21:44.890 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:44.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.891 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:21:44.891 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:21:44.891 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.892 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.892 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:21:44.892 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:21:44.892 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:21:44.893 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:21:44.893 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:44.893 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:44.893 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:44.893 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.894 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:21:44.894 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:21:44.894 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:44.895 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:44.895 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:44.895 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:44.895 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:44.896 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:44.896 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:44.896 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:44.896 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:44.896 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:44.897 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:44.897 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.897 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:21:44.898 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:44.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.898 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.898 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:21:44.899 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:44.899 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.899 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.899 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:44.900 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.900 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:21:44.901 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:44.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.901 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:21:44.902 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:44.902 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.902 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.902 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:44.903 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.903 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.903 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:21:44.903 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:44.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.904 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:21:44.904 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:44.905 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.905 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.905 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:44.906 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.906 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:21:44.906 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:44.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.907 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:21:44.907 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:21:44.909 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:21:44.909 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:21:44.909 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:44.909 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:44.910 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:44.910 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.910 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:21:44.911 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:21:44.911 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:44.911 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:44.911 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:44.912 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:44.912 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:44.912 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:44.912 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:44.913 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:44.913 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:44.913 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:44.913 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:44.913 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.914 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:21:44.914 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:44.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.915 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:21:44.915 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:44.916 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.916 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.916 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:44.916 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.917 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:21:44.917 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:44.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.918 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:21:44.918 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:44.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.919 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.919 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:44.919 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.920 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:21:44.920 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:44.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.921 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:21:44.921 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:44.921 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.922 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.922 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:44.922 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.923 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:21:44.923 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:44.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.924 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:21:44.924 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:21:44.924 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.925 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.925 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:21:44.925 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:21:44.925 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:21:44.926 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:21:44.926 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:44.926 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:44.926 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:44.926 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.927 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:21:44.927 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:21:44.927 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:44.928 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:44.928 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:44.928 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:44.928 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:44.928 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:44.929 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:44.929 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 33, 2021-10-20T23:21:44.929 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:44.929 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:44.929 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:44.930 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.930 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:21:44.931 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:44.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:21:44.932 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:44.932 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.932 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.932 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:44.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:21:44.933 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:44.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:21:44.934 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:44.935 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.935 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.935 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:44.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:21:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:21:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:21:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:21:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:21:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:21:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:21:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:21:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:21:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:21:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:21:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:21:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:21:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:21:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:21:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:21:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:21:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:21:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 34, 2021-10-20T23:21:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:21:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:21:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:21:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:21:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:21:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:21:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:21:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:21:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:21:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:21:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:21:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:21:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:21:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:21:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:21:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:21:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:21:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:21:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:21:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:21:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:21:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:21:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:21:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:21:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:21:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:21:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:21:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:21:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:21:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:21:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:21:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:21:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:21:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:21:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:21:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:21:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:21:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:21:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:21:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:21:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:21:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:21:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:21:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:21:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:21:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:21:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:21:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:21:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:21:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:21:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:21:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:21:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6835/655661573": "2021-10-21T23:21:39.020993+0000", 2021-10-20T23:21:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6834/655661573": "2021-10-21T23:21:39.020993+0000" 2021-10-20T23:21:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:21:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:21:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:21:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:21:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:21:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:21:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:21:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:21:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:21:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:21:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:21:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:21:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:21:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:21:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:21:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:21:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:21:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:21:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:21:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:21:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:21:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:21:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:21:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:21:44.984 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:21:44.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf54053640 msgr2=0x7fcf54055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf54053640 0x7fcf54055b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fcf7000d000 tx=0x7fcf70009040).stop 2021-10-20T23:21:44.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf740b04a0 msgr2=0x7fcf74155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:44.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf740b04a0 0x7fcf74155c70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fcf64001110 tx=0x7fcf64007ab0).stop 2021-10-20T23:21:44.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 shutdown_connections 2021-10-20T23:21:44.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf54053640 0x7fcf54055b00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf740b0880 0x7fcf74144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf740b04a0 0x7fcf74155c70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 --2- 172.21.15.12:0/2471276529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740aa120 0x7fcf740ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:44.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 >> 172.21.15.12:0/2471276529 conn(0x7fcf740607c0 msgr2=0x7fcf74145f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:44.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 shutdown_connections 2021-10-20T23:21:44.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:44.789+0000 7fcf7b4c8700 1 -- 172.21.15.12:0/2471276529 wait complete. 2021-10-20T23:21:44.990 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:21:45.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.101+0000 7f2fe49f9700 1 Processor -- start 2021-10-20T23:21:45.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.101+0000 7f2fe49f9700 1 -- start start 2021-10-20T23:21:45.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.101+0000 7f2fe49f9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2fe00ac6f0 0x7f2fe0143580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.101+0000 7f2fe49f9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe0067880 con 0x7f2fe00b2580 2021-10-20T23:21:45.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.101+0000 7f2fe49f9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe0067b20 con 0x7f2fe00b00e0 2021-10-20T23:21:45.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.101+0000 7f2fe49f9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe00ad5b0 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.101+0000 7f2fded9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2fe00b2580 0x7f2fe0140050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37058/0 (socket says 172.21.15.12:37058) 2021-10-20T23:21:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.101+0000 7f2fded9d700 1 -- 172.21.15.12:0/1482261635 learned_addr learned my addr 172.21.15.12:0/1482261635 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.101+0000 7f2fdf59e700 1 --2- 172.21.15.12:0/1482261635 >> v2:172.21.15.31:3300/0 conn(0x7f2fe00ac6f0 0x7f2fe0143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fddd9b700 1 -- 172.21.15.12:0/1482261635 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045279681 0 0) 0x7f2fe0067880 con 0x7f2fe00b2580 2021-10-20T23:21:45.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fddd9b700 1 -- 172.21.15.12:0/1482261635 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc4003260 con 0x7f2fe00b2580 2021-10-20T23:21:45.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fddd9b700 1 -- 172.21.15.12:0/1482261635 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108627819 0 0) 0x7f2fe0067b20 con 0x7f2fe00b00e0 2021-10-20T23:21:45.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fddd9b700 1 -- 172.21.15.12:0/1482261635 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe0067880 con 0x7f2fe00b00e0 2021-10-20T23:21:45.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fddd9b700 1 -- 172.21.15.12:0/1482261635 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357745488 0 0) 0x7f2fc4003260 con 0x7f2fe00b2580 2021-10-20T23:21:45.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fdf59e700 1 -- 172.21.15.12:0/1482261635 >> v1:172.21.15.31:6789/0 conn(0x7f2fe00b00e0 legacy=0x7f2fe0142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fdf59e700 1 -- 172.21.15.12:0/1482261635 >> v1:172.21.15.12:6789/0 conn(0x7f2fe00b2580 legacy=0x7f2fe0140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fdf59e700 1 -- 172.21.15.12:0/1482261635 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0146fd0 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fdf59e700 1 --2- 172.21.15.12:0/1482261635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fe00ac6f0 0x7f2fe0143580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f2fd4001110 tx=0x7f2fd80091d0).ready entity=mon.1 client_cookie=2d8d304dea889292 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:45.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fddd9b700 1 -- 172.21.15.12:0/1482261635 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd4001660 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fddd9b700 1 -- 172.21.15.12:0/1482261635 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd800f510 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fddd9b700 1 -- 172.21.15.12:0/1482261635 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd800f680 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fe49f9700 1 -- 172.21.15.12:0/1482261635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fe00ac6f0 msgr2=0x7f2fe0143580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fe49f9700 1 --2- 172.21.15.12:0/1482261635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fe00ac6f0 0x7f2fe0143580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f2fd4001110 tx=0x7f2fd80091d0).stop 2021-10-20T23:21:45.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fe49f9700 1 -- 172.21.15.12:0/1482261635 shutdown_connections 2021-10-20T23:21:45.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fe49f9700 1 --2- 172.21.15.12:0/1482261635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fe00ac6f0 0x7f2fe0143580 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fe49f9700 1 -- 172.21.15.12:0/1482261635 >> 172.21.15.12:0/1482261635 conn(0x7f2fe0060180 msgr2=0x7f2fe00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:45.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fe49f9700 1 -- 172.21.15.12:0/1482261635 shutdown_connections 2021-10-20T23:21:45.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fe49f9700 1 -- 172.21.15.12:0/1482261635 wait complete. 2021-10-20T23:21:45.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fe49f9700 1 Processor -- start 2021-10-20T23:21:45.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.105+0000 7f2fe49f9700 1 -- start start 2021-10-20T23:21:45.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fe49f9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe00ac6f0 0x7f2fe0145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fe49f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fe00b00e0 0x7f2fe01523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fe49f9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fe00b2580 0x7f2fe00a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fe49f9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe01528a0 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fe49f9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe0152ac0 con 0x7f2fe00b00e0 2021-10-20T23:21:45.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fe49f9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe0152d60 con 0x7f2fe00b2580 2021-10-20T23:21:45.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fded9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe00ac6f0 0x7f2fe0145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fded9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe00ac6f0 0x7f2fe0145a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38470/0 (socket says 172.21.15.12:38470) 2021-10-20T23:21:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fded9d700 1 -- 172.21.15.12:0/4170958273 learned_addr learned my addr 172.21.15.12:0/4170958273 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fde59c700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fe00b00e0 0x7f2fe01523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fdf59e700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fe00b2580 0x7f2fe00a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fded9d700 1 -- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fe00b2580 msgr2=0x7f2fe00a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fded9d700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fe00b2580 0x7f2fe00a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fded9d700 1 -- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fe00b00e0 msgr2=0x7f2fe01523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fded9d700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fe00b00e0 0x7f2fe01523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fded9d700 1 -- 172.21.15.12:0/4170958273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8009470 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fded9d700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe00ac6f0 0x7f2fe0145a10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f2fd4000fe0 tx=0x7f2fd4001ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:45.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fcffff700 1 -- 172.21.15.12:0/4170958273 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd4007170 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe0153000 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fcffff700 1 -- 172.21.15.12:0/4170958273 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd40072d0 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fcffff700 1 -- 172.21.15.12:0/4170958273 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd4004920 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe009e8b0 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.109+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe00aa6a0 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.113+0000 7f2fcffff700 1 -- 172.21.15.12:0/4170958273 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2fd401b070 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.113+0000 7f2fcffff700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2fbc053640 0x7f2fbc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.113+0000 7f2fcffff700 1 -- 172.21.15.12:0/4170958273 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f2fd406afe0 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.113+0000 7f2fde59c700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2fbc053640 0x7f2fbc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.113+0000 7f2fde59c700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2fbc053640 0x7f2fbc055b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f2fd000d000 tx=0x7f2fd0007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.117+0000 7f2fcffff700 1 -- 172.21.15.12:0/4170958273 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2fd4042190 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.281+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fe0143a70 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fcffff700 1 -- 172.21.15.12:0/4170958273 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+1556 (secure 0 0 0) 0x7f2fd40457b0 con 0x7f2fe00ac6f0 2021-10-20T23:21:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:45.288 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4883,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/989782281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":989782281},{"type":"v1","addr":"172.21.15.12:6835","nonce":989782281}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[]} 2021-10-20T23:21:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2fbc053640 msgr2=0x7f2fbc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2fbc053640 0x7f2fbc055b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f2fd000d000 tx=0x7f2fd0007a20).stop 2021-10-20T23:21:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe00ac6f0 msgr2=0x7f2fe0145a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe00ac6f0 0x7f2fe0145a10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f2fd4000fe0 tx=0x7f2fd4001ac0).stop 2021-10-20T23:21:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 shutdown_connections 2021-10-20T23:21:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2fbc053640 0x7f2fbc055b00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fe00b2580 0x7f2fe00a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fe00b00e0 0x7f2fe01523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 --2- 172.21.15.12:0/4170958273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe00ac6f0 0x7f2fe0145a10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 >> 172.21.15.12:0/4170958273 conn(0x7f2fe0060180 msgr2=0x7f2fe00b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 shutdown_connections 2021-10-20T23:21:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.285+0000 7f2fe49f9700 1 -- 172.21.15.12:0/4170958273 wait complete. 2021-10-20T23:21:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2021-10-20T23:21:45.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:21:45.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.401+0000 7fe9c7fff700 1 Processor -- start 2021-10-20T23:21:45.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.401+0000 7fe9c7fff700 1 -- start start 2021-10-20T23:21:45.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.401+0000 7fe9c7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 0x7fe9c80afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.401+0000 7fe9c7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9c80b1790 0x7fe9c80b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.401+0000 7fe9c7fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c80b05b0 con 0x7fe9c80b2580 2021-10-20T23:21:45.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.401+0000 7fe9c7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c80add80 con 0x7fe9c80b1790 2021-10-20T23:21:45.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.401+0000 7fe9c7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80ae020 con 0x7fe9c80b1260 2021-10-20T23:21:45.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9c80b1790 0x7fe9c80b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9c80b1790 0x7fe9c80b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38482/0 (socket says 172.21.15.12:38482) 2021-10-20T23:21:45.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c77fe700 1 -- 172.21.15.12:0/3545489803 learned_addr learned my addr 172.21.15.12:0/3545489803 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:45.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9bffff700 1 --2- 172.21.15.12:0/3545489803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 0x7fe9c80afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c77fe700 1 -- 172.21.15.12:0/3545489803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 msgr2=0x7fe9c80afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:45.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c77fe700 1 --2- 172.21.15.12:0/3545489803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 0x7fe9c80afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c77fe700 1 -- 172.21.15.12:0/3545489803 >> v1:172.21.15.31:6789/0 conn(0x7fe9c80b2580 legacy=0x7fe9c80abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c77fe700 1 -- 172.21.15.12:0/3545489803 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c80a9390 con 0x7fe9c80b1790 2021-10-20T23:21:45.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c77fe700 1 --2- 172.21.15.12:0/3545489803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b1790 0x7fe9c80b00c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fe9c8067a30 tx=0x7fe9c0009290).ready entity=mon.0 client_cookie=70d750d2cc9b11fc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:45.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c67fc700 1 -- 172.21.15.12:0/3545489803 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c000b860 con 0x7fe9c80b1790 2021-10-20T23:21:45.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c67fc700 1 -- 172.21.15.12:0/3545489803 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c000b9c0 con 0x7fe9c80b1790 2021-10-20T23:21:45.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c67fc700 1 -- 172.21.15.12:0/3545489803 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c000bb30 con 0x7fe9c80b1790 2021-10-20T23:21:45.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3545489803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b1790 msgr2=0x7fe9c80b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c7fff700 1 --2- 172.21.15.12:0/3545489803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b1790 0x7fe9c80b00c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fe9c8067a30 tx=0x7fe9c0009290).stop 2021-10-20T23:21:45.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3545489803 shutdown_connections 2021-10-20T23:21:45.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c7fff700 1 --2- 172.21.15.12:0/3545489803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b1790 0x7fe9c80b00c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c7fff700 1 --2- 172.21.15.12:0/3545489803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 0x7fe9c80afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3545489803 >> 172.21.15.12:0/3545489803 conn(0x7fe9c8060180 msgr2=0x7fe9c80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:45.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3545489803 shutdown_connections 2021-10-20T23:21:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.405+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3545489803 wait complete. 2021-10-20T23:21:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c7fff700 1 Processor -- start 2021-10-20T23:21:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c7fff700 1 -- start start 2021-10-20T23:21:45.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 0x7fe9c809ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c80b1790 0x7fe9c814f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b2580 0x7fe9c814f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c809f610 con 0x7fe9c80b2580 2021-10-20T23:21:45.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8066b80 con 0x7fe9c80b1790 2021-10-20T23:21:45.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8067020 con 0x7fe9c80b1260 2021-10-20T23:21:45.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b2580 0x7fe9c814f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b2580 0x7fe9c814f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38488/0 (socket says 172.21.15.12:38488) 2021-10-20T23:21:45.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c77fe700 1 -- 172.21.15.12:0/3437992591 learned_addr learned my addr 172.21.15.12:0/3437992591 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:45.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9bffff700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c80b1790 0x7fe9c814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.409+0000 7fe9c6ffd700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 0x7fe9c809ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c77fe700 1 -- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 msgr2=0x7fe9c809ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c77fe700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 0x7fe9c809ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c77fe700 1 -- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c80b1790 msgr2=0x7fe9c814f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c77fe700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c80b1790 0x7fe9c814f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c77fe700 1 -- 172.21.15.12:0/3437992591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0009530 con 0x7fe9c80b2580 2021-10-20T23:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c6ffd700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 0x7fe9c809ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:21:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c77fe700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b2580 0x7fe9c814f640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fe9c8067a30 tx=0x7fe9c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c4ff9700 1 -- 172.21.15.12:0/3437992591 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c00032f0 con 0x7fe9c80b2580 2021-10-20T23:21:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c4ff9700 1 -- 172.21.15.12:0/3437992591 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c000bda0 con 0x7fe9c80b2580 2021-10-20T23:21:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c814fb30 con 0x7fe9c80b2580 2021-10-20T23:21:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c4ff9700 1 -- 172.21.15.12:0/3437992591 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c001e5f0 con 0x7fe9c80b2580 2021-10-20T23:21:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c8065290 con 0x7fe9c80b2580 2021-10-20T23:21:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c8066d40 con 0x7fe9c80b2580 2021-10-20T23:21:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c4ff9700 1 -- 172.21.15.12:0/3437992591 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9c000f070 con 0x7fe9c80b2580 2021-10-20T23:21:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c4ff9700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9ac0536a0 0x7fe9ac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c4ff9700 1 -- 172.21.15.12:0/3437992591 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe9c006f1e0 con 0x7fe9c80b2580 2021-10-20T23:21:45.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.413+0000 7fe9c6ffd700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9ac0536a0 0x7fe9ac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.417+0000 7fe9c6ffd700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9ac0536a0 0x7fe9ac055b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fe9b8008000 tx=0x7fe9b8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:45.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.417+0000 7fe9c4ff9700 1 -- 172.21.15.12:0/3437992591 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9c00464c0 con 0x7fe9c80b2580 2021-10-20T23:21:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.581+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9c8057350 con 0x7fe9c80b2580 2021-10-20T23:21:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.581+0000 7fe9c4ff9700 1 -- 172.21.15.12:0/3437992591 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+1556 (secure 0 0 0) 0x7fe9c0022090 con 0x7fe9c80b2580 2021-10-20T23:21:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:45.584 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4882,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2018242604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2018242604},{"type":"v1","addr":"172.21.15.31:6835","nonce":2018242604}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":4883,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/989782281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":989782281},{"type":"v1","addr":"172.21.15.12:6835","nonce":989782281}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/426437227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":426437227},{"type":"v1","addr":"172.21.15.12:6833","nonce":426437227}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[]} 2021-10-20T23:21:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9ac0536a0 msgr2=0x7fe9ac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9ac0536a0 0x7fe9ac055b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fe9b8008000 tx=0x7fe9b8009040).stop 2021-10-20T23:21:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b2580 msgr2=0x7fe9c814f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b2580 0x7fe9c814f640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fe9c8067a30 tx=0x7fe9c0016000).stop 2021-10-20T23:21:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 shutdown_connections 2021-10-20T23:21:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9ac0536a0 0x7fe9ac055b60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9c80b2580 0x7fe9c814f640 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c80b1790 0x7fe9c814f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 --2- 172.21.15.12:0/3437992591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c80b1260 0x7fe9c809ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 >> 172.21.15.12:0/3437992591 conn(0x7fe9c8060180 msgr2=0x7fe9c813e400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 shutdown_connections 2021-10-20T23:21:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.585+0000 7fe9c7fff700 1 -- 172.21.15.12:0/3437992591 wait complete. 2021-10-20T23:21:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2021-10-20T23:21:45.602 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:21:45.602 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:21:45.603 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:21:45.603 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:21:45.603 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:21:45.603 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:21:45.604 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:21:45.604 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:21:45.604 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:21:45.605 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:21:45.605 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:21:45.605 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:21:45.619 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:21:45.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:21:45.621 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:21:45.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:21:45.623 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:21:45.623 DEBUG:teuthology.parallel:result is None 2021-10-20T23:21:45.624 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:21:45.625 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:21:45.626 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:21:45.626 DEBUG:teuthology.parallel:result is None 2021-10-20T23:21:45.629 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:21:45.629 DEBUG:teuthology.parallel:result is None 2021-10-20T23:21:45.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:21:45.686 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:21:45.688 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:21:45.706 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:21:45.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 Processor -- start 2021-10-20T23:21:45.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 -- start start 2021-10-20T23:21:45.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f99680b1db0 0x7f99680b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99681483a0 0x7f99680b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99680a70c0 0x7f9968144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99680a90c0 con 0x7f99680b1db0 2021-10-20T23:21:45.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99680b0350 con 0x7f99680a70c0 2021-10-20T23:21:45.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680b05f0 con 0x7f99681483a0 2021-10-20T23:21:45.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9967fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f99680b1db0 0x7f99680b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9967fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f99680b1db0 0x7f99680b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38522/0 (socket says 172.21.15.12:38522) 2021-10-20T23:21:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9967fff700 1 -- 172.21.15.12:0/2799379616 learned_addr learned my addr 172.21.15.12:0/2799379616 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996c944700 1 --2- 172.21.15.12:0/2799379616 >> v2:172.21.15.31:3300/0 conn(0x7f99680a70c0 0x7f9968144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f99677fe700 1 --2- 172.21.15.12:0/2799379616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99681483a0 0x7f99680b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9967fff700 1 -- 172.21.15.12:0/2799379616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99681483a0 msgr2=0x7f99680b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:45.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9967fff700 1 --2- 172.21.15.12:0/2799379616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99681483a0 0x7f99680b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9967fff700 1 -- 172.21.15.12:0/2799379616 >> v2:172.21.15.31:3300/0 conn(0x7f99680a70c0 msgr2=0x7f9968144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:45.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9967fff700 1 --2- 172.21.15.12:0/2799379616 >> v2:172.21.15.31:3300/0 conn(0x7f99680a70c0 0x7f9968144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9967fff700 1 -- 172.21.15.12:0/2799379616 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680b0890 con 0x7f99680b1db0 2021-10-20T23:21:45.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9967fff700 1 --2- 172.21.15.12:0/2799379616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99680b1db0 0x7f99680b0fd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f99600032f0 tx=0x7f9960009290).ready entity=mon.0 client_cookie=22e908b6d6d28f5c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:45.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9966ffd700 1 -- 172.21.15.12:0/2799379616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f996000b680 con 0x7f99680b1db0 2021-10-20T23:21:45.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9966ffd700 1 -- 172.21.15.12:0/2799379616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996000b7e0 con 0x7f99680b1db0 2021-10-20T23:21:45.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f9966ffd700 1 -- 172.21.15.12:0/2799379616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f996000b950 con 0x7f99680b1db0 2021-10-20T23:21:45.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 -- 172.21.15.12:0/2799379616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99680b1db0 msgr2=0x7f99680b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2799379616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99680b1db0 0x7f99680b0fd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f99600032f0 tx=0x7f9960009290).stop 2021-10-20T23:21:45.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 -- 172.21.15.12:0/2799379616 shutdown_connections 2021-10-20T23:21:45.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2799379616 >> v2:172.21.15.31:3300/0 conn(0x7f99680a70c0 0x7f9968144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2799379616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99681483a0 0x7f99680b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2799379616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99680b1db0 0x7f99680b0fd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 -- 172.21.15.12:0/2799379616 >> 172.21.15.12:0/2799379616 conn(0x7f996805f6b0 msgr2=0x7f996805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:45.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 -- 172.21.15.12:0/2799379616 shutdown_connections 2021-10-20T23:21:45.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.737+0000 7f996e3a7700 1 -- 172.21.15.12:0/2799379616 wait complete. 2021-10-20T23:21:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 Processor -- start 2021-10-20T23:21:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 -- start start 2021-10-20T23:21:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99680a70c0 0x7f99680aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99680b1db0 0x7f99680ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99681483a0 0x7f996814b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9968149ec0 con 0x7f99681483a0 2021-10-20T23:21:45.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996814baf0 con 0x7f99680b1db0 2021-10-20T23:21:45.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996814a0f0 con 0x7f99680a70c0 2021-10-20T23:21:45.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996c944700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99681483a0 0x7f996814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f9967fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99680a70c0 0x7f99680aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996c944700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99681483a0 0x7f996814b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38532/0 (socket says 172.21.15.12:38532) 2021-10-20T23:21:45.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f9967fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99680a70c0 0x7f99680aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:44286/0 (socket says 172.21.15.12:44286) 2021-10-20T23:21:45.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996c944700 1 -- 172.21.15.12:0/2491631785 learned_addr learned my addr 172.21.15.12:0/2491631785 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:45.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f99677fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99680b1db0 0x7f99680ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996c944700 1 -- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99680a70c0 msgr2=0x7f99680aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996c944700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99680a70c0 0x7f99680aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996c944700 1 -- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99680b1db0 msgr2=0x7f99680ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:45.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996c944700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99680b1db0 0x7f99680ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:45.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996c944700 1 -- 172.21.15.12:0/2491631785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960009530 con 0x7f99681483a0 2021-10-20T23:21:45.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996c944700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99681483a0 0x7f996814b600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f995800c000 tx=0x7f9958006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:45.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f99657fa700 1 -- 172.21.15.12:0/2491631785 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9958010780 con 0x7f99681483a0 2021-10-20T23:21:45.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f99657fa700 1 -- 172.21.15.12:0/2491631785 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99580108e0 con 0x7f99681483a0 2021-10-20T23:21:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996814a390 con 0x7f99681483a0 2021-10-20T23:21:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f99657fa700 1 -- 172.21.15.12:0/2491631785 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9958010c40 con 0x7f99681483a0 2021-10-20T23:21:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.741+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996814ab80 con 0x7f99681483a0 2021-10-20T23:21:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.745+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99680b0b30 con 0x7f99681483a0 2021-10-20T23:21:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.745+0000 7f99657fa700 1 -- 172.21.15.12:0/2491631785 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f99580123f0 con 0x7f99681483a0 2021-10-20T23:21:45.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.745+0000 7f99657fa700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f994c0534f0 0x7f994c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:45.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.745+0000 7f99657fa700 1 -- 172.21.15.12:0/2491631785 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f995806bd70 con 0x7f99681483a0 2021-10-20T23:21:45.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.745+0000 7f9967fff700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f994c0534f0 0x7f994c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:45.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.745+0000 7f9967fff700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f994c0534f0 0x7f994c0559b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f996001a000 tx=0x7f9960017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:45.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.749+0000 7f99657fa700 1 -- 172.21.15.12:0/2491631785 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9958042e60 con 0x7f99681483a0 2021-10-20T23:21:45.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:45.889+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9968057350 con 0x7f99681483a0 2021-10-20T23:21:46.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.737+0000 7f99657fa700 1 -- 172.21.15.12:0/2491631785 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9958046480 con 0x7f99681483a0 2021-10-20T23:21:46.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.737+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f994c0534f0 msgr2=0x7f994c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.737+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f994c0534f0 0x7f994c0559b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f996001a000 tx=0x7f9960017000).stop 2021-10-20T23:21:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.737+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99681483a0 msgr2=0x7f996814b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.737+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99681483a0 0x7f996814b600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f995800c000 tx=0x7f9958006df0).stop 2021-10-20T23:21:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.741+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 shutdown_connections 2021-10-20T23:21:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.741+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f994c0534f0 0x7f994c0559b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.741+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99681483a0 0x7f996814b600 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.741+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99680b1db0 0x7f99680ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.741+0000 7f996e3a7700 1 --2- 172.21.15.12:0/2491631785 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99680a70c0 0x7f99680aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.741+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 >> 172.21.15.12:0/2491631785 conn(0x7f996805f6b0 msgr2=0x7f99680b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.741+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 shutdown_connections 2021-10-20T23:21:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.741+0000 7f996e3a7700 1 -- 172.21.15.12:0/2491631785 wait complete. 2021-10-20T23:21:46.744 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:21:46.756 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:21:46.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:21:46.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f0174ebd700 1 Processor -- start 2021-10-20T23:21:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f0174ebd700 1 -- start start 2021-10-20T23:21:46.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f0174ebd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0170060100 0x7f01700b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:46.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f0174ebd700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01700aabb0 con 0x7f01700b4c40 2021-10-20T23:21:46.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f0174ebd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01700604e0 con 0x7f0170067300 2021-10-20T23:21:46.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f0174ebd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0170066ea0 con 0x7f0170060100 2021-10-20T23:21:46.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016ed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f01700b4c40 0x7f017014b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37136/0 (socket says 172.21.15.12:37136) 2021-10-20T23:21:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016ed9d700 1 -- 172.21.15.12:0/564548118 learned_addr learned my addr 172.21.15.12:0/564548118 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016e59c700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0170060100 0x7f01700b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142615921 0 0) 0x7f01700aabb0 con 0x7f01700b4c40 2021-10-20T23:21:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0154003260 con 0x7f01700b4c40 2021-10-20T23:21:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4015551752 0 0) 0x7f0154003260 con 0x7f01700b4c40 2021-10-20T23:21:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0170060100 msgr2=0x7f01700b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0170060100 0x7f01700b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 >> v1:172.21.15.31:6789/0 conn(0x7f0170067300 legacy=0x7f01701438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700b33b0 con 0x7f01700b4c40 2021-10-20T23:21:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f0160001660 con 0x7f01700b4c40 2021-10-20T23:21:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 >> v1:172.21.15.12:6789/0 conn(0x7f01700b4c40 legacy=0x7f017014b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0154003780 0x7f0154003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f0154004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0170060100 0x7f0154004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170066ea0 con 0x7f0154004500 2021-10-20T23:21:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015400b780 con 0x7f0154003780 2021-10-20T23:21:46.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015400b940 con 0x7f0170060100 2021-10-20T23:21:46.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016dd9b700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f0154004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:46.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016ed9d700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0170060100 0x7f0154004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:46.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.869+0000 7f016e59c700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0154003780 0x7f0154003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:46.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016dd9b700 1 -- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0170060100 msgr2=0x7f0154004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:46.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016dd9b700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0170060100 0x7f0154004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:46.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016dd9b700 1 -- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0154003780 msgr2=0x7f0154003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:46.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016dd9b700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0154003780 0x7f0154003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016dd9b700 1 -- 172.21.15.12:0/564548118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0154003260 con 0x7f0154004500 2021-10-20T23:21:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016dd9b700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f0154004980 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f0170067720 tx=0x7f0164007a00).ready entity=mon.0 client_cookie=b5c1b436a9390487 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0164007d10 con 0x7f0154004500 2021-10-20T23:21:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0164007030 con 0x7f0154004500 2021-10-20T23:21:46.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016d59a700 1 -- 172.21.15.12:0/564548118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0164007390 con 0x7f0154004500 2021-10-20T23:21:46.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f0174ebd700 1 -- 172.21.15.12:0/564548118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 msgr2=0x7f0154004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:46.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f0174ebd700 1 --2- 172.21.15.12:0/564548118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f0154004980 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f0170067720 tx=0x7f0164007a00).stop 2021-10-20T23:21:46.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f016ed9d700 1 -- 172.21.15.12:0/564548118 reap_dead start 2021-10-20T23:21:46.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f0174ebd700 1 -- 172.21.15.12:0/564548118 shutdown_connections 2021-10-20T23:21:46.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f0174ebd700 1 -- 172.21.15.12:0/564548118 >> 172.21.15.12:0/564548118 conn(0x7f017005cf30 msgr2=0x7f017005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:46.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f0174ebd700 1 -- 172.21.15.12:0/564548118 shutdown_connections 2021-10-20T23:21:46.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.873+0000 7f0174ebd700 1 -- 172.21.15.12:0/564548118 wait complete. 2021-10-20T23:21:46.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f0174ebd700 1 Processor -- start 2021-10-20T23:21:46.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f0174ebd700 1 -- start start 2021-10-20T23:21:46.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f0174ebd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f01700b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:46.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f0174ebd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01700a9ef0 0x7f01700aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:46.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f0174ebd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0170150350 0x7f01701507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:46.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f0174ebd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01700aa860 con 0x7f0154004500 2021-10-20T23:21:46.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f0174ebd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01700af8d0 con 0x7f0170150350 2021-10-20T23:21:46.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f0174ebd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01700ae470 con 0x7f01700a9ef0 2021-10-20T23:21:46.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f01700b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:46.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f01700b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38552/0 (socket says 172.21.15.12:38552) 2021-10-20T23:21:46.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016e59c700 1 -- 172.21.15.12:0/1461002035 learned_addr learned my addr 172.21.15.12:0/1461002035 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:46.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016dd9b700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01700a9ef0 0x7f01700aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:46.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016ed9d700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0170150350 0x7f01701507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:46.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016e59c700 1 -- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01700a9ef0 msgr2=0x7f01700aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:46.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016e59c700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01700a9ef0 0x7f01700aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:46.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016e59c700 1 -- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0170150350 msgr2=0x7f01701507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:46.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016e59c700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0170150350 0x7f01701507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:46.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016e59c700 1 -- 172.21.15.12:0/1461002035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700afb00 con 0x7f0154004500 2021-10-20T23:21:46.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016dd9b700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01700a9ef0 0x7f01700aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:46.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f016e59c700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f01700b02f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f01700afda0 tx=0x7f01680091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:46.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f015f7fe700 1 -- 172.21.15.12:0/1461002035 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0168011e50 con 0x7f0154004500 2021-10-20T23:21:46.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.877+0000 7f015f7fe700 1 -- 172.21.15.12:0/1461002035 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800fcd0 con 0x7f0154004500 2021-10-20T23:21:46.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.881+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01700ae6d0 con 0x7f0154004500 2021-10-20T23:21:46.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.881+0000 7f015f7fe700 1 -- 172.21.15.12:0/1461002035 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f016800fe40 con 0x7f0154004500 2021-10-20T23:21:46.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.881+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0170145000 con 0x7f0154004500 2021-10-20T23:21:46.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.881+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01700ae860 con 0x7f0154004500 2021-10-20T23:21:46.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.881+0000 7f015f7fe700 1 -- 172.21.15.12:0/1461002035 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0168024070 con 0x7f0154004500 2021-10-20T23:21:46.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.881+0000 7f015f7fe700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f014c0536d0 0x7f014c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:46.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.881+0000 7f015f7fe700 1 -- 172.21.15.12:0/1461002035 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f016806c5d0 con 0x7f0154004500 2021-10-20T23:21:46.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.881+0000 7f016dd9b700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f014c0536d0 0x7f014c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:46.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.881+0000 7f016dd9b700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f014c0536d0 0x7f014c055b90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f0164019000 tx=0x7f0164015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:46.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:46.889+0000 7f015f7fe700 1 -- 172.21.15.12:0/1461002035 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0168043910 con 0x7f0154004500 2021-10-20T23:21:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.061+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0170057350 con 0x7f0154004500 2021-10-20T23:21:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.061+0000 7f015f7fe700 1 -- 172.21.15.12:0/1461002035 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f0168046f30 con 0x7f0154004500 2021-10-20T23:21:47.064 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:47.064 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:21:47.064 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:21:47.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.065 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:21:47.065 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:21:47.065 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.065 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:21:47.066 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.066 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.066 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.066 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.067 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:21:47.067 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:21:47.067 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.068 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:21:47.068 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.068 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.068 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.069 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:21:47.069 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:21:47.069 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.070 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:21:47.070 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.070 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.070 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.071 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.071 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:21:47.072 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:21:47.072 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.072 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.072 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.072 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.073 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.073 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:21:47.074 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:21:47.074 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.074 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.074 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.074 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.075 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.075 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:21:47.076 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:21:47.076 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.076 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.076 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.076 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.077 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.077 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:21:47.077 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:21:47.078 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.078 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.078 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.078 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:21:47.079 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:21:47.080 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.080 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.080 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.080 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.081 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.081 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:21:47.081 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:21:47.082 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.082 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.082 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.082 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:21:47.083 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:21:47.084 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.084 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.084 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.084 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:21:47.085 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:21:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.087 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:21:47.087 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:21:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:21:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:21:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:21:47.088 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.089 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:21:47.089 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:21:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:21:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:21:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:21:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:21:47.091 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:21:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:21:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:21:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:21:47.092 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:21:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:21:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:21:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:21:47.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.095 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:47.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:47.095 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:21:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:21:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:21:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:21:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:21:47.096 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:21:47.097 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.097 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:47.097 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:21:47.097 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:21:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f014c0536d0 msgr2=0x7f014c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f014c0536d0 0x7f014c055b90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f0164019000 tx=0x7f0164015000).stop 2021-10-20T23:21:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 msgr2=0x7f01700b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f01700b02f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f01700afda0 tx=0x7f01680091d0).stop 2021-10-20T23:21:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 shutdown_connections 2021-10-20T23:21:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f014c0536d0 0x7f014c055b90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0170150350 0x7f01701507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01700a9ef0 0x7f01700aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 --2- 172.21.15.12:0/1461002035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0154004500 0x7f01700b02f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 >> 172.21.15.12:0/1461002035 conn(0x7f017005cf30 msgr2=0x7f0170064870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 shutdown_connections 2021-10-20T23:21:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.065+0000 7f0174ebd700 1 -- 172.21.15.12:0/1461002035 wait complete. 2021-10-20T23:21:47.102 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:21:47.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.205+0000 7fb93b3d2700 1 Processor -- start 2021-10-20T23:21:47.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.205+0000 7fb93b3d2700 1 -- start start 2021-10-20T23:21:47.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 0x7fb93413e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9340b0ff0 0x7fb93413e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9340aaa90 con 0x7fb934141080 2021-10-20T23:21:47.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb934141c20 con 0x7fb9340b0ff0 2021-10-20T23:21:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb934140c90 con 0x7fb9340b2720 2021-10-20T23:21:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb939bcf700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9340b0ff0 0x7fb93413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb939bcf700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9340b0ff0 0x7fb93413e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38560/0 (socket says 172.21.15.12:38560) 2021-10-20T23:21:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb939bcf700 1 -- 172.21.15.12:0/4126604400 learned_addr learned my addr 172.21.15.12:0/4126604400 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:47.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93a3d0700 1 --2- 172.21.15.12:0/4126604400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 0x7fb93413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb939bcf700 1 -- 172.21.15.12:0/4126604400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 msgr2=0x7fb93413e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:47.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb939bcf700 1 --2- 172.21.15.12:0/4126604400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 0x7fb93413e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb939bcf700 1 -- 172.21.15.12:0/4126604400 >> v1:172.21.15.31:6789/0 conn(0x7fb934141080 legacy=0x7fb934141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb939bcf700 1 -- 172.21.15.12:0/4126604400 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340b2b00 con 0x7fb9340b0ff0 2021-10-20T23:21:47.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb939bcf700 1 --2- 172.21.15.12:0/4126604400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 0x7fb93413e520 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb930002f70 tx=0x7fb930006eb0).ready entity=mon.0 client_cookie=1eb81bc9177399c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:47.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb9393ce700 1 -- 172.21.15.12:0/4126604400 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93000d5c0 con 0x7fb9340b0ff0 2021-10-20T23:21:47.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb9393ce700 1 -- 172.21.15.12:0/4126604400 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb930000e90 con 0x7fb9340b0ff0 2021-10-20T23:21:47.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb9393ce700 1 -- 172.21.15.12:0/4126604400 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93000d950 con 0x7fb9340b0ff0 2021-10-20T23:21:47.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 -- 172.21.15.12:0/4126604400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 msgr2=0x7fb93413e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 --2- 172.21.15.12:0/4126604400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 0x7fb93413e520 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb930002f70 tx=0x7fb930006eb0).stop 2021-10-20T23:21:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 -- 172.21.15.12:0/4126604400 shutdown_connections 2021-10-20T23:21:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 --2- 172.21.15.12:0/4126604400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 0x7fb93413e520 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 --2- 172.21.15.12:0/4126604400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 0x7fb93413e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 -- 172.21.15.12:0/4126604400 >> 172.21.15.12:0/4126604400 conn(0x7fb934060180 msgr2=0x7fb9340b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:47.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 -- 172.21.15.12:0/4126604400 shutdown_connections 2021-10-20T23:21:47.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.209+0000 7fb93b3d2700 1 -- 172.21.15.12:0/4126604400 wait complete. 2021-10-20T23:21:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 Processor -- start 2021-10-20T23:21:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 -- start start 2021-10-20T23:21:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 0x7fb9340b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 0x7fb9340b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb934141080 0x7fb9340b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb934144340 con 0x7fb9340b0ff0 2021-10-20T23:21:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9341445e0 con 0x7fb934141080 2021-10-20T23:21:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb934144880 con 0x7fb9340b2720 2021-10-20T23:21:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93a3d0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 0x7fb9340b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93a3d0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 0x7fb9340b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38568/0 (socket says 172.21.15.12:38568) 2021-10-20T23:21:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93a3d0700 1 -- 172.21.15.12:0/2504347987 learned_addr learned my addr 172.21.15.12:0/2504347987 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:47.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb939bcf700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 0x7fb9340b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93abd1700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb934141080 0x7fb9340b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93a3d0700 1 -- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 msgr2=0x7fb9340b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93a3d0700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 0x7fb9340b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93a3d0700 1 -- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb934141080 msgr2=0x7fb9340b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93a3d0700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb934141080 0x7fb9340b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93a3d0700 1 -- 172.21.15.12:0/2504347987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93000b1e0 con 0x7fb9340b0ff0 2021-10-20T23:21:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93abd1700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb934141080 0x7fb9340b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93a3d0700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 0x7fb9340b4b20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fb9240030b0 tx=0x7fb924008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb9237fe700 1 -- 172.21.15.12:0/2504347987 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb924011780 con 0x7fb9340b0ff0 2021-10-20T23:21:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb9237fe700 1 -- 172.21.15.12:0/2504347987 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9240118e0 con 0x7fb9340b0ff0 2021-10-20T23:21:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb9237fe700 1 -- 172.21.15.12:0/2504347987 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb924011c40 con 0x7fb9340b0ff0 2021-10-20T23:21:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb934143fc0 con 0x7fb9340b0ff0 2021-10-20T23:21:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.213+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb934144cc0 con 0x7fb9340b0ff0 2021-10-20T23:21:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.217+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb934144a40 con 0x7fb9340b0ff0 2021-10-20T23:21:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.217+0000 7fb9237fe700 1 -- 172.21.15.12:0/2504347987 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb924012420 con 0x7fb9340b0ff0 2021-10-20T23:21:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.217+0000 7fb9237fe700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb914053580 0x7fb914055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.217+0000 7fb9237fe700 1 -- 172.21.15.12:0/2504347987 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fb92406b5c0 con 0x7fb9340b0ff0 2021-10-20T23:21:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.217+0000 7fb939bcf700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb914053580 0x7fb914055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.217+0000 7fb939bcf700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb914053580 0x7fb914055a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb93001c000 tx=0x7fb930015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:47.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.225+0000 7fb9237fe700 1 -- 172.21.15.12:0/2504347987 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb9240428a0 con 0x7fb9340b0ff0 2021-10-20T23:21:47.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.349+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb934057350 con 0x7fb9340b0ff0 2021-10-20T23:21:47.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb9237fe700 1 -- 172.21.15.12:0/2504347987 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13414 (secure 0 0 0) 0x7fb924045ec0 con 0x7fb9340b0ff0 2021-10-20T23:21:47.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:47.355 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":43,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:21:46.723657+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:21:47.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb914053580 msgr2=0x7fb914055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb914053580 0x7fb914055a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb93001c000 tx=0x7fb930015000).stop 2021-10-20T23:21:47.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 msgr2=0x7fb9340b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 0x7fb9340b4b20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fb9240030b0 tx=0x7fb924008040).stop 2021-10-20T23:21:47.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 shutdown_connections 2021-10-20T23:21:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb914053580 0x7fb914055a40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb934141080 0x7fb9340b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9340b2720 0x7fb9340b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 --2- 172.21.15.12:0/2504347987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9340b0ff0 0x7fb9340b4b20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 >> 172.21.15.12:0/2504347987 conn(0x7fb934060180 msgr2=0x7fb934140440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:47.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 shutdown_connections 2021-10-20T23:21:47.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.353+0000 7fb93b3d2700 1 -- 172.21.15.12:0/2504347987 wait complete. 2021-10-20T23:21:47.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:21:47.368 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:21:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.477+0000 7f58a5325700 1 Processor -- start 2021-10-20T23:21:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.477+0000 7f58a5325700 1 -- start start 2021-10-20T23:21:47.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58a00b6290 0x7f58a0061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 0x7f58a0061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a00b5f50 con 0x7f58a0061e50 2021-10-20T23:21:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a00b1f70 con 0x7f58a00b6290 2021-10-20T23:21:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00b2210 con 0x7f58a00b4060 2021-10-20T23:21:47.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58a00b6290 0x7f58a0061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f5897fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 0x7f58a0061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a4b24700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f58a0061e50 0x7f58a0146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:44236/0 (socket says 172.21.15.12:44236) 2021-10-20T23:21:47.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a4b24700 1 -- 172.21.15.12:0/660975976 learned_addr learned my addr 172.21.15.12:0/660975976 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:47.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589ffff700 1 -- 172.21.15.12:0/660975976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 msgr2=0x7f58a0061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589ffff700 1 --2- 172.21.15.12:0/660975976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 0x7f58a0061960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589ffff700 1 -- 172.21.15.12:0/660975976 >> v1:172.21.15.31:6789/0 conn(0x7f58a0061e50 legacy=0x7f58a0146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589ffff700 1 -- 172.21.15.12:0/660975976 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00b24b0 con 0x7f58a00b6290 2021-10-20T23:21:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589f7fe700 1 -- 172.21.15.12:0/660975976 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432075225 0 0) 0x7f5898001490 con 0x7f58a0061e50 2021-10-20T23:21:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f5897fff700 1 --2- 172.21.15.12:0/660975976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 0x7f58a0061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:47.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589ffff700 1 --2- 172.21.15.12:0/660975976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 0x7f58a0061470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f5890002f70 tx=0x7f5890006df0).ready entity=mon.1 client_cookie=9afa473e5ecffe14 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:47.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589f7fe700 1 -- 172.21.15.12:0/660975976 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589000d570 con 0x7f58a00b6290 2021-10-20T23:21:47.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589f7fe700 1 -- 172.21.15.12:0/660975976 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890000e90 con 0x7f58a00b6290 2021-10-20T23:21:47.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f589f7fe700 1 -- 172.21.15.12:0/660975976 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589000d8c0 con 0x7f58a00b6290 2021-10-20T23:21:47.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 -- 172.21.15.12:0/660975976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 msgr2=0x7f58a0061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 --2- 172.21.15.12:0/660975976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 0x7f58a0061470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f5890002f70 tx=0x7f5890006df0).stop 2021-10-20T23:21:47.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 -- 172.21.15.12:0/660975976 shutdown_connections 2021-10-20T23:21:47.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 --2- 172.21.15.12:0/660975976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 0x7f58a0061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 --2- 172.21.15.12:0/660975976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 0x7f58a0061470 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 -- 172.21.15.12:0/660975976 >> 172.21.15.12:0/660975976 conn(0x7f58a005c490 msgr2=0x7f58a005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:47.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 -- 172.21.15.12:0/660975976 shutdown_connections 2021-10-20T23:21:47.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.481+0000 7f58a5325700 1 -- 172.21.15.12:0/660975976 wait complete. 2021-10-20T23:21:47.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a5325700 1 Processor -- start 2021-10-20T23:21:47.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a5325700 1 -- start start 2021-10-20T23:21:47.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a5325700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58a0061e50 0x7f58a00ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a5325700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 0x7f58a013eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a5325700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 0x7f58a0145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a5325700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00af0e0 con 0x7f58a0061e50 2021-10-20T23:21:47.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a5325700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a013f6a0 con 0x7f58a00b6290 2021-10-20T23:21:47.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a5325700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a013f3c0 con 0x7f58a00b4060 2021-10-20T23:21:47.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f589ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58a0061e50 0x7f58a00ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f589ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58a0061e50 0x7f58a00ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38580/0 (socket says 172.21.15.12:38580) 2021-10-20T23:21:47.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f589ffff700 1 -- 172.21.15.12:0/1725198566 learned_addr learned my addr 172.21.15.12:0/1725198566 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:47.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a4b24700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 0x7f58a0145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f5897fff700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 0x7f58a013eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f589ffff700 1 -- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 msgr2=0x7f58a013eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f589ffff700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 0x7f58a013eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f589ffff700 1 -- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 msgr2=0x7f58a0145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f589ffff700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 0x7f58a0145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f589ffff700 1 -- 172.21.15.12:0/1725198566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588800b180 con 0x7f58a0061e50 2021-10-20T23:21:47.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.485+0000 7f58a4b24700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 0x7f58a0145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:47.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f589ffff700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58a0061e50 0x7f58a00ae020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f5890002f70 tx=0x7f5890014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:47.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f589dffb700 1 -- 172.21.15.12:0/1725198566 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589000dea0 con 0x7f58a0061e50 2021-10-20T23:21:47.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f589dffb700 1 -- 172.21.15.12:0/1725198566 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890013de0 con 0x7f58a0061e50 2021-10-20T23:21:47.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589000b180 con 0x7f58a0061e50 2021-10-20T23:21:47.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f589dffb700 1 -- 172.21.15.12:0/1725198566 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589001e5f0 con 0x7f58a0061e50 2021-10-20T23:21:47.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a01400b0 con 0x7f58a0061e50 2021-10-20T23:21:47.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a00b2750 con 0x7f58a0061e50 2021-10-20T23:21:47.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f589dffb700 1 -- 172.21.15.12:0/1725198566 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5890025030 con 0x7f58a0061e50 2021-10-20T23:21:47.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f589dffb700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5884053610 0x7f5884055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f589dffb700 1 -- 172.21.15.12:0/1725198566 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f589006c640 con 0x7f58a0061e50 2021-10-20T23:21:47.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.489+0000 7f5897fff700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5884053610 0x7f5884055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.493+0000 7f5897fff700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5884053610 0x7f5884055ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f588800b000 tx=0x7f5888006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:47.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.493+0000 7f589dffb700 1 -- 172.21.15.12:0/1725198566 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5890043870 con 0x7f58a0061e50 2021-10-20T23:21:47.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f58a0057350 con 0x7f58a0061e50 2021-10-20T23:21:47.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f589dffb700 1 -- 172.21.15.12:0/1725198566 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v43) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5890046e90 con 0x7f58a0061e50 2021-10-20T23:21:47.622 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:21:47.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5884053610 msgr2=0x7f5884055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5884053610 0x7f5884055ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f588800b000 tx=0x7f5888006df0).stop 2021-10-20T23:21:47.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58a0061e50 msgr2=0x7f58a00ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58a0061e50 0x7f58a00ae020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f5890002f70 tx=0x7f5890014000).stop 2021-10-20T23:21:47.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 shutdown_connections 2021-10-20T23:21:47.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5884053610 0x7f5884055ad0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a00b6290 0x7f58a0145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58a00b4060 0x7f58a013eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 --2- 172.21.15.12:0/1725198566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58a0061e50 0x7f58a00ae020 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 >> 172.21.15.12:0/1725198566 conn(0x7f58a005c490 msgr2=0x7f58a00b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:47.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 shutdown_connections 2021-10-20T23:21:47.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.620+0000 7f58a5325700 1 -- 172.21.15.12:0/1725198566 wait complete. 2021-10-20T23:21:47.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:21:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fab59e700 1 Processor -- start 2021-10-20T23:21:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fab59e700 1 -- start start 2021-10-20T23:21:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fab59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7fac0b2720 0x7f7fac13e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fab59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 0x7f7fac13e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fab59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0aaa90 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fab59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac140c90 con 0x7f7fac0b2720 2021-10-20T23:21:47.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fab59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0b2b00 con 0x7f7fac141790 2021-10-20T23:21:47.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fa9d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7fac0b0ff0 0x7f7fac141080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37182/0 (socket says 172.21.15.12:37182) 2021-10-20T23:21:47.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fa9d9b700 1 -- 172.21.15.12:0/903110637 learned_addr learned my addr 172.21.15.12:0/903110637 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:47.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7faa59c700 1 --2- 172.21.15.12:0/903110637 >> v2:172.21.15.12:3300/0 conn(0x7f7fac0b2720 0x7f7fac13e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7faad9d700 1 --2- 172.21.15.12:0/903110637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 0x7f7fac13e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fa959a700 1 -- 172.21.15.12:0/903110637 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268331966 0 0) 0x7f7f9c001110 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7fa959a700 1 -- 172.21.15.12:0/903110637 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f90003260 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7faa59c700 1 -- 172.21.15.12:0/903110637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 msgr2=0x7f7fac13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7faa59c700 1 --2- 172.21.15.12:0/903110637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 0x7f7fac13e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7faa59c700 1 -- 172.21.15.12:0/903110637 >> v1:172.21.15.12:6789/0 conn(0x7f7fac0b0ff0 legacy=0x7f7fac141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.744+0000 7f7faa59c700 1 -- 172.21.15.12:0/903110637 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0aa2b0 con 0x7f7fac0b2720 2021-10-20T23:21:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7faa59c700 1 --2- 172.21.15.12:0/903110637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 0x7f7fac13e030 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f7fa0002f70 tx=0x7f7fa0006df0).ready entity=mon.0 client_cookie=53e85dd4292ff7f2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fa959a700 1 -- 172.21.15.12:0/903110637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa000d4a0 con 0x7f7fac0b2720 2021-10-20T23:21:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fa959a700 1 -- 172.21.15.12:0/903110637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0000e90 con 0x7f7fac0b2720 2021-10-20T23:21:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fa959a700 1 -- 172.21.15.12:0/903110637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa000d7f0 con 0x7f7fac0b2720 2021-10-20T23:21:47.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fab59e700 1 -- 172.21.15.12:0/903110637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 msgr2=0x7f7fac13e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fab59e700 1 --2- 172.21.15.12:0/903110637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 0x7f7fac13e030 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f7fa0002f70 tx=0x7f7fa0006df0).stop 2021-10-20T23:21:47.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fab59e700 1 -- 172.21.15.12:0/903110637 shutdown_connections 2021-10-20T23:21:47.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fab59e700 1 --2- 172.21.15.12:0/903110637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 0x7f7fac13e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fab59e700 1 --2- 172.21.15.12:0/903110637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 0x7f7fac13e030 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fab59e700 1 -- 172.21.15.12:0/903110637 >> 172.21.15.12:0/903110637 conn(0x7f7fac060180 msgr2=0x7f7fac0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:47.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fab59e700 1 -- 172.21.15.12:0/903110637 shutdown_connections 2021-10-20T23:21:47.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fab59e700 1 -- 172.21.15.12:0/903110637 wait complete. 2021-10-20T23:21:47.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.748+0000 7f7fab59e700 1 Processor -- start 2021-10-20T23:21:47.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 -- start start 2021-10-20T23:21:47.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac0b0ff0 0x7f7fac154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 0x7f7fac1423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 0x7f7fac142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0b48a0 con 0x7f7fac0b2720 2021-10-20T23:21:47.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac153650 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac1538f0 con 0x7f7fac141790 2021-10-20T23:21:47.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fa9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 0x7f7fac1423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fa9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 0x7f7fac1423d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38596/0 (socket says 172.21.15.12:38596) 2021-10-20T23:21:47.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fa9d9b700 1 -- 172.21.15.12:0/1103950192 learned_addr learned my addr 172.21.15.12:0/1103950192 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:47.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7faa59c700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac0b0ff0 0x7f7fac154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7faad9d700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 0x7f7fac142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7faa59c700 1 -- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 msgr2=0x7f7fac142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7faa59c700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 0x7f7fac142a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7faa59c700 1 -- 172.21.15.12:0/1103950192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 msgr2=0x7f7fac1423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7faa59c700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 0x7f7fac1423d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7faa59c700 1 -- 172.21.15.12:0/1103950192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa000b180 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fa9d9b700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 0x7f7fac1423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:47.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7faa59c700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac0b0ff0 0x7f7fac154030 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f7fa0002f70 tx=0x7f7fa0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:47.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7f9b7fe700 1 -- 172.21.15.12:0/1103950192 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa0012930 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7f9b7fe700 1 -- 172.21.15.12:0/1103950192 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0012a90 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac153b90 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7f9b7fe700 1 -- 172.21.15.12:0/1103950192 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa0012df0 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac063dc0 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.752+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac153d20 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.756+0000 7f7f9b7fe700 1 -- 172.21.15.12:0/1103950192 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7fa001c070 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.756+0000 7f7f9b7fe700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7f880535b0 0x7f7f88055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:47.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.756+0000 7f7f9b7fe700 1 -- 172.21.15.12:0/1103950192 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f7fa006c5e0 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.756+0000 7f7fa9d9b700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7f880535b0 0x7f7f88055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:47.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.756+0000 7f7fa9d9b700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7f880535b0 0x7f7f88055a70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7f9c00d000 tx=0x7f7f9c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:47.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.764+0000 7f7f9b7fe700 1 -- 172.21.15.12:0/1103950192 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7fa0043810 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.892+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7fac057350 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.892+0000 7f7f9b7fe700 1 -- 172.21.15.12:0/1103950192 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7fa0019020 con 0x7f7fac0b0ff0 2021-10-20T23:21:47.896 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:21:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7f880535b0 msgr2=0x7f7f88055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7f880535b0 0x7f7f88055a70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7f9c00d000 tx=0x7f7f9c009040).stop 2021-10-20T23:21:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac0b0ff0 msgr2=0x7f7fac154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac0b0ff0 0x7f7fac154030 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f7fa0002f70 tx=0x7f7fa0014000).stop 2021-10-20T23:21:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 shutdown_connections 2021-10-20T23:21:47.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7f880535b0 0x7f7f88055a70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac141790 0x7f7fac142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac0b2720 0x7f7fac1423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 --2- 172.21.15.12:0/1103950192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac0b0ff0 0x7f7fac154030 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:47.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 >> 172.21.15.12:0/1103950192 conn(0x7f7fac060180 msgr2=0x7f7fac0b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:47.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 shutdown_connections 2021-10-20T23:21:47.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:47.896+0000 7f7fab59e700 1 -- 172.21.15.12:0/1103950192 wait complete. 2021-10-20T23:21:47.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:21:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 Processor -- start 2021-10-20T23:21:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 -- start start 2021-10-20T23:21:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82500b3740 0x7f82500607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8250060cb0 0x7f8250061120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82500604e0 con 0x7f8250060100 2021-10-20T23:21:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8250065aa0 con 0x7f82500b3740 2021-10-20T23:21:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8250065d40 con 0x7f8250060cb0 2021-10-20T23:21:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82500b3740 0x7f82500607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82500b3740 0x7f82500607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38604/0 (socket says 172.21.15.12:38604) 2021-10-20T23:21:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824effd700 1 -- 172.21.15.12:0/2112816427 learned_addr learned my addr 172.21.15.12:0/2112816427 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824ffff700 1 --2- 172.21.15.12:0/2112816427 >> v2:172.21.15.31:3300/0 conn(0x7f8250060cb0 0x7f8250061120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824effd700 1 -- 172.21.15.12:0/2112816427 >> v2:172.21.15.31:3300/0 conn(0x7f8250060cb0 msgr2=0x7f8250061120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824effd700 1 --2- 172.21.15.12:0/2112816427 >> v2:172.21.15.31:3300/0 conn(0x7f8250060cb0 0x7f8250061120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824effd700 1 -- 172.21.15.12:0/2112816427 >> v1:172.21.15.31:6789/0 conn(0x7f8250060100 legacy=0x7f8250066480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824effd700 1 -- 172.21.15.12:0/2112816427 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250065fe0 con 0x7f82500b3740 2021-10-20T23:21:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824effd700 1 --2- 172.21.15.12:0/2112816427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 0x7f82500607c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f8238002f70 tx=0x7f8238006eb0).ready entity=mon.0 client_cookie=c37bb283ce1e3d84 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824e7fc700 1 -- 172.21.15.12:0/2112816427 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f823800d610 con 0x7f82500b3740 2021-10-20T23:21:48.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824e7fc700 1 -- 172.21.15.12:0/2112816427 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8238000e90 con 0x7f82500b3740 2021-10-20T23:21:48.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f824e7fc700 1 -- 172.21.15.12:0/2112816427 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f823800d9a0 con 0x7f82500b3740 2021-10-20T23:21:48.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 -- 172.21.15.12:0/2112816427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 msgr2=0x7f82500607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 --2- 172.21.15.12:0/2112816427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 0x7f82500607c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f8238002f70 tx=0x7f8238006eb0).stop 2021-10-20T23:21:48.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 -- 172.21.15.12:0/2112816427 shutdown_connections 2021-10-20T23:21:48.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 --2- 172.21.15.12:0/2112816427 >> v2:172.21.15.31:3300/0 conn(0x7f8250060cb0 0x7f8250061120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 --2- 172.21.15.12:0/2112816427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 0x7f82500607c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 -- 172.21.15.12:0/2112816427 >> 172.21.15.12:0/2112816427 conn(0x7f825005cf30 msgr2=0x7f825005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:48.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 -- 172.21.15.12:0/2112816427 shutdown_connections 2021-10-20T23:21:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.008+0000 7f82560db700 1 -- 172.21.15.12:0/2112816427 wait complete. 2021-10-20T23:21:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.012+0000 7f82560db700 1 Processor -- start 2021-10-20T23:21:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.012+0000 7f82560db700 1 -- start start 2021-10-20T23:21:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.012+0000 7f82560db700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8250060100 0x7f8250157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.012+0000 7f82560db700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8250060cb0 0x7f82500ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.012+0000 7f82560db700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 0x7f82500ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f82560db700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825009e920 con 0x7f82500b3740 2021-10-20T23:21:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f82560db700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82500ad970 con 0x7f8250060100 2021-10-20T23:21:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f82560db700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82500acdb0 con 0x7f8250060cb0 2021-10-20T23:21:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 0x7f82500ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8250060100 0x7f8250157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 0x7f82500ab900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38612/0 (socket says 172.21.15.12:38612) 2021-10-20T23:21:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824ffff700 1 -- 172.21.15.12:0/3234627241 learned_addr learned my addr 172.21.15.12:0/3234627241 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824effd700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8250060cb0 0x7f82500ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824ffff700 1 -- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8250060cb0 msgr2=0x7f82500ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824ffff700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8250060cb0 0x7f82500ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824ffff700 1 -- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8250060100 msgr2=0x7f8250157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824ffff700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8250060100 0x7f8250157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824ffff700 1 -- 172.21.15.12:0/3234627241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823800b1e0 con 0x7f82500b3740 2021-10-20T23:21:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824f7fe700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8250060100 0x7f8250157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824ffff700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 0x7f82500ab900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f8250157820 tx=0x7f8248008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824cff9700 1 -- 172.21.15.12:0/3234627241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8248013620 con 0x7f82500b3740 2021-10-20T23:21:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824cff9700 1 -- 172.21.15.12:0/3234627241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248013780 con 0x7f82500b3740 2021-10-20T23:21:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824cff9700 1 -- 172.21.15.12:0/3234627241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8248013ae0 con 0x7f82500b3740 2021-10-20T23:21:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82500adba0 con 0x7f82500b3740 2021-10-20T23:21:48.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82500ad1e0 con 0x7f82500b3740 2021-10-20T23:21:48.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8250057350 con 0x7f82500b3740 2021-10-20T23:21:48.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.016+0000 7f824cff9700 1 -- 172.21.15.12:0/3234627241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8248013c40 con 0x7f82500b3740 2021-10-20T23:21:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.020+0000 7f824cff9700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f82340536a0 0x7f8234055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.020+0000 7f824cff9700 1 -- 172.21.15.12:0/3234627241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f824806b790 con 0x7f82500b3740 2021-10-20T23:21:48.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.020+0000 7f824f7fe700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f82340536a0 0x7f8234055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.020+0000 7f824f7fe700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f82340536a0 0x7f8234055b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f824000d000 tx=0x7f8240007b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.028+0000 7f824cff9700 1 -- 172.21.15.12:0/3234627241 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8248042a70 con 0x7f82500b3740 2021-10-20T23:21:48.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.156+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f82500acef0 con 0x7f82500b3740 2021-10-20T23:21:48.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f824cff9700 1 -- 172.21.15.12:0/3234627241 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+143 (secure 0 0 0) 0x7f8248046090 con 0x7f82500b3740 2021-10-20T23:21:48.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:48.163 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:21:48.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:48.163 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:21:48.163 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:21:48.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:21:48.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:21:48.164 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:21:48.164 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:21:48.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:21:48.167 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:21:48.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f82340536a0 msgr2=0x7f8234055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f82340536a0 0x7f8234055b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f824000d000 tx=0x7f8240007b50).stop 2021-10-20T23:21:48.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 msgr2=0x7f82500ab900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 0x7f82500ab900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f8250157820 tx=0x7f8248008040).stop 2021-10-20T23:21:48.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 shutdown_connections 2021-10-20T23:21:48.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f82340536a0 0x7f8234055b60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82500b3740 0x7f82500ab900 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8250060cb0 0x7f82500ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 --2- 172.21.15.12:0/3234627241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8250060100 0x7f8250157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 >> 172.21.15.12:0/3234627241 conn(0x7f825005cf30 msgr2=0x7f82500663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:48.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 shutdown_connections 2021-10-20T23:21:48.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.160+0000 7f82560db700 1 -- 172.21.15.12:0/3234627241 wait complete. 2021-10-20T23:21:48.182 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:21:48.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:21:48.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f9500dfd700 1 Processor -- start 2021-10-20T23:21:48.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f9500dfd700 1 -- start start 2021-10-20T23:21:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f9500dfd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f94fc0b6560 0x7f94fc0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f9500dfd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc0b5990 0x7f94fc0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f9500dfd700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94fc143f60 con 0x7f94fc05fc00 2021-10-20T23:21:48.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f9500dfd700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94fc0ba6b0 con 0x7f94fc0b6560 2021-10-20T23:21:48.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f9500dfd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc05ffe0 con 0x7f94fc0b5990 2021-10-20T23:21:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94fa59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f94fc05fc00 0x7f94fc0b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37210/0 (socket says 172.21.15.12:37210) 2021-10-20T23:21:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f9d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f94fc0b6560 0x7f94fc0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94fa59c700 1 -- 172.21.15.12:0/3487230638 learned_addr learned my addr 172.21.15.12:0/3487230638 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94fad9d700 1 --2- 172.21.15.12:0/3487230638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc0b5990 0x7f94fc0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f959a700 1 -- 172.21.15.12:0/3487230638 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756553633 0 0) 0x7f94fc143f60 con 0x7f94fc05fc00 2021-10-20T23:21:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f959a700 1 -- 172.21.15.12:0/3487230638 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e0003260 con 0x7f94fc05fc00 2021-10-20T23:21:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f9d9b700 1 -- 172.21.15.12:0/3487230638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc0b5990 msgr2=0x7f94fc0b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f9d9b700 1 --2- 172.21.15.12:0/3487230638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc0b5990 0x7f94fc0b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f9d9b700 1 -- 172.21.15.12:0/3487230638 >> v1:172.21.15.12:6789/0 conn(0x7f94fc05fc00 legacy=0x7f94fc0b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f9d9b700 1 -- 172.21.15.12:0/3487230638 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc143a50 con 0x7f94fc0b6560 2021-10-20T23:21:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f9d9b700 1 --2- 172.21.15.12:0/3487230638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 0x7f94fc0b41b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f94f0002f70 tx=0x7f94f0006df0).ready entity=mon.0 client_cookie=1afb75d479fc2a41 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f959a700 1 -- 172.21.15.12:0/3487230638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94f000d4a0 con 0x7f94fc0b6560 2021-10-20T23:21:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f959a700 1 -- 172.21.15.12:0/3487230638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f0000e90 con 0x7f94fc0b6560 2021-10-20T23:21:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.288+0000 7f94f959a700 1 -- 172.21.15.12:0/3487230638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94f000d7f0 con 0x7f94fc0b6560 2021-10-20T23:21:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 -- 172.21.15.12:0/3487230638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 msgr2=0x7f94fc0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 --2- 172.21.15.12:0/3487230638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 0x7f94fc0b41b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f94f0002f70 tx=0x7f94f0006df0).stop 2021-10-20T23:21:48.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 -- 172.21.15.12:0/3487230638 shutdown_connections 2021-10-20T23:21:48.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 --2- 172.21.15.12:0/3487230638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc0b5990 0x7f94fc0b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 --2- 172.21.15.12:0/3487230638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 0x7f94fc0b41b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 -- 172.21.15.12:0/3487230638 >> 172.21.15.12:0/3487230638 conn(0x7f94fc0623a0 msgr2=0x7f94fc066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:48.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 -- 172.21.15.12:0/3487230638 shutdown_connections 2021-10-20T23:21:48.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 -- 172.21.15.12:0/3487230638 wait complete. 2021-10-20T23:21:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 Processor -- start 2021-10-20T23:21:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.292+0000 7f9500dfd700 1 -- start start 2021-10-20T23:21:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f9500dfd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc05fc00 0x7f94fc0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f9500dfd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94fc0b5990 0x7f94fc149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f9500dfd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 0x7f94fc146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f9500dfd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc146f40 con 0x7f94fc0b6560 2021-10-20T23:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f9500dfd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1471e0 con 0x7f94fc0b5990 2021-10-20T23:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f9500dfd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc0b0210 con 0x7f94fc05fc00 2021-10-20T23:21:48.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 0x7f94fc146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fa59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc05fc00 0x7f94fc0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 0x7f94fc146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38626/0 (socket says 172.21.15.12:38626) 2021-10-20T23:21:48.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fad9d700 1 -- 172.21.15.12:0/1036639199 learned_addr learned my addr 172.21.15.12:0/1036639199 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:48.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94f9d9b700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94fc0b5990 0x7f94fc149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fad9d700 1 -- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc05fc00 msgr2=0x7f94fc0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fad9d700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc05fc00 0x7f94fc0aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fad9d700 1 -- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94fc0b5990 msgr2=0x7f94fc149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fad9d700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94fc0b5990 0x7f94fc149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fad9d700 1 -- 172.21.15.12:0/1036639199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f000b180 con 0x7f94fc0b6560 2021-10-20T23:21:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94fad9d700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 0x7f94fc146380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f94f4006e00 tx=0x7f94f40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94eb7fe700 1 -- 172.21.15.12:0/1036639199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94f400c640 con 0x7f94fc0b6560 2021-10-20T23:21:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94eb7fe700 1 -- 172.21.15.12:0/1036639199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f400c7a0 con 0x7f94fc0b6560 2021-10-20T23:21:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc0b04b0 con 0x7f94fc0b6560 2021-10-20T23:21:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f94eb7fe700 1 -- 172.21.15.12:0/1036639199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94f400cb00 con 0x7f94fc0b6560 2021-10-20T23:21:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.296+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc12d130 con 0x7f94fc0b6560 2021-10-20T23:21:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.300+0000 7f94eb7fe700 1 -- 172.21.15.12:0/1036639199 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f94f400cc60 con 0x7f94fc0b6560 2021-10-20T23:21:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.300+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc0b0640 con 0x7f94fc0b6560 2021-10-20T23:21:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.300+0000 7f94eb7fe700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94d8053520 0x7f94d80559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.300+0000 7f94eb7fe700 1 -- 172.21.15.12:0/1036639199 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f94f406b9c0 con 0x7f94fc0b6560 2021-10-20T23:21:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.300+0000 7f94fa59c700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94d8053520 0x7f94d80559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.300+0000 7f94fa59c700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94d8053520 0x7f94d80559e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f94ec00d000 tx=0x7f94ec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.304+0000 7f94eb7fe700 1 -- 172.21.15.12:0/1036639199 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f94f4042c80 con 0x7f94fc0b6560 2021-10-20T23:21:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:48.432+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f94fc143cc0 con 0x7f94fc0b6560 2021-10-20T23:21:49.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.160+0000 7f94eb7fe700 1 -- 172.21.15.12:0/1036639199 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v44) v1 ==== 133+0+0 (secure 0 0 0) 0x7f94f40462a0 con 0x7f94fc0b6560 2021-10-20T23:21:49.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94d8053520 msgr2=0x7f94d80559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:49.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94d8053520 0x7f94d80559e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f94ec00d000 tx=0x7f94ec009040).stop 2021-10-20T23:21:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 msgr2=0x7f94fc146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 0x7f94fc146380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f94f4006e00 tx=0x7f94f40091d0).stop 2021-10-20T23:21:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 shutdown_connections 2021-10-20T23:21:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94d8053520 0x7f94d80559e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:49.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94fc0b6560 0x7f94fc146380 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:49.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94fc0b5990 0x7f94fc149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:49.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 --2- 172.21.15.12:0/1036639199 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94fc05fc00 0x7f94fc0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:49.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 >> 172.21.15.12:0/1036639199 conn(0x7f94fc0623a0 msgr2=0x7f94fc0b8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:49.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 shutdown_connections 2021-10-20T23:21:49.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.168+0000 7f9500dfd700 1 -- 172.21.15.12:0/1036639199 wait complete. 2021-10-20T23:21:49.173 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:21:49.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:21:49.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c02e54700 1 Processor -- start 2021-10-20T23:21:49.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c02e54700 1 -- start start 2021-10-20T23:21:49.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c02e54700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc0acb70 0x7f7bfc0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:49.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c02e54700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7bfc140ba0 0x7f7bfc0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:49.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c02e54700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bfc0ac7c0 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c02e54700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bfc0ac020 con 0x7f7bfc140ba0 2021-10-20T23:21:49.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c02e54700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc141010 con 0x7f7bfc0acb70 2021-10-20T23:21:49.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c00bf0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7bfc0b10c0 0x7f7bfc13d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37224/0 (socket says 172.21.15.12:37224) 2021-10-20T23:21:49.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c00bf0700 1 -- 172.21.15.12:0/1464225421 learned_addr learned my addr 172.21.15.12:0/1464225421 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:49.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7bfbfff700 1 --2- 172.21.15.12:0/1464225421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc0acb70 0x7f7bfc0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:49.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.300+0000 7f7c013f1700 1 --2- 172.21.15.12:0/1464225421 >> v2:172.21.15.31:3300/0 conn(0x7f7bfc140ba0 0x7f7bfc0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:49.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7bfb7fe700 1 -- 172.21.15.12:0/1464225421 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285061890 0 0) 0x7f7bfc0ac7c0 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7bfb7fe700 1 -- 172.21.15.12:0/1464225421 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be0003260 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c013f1700 1 -- 172.21.15.12:0/1464225421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc0acb70 msgr2=0x7f7bfc0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c013f1700 1 --2- 172.21.15.12:0/1464225421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc0acb70 0x7f7bfc0b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c013f1700 1 -- 172.21.15.12:0/1464225421 >> v1:172.21.15.12:6789/0 conn(0x7f7bfc0b10c0 legacy=0x7f7bfc13d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c013f1700 1 -- 172.21.15.12:0/1464225421 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc0ac280 con 0x7f7bfc140ba0 2021-10-20T23:21:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c013f1700 1 --2- 172.21.15.12:0/1464225421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bfc140ba0 0x7f7bfc0b24e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f7bf40032f0 tx=0x7f7bf40091d0).ready entity=mon.1 client_cookie=7c4f73a49726a474 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:49.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7bfb7fe700 1 -- 172.21.15.12:0/1464225421 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf400b600 con 0x7f7bfc140ba0 2021-10-20T23:21:49.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7bfb7fe700 1 -- 172.21.15.12:0/1464225421 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf400b760 con 0x7f7bfc140ba0 2021-10-20T23:21:49.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7bfb7fe700 1 -- 172.21.15.12:0/1464225421 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf400b8d0 con 0x7f7bfc140ba0 2021-10-20T23:21:49.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 -- 172.21.15.12:0/1464225421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bfc140ba0 msgr2=0x7f7bfc0b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:49.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 --2- 172.21.15.12:0/1464225421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bfc140ba0 0x7f7bfc0b24e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f7bf40032f0 tx=0x7f7bf40091d0).stop 2021-10-20T23:21:49.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 -- 172.21.15.12:0/1464225421 shutdown_connections 2021-10-20T23:21:49.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 --2- 172.21.15.12:0/1464225421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bfc140ba0 0x7f7bfc0b24e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:49.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 --2- 172.21.15.12:0/1464225421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc0acb70 0x7f7bfc0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:49.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 -- 172.21.15.12:0/1464225421 >> 172.21.15.12:0/1464225421 conn(0x7f7bfc05f6b0 msgr2=0x7f7bfc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 -- 172.21.15.12:0/1464225421 shutdown_connections 2021-10-20T23:21:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 -- 172.21.15.12:0/1464225421 wait complete. 2021-10-20T23:21:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 Processor -- start 2021-10-20T23:21:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.304+0000 7f7c02e54700 1 -- start start 2021-10-20T23:21:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c02e54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bfc0acb70 0x7f7bfc0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:49.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c02e54700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bfc0b10c0 0x7f7bfc067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:49.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c02e54700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc140ba0 0x7f7bfc0b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:49.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c02e54700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc0b6270 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c02e54700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc063130 con 0x7f7bfc0acb70 2021-10-20T23:21:49.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c02e54700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc0b3ed0 con 0x7f7bfc140ba0 2021-10-20T23:21:49.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bfbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bfc0b10c0 0x7f7bfc067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:49.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bfbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bfc0b10c0 0x7f7bfc067460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38638/0 (socket says 172.21.15.12:38638) 2021-10-20T23:21:49.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bfbfff700 1 -- 172.21.15.12:0/3199004456 learned_addr learned my addr 172.21.15.12:0/3199004456 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:49.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c00bf0700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bfc0acb70 0x7f7bfc0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c013f1700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc140ba0 0x7f7bfc0b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bfbfff700 1 -- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc140ba0 msgr2=0x7f7bfc0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bfbfff700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc140ba0 0x7f7bfc0b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bfbfff700 1 -- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bfc0acb70 msgr2=0x7f7bfc0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bfbfff700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bfc0acb70 0x7f7bfc0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:49.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bfbfff700 1 -- 172.21.15.12:0/3199004456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4009470 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bfbfff700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bfc0b10c0 0x7f7bfc067460 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f7be800c000 tx=0x7f7be8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:49.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bf9ffb700 1 -- 172.21.15.12:0/3199004456 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be8010780 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bf9ffb700 1 -- 172.21.15.12:0/3199004456 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be80108e0 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bfc0b33b0 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7bf9ffb700 1 -- 172.21.15.12:0/3199004456 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be8010c40 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.308+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bfc1311b0 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.312+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bfc0b40d0 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.312+0000 7f7bf9ffb700 1 -- 172.21.15.12:0/3199004456 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7be801c460 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.312+0000 7f7bf9ffb700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7bdc0534f0 0x7f7bdc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:49.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.312+0000 7f7bf9ffb700 1 -- 172.21.15.12:0/3199004456 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f7be806bdc0 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.312+0000 7f7c00bf0700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7bdc0534f0 0x7f7bdc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:49.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.312+0000 7f7c00bf0700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7bdc0534f0 0x7f7bdc0559b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f7bf000d000 tx=0x7f7bf0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:49.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.316+0000 7f7bf9ffb700 1 -- 172.21.15.12:0/3199004456 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7be8042e90 con 0x7f7bfc0b10c0 2021-10-20T23:21:49.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:49.444+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7bfc0ac520 con 0x7f7bfc0b10c0 2021-10-20T23:21:50.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.172+0000 7f7bf9ffb700 1 -- 172.21.15.12:0/3199004456 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v45) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7be80464b0 con 0x7f7bfc0b10c0 2021-10-20T23:21:50.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7bdc0534f0 msgr2=0x7f7bdc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7bdc0534f0 0x7f7bdc0559b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f7bf000d000 tx=0x7f7bf0009040).stop 2021-10-20T23:21:50.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bfc0b10c0 msgr2=0x7f7bfc067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bfc0b10c0 0x7f7bfc067460 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f7be800c000 tx=0x7f7be8006df0).stop 2021-10-20T23:21:50.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 shutdown_connections 2021-10-20T23:21:50.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7bdc0534f0 0x7f7bdc0559b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bfc140ba0 0x7f7bfc0b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bfc0b10c0 0x7f7bfc067460 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 --2- 172.21.15.12:0/3199004456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bfc0acb70 0x7f7bfc0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 >> 172.21.15.12:0/3199004456 conn(0x7f7bfc05f6b0 msgr2=0x7f7bfc0ab3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:50.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 shutdown_connections 2021-10-20T23:21:50.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.180+0000 7f7c02e54700 1 -- 172.21.15.12:0/3199004456 wait complete. 2021-10-20T23:21:50.188 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:21:50.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:21:50.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.304+0000 7fcfdf59e700 1 Processor -- start 2021-10-20T23:21:50.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.304+0000 7fcfdf59e700 1 -- start start 2021-10-20T23:21:50.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.304+0000 7fcfdf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b0010 0x7fcfe00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.304+0000 7fcfdf59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfe00afbd0 0x7fcfe00a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.304+0000 7fcfdf59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe00a70c0 con 0x7fcfe00b2580 2021-10-20T23:21:50.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.304+0000 7fcfdf59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe00a72f0 con 0x7fcfe00afbd0 2021-10-20T23:21:50.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.304+0000 7fcfdf59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00a7590 con 0x7fcfe00b0010 2021-10-20T23:21:50.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfddd9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b0010 0x7fcfe00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfded9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfe00afbd0 0x7fcfe00a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfddd9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b0010 0x7fcfe00a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:44404/0 (socket says 172.21.15.12:44404) 2021-10-20T23:21:50.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfddd9b700 1 -- 172.21.15.12:0/3390932194 learned_addr learned my addr 172.21.15.12:0/3390932194 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:50.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfded9d700 1 --2- 172.21.15.12:0/3390932194 >> v2:172.21.15.31:3300/0 conn(0x7fcfe00afbd0 0x7fcfe00a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:53622/0 (socket says 172.21.15.12:53622) 2021-10-20T23:21:50.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfded9d700 1 -- 172.21.15.12:0/3390932194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b0010 msgr2=0x7fcfe00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:50.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfded9d700 1 --2- 172.21.15.12:0/3390932194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b0010 0x7fcfe00a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfded9d700 1 -- 172.21.15.12:0/3390932194 >> v1:172.21.15.31:6789/0 conn(0x7fcfe00b2580 legacy=0x7fcfe014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfded9d700 1 -- 172.21.15.12:0/3390932194 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00a7830 con 0x7fcfe00afbd0 2021-10-20T23:21:50.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfddd9b700 1 --2- 172.21.15.12:0/3390932194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b0010 0x7fcfe00a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:50.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfded9d700 1 --2- 172.21.15.12:0/3390932194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfe00afbd0 0x7fcfe00a88a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fcfd8002f70 tx=0x7fcfd8006df0).ready entity=mon.1 client_cookie=56abba5b6e021073 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:50.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdd59a700 1 -- 172.21.15.12:0/3390932194 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfd800d570 con 0x7fcfe00afbd0 2021-10-20T23:21:50.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdd59a700 1 -- 172.21.15.12:0/3390932194 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8000e90 con 0x7fcfe00afbd0 2021-10-20T23:21:50.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdd59a700 1 -- 172.21.15.12:0/3390932194 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfd800d8c0 con 0x7fcfe00afbd0 2021-10-20T23:21:50.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3390932194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfe00afbd0 msgr2=0x7fcfe00a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 --2- 172.21.15.12:0/3390932194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfe00afbd0 0x7fcfe00a88a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fcfd8002f70 tx=0x7fcfd8006df0).stop 2021-10-20T23:21:50.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3390932194 shutdown_connections 2021-10-20T23:21:50.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 --2- 172.21.15.12:0/3390932194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfe00afbd0 0x7fcfe00a88a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 --2- 172.21.15.12:0/3390932194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b0010 0x7fcfe00a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3390932194 >> 172.21.15.12:0/3390932194 conn(0x7fcfe0060180 msgr2=0x7fcfe00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:50.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3390932194 shutdown_connections 2021-10-20T23:21:50.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3390932194 wait complete. 2021-10-20T23:21:50.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 Processor -- start 2021-10-20T23:21:50.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.308+0000 7fcfdf59e700 1 -- start start 2021-10-20T23:21:50.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfdf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfe00afbd0 0x7fcfe00aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfdf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe00b0010 0x7fcfe0156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfdf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b2580 0x7fcfe0156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfdf59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00a9290 con 0x7fcfe00b0010 2021-10-20T23:21:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfdf59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00aa0c0 con 0x7fcfe00afbd0 2021-10-20T23:21:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfdf59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00aa360 con 0x7fcfe00b2580 2021-10-20T23:21:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfddd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe00b0010 0x7fcfe0156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfddd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe00b0010 0x7fcfe0156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38650/0 (socket says 172.21.15.12:38650) 2021-10-20T23:21:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfddd9b700 1 -- 172.21.15.12:0/3173272754 learned_addr learned my addr 172.21.15.12:0/3173272754 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:50.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfded9d700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b2580 0x7fcfe0156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfde59c700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfe00afbd0 0x7fcfe00aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfddd9b700 1 -- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b2580 msgr2=0x7fcfe0156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfddd9b700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b2580 0x7fcfe0156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfddd9b700 1 -- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfe00afbd0 msgr2=0x7fcfe00aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfddd9b700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfe00afbd0 0x7fcfe00aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfddd9b700 1 -- 172.21.15.12:0/3173272754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0009530 con 0x7fcfe00b0010 2021-10-20T23:21:50.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfddd9b700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe00b0010 0x7fcfe0156460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fcfd0006b60 tx=0x7fcfd0009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:50.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfcf7fe700 1 -- 172.21.15.12:0/3173272754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfd000c850 con 0x7fcfe00b0010 2021-10-20T23:21:50.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfcf7fe700 1 -- 172.21.15.12:0/3173272754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd000c9b0 con 0x7fcfe00b0010 2021-10-20T23:21:50.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd800b180 con 0x7fcfe00b0010 2021-10-20T23:21:50.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfcf7fe700 1 -- 172.21.15.12:0/3173272754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfd000cd10 con 0x7fcfe00b0010 2021-10-20T23:21:50.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe00ab3a0 con 0x7fcfe00b0010 2021-10-20T23:21:50.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.312+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe00a98b0 con 0x7fcfe00b0010 2021-10-20T23:21:50.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.316+0000 7fcfcf7fe700 1 -- 172.21.15.12:0/3173272754 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcfd0022070 con 0x7fcfe00b0010 2021-10-20T23:21:50.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.316+0000 7fcfcf7fe700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfbc0536a0 0x7fcfbc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.316+0000 7fcfcf7fe700 1 -- 172.21.15.12:0/3173272754 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fcfd006c270 con 0x7fcfe00b0010 2021-10-20T23:21:50.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.316+0000 7fcfde59c700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfbc0536a0 0x7fcfbc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.316+0000 7fcfde59c700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfbc0536a0 0x7fcfbc055b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fcfd400d000 tx=0x7fcfd4007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:50.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.320+0000 7fcfcf7fe700 1 -- 172.21.15.12:0/3173272754 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcfd00432f0 con 0x7fcfe00b0010 2021-10-20T23:21:50.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.492+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fcfe0057350 con 0x7fcfe00b0010 2021-10-20T23:21:50.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfcf7fe700 1 -- 172.21.15.12:0/3173272754 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v18) v1 ==== 187+0+0 (secure 0 0 0) 0x7fcfd0046910 con 0x7fcfe00b0010 2021-10-20T23:21:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfbc0536a0 msgr2=0x7fcfbc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfbc0536a0 0x7fcfbc055b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fcfd400d000 tx=0x7fcfd4007b90).stop 2021-10-20T23:21:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe00b0010 msgr2=0x7fcfe0156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe00b0010 0x7fcfe0156460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fcfd0006b60 tx=0x7fcfd0009290).stop 2021-10-20T23:21:50.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 shutdown_connections 2021-10-20T23:21:50.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfbc0536a0 0x7fcfbc055b60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfe00b2580 0x7fcfe0156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe00b0010 0x7fcfe0156460 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 --2- 172.21.15.12:0/3173272754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfe00afbd0 0x7fcfe00aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 >> 172.21.15.12:0/3173272754 conn(0x7fcfe0060180 msgr2=0x7fcfe0148a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:50.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 shutdown_connections 2021-10-20T23:21:50.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.504+0000 7fcfdf59e700 1 -- 172.21.15.12:0/3173272754 wait complete. 2021-10-20T23:21:50.512 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 7 and data pool 8 2021-10-20T23:21:50.524 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:21:50.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.612+0000 7f42b4926700 1 Processor -- start 2021-10-20T23:21:50.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.612+0000 7f42b4926700 1 -- start start 2021-10-20T23:21:50.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f42b00b3550 0x7f42b0067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b0066500 con 0x7f42b0064980 2021-10-20T23:21:50.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b00b46c0 con 0x7f42b0144ce0 2021-10-20T23:21:50.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b00b3ea0 con 0x7f42b00b3550 2021-10-20T23:21:50.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42aed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f42b0064980 0x7f42b0066a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37254/0 (socket says 172.21.15.12:37254) 2021-10-20T23:21:50.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42aed9d700 1 -- 172.21.15.12:0/3982220474 learned_addr learned my addr 172.21.15.12:0/3982220474 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:50.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42a7fff700 1 --2- 172.21.15.12:0/3982220474 >> v2:172.21.15.31:3300/0 conn(0x7f42b00b3550 0x7f42b0067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42ae59c700 1 -- 172.21.15.12:0/3982220474 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267994758 0 0) 0x7f42b0066500 con 0x7f42b0064980 2021-10-20T23:21:50.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42ae59c700 1 -- 172.21.15.12:0/3982220474 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4290003260 con 0x7f42b0064980 2021-10-20T23:21:50.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42a7fff700 1 -- 172.21.15.12:0/3982220474 >> v1:172.21.15.31:6789/0 conn(0x7f42b0144ce0 legacy=0x7f42b0141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42ae59c700 1 -- 172.21.15.12:0/3982220474 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962805493 0 0) 0x7f42b00b46c0 con 0x7f42b0144ce0 2021-10-20T23:21:50.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42a7fff700 1 -- 172.21.15.12:0/3982220474 >> v1:172.21.15.12:6789/0 conn(0x7f42b0064980 legacy=0x7f42b0066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42a7fff700 1 -- 172.21.15.12:0/3982220474 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b0064d60 con 0x7f42b00b3550 2021-10-20T23:21:50.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42a7fff700 1 --2- 172.21.15.12:0/3982220474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b00b3550 0x7f42b0067110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f4298002f70 tx=0x7f4298006df0).ready entity=mon.1 client_cookie=4d99726173e44ae1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:50.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42ae59c700 1 -- 172.21.15.12:0/3982220474 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f429800d5c0 con 0x7f42b00b3550 2021-10-20T23:21:50.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42ae59c700 1 -- 172.21.15.12:0/3982220474 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4298000e90 con 0x7f42b00b3550 2021-10-20T23:21:50.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42ae59c700 1 -- 172.21.15.12:0/3982220474 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f429800d910 con 0x7f42b00b3550 2021-10-20T23:21:50.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 -- 172.21.15.12:0/3982220474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b00b3550 msgr2=0x7f42b0067110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 --2- 172.21.15.12:0/3982220474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b00b3550 0x7f42b0067110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f4298002f70 tx=0x7f4298006df0).stop 2021-10-20T23:21:50.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 -- 172.21.15.12:0/3982220474 shutdown_connections 2021-10-20T23:21:50.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 --2- 172.21.15.12:0/3982220474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b00b3550 0x7f42b0067110 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 -- 172.21.15.12:0/3982220474 >> 172.21.15.12:0/3982220474 conn(0x7f42b005f6b0 msgr2=0x7f42b005fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:50.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 -- 172.21.15.12:0/3982220474 shutdown_connections 2021-10-20T23:21:50.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.616+0000 7f42b4926700 1 -- 172.21.15.12:0/3982220474 wait complete. 2021-10-20T23:21:50.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42b4926700 1 Processor -- start 2021-10-20T23:21:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42b4926700 1 -- start start 2021-10-20T23:21:50.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42b4926700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42b0064980 0x7f42b013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42b4926700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b00b3550 0x7f42b00b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42b4926700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42b0144ce0 0x7f42b0151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42b4926700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00b7310 con 0x7f42b0144ce0 2021-10-20T23:21:50.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42b4926700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00b1600 con 0x7f42b00b3550 2021-10-20T23:21:50.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42b4926700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b01515c0 con 0x7f42b0064980 2021-10-20T23:21:50.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42b0144ce0 0x7f42b0151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42b0144ce0 0x7f42b0151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38668/0 (socket says 172.21.15.12:38668) 2021-10-20T23:21:50.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42af59e700 1 -- 172.21.15.12:0/2236844682 learned_addr learned my addr 172.21.15.12:0/2236844682 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:50.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42aed9d700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42b0064980 0x7f42b013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42a7fff700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b00b3550 0x7f42b00b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42af59e700 1 -- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42b0064980 msgr2=0x7f42b013f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42af59e700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42b0064980 0x7f42b013f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42af59e700 1 -- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b00b3550 msgr2=0x7f42b00b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42af59e700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b00b3550 0x7f42b00b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42af59e700 1 -- 172.21.15.12:0/2236844682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429800b180 con 0x7f42b0144ce0 2021-10-20T23:21:50.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42aed9d700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42b0064980 0x7f42b013f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:50.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.620+0000 7f42af59e700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42b0144ce0 0x7f42b0151d00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f42a8001250 tx=0x7f42a8007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:50.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42acd99700 1 -- 172.21.15.12:0/2236844682 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a800e4a0 con 0x7f42b0144ce0 2021-10-20T23:21:50.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42acd99700 1 -- 172.21.15.12:0/2236844682 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a800e600 con 0x7f42b0144ce0 2021-10-20T23:21:50.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b0151860 con 0x7f42b0144ce0 2021-10-20T23:21:50.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42acd99700 1 -- 172.21.15.12:0/2236844682 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a800e9a0 con 0x7f42b0144ce0 2021-10-20T23:21:50.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b01521f0 con 0x7f42b0144ce0 2021-10-20T23:21:50.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42acd99700 1 -- 172.21.15.12:0/2236844682 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f42a8019030 con 0x7f42b0144ce0 2021-10-20T23:21:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b00b1800 con 0x7f42b0144ce0 2021-10-20T23:21:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42acd99700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4294053580 0x7f4294055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42acd99700 1 -- 172.21.15.12:0/2236844682 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f42a806b290 con 0x7f42b0144ce0 2021-10-20T23:21:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42aed9d700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4294053580 0x7f4294055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.624+0000 7f42aed9d700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4294053580 0x7f4294055a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f42a000b000 tx=0x7f42a0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:50.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.628+0000 7f42acd99700 1 -- 172.21.15.12:0/2236844682 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f42a80422a0 con 0x7f42b0144ce0 2021-10-20T23:21:50.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.756+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42b01519f0 con 0x7f42b0144ce0 2021-10-20T23:21:50.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.756+0000 7f42acd99700 1 -- 172.21.15.12:0/2236844682 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16297 (secure 0 0 0) 0x7f42a8024fc0 con 0x7f42b0144ce0 2021-10-20T23:21:50.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:50.761 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":46,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:21:50.498648+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:21:48.487958+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-20T23:21:49.501193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:21:50.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4294053580 msgr2=0x7f4294055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4294053580 0x7f4294055a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f42a000b000 tx=0x7f42a0009040).stop 2021-10-20T23:21:50.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42b0144ce0 msgr2=0x7f42b0151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42b0144ce0 0x7f42b0151d00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f42a8001250 tx=0x7f42a8007dc0).stop 2021-10-20T23:21:50.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 shutdown_connections 2021-10-20T23:21:50.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4294053580 0x7f4294055a40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42b0144ce0 0x7f42b0151d00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b00b3550 0x7f42b00b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 --2- 172.21.15.12:0/2236844682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42b0064980 0x7f42b013f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 >> 172.21.15.12:0/2236844682 conn(0x7f42b005f6b0 msgr2=0x7f42b0144040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:50.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 shutdown_connections 2021-10-20T23:21:50.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.760+0000 7f42b4926700 1 -- 172.21.15.12:0/2236844682 wait complete. 2021-10-20T23:21:50.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:21:50.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.872+0000 7fd5c359e700 1 Processor -- start 2021-10-20T23:21:50.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.872+0000 7fd5c359e700 1 -- start start 2021-10-20T23:21:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 0x7fd5c413e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c40b1570 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c4066ca0 con 0x7fd5c40668c0 2021-10-20T23:21:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40b1370 con 0x7fd5c405fc90 2021-10-20T23:21:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c1d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd5c40b0cd0 0x7fd5c413daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37266/0 (socket says 172.21.15.12:37266) 2021-10-20T23:21:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c1d9b700 1 -- 172.21.15.12:0/4000986181 learned_addr learned my addr 172.21.15.12:0/4000986181 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:50.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c2d9d700 1 --2- 172.21.15.12:0/4000986181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 0x7fd5c413e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c159a700 1 -- 172.21.15.12:0/4000986181 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721124600 0 0) 0x7fd5c40b1570 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c159a700 1 -- 172.21.15.12:0/4000986181 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a8003260 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c2d9d700 1 -- 172.21.15.12:0/4000986181 >> v1:172.21.15.31:6789/0 conn(0x7fd5c40668c0 legacy=0x7fd5c40b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c159a700 1 -- 172.21.15.12:0/4000986181 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038445723 0 0) 0x7fd5c4066ca0 con 0x7fd5c40668c0 2021-10-20T23:21:50.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c2d9d700 1 -- 172.21.15.12:0/4000986181 >> v1:172.21.15.12:6789/0 conn(0x7fd5c40b0cd0 legacy=0x7fd5c413daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c2d9d700 1 -- 172.21.15.12:0/4000986181 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c405f830 con 0x7fd5c405fc90 2021-10-20T23:21:50.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c2d9d700 1 --2- 172.21.15.12:0/4000986181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 0x7fd5c413e200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd5bc0032f0 tx=0x7fd5bc0091d0).ready entity=mon.2 client_cookie=4d39368c9974ffec server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:50.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c159a700 1 -- 172.21.15.12:0/4000986181 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5bc00b6c0 con 0x7fd5c405fc90 2021-10-20T23:21:50.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c159a700 1 -- 172.21.15.12:0/4000986181 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00b820 con 0x7fd5c405fc90 2021-10-20T23:21:50.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c159a700 1 -- 172.21.15.12:0/4000986181 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5bc00b990 con 0x7fd5c405fc90 2021-10-20T23:21:50.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 -- 172.21.15.12:0/4000986181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 msgr2=0x7fd5c413e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 --2- 172.21.15.12:0/4000986181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 0x7fd5c413e200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd5bc0032f0 tx=0x7fd5bc0091d0).stop 2021-10-20T23:21:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 -- 172.21.15.12:0/4000986181 shutdown_connections 2021-10-20T23:21:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 --2- 172.21.15.12:0/4000986181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 0x7fd5c413e200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 -- 172.21.15.12:0/4000986181 >> 172.21.15.12:0/4000986181 conn(0x7fd5c4063670 msgr2=0x7fd5c4063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 -- 172.21.15.12:0/4000986181 shutdown_connections 2021-10-20T23:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.876+0000 7fd5c359e700 1 -- 172.21.15.12:0/4000986181 wait complete. 2021-10-20T23:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 Processor -- start 2021-10-20T23:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 -- start start 2021-10-20T23:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 0x7fd5c4144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c40668c0 0x7fd5c40abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c40b0cd0 0x7fd5c4143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4138960 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4138c00 con 0x7fd5c40668c0 2021-10-20T23:21:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4138ea0 con 0x7fd5c405fc90 2021-10-20T23:21:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c40b0cd0 0x7fd5c4143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c40b0cd0 0x7fd5c4143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38682/0 (socket says 172.21.15.12:38682) 2021-10-20T23:21:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c2d9d700 1 -- 172.21.15.12:0/746332069 learned_addr learned my addr 172.21.15.12:0/746332069 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c259c700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 0x7fd5c4144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c1d9b700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c40668c0 0x7fd5c40abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c2d9d700 1 -- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 msgr2=0x7fd5c4144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c2d9d700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 0x7fd5c4144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c2d9d700 1 -- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c40668c0 msgr2=0x7fd5c40abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c2d9d700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c40668c0 0x7fd5c40abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:50.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c2d9d700 1 -- 172.21.15.12:0/746332069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc009470 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c1d9b700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c40668c0 0x7fd5c40abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:50.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c2d9d700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c40b0cd0 0x7fd5c4143260 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fd5bc0032f0 tx=0x7fd5bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:50.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5b37fe700 1 -- 172.21.15.12:0/746332069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5bc00b990 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5b37fe700 1 -- 172.21.15.12:0/746332069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc01f3f0 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c4142dc0 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5b37fe700 1 -- 172.21.15.12:0/746332069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5bc00b6c0 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.880+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c4138500 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.884+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c40b17a0 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.884+0000 7fd5b37fe700 1 -- 172.21.15.12:0/746332069 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd5bc026030 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.884+0000 7fd5b37fe700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a0053610 0x7fd5a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:50.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.884+0000 7fd5b37fe700 1 -- 172.21.15.12:0/746332069 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd5bc06c4d0 con 0x7fd5c40b0cd0 2021-10-20T23:21:50.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.884+0000 7fd5c259c700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a0053610 0x7fd5a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:50.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.884+0000 7fd5c259c700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a0053610 0x7fd5a0055ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd5b800d000 tx=0x7fd5b80079b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:50.888+0000 7fd5b37fe700 1 -- 172.21.15.12:0/746332069 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5bc043510 con 0x7fd5c40b0cd0 2021-10-20T23:21:51.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.016+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5c4057350 con 0x7fd5c40b0cd0 2021-10-20T23:21:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5b37fe700 1 -- 172.21.15.12:0/746332069 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16297 (secure 0 0 0) 0x7fd5bc046af0 con 0x7fd5c40b0cd0 2021-10-20T23:21:51.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:51.023 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":46,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:21:50.498648+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:21:48.487958+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-20T23:21:49.501193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:21:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a0053610 msgr2=0x7fd5a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a0053610 0x7fd5a0055ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd5b800d000 tx=0x7fd5b80079b0).stop 2021-10-20T23:21:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c40b0cd0 msgr2=0x7fd5c4143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c40b0cd0 0x7fd5c4143260 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fd5bc0032f0 tx=0x7fd5bc016000).stop 2021-10-20T23:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 shutdown_connections 2021-10-20T23:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a0053610 0x7fd5a0055ad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c40b0cd0 0x7fd5c4143260 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c40668c0 0x7fd5c40abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 --2- 172.21.15.12:0/746332069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c405fc90 0x7fd5c4144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 >> 172.21.15.12:0/746332069 conn(0x7fd5c4063670 msgr2=0x7fd5c413c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:51.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 shutdown_connections 2021-10-20T23:21:51.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.020+0000 7fd5c359e700 1 -- 172.21.15.12:0/746332069 wait complete. 2021-10-20T23:21:51.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:21:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2fb2e1700 1 Processor -- start 2021-10-20T23:21:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2fb2e1700 1 -- start start 2021-10-20T23:21:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2fb2e1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4144440 0x7fe2f4144970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2fb2e1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40604e0 con 0x7fe2f4065420 2021-10-20T23:21:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2fb2e1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40b23b0 con 0x7fe2f4060100 2021-10-20T23:21:51.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2fb2e1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4065c80 con 0x7fe2f4144440 2021-10-20T23:21:51.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2f987e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe2f4065420 0x7fe2f414b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37284/0 (socket says 172.21.15.12:37284) 2021-10-20T23:21:51.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2f987e700 1 -- 172.21.15.12:0/2851909062 learned_addr learned my addr 172.21.15.12:0/2851909062 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:51.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2f887c700 1 --2- 172.21.15.12:0/2851909062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4144440 0x7fe2f4144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2f887c700 1 -- 172.21.15.12:0/2851909062 >> v1:172.21.15.31:6789/0 conn(0x7fe2f4060100 legacy=0x7fe2f4064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2ebfff700 1 -- 172.21.15.12:0/2851909062 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547771329 0 0) 0x7fe2f40b23b0 con 0x7fe2f4060100 2021-10-20T23:21:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2f887c700 1 -- 172.21.15.12:0/2851909062 >> v1:172.21.15.12:6789/0 conn(0x7fe2f4065420 legacy=0x7fe2f414b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2f887c700 1 -- 172.21.15.12:0/2851909062 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40b2650 con 0x7fe2f4144440 2021-10-20T23:21:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2f887c700 1 --2- 172.21.15.12:0/2851909062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4144440 0x7fe2f4144970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fe2ec0013c0 tx=0x7fe2e4006df0).ready entity=mon.2 client_cookie=7850917781bbf6b3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2ebfff700 1 -- 172.21.15.12:0/2851909062 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e400d570 con 0x7fe2f4144440 2021-10-20T23:21:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2ebfff700 1 -- 172.21.15.12:0/2851909062 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4000e90 con 0x7fe2f4144440 2021-10-20T23:21:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.144+0000 7fe2ebfff700 1 -- 172.21.15.12:0/2851909062 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e400d8c0 con 0x7fe2f4144440 2021-10-20T23:21:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2851909062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4144440 msgr2=0x7fe2f4144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 --2- 172.21.15.12:0/2851909062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4144440 0x7fe2f4144970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fe2ec0013c0 tx=0x7fe2e4006df0).stop 2021-10-20T23:21:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2851909062 shutdown_connections 2021-10-20T23:21:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 --2- 172.21.15.12:0/2851909062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4144440 0x7fe2f4144970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2851909062 >> 172.21.15.12:0/2851909062 conn(0x7fe2f405cf60 msgr2=0x7fe2f405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2851909062 shutdown_connections 2021-10-20T23:21:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2851909062 wait complete. 2021-10-20T23:21:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 Processor -- start 2021-10-20T23:21:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 -- start start 2021-10-20T23:21:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f4060100 0x7fe2f40aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4065420 0x7fe2f413f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2f40af2f0 0x7fe2f40b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4138b50 con 0x7fe2f40af2f0 2021-10-20T23:21:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40b6170 con 0x7fe2f4060100 2021-10-20T23:21:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.148+0000 7fe2fb2e1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4138d80 con 0x7fe2f4065420 2021-10-20T23:21:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f907d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f4060100 0x7fe2f40aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f987e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2f40af2f0 0x7fe2f40b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f907d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f4060100 0x7fe2f40aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:53666/0 (socket says 172.21.15.12:53666) 2021-10-20T23:21:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f907d700 1 -- 172.21.15.12:0/2951088657 learned_addr learned my addr 172.21.15.12:0/2951088657 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f887c700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4065420 0x7fe2f413f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f907d700 1 -- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4065420 msgr2=0x7fe2f413f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f907d700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4065420 0x7fe2f413f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f907d700 1 -- 172.21.15.12:0/2951088657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2f40af2f0 msgr2=0x7fe2f40b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f907d700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2f40af2f0 0x7fe2f40b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f907d700 1 -- 172.21.15.12:0/2951088657 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e400b180 con 0x7fe2f4060100 2021-10-20T23:21:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2f907d700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f4060100 0x7fe2f40aed50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fe2f0000bc0 tx=0x7fe2f0007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2ea7fc700 1 -- 172.21.15.12:0/2951088657 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f0012400 con 0x7fe2f4060100 2021-10-20T23:21:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2ea7fc700 1 -- 172.21.15.12:0/2951088657 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f0012560 con 0x7fe2f4060100 2021-10-20T23:21:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f4139020 con 0x7fe2f4060100 2021-10-20T23:21:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2ea7fc700 1 -- 172.21.15.12:0/2951088657 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f00128c0 con 0x7fe2f4060100 2021-10-20T23:21:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f40b6a90 con 0x7fe2f4060100 2021-10-20T23:21:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f41391b0 con 0x7fe2f4060100 2021-10-20T23:21:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.152+0000 7fe2ea7fc700 1 -- 172.21.15.12:0/2951088657 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe2f0019030 con 0x7fe2f4060100 2021-10-20T23:21:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.156+0000 7fe2ea7fc700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe2dc053610 0x7fe2dc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.156+0000 7fe2ea7fc700 1 -- 172.21.15.12:0/2951088657 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe2f006ade0 con 0x7fe2f4060100 2021-10-20T23:21:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.156+0000 7fe2f887c700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe2dc053610 0x7fe2dc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.156+0000 7fe2f887c700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe2dc053610 0x7fe2dc055ad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fe2e401a000 tx=0x7fe2e4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.164+0000 7fe2ea7fc700 1 -- 172.21.15.12:0/2951088657 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe2f0041d80 con 0x7fe2f4060100 2021-10-20T23:21:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.332+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe2f40b62b0 con 0x7fe2f4060100 2021-10-20T23:21:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.504+0000 7fe2ea7fc700 1 -- 172.21.15.12:0/2951088657 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v19) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe2f00453a0 con 0x7fe2f4060100 2021-10-20T23:21:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe2dc053610 msgr2=0x7fe2dc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe2dc053610 0x7fe2dc055ad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fe2e401a000 tx=0x7fe2e4014000).stop 2021-10-20T23:21:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f4060100 msgr2=0x7fe2f40aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f4060100 0x7fe2f40aed50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fe2f0000bc0 tx=0x7fe2f0007a70).stop 2021-10-20T23:21:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 shutdown_connections 2021-10-20T23:21:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe2dc053610 0x7fe2dc055ad0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2f40af2f0 0x7fe2f40b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2f4065420 0x7fe2f413f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 --2- 172.21.15.12:0/2951088657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f4060100 0x7fe2f40aed50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 >> 172.21.15.12:0/2951088657 conn(0x7fe2f405cf60 msgr2=0x7fe2f40ade30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 shutdown_connections 2021-10-20T23:21:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.508+0000 7fe2fb2e1700 1 -- 172.21.15.12:0/2951088657 wait complete. 2021-10-20T23:21:51.528 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:21:51.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 Processor -- start 2021-10-20T23:21:51.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 -- start start 2021-10-20T23:21:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bc40b1db0 0x7f4bc40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc41483a0 0x7f4bc40b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4bc40a70c0 0x7f4bc4144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc40a90c0 con 0x7f4bc40a70c0 2021-10-20T23:21:51.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc40b0350 con 0x7f4bc40b1db0 2021-10-20T23:21:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40b05f0 con 0x7f4bc41483a0 2021-10-20T23:21:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4bc40a70c0 0x7f4bc4144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4bc40a70c0 0x7f4bc4144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38704/0 (socket says 172.21.15.12:38704) 2021-10-20T23:21:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc359e700 1 -- 172.21.15.12:0/3578404176 learned_addr learned my addr 172.21.15.12:0/3578404176 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc259c700 1 --2- 172.21.15.12:0/3578404176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc41483a0 0x7f4bc40b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc2d9d700 1 --2- 172.21.15.12:0/3578404176 >> v2:172.21.15.31:3300/0 conn(0x7f4bc40b1db0 0x7f4bc40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc359e700 1 -- 172.21.15.12:0/3578404176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc41483a0 msgr2=0x7f4bc40b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:51.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc359e700 1 --2- 172.21.15.12:0/3578404176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc41483a0 0x7f4bc40b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc359e700 1 -- 172.21.15.12:0/3578404176 >> v2:172.21.15.31:3300/0 conn(0x7f4bc40b1db0 msgr2=0x7f4bc40b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:51.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc359e700 1 --2- 172.21.15.12:0/3578404176 >> v2:172.21.15.31:3300/0 conn(0x7f4bc40b1db0 0x7f4bc40b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc359e700 1 -- 172.21.15.12:0/3578404176 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40b0890 con 0x7f4bc40a70c0 2021-10-20T23:21:51.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc2d9d700 1 --2- 172.21.15.12:0/3578404176 >> v2:172.21.15.31:3300/0 conn(0x7f4bc40b1db0 0x7f4bc40b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:51.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc259c700 1 --2- 172.21.15.12:0/3578404176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc41483a0 0x7f4bc40b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:51.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc359e700 1 --2- 172.21.15.12:0/3578404176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 0x7f4bc4144720 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f4bbc0032f0 tx=0x7f4bbc009290).ready entity=mon.0 client_cookie=704d3923fa91abd8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:51.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc1d9b700 1 -- 172.21.15.12:0/3578404176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bbc00b870 con 0x7f4bc40a70c0 2021-10-20T23:21:51.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc1d9b700 1 -- 172.21.15.12:0/3578404176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc00b9d0 con 0x7f4bc40a70c0 2021-10-20T23:21:51.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc1d9b700 1 -- 172.21.15.12:0/3578404176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bbc00bb40 con 0x7f4bc40a70c0 2021-10-20T23:21:51.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 -- 172.21.15.12:0/3578404176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 msgr2=0x7f4bc4144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/3578404176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 0x7f4bc4144720 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f4bbc0032f0 tx=0x7f4bbc009290).stop 2021-10-20T23:21:51.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 -- 172.21.15.12:0/3578404176 shutdown_connections 2021-10-20T23:21:51.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/3578404176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 0x7f4bc4144720 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/3578404176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc41483a0 0x7f4bc40b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/3578404176 >> v2:172.21.15.31:3300/0 conn(0x7f4bc40b1db0 0x7f4bc40b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 -- 172.21.15.12:0/3578404176 >> 172.21.15.12:0/3578404176 conn(0x7f4bc405f6b0 msgr2=0x7f4bc405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:51.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.632+0000 7f4bc91b1700 1 -- 172.21.15.12:0/3578404176 shutdown_connections 2021-10-20T23:21:51.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 -- 172.21.15.12:0/3578404176 wait complete. 2021-10-20T23:21:51.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 Processor -- start 2021-10-20T23:21:51.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 -- start start 2021-10-20T23:21:51.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 0x7f4bc413fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc40b1db0 0x7f4bc413d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc41483a0 0x7f4bc413dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40ae1d0 con 0x7f4bc40a70c0 2021-10-20T23:21:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40ae470 con 0x7f4bc41483a0 2021-10-20T23:21:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40ae710 con 0x7f4bc40b1db0 2021-10-20T23:21:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 0x7f4bc413fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 0x7f4bc413fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38706/0 (socket says 172.21.15.12:38706) 2021-10-20T23:21:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc2d9d700 1 -- 172.21.15.12:0/2182815243 learned_addr learned my addr 172.21.15.12:0/2182815243 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc259c700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc40b1db0 0x7f4bc413d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc359e700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc41483a0 0x7f4bc413dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc2d9d700 1 -- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc40b1db0 msgr2=0x7f4bc413d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc2d9d700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc40b1db0 0x7f4bc413d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc2d9d700 1 -- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc41483a0 msgr2=0x7f4bc413dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc2d9d700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc41483a0 0x7f4bc413dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc2d9d700 1 -- 172.21.15.12:0/2182815243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc009530 con 0x7f4bc40a70c0 2021-10-20T23:21:51.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc359e700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc41483a0 0x7f4bc413dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:51.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc2d9d700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 0x7f4bc413fa20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f4bac006940 tx=0x7f4bac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:51.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bbbfff700 1 -- 172.21.15.12:0/2182815243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bac011850 con 0x7f4bc40a70c0 2021-10-20T23:21:51.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bbbfff700 1 -- 172.21.15.12:0/2182815243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0119b0 con 0x7f4bc40a70c0 2021-10-20T23:21:51.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc40af990 con 0x7f4bc40a70c0 2021-10-20T23:21:51.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.636+0000 7f4bbbfff700 1 -- 172.21.15.12:0/2182815243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bac011d10 con 0x7f4bc40a70c0 2021-10-20T23:21:51.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.640+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc413e1c0 con 0x7f4bc40a70c0 2021-10-20T23:21:51.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.640+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc40b0b30 con 0x7f4bc40a70c0 2021-10-20T23:21:51.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.640+0000 7f4bbbfff700 1 -- 172.21.15.12:0/2182815243 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4bac01c460 con 0x7f4bc40a70c0 2021-10-20T23:21:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.640+0000 7f4bbbfff700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ba8053610 0x7f4ba8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.640+0000 7f4bbbfff700 1 -- 172.21.15.12:0/2182815243 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4bac06bdf0 con 0x7f4bc40a70c0 2021-10-20T23:21:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.640+0000 7f4bc259c700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ba8053610 0x7f4ba8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.640+0000 7f4bc259c700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ba8053610 0x7f4ba8055ad0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f4bb400c000 tx=0x7f4bb4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:51.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.644+0000 7f4bbbfff700 1 -- 172.21.15.12:0/2182815243 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4bac042cf0 con 0x7f4bc40a70c0 2021-10-20T23:21:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.808+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bc4057350 con 0x7f4bc40a70c0 2021-10-20T23:21:51.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.808+0000 7f4bbbfff700 1 -- 172.21.15.12:0/2182815243 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f4bac046310 con 0x7f4bc40a70c0 2021-10-20T23:21:51.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:51.815 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:21:50.499039+0000","modified":"2021-10-20T23:21:51.501920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5233":{"gid":5233,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2510327912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2510327912},{"type":"v1","addr":"172.21.15.31:6835","nonce":2510327912}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-20T23:21:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ba8053610 msgr2=0x7f4ba8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ba8053610 0x7f4ba8055ad0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f4bb400c000 tx=0x7f4bb4008040).stop 2021-10-20T23:21:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 msgr2=0x7f4bc413fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 0x7f4bc413fa20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f4bac006940 tx=0x7f4bac008040).stop 2021-10-20T23:21:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 shutdown_connections 2021-10-20T23:21:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ba8053610 0x7f4ba8055ad0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc41483a0 0x7f4bc413dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bc40b1db0 0x7f4bc413d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 --2- 172.21.15.12:0/2182815243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bc40a70c0 0x7f4bc413fa20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 >> 172.21.15.12:0/2182815243 conn(0x7f4bc405f6b0 msgr2=0x7f4bc40b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:51.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 shutdown_connections 2021-10-20T23:21:51.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.812+0000 7f4bc91b1700 1 -- 172.21.15.12:0/2182815243 wait complete. 2021-10-20T23:21:51.823 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 19 2021-10-20T23:21:51.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:21:51.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0e601700 1 Processor -- start 2021-10-20T23:21:51.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0e601700 1 -- start start 2021-10-20T23:21:51.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0e601700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e08067110 0x7f7e08141840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0e601700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e08066500 con 0x7f7e08064980 2021-10-20T23:21:51.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0e601700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080b46c0 con 0x7f7e080b3550 2021-10-20T23:21:51.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0e601700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e080b3ea0 con 0x7f7e08067110 2021-10-20T23:21:51.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0d5ff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7e08064980 0x7f7e08066a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37310/0 (socket says 172.21.15.12:37310) 2021-10-20T23:21:51.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0d5ff700 1 -- 172.21.15.12:0/551902255 learned_addr learned my addr 172.21.15.12:0/551902255 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:51.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0de00700 1 --2- 172.21.15.12:0/551902255 >> v2:172.21.15.31:3300/0 conn(0x7f7e08067110 0x7f7e08141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7dfffff700 1 -- 172.21.15.12:0/551902255 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432157777 0 0) 0x7f7e08066500 con 0x7f7e08064980 2021-10-20T23:21:51.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7dfffff700 1 -- 172.21.15.12:0/551902255 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dec003260 con 0x7f7e08064980 2021-10-20T23:21:51.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0de00700 1 -- 172.21.15.12:0/551902255 >> v1:172.21.15.31:6789/0 conn(0x7f7e080b3550 legacy=0x7f7e08141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0de00700 1 -- 172.21.15.12:0/551902255 >> v1:172.21.15.12:6789/0 conn(0x7f7e08064980 legacy=0x7f7e08066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0de00700 1 -- 172.21.15.12:0/551902255 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08064d60 con 0x7f7e08067110 2021-10-20T23:21:51.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7e0de00700 1 --2- 172.21.15.12:0/551902255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e08067110 0x7f7e08141840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7e000032f0 tx=0x7f7e000091d0).ready entity=mon.1 client_cookie=a3852a51e928a4fa server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:51.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.932+0000 7f7dfffff700 1 -- 172.21.15.12:0/551902255 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e0000b680 con 0x7f7e08067110 2021-10-20T23:21:51.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7dfffff700 1 -- 172.21.15.12:0/551902255 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0000b7e0 con 0x7f7e08067110 2021-10-20T23:21:51.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7dfffff700 1 -- 172.21.15.12:0/551902255 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e0000b950 con 0x7f7e08067110 2021-10-20T23:21:51.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7e0e601700 1 -- 172.21.15.12:0/551902255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e08067110 msgr2=0x7f7e08141840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7e0e601700 1 --2- 172.21.15.12:0/551902255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e08067110 0x7f7e08141840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7e000032f0 tx=0x7f7e000091d0).stop 2021-10-20T23:21:51.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7e0e601700 1 -- 172.21.15.12:0/551902255 shutdown_connections 2021-10-20T23:21:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7e0e601700 1 --2- 172.21.15.12:0/551902255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e08067110 0x7f7e08141840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7e0e601700 1 -- 172.21.15.12:0/551902255 >> 172.21.15.12:0/551902255 conn(0x7f7e0805f6b0 msgr2=0x7f7e0805fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7e0e601700 1 -- 172.21.15.12:0/551902255 shutdown_connections 2021-10-20T23:21:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7e0e601700 1 -- 172.21.15.12:0/551902255 wait complete. 2021-10-20T23:21:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7e0e601700 1 Processor -- start 2021-10-20T23:21:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.936+0000 7f7e0e601700 1 -- start start 2021-10-20T23:21:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0e601700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e08064980 0x7f7e08137ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0e601700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e08067110 0x7f7e080b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0e601700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080b3550 0x7f7e080b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0e601700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080b5820 con 0x7f7e080b3550 2021-10-20T23:21:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0e601700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08151110 con 0x7f7e08067110 2021-10-20T23:21:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0e601700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080b5a50 con 0x7f7e08064980 2021-10-20T23:21:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0de00700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080b3550 0x7f7e080b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0de00700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080b3550 0x7f7e080b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38724/0 (socket says 172.21.15.12:38724) 2021-10-20T23:21:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0cdfe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e08067110 0x7f7e080b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0de00700 1 -- 172.21.15.12:0/1451287607 learned_addr learned my addr 172.21.15.12:0/1451287607 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0d5ff700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e08064980 0x7f7e08137ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0de00700 1 -- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e08064980 msgr2=0x7f7e08137ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0de00700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e08064980 0x7f7e08137ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0de00700 1 -- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e08067110 msgr2=0x7f7e080b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0de00700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e08067110 0x7f7e080b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0de00700 1 -- 172.21.15.12:0/1451287607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00009470 con 0x7f7e080b3550 2021-10-20T23:21:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0de00700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080b3550 0x7f7e080b1160 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f7e000032f0 tx=0x7f7e00016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7dfe7fc700 1 -- 172.21.15.12:0/1451287607 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e0000b680 con 0x7f7e080b3550 2021-10-20T23:21:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7dfe7fc700 1 -- 172.21.15.12:0/1451287607 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00021630 con 0x7f7e080b3550 2021-10-20T23:21:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e080b5cf0 con 0x7f7e080b3550 2021-10-20T23:21:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7dfe7fc700 1 -- 172.21.15.12:0/1451287607 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e00021990 con 0x7f7e080b3550 2021-10-20T23:21:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e080b5070 con 0x7f7e080b3550 2021-10-20T23:21:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.940+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e080b5e80 con 0x7f7e080b3550 2021-10-20T23:21:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.944+0000 7f7dfe7fc700 1 -- 172.21.15.12:0/1451287607 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e00028070 con 0x7f7e080b3550 2021-10-20T23:21:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.944+0000 7f7dfe7fc700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7df0053580 0x7f7df0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.944+0000 7f7dfe7fc700 1 -- 172.21.15.12:0/1451287607 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7e0006cae0 con 0x7f7e080b3550 2021-10-20T23:21:51.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.944+0000 7f7e0d5ff700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7df0053580 0x7f7df0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:51.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.944+0000 7f7e0d5ff700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7df0053580 0x7f7df0055a40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f7df800d000 tx=0x7f7df8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:51.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:51.948+0000 7f7dfe7fc700 1 -- 172.21.15.12:0/1451287607 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e00043970 con 0x7f7e080b3550 2021-10-20T23:21:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.080+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e08057350 con 0x7f7e080b3550 2021-10-20T23:21:52.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.080+0000 7f7dfe7fc700 1 -- 172.21.15.12:0/1451287607 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16284 (secure 0 0 0) 0x7f7e00046f90 con 0x7f7e080b3550 2021-10-20T23:21:52.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:52.087 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":47,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:21:51.502653+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:21:48.487958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-20T23:21:49.501193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:21:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7df0053580 msgr2=0x7f7df0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7df0053580 0x7f7df0055a40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f7df800d000 tx=0x7f7df8009040).stop 2021-10-20T23:21:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080b3550 msgr2=0x7f7e080b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080b3550 0x7f7e080b1160 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f7e000032f0 tx=0x7f7e00016000).stop 2021-10-20T23:21:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 shutdown_connections 2021-10-20T23:21:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7df0053580 0x7f7df0055a40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080b3550 0x7f7e080b1160 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e08067110 0x7f7e080b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 --2- 172.21.15.12:0/1451287607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e08064980 0x7f7e08137ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 >> 172.21.15.12:0/1451287607 conn(0x7f7e0805f6b0 msgr2=0x7f7e0813a180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 shutdown_connections 2021-10-20T23:21:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.084+0000 7f7e0e601700 1 -- 172.21.15.12:0/1451287607 wait complete. 2021-10-20T23:21:52.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:21:52.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.192+0000 7f051af18700 1 Processor -- start 2021-10-20T23:21:52.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.192+0000 7f051af18700 1 -- start start 2021-10-20T23:21:52.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05140a9190 0x7f0514146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05140b0b80 0x7f0514146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b03d0 0x7f05141401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05140b1140 con 0x7f05140b0b80 2021-10-20T23:21:52.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05140a9570 con 0x7f05140a9190 2021-10-20T23:21:52.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140b1370 con 0x7f05140b03d0 2021-10-20T23:21:52.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519715700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05140b0b80 0x7f0514146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519715700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05140b0b80 0x7f0514146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38730/0 (socket says 172.21.15.12:38730) 2021-10-20T23:21:52.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519715700 1 -- 172.21.15.12:0/1529975980 learned_addr learned my addr 172.21.15.12:0/1529975980 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:52.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519f16700 1 --2- 172.21.15.12:0/1529975980 >> v2:172.21.15.31:3300/0 conn(0x7f05140a9190 0x7f0514146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051a717700 1 --2- 172.21.15.12:0/1529975980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b03d0 0x7f05141401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519715700 1 -- 172.21.15.12:0/1529975980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b03d0 msgr2=0x7f05141401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:52.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519715700 1 --2- 172.21.15.12:0/1529975980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b03d0 0x7f05141401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519715700 1 -- 172.21.15.12:0/1529975980 >> v2:172.21.15.31:3300/0 conn(0x7f05140a9190 msgr2=0x7f0514146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:52.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519715700 1 --2- 172.21.15.12:0/1529975980 >> v2:172.21.15.31:3300/0 conn(0x7f05140a9190 0x7f0514146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519715700 1 -- 172.21.15.12:0/1529975980 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05140b1610 con 0x7f05140b0b80 2021-10-20T23:21:52.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519f16700 1 --2- 172.21.15.12:0/1529975980 >> v2:172.21.15.31:3300/0 conn(0x7f05140a9190 0x7f0514146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:52.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0519715700 1 --2- 172.21.15.12:0/1529975980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b0b80 0x7f0514146a40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f0504002f70 tx=0x7f0504006eb0).ready entity=mon.0 client_cookie=76c456cc4d2d7eaf server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:52.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0518f14700 1 -- 172.21.15.12:0/1529975980 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050400d570 con 0x7f05140b0b80 2021-10-20T23:21:52.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0518f14700 1 -- 172.21.15.12:0/1529975980 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504000e90 con 0x7f05140b0b80 2021-10-20T23:21:52.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f0518f14700 1 -- 172.21.15.12:0/1529975980 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050400d900 con 0x7f05140b0b80 2021-10-20T23:21:52.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 -- 172.21.15.12:0/1529975980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b0b80 msgr2=0x7f0514146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 --2- 172.21.15.12:0/1529975980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b0b80 0x7f0514146a40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f0504002f70 tx=0x7f0504006eb0).stop 2021-10-20T23:21:52.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 -- 172.21.15.12:0/1529975980 shutdown_connections 2021-10-20T23:21:52.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 --2- 172.21.15.12:0/1529975980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b03d0 0x7f05141401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 --2- 172.21.15.12:0/1529975980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b0b80 0x7f0514146a40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 --2- 172.21.15.12:0/1529975980 >> v2:172.21.15.31:3300/0 conn(0x7f05140a9190 0x7f0514146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 -- 172.21.15.12:0/1529975980 >> 172.21.15.12:0/1529975980 conn(0x7f0514061140 msgr2=0x7f0514062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:52.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 -- 172.21.15.12:0/1529975980 shutdown_connections 2021-10-20T23:21:52.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.196+0000 7f051af18700 1 -- 172.21.15.12:0/1529975980 wait complete. 2021-10-20T23:21:52.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 Processor -- start 2021-10-20T23:21:52.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 -- start start 2021-10-20T23:21:52.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05140a9190 0x7f05140ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b03d0 0x7f05141559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b0b80 0x7f05140b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0514143630 con 0x7f05140b03d0 2021-10-20T23:21:52.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0514141c10 con 0x7f05140a9190 2021-10-20T23:21:52.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0514142f70 con 0x7f05140b0b80 2021-10-20T23:21:52.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519715700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b03d0 0x7f05141559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519f16700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05140a9190 0x7f05140ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519f16700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05140a9190 0x7f05140ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:53708/0 (socket says 172.21.15.12:53708) 2021-10-20T23:21:52.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519f16700 1 -- 172.21.15.12:0/62973795 learned_addr learned my addr 172.21.15.12:0/62973795 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:52.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051a717700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b0b80 0x7f05140b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519715700 1 -- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b0b80 msgr2=0x7f05140b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519715700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b0b80 0x7f05140b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519715700 1 -- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05140a9190 msgr2=0x7f05140ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519715700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05140a9190 0x7f05140ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519715700 1 -- 172.21.15.12:0/62973795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050400b1e0 con 0x7f05140b03d0 2021-10-20T23:21:52.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0519715700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b03d0 0x7f05141559b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f0514142390 tx=0x7f0504015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:52.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0502ffd700 1 -- 172.21.15.12:0/62973795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05040116e0 con 0x7f05140b03d0 2021-10-20T23:21:52.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0502ffd700 1 -- 172.21.15.12:0/62973795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504011840 con 0x7f05140b03d0 2021-10-20T23:21:52.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f0502ffd700 1 -- 172.21.15.12:0/62973795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0504011ba0 con 0x7f05140b03d0 2021-10-20T23:21:52.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05140b45f0 con 0x7f05140b03d0 2021-10-20T23:21:52.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.200+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0514143820 con 0x7f05140b03d0 2021-10-20T23:21:52.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.204+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051405caf0 con 0x7f05140b03d0 2021-10-20T23:21:52.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.204+0000 7f0502ffd700 1 -- 172.21.15.12:0/62973795 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f050401a040 con 0x7f05140b03d0 2021-10-20T23:21:52.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.204+0000 7f0502ffd700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04f40534f0 0x7f04f40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.204+0000 7f0502ffd700 1 -- 172.21.15.12:0/62973795 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f050406c6c0 con 0x7f05140b03d0 2021-10-20T23:21:52.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.204+0000 7f0519f16700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04f40534f0 0x7f04f40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.204+0000 7f0519f16700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04f40534f0 0x7f04f40559b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f0510008000 tx=0x7f0510008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:52.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.208+0000 7f0502ffd700 1 -- 172.21.15.12:0/62973795 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05040436c0 con 0x7f05140b03d0 2021-10-20T23:21:52.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.376+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0514057350 con 0x7f05140b03d0 2021-10-20T23:21:52.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.384+0000 7f0502ffd700 1 -- 172.21.15.12:0/62973795 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f05040230e0 con 0x7f05140b03d0 2021-10-20T23:21:52.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.384+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04f40534f0 msgr2=0x7f04f40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.384+0000 7f051af18700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04f40534f0 0x7f04f40559b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f0510008000 tx=0x7f0510008040).stop 2021-10-20T23:21:52.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.384+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b03d0 msgr2=0x7f05141559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.384+0000 7f051af18700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b03d0 0x7f05141559b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f0514142390 tx=0x7f0504015000).stop 2021-10-20T23:21:52.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.388+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 shutdown_connections 2021-10-20T23:21:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.388+0000 7f051af18700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04f40534f0 0x7f04f40559b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.388+0000 7f051af18700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05140b0b80 0x7f05140b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.388+0000 7f051af18700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05140b03d0 0x7f05141559b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.388+0000 7f051af18700 1 --2- 172.21.15.12:0/62973795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05140a9190 0x7f05140ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.388+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 >> 172.21.15.12:0/62973795 conn(0x7f0514061140 msgr2=0x7f05140aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.388+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 shutdown_connections 2021-10-20T23:21:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.388+0000 7f051af18700 1 -- 172.21.15.12:0/62973795 wait complete. 2021-10-20T23:21:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:21:52.404 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:21:52.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d681f700 1 Processor -- start 2021-10-20T23:21:52.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d681f700 1 -- start start 2021-10-20T23:21:52.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d681f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35d00b65c0 0x7f35d00b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d681f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00acc90 con 0x7f35d01450c0 2021-10-20T23:21:52.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d681f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00ae560 con 0x7f35d0060d70 2021-10-20T23:21:52.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d681f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d01446e0 con 0x7f35d00b65c0 2021-10-20T23:21:52.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35cffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35d00b65c0 0x7f35d00b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d4dbc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f35d01450c0 0x7f35d013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37340/0 (socket says 172.21.15.12:37340) 2021-10-20T23:21:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d4dbc700 1 -- 172.21.15.12:0/3245963116 learned_addr learned my addr 172.21.15.12:0/3245963116 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35cffff700 1 -- 172.21.15.12:0/3245963116 >> v1:172.21.15.31:6789/0 conn(0x7f35d0060d70 legacy=0x7f35d0141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35cffff700 1 -- 172.21.15.12:0/3245963116 >> v1:172.21.15.12:6789/0 conn(0x7f35d01450c0 legacy=0x7f35d013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35cf7fe700 1 -- 172.21.15.12:0/3245963116 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133174363 0 0) 0x7f35d00acc90 con 0x7f35d01450c0 2021-10-20T23:21:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35cffff700 1 -- 172.21.15.12:0/3245963116 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0144980 con 0x7f35d00b65c0 2021-10-20T23:21:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35cffff700 1 --2- 172.21.15.12:0/3245963116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 0x7f35d00b69a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f35c0002f70 tx=0x7f35c0006df0).ready entity=mon.0 client_cookie=987581a9b353e112 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35cf7fe700 1 -- 172.21.15.12:0/3245963116 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c000d610 con 0x7f35d00b65c0 2021-10-20T23:21:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35cf7fe700 1 -- 172.21.15.12:0/3245963116 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0000e90 con 0x7f35d00b65c0 2021-10-20T23:21:52.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35cf7fe700 1 -- 172.21.15.12:0/3245963116 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c000d960 con 0x7f35d00b65c0 2021-10-20T23:21:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d681f700 1 -- 172.21.15.12:0/3245963116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 msgr2=0x7f35d00b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.516+0000 7f35d681f700 1 --2- 172.21.15.12:0/3245963116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 0x7f35d00b69a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f35c0002f70 tx=0x7f35c0006df0).stop 2021-10-20T23:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 -- 172.21.15.12:0/3245963116 shutdown_connections 2021-10-20T23:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 --2- 172.21.15.12:0/3245963116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 0x7f35d00b69a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 -- 172.21.15.12:0/3245963116 >> 172.21.15.12:0/3245963116 conn(0x7f35d00b3480 msgr2=0x7f35d00b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 -- 172.21.15.12:0/3245963116 shutdown_connections 2021-10-20T23:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 -- 172.21.15.12:0/3245963116 wait complete. 2021-10-20T23:21:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 Processor -- start 2021-10-20T23:21:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 -- start start 2021-10-20T23:21:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35d0060d70 0x7f35d01440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 0x7f35d00b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d01450c0 0x7f35d00b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00af6c0 con 0x7f35d00b65c0 2021-10-20T23:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00af8b0 con 0x7f35d01450c0 2021-10-20T23:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d681f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00b1e40 con 0x7f35d0060d70 2021-10-20T23:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 0x7f35d00b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 0x7f35d00b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38750/0 (socket says 172.21.15.12:38750) 2021-10-20T23:21:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35cffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35d0060d70 0x7f35d01440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35c77fe700 1 -- 172.21.15.12:0/2214292187 learned_addr learned my addr 172.21.15.12:0/2214292187 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d4dbc700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d01450c0 0x7f35d00b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35c77fe700 1 -- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35d0060d70 msgr2=0x7f35d01440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35c77fe700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35d0060d70 0x7f35d01440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35c77fe700 1 -- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d01450c0 msgr2=0x7f35d00b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35c77fe700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d01450c0 0x7f35d00b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35c77fe700 1 -- 172.21.15.12:0/2214292187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c000b180 con 0x7f35d00b65c0 2021-10-20T23:21:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35cffff700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35d0060d70 0x7f35d01440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.520+0000 7f35d4dbc700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d01450c0 0x7f35d00b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35c77fe700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 0x7f35d00b0fc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f35d00b3990 tx=0x7f35b8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35cdffb700 1 -- 172.21.15.12:0/2214292187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b8012400 con 0x7f35d00b65c0 2021-10-20T23:21:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35cdffb700 1 -- 172.21.15.12:0/2214292187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8012560 con 0x7f35d00b65c0 2021-10-20T23:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d00b20e0 con 0x7f35d00b65c0 2021-10-20T23:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35cdffb700 1 -- 172.21.15.12:0/2214292187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b80128c0 con 0x7f35d00b65c0 2021-10-20T23:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d013bc90 con 0x7f35d00b65c0 2021-10-20T23:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35cdffb700 1 -- 172.21.15.12:0/2214292187 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35b8019030 con 0x7f35d00b65c0 2021-10-20T23:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d00b2270 con 0x7f35d00b65c0 2021-10-20T23:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35cdffb700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35b4053610 0x7f35b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35cdffb700 1 -- 172.21.15.12:0/2214292187 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f35b806adb0 con 0x7f35d00b65c0 2021-10-20T23:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35cffff700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35b4053610 0x7f35b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.524+0000 7f35cffff700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35b4053610 0x7f35b4055ad0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f35c001c000 tx=0x7f35c0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.528+0000 7f35cdffb700 1 -- 172.21.15.12:0/2214292187 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35b8041db0 con 0x7f35d00b65c0 2021-10-20T23:21:52.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.692+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f35d0144c20 con 0x7f35d00b65c0 2021-10-20T23:21:52.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35cdffb700 1 -- 172.21.15.12:0/2214292187 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f35b80453d0 con 0x7f35d00b65c0 2021-10-20T23:21:52.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35b4053610 msgr2=0x7f35b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35b4053610 0x7f35b4055ad0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f35c001c000 tx=0x7f35c0015000).stop 2021-10-20T23:21:52.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 msgr2=0x7f35d00b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 0x7f35d00b0fc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f35d00b3990 tx=0x7f35b8007c50).stop 2021-10-20T23:21:52.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 shutdown_connections 2021-10-20T23:21:52.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35b4053610 0x7f35b4055ad0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d01450c0 0x7f35d00b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35d00b65c0 0x7f35d00b0fc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 --2- 172.21.15.12:0/2214292187 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35d0060d70 0x7f35d01440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 >> 172.21.15.12:0/2214292187 conn(0x7f35d00b3480 msgr2=0x7f35d013acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:52.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 shutdown_connections 2021-10-20T23:21:52.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.700+0000 7f35d681f700 1 -- 172.21.15.12:0/2214292187 wait complete. 2021-10-20T23:21:52.707 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:21:52.718 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:21:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe050f99700 1 Processor -- start 2021-10-20T23:21:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe050f99700 1 -- start start 2021-10-20T23:21:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe050f99700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe04c0b2580 0x7fe04c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe050f99700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c0a70c0 con 0x7fe04c0a8ac0 2021-10-20T23:21:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe050f99700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c0a72f0 con 0x7fe04c0b0010 2021-10-20T23:21:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe050f99700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0a7590 con 0x7fe04c0b2580 2021-10-20T23:21:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe04bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe04c0a8ac0 0x7fe04c151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37352/0 (socket says 172.21.15.12:37352) 2021-10-20T23:21:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe04bfff700 1 -- 172.21.15.12:0/1173366440 learned_addr learned my addr 172.21.15.12:0/1173366440 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe04b7fe700 1 --2- 172.21.15.12:0/1173366440 >> v2:172.21.15.31:3300/0 conn(0x7fe04c0b2580 0x7fe04c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.816+0000 7fe04a7fc700 1 -- 172.21.15.12:0/1173366440 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040577436 0 0) 0x7fe04c0a70c0 con 0x7fe04c0a8ac0 2021-10-20T23:21:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe04a7fc700 1 -- 172.21.15.12:0/1173366440 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe038003260 con 0x7fe04c0a8ac0 2021-10-20T23:21:52.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe04b7fe700 1 -- 172.21.15.12:0/1173366440 >> v1:172.21.15.31:6789/0 conn(0x7fe04c0b0010 legacy=0x7fe04c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe04b7fe700 1 -- 172.21.15.12:0/1173366440 >> v1:172.21.15.12:6789/0 conn(0x7fe04c0a8ac0 legacy=0x7fe04c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe04b7fe700 1 -- 172.21.15.12:0/1173366440 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0a7830 con 0x7fe04c0b2580 2021-10-20T23:21:52.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe04b7fe700 1 --2- 172.21.15.12:0/1173366440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe04c0b2580 0x7fe04c14ae40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fe0440032f0 tx=0x7fe0440091d0).ready entity=mon.1 client_cookie=5d3bb4490084de55 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:52.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe04a7fc700 1 -- 172.21.15.12:0/1173366440 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe04400b6c0 con 0x7fe04c0b2580 2021-10-20T23:21:52.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe04a7fc700 1 -- 172.21.15.12:0/1173366440 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400b820 con 0x7fe04c0b2580 2021-10-20T23:21:52.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe04a7fc700 1 -- 172.21.15.12:0/1173366440 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe04400b990 con 0x7fe04c0b2580 2021-10-20T23:21:52.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe050f99700 1 -- 172.21.15.12:0/1173366440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe04c0b2580 msgr2=0x7fe04c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe050f99700 1 --2- 172.21.15.12:0/1173366440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe04c0b2580 0x7fe04c14ae40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fe0440032f0 tx=0x7fe0440091d0).stop 2021-10-20T23:21:52.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe050f99700 1 -- 172.21.15.12:0/1173366440 shutdown_connections 2021-10-20T23:21:52.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe050f99700 1 --2- 172.21.15.12:0/1173366440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe04c0b2580 0x7fe04c14ae40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe050f99700 1 -- 172.21.15.12:0/1173366440 >> 172.21.15.12:0/1173366440 conn(0x7fe04c060180 msgr2=0x7fe04c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:52.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe050f99700 1 -- 172.21.15.12:0/1173366440 shutdown_connections 2021-10-20T23:21:52.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe050f99700 1 -- 172.21.15.12:0/1173366440 wait complete. 2021-10-20T23:21:52.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe050f99700 1 Processor -- start 2021-10-20T23:21:52.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.820+0000 7fe050f99700 1 -- start start 2021-10-20T23:21:52.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe050f99700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe04c0a8ac0 0x7fe04c0ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe050f99700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe04c0b0010 0x7fe04c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe050f99700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe04c0b2580 0x7fe04c1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe050f99700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0a93f0 con 0x7fe04c0b0010 2021-10-20T23:21:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe050f99700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0a9620 con 0x7fe04c0a8ac0 2021-10-20T23:21:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe050f99700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0a98c0 con 0x7fe04c0b2580 2021-10-20T23:21:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe04c0b0010 0x7fe04c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe04c0b0010 0x7fe04c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38764/0 (socket says 172.21.15.12:38764) 2021-10-20T23:21:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04affd700 1 -- 172.21.15.12:0/823086336 learned_addr learned my addr 172.21.15.12:0/823086336 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04b7fe700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe04c0a8ac0 0x7fe04c0ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04bfff700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe04c0b2580 0x7fe04c1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04affd700 1 -- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe04c0b2580 msgr2=0x7fe04c1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04affd700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe04c0b2580 0x7fe04c1567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04affd700 1 -- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe04c0a8ac0 msgr2=0x7fe04c0ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04affd700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe04c0a8ac0 0x7fe04c0ab850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04affd700 1 -- 172.21.15.12:0/823086336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044009470 con 0x7fe04c0b0010 2021-10-20T23:21:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe04affd700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe04c0b0010 0x7fe04c0b3940 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fe04c061a80 tx=0x7fe040007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe048ff9700 1 -- 172.21.15.12:0/823086336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe040007030 con 0x7fe04c0b0010 2021-10-20T23:21:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe048ff9700 1 -- 172.21.15.12:0/823086336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe040007190 con 0x7fe04c0b0010 2021-10-20T23:21:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c0b3e30 con 0x7fe04c0b0010 2021-10-20T23:21:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe048ff9700 1 -- 172.21.15.12:0/823086336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe040006510 con 0x7fe04c0b0010 2021-10-20T23:21:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c0aa130 con 0x7fe04c0b0010 2021-10-20T23:21:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.824+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c0a9ac0 con 0x7fe04c0b0010 2021-10-20T23:21:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.828+0000 7fe048ff9700 1 -- 172.21.15.12:0/823086336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe040010030 con 0x7fe04c0b0010 2021-10-20T23:21:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.828+0000 7fe048ff9700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe02c0534f0 0x7fe02c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.828+0000 7fe048ff9700 1 -- 172.21.15.12:0/823086336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe04006b700 con 0x7fe04c0b0010 2021-10-20T23:21:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.828+0000 7fe04b7fe700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe02c0534f0 0x7fe02c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.828+0000 7fe04b7fe700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe02c0534f0 0x7fe02c0559b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fe04401b000 tx=0x7fe044016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:52.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.832+0000 7fe048ff9700 1 -- 172.21.15.12:0/823086336 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe0400425f0 con 0x7fe04c0b0010 2021-10-20T23:21:53.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:52.996+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe04c057350 con 0x7fe04c0b0010 2021-10-20T23:21:53.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe048ff9700 1 -- 172.21.15.12:0/823086336 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2491 (secure 0 0 0) 0x7fe040045c10 con 0x7fe04c0b0010 2021-10-20T23:21:53.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:53.003 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:21:50.499039+0000","modified":"2021-10-20T23:21:51.501920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5233":{"gid":5233,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2510327912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2510327912},{"type":"v1","addr":"172.21.15.31:6835","nonce":2510327912}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-20T23:21:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe02c0534f0 msgr2=0x7fe02c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe02c0534f0 0x7fe02c0559b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fe04401b000 tx=0x7fe044016000).stop 2021-10-20T23:21:53.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe04c0b0010 msgr2=0x7fe04c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe04c0b0010 0x7fe04c0b3940 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fe04c061a80 tx=0x7fe040007bb0).stop 2021-10-20T23:21:53.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 shutdown_connections 2021-10-20T23:21:53.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe02c0534f0 0x7fe02c0559b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe04c0b2580 0x7fe04c1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe04c0b0010 0x7fe04c0b3940 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 --2- 172.21.15.12:0/823086336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe04c0a8ac0 0x7fe04c0ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 >> 172.21.15.12:0/823086336 conn(0x7fe04c060180 msgr2=0x7fe04c148430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 shutdown_connections 2021-10-20T23:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.000+0000 7fe050f99700 1 -- 172.21.15.12:0/823086336 wait complete. 2021-10-20T23:21:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 19 2021-10-20T23:21:53.318 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:21:50.499039+0000', 'modified': '2021-10-20T23:21:51.501920+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5233}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5233': {'gid': 5233, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/2510327912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 2510327912}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2510327912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:21:53.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:21:53.319 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:21:53.439 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":5233,"want_state":"up:active","state":"up:active","rank_uptime":2.9280703539999999,"mdsmap_epoch":19,"osdmap_epoch":48,"osdmap_epoch_barrier":46,"uptime":7.7189544640000003} 2021-10-20T23:21:53.439 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 5233, "mdsmap_epoch": 19, "osdmap_epoch": 48, "osdmap_epoch_barrier": 46, "rank_uptime": 2.928070354, "state": "up:active", "uptime": 7.718954464, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:21:53.440 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:21:53.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 Processor -- start 2021-10-20T23:21:53.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 -- start start 2021-10-20T23:21:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7a00b43c0 0x7fb7a00b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a01440b0 con 0x7fb7a00b6580 2021-10-20T23:21:53.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a0143b70 con 0x7fb7a00b6960 2021-10-20T23:21:53.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a0143e10 con 0x7fb7a00b43c0 2021-10-20T23:21:53.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb797fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7a00b43c0 0x7fb7a00b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb79e59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb7a00b6580 0x7fb7a0061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37364/0 (socket says 172.21.15.12:37364) 2021-10-20T23:21:53.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb79e59c700 1 -- 172.21.15.12:0/2181905438 learned_addr learned my addr 172.21.15.12:0/2181905438 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:53.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb797fff700 1 -- 172.21.15.12:0/2181905438 >> v1:172.21.15.31:6789/0 conn(0x7fb7a00b6960 legacy=0x7fb7a012ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:53.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb797fff700 1 -- 172.21.15.12:0/2181905438 >> v1:172.21.15.12:6789/0 conn(0x7fb7a00b6580 legacy=0x7fb7a0061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb797fff700 1 -- 172.21.15.12:0/2181905438 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a00615f0 con 0x7fb7a00b43c0 2021-10-20T23:21:53.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb797fff700 1 --2- 172.21.15.12:0/2181905438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b43c0 0x7fb7a00b5bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fb7a00608b0 tx=0x7fb788006df0).ready entity=mon.0 client_cookie=5c1fe5bcf3c984ba server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb79dd9b700 1 -- 172.21.15.12:0/2181905438 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb78800d5c0 con 0x7fb7a00b43c0 2021-10-20T23:21:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb79dd9b700 1 -- 172.21.15.12:0/2181905438 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788000e90 con 0x7fb7a00b43c0 2021-10-20T23:21:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb79dd9b700 1 -- 172.21.15.12:0/2181905438 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb78800d910 con 0x7fb7a00b43c0 2021-10-20T23:21:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/2181905438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b43c0 msgr2=0x7fb7a00b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 --2- 172.21.15.12:0/2181905438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b43c0 0x7fb7a00b5bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fb7a00608b0 tx=0x7fb788006df0).stop 2021-10-20T23:21:53.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/2181905438 shutdown_connections 2021-10-20T23:21:53.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.548+0000 7fb7a4a1a700 1 --2- 172.21.15.12:0/2181905438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b43c0 0x7fb7a00b5bf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/2181905438 >> 172.21.15.12:0/2181905438 conn(0x7fb7a005c490 msgr2=0x7fb7a005c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:53.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/2181905438 shutdown_connections 2021-10-20T23:21:53.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/2181905438 wait complete. 2021-10-20T23:21:53.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 Processor -- start 2021-10-20T23:21:53.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 -- start start 2021-10-20T23:21:53.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7a00b43c0 0x7fb7a01264a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a00b6580 0x7fb7a0148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b6960 0x7fb7a0148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00b2b60 con 0x7fb7a00b6960 2021-10-20T23:21:53.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00b3a10 con 0x7fb7a00b6580 2021-10-20T23:21:53.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb7a4a1a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00b2d90 con 0x7fb7a00b43c0 2021-10-20T23:21:53.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b6960 0x7fb7a0148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b6960 0x7fb7a0148e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38780/0 (socket says 172.21.15.12:38780) 2021-10-20T23:21:53.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79ed9d700 1 -- 172.21.15.12:0/3797778463 learned_addr learned my addr 172.21.15.12:0/3797778463 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:53.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb797fff700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a00b6580 0x7fb7a0148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79e59c700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7a00b43c0 0x7fb7a01264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79ed9d700 1 -- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7a00b43c0 msgr2=0x7fb7a01264a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79ed9d700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7a00b43c0 0x7fb7a01264a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79ed9d700 1 -- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a00b6580 msgr2=0x7fb7a0148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79ed9d700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a00b6580 0x7fb7a0148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79ed9d700 1 -- 172.21.15.12:0/3797778463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78800b180 con 0x7fb7a00b6960 2021-10-20T23:21:53.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb797fff700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a00b6580 0x7fb7a0148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.552+0000 7fb79ed9d700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b6960 0x7fb7a0148e50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fb7980032b0 tx=0x7fb7980090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb7977fe700 1 -- 172.21.15.12:0/3797778463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb79800d4a0 con 0x7fb7a00b6960 2021-10-20T23:21:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb7977fe700 1 -- 172.21.15.12:0/3797778463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79800d600 con 0x7fb7a00b6960 2021-10-20T23:21:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a00b3030 con 0x7fb7a00b6960 2021-10-20T23:21:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb7977fe700 1 -- 172.21.15.12:0/3797778463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb79800d960 con 0x7fb7a00b6960 2021-10-20T23:21:53.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a00b3570 con 0x7fb7a00b6960 2021-10-20T23:21:53.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a00b3770 con 0x7fb7a00b6960 2021-10-20T23:21:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb7977fe700 1 -- 172.21.15.12:0/3797778463 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb798018030 con 0x7fb7a00b6960 2021-10-20T23:21:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb7977fe700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb784053610 0x7fb784055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb7977fe700 1 -- 172.21.15.12:0/3797778463 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb79806b2e0 con 0x7fb7a00b6960 2021-10-20T23:21:53.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.556+0000 7fb79e59c700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb784053610 0x7fb784055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.560+0000 7fb79e59c700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb784053610 0x7fb784055ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb79000b000 tx=0x7fb790009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:53.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.564+0000 7fb7977fe700 1 -- 172.21.15.12:0/3797778463 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb7a00b3770 con 0x7fb7a00b6960 2021-10-20T23:21:53.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.696+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7a00b3770 con 0x7fb7a00b6960 2021-10-20T23:21:53.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:53.705 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":48,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:21:52.512426+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:21:48.487958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-20T23:21:49.501193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:21:53.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.696+0000 7fb7977fe700 1 -- 172.21.15.12:0/3797778463 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16271 (secure 0 0 0) 0x7fb798023fa0 con 0x7fb7a00b6960 2021-10-20T23:21:53.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb784053610 msgr2=0x7fb784055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb784053610 0x7fb784055ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb79000b000 tx=0x7fb790009040).stop 2021-10-20T23:21:53.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b6960 msgr2=0x7fb7a0148e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b6960 0x7fb7a0148e50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fb7980032b0 tx=0x7fb7980090f0).stop 2021-10-20T23:21:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 shutdown_connections 2021-10-20T23:21:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb784053610 0x7fb784055ad0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7a00b6960 0x7fb7a0148e50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a00b6580 0x7fb7a0148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 --2- 172.21.15.12:0/3797778463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7a00b43c0 0x7fb7a01264a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 >> 172.21.15.12:0/3797778463 conn(0x7fb7a005c490 msgr2=0x7fb7a0141ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 shutdown_connections 2021-10-20T23:21:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.700+0000 7fb7a4a1a700 1 -- 172.21.15.12:0/3797778463 wait complete. 2021-10-20T23:21:53.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:21:48.487958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:21:49.501193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:21:53.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:21:53.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.824+0000 7f9246c8a700 1 Processor -- start 2021-10-20T23:21:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.824+0000 7f9246c8a700 1 -- start start 2021-10-20T23:21:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f92400b0710 0x7f9240142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400ace70 0x7f924013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9240143920 con 0x7f92400b30d0 2021-10-20T23:21:53.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400b0af0 con 0x7f92400b0710 2021-10-20T23:21:53.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400ae680 con 0x7f92400ace70 2021-10-20T23:21:53.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9245487700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f92400b30d0 0x7f9240143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37382/0 (socket says 172.21.15.12:37382) 2021-10-20T23:21:53.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9245487700 1 -- 172.21.15.12:0/169516433 learned_addr learned my addr 172.21.15.12:0/169516433 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:53.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9245c88700 1 --2- 172.21.15.12:0/169516433 >> v2:172.21.15.31:3300/0 conn(0x7f92400b0710 0x7f9240142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246489700 1 --2- 172.21.15.12:0/169516433 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400ace70 0x7f924013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9244c86700 1 -- 172.21.15.12:0/169516433 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661689335 0 0) 0x7f9240143920 con 0x7f92400b30d0 2021-10-20T23:21:53.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9244c86700 1 -- 172.21.15.12:0/169516433 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9228003260 con 0x7f92400b30d0 2021-10-20T23:21:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246489700 1 -- 172.21.15.12:0/169516433 >> v2:172.21.15.31:3300/0 conn(0x7f92400b0710 msgr2=0x7f9240142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246489700 1 --2- 172.21.15.12:0/169516433 >> v2:172.21.15.31:3300/0 conn(0x7f92400b0710 0x7f9240142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246489700 1 -- 172.21.15.12:0/169516433 >> v1:172.21.15.12:6789/0 conn(0x7f92400b30d0 legacy=0x7f9240143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9244c86700 1 -- 172.21.15.12:0/169516433 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4180580537 0 0) 0x7f9228003260 con 0x7f92400b30d0 2021-10-20T23:21:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246489700 1 -- 172.21.15.12:0/169516433 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400ae920 con 0x7f92400ace70 2021-10-20T23:21:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9245c88700 1 --2- 172.21.15.12:0/169516433 >> v2:172.21.15.31:3300/0 conn(0x7f92400b0710 0x7f9240142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246489700 1 --2- 172.21.15.12:0/169516433 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400ace70 0x7f924013f8a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f92380032f0 tx=0x7f923800a370).ready entity=mon.2 client_cookie=39388379759deb9d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9244c86700 1 -- 172.21.15.12:0/169516433 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923800cba0 con 0x7f92400ace70 2021-10-20T23:21:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9244c86700 1 -- 172.21.15.12:0/169516433 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923800cd00 con 0x7f92400ace70 2021-10-20T23:21:53.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9244c86700 1 -- 172.21.15.12:0/169516433 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9238010600 con 0x7f92400ace70 2021-10-20T23:21:53.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 -- 172.21.15.12:0/169516433 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400ace70 msgr2=0x7f924013f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 --2- 172.21.15.12:0/169516433 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400ace70 0x7f924013f8a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f92380032f0 tx=0x7f923800a370).stop 2021-10-20T23:21:53.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 -- 172.21.15.12:0/169516433 shutdown_connections 2021-10-20T23:21:53.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 --2- 172.21.15.12:0/169516433 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400ace70 0x7f924013f8a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 --2- 172.21.15.12:0/169516433 >> v2:172.21.15.31:3300/0 conn(0x7f92400b0710 0x7f9240142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 -- 172.21.15.12:0/169516433 >> 172.21.15.12:0/169516433 conn(0x7f9240061140 msgr2=0x7f9240062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:53.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 -- 172.21.15.12:0/169516433 shutdown_connections 2021-10-20T23:21:53.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.828+0000 7f9246c8a700 1 -- 172.21.15.12:0/169516433 wait complete. 2021-10-20T23:21:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9246c8a700 1 Processor -- start 2021-10-20T23:21:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9246c8a700 1 -- start start 2021-10-20T23:21:53.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9246c8a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400ace70 0x7f92400ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9246c8a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92400b0710 0x7f9240155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9246c8a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400b30d0 0x7f92401563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9246c8a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9240064e80 con 0x7f92400b0710 2021-10-20T23:21:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9246c8a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9240065120 con 0x7f92400ace70 2021-10-20T23:21:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9246c8a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400653c0 con 0x7f92400b30d0 2021-10-20T23:21:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9245487700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92400b0710 0x7f9240155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9245487700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92400b0710 0x7f9240155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38792/0 (socket says 172.21.15.12:38792) 2021-10-20T23:21:53.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9245487700 1 -- 172.21.15.12:0/2569015688 learned_addr learned my addr 172.21.15.12:0/2569015688 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:53.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9245c88700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400ace70 0x7f92400ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9246489700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400b30d0 0x7f92401563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9245487700 1 -- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400b30d0 msgr2=0x7f92401563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9245487700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400b30d0 0x7f92401563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9245487700 1 -- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400ace70 msgr2=0x7f92400ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9245487700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400ace70 0x7f92400ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.832+0000 7f9245487700 1 -- 172.21.15.12:0/2569015688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c00b180 con 0x7f92400b0710 2021-10-20T23:21:53.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f9245487700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92400b0710 0x7f9240155ec0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f9230000ed0 tx=0x7f9230007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:53.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f922effd700 1 -- 172.21.15.12:0/2569015688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923000ce30 con 0x7f92400b0710 2021-10-20T23:21:53.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f922effd700 1 -- 172.21.15.12:0/2569015688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9230007170 con 0x7f92400b0710 2021-10-20T23:21:53.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923800a610 con 0x7f92400b0710 2021-10-20T23:21:53.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f922effd700 1 -- 172.21.15.12:0/2569015688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9230004520 con 0x7f92400b0710 2021-10-20T23:21:53.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9240155810 con 0x7f92400b0710 2021-10-20T23:21:53.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92401524e0 con 0x7f92400b0710 2021-10-20T23:21:53.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f922effd700 1 -- 172.21.15.12:0/2569015688 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9230004680 con 0x7f92400b0710 2021-10-20T23:21:53.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f922effd700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92200534f0 0x7f92200559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:53.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f922effd700 1 -- 172.21.15.12:0/2569015688 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f923006b370 con 0x7f92400b0710 2021-10-20T23:21:53.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.836+0000 7f9245c88700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92200534f0 0x7f92200559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:53.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.840+0000 7f9245c88700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92200534f0 0x7f92200559b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f923c00b000 tx=0x7f923c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:53.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.844+0000 7f922effd700 1 -- 172.21.15.12:0/2569015688 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92300422d0 con 0x7f92400b0710 2021-10-20T23:21:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9240057350 con 0x7f92400b0710 2021-10-20T23:21:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f922effd700 1 -- 172.21.15.12:0/2569015688 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v48) v1 ==== 110+0+10 (secure 0 0 0) 0x7f92300458f0 con 0x7f92400b0710 2021-10-20T23:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:21:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92200534f0 msgr2=0x7f92200559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92200534f0 0x7f92200559b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f923c00b000 tx=0x7f923c006df0).stop 2021-10-20T23:21:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92400b0710 msgr2=0x7f9240155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92400b0710 0x7f9240155ec0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f9230000ed0 tx=0x7f9230007a70).stop 2021-10-20T23:21:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 shutdown_connections 2021-10-20T23:21:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92200534f0 0x7f92200559b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92400b30d0 0x7f92401563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92400b0710 0x7f9240155ec0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 --2- 172.21.15.12:0/2569015688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400ace70 0x7f92400ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 >> 172.21.15.12:0/2569015688 conn(0x7f9240061140 msgr2=0x7f92401408b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 shutdown_connections 2021-10-20T23:21:53.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:53.972+0000 7f9246c8a700 1 -- 172.21.15.12:0/2569015688 wait complete. 2021-10-20T23:21:53.989 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:21:54.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.096+0000 7f27f0c4d700 1 Processor -- start 2021-10-20T23:21:54.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.096+0000 7f27f0c4d700 1 -- start start 2021-10-20T23:21:54.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27f0c4d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0b1980 0x7f27ec0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27f0c4d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec140090 con 0x7f27ec0616d0 2021-10-20T23:21:54.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27f0c4d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec140330 con 0x7f27ec060b30 2021-10-20T23:21:54.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27f0c4d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec060fc0 con 0x7f27ec0b1980 2021-10-20T23:21:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e3fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f27ec0616d0 0x7f27ec139ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37394/0 (socket says 172.21.15.12:37394) 2021-10-20T23:21:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e3fff700 1 -- 172.21.15.12:0/305891367 learned_addr learned my addr 172.21.15.12:0/305891367 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ea59c700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0b1980 0x7f27ec0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035724554 0 0) 0x7f27ec140090 con 0x7f27ec0616d0 2021-10-20T23:21:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27cc003260 con 0x7f27ec0616d0 2021-10-20T23:21:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582557630 0 0) 0x7f27ec140330 con 0x7f27ec060b30 2021-10-20T23:21:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ec140090 con 0x7f27ec060b30 2021-10-20T23:21:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 23100623 0 0) 0x7f27cc003260 con 0x7f27ec0616d0 2021-10-20T23:21:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0b1980 msgr2=0x7f27ec0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0b1980 0x7f27ec0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 >> v1:172.21.15.31:6789/0 conn(0x7f27ec060b30 legacy=0x7f27ec05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec1405d0 con 0x7f27ec0616d0 2021-10-20T23:21:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f27d4001660 con 0x7f27ec0616d0 2021-10-20T23:21:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ea59c700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0b1980 0x7f27ec0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:21:54.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 >> v1:172.21.15.12:6789/0 conn(0x7f27ec0616d0 legacy=0x7f27ec139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc003910 0x7f27cc003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0b1980 0x7f27cc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27cc0049f0 0x7f27cc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec060fc0 con 0x7f27cc0049f0 2021-10-20T23:21:54.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc00b750 con 0x7f27cc003910 2021-10-20T23:21:54.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc00db20 con 0x7f27ec0b1980 2021-10-20T23:21:54.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ead9d700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27cc0049f0 0x7f27cc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ea59c700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc003910 0x7f27cc003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e3fff700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0b1980 0x7f27cc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ead9d700 1 -- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0b1980 msgr2=0x7f27cc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ead9d700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0b1980 0x7f27cc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ead9d700 1 -- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc003910 msgr2=0x7f27cc003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ead9d700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc003910 0x7f27cc003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ead9d700 1 -- 172.21.15.12:0/305891367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc00b180 con 0x7f27cc0049f0 2021-10-20T23:21:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ead9d700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27cc0049f0 0x7f27cc004e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f27e4001490 tx=0x7f27e4007d80).ready entity=mon.0 client_cookie=a2738163909c0516 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e4001780 con 0x7f27cc0049f0 2021-10-20T23:21:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e4006890 con 0x7f27cc0049f0 2021-10-20T23:21:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27e9d9b700 1 -- 172.21.15.12:0/305891367 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e4006bf0 con 0x7f27cc0049f0 2021-10-20T23:21:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27f0c4d700 1 -- 172.21.15.12:0/305891367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27cc0049f0 msgr2=0x7f27cc004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27f0c4d700 1 --2- 172.21.15.12:0/305891367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27cc0049f0 0x7f27cc004e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f27e4001490 tx=0x7f27e4007d80).stop 2021-10-20T23:21:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27ead9d700 1 -- 172.21.15.12:0/305891367 reap_dead start 2021-10-20T23:21:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27f0c4d700 1 -- 172.21.15.12:0/305891367 shutdown_connections 2021-10-20T23:21:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.100+0000 7f27f0c4d700 1 -- 172.21.15.12:0/305891367 >> 172.21.15.12:0/305891367 conn(0x7f27ec0b2970 msgr2=0x7f27ec0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 -- 172.21.15.12:0/305891367 shutdown_connections 2021-10-20T23:21:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 -- 172.21.15.12:0/305891367 wait complete. 2021-10-20T23:21:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 Processor -- start 2021-10-20T23:21:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 -- start start 2021-10-20T23:21:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc0049f0 0x7f27ec0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0ae770 0x7f27ec066030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec066520 0x7f27ec14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec063ab0 con 0x7f27ec066520 2021-10-20T23:21:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1524e0 con 0x7f27cc0049f0 2021-10-20T23:21:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27f0c4d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1515c0 con 0x7f27ec0ae770 2021-10-20T23:21:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27ead9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec066520 0x7f27ec14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27ead9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec066520 0x7f27ec14dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38814/0 (socket says 172.21.15.12:38814) 2021-10-20T23:21:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27ead9d700 1 -- 172.21.15.12:0/2878142732 learned_addr learned my addr 172.21.15.12:0/2878142732 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27ea59c700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc0049f0 0x7f27ec0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27e3fff700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0ae770 0x7f27ec066030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27ead9d700 1 -- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0ae770 msgr2=0x7f27ec066030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27ead9d700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0ae770 0x7f27ec066030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27ead9d700 1 -- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc0049f0 msgr2=0x7f27ec0b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27ead9d700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc0049f0 0x7f27ec0b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.104+0000 7f27ead9d700 1 -- 172.21.15.12:0/2878142732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec151860 con 0x7f27ec066520 2021-10-20T23:21:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27ead9d700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec066520 0x7f27ec14dff0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f27ec0b03d0 tx=0x7f27e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27e37fe700 1 -- 172.21.15.12:0/2878142732 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e4001780 con 0x7f27ec066520 2021-10-20T23:21:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27e37fe700 1 -- 172.21.15.12:0/2878142732 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e4007860 con 0x7f27ec066520 2021-10-20T23:21:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec151b00 con 0x7f27ec066520 2021-10-20T23:21:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27e37fe700 1 -- 172.21.15.12:0/2878142732 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e4006ea0 con 0x7f27ec066520 2021-10-20T23:21:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec152040 con 0x7f27ec066520 2021-10-20T23:21:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec057350 con 0x7f27ec066520 2021-10-20T23:21:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27e37fe700 1 -- 172.21.15.12:0/2878142732 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f27e4025030 con 0x7f27ec066520 2021-10-20T23:21:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27e37fe700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f27d00534f0 0x7f27d00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27e37fe700 1 -- 172.21.15.12:0/2878142732 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f27e406cb20 con 0x7f27ec066520 2021-10-20T23:21:54.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27ea59c700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f27d00534f0 0x7f27d00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.108+0000 7f27ea59c700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f27d00534f0 0x7f27d00559b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f27dc00b000 tx=0x7f27dc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.116+0000 7f27e37fe700 1 -- 172.21.15.12:0/2878142732 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f27e4043a10 con 0x7f27ec066520 2021-10-20T23:21:54.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.248+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f27ec044650 con 0x7f27ec066520 2021-10-20T23:21:54.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.248+0000 7f27e37fe700 1 -- 172.21.15.12:0/2878142732 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7f27e4023070 con 0x7f27ec066520 2021-10-20T23:21:54.253 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:21:54.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f27d00534f0 msgr2=0x7f27d00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f27d00534f0 0x7f27d00559b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f27dc00b000 tx=0x7f27dc008040).stop 2021-10-20T23:21:54.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec066520 msgr2=0x7f27ec14dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec066520 0x7f27ec14dff0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f27ec0b03d0 tx=0x7f27e4016000).stop 2021-10-20T23:21:54.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 shutdown_connections 2021-10-20T23:21:54.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f27d00534f0 0x7f27d00559b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec066520 0x7f27ec14dff0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27ec0ae770 0x7f27ec066030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 --2- 172.21.15.12:0/2878142732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc0049f0 0x7f27ec0b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 >> 172.21.15.12:0/2878142732 conn(0x7f27ec0b2970 msgr2=0x7f27ec141200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:54.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 shutdown_connections 2021-10-20T23:21:54.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.252+0000 7f27f0c4d700 1 -- 172.21.15.12:0/2878142732 wait complete. 2021-10-20T23:21:54.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:21:54.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.368+0000 7f8a2ad2f700 1 Processor -- start 2021-10-20T23:21:54.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.368+0000 7f8a2ad2f700 1 -- start start 2021-10-20T23:21:54.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a240b4710 0x7f8a2413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a240b6910 con 0x7f8a241439a0 2021-10-20T23:21:54.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a240b6bb0 con 0x7f8a24061680 2021-10-20T23:21:54.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a240b9680 con 0x7f8a240b4710 2021-10-20T23:21:54.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2a52e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8a241439a0 0x7f8a24140290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37416/0 (socket says 172.21.15.12:37416) 2021-10-20T23:21:54.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2a52e700 1 -- 172.21.15.12:0/940083010 learned_addr learned my addr 172.21.15.12:0/940083010 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:54.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2952c700 1 --2- 172.21.15.12:0/940083010 >> v2:172.21.15.31:3300/0 conn(0x7f8a240b4710 0x7f8a2413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a28d2b700 1 -- 172.21.15.12:0/940083010 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199904173 0 0) 0x7f8a240b6910 con 0x7f8a241439a0 2021-10-20T23:21:54.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a28d2b700 1 -- 172.21.15.12:0/940083010 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a0c003260 con 0x7f8a241439a0 2021-10-20T23:21:54.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2952c700 1 -- 172.21.15.12:0/940083010 >> v1:172.21.15.31:6789/0 conn(0x7f8a24061680 legacy=0x7f8a240b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2952c700 1 -- 172.21.15.12:0/940083010 >> v1:172.21.15.12:6789/0 conn(0x7f8a241439a0 legacy=0x7f8a24140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2952c700 1 -- 172.21.15.12:0/940083010 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240b6e50 con 0x7f8a240b4710 2021-10-20T23:21:54.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2952c700 1 --2- 172.21.15.12:0/940083010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a240b4710 0x7f8a2413fda0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f8a14002f70 tx=0x7f8a14006df0).ready entity=mon.1 client_cookie=c4b996505593bd67 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a28d2b700 1 -- 172.21.15.12:0/940083010 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1400d610 con 0x7f8a240b4710 2021-10-20T23:21:54.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a28d2b700 1 -- 172.21.15.12:0/940083010 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a14000e90 con 0x7f8a240b4710 2021-10-20T23:21:54.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a28d2b700 1 -- 172.21.15.12:0/940083010 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1400d960 con 0x7f8a240b4710 2021-10-20T23:21:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/940083010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a240b4710 msgr2=0x7f8a2413fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 --2- 172.21.15.12:0/940083010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a240b4710 0x7f8a2413fda0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f8a14002f70 tx=0x7f8a14006df0).stop 2021-10-20T23:21:54.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/940083010 shutdown_connections 2021-10-20T23:21:54.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 --2- 172.21.15.12:0/940083010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a240b4710 0x7f8a2413fda0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/940083010 >> 172.21.15.12:0/940083010 conn(0x7f8a2406adf0 msgr2=0x7f8a2405f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/940083010 shutdown_connections 2021-10-20T23:21:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.372+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/940083010 wait complete. 2021-10-20T23:21:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 Processor -- start 2021-10-20T23:21:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 -- start start 2021-10-20T23:21:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a24061680 0x7f8a240af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a241439a0 0x7f8a2413e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a241132b0 0x7f8a2413e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24146b20 con 0x7f8a241132b0 2021-10-20T23:21:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24146420 con 0x7f8a241439a0 2021-10-20T23:21:54.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a240aff80 con 0x7f8a24061680 2021-10-20T23:21:54.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2a52e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a241132b0 0x7f8a2413e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2952c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a241439a0 0x7f8a2413e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2a52e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a241132b0 0x7f8a2413e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38828/0 (socket says 172.21.15.12:38828) 2021-10-20T23:21:54.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2a52e700 1 -- 172.21.15.12:0/3687391202 learned_addr learned my addr 172.21.15.12:0/3687391202 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:54.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a29d2d700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a24061680 0x7f8a240af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2a52e700 1 -- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a24061680 msgr2=0x7f8a240af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2a52e700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a24061680 0x7f8a240af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2a52e700 1 -- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a241439a0 msgr2=0x7f8a2413e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2a52e700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a241439a0 0x7f8a2413e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2a52e700 1 -- 172.21.15.12:0/3687391202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1400b180 con 0x7f8a241132b0 2021-10-20T23:21:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2a52e700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a241132b0 0x7f8a2413e680 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f8a240b0110 tx=0x7f8a1c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a12ffd700 1 -- 172.21.15.12:0/3687391202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1c005ba0 con 0x7f8a241132b0 2021-10-20T23:21:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a12ffd700 1 -- 172.21.15.12:0/3687391202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c005d00 con 0x7f8a241132b0 2021-10-20T23:21:54.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a240afce0 con 0x7f8a241132b0 2021-10-20T23:21:54.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a12ffd700 1 -- 172.21.15.12:0/3687391202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1c0072c0 con 0x7f8a241132b0 2021-10-20T23:21:54.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.376+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a24141620 con 0x7f8a241132b0 2021-10-20T23:21:54.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.380+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2413ed10 con 0x7f8a241132b0 2021-10-20T23:21:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.380+0000 7f8a12ffd700 1 -- 172.21.15.12:0/3687391202 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a1c01a060 con 0x7f8a241132b0 2021-10-20T23:21:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.380+0000 7f8a12ffd700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a04053610 0x7f8a04055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.380+0000 7f8a12ffd700 1 -- 172.21.15.12:0/3687391202 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8a1c06b440 con 0x7f8a241132b0 2021-10-20T23:21:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.380+0000 7f8a29d2d700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a04053610 0x7f8a04055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.380+0000 7f8a29d2d700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a04053610 0x7f8a04055ad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8a2000d000 tx=0x7f8a20007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.388+0000 7f8a12ffd700 1 -- 172.21.15.12:0/3687391202 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a1c042440 con 0x7f8a241132b0 2021-10-20T23:21:54.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.516+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a240b9870 con 0x7f8a241132b0 2021-10-20T23:21:54.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.516+0000 7f8a12ffd700 1 -- 172.21.15.12:0/3687391202 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8a1c018020 con 0x7f8a241132b0 2021-10-20T23:21:54.521 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:21:54.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a04053610 msgr2=0x7f8a04055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a04053610 0x7f8a04055ad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8a2000d000 tx=0x7f8a20007b90).stop 2021-10-20T23:21:54.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a241132b0 msgr2=0x7f8a2413e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a241132b0 0x7f8a2413e680 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f8a240b0110 tx=0x7f8a1c007e00).stop 2021-10-20T23:21:54.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 shutdown_connections 2021-10-20T23:21:54.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a04053610 0x7f8a04055ad0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a241132b0 0x7f8a2413e680 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a241439a0 0x7f8a2413e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 --2- 172.21.15.12:0/3687391202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a24061680 0x7f8a240af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 >> 172.21.15.12:0/3687391202 conn(0x7f8a2406adf0 msgr2=0x7f8a24141890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:54.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 shutdown_connections 2021-10-20T23:21:54.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.520+0000 7f8a2ad2f700 1 -- 172.21.15.12:0/3687391202 wait complete. 2021-10-20T23:21:54.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:21:54.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.636+0000 7fd001d7b700 1 Processor -- start 2021-10-20T23:21:54.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.636+0000 7fd001d7b700 1 -- start start 2021-10-20T23:21:54.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcffc0b6290 0x7fcffc061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcffc142e60 0x7fcffc1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc0b5f50 con 0x7fcffc0b4060 2021-10-20T23:21:54.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc0b1f70 con 0x7fcffc142e60 2021-10-20T23:21:54.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc0b2210 con 0x7fcffc0b6290 2021-10-20T23:21:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd00157a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcffc142e60 0x7fcffc1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd00157a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcffc142e60 0x7fcffc1432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38836/0 (socket says 172.21.15.12:38836) 2021-10-20T23:21:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd00157a700 1 -- 172.21.15.12:0/2921337454 learned_addr learned my addr 172.21.15.12:0/2921337454 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd000d79700 1 --2- 172.21.15.12:0/2921337454 >> v2:172.21.15.31:3300/0 conn(0x7fcffc0b6290 0x7fcffc061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd000d79700 1 -- 172.21.15.12:0/2921337454 >> v2:172.21.15.12:3300/0 conn(0x7fcffc142e60 msgr2=0x7fcffc1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:21:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd000d79700 1 --2- 172.21.15.12:0/2921337454 >> v2:172.21.15.12:3300/0 conn(0x7fcffc142e60 0x7fcffc1432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd000d79700 1 -- 172.21.15.12:0/2921337454 >> v1:172.21.15.31:6789/0 conn(0x7fcffc0b4060 legacy=0x7fcffc061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd000d79700 1 -- 172.21.15.12:0/2921337454 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc0b24b0 con 0x7fcffc0b6290 2021-10-20T23:21:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd000d79700 1 --2- 172.21.15.12:0/2921337454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 0x7fcffc061470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fcff8002f70 tx=0x7fcff8006df0).ready entity=mon.1 client_cookie=92e337043ad79704 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fcff37fe700 1 -- 172.21.15.12:0/2921337454 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcff800d570 con 0x7fcffc0b6290 2021-10-20T23:21:54.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fcff37fe700 1 -- 172.21.15.12:0/2921337454 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff8000e90 con 0x7fcffc0b6290 2021-10-20T23:21:54.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fcff37fe700 1 -- 172.21.15.12:0/2921337454 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcff800d8c0 con 0x7fcffc0b6290 2021-10-20T23:21:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 -- 172.21.15.12:0/2921337454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 msgr2=0x7fcffc061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 --2- 172.21.15.12:0/2921337454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 0x7fcffc061470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fcff8002f70 tx=0x7fcff8006df0).stop 2021-10-20T23:21:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 -- 172.21.15.12:0/2921337454 shutdown_connections 2021-10-20T23:21:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 --2- 172.21.15.12:0/2921337454 >> v2:172.21.15.12:3300/0 conn(0x7fcffc142e60 0x7fcffc1432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 --2- 172.21.15.12:0/2921337454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 0x7fcffc061470 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 -- 172.21.15.12:0/2921337454 >> 172.21.15.12:0/2921337454 conn(0x7fcffc05c490 msgr2=0x7fcffc05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 -- 172.21.15.12:0/2921337454 shutdown_connections 2021-10-20T23:21:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.640+0000 7fd001d7b700 1 -- 172.21.15.12:0/2921337454 wait complete. 2021-10-20T23:21:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd001d7b700 1 Processor -- start 2021-10-20T23:21:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd001d7b700 1 -- start start 2021-10-20T23:21:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd001d7b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcffc0b4060 0x7fcffc0b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd001d7b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 0x7fcffc12adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd001d7b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcffc142e60 0x7fcffc12b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd001d7b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc13faa0 con 0x7fcffc0b4060 2021-10-20T23:21:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd001d7b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc13f730 con 0x7fcffc0b6290 2021-10-20T23:21:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd001d7b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc13f490 con 0x7fcffc142e60 2021-10-20T23:21:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd000d79700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcffc0b4060 0x7fcffc0b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd000d79700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcffc0b4060 0x7fcffc0b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38838/0 (socket says 172.21.15.12:38838) 2021-10-20T23:21:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd000d79700 1 -- 172.21.15.12:0/1985931504 learned_addr learned my addr 172.21.15.12:0/1985931504 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fd00157a700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcffc142e60 0x7fcffc12b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.644+0000 7fcff3fff700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 0x7fcffc12adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fd000d79700 1 -- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcffc142e60 msgr2=0x7fcffc12b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fd000d79700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcffc142e60 0x7fcffc12b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fd000d79700 1 -- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 msgr2=0x7fcffc12adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fd000d79700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 0x7fcffc12adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fd000d79700 1 -- 172.21.15.12:0/1985931504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff800b180 con 0x7fcffc0b4060 2021-10-20T23:21:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fcff3fff700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 0x7fcffc12adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:21:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fd000d79700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcffc0b4060 0x7fcffc0b4b10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fcff8002f70 tx=0x7fcff8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fcff1ffb700 1 -- 172.21.15.12:0/1985931504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcff800dea0 con 0x7fcffc0b4060 2021-10-20T23:21:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fcff1ffb700 1 -- 172.21.15.12:0/1985931504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff801e400 con 0x7fcffc0b4060 2021-10-20T23:21:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc13fd00 con 0x7fcffc0b4060 2021-10-20T23:21:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fcff1ffb700 1 -- 172.21.15.12:0/1985931504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcff801e760 con 0x7fcffc0b4060 2021-10-20T23:21:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc13eff0 con 0x7fcffc0b4060 2021-10-20T23:21:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc0b2750 con 0x7fcffc0b4060 2021-10-20T23:21:54.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fcff1ffb700 1 -- 172.21.15.12:0/1985931504 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcff8025030 con 0x7fcffc0b4060 2021-10-20T23:21:54.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fcff1ffb700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfdc0534f0 0x7fcfdc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.648+0000 7fcff1ffb700 1 -- 172.21.15.12:0/1985931504 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcff806c900 con 0x7fcffc0b4060 2021-10-20T23:21:54.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.652+0000 7fcff3fff700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfdc0534f0 0x7fcfdc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.652+0000 7fcff3fff700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfdc0534f0 0x7fcfdc0559b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fcfec00b000 tx=0x7fcfec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.660+0000 7fcff1ffb700 1 -- 172.21.15.12:0/1985931504 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcff80437f0 con 0x7fcffc0b4060 2021-10-20T23:21:54.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.784+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcffc057350 con 0x7fcffc0b4060 2021-10-20T23:21:54.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.784+0000 7fcff1ffb700 1 -- 172.21.15.12:0/1985931504 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcff80230a0 con 0x7fcffc0b4060 2021-10-20T23:21:54.789 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:21:54.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfdc0534f0 msgr2=0x7fcfdc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfdc0534f0 0x7fcfdc0559b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fcfec00b000 tx=0x7fcfec009040).stop 2021-10-20T23:21:54.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcffc0b4060 msgr2=0x7fcffc0b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcffc0b4060 0x7fcffc0b4b10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fcff8002f70 tx=0x7fcff8014000).stop 2021-10-20T23:21:54.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 shutdown_connections 2021-10-20T23:21:54.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcfdc0534f0 0x7fcfdc0559b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcffc142e60 0x7fcffc12b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcffc0b6290 0x7fcffc12adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 --2- 172.21.15.12:0/1985931504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcffc0b4060 0x7fcffc0b4b10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 >> 172.21.15.12:0/1985931504 conn(0x7fcffc05c490 msgr2=0x7fcffc0b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:54.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 shutdown_connections 2021-10-20T23:21:54.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.788+0000 7fd001d7b700 1 -- 172.21.15.12:0/1985931504 wait complete. 2021-10-20T23:21:54.802 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:21:54.803 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:21:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.900+0000 7f6702fb9700 1 Processor -- start 2021-10-20T23:21:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.900+0000 7f6702fb9700 1 -- start start 2021-10-20T23:21:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f66fc05c7d0 0x7f66fc0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc05cbb0 con 0x7f66fc05d0b0 2021-10-20T23:21:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc0b1790 con 0x7f66fc13f390 2021-10-20T23:21:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc0ad540 con 0x7f66fc05c7d0 2021-10-20T23:21:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f67017b6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f66fc05d0b0 0x7f66fc0ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37440/0 (socket says 172.21.15.12:37440) 2021-10-20T23:21:54.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f67017b6700 1 -- 172.21.15.12:0/550334739 learned_addr learned my addr 172.21.15.12:0/550334739 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:21:54.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6701fb7700 1 --2- 172.21.15.12:0/550334739 >> v2:172.21.15.31:3300/0 conn(0x7f66fc05c7d0 0x7f66fc0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6700fb5700 1 -- 172.21.15.12:0/550334739 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414525071 0 0) 0x7f66fc05cbb0 con 0x7f66fc05d0b0 2021-10-20T23:21:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6700fb5700 1 -- 172.21.15.12:0/550334739 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e4003260 con 0x7f66fc05d0b0 2021-10-20T23:21:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6701fb7700 1 -- 172.21.15.12:0/550334739 >> v1:172.21.15.31:6789/0 conn(0x7f66fc13f390 legacy=0x7f66fc0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6701fb7700 1 -- 172.21.15.12:0/550334739 >> v1:172.21.15.12:6789/0 conn(0x7f66fc05d0b0 legacy=0x7f66fc0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6701fb7700 1 -- 172.21.15.12:0/550334739 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0b1a30 con 0x7f66fc05c7d0 2021-10-20T23:21:54.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6701fb7700 1 --2- 172.21.15.12:0/550334739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66fc05c7d0 0x7f66fc0b10f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f66f8002f70 tx=0x7f66f8006df0).ready entity=mon.1 client_cookie=828a9de52ae024a4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6700fb5700 1 -- 172.21.15.12:0/550334739 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f800d610 con 0x7f66fc05c7d0 2021-10-20T23:21:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6700fb5700 1 -- 172.21.15.12:0/550334739 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f8000e90 con 0x7f66fc05c7d0 2021-10-20T23:21:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6700fb5700 1 -- 172.21.15.12:0/550334739 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f800d960 con 0x7f66fc05c7d0 2021-10-20T23:21:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 -- 172.21.15.12:0/550334739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66fc05c7d0 msgr2=0x7f66fc0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 --2- 172.21.15.12:0/550334739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66fc05c7d0 0x7f66fc0b10f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f66f8002f70 tx=0x7f66f8006df0).stop 2021-10-20T23:21:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 -- 172.21.15.12:0/550334739 shutdown_connections 2021-10-20T23:21:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 --2- 172.21.15.12:0/550334739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66fc05c7d0 0x7f66fc0b10f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 -- 172.21.15.12:0/550334739 >> 172.21.15.12:0/550334739 conn(0x7f66fc060180 msgr2=0x7f66fc0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 -- 172.21.15.12:0/550334739 shutdown_connections 2021-10-20T23:21:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 -- 172.21.15.12:0/550334739 wait complete. 2021-10-20T23:21:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 Processor -- start 2021-10-20T23:21:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.904+0000 7f6702fb9700 1 -- start start 2021-10-20T23:21:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6702fb9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66fc05c7d0 0x7f66fc0673a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6702fb9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66fc05d0b0 0x7f66fc142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6702fb9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66fc13f390 0x7f66fc153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6702fb9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0ab790 con 0x7f66fc05c7d0 2021-10-20T23:21:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6702fb9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0b4600 con 0x7f66fc13f390 2021-10-20T23:21:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6702fb9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0ab9c0 con 0x7f66fc05d0b0 2021-10-20T23:21:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6701fb7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66fc05c7d0 0x7f66fc0673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6701fb7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66fc05c7d0 0x7f66fc0673a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38854/0 (socket says 172.21.15.12:38854) 2021-10-20T23:21:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6701fb7700 1 -- 172.21.15.12:0/2718722630 learned_addr learned my addr 172.21.15.12:0/2718722630 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:21:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f67017b6700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66fc05d0b0 0x7f66fc142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f67027b8700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66fc13f390 0x7f66fc153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6701fb7700 1 -- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66fc05d0b0 msgr2=0x7f66fc142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6701fb7700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66fc05d0b0 0x7f66fc142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6701fb7700 1 -- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66fc13f390 msgr2=0x7f66fc153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6701fb7700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66fc13f390 0x7f66fc153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6701fb7700 1 -- 172.21.15.12:0/2718722630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f800b180 con 0x7f66fc05c7d0 2021-10-20T23:21:54.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6701fb7700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66fc05c7d0 0x7f66fc0673a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f66f8002f70 tx=0x7f66f8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f66eaffd700 1 -- 172.21.15.12:0/2718722630 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f8013de0 con 0x7f66fc05c7d0 2021-10-20T23:21:54.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f66eaffd700 1 -- 172.21.15.12:0/2718722630 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f800d290 con 0x7f66fc05c7d0 2021-10-20T23:21:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc0abc60 con 0x7f66fc05c7d0 2021-10-20T23:21:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f66eaffd700 1 -- 172.21.15.12:0/2718722630 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f801e5f0 con 0x7f66fc05c7d0 2021-10-20T23:21:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.908+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc0b4920 con 0x7f66fc05c7d0 2021-10-20T23:21:54.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.912+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc057350 con 0x7f66fc05c7d0 2021-10-20T23:21:54.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.912+0000 7f66eaffd700 1 -- 172.21.15.12:0/2718722630 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f66f8025030 con 0x7f66fc05c7d0 2021-10-20T23:21:54.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.912+0000 7f66eaffd700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f66dc053640 0x7f66dc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:21:54.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.912+0000 7f66eaffd700 1 -- 172.21.15.12:0/2718722630 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f66f806c770 con 0x7f66fc05c7d0 2021-10-20T23:21:54.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.912+0000 7f67017b6700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f66dc053640 0x7f66dc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:21:54.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.912+0000 7f67017b6700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f66dc053640 0x7f66dc055b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f66ec00d000 tx=0x7f66ec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:21:54.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:54.920+0000 7f66eaffd700 1 -- 172.21.15.12:0/2718722630 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66f8043770 con 0x7f66fc05c7d0 2021-10-20T23:21:55.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.084+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66fc0abdf0 con 0x7f66fc05c7d0 2021-10-20T23:21:55.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.084+0000 7f66eaffd700 1 -- 172.21.15.12:0/2718722630 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f66f8023020 con 0x7f66fc05c7d0 2021-10-20T23:21:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:21:55.089 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:21:50.499039+0000","modified":"2021-10-20T23:21:51.501920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5233":{"gid":5233,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2510327912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2510327912},{"type":"v1","addr":"172.21.15.31:6835","nonce":2510327912}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-20T23:21:55.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f66dc053640 msgr2=0x7f66dc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:55.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f66dc053640 0x7f66dc055b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f66ec00d000 tx=0x7f66ec009040).stop 2021-10-20T23:21:55.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66fc05c7d0 msgr2=0x7f66fc0673a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:21:55.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66fc05c7d0 0x7f66fc0673a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f66f8002f70 tx=0x7f66f8014000).stop 2021-10-20T23:21:55.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 shutdown_connections 2021-10-20T23:21:55.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f66dc053640 0x7f66dc055b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:55.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66fc13f390 0x7f66fc153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:55.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66fc05d0b0 0x7f66fc142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:55.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 --2- 172.21.15.12:0/2718722630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66fc05c7d0 0x7f66fc0673a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:21:55.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 >> 172.21.15.12:0/2718722630 conn(0x7f66fc060180 msgr2=0x7f66fc13e510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:21:55.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 shutdown_connections 2021-10-20T23:21:55.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:21:55.088+0000 7f6702fb9700 1 -- 172.21.15.12:0/2718722630 wait complete. 2021-10-20T23:21:55.094 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 19 2021-10-20T23:21:55.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:21:50.499039+0000', 'modified': '2021-10-20T23:21:51.501920+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5233}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5233': {'gid': 5233, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/2510327912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 2510327912}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2510327912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:21:55.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:21:55.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:21:55.522 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":5233,"want_state":"up:active","state":"up:active","rank_uptime":5.01173191,"mdsmap_epoch":19,"osdmap_epoch":48,"osdmap_epoch_barrier":46,"uptime":9.8026193429999999} 2021-10-20T23:21:55.523 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 5233, "mdsmap_epoch": 19, "osdmap_epoch": 48, "osdmap_epoch_barrier": 46, "rank_uptime": 5.01173191, "state": "up:active", "uptime": 9.802619343, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:21:55.523 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:21:55.524 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:21:55.524 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:21:55.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:55.525 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:55.533 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:21:55.592 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:21:55.593 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:21:55.609 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:21:55.610 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:21:55.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:55.612 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:21:55.619 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:21:55.619 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:55.662 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:21:55.680 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:21:55.681 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:21:55.691 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:21:55.692 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:21:55.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:55.694 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:21:55.737 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:21:55.735+0000 7f37aac6a080 -1 init, newargv = 0x55e4be672100 newargc=9ceph-fuse[13924]: starting ceph client 2021-10-20T23:21:55.738 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr: 2021-10-20T23:21:55.747 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[13924]: starting fuse 2021-10-20T23:21:56.843 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:21:56.862 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:21:56.863 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:21:56.874 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:21:56.875 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:21:56.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:56.877 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:21:56.882 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:21:56.883 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:21:56.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:56.884 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:21:56.884 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:21:56.885 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:21:56.885 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:21:56.886 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:21:56.886 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:21:56.887 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:21:56.887 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:21:56.888 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:21:56.888 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:21:56.888 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:21:56.889 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:21:56.889 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:21:56.890 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:21:56.890 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:21:56.891 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:21:56.891 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:21:56.891 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:21:56.892 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:21:56.892 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:21:56.893 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:21:56.893 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:21:56.894 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:21:56.968 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.13924.asok 2021-10-20T23:21:56.973 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13924.asok 2021-10-20T23:21:56.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:56.975 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13924.asok status 2021-10-20T23:21:57.067 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:21:57.067 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:21:57.067 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:21:57.068 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:21:57.068 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:21:57.068 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:21:57.068 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:21:57.069 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "13924", 2021-10-20T23:21:57.069 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:21:57.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:21:57.069 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:21:57.070 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:21:57.070 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5391, 2021-10-20T23:21:57.070 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:21:57.070 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:21:57.070 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:21:57.071 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5391 2021-10-20T23:21:57.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:21:57.071 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:21:57.072 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:21:57.072 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:21:57.072 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3792062335 2021-10-20T23:21:57.072 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:21:57.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:21:57.073 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:21:57.073 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:21:57.073 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:21:57.074 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3792062335 2021-10-20T23:21:57.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:21:57.074 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5391 172.21.15.119:0/3792062335", 2021-10-20T23:21:57.074 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/3792062335", 2021-10-20T23:21:57.074 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:21:57.075 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 19, 2021-10-20T23:21:57.075 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 48, 2021-10-20T23:21:57.075 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:21:57.075 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:21:57.076 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:21:57.076 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:21:57.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:57.078 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:21:57.078 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:57.085 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:21:57.087 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:21:57.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:57.088 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:57.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:21:57.146 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:21:57.146 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:21:57.154 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:21:57.155 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:21:57.155 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-20T23:21:57.156 DEBUG:teuthology.orchestra.run.smithi119:> import sys 2021-10-20T23:21:57.156 DEBUG:teuthology.orchestra.run.smithi119:> import time 2021-10-20T23:21:57.157 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:21:57.157 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:21:57.157 DEBUG:teuthology.orchestra.run.smithi119:> n = 1000 2021-10-20T23:21:57.158 DEBUG:teuthology.orchestra.run.smithi119:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-10-20T23:21:57.158 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:21:57.159 DEBUG:teuthology.orchestra.run.smithi119:> if not os.path.exists(os.path.dirname(abs_path)): 2021-10-20T23:21:57.159 DEBUG:teuthology.orchestra.run.smithi119:> os.makedirs(os.path.dirname(abs_path)) 2021-10-20T23:21:57.159 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:21:57.160 DEBUG:teuthology.orchestra.run.smithi119:> for i in range(0, n): 2021-10-20T23:21:57.160 DEBUG:teuthology.orchestra.run.smithi119:> fname = "{0}_{1}".format(abs_path, i) 2021-10-20T23:21:57.160 DEBUG:teuthology.orchestra.run.smithi119:> with open(fname, '"'"'w'"'"') as f: 2021-10-20T23:21:57.161 DEBUG:teuthology.orchestra.run.smithi119:> f.write('"'"'content'"'"') 2021-10-20T23:21:57.161 DEBUG:teuthology.orchestra.run.smithi119:> if True: 2021-10-20T23:21:57.162 DEBUG:teuthology.orchestra.run.smithi119:> f.flush() 2021-10-20T23:21:57.162 DEBUG:teuthology.orchestra.run.smithi119:> os.fsync(f.fileno()) 2021-10-20T23:21:57.162 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:22:06.274 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:22:06.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:22:06.279 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:22:06.282 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:22:08.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:22:08.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c3435700 1 Processor -- start 2021-10-20T23:22:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c3435700 1 -- start start 2021-10-20T23:22:08.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c3435700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc0b1280 0x7f01bc0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c3435700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f01bc140cf0 0x7f01bc0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c3435700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01bc140310 con 0x7f01bc0a8c70 2021-10-20T23:22:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c3435700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc1405b0 con 0x7f01bc140cf0 2021-10-20T23:22:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c3435700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc140850 con 0x7f01bc0b1280 2021-10-20T23:22:08.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c19d2700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f01bc0a8c70 0x7f01bc0ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37458/0 (socket says 172.21.15.12:37458) 2021-10-20T23:22:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c19d2700 1 -- 172.21.15.12:0/913011699 learned_addr learned my addr 172.21.15.12:0/913011699 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:22:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c11d1700 1 --2- 172.21.15.12:0/913011699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc0b1280 0x7f01bc0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c09d0700 1 --2- 172.21.15.12:0/913011699 >> v2:172.21.15.31:3300/0 conn(0x7f01bc140cf0 0x7f01bc0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01abfff700 1 -- 172.21.15.12:0/913011699 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167819274 0 0) 0x7f01bc140310 con 0x7f01bc0a8c70 2021-10-20T23:22:08.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01abfff700 1 -- 172.21.15.12:0/913011699 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a4003260 con 0x7f01bc0a8c70 2021-10-20T23:22:08.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c11d1700 1 -- 172.21.15.12:0/913011699 >> v2:172.21.15.31:3300/0 conn(0x7f01bc140cf0 msgr2=0x7f01bc0b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:08.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c11d1700 1 --2- 172.21.15.12:0/913011699 >> v2:172.21.15.31:3300/0 conn(0x7f01bc140cf0 0x7f01bc0b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c11d1700 1 -- 172.21.15.12:0/913011699 >> v1:172.21.15.12:6789/0 conn(0x7f01bc0a8c70 legacy=0x7f01bc0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:08.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c11d1700 1 -- 172.21.15.12:0/913011699 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc140000 con 0x7f01bc0b1280 2021-10-20T23:22:08.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01c11d1700 1 --2- 172.21.15.12:0/913011699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc0b1280 0x7f01bc0b1c70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f01b8002f70 tx=0x7f01b8006df0).ready entity=mon.2 client_cookie=afd7173665105ad0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:08.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01abfff700 1 -- 172.21.15.12:0/913011699 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b800d4a0 con 0x7f01bc0b1280 2021-10-20T23:22:08.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01abfff700 1 -- 172.21.15.12:0/913011699 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b8000e90 con 0x7f01bc0b1280 2021-10-20T23:22:08.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.560+0000 7f01abfff700 1 -- 172.21.15.12:0/913011699 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b800d7f0 con 0x7f01bc0b1280 2021-10-20T23:22:08.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 -- 172.21.15.12:0/913011699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc0b1280 msgr2=0x7f01bc0b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:08.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 --2- 172.21.15.12:0/913011699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc0b1280 0x7f01bc0b1c70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f01b8002f70 tx=0x7f01b8006df0).stop 2021-10-20T23:22:08.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 -- 172.21.15.12:0/913011699 shutdown_connections 2021-10-20T23:22:08.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 --2- 172.21.15.12:0/913011699 >> v2:172.21.15.31:3300/0 conn(0x7f01bc140cf0 0x7f01bc0b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 --2- 172.21.15.12:0/913011699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc0b1280 0x7f01bc0b1c70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 -- 172.21.15.12:0/913011699 >> 172.21.15.12:0/913011699 conn(0x7f01bc05f6b0 msgr2=0x7f01bc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:08.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 -- 172.21.15.12:0/913011699 shutdown_connections 2021-10-20T23:22:08.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 -- 172.21.15.12:0/913011699 wait complete. 2021-10-20T23:22:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 Processor -- start 2021-10-20T23:22:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 -- start start 2021-10-20T23:22:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01bc0a8c70 0x7f01bc0ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01bc0b1280 0x7f01bc13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc140cf0 0x7f01bc13cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc143610 con 0x7f01bc0a8c70 2021-10-20T23:22:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0acba0 con 0x7f01bc0b1280 2021-10-20T23:22:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c3435700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc143840 con 0x7f01bc140cf0 2021-10-20T23:22:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c11d1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01bc0a8c70 0x7f01bc0ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c11d1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01bc0a8c70 0x7f01bc0ac6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38866/0 (socket says 172.21.15.12:38866) 2021-10-20T23:22:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c11d1700 1 -- 172.21.15.12:0/504925762 learned_addr learned my addr 172.21.15.12:0/504925762 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c09d0700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01bc0b1280 0x7f01bc13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.564+0000 7f01c19d2700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc140cf0 0x7f01bc13cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01c11d1700 1 -- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc140cf0 msgr2=0x7f01bc13cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01c11d1700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc140cf0 0x7f01bc13cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01c11d1700 1 -- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01bc0b1280 msgr2=0x7f01bc13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01c11d1700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01bc0b1280 0x7f01bc13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01c11d1700 1 -- 172.21.15.12:0/504925762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b800b180 con 0x7f01bc0a8c70 2021-10-20T23:22:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01c11d1700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01bc0a8c70 0x7f01bc0ac6b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f01b8002f70 tx=0x7f01b8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01aa7fc700 1 -- 172.21.15.12:0/504925762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b8016070 con 0x7f01bc0a8c70 2021-10-20T23:22:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01aa7fc700 1 -- 172.21.15.12:0/504925762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b80137d0 con 0x7f01bc0a8c70 2021-10-20T23:22:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01bc143ae0 con 0x7f01bc0a8c70 2021-10-20T23:22:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01aa7fc700 1 -- 172.21.15.12:0/504925762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b8013b30 con 0x7f01bc0a8c70 2021-10-20T23:22:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc13b8c0 con 0x7f01bc0a8c70 2021-10-20T23:22:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc0aa390 con 0x7f01bc0a8c70 2021-10-20T23:22:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.568+0000 7f01aa7fc700 1 -- 172.21.15.12:0/504925762 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f01b8025030 con 0x7f01bc0a8c70 2021-10-20T23:22:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.572+0000 7f01aa7fc700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f019c053580 0x7f019c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.572+0000 7f01aa7fc700 1 -- 172.21.15.12:0/504925762 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f01b806c8e0 con 0x7f01bc0a8c70 2021-10-20T23:22:08.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.572+0000 7f01c09d0700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f019c053580 0x7f019c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.572+0000 7f01c09d0700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f019c053580 0x7f019c055a40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f01ac00b000 tx=0x7f01ac006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:08.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.576+0000 7f01aa7fc700 1 -- 172.21.15.12:0/504925762 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f01b80438e0 con 0x7f01bc0a8c70 2021-10-20T23:22:08.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.740+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01bc057350 con 0x7f01bc0a8c70 2021-10-20T23:22:08.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01aa7fc700 1 -- 172.21.15.12:0/504925762 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f01b8023020 con 0x7f01bc0a8c70 2021-10-20T23:22:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:22:08.747 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:21:50.499039+0000","modified":"2021-10-20T23:21:51.501920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5233":{"gid":5233,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2510327912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2510327912},{"type":"v1","addr":"172.21.15.31:6835","nonce":2510327912}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-20T23:22:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f019c053580 msgr2=0x7f019c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f019c053580 0x7f019c055a40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f01ac00b000 tx=0x7f01ac006df0).stop 2021-10-20T23:22:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01bc0a8c70 msgr2=0x7f01bc0ac6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:08.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01bc0a8c70 0x7f01bc0ac6b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f01b8002f70 tx=0x7f01b8014000).stop 2021-10-20T23:22:08.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 shutdown_connections 2021-10-20T23:22:08.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f019c053580 0x7f019c055a40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01bc140cf0 0x7f01bc13cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01bc0b1280 0x7f01bc13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 --2- 172.21.15.12:0/504925762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01bc0a8c70 0x7f01bc0ac6b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 >> 172.21.15.12:0/504925762 conn(0x7f01bc05f6b0 msgr2=0x7f01bc0b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 shutdown_connections 2021-10-20T23:22:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.744+0000 7f01c3435700 1 -- 172.21.15.12:0/504925762 wait complete. 2021-10-20T23:22:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 19 2021-10-20T23:22:08.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_caps 20 2021-10-20T23:22:08.863 INFO:teuthology.orchestra.run.smithi031.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-10-20T23:22:08.864 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-10-20T23:22:08.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:22:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711b59e700 1 Processor -- start 2021-10-20T23:22:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711b59e700 1 -- start start 2021-10-20T23:22:08.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c061320 0x7f711c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f711c0ad5c0 0x7f711c0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f711c140440 0x7f711c1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711b59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0aecf0 con 0x7f711c140440 2021-10-20T23:22:08.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711b59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0b6f20 con 0x7f711c0ad5c0 2021-10-20T23:22:08.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711b59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0aef20 con 0x7f711c061320 2021-10-20T23:22:08.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f711c140440 0x7f711c1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f711c140440 0x7f711c1408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38878/0 (socket says 172.21.15.12:38878) 2021-10-20T23:22:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711ad9d700 1 -- 172.21.15.12:0/647750400 learned_addr learned my addr 172.21.15.12:0/647750400 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f7119d9b700 1 --2- 172.21.15.12:0/647750400 >> v2:172.21.15.31:3300/0 conn(0x7f711c0ad5c0 0x7f711c0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711a59c700 1 --2- 172.21.15.12:0/647750400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c061320 0x7f711c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711ad9d700 1 -- 172.21.15.12:0/647750400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c061320 msgr2=0x7f711c061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:08.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711ad9d700 1 --2- 172.21.15.12:0/647750400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c061320 0x7f711c061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711ad9d700 1 -- 172.21.15.12:0/647750400 >> v2:172.21.15.31:3300/0 conn(0x7f711c0ad5c0 msgr2=0x7f711c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:08.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711ad9d700 1 --2- 172.21.15.12:0/647750400 >> v2:172.21.15.31:3300/0 conn(0x7f711c0ad5c0 0x7f711c0b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711ad9d700 1 -- 172.21.15.12:0/647750400 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0af1c0 con 0x7f711c140440 2021-10-20T23:22:08.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711ad9d700 1 --2- 172.21.15.12:0/647750400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c140440 0x7f711c1408f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f71140032f0 tx=0x7f7114009290).ready entity=mon.0 client_cookie=2124775abd9e74f4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:08.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711959a700 1 -- 172.21.15.12:0/647750400 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f711400b680 con 0x7f711c140440 2021-10-20T23:22:08.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711959a700 1 -- 172.21.15.12:0/647750400 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711400b7e0 con 0x7f711c140440 2021-10-20T23:22:08.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.972+0000 7f711959a700 1 -- 172.21.15.12:0/647750400 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f711400b950 con 0x7f711c140440 2021-10-20T23:22:08.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 -- 172.21.15.12:0/647750400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c140440 msgr2=0x7f711c1408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:08.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 --2- 172.21.15.12:0/647750400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c140440 0x7f711c1408f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f71140032f0 tx=0x7f7114009290).stop 2021-10-20T23:22:08.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 -- 172.21.15.12:0/647750400 shutdown_connections 2021-10-20T23:22:08.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 --2- 172.21.15.12:0/647750400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c140440 0x7f711c1408f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 --2- 172.21.15.12:0/647750400 >> v2:172.21.15.31:3300/0 conn(0x7f711c0ad5c0 0x7f711c0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 --2- 172.21.15.12:0/647750400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c061320 0x7f711c061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 -- 172.21.15.12:0/647750400 >> 172.21.15.12:0/647750400 conn(0x7f711c066de0 msgr2=0x7f711c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:08.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 -- 172.21.15.12:0/647750400 shutdown_connections 2021-10-20T23:22:08.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 -- 172.21.15.12:0/647750400 wait complete. 2021-10-20T23:22:08.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 Processor -- start 2021-10-20T23:22:08.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 -- start start 2021-10-20T23:22:08.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c061320 0x7f711c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c0ad5c0 0x7f711c145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c140440 0x7f711c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0aa960 con 0x7f711c061320 2021-10-20T23:22:08.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c155a90 con 0x7f711c140440 2021-10-20T23:22:08.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711b59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c155d30 con 0x7f711c0ad5c0 2021-10-20T23:22:08.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c061320 0x7f711c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c061320 0x7f711c1523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38880/0 (socket says 172.21.15.12:38880) 2021-10-20T23:22:08.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711a59c700 1 -- 172.21.15.12:0/1870656827 learned_addr learned my addr 172.21.15.12:0/1870656827 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:08.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711ad9d700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c140440 0x7f711c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f7119d9b700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c0ad5c0 0x7f711c145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711a59c700 1 -- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c0ad5c0 msgr2=0x7f711c145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:08.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711a59c700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c0ad5c0 0x7f711c145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711a59c700 1 -- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c140440 msgr2=0x7f711c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:08.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711a59c700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c140440 0x7f711c1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:08.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.976+0000 7f711a59c700 1 -- 172.21.15.12:0/1870656827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009530 con 0x7f711c061320 2021-10-20T23:22:08.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f711a59c700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c061320 0x7f711c1523c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f710c00c000 tx=0x7f710c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:08.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f710b7fe700 1 -- 172.21.15.12:0/1870656827 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710c010780 con 0x7f711c061320 2021-10-20T23:22:08.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f710b7fe700 1 -- 172.21.15.12:0/1870656827 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c0108e0 con 0x7f711c061320 2021-10-20T23:22:08.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c1528b0 con 0x7f711c061320 2021-10-20T23:22:08.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f710b7fe700 1 -- 172.21.15.12:0/1870656827 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710c010c40 con 0x7f711c061320 2021-10-20T23:22:08.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c0b14d0 con 0x7f711c061320 2021-10-20T23:22:08.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c0af460 con 0x7f711c061320 2021-10-20T23:22:08.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f710b7fe700 1 -- 172.21.15.12:0/1870656827 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f710c01c460 con 0x7f711c061320 2021-10-20T23:22:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f710b7fe700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70f80534f0 0x7f70f80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f710b7fe700 1 -- 172.21.15.12:0/1870656827 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f710c06c090 con 0x7f711c061320 2021-10-20T23:22:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.980+0000 7f7119d9b700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70f80534f0 0x7f70f80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.984+0000 7f7119d9b700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70f80534f0 0x7f70f80559b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f711000b000 tx=0x7f7110006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:08.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:08.988+0000 7f710b7fe700 1 -- 172.21.15.12:0/1870656827 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f710c042ea0 con 0x7f711c061320 2021-10-20T23:22:09.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f711c0aab30 con 0x7f711c061320 2021-10-20T23:22:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f710b7fe700 1 -- 172.21.15.12:0/1870656827 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f710c0464c0 con 0x7f711c061320 2021-10-20T23:22:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:22:09.156 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:21:50.499039+0000","modified":"2021-10-20T23:21:51.501920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5233":{"gid":5233,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2510327912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2510327912},{"type":"v1","addr":"172.21.15.31:6835","nonce":2510327912}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-20T23:22:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70f80534f0 msgr2=0x7f70f80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70f80534f0 0x7f70f80559b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f711000b000 tx=0x7f7110006df0).stop 2021-10-20T23:22:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c061320 msgr2=0x7f711c1523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c061320 0x7f711c1523c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f710c00c000 tx=0x7f710c006df0).stop 2021-10-20T23:22:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 shutdown_connections 2021-10-20T23:22:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70f80534f0 0x7f70f80559b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c140440 0x7f711c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f711c0ad5c0 0x7f711c145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 --2- 172.21.15.12:0/1870656827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711c061320 0x7f711c1523c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 >> 172.21.15.12:0/1870656827 conn(0x7f711c066de0 msgr2=0x7f711c146650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 shutdown_connections 2021-10-20T23:22:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.152+0000 7f711b59e700 1 -- 172.21.15.12:0/1870656827 wait complete. 2021-10-20T23:22:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 19 2021-10-20T23:22:09.168 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_decay_threshold 400 2021-10-20T23:22:09.284 INFO:teuthology.orchestra.run.smithi031.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-10-20T23:22:09.285 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-10-20T23:22:09.285 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:22:09.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:22:09.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0eae08700 1 Processor -- start 2021-10-20T23:22:09.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0eae08700 1 -- start start 2021-10-20T23:22:09.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0eae08700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0e40b6290 0x7fd0e4061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0eae08700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0e40b4060 0x7fd0e4061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0eae08700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e40b5f50 con 0x7fd0e4061e50 2021-10-20T23:22:09.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0eae08700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e40b1f70 con 0x7fd0e40b4060 2021-10-20T23:22:09.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0eae08700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e40b2210 con 0x7fd0e40b6290 2021-10-20T23:22:09.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0e9605700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0e40b4060 0x7fd0e4061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0e9605700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0e40b4060 0x7fd0e4061960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38888/0 (socket says 172.21.15.12:38888) 2021-10-20T23:22:09.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.412+0000 7fd0e9605700 1 -- 172.21.15.12:0/653425276 learned_addr learned my addr 172.21.15.12:0/653425276 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:09.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0e9e06700 1 --2- 172.21.15.12:0/653425276 >> v2:172.21.15.31:3300/0 conn(0x7fd0e40b6290 0x7fd0e4061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0e9605700 1 -- 172.21.15.12:0/653425276 >> v2:172.21.15.31:3300/0 conn(0x7fd0e40b6290 msgr2=0x7fd0e4061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0e9605700 1 --2- 172.21.15.12:0/653425276 >> v2:172.21.15.31:3300/0 conn(0x7fd0e40b6290 0x7fd0e4061470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0e9605700 1 -- 172.21.15.12:0/653425276 >> v1:172.21.15.31:6789/0 conn(0x7fd0e4061e50 legacy=0x7fd0e4146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0e9605700 1 -- 172.21.15.12:0/653425276 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e40b24b0 con 0x7fd0e40b4060 2021-10-20T23:22:09.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0e9605700 1 --2- 172.21.15.12:0/653425276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e40b4060 0x7fd0e4061960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d8009290).ready entity=mon.0 client_cookie=60dd25b32a392a58 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0e8e04700 1 -- 172.21.15.12:0/653425276 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d800b870 con 0x7fd0e40b4060 2021-10-20T23:22:09.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0e8e04700 1 -- 172.21.15.12:0/653425276 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d800b9d0 con 0x7fd0e40b4060 2021-10-20T23:22:09.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0e8e04700 1 -- 172.21.15.12:0/653425276 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d800bb40 con 0x7fd0e40b4060 2021-10-20T23:22:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0eae08700 1 -- 172.21.15.12:0/653425276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e40b4060 msgr2=0x7fd0e4061960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0eae08700 1 --2- 172.21.15.12:0/653425276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e40b4060 0x7fd0e4061960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d8009290).stop 2021-10-20T23:22:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0eae08700 1 -- 172.21.15.12:0/653425276 shutdown_connections 2021-10-20T23:22:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0eae08700 1 --2- 172.21.15.12:0/653425276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e40b4060 0x7fd0e4061960 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0eae08700 1 --2- 172.21.15.12:0/653425276 >> v2:172.21.15.31:3300/0 conn(0x7fd0e40b6290 0x7fd0e4061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0eae08700 1 -- 172.21.15.12:0/653425276 >> 172.21.15.12:0/653425276 conn(0x7fd0e405c490 msgr2=0x7fd0e405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0eae08700 1 -- 172.21.15.12:0/653425276 shutdown_connections 2021-10-20T23:22:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.416+0000 7fd0eae08700 1 -- 172.21.15.12:0/653425276 wait complete. 2021-10-20T23:22:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 Processor -- start 2021-10-20T23:22:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 -- start start 2021-10-20T23:22:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4061e50 0x7fd0e4142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0e40b4060 0x7fd0e4152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0e40b6290 0x7fd0e413d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4153440 con 0x7fd0e4061e50 2021-10-20T23:22:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4143300 con 0x7fd0e40b6290 2021-10-20T23:22:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4152810 con 0x7fd0e40b4060 2021-10-20T23:22:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9e06700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4061e50 0x7fd0e4142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9e06700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4061e50 0x7fd0e4142d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38894/0 (socket says 172.21.15.12:38894) 2021-10-20T23:22:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9e06700 1 -- 172.21.15.12:0/3583563044 learned_addr learned my addr 172.21.15.12:0/3583563044 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9605700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0e40b4060 0x7fd0e4152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0ea607700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0e40b6290 0x7fd0e413d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9605700 1 -- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0e40b6290 msgr2=0x7fd0e413d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9605700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0e40b6290 0x7fd0e413d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9605700 1 -- 172.21.15.12:0/3583563044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4061e50 msgr2=0x7fd0e4142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9605700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4061e50 0x7fd0e4142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9605700 1 -- 172.21.15.12:0/3583563044 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8009530 con 0x7fd0e40b4060 2021-10-20T23:22:09.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0e9605700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0e40b4060 0x7fd0e4152f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d8016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0d6ffd700 1 -- 172.21.15.12:0/3583563044 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d800b870 con 0x7fd0e40b4060 2021-10-20T23:22:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0d6ffd700 1 -- 172.21.15.12:0/3583563044 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d8021440 con 0x7fd0e40b4060 2021-10-20T23:22:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e4152ab0 con 0x7fd0e40b4060 2021-10-20T23:22:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0d6ffd700 1 -- 172.21.15.12:0/3583563044 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d80217a0 con 0x7fd0e40b4060 2021-10-20T23:22:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.420+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e413db80 con 0x7fd0e40b4060 2021-10-20T23:22:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.424+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e4152c40 con 0x7fd0e40b4060 2021-10-20T23:22:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.424+0000 7fd0d6ffd700 1 -- 172.21.15.12:0/3583563044 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd0d800f070 con 0x7fd0e40b4060 2021-10-20T23:22:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.424+0000 7fd0d6ffd700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c4053610 0x7fd0c4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.424+0000 7fd0d6ffd700 1 -- 172.21.15.12:0/3583563044 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd0d806ccb0 con 0x7fd0e40b4060 2021-10-20T23:22:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.424+0000 7fd0e9e06700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c4053610 0x7fd0c4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.424+0000 7fd0e9e06700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c4053610 0x7fd0c4055ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fd0e000b000 tx=0x7fd0e0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.432+0000 7fd0d6ffd700 1 -- 172.21.15.12:0/3583563044 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0d8043be0 con 0x7fd0e40b4060 2021-10-20T23:22:09.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.600+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0e40b2750 con 0x7fd0e40b4060 2021-10-20T23:22:09.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0d6ffd700 1 -- 172.21.15.12:0/3583563044 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2491 (secure 0 0 0) 0x7fd0d8015030 con 0x7fd0e40b4060 2021-10-20T23:22:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:22:09.606 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:21:50.499039+0000","modified":"2021-10-20T23:21:51.501920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5233":{"gid":5233,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2510327912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2510327912},{"type":"v1","addr":"172.21.15.31:6835","nonce":2510327912}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-20T23:22:09.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c4053610 msgr2=0x7fd0c4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c4053610 0x7fd0c4055ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fd0e000b000 tx=0x7fd0e0006df0).stop 2021-10-20T23:22:09.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0e40b4060 msgr2=0x7fd0e4152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0e40b4060 0x7fd0e4152f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d8016000).stop 2021-10-20T23:22:09.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 shutdown_connections 2021-10-20T23:22:09.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c4053610 0x7fd0c4055ad0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0e40b6290 0x7fd0e413d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0e40b4060 0x7fd0e4152f50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 --2- 172.21.15.12:0/3583563044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4061e50 0x7fd0e4142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 >> 172.21.15.12:0/3583563044 conn(0x7fd0e405c490 msgr2=0x7fd0e40b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:09.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 shutdown_connections 2021-10-20T23:22:09.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.604+0000 7fd0eae08700 1 -- 172.21.15.12:0/3583563044 wait complete. 2021-10-20T23:22:09.611 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 19 2021-10-20T23:22:09.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b cache drop 2021-10-20T23:22:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0bbeac700 1 Processor -- start 2021-10-20T23:22:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0bbeac700 1 -- start start 2021-10-20T23:22:09.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0bbeac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe0b40607d0 0x7fe0b41400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0bbeac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b40ac500 0x7fe0b4140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0bbeac700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b405fe80 con 0x7fe0b405faa0 2021-10-20T23:22:09.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0bbeac700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b4143240 con 0x7fe0b40607d0 2021-10-20T23:22:09.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0bbeac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40acc60 con 0x7fe0b40ac500 2021-10-20T23:22:09.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0ba449700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b40ac500 0x7fe0b4140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0b9447700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe0b40607d0 0x7fe0b41400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0b9c48700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe0b405faa0 0x7fe0b41438d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:44560/0 (socket says 172.21.15.12:44560) 2021-10-20T23:22:09.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0b9c48700 1 -- 172.21.15.12:0/933707160 learned_addr learned my addr 172.21.15.12:0/933707160 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:22:09.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0b9447700 1 -- 172.21.15.12:0/933707160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b40ac500 msgr2=0x7fe0b4140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0b9447700 1 --2- 172.21.15.12:0/933707160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b40ac500 0x7fe0b4140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0b9447700 1 -- 172.21.15.12:0/933707160 >> v1:172.21.15.31:6789/0 conn(0x7fe0b405faa0 legacy=0x7fe0b41438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0b8c46700 1 -- 172.21.15.12:0/933707160 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361650547 0 0) 0x7fe0b405fe80 con 0x7fe0b405faa0 2021-10-20T23:22:09.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.724+0000 7fe0b9447700 1 -- 172.21.15.12:0/933707160 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40acf00 con 0x7fe0b40607d0 2021-10-20T23:22:09.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0b9447700 1 --2- 172.21.15.12:0/933707160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b40607d0 0x7fe0b41400a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fe0b00032f0 tx=0x7fe0b00091d0).ready entity=mon.1 client_cookie=2796a6dd88f0406f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0b8c46700 1 -- 172.21.15.12:0/933707160 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000b6c0 con 0x7fe0b40607d0 2021-10-20T23:22:09.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0b8c46700 1 -- 172.21.15.12:0/933707160 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000b820 con 0x7fe0b40607d0 2021-10-20T23:22:09.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0b8c46700 1 -- 172.21.15.12:0/933707160 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000b990 con 0x7fe0b40607d0 2021-10-20T23:22:09.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0bbeac700 1 -- 172.21.15.12:0/933707160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b40607d0 msgr2=0x7fe0b41400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0bbeac700 1 --2- 172.21.15.12:0/933707160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b40607d0 0x7fe0b41400a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fe0b00032f0 tx=0x7fe0b00091d0).stop 2021-10-20T23:22:09.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0bbeac700 1 -- 172.21.15.12:0/933707160 shutdown_connections 2021-10-20T23:22:09.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0bbeac700 1 --2- 172.21.15.12:0/933707160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b40ac500 0x7fe0b4140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0bbeac700 1 --2- 172.21.15.12:0/933707160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b40607d0 0x7fe0b41400a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0bbeac700 1 -- 172.21.15.12:0/933707160 >> 172.21.15.12:0/933707160 conn(0x7fe0b40b2970 msgr2=0x7fe0b40b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:09.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0bbeac700 1 -- 172.21.15.12:0/933707160 shutdown_connections 2021-10-20T23:22:09.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.728+0000 7fe0bbeac700 1 -- 172.21.15.12:0/933707160 wait complete. 2021-10-20T23:22:09.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0bbeac700 1 Processor -- start 2021-10-20T23:22:09.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0bbeac700 1 -- start start 2021-10-20T23:22:09.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0bbeac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b405faa0 0x7fe0b414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0bbeac700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0b40607d0 0x7fe0b4152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0bbeac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b40ac500 0x7fe0b4153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0bbeac700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b413a3b0 con 0x7fe0b40607d0 2021-10-20T23:22:09.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0bbeac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4155c50 con 0x7fe0b40ac500 2021-10-20T23:22:09.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0bbeac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4148d50 con 0x7fe0b405faa0 2021-10-20T23:22:09.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9447700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0b40607d0 0x7fe0b4152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9447700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0b40607d0 0x7fe0b4152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38910/0 (socket says 172.21.15.12:38910) 2021-10-20T23:22:09.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9447700 1 -- 172.21.15.12:0/1909402736 learned_addr learned my addr 172.21.15.12:0/1909402736 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:09.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b405faa0 0x7fe0b414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0ba449700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b40ac500 0x7fe0b4153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9447700 1 -- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b405faa0 msgr2=0x7fe0b414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9447700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b405faa0 0x7fe0b414a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9447700 1 -- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b40ac500 msgr2=0x7fe0b4153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9447700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b40ac500 0x7fe0b4153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9447700 1 -- 172.21.15.12:0/1909402736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0009470 con 0x7fe0b40607d0 2021-10-20T23:22:09.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0b9447700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0b40607d0 0x7fe0b4152d10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fe0b4155b70 tx=0x7fe0b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0aaffd700 1 -- 172.21.15.12:0/1909402736 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000b6c0 con 0x7fe0b40607d0 2021-10-20T23:22:09.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0aaffd700 1 -- 172.21.15.12:0/1909402736 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0021630 con 0x7fe0b40607d0 2021-10-20T23:22:09.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0bbeac700 1 -- 172.21.15.12:0/1909402736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b4148810 con 0x7fe0b40607d0 2021-10-20T23:22:09.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.732+0000 7fe0aaffd700 1 -- 172.21.15.12:0/1909402736 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b0021990 con 0x7fe0b40607d0 2021-10-20T23:22:09.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.736+0000 7fe0bbeac700 1 -- 172.21.15.12:0/1909402736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b40ae270 con 0x7fe0b40607d0 2021-10-20T23:22:09.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.736+0000 7fe0aaffd700 1 -- 172.21.15.12:0/1909402736 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe0b0027020 con 0x7fe0b40607d0 2021-10-20T23:22:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.736+0000 7fe0c60f0740 1 Processor -- start 2021-10-20T23:22:09.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.736+0000 7fe0c60f0740 1 -- start start 2021-10-20T23:22:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.736+0000 7fe0aaffd700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe094053610 0x7fe094055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.736+0000 7fe0aaffd700 1 -- 172.21.15.12:0/1909402736 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe0b006d0d0 con 0x7fe0b40607d0 2021-10-20T23:22:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.736+0000 7fe0ba449700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe094053610 0x7fe094055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 0xef24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf22c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 0xef08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0xe60190 con 0xf227c0 2021-10-20T23:22:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0xe40820 con 0xef0470 2021-10-20T23:22:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0xeefcf0 con 0xef20c0 2021-10-20T23:22:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0ba449700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe094053610 0x7fe094055ad0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fe0ac00b000 tx=0x7fe0ac006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9447700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf22c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9447700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf22c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38918/0 (socket says 172.21.15.12:38918) 2021-10-20T23:22:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9447700 1 -- 172.21.15.12:0/3453419681 learned_addr learned my addr 172.21.15.12:0/3453419681 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:09.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/3453419681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 0xef24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0ba449700 1 --2- 172.21.15.12:0/3453419681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 0xef08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9447700 1 -- 172.21.15.12:0/3453419681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 msgr2=0xef24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9447700 1 --2- 172.21.15.12:0/3453419681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 0xef24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9447700 1 -- 172.21.15.12:0/3453419681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 msgr2=0xef08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9447700 1 --2- 172.21.15.12:0/3453419681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 0xef08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9447700 1 -- 172.21.15.12:0/3453419681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe986e0 con 0xf227c0 2021-10-20T23:22:09.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0b9447700 1 --2- 172.21.15.12:0/3453419681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf22c20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0xf226b0 tx=0x7fe0b0012000).ready entity=mon.0 client_cookie=c4287471e74b1701 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0bbeac700 1 -- 172.21.15.12:0/3453419681 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b002f070 con 0xf227c0 2021-10-20T23:22:09.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0bbeac700 1 -- 172.21.15.12:0/3453419681 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0047c00 con 0xf227c0 2021-10-20T23:22:09.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0bbeac700 1 -- 172.21.15.12:0/3453419681 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000b990 con 0xf227c0 2021-10-20T23:22:09.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3453419681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 msgr2=0xf22c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3453419681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf22c20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0xf226b0 tx=0x7fe0b0012000).stop 2021-10-20T23:22:09.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3453419681 shutdown_connections 2021-10-20T23:22:09.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3453419681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 0xef08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3453419681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf22c20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3453419681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 0xef24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3453419681 >> 172.21.15.12:0/3453419681 conn(0xe78870 msgr2=0xef2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:09.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3453419681 shutdown_connections 2021-10-20T23:22:09.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3453419681 wait complete. 2021-10-20T23:22:09.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 -- start start 2021-10-20T23:22:09.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.740+0000 7fe0c60f0740 1 Processor -- start 2021-10-20T23:22:09.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 0xf34cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 0xf28040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf28530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0xf25da0 con 0xf227c0 2021-10-20T23:22:09.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0xf26010 con 0xef0470 2021-10-20T23:22:09.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0xf262b0 con 0xef20c0 2021-10-20T23:22:09.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 10 client.0 ll_register_callbacks cb 0xe2e410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-20T23:22:09.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0ba449700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf28530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0ba449700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf28530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38926/0 (socket says 172.21.15.12:38926) 2021-10-20T23:22:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0b9c48700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 0xf34cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0ba449700 1 -- 172.21.15.12:0/3012047763 learned_addr learned my addr 172.21.15.12:0/3012047763 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0b9447700 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 0xf28040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0ba449700 1 -- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 msgr2=0xf28040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0ba449700 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 0xf28040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0ba449700 1 -- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 msgr2=0xf34cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0ba449700 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 0xf34cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0ba449700 1 -- 172.21.15.12:0/3012047763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b40ae270 con 0xf227c0 2021-10-20T23:22:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0ba449700 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf28530 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fe0ac01a000 tx=0x7fe0ac016000).ready entity=mon.0 client_cookie=84e446d73a3ed301 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe090ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2021-10-20T23:22:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe090ff9700 1 -- 172.21.15.12:0/3012047763 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0ac024070 con 0xf227c0 2021-10-20T23:22:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe090ff9700 1 -- 172.21.15.12:0/3012047763 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe0ac0135b0 con 0xf227c0 2021-10-20T23:22:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3012047763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe4e4e0 con 0xf227c0 2021-10-20T23:22:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe090ff9700 1 -- 172.21.15.12:0/3012047763 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0ac013770 con 0xf227c0 2021-10-20T23:22:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 10 client.5418 fetch_fsmap learned FSMap version 19 2021-10-20T23:22:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3012047763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0xe4fa50 con 0xf227c0 2021-10-20T23:22:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe090ff9700 1 -- 172.21.15.12:0/3012047763 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe4e4e0 con 0xf227c0 2021-10-20T23:22:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe090ff9700 1 -- 172.21.15.12:0/3012047763 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 19) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fe0ac027300 con 0xf227c0 2021-10-20T23:22:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 10 client.5418 fetch_fsmap finished waiting for FSMap version 19 2021-10-20T23:22:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 10 client.5418 resolve_mds: resolved ID 'b' to GID 5233 2021-10-20T23:22:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 20 client.5418 populate_metadata read hostname 'smithi012' 2021-10-20T23:22:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] conn(0xf14150 0xf14530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 4 client.5418 mds_command: new command op to 5233 tid=0[{"prefix": "get_command_descriptions"}] 2021-10-20T23:22:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3012047763 --> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd44590 con 0xf14150 2021-10-20T23:22:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.744+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] conn(0xf14150 0xf14530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] conn(0xf14150 0xf14530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9d1b2e46d28c2238 server_cookie=448c1aba822e7652 in_seq=0 out_seq=0 2021-10-20T23:22:09.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe090ff9700 10 client.5418 ms_handle_connect on v2:172.21.15.31:6834/2510327912 2021-10-20T23:22:09.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe090ff9700 1 -- 172.21.15.12:0/3012047763 <== mds.0 v2:172.21.15.31:6834/2510327912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0xd44590 con 0xf14150 2021-10-20T23:22:09.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe090ff9700 10 client.5418 handle_command_reply: tid=0 2021-10-20T23:22:09.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 client.5418 shutdown 2021-10-20T23:22:09.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3012047763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 msgr2=0xf28530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf28530 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fe0ac01a000 tx=0x7fe0ac016000).stop 2021-10-20T23:22:09.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3012047763 shutdown_connections 2021-10-20T23:22:09.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] conn(0xf14150 0xf14530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xf28530 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef20c0 0xf28040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/3012047763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef0470 0xf34cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe090ff9700 0 client.5418 ms_handle_reset on v2:172.21.15.31:6834/2510327912 2021-10-20T23:22:09.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3012047763 >> 172.21.15.12:0/3012047763 conn(0xe78870 msgr2=0xeea6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:09.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3012047763 shutdown_connections 2021-10-20T23:22:09.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 1 -- 172.21.15.12:0/3012047763 wait complete. 2021-10-20T23:22:09.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.748+0000 7fe0c60f0740 20 client.5418 trim_cache size 0 max 16384 2021-10-20T23:22:09.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 Processor -- start 2021-10-20T23:22:09.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 -- start start 2021-10-20T23:22:09.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xef0470 0xef24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 0xf20ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xf227c0 0xf20fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0xeeec70 con 0xef0470 2021-10-20T23:22:09.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0xeec690 con 0xef20c0 2021-10-20T23:22:09.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0xd44590 con 0xf227c0 2021-10-20T23:22:09.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9c48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xef0470 0xef24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9c48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xef0470 0xef24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38932/0 (socket says 172.21.15.12:38932) 2021-10-20T23:22:09.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0ba449700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xf227c0 0xf20fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9c48700 1 -- 172.21.15.12:0/2398278689 learned_addr learned my addr 172.21.15.12:0/2398278689 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:09.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9447700 1 --2- 172.21.15.12:0/2398278689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 0xf20ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9c48700 1 -- 172.21.15.12:0/2398278689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xf227c0 msgr2=0xf20fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/2398278689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xf227c0 0xf20fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9c48700 1 -- 172.21.15.12:0/2398278689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 msgr2=0xf20ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/2398278689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 0xf20ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9c48700 1 -- 172.21.15.12:0/2398278689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe54d40 con 0xef0470 2021-10-20T23:22:09.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/2398278689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xef0470 0xef24a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0xceb440 tx=0x7fe0a4009040).ready entity=mon.0 client_cookie=6fe46e673c8859ca server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe092ffd700 1 -- 172.21.15.12:0/2398278689 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a401d070 con 0xef0470 2021-10-20T23:22:09.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe092ffd700 1 -- 172.21.15.12:0/2398278689 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a40070d0 con 0xef0470 2021-10-20T23:22:09.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe092ffd700 1 -- 172.21.15.12:0/2398278689 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a40063d0 con 0xef0470 2021-10-20T23:22:09.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2398278689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xef0470 msgr2=0xef24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:09.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2398278689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xef0470 0xef24a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0xceb440 tx=0x7fe0a4009040).stop 2021-10-20T23:22:09.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2398278689 shutdown_connections 2021-10-20T23:22:09.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2398278689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xf227c0 0xf20fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2398278689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 0xf20ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2398278689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xef0470 0xef24a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2398278689 >> 172.21.15.12:0/2398278689 conn(0xe78870 msgr2=0xef1660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:09.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2398278689 shutdown_connections 2021-10-20T23:22:09.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.764+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2398278689 wait complete. 2021-10-20T23:22:09.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0c60f0740 1 -- start start 2021-10-20T23:22:09.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0c60f0740 1 Processor -- start 2021-10-20T23:22:09.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef0470 0xf87d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 0xf88230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0c60f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xeed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0xeebe80 con 0xf227c0 2021-10-20T23:22:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0xeecfb0 con 0xef20c0 2021-10-20T23:22:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0c60f0740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0xf88720 con 0xef0470 2021-10-20T23:22:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0c60f0740 10 client.0 ll_register_callbacks cb 0x7fe0a4006640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-20T23:22:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0ba449700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xeed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0ba449700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xeed7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38940/0 (socket says 172.21.15.12:38940) 2021-10-20T23:22:09.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0ba449700 1 -- 172.21.15.12:0/2060024518 learned_addr learned my addr 172.21.15.12:0/2060024518 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:09.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0b9447700 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 0xf88230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef0470 0xf87d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0ba449700 1 -- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef0470 msgr2=0xf87d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0ba449700 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef0470 0xf87d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0ba449700 1 -- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 msgr2=0xf88230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0ba449700 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 0xf88230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0ba449700 1 -- 172.21.15.12:0/2060024518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a4006180 con 0xf227c0 2021-10-20T23:22:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe091ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2021-10-20T23:22:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.768+0000 7fe0ba449700 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xeed7e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0xf348b0 tx=0x7fe0ac024000).ready entity=mon.0 client_cookie=336e02b9a9326e2c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe091ffb700 1 -- 172.21.15.12:0/2060024518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0ac037070 con 0xf227c0 2021-10-20T23:22:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe091ffb700 1 -- 172.21.15.12:0/2060024518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe0ac00b8c0 con 0xf227c0 2021-10-20T23:22:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2060024518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe56170 con 0xf227c0 2021-10-20T23:22:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe091ffb700 1 -- 172.21.15.12:0/2060024518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0ac027300 con 0xf227c0 2021-10-20T23:22:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0c60f0740 10 client.5424 fetch_fsmap learned FSMap version 19 2021-10-20T23:22:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2060024518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0xe2a3f0 con 0xf227c0 2021-10-20T23:22:09.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe091ffb700 1 -- 172.21.15.12:0/2060024518 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe56170 con 0xf227c0 2021-10-20T23:22:09.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe091ffb700 1 -- 172.21.15.12:0/2060024518 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 19) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fe0ac014d00 con 0xf227c0 2021-10-20T23:22:09.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0c60f0740 10 client.5424 fetch_fsmap finished waiting for FSMap version 19 2021-10-20T23:22:09.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0c60f0740 10 client.5424 resolve_mds: resolved ID 'b' to GID 5233 2021-10-20T23:22:09.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0c60f0740 20 client.5424 populate_metadata read hostname 'smithi012' 2021-10-20T23:22:09.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] conn(0xf242c0 0xeedcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:09.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0c60f0740 4 client.5424 mds_command: new command op to 5233 tid=0[{"prefix": "cache drop"}] 2021-10-20T23:22:09.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2060024518 --> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0xcfa310 con 0xf242c0 2021-10-20T23:22:09.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] conn(0xf242c0 0xeedcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:09.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe091ffb700 10 client.5424 ms_handle_connect on v2:172.21.15.31:6834/2510327912 2021-10-20T23:22:09.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:09.772+0000 7fe0b9c48700 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] conn(0xf242c0 0xeedcd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=29750f86e2c93fd9 server_cookie=fd4440ad22d75094 in_seq=0 out_seq=0 2021-10-20T23:22:20.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe091ffb700 1 -- 172.21.15.12:0/2060024518 <== mds.0 v2:172.21.15.31:6834/2510327912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0xcfa310 con 0xf242c0 2021-10-20T23:22:20.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe091ffb700 10 client.5424 handle_command_reply: tid=0 2021-10-20T23:22:20.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 client.5424 shutdown 2021-10-20T23:22:20.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2060024518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 msgr2=0xeed7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:20.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xeed7e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0xf348b0 tx=0x7fe0ac024000).stop 2021-10-20T23:22:20.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2060024518 shutdown_connections 2021-10-20T23:22:20.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:6834/2510327912,v1:172.21.15.31:6835/2510327912] conn(0xf242c0 0xeedcd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:20.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xf227c0 0xeed7e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:20.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe091ffb700 0 client.5424 ms_handle_reset on v2:172.21.15.31:6834/2510327912 2021-10-20T23:22:20.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xef20c0 0xf88230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:20.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 --2- 172.21.15.12:0/2060024518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xef0470 0xf87d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:20.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2060024518 >> 172.21.15.12:0/2060024518 conn(0xe78870 msgr2=0xef1660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:20.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2060024518 shutdown_connections 2021-10-20T23:22:20.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 1 -- 172.21.15.12:0/2060024518 wait complete. 2021-10-20T23:22:20.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0c60f0740 20 client.5424 trim_cache size 0 max 16384 2021-10-20T23:22:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:22:20.960 INFO:teuthology.orchestra.run.smithi012.stdout: "client_recall": { 2021-10-20T23:22:20.960 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2021-10-20T23:22:20.960 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "(0) Success", 2021-10-20T23:22:20.961 INFO:teuthology.orchestra.run.smithi012.stdout: "recalled": 220 2021-10-20T23:22:20.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:22:20.962 INFO:teuthology.orchestra.run.smithi012.stdout: "flush_journal": { 2021-10-20T23:22:20.962 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2021-10-20T23:22:20.963 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "" 2021-10-20T23:22:20.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:22:20.964 INFO:teuthology.orchestra.run.smithi012.stdout: "trim_cache": { 2021-10-20T23:22:20.964 INFO:teuthology.orchestra.run.smithi012.stdout: "trimmed": 0 2021-10-20T23:22:20.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:22:20.965 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2021-10-20T23:22:20.965 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": { 2021-10-20T23:22:20.965 INFO:teuthology.orchestra.run.smithi012.stdout: "items": 19992, 2021-10-20T23:22:20.965 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes": 3099808 2021-10-20T23:22:20.965 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:22:20.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:22:20.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 11.174489053 2021-10-20T23:22:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:22:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 -- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe094053610 msgr2=0x7fe094055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe094053610 0x7fe094055ad0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fe0ac00b000 tx=0x7fe0ac006df0).stop 2021-10-20T23:22:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 -- 172.21.15.12:0/1909402736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0b40607d0 msgr2=0x7fe0b4152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0b40607d0 0x7fe0b4152d10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fe0b4155b70 tx=0x7fe0b0016000).stop 2021-10-20T23:22:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 -- 172.21.15.12:0/1909402736 shutdown_connections 2021-10-20T23:22:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe094053610 0x7fe094055ad0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b40ac500 0x7fe0b4153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0b40607d0 0x7fe0b4152d10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 --2- 172.21.15.12:0/1909402736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b405faa0 0x7fe0b414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 -- 172.21.15.12:0/1909402736 >> 172.21.15.12:0/1909402736 conn(0x7fe0b40b2970 msgr2=0x7fe0b40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 -- 172.21.15.12:0/1909402736 shutdown_connections 2021-10-20T23:22:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:20.948+0000 7fe0bbeac700 1 -- 172.21.15.12:0/1909402736 wait complete. 2021-10-20T23:22:20.975 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-10-20T23:22:20.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:20.976 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:22:20.976 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:22:20.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:22:20.986 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-10-20T23:22:20.986 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-10-20T23:22:20.987 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:22:20.987 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:22:20.988 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:22:21.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:21.017 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:22:21.017 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:22:21.067 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:22:21.068 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:22:21.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:22:21.070 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:22:21.078 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:22:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52db2db700 1 Processor -- start 2021-10-20T23:22:21.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52db2db700 1 -- start start 2021-10-20T23:22:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52db2db700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52d40af2c0 0x7f52d40af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52db2db700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d40ad320 0x7f52d4143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52db2db700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d40afda0 con 0x7f52d4143640 2021-10-20T23:22:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52db2db700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d405c610 con 0x7f52d40af2c0 2021-10-20T23:22:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52db2db700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4140800 con 0x7f52d40ad320 2021-10-20T23:22:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52daada700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f52d4143640 0x7f52d40a8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37542/0 (socket says 172.21.15.12:37542) 2021-10-20T23:22:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52daada700 1 -- 172.21.15.12:0/3465721066 learned_addr learned my addr 172.21.15.12:0/3465721066 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:22:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d9ad8700 1 --2- 172.21.15.12:0/3465721066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d40ad320 0x7f52d4143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52da2d9700 1 --2- 172.21.15.12:0/3465721066 >> v2:172.21.15.31:3300/0 conn(0x7f52d40af2c0 0x7f52d40af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d92d7700 1 -- 172.21.15.12:0/3465721066 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589306882 0 0) 0x7f52d40afda0 con 0x7f52d4143640 2021-10-20T23:22:21.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d92d7700 1 -- 172.21.15.12:0/3465721066 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc003260 con 0x7f52d4143640 2021-10-20T23:22:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d9ad8700 1 -- 172.21.15.12:0/3465721066 >> v2:172.21.15.31:3300/0 conn(0x7f52d40af2c0 msgr2=0x7f52d40af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d9ad8700 1 --2- 172.21.15.12:0/3465721066 >> v2:172.21.15.31:3300/0 conn(0x7f52d40af2c0 0x7f52d40af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d9ad8700 1 -- 172.21.15.12:0/3465721066 >> v1:172.21.15.12:6789/0 conn(0x7f52d4143640 legacy=0x7f52d40a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d9ad8700 1 -- 172.21.15.12:0/3465721066 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40a93c0 con 0x7f52d40ad320 2021-10-20T23:22:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d9ad8700 1 --2- 172.21.15.12:0/3465721066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d40ad320 0x7f52d4143150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f52d413fc30 tx=0x7f52c4006df0).ready entity=mon.2 client_cookie=74259bcfd19c3982 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d92d7700 1 -- 172.21.15.12:0/3465721066 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c400d570 con 0x7f52d40ad320 2021-10-20T23:22:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d92d7700 1 -- 172.21.15.12:0/3465721066 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c4000e90 con 0x7f52d40ad320 2021-10-20T23:22:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.188+0000 7f52d92d7700 1 -- 172.21.15.12:0/3465721066 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c400d8c0 con 0x7f52d40ad320 2021-10-20T23:22:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 -- 172.21.15.12:0/3465721066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d40ad320 msgr2=0x7f52d4143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 --2- 172.21.15.12:0/3465721066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d40ad320 0x7f52d4143150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f52d413fc30 tx=0x7f52c4006df0).stop 2021-10-20T23:22:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 -- 172.21.15.12:0/3465721066 shutdown_connections 2021-10-20T23:22:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 --2- 172.21.15.12:0/3465721066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d40ad320 0x7f52d4143150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 --2- 172.21.15.12:0/3465721066 >> v2:172.21.15.31:3300/0 conn(0x7f52d40af2c0 0x7f52d40af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 -- 172.21.15.12:0/3465721066 >> 172.21.15.12:0/3465721066 conn(0x7f52d4061140 msgr2=0x7f52d4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 -- 172.21.15.12:0/3465721066 shutdown_connections 2021-10-20T23:22:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 -- 172.21.15.12:0/3465721066 wait complete. 2021-10-20T23:22:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 Processor -- start 2021-10-20T23:22:21.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.192+0000 7f52db2db700 1 -- start start 2021-10-20T23:22:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52db2db700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d40ad320 0x7f52d41520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52db2db700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d40af2c0 0x7f52d4146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52db2db700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d4143640 0x7f52d4155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52db2db700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40b56c0 con 0x7f52d40ad320 2021-10-20T23:22:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52db2db700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d41557f0 con 0x7f52d40af2c0 2021-10-20T23:22:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52db2db700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4152590 con 0x7f52d4143640 2021-10-20T23:22:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52da2d9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d40ad320 0x7f52d41520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52da2d9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d40ad320 0x7f52d41520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38950/0 (socket says 172.21.15.12:38950) 2021-10-20T23:22:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52da2d9700 1 -- 172.21.15.12:0/813819391 learned_addr learned my addr 172.21.15.12:0/813819391 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52d9ad8700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d40af2c0 0x7f52d4146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52daada700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d4143640 0x7f52d4155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52da2d9700 1 -- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d4143640 msgr2=0x7f52d4155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52da2d9700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d4143640 0x7f52d4155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52da2d9700 1 -- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d40af2c0 msgr2=0x7f52d4146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52da2d9700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d40af2c0 0x7f52d4146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52da2d9700 1 -- 172.21.15.12:0/813819391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c400b180 con 0x7f52d40ad320 2021-10-20T23:22:21.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52d9ad8700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d40af2c0 0x7f52d4146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:22:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52daada700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d4143640 0x7f52d4155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:22:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52da2d9700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d40ad320 0x7f52d41520a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f52d000c000 tx=0x7f52d0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52c37fe700 1 -- 172.21.15.12:0/813819391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d0010780 con 0x7f52d40ad320 2021-10-20T23:22:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52c37fe700 1 -- 172.21.15.12:0/813819391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d00108e0 con 0x7f52d40ad320 2021-10-20T23:22:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d40b4bb0 con 0x7f52d40ad320 2021-10-20T23:22:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52c37fe700 1 -- 172.21.15.12:0/813819391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d0010c40 con 0x7f52d40ad320 2021-10-20T23:22:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d4156420 con 0x7f52d40ad320 2021-10-20T23:22:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.196+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d4057350 con 0x7f52d40ad320 2021-10-20T23:22:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.200+0000 7f52c37fe700 1 -- 172.21.15.12:0/813819391 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52d001c460 con 0x7f52d40ad320 2021-10-20T23:22:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.200+0000 7f52c37fe700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52b40536d0 0x7f52b4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.200+0000 7f52c37fe700 1 -- 172.21.15.12:0/813819391 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f52d006be20 con 0x7f52d40ad320 2021-10-20T23:22:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.200+0000 7f52d9ad8700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52b40536d0 0x7f52b4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.200+0000 7f52d9ad8700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52b40536d0 0x7f52b4055b90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f52c401a000 tx=0x7f52c4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:21.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.204+0000 7f52c37fe700 1 -- 172.21.15.12:0/813819391 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52d0042dc0 con 0x7f52d40ad320 2021-10-20T23:22:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.332+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52d4061990 con 0x7f52d40ad320 2021-10-20T23:22:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52c37fe700 1 -- 172.21.15.12:0/813819391 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f52d00463e0 con 0x7f52d40ad320 2021-10-20T23:22:21.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:22:21.339 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":48,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:21:52.512426+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:21:48.487958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-20T23:21:49.501193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:22:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52b40536d0 msgr2=0x7f52b4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52b40536d0 0x7f52b4055b90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f52c401a000 tx=0x7f52c4014000).stop 2021-10-20T23:22:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d40ad320 msgr2=0x7f52d41520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d40ad320 0x7f52d41520a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f52d000c000 tx=0x7f52d0006df0).stop 2021-10-20T23:22:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 shutdown_connections 2021-10-20T23:22:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52b40536d0 0x7f52b4055b90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52d4143640 0x7f52d4155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d40af2c0 0x7f52d4146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 --2- 172.21.15.12:0/813819391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d40ad320 0x7f52d41520a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 >> 172.21.15.12:0/813819391 conn(0x7f52d4061140 msgr2=0x7f52d405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 shutdown_connections 2021-10-20T23:22:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.336+0000 7f52db2db700 1 -- 172.21.15.12:0/813819391 wait complete. 2021-10-20T23:22:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:21:48.487958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:21:49.501193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:22:21.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:22:21.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.460+0000 7efd132bc700 1 Processor -- start 2021-10-20T23:22:21.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.460+0000 7efd132bc700 1 -- start start 2021-10-20T23:22:21.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efd0c0a9c10 0x7efd0c0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c140140 0x7efd0c1405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c066ea0 con 0x7efd0c0b3040 2021-10-20T23:22:21.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c0648e0 con 0x7efd0c0a9c10 2021-10-20T23:22:21.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c061dd0 con 0x7efd0c140140 2021-10-20T23:22:21.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd11ab9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efd0c0a9c10 0x7efd0c0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd122ba700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efd0c0b3040 0x7efd0c065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37552/0 (socket says 172.21.15.12:37552) 2021-10-20T23:22:21.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd11ab9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efd0c0a9c10 0x7efd0c0607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38960/0 (socket says 172.21.15.12:38960) 2021-10-20T23:22:21.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd122ba700 1 -- 172.21.15.12:0/997004512 learned_addr learned my addr 172.21.15.12:0/997004512 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:22:21.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd12abb700 1 --2- 172.21.15.12:0/997004512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c140140 0x7efd0c1405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd11ab9700 1 -- 172.21.15.12:0/997004512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c140140 msgr2=0x7efd0c1405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:21.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd11ab9700 1 --2- 172.21.15.12:0/997004512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c140140 0x7efd0c1405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd112b8700 1 -- 172.21.15.12:0/997004512 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067928600 0 0) 0x7efd0c066ea0 con 0x7efd0c0b3040 2021-10-20T23:22:21.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd11ab9700 1 -- 172.21.15.12:0/997004512 >> v1:172.21.15.12:6789/0 conn(0x7efd0c0b3040 legacy=0x7efd0c065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd11ab9700 1 -- 172.21.15.12:0/997004512 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0b3420 con 0x7efd0c0a9c10 2021-10-20T23:22:21.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd11ab9700 1 --2- 172.21.15.12:0/997004512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 0x7efd0c0607c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7efd0c0630a0 tx=0x7efcfc006df0).ready entity=mon.0 client_cookie=59c9df23c18b4f1b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:21.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd112b8700 1 -- 172.21.15.12:0/997004512 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcfc00d570 con 0x7efd0c0a9c10 2021-10-20T23:22:21.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd112b8700 1 -- 172.21.15.12:0/997004512 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc000e90 con 0x7efd0c0a9c10 2021-10-20T23:22:21.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd112b8700 1 -- 172.21.15.12:0/997004512 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcfc00d8c0 con 0x7efd0c0a9c10 2021-10-20T23:22:21.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 -- 172.21.15.12:0/997004512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 msgr2=0x7efd0c0607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 --2- 172.21.15.12:0/997004512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 0x7efd0c0607c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7efd0c0630a0 tx=0x7efcfc006df0).stop 2021-10-20T23:22:21.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 -- 172.21.15.12:0/997004512 shutdown_connections 2021-10-20T23:22:21.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 --2- 172.21.15.12:0/997004512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c140140 0x7efd0c1405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 --2- 172.21.15.12:0/997004512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 0x7efd0c0607c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 -- 172.21.15.12:0/997004512 >> 172.21.15.12:0/997004512 conn(0x7efd0c0636e0 msgr2=0x7efd0c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:21.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 -- 172.21.15.12:0/997004512 shutdown_connections 2021-10-20T23:22:21.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.464+0000 7efd132bc700 1 -- 172.21.15.12:0/997004512 wait complete. 2021-10-20T23:22:21.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd132bc700 1 Processor -- start 2021-10-20T23:22:21.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd132bc700 1 -- start start 2021-10-20T23:22:21.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd132bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 0x7efd0c142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd132bc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c0b3040 0x7efd0c141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd132bc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0c140140 0x7efd0c0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd132bc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c142650 con 0x7efd0c0a9c10 2021-10-20T23:22:21.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd132bc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c13a520 con 0x7efd0c140140 2021-10-20T23:22:21.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd132bc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c141f80 con 0x7efd0c0b3040 2021-10-20T23:22:21.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd122ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 0x7efd0c142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd122ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 0x7efd0c142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38964/0 (socket says 172.21.15.12:38964) 2021-10-20T23:22:21.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd122ba700 1 -- 172.21.15.12:0/2615711424 learned_addr learned my addr 172.21.15.12:0/2615711424 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:21.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd11ab9700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c0b3040 0x7efd0c141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd12abb700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0c140140 0x7efd0c0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd122ba700 1 -- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c0b3040 msgr2=0x7efd0c141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd122ba700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c0b3040 0x7efd0c141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd122ba700 1 -- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0c140140 msgr2=0x7efd0c0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd122ba700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0c140140 0x7efd0c0a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd122ba700 1 -- 172.21.15.12:0/2615711424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc00b180 con 0x7efd0c0a9c10 2021-10-20T23:22:21.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd122ba700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 0x7efd0c142ab0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7efd0c143000 tx=0x7efd08007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:21.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efcfb7fe700 1 -- 172.21.15.12:0/2615711424 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd0800ce40 con 0x7efd0c0a9c10 2021-10-20T23:22:21.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efcfb7fe700 1 -- 172.21.15.12:0/2615711424 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd080072e0 con 0x7efd0c0a9c10 2021-10-20T23:22:21.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c155f50 con 0x7efd0c0a9c10 2021-10-20T23:22:21.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.468+0000 7efcfb7fe700 1 -- 172.21.15.12:0/2615711424 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd08005610 con 0x7efd0c0a9c10 2021-10-20T23:22:21.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.472+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c1421b0 con 0x7efd0c0a9c10 2021-10-20T23:22:21.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.472+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c141490 con 0x7efd0c0a9c10 2021-10-20T23:22:21.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.472+0000 7efcfb7fe700 1 -- 172.21.15.12:0/2615711424 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd08010070 con 0x7efd0c0a9c10 2021-10-20T23:22:21.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.472+0000 7efcfb7fe700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcec053580 0x7efcec055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.472+0000 7efcfb7fe700 1 -- 172.21.15.12:0/2615711424 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efd0806b2b0 con 0x7efd0c0a9c10 2021-10-20T23:22:21.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.472+0000 7efd11ab9700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcec053580 0x7efcec055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.472+0000 7efd11ab9700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcec053580 0x7efcec055a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7efcfc018000 tx=0x7efcfc014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:21.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.480+0000 7efcfb7fe700 1 -- 172.21.15.12:0/2615711424 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efd0c141490 con 0x7efd0c0a9c10 2021-10-20T23:22:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efd0c141490 con 0x7efd0c0a9c10 2021-10-20T23:22:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efcfb7fe700 1 -- 172.21.15.12:0/2615711424 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v48) v1 ==== 110+0+10 (secure 0 0 0) 0x7efd0c141490 con 0x7efd0c0a9c10 2021-10-20T23:22:21.607 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:22:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcec053580 msgr2=0x7efcec055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcec053580 0x7efcec055a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7efcfc018000 tx=0x7efcfc014000).stop 2021-10-20T23:22:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 msgr2=0x7efd0c142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 0x7efd0c142ab0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7efd0c143000 tx=0x7efd08007ac0).stop 2021-10-20T23:22:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 shutdown_connections 2021-10-20T23:22:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcec053580 0x7efcec055a40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0c140140 0x7efd0c0a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd0c0b3040 0x7efd0c141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 --2- 172.21.15.12:0/2615711424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd0c0a9c10 0x7efd0c142ab0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 >> 172.21.15.12:0/2615711424 conn(0x7efd0c0636e0 msgr2=0x7efd0c0b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:21.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 shutdown_connections 2021-10-20T23:22:21.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.604+0000 7efd132bc700 1 -- 172.21.15.12:0/2615711424 wait complete. 2021-10-20T23:22:21.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:22:21.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.728+0000 7f603ffff700 1 Processor -- start 2021-10-20T23:22:21.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.728+0000 7f603ffff700 1 -- start start 2021-10-20T23:22:21.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b3000 0x7f6040060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60400b25a0 0x7f6040061000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6040066520 0x7f6040066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6040062000 con 0x7f6040066520 2021-10-20T23:22:21.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6040065330 con 0x7f60400b25a0 2021-10-20T23:22:21.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60400b33e0 con 0x7f60400b3000 2021-10-20T23:22:21.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6040066520 0x7f6040066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6040066520 0x7f6040066990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38976/0 (socket says 172.21.15.12:38976) 2021-10-20T23:22:21.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603f7fe700 1 -- 172.21.15.12:0/4164041676 learned_addr learned my addr 172.21.15.12:0/4164041676 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:21.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603e7fc700 1 --2- 172.21.15.12:0/4164041676 >> v2:172.21.15.31:3300/0 conn(0x7f60400b25a0 0x7f6040061000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603effd700 1 --2- 172.21.15.12:0/4164041676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b3000 0x7f6040060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603f7fe700 1 -- 172.21.15.12:0/4164041676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b3000 msgr2=0x7f6040060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:21.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603f7fe700 1 --2- 172.21.15.12:0/4164041676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b3000 0x7f6040060b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603f7fe700 1 -- 172.21.15.12:0/4164041676 >> v2:172.21.15.31:3300/0 conn(0x7f60400b25a0 msgr2=0x7f6040061000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:21.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603f7fe700 1 --2- 172.21.15.12:0/4164041676 >> v2:172.21.15.31:3300/0 conn(0x7f60400b25a0 0x7f6040061000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603f7fe700 1 -- 172.21.15.12:0/4164041676 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604005fa60 con 0x7f6040066520 2021-10-20T23:22:21.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603f7fe700 1 --2- 172.21.15.12:0/4164041676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 0x7f6040066990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f60380032f0 tx=0x7f6038009290).ready entity=mon.0 client_cookie=c522ccdfcae8f1ce server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:21.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603dffb700 1 -- 172.21.15.12:0/4164041676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f603800b870 con 0x7f6040066520 2021-10-20T23:22:21.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603dffb700 1 -- 172.21.15.12:0/4164041676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603800b9d0 con 0x7f6040066520 2021-10-20T23:22:21.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603dffb700 1 -- 172.21.15.12:0/4164041676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f603800bb40 con 0x7f6040066520 2021-10-20T23:22:21.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 -- 172.21.15.12:0/4164041676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 msgr2=0x7f6040066990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 --2- 172.21.15.12:0/4164041676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 0x7f6040066990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f60380032f0 tx=0x7f6038009290).stop 2021-10-20T23:22:21.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 -- 172.21.15.12:0/4164041676 shutdown_connections 2021-10-20T23:22:21.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 --2- 172.21.15.12:0/4164041676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 0x7f6040066990 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 --2- 172.21.15.12:0/4164041676 >> v2:172.21.15.31:3300/0 conn(0x7f60400b25a0 0x7f6040061000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 --2- 172.21.15.12:0/4164041676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b3000 0x7f6040060b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 -- 172.21.15.12:0/4164041676 >> 172.21.15.12:0/4164041676 conn(0x7f60400636e0 msgr2=0x7f6040063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:21.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 -- 172.21.15.12:0/4164041676 shutdown_connections 2021-10-20T23:22:21.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.732+0000 7f603ffff700 1 -- 172.21.15.12:0/4164041676 wait complete. 2021-10-20T23:22:21.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 Processor -- start 2021-10-20T23:22:21.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 -- start start 2021-10-20T23:22:21.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 0x7f60400b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b25a0 0x7f60400adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60400b3000 0x7f60400adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6040145a70 con 0x7f6040066520 2021-10-20T23:22:21.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6040152a30 con 0x7f60400b3000 2021-10-20T23:22:21.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6040145ca0 con 0x7f60400b25a0 2021-10-20T23:22:21.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 0x7f60400b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 0x7f60400b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38978/0 (socket says 172.21.15.12:38978) 2021-10-20T23:22:21.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603effd700 1 -- 172.21.15.12:0/296011310 learned_addr learned my addr 172.21.15.12:0/296011310 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:21.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603e7fc700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b25a0 0x7f60400adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603f7fe700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60400b3000 0x7f60400adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603effd700 1 -- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b25a0 msgr2=0x7f60400adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603effd700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b25a0 0x7f60400adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603effd700 1 -- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60400b3000 msgr2=0x7f60400adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603effd700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60400b3000 0x7f60400adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603effd700 1 -- 172.21.15.12:0/296011310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038009530 con 0x7f6040066520 2021-10-20T23:22:21.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603e7fc700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b25a0 0x7f60400adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:22:21.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603effd700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 0x7f60400b0410 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f60300030b0 tx=0x7f6030008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:21.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f6037fff700 1 -- 172.21.15.12:0/296011310 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6030011780 con 0x7f6040066520 2021-10-20T23:22:21.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6040152ca0 con 0x7f6040066520 2021-10-20T23:22:21.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f6037fff700 1 -- 172.21.15.12:0/296011310 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60300118e0 con 0x7f6040066520 2021-10-20T23:22:21.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60400ac500 con 0x7f6040066520 2021-10-20T23:22:21.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.736+0000 7f6037fff700 1 -- 172.21.15.12:0/296011310 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6030011c40 con 0x7f6040066520 2021-10-20T23:22:21.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.740+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604005fd00 con 0x7f6040066520 2021-10-20T23:22:21.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.740+0000 7f6037fff700 1 -- 172.21.15.12:0/296011310 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6030012420 con 0x7f6040066520 2021-10-20T23:22:21.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.740+0000 7f6037fff700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60240535b0 0x7f6024055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:21.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.740+0000 7f6037fff700 1 -- 172.21.15.12:0/296011310 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f603006b8b0 con 0x7f6040066520 2021-10-20T23:22:21.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.740+0000 7f603e7fc700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60240535b0 0x7f6024055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:21.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.740+0000 7f603e7fc700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60240535b0 0x7f6024055a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f602800b000 tx=0x7f6028008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:21.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.748+0000 7f6037fff700 1 -- 172.21.15.12:0/296011310 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60300427b0 con 0x7f6040066520 2021-10-20T23:22:21.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.872+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6040057350 con 0x7f6040066520 2021-10-20T23:22:21.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.872+0000 7f6037fff700 1 -- 172.21.15.12:0/296011310 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6030045dd0 con 0x7f6040066520 2021-10-20T23:22:21.878 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:22:21.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60240535b0 msgr2=0x7f6024055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60240535b0 0x7f6024055a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f602800b000 tx=0x7f6028008040).stop 2021-10-20T23:22:21.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 msgr2=0x7f60400b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:21.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 0x7f60400b0410 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f60300030b0 tx=0x7f6030008040).stop 2021-10-20T23:22:21.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 shutdown_connections 2021-10-20T23:22:21.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60240535b0 0x7f6024055a70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60400b3000 0x7f60400adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60400b25a0 0x7f60400adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 --2- 172.21.15.12:0/296011310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040066520 0x7f60400b0410 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:21.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 >> 172.21.15.12:0/296011310 conn(0x7f60400636e0 msgr2=0x7f60400b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:21.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 shutdown_connections 2021-10-20T23:22:21.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:21.876+0000 7f603ffff700 1 -- 172.21.15.12:0/296011310 wait complete. 2021-10-20T23:22:21.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:22:22.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.000+0000 7f12b7fff700 1 Processor -- start 2021-10-20T23:22:22.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.000+0000 7f12b7fff700 1 -- start start 2021-10-20T23:22:22.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.000+0000 7f12b7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b8061680 0x7f12b80b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.000+0000 7f12b7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12b81439a0 0x7f12b81404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.000+0000 7f12b7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b80b6910 con 0x7f12b80b4710 2021-10-20T23:22:22.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.000+0000 7f12b7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b80b9680 con 0x7f12b81439a0 2021-10-20T23:22:22.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.000+0000 7f12b7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80b6bb0 con 0x7f12b8061680 2021-10-20T23:22:22.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12b81439a0 0x7f12b81404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12b81439a0 0x7f12b81404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38990/0 (socket says 172.21.15.12:38990) 2021-10-20T23:22:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b77fe700 1 -- 172.21.15.12:0/323113210 learned_addr learned my addr 172.21.15.12:0/323113210 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b67fc700 1 --1- 172.21.15.12:0/323113210 >> v1:172.21.15.12:6789/0 conn(0x7f12b80b4710 0x7f12b813fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37580/0 (socket says 172.21.15.12:37580) 2021-10-20T23:22:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b6ffd700 1 --2- 172.21.15.12:0/323113210 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b8061680 0x7f12b80b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b77fe700 1 -- 172.21.15.12:0/323113210 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b8061680 msgr2=0x7f12b80b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b77fe700 1 --2- 172.21.15.12:0/323113210 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b8061680 0x7f12b80b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b77fe700 1 -- 172.21.15.12:0/323113210 >> v1:172.21.15.12:6789/0 conn(0x7f12b80b4710 legacy=0x7f12b813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b77fe700 1 -- 172.21.15.12:0/323113210 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80b6e50 con 0x7f12b81439a0 2021-10-20T23:22:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b77fe700 1 --2- 172.21.15.12:0/323113210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b81439a0 0x7f12b81404b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f12b00032f0 tx=0x7f12b0009290).ready entity=mon.0 client_cookie=227946e1065446b3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b5ffb700 1 -- 172.21.15.12:0/323113210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12b000b8a0 con 0x7f12b81439a0 2021-10-20T23:22:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b5ffb700 1 -- 172.21.15.12:0/323113210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b000ba00 con 0x7f12b81439a0 2021-10-20T23:22:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b5ffb700 1 -- 172.21.15.12:0/323113210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12b000bb70 con 0x7f12b81439a0 2021-10-20T23:22:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b7fff700 1 -- 172.21.15.12:0/323113210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b81439a0 msgr2=0x7f12b81404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b7fff700 1 --2- 172.21.15.12:0/323113210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b81439a0 0x7f12b81404b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f12b00032f0 tx=0x7f12b0009290).stop 2021-10-20T23:22:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b7fff700 1 -- 172.21.15.12:0/323113210 shutdown_connections 2021-10-20T23:22:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b7fff700 1 --2- 172.21.15.12:0/323113210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b81439a0 0x7f12b81404b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b7fff700 1 --2- 172.21.15.12:0/323113210 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b8061680 0x7f12b80b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b7fff700 1 -- 172.21.15.12:0/323113210 >> 172.21.15.12:0/323113210 conn(0x7f12b806adf0 msgr2=0x7f12b805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:22.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b7fff700 1 -- 172.21.15.12:0/323113210 shutdown_connections 2021-10-20T23:22:22.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b7fff700 1 -- 172.21.15.12:0/323113210 wait complete. 2021-10-20T23:22:22.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.004+0000 7f12b7fff700 1 Processor -- start 2021-10-20T23:22:22.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b7fff700 1 -- start start 2021-10-20T23:22:22.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b8061680 0x7f12b80ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b81439a0 0x7f12b8146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b80adae0 0x7f12b8155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80b0560 con 0x7f12b80adae0 2021-10-20T23:22:22.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80b0790 con 0x7f12b8061680 2021-10-20T23:22:22.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8145ee0 con 0x7f12b81439a0 2021-10-20T23:22:22.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b80adae0 0x7f12b8155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b80adae0 0x7f12b8155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38996/0 (socket says 172.21.15.12:38996) 2021-10-20T23:22:22.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b67fc700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b81439a0 0x7f12b8146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b77fe700 1 -- 172.21.15.12:0/1270168312 learned_addr learned my addr 172.21.15.12:0/1270168312 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:22.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b6ffd700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b8061680 0x7f12b80ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b77fe700 1 -- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b81439a0 msgr2=0x7f12b8146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b77fe700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b81439a0 0x7f12b8146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b77fe700 1 -- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b8061680 msgr2=0x7f12b80ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b77fe700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b8061680 0x7f12b80ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b77fe700 1 -- 172.21.15.12:0/1270168312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0009530 con 0x7f12b80adae0 2021-10-20T23:22:22.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b67fc700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b81439a0 0x7f12b8146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:22:22.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b77fe700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b80adae0 0x7f12b8155e30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f12b00032f0 tx=0x7f12b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:22.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12affff700 1 -- 172.21.15.12:0/1270168312 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12b000b8a0 con 0x7f12b80adae0 2021-10-20T23:22:22.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12affff700 1 -- 172.21.15.12:0/1270168312 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b0021670 con 0x7f12b80adae0 2021-10-20T23:22:22.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b80ae000 con 0x7f12b80adae0 2021-10-20T23:22:22.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12affff700 1 -- 172.21.15.12:0/1270168312 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12b00219d0 con 0x7f12b80adae0 2021-10-20T23:22:22.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.008+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b8112c90 con 0x7f12b80adae0 2021-10-20T23:22:22.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.012+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b8144b00 con 0x7f12b80adae0 2021-10-20T23:22:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.012+0000 7f12affff700 1 -- 172.21.15.12:0/1270168312 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f12b000f070 con 0x7f12b80adae0 2021-10-20T23:22:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.012+0000 7f12affff700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f129c053640 0x7f129c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.012+0000 7f12affff700 1 -- 172.21.15.12:0/1270168312 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f12b006cb80 con 0x7f12b80adae0 2021-10-20T23:22:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.012+0000 7f12b6ffd700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f129c053640 0x7f129c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.012+0000 7f12b6ffd700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f129c053640 0x7f129c055b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f12a800c000 tx=0x7f12a8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.020+0000 7f12affff700 1 -- 172.21.15.12:0/1270168312 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f12b0043ae0 con 0x7f12b80adae0 2021-10-20T23:22:22.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12b8057350 con 0x7f12b80adae0 2021-10-20T23:22:22.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12affff700 1 -- 172.21.15.12:0/1270168312 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+10 (secure 0 0 0) 0x7f12b0015020 con 0x7f12b80adae0 2021-10-20T23:22:22.148 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:22:22.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f129c053640 msgr2=0x7f129c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f129c053640 0x7f129c055b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f12a800c000 tx=0x7f12a8008040).stop 2021-10-20T23:22:22.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b80adae0 msgr2=0x7f12b8155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b80adae0 0x7f12b8155e30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f12b00032f0 tx=0x7f12b0016000).stop 2021-10-20T23:22:22.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 shutdown_connections 2021-10-20T23:22:22.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f129c053640 0x7f129c055b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12b80adae0 0x7f12b8155e30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12b81439a0 0x7f12b8146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 --2- 172.21.15.12:0/1270168312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b8061680 0x7f12b80ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.144+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 >> 172.21.15.12:0/1270168312 conn(0x7f12b806adf0 msgr2=0x7f12b8141830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:22.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.148+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 shutdown_connections 2021-10-20T23:22:22.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.148+0000 7f12b7fff700 1 -- 172.21.15.12:0/1270168312 wait complete. 2021-10-20T23:22:22.161 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:22:22.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e31ac700 1 Processor -- start 2021-10-20T23:22:22.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e31ac700 1 -- start start 2021-10-20T23:22:22.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e31ac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5dc146950 0x7fa5dc140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e31ac700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5dc0b4180 0x7fa5dc140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e31ac700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc143b60 con 0x7fa5dc0b4690 2021-10-20T23:22:22.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e31ac700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5dc147510 con 0x7fa5dc0b4180 2021-10-20T23:22:22.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e31ac700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5dc143e00 con 0x7fa5dc146950 2021-10-20T23:22:22.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5dc0b4180 0x7fa5dc140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5dc0b4180 0x7fa5dc140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39002/0 (socket says 172.21.15.12:39002) 2021-10-20T23:22:22.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d3fff700 1 -- 172.21.15.12:0/3878270733 learned_addr learned my addr 172.21.15.12:0/3878270733 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:22.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e0f48700 1 --2- 172.21.15.12:0/3878270733 >> v2:172.21.15.31:3300/0 conn(0x7fa5dc146950 0x7fa5dc140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d3fff700 1 -- 172.21.15.12:0/3878270733 >> v2:172.21.15.31:3300/0 conn(0x7fa5dc146950 msgr2=0x7fa5dc140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:22:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d3fff700 1 --2- 172.21.15.12:0/3878270733 >> v2:172.21.15.31:3300/0 conn(0x7fa5dc146950 0x7fa5dc140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d3fff700 1 -- 172.21.15.12:0/3878270733 >> v1:172.21.15.12:6789/0 conn(0x7fa5dc0b4690 legacy=0x7fa5dc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d3fff700 1 -- 172.21.15.12:0/3878270733 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc0b0c90 con 0x7fa5dc0b4180 2021-10-20T23:22:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d37fe700 1 -- 172.21.15.12:0/3878270733 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050027846 0 0) 0x7fa5dc143b60 con 0x7fa5dc0b4690 2021-10-20T23:22:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d3fff700 1 --2- 172.21.15.12:0/3878270733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 0x7fa5dc140720 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fa5cc002f70 tx=0x7fa5cc006eb0).ready entity=mon.0 client_cookie=1333f82324fff877 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d37fe700 1 -- 172.21.15.12:0/3878270733 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5cc00d610 con 0x7fa5dc0b4180 2021-10-20T23:22:22.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d37fe700 1 -- 172.21.15.12:0/3878270733 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc000e90 con 0x7fa5dc0b4180 2021-10-20T23:22:22.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5d37fe700 1 -- 172.21.15.12:0/3878270733 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5cc00d960 con 0x7fa5dc0b4180 2021-10-20T23:22:22.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e31ac700 1 -- 172.21.15.12:0/3878270733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 msgr2=0x7fa5dc140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.268+0000 7fa5e31ac700 1 --2- 172.21.15.12:0/3878270733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 0x7fa5dc140720 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fa5cc002f70 tx=0x7fa5cc006eb0).stop 2021-10-20T23:22:22.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 -- 172.21.15.12:0/3878270733 shutdown_connections 2021-10-20T23:22:22.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 --2- 172.21.15.12:0/3878270733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 0x7fa5dc140720 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 --2- 172.21.15.12:0/3878270733 >> v2:172.21.15.31:3300/0 conn(0x7fa5dc146950 0x7fa5dc140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 -- 172.21.15.12:0/3878270733 >> 172.21.15.12:0/3878270733 conn(0x7fa5dc05c490 msgr2=0x7fa5dc05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:22.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 -- 172.21.15.12:0/3878270733 shutdown_connections 2021-10-20T23:22:22.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 -- 172.21.15.12:0/3878270733 wait complete. 2021-10-20T23:22:22.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 Processor -- start 2021-10-20T23:22:22.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 -- start start 2021-10-20T23:22:22.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 0x7fa5dc144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5dc0b4690 0x7fa5dc0ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5dc146950 0x7fa5dc0af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc0b77d0 con 0x7fa5dc0b4180 2021-10-20T23:22:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc0ae9e0 con 0x7fa5dc0b4690 2021-10-20T23:22:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e31ac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc0b0160 con 0x7fa5dc146950 2021-10-20T23:22:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e0f48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 0x7fa5dc144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e0f48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 0x7fa5dc144440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39006/0 (socket says 172.21.15.12:39006) 2021-10-20T23:22:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e0f48700 1 -- 172.21.15.12:0/2632406066 learned_addr learned my addr 172.21.15.12:0/2632406066 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5d3fff700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5dc0b4690 0x7fa5dc0ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e0f48700 1 -- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5dc146950 msgr2=0x7fa5dc0af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.272+0000 7fa5e1749700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5dc146950 0x7fa5dc0af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e0f48700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5dc146950 0x7fa5dc0af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e0f48700 1 -- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5dc0b4690 msgr2=0x7fa5dc0ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e0f48700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5dc0b4690 0x7fa5dc0ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e0f48700 1 -- 172.21.15.12:0/2632406066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc00b1e0 con 0x7fa5dc0b4180 2021-10-20T23:22:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5d3fff700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5dc0b4690 0x7fa5dc0ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:22:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e1749700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5dc146950 0x7fa5dc0af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:22:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e0f48700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 0x7fa5dc144440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fa5d80030b0 tx=0x7fa5d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5d1ffb700 1 -- 172.21.15.12:0/2632406066 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5d8011780 con 0x7fa5dc0b4180 2021-10-20T23:22:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5d1ffb700 1 -- 172.21.15.12:0/2632406066 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d80118e0 con 0x7fa5dc0b4180 2021-10-20T23:22:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc0ae490 con 0x7fa5dc0b4180 2021-10-20T23:22:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5d1ffb700 1 -- 172.21.15.12:0/2632406066 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5d8011c40 con 0x7fa5dc0b4180 2021-10-20T23:22:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc0ba4f0 con 0x7fa5dc0b4180 2021-10-20T23:22:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc152b50 con 0x7fa5dc0b4180 2021-10-20T23:22:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5d1ffb700 1 -- 172.21.15.12:0/2632406066 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa5d8012420 con 0x7fa5dc0b4180 2021-10-20T23:22:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5d1ffb700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5bc053610 0x7fa5bc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.276+0000 7fa5d1ffb700 1 -- 172.21.15.12:0/2632406066 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa5d806b990 con 0x7fa5dc0b4180 2021-10-20T23:22:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.280+0000 7fa5d3fff700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5bc053610 0x7fa5bc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.280+0000 7fa5d3fff700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5bc053610 0x7fa5bc055ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fa5cc01a000 tx=0x7fa5cc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.284+0000 7fa5d1ffb700 1 -- 172.21.15.12:0/2632406066 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa5d8042930 con 0x7fa5dc0b4180 2021-10-20T23:22:22.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5dc0ade80 con 0x7fa5dc0b4180 2021-10-20T23:22:22.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5d1ffb700 1 -- 172.21.15.12:0/2632406066 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa5d8045f50 con 0x7fa5dc0b4180 2021-10-20T23:22:22.421 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:22:22.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5bc053610 msgr2=0x7fa5bc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5bc053610 0x7fa5bc055ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fa5cc01a000 tx=0x7fa5cc015000).stop 2021-10-20T23:22:22.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 msgr2=0x7fa5dc144440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 0x7fa5dc144440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fa5d80030b0 tx=0x7fa5d8008040).stop 2021-10-20T23:22:22.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 shutdown_connections 2021-10-20T23:22:22.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa5bc053610 0x7fa5bc055ad0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5dc146950 0x7fa5dc0af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5dc0b4690 0x7fa5dc0ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 --2- 172.21.15.12:0/2632406066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc0b4180 0x7fa5dc144440 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 >> 172.21.15.12:0/2632406066 conn(0x7fa5dc05c490 msgr2=0x7fa5dc061550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:22.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.416+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 shutdown_connections 2021-10-20T23:22:22.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.420+0000 7fa5e31ac700 1 -- 172.21.15.12:0/2632406066 wait complete. 2021-10-20T23:22:22.433 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:22:22.434 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:22:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.532+0000 7f304a70b700 1 Processor -- start 2021-10-20T23:22:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.532+0000 7f304a70b700 1 -- start start 2021-10-20T23:22:22.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440b0010 0x7f30440a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30440a70c0 con 0x7f30440afbd0 2021-10-20T23:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30440a72f0 con 0x7f30440b2580 2021-10-20T23:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30440a7590 con 0x7f30440b0010 2021-10-20T23:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f3049f0a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f30440afbd0 0x7f3044151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37612/0 (socket says 172.21.15.12:37612) 2021-10-20T23:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f3049f0a700 1 -- 172.21.15.12:0/2226208937 learned_addr learned my addr 172.21.15.12:0/2226208937 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f3048f08700 1 --2- 172.21.15.12:0/2226208937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440b0010 0x7f30440a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f303bfff700 1 -- 172.21.15.12:0/2226208937 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902012112 0 0) 0x7f30440a70c0 con 0x7f30440afbd0 2021-10-20T23:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f303bfff700 1 -- 172.21.15.12:0/2226208937 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3028003260 con 0x7f30440afbd0 2021-10-20T23:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f303bfff700 1 -- 172.21.15.12:0/2226208937 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710348593 0 0) 0x7f30440a72f0 con 0x7f30440b2580 2021-10-20T23:22:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f303bfff700 1 -- 172.21.15.12:0/2226208937 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30440a70c0 con 0x7f30440b2580 2021-10-20T23:22:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f3048f08700 1 -- 172.21.15.12:0/2226208937 >> v1:172.21.15.31:6789/0 conn(0x7f30440b2580 legacy=0x7f304414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f3048f08700 1 -- 172.21.15.12:0/2226208937 >> v1:172.21.15.12:6789/0 conn(0x7f30440afbd0 legacy=0x7f3044151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f3048f08700 1 -- 172.21.15.12:0/2226208937 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440a7830 con 0x7f30440b0010 2021-10-20T23:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f3048f08700 1 --2- 172.21.15.12:0/2226208937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440b0010 0x7f30440a83b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3034001110 tx=0x7f3040006df0).ready entity=mon.2 client_cookie=2eff3cc831e29d51 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f303bfff700 1 -- 172.21.15.12:0/2226208937 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f304000d570 con 0x7f30440b0010 2021-10-20T23:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f303bfff700 1 -- 172.21.15.12:0/2226208937 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040000e90 con 0x7f30440b0010 2021-10-20T23:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f303bfff700 1 -- 172.21.15.12:0/2226208937 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f304000d8c0 con 0x7f30440b0010 2021-10-20T23:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 -- 172.21.15.12:0/2226208937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440b0010 msgr2=0x7f30440a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 --2- 172.21.15.12:0/2226208937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440b0010 0x7f30440a83b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3034001110 tx=0x7f3040006df0).stop 2021-10-20T23:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 -- 172.21.15.12:0/2226208937 shutdown_connections 2021-10-20T23:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 --2- 172.21.15.12:0/2226208937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440b0010 0x7f30440a83b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 -- 172.21.15.12:0/2226208937 >> 172.21.15.12:0/2226208937 conn(0x7f3044060180 msgr2=0x7f30440b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:22.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 -- 172.21.15.12:0/2226208937 shutdown_connections 2021-10-20T23:22:22.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 -- 172.21.15.12:0/2226208937 wait complete. 2021-10-20T23:22:22.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 Processor -- start 2021-10-20T23:22:22.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.536+0000 7f304a70b700 1 -- start start 2021-10-20T23:22:22.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f304a70b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440afbd0 0x7f3044149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f304a70b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30440b0010 0x7f304414c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f304a70b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30440b2580 0x7f30440b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f304a70b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30440ac910 con 0x7f30440b2580 2021-10-20T23:22:22.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f304a70b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30440a9a10 con 0x7f30440b0010 2021-10-20T23:22:22.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f304a70b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30440a9cb0 con 0x7f30440afbd0 2021-10-20T23:22:22.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049f0a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30440b2580 0x7f30440b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049709700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440afbd0 0x7f3044149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049f0a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30440b2580 0x7f30440b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39024/0 (socket says 172.21.15.12:39024) 2021-10-20T23:22:22.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3048f08700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30440b0010 0x7f304414c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049709700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440afbd0 0x7f3044149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:44778/0 (socket says 172.21.15.12:44778) 2021-10-20T23:22:22.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049f0a700 1 -- 172.21.15.12:0/3921541743 learned_addr learned my addr 172.21.15.12:0/3921541743 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:22:22.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049f0a700 1 -- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440afbd0 msgr2=0x7f3044149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049f0a700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440afbd0 0x7f3044149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049f0a700 1 -- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30440b0010 msgr2=0x7f304414c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049f0a700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30440b0010 0x7f304414c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049f0a700 1 -- 172.21.15.12:0/3921541743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304000b180 con 0x7f30440b2580 2021-10-20T23:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f3049f0a700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30440b2580 0x7f30440b4460 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f303c001490 tx=0x7f303c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f303a7fc700 1 -- 172.21.15.12:0/3921541743 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303c005ba0 con 0x7f30440b2580 2021-10-20T23:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f303a7fc700 1 -- 172.21.15.12:0/3921541743 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c005d00 con 0x7f30440b2580 2021-10-20T23:22:22.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30440a9f50 con 0x7f30440b2580 2021-10-20T23:22:22.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f303a7fc700 1 -- 172.21.15.12:0/3921541743 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303c0072c0 con 0x7f30440b2580 2021-10-20T23:22:22.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.540+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304414c750 con 0x7f30440b2580 2021-10-20T23:22:22.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.544+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3044057350 con 0x7f30440b2580 2021-10-20T23:22:22.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.544+0000 7f303a7fc700 1 -- 172.21.15.12:0/3921541743 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f303c010070 con 0x7f30440b2580 2021-10-20T23:22:22.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.544+0000 7f303a7fc700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f302c053610 0x7f302c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:22:22.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.544+0000 7f303a7fc700 1 -- 172.21.15.12:0/3921541743 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f303c06b470 con 0x7f30440b2580 2021-10-20T23:22:22.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.544+0000 7f3049709700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f302c053610 0x7f302c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:22:22.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.544+0000 7f3049709700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f302c053610 0x7f302c055ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f303400d000 tx=0x7f3034007af0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:22:22.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.552+0000 7f303a7fc700 1 -- 172.21.15.12:0/3921541743 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f303c042360 con 0x7f30440b2580 2021-10-20T23:22:22.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.716+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30440698e0 con 0x7f30440b2580 2021-10-20T23:22:22.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f303a7fc700 1 -- 172.21.15.12:0/3921541743 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f303c018070 con 0x7f30440b2580 2021-10-20T23:22:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:22:22.722 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:21:50.499039+0000","modified":"2021-10-20T23:21:51.501920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5233":{"gid":5233,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2510327912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2510327912},{"type":"v1","addr":"172.21.15.31:6835","nonce":2510327912}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-20T23:22:22.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f302c053610 msgr2=0x7f302c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f302c053610 0x7f302c055ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f303400d000 tx=0x7f3034007af0).stop 2021-10-20T23:22:22.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30440b2580 msgr2=0x7f30440b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:22:22.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30440b2580 0x7f30440b4460 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f303c001490 tx=0x7f303c007e00).stop 2021-10-20T23:22:22.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 shutdown_connections 2021-10-20T23:22:22.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f302c053610 0x7f302c055ad0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30440b2580 0x7f30440b4460 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30440b0010 0x7f304414c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 --2- 172.21.15.12:0/3921541743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30440afbd0 0x7f3044149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:22:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 >> 172.21.15.12:0/3921541743 conn(0x7f3044060180 msgr2=0x7f30441453b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:22:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 shutdown_connections 2021-10-20T23:22:22.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:22:22.720+0000 7f304a70b700 1 -- 172.21.15.12:0/3921541743 wait complete. 2021-10-20T23:22:22.728 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 19 2021-10-20T23:22:23.037 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:21:50.499039+0000', 'modified': '2021-10-20T23:21:51.501920+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5233}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5233': {'gid': 5233, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/2510327912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 2510327912}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2510327912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:22:23.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:22:23.039 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:22:23.156 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":5233,"want_state":"up:active","state":"up:active","rank_uptime":32.645396718000001,"mdsmap_epoch":19,"osdmap_epoch":48,"osdmap_epoch_barrier":46,"uptime":37.436289938000002} 2021-10-20T23:22:23.157 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 5233, "mdsmap_epoch": 19, "osdmap_epoch": 48, "osdmap_epoch_barrier": 46, "rank_uptime": 32.645396718, "state": "up:active", "uptime": 37.436289938, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:22:23.157 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:22:23.158 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:22:23.158 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:22:23.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:23.159 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:22:23.167 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:22:23.226 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:22:23.226 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:22:23.238 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:22:23.239 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:22:23.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:23.241 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:22:23.247 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:22:23.247 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:22:23.290 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:22:23.308 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:22:23.308 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:22:23.317 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:22:23.318 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:22:23.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:23.319 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:22:23.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:22:23.359+0000 7f824db85080 -1 init, newargv = 0x561251e0b160 newargc=9ceph-fuse[14006]: starting ceph client 2021-10-20T23:22:23.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr: 2021-10-20T23:22:23.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14006]: starting fuse 2021-10-20T23:22:24.427 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:22:24.445 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:22:24.446 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:22:24.502 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:22:24.503 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:22:24.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:24.504 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:22:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:22:24.511 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:22:24.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:24.512 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:22:24.513 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:22:24.513 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:22:24.513 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:22:24.514 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:22:24.514 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:22:24.515 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:22:24.515 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:22:24.515 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:22:24.516 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:22:24.516 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:22:24.517 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:22:24.517 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:22:24.517 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:22:24.518 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:22:24.518 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:22:24.519 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:22:24.519 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:22:24.520 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:22:24.520 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:22:24.520 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:22:24.521 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:22:24.521 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:22:24.567 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14006.asok 2021-10-20T23:22:24.571 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14006.asok 2021-10-20T23:22:24.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:24.572 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14006.asok status 2021-10-20T23:22:24.705 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:22:24.706 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:22:24.707 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:22:24.707 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:22:24.708 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:22:24.708 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:22:24.709 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:22:24.709 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14006", 2021-10-20T23:22:24.709 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:22:24.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:22:24.710 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:22:24.711 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:22:24.711 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5135, 2021-10-20T23:22:24.712 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:22:24.712 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:22:24.712 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:22:24.713 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5135 2021-10-20T23:22:24.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:22:24.714 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:22:24.714 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:22:24.715 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:22:24.715 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2093742815 2021-10-20T23:22:24.715 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:22:24.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:22:24.716 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:22:24.717 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:22:24.717 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:22:24.718 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2093742815 2021-10-20T23:22:24.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:22:24.718 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5135 172.21.15.119:0/2093742815", 2021-10-20T23:22:24.719 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/2093742815", 2021-10-20T23:22:24.719 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:22:24.720 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 19, 2021-10-20T23:22:24.720 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 48, 2021-10-20T23:22:24.721 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:22:24.721 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:22:24.721 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:22:24.722 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:22:24.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:24.725 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:22:24.726 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:22:24.734 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:22:24.736 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:22:24.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:22:24.737 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:22:36.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:22:36.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:22:36.359 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:22:36.362 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:23:06.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:23:06.422 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:23:06.424 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:23:06.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:23:10.720 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:23:10.721 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:23:10.740 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:23:10.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:23:10.783 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:23:10.804 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:23:10.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:10.805 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:10.806 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:10.814 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:23:10.815 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:23:10.815 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:23:10.816 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:23:10.816 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:10.871 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14006]: fuse finished with error 0 and tester_r 0 2021-10-20T23:23:10.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:10.874 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:10.875 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:10.882 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:23:10.884 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:23:11.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:23:11.005 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:11.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:11.057 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:11.057 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:23:11.065 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:23:11.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:23:11.067 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:23:11.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:23:11.069 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:23:11.075 INFO:teuthology.orchestra.run.smithi136.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:23:11.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:23:11.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:23:11.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16ebfff700 1 Processor -- start 2021-10-20T23:23:11.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16ebfff700 1 -- start start 2021-10-20T23:23:11.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16ebfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f16ec0b3040 0x7f16ec065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16ebfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16ec140140 0x7f16ec1405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16ebfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec066ea0 con 0x7f16ec0a9c10 2021-10-20T23:23:11.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16ebfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec0648e0 con 0x7f16ec0b3040 2021-10-20T23:23:11.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16ebfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec061dd0 con 0x7f16ec140140 2021-10-20T23:23:11.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f16ec0b3040 0x7f16ec065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f16ec0b3040 0x7f16ec065e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39028/0 (socket says 172.21.15.12:39028) 2021-10-20T23:23:11.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eaffd700 1 -- 172.21.15.12:0/2587843681 learned_addr learned my addr 172.21.15.12:0/2587843681 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:11.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eb7fe700 1 --2- 172.21.15.12:0/2587843681 >> v2:172.21.15.31:3300/0 conn(0x7f16ec140140 0x7f16ec1405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eaffd700 1 -- 172.21.15.12:0/2587843681 >> v2:172.21.15.31:3300/0 conn(0x7f16ec140140 msgr2=0x7f16ec1405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:11.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eaffd700 1 --2- 172.21.15.12:0/2587843681 >> v2:172.21.15.31:3300/0 conn(0x7f16ec140140 0x7f16ec1405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eaffd700 1 -- 172.21.15.12:0/2587843681 >> v1:172.21.15.31:6789/0 conn(0x7f16ec0a9c10 legacy=0x7f16ec0607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eaffd700 1 -- 172.21.15.12:0/2587843681 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0b3420 con 0x7f16ec0b3040 2021-10-20T23:23:11.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eb7fe700 1 --2- 172.21.15.12:0/2587843681 >> v2:172.21.15.31:3300/0 conn(0x7f16ec140140 0x7f16ec1405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:11.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16eaffd700 1 --2- 172.21.15.12:0/2587843681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0b3040 0x7f16ec065e90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f16ec062440 tx=0x7f16e0006eb0).ready entity=mon.0 client_cookie=20d793334ea44aba server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:11.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16e9ffb700 1 -- 172.21.15.12:0/2587843681 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e000d610 con 0x7f16ec0b3040 2021-10-20T23:23:11.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16e9ffb700 1 -- 172.21.15.12:0/2587843681 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e0000e90 con 0x7f16ec0b3040 2021-10-20T23:23:11.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.182+0000 7f16e9ffb700 1 -- 172.21.15.12:0/2587843681 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e000d960 con 0x7f16ec0b3040 2021-10-20T23:23:11.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 -- 172.21.15.12:0/2587843681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0b3040 msgr2=0x7f16ec065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 --2- 172.21.15.12:0/2587843681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0b3040 0x7f16ec065e90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f16ec062440 tx=0x7f16e0006eb0).stop 2021-10-20T23:23:11.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 -- 172.21.15.12:0/2587843681 shutdown_connections 2021-10-20T23:23:11.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 --2- 172.21.15.12:0/2587843681 >> v2:172.21.15.31:3300/0 conn(0x7f16ec140140 0x7f16ec1405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 --2- 172.21.15.12:0/2587843681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0b3040 0x7f16ec065e90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 -- 172.21.15.12:0/2587843681 >> 172.21.15.12:0/2587843681 conn(0x7f16ec0636e0 msgr2=0x7f16ec063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:11.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 -- 172.21.15.12:0/2587843681 shutdown_connections 2021-10-20T23:23:11.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 -- 172.21.15.12:0/2587843681 wait complete. 2021-10-20T23:23:11.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 Processor -- start 2021-10-20T23:23:11.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 -- start start 2021-10-20T23:23:11.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16ec0a9c10 0x7f16ec0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ec0b3040 0x7f16ec12d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec140140 0x7f16ec12c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0ad000 con 0x7f16ec140140 2021-10-20T23:23:11.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec156360 con 0x7f16ec0b3040 2021-10-20T23:23:11.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.186+0000 7f16ebfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0aaff0 con 0x7f16ec0a9c10 2021-10-20T23:23:11.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec140140 0x7f16ec12c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec140140 0x7f16ec12c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39038/0 (socket says 172.21.15.12:39038) 2021-10-20T23:23:11.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eb7fe700 1 -- 172.21.15.12:0/130410769 learned_addr learned my addr 172.21.15.12:0/130410769 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:11.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16ea7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ec0b3040 0x7f16ec12d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eaffd700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16ec0a9c10 0x7f16ec0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eb7fe700 1 -- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16ec0a9c10 msgr2=0x7f16ec0ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eb7fe700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16ec0a9c10 0x7f16ec0ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eb7fe700 1 -- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ec0b3040 msgr2=0x7f16ec12d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eb7fe700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ec0b3040 0x7f16ec12d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eb7fe700 1 -- 172.21.15.12:0/130410769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e000b1e0 con 0x7f16ec140140 2021-10-20T23:23:11.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eaffd700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16ec0a9c10 0x7f16ec0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:11.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16eb7fe700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec140140 0x7f16ec12c050 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f16e4006cc0 tx=0x7f16e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:11.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16dbfff700 1 -- 172.21.15.12:0/130410769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e4011780 con 0x7f16ec140140 2021-10-20T23:23:11.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16dbfff700 1 -- 172.21.15.12:0/130410769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e40118e0 con 0x7f16ec140140 2021-10-20T23:23:11.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec0ad360 con 0x7f16ec140140 2021-10-20T23:23:11.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16dbfff700 1 -- 172.21.15.12:0/130410769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e4011c40 con 0x7f16ec140140 2021-10-20T23:23:11.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec156600 con 0x7f16ec140140 2021-10-20T23:23:11.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec1561b0 con 0x7f16ec140140 2021-10-20T23:23:11.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.190+0000 7f16dbfff700 1 -- 172.21.15.12:0/130410769 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f16e4012420 con 0x7f16ec140140 2021-10-20T23:23:11.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.194+0000 7f16dbfff700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16c80536a0 0x7f16c8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.194+0000 7f16dbfff700 1 -- 172.21.15.12:0/130410769 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f16e406bd30 con 0x7f16ec140140 2021-10-20T23:23:11.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.194+0000 7f16eaffd700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16c80536a0 0x7f16c8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.194+0000 7f16eaffd700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16c80536a0 0x7f16c8055b60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f16e0019000 tx=0x7f16e0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:11.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.198+0000 7f16dbfff700 1 -- 172.21.15.12:0/130410769 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f16e4042bc0 con 0x7f16ec140140 2021-10-20T23:23:11.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.326+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f16ec066960 con 0x7f16ec140140 2021-10-20T23:23:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16dbfff700 1 -- 172.21.15.12:0/130410769 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+34037 (secure 0 0 0) 0x7f16e40461e0 con 0x7f16ec140140 2021-10-20T23:23:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:11.333 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:23:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 48, 2021-10-20T23:23:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:23:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:23:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:21:52.512426+0000", 2021-10-20T23:23:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:23:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:23:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:23:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:23:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:23:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:23:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:23:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:23:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:23:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:23:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:23:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:23:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:23:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:23:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:23:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 8, 2021-10-20T23:23:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:23:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:23:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:23:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:23:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:23:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:23:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:23:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:23:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:23:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:23:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:23:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:23:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:23:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:23:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:23:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:23:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:23:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:23:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:23:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:23:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:23:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:23:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:23:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:23:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:23:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:23:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:23:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:23:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:23:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:23:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:23:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:23:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:23:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:23:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:23:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:23:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:23:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:23:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:23:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:23:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:23:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:23:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:23:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:23:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:23:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:23:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:23:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:23:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:23:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:23:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:23:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:23:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:23:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:23:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:23:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:23:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:23:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:23:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:23:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:23:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:23:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:23:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:23:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:23:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:23:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:23:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:23:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:23:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:23:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:23:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:23:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:23:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:23:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:23:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:23:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:23:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:23:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:23:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:23:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:23:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:23:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:23:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:23:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:23:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:23:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:23:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:23:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:23:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:23:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:23:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:23:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:23:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:23:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:23:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:23:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:23:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:23:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:23:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:23:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:23:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:23:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:23:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:23:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:23:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:23:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:23:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:23:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:23:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:23:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:23:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:23:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:23:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:23:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:23:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:23:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:23:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:23:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:23:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:23:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:23:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:23:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:23:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:23:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:23:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:23:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:23:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:23:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:23:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:23:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:23:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:23:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:23:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:23:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:23:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 7, 2021-10-20T23:23:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:23:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:21:48.487958+0000", 2021-10-20T23:23:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:23:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:23:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:23:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:23:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:23:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:23:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:23:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:23:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:23:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:23:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:23:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:23:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:23:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:23:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:23:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:23:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:23:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:23:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:23:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:23:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "47", 2021-10-20T23:23:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:23:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:23:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:23:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:23:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:23:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:23:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:23:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:23:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:23:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:23:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:23:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:23:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:23:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:23:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:23:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:23:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:23:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:23:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:23:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:23:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:23:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:23:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:23:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:23:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:23:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:23:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:23:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:23:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:23:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:23:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:23:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:23:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:23:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:23:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:23:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:23:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:23:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:23:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:23:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:23:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:23:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:23:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:23:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:23:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 8, 2021-10-20T23:23:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:23:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:21:49.501193+0000", 2021-10-20T23:23:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:23:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:23:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:23:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:23:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:23:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:23:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:23:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:23:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:23:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:23:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:23:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:23:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:23:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:23:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:23:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:23:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:23:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:23:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:23:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:23:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "48", 2021-10-20T23:23:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:23:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:23:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:23:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:23:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:23:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:23:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:23:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:23:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:23:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:23:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:23:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:23:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:23:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:23:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:23:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:23:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:23:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:23:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:23:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:23:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:23:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:23:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:23:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:23:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:23:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:23:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:23:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:23:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:23:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:23:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:23:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:23:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:23:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:23:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:23:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:23:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:23:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:23:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:23:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:23:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:23:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:23:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:23:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:23:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:23:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:23:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:23:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:23:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:23:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:23:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:23:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:23:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:23:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:23:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:23:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:23:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:23:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:23:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:23:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 46, 2021-10-20T23:23:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:23:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:23:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:23:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:23:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:23:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:23:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:23:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:23:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:23:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:23:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:23:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:23:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:23:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:23:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 33, 2021-10-20T23:23:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:23:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:23:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:23:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:23:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:23:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:23:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:23:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:23:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:23:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:23:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:23:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:23:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:23:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:23:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:23:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:23:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:23:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:23:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:23:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:23:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:23:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:23:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:23:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:23:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:23:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:23:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:23:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:23:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:23:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:23:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:23:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:23:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:23:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:23:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:23:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:23:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:23:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:23:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:23:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:23:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:23:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:23:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:23:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:23:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:23:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:23:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:23:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:23:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:23:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:23:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:23:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:23:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:23:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:23:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:23:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:23:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:23:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:23:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:23:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:23:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:23:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:23:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:23:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:23:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:23:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:23:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:23:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:23:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:23:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:23:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 44, 2021-10-20T23:23:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:23:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:23:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:23:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:23:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:23:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:23:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:23:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:23:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:23:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:23:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:23:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:23:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:23:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:23:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:23:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:23:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:23:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:23:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:23:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:23:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:23:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:23:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:23:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:11.562 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:23:11.562 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:11.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:23:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:23:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:23:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:23:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:23:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:23:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:23:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:23:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:23:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:23:11.570 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:23:11.570 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:23:11.570 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:23:11.570 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:23:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:23:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:23:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:23:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:23:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:23:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:23:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:23:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:23:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:23:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:23:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:23:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:23:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:23:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:23:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:23:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:23:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:23:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:23:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:23:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:23:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16c80536a0 msgr2=0x7f16c8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16c80536a0 0x7f16c8055b60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f16e0019000 tx=0x7f16e0015000).stop 2021-10-20T23:23:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec140140 msgr2=0x7f16ec12c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec140140 0x7f16ec12c050 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f16e4006cc0 tx=0x7f16e4008040).stop 2021-10-20T23:23:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 shutdown_connections 2021-10-20T23:23:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16c80536a0 0x7f16c8055b60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec140140 0x7f16ec12c050 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ec0b3040 0x7f16ec12d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 --2- 172.21.15.12:0/130410769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16ec0a9c10 0x7f16ec0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 >> 172.21.15.12:0/130410769 conn(0x7f16ec0636e0 msgr2=0x7f16ec0b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:11.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 shutdown_connections 2021-10-20T23:23:11.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.330+0000 7f16ebfff700 1 -- 172.21.15.12:0/130410769 wait complete. 2021-10-20T23:23:11.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.690+0000 7fec08970700 1 Processor -- start 2021-10-20T23:23:11.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.690+0000 7fec08970700 1 -- start start 2021-10-20T23:23:11.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.690+0000 7fec08970700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec040b0010 0x7fec040a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.690+0000 7fec08970700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040a70c0 con 0x7fec040b2580 2021-10-20T23:23:11.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.690+0000 7fec08970700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040a72f0 con 0x7fec040afbd0 2021-10-20T23:23:11.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.690+0000 7fec08970700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec040a7590 con 0x7fec040b0010 2021-10-20T23:23:11.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec037fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fec040b2580 0x7fec0414ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37638/0 (socket says 172.21.15.12:37638) 2021-10-20T23:23:11.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec037fe700 1 -- 172.21.15.12:0/1331090544 learned_addr learned my addr 172.21.15.12:0/1331090544 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:11.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec02ffd700 1 --2- 172.21.15.12:0/1331090544 >> v2:172.21.15.31:3300/0 conn(0x7fec040b0010 0x7fec040a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec027fc700 1 -- 172.21.15.12:0/1331090544 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668873454 0 0) 0x7fec040a70c0 con 0x7fec040b2580 2021-10-20T23:23:11.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec027fc700 1 -- 172.21.15.12:0/1331090544 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf0003260 con 0x7fec040b2580 2021-10-20T23:23:11.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec027fc700 1 -- 172.21.15.12:0/1331090544 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114050209 0 0) 0x7fec040a72f0 con 0x7fec040afbd0 2021-10-20T23:23:11.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec027fc700 1 -- 172.21.15.12:0/1331090544 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec040a70c0 con 0x7fec040afbd0 2021-10-20T23:23:11.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec02ffd700 1 -- 172.21.15.12:0/1331090544 >> v1:172.21.15.31:6789/0 conn(0x7fec040afbd0 legacy=0x7fec04151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec02ffd700 1 -- 172.21.15.12:0/1331090544 >> v1:172.21.15.12:6789/0 conn(0x7fec040b2580 legacy=0x7fec0414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec02ffd700 1 -- 172.21.15.12:0/1331090544 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040a7830 con 0x7fec040b0010 2021-10-20T23:23:11.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec02ffd700 1 --2- 172.21.15.12:0/1331090544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec040b0010 0x7fec040a83b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7febf40032f0 tx=0x7febf40091d0).ready entity=mon.1 client_cookie=21e193c5b9d36da4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec027fc700 1 -- 172.21.15.12:0/1331090544 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febf400b600 con 0x7fec040b0010 2021-10-20T23:23:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec027fc700 1 -- 172.21.15.12:0/1331090544 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf400b760 con 0x7fec040b0010 2021-10-20T23:23:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec027fc700 1 -- 172.21.15.12:0/1331090544 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febf400b8d0 con 0x7fec040b0010 2021-10-20T23:23:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec08970700 1 -- 172.21.15.12:0/1331090544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec040b0010 msgr2=0x7fec040a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec08970700 1 --2- 172.21.15.12:0/1331090544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec040b0010 0x7fec040a83b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7febf40032f0 tx=0x7febf40091d0).stop 2021-10-20T23:23:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec08970700 1 -- 172.21.15.12:0/1331090544 shutdown_connections 2021-10-20T23:23:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec08970700 1 --2- 172.21.15.12:0/1331090544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec040b0010 0x7fec040a83b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec08970700 1 -- 172.21.15.12:0/1331090544 >> 172.21.15.12:0/1331090544 conn(0x7fec04060180 msgr2=0x7fec040b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec08970700 1 -- 172.21.15.12:0/1331090544 shutdown_connections 2021-10-20T23:23:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.694+0000 7fec08970700 1 -- 172.21.15.12:0/1331090544 wait complete. 2021-10-20T23:23:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 Processor -- start 2021-10-20T23:23:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 -- start start 2021-10-20T23:23:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec040afbd0 0x7fec040ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec040b0010 0x7fec04156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec040b2580 0x7fec040a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec040aac00 con 0x7fec040b2580 2021-10-20T23:23:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec040aaea0 con 0x7fec040afbd0 2021-10-20T23:23:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec040ab140 con 0x7fec040b0010 2021-10-20T23:23:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec040b2580 0x7fec040a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec040b2580 0x7fec040a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39052/0 (socket says 172.21.15.12:39052) 2021-10-20T23:23:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec03fff700 1 -- 172.21.15.12:0/1699534769 learned_addr learned my addr 172.21.15.12:0/1699534769 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec02ffd700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec040b0010 0x7fec04156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec037fe700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec040afbd0 0x7fec040ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec03fff700 1 -- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec040b0010 msgr2=0x7fec04156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec03fff700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec040b0010 0x7fec04156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec03fff700 1 -- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec040afbd0 msgr2=0x7fec040ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec03fff700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec040afbd0 0x7fec040ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec03fff700 1 -- 172.21.15.12:0/1699534769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4009470 con 0x7fec040b2580 2021-10-20T23:23:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec03fff700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec040b2580 0x7fec040a9400 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7febfc001110 tx=0x7febfc007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec00ff9700 1 -- 172.21.15.12:0/1699534769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febfc012400 con 0x7fec040b2580 2021-10-20T23:23:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec00ff9700 1 -- 172.21.15.12:0/1699534769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc012560 con 0x7fec040b2580 2021-10-20T23:23:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec040ab3e0 con 0x7fec040b2580 2021-10-20T23:23:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec00ff9700 1 -- 172.21.15.12:0/1699534769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febfc0128c0 con 0x7fec040b2580 2021-10-20T23:23:11.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.698+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec040a99b0 con 0x7fec040b2580 2021-10-20T23:23:11.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.702+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec04057350 con 0x7fec040b2580 2021-10-20T23:23:11.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.702+0000 7fec00ff9700 1 -- 172.21.15.12:0/1699534769 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7febfc019030 con 0x7fec040b2580 2021-10-20T23:23:11.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.702+0000 7fec00ff9700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febe4053640 0x7febe4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.702+0000 7fec00ff9700 1 -- 172.21.15.12:0/1699534769 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7febfc06adf0 con 0x7fec040b2580 2021-10-20T23:23:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.702+0000 7fec037fe700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febe4053640 0x7febe4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.702+0000 7fec037fe700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febe4053640 0x7febe4055b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7febf800d000 tx=0x7febf8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.710+0000 7fec00ff9700 1 -- 172.21.15.12:0/1699534769 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7febfc041cf0 con 0x7fec040b2580 2021-10-20T23:23:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.874+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec040ab570 con 0x7fec040b2580 2021-10-20T23:23:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec00ff9700 1 -- 172.21.15.12:0/1699534769 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2491 (secure 0 0 0) 0x7febfc045310 con 0x7fec040b2580 2021-10-20T23:23:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:11.880 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:21:50.499039+0000","modified":"2021-10-20T23:21:51.501920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5233":{"gid":5233,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2510327912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2510327912},{"type":"v1","addr":"172.21.15.31:6835","nonce":2510327912}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-20T23:23:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febe4053640 msgr2=0x7febe4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febe4053640 0x7febe4055b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7febf800d000 tx=0x7febf8009040).stop 2021-10-20T23:23:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec040b2580 msgr2=0x7fec040a9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec040b2580 0x7fec040a9400 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7febfc001110 tx=0x7febfc007a20).stop 2021-10-20T23:23:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 shutdown_connections 2021-10-20T23:23:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febe4053640 0x7febe4055b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec040b2580 0x7fec040a9400 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec040b0010 0x7fec04156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 --2- 172.21.15.12:0/1699534769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec040afbd0 0x7fec040ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 >> 172.21.15.12:0/1699534769 conn(0x7fec04060180 msgr2=0x7fec0414a890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 shutdown_connections 2021-10-20T23:23:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.878+0000 7fec08970700 1 -- 172.21.15.12:0/1699534769 wait complete. 2021-10-20T23:23:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 19 2021-10-20T23:23:11.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:23:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39cc24700 1 Processor -- start 2021-10-20T23:23:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39cc24700 1 -- start start 2021-10-20T23:23:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39cc24700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3981483a0 0x7fc3980b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:12.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39cc24700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3980a70c0 0x7fc398144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:12.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39cc24700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3980b0350 con 0x7fc3980b1db0 2021-10-20T23:23:12.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39cc24700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3980a90c0 con 0x7fc3980a70c0 2021-10-20T23:23:12.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39cc24700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3980b05f0 con 0x7fc3981483a0 2021-10-20T23:23:12.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc396d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3980a70c0 0x7fc398144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:12.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc396d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3980a70c0 0x7fc398144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39060/0 (socket says 172.21.15.12:39060) 2021-10-20T23:23:12.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc396d9d700 1 -- 172.21.15.12:0/1792967983 learned_addr learned my addr 172.21.15.12:0/1792967983 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:12.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39659c700 1 --1- 172.21.15.12:0/1792967983 >> v1:172.21.15.12:6789/0 conn(0x7fc3980b1db0 0x7fc3980b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37650/0 (socket says 172.21.15.12:37650) 2021-10-20T23:23:12.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc395d9b700 1 --2- 172.21.15.12:0/1792967983 >> v2:172.21.15.31:3300/0 conn(0x7fc3981483a0 0x7fc3980b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:12.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc396d9d700 1 -- 172.21.15.12:0/1792967983 >> v2:172.21.15.31:3300/0 conn(0x7fc3981483a0 msgr2=0x7fc3980b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:12.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc396d9d700 1 --2- 172.21.15.12:0/1792967983 >> v2:172.21.15.31:3300/0 conn(0x7fc3981483a0 0x7fc3980b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:12.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc396d9d700 1 -- 172.21.15.12:0/1792967983 >> v1:172.21.15.12:6789/0 conn(0x7fc3980b1db0 legacy=0x7fc3980b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:12.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc396d9d700 1 -- 172.21.15.12:0/1792967983 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980b0890 con 0x7fc3980a70c0 2021-10-20T23:23:12.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc396d9d700 1 --2- 172.21.15.12:0/1792967983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 0x7fc398144720 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fc398147730 tx=0x7fc390006eb0).ready entity=mon.0 client_cookie=10b515a0fe69f654 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39559a700 1 -- 172.21.15.12:0/1792967983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc39000d610 con 0x7fc3980a70c0 2021-10-20T23:23:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39559a700 1 -- 172.21.15.12:0/1792967983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc390000e90 con 0x7fc3980a70c0 2021-10-20T23:23:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.990+0000 7fc39559a700 1 -- 172.21.15.12:0/1792967983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc39000d9a0 con 0x7fc3980a70c0 2021-10-20T23:23:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 -- 172.21.15.12:0/1792967983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 msgr2=0x7fc398144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 --2- 172.21.15.12:0/1792967983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 0x7fc398144720 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fc398147730 tx=0x7fc390006eb0).stop 2021-10-20T23:23:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 -- 172.21.15.12:0/1792967983 shutdown_connections 2021-10-20T23:23:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 --2- 172.21.15.12:0/1792967983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 0x7fc398144720 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 --2- 172.21.15.12:0/1792967983 >> v2:172.21.15.31:3300/0 conn(0x7fc3981483a0 0x7fc3980b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 -- 172.21.15.12:0/1792967983 >> 172.21.15.12:0/1792967983 conn(0x7fc39805f6b0 msgr2=0x7fc39805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 -- 172.21.15.12:0/1792967983 shutdown_connections 2021-10-20T23:23:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 -- 172.21.15.12:0/1792967983 wait complete. 2021-10-20T23:23:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 Processor -- start 2021-10-20T23:23:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 -- start start 2021-10-20T23:23:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 0x7fc3980aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3980b1db0 0x7fc398149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3981483a0 0x7fc39814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc398148e70 con 0x7fc3980a70c0 2021-10-20T23:23:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39815ac20 con 0x7fc3981483a0 2021-10-20T23:23:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39cc24700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39814ada0 con 0x7fc3980b1db0 2021-10-20T23:23:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 0x7fc3980aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 0x7fc3980aac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39062/0 (socket says 172.21.15.12:39062) 2021-10-20T23:23:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.994+0000 7fc39659c700 1 -- 172.21.15.12:0/458010790 learned_addr learned my addr 172.21.15.12:0/458010790 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc396d9d700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3981483a0 0x7fc39814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:12.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc395d9b700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3980b1db0 0x7fc398149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:12.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc39659c700 1 -- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3980b1db0 msgr2=0x7fc398149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:12.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc39659c700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3980b1db0 0x7fc398149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:12.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc39659c700 1 -- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3981483a0 msgr2=0x7fc39814b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc39659c700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3981483a0 0x7fc39814b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc39659c700 1 -- 172.21.15.12:0/458010790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39000b1e0 con 0x7fc3980a70c0 2021-10-20T23:23:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc39659c700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 0x7fc3980aac50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fc3980ace60 tx=0x7fc38c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc3877fe700 1 -- 172.21.15.12:0/458010790 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc38c0070d0 con 0x7fc3980a70c0 2021-10-20T23:23:12.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc3877fe700 1 -- 172.21.15.12:0/458010790 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c007230 con 0x7fc3980a70c0 2021-10-20T23:23:12.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39814b040 con 0x7fc3980a70c0 2021-10-20T23:23:12.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc3877fe700 1 -- 172.21.15.12:0/458010790 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc38c005740 con 0x7fc3980a70c0 2021-10-20T23:23:12.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39814a0a0 con 0x7fc3980a70c0 2021-10-20T23:23:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:11.998+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39815adf0 con 0x7fc3980a70c0 2021-10-20T23:23:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:12.002+0000 7fc3877fe700 1 -- 172.21.15.12:0/458010790 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc38c010070 con 0x7fc3980a70c0 2021-10-20T23:23:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:12.002+0000 7fc3877fe700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc374053610 0x7fc374055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:12.002+0000 7fc3877fe700 1 -- 172.21.15.12:0/458010790 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc38c06af20 con 0x7fc3980a70c0 2021-10-20T23:23:12.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:12.002+0000 7fc395d9b700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc374053610 0x7fc374055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:12.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:12.002+0000 7fc395d9b700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc374053610 0x7fc374055ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fc38800b000 tx=0x7fc3880091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:12.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:12.006+0000 7fc3877fe700 1 -- 172.21.15.12:0/458010790 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc38c041f20 con 0x7fc3980a70c0 2021-10-20T23:23:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:12.174+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc3980b0b30 con 0x7fc3980a70c0 2021-10-20T23:23:13.100 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:23:13.098+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:23:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.106+0000 7fc3877fe700 1 -- 172.21.15.12:0/458010790 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc38c045540 con 0x7fc3980a70c0 2021-10-20T23:23:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc374053610 msgr2=0x7fc374055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc374053610 0x7fc374055ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fc38800b000 tx=0x7fc3880091d0).stop 2021-10-20T23:23:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 msgr2=0x7fc3980aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 0x7fc3980aac50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fc3980ace60 tx=0x7fc38c007c00).stop 2021-10-20T23:23:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 shutdown_connections 2021-10-20T23:23:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc374053610 0x7fc374055ad0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3981483a0 0x7fc39814b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3980b1db0 0x7fc398149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 --2- 172.21.15.12:0/458010790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3980a70c0 0x7fc3980aac50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 >> 172.21.15.12:0/458010790 conn(0x7fc39805f6b0 msgr2=0x7fc3980b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 shutdown_connections 2021-10-20T23:23:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.110+0000 7fc39cc24700 1 -- 172.21.15.12:0/458010790 wait complete. 2021-10-20T23:23:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:23:13.127 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:13.147 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:23:13.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5f0041b700 1 Processor -- start 2021-10-20T23:23:13.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5f0041b700 1 -- start start 2021-10-20T23:23:13.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5f0041b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ef80a9eb0 0x7f5ef80b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5f0041b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 0x7f5ef8144480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5f0041b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef80aa290 con 0x7f5ef80b3130 2021-10-20T23:23:13.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5f0041b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef80ae300 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5f0041b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8148170 con 0x7f5ef80af070 2021-10-20T23:23:13.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efd9b6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5ef80b3130 0x7f5ef814b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37664/0 (socket says 172.21.15.12:37664) 2021-10-20T23:23:13.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efd9b6700 1 -- 172.21.15.12:0/633733475 learned_addr learned my addr 172.21.15.12:0/633733475 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:13.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efe9b8700 1 --2- 172.21.15.12:0/633733475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 0x7f5ef8144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efe1b7700 1 --2- 172.21.15.12:0/633733475 >> v2:172.21.15.31:3300/0 conn(0x7f5ef80a9eb0 0x7f5ef80b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efd1b5700 1 -- 172.21.15.12:0/633733475 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471111438 0 0) 0x7f5ef80aa290 con 0x7f5ef80b3130 2021-10-20T23:23:13.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efd1b5700 1 -- 172.21.15.12:0/633733475 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee4003260 con 0x7f5ef80b3130 2021-10-20T23:23:13.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efe9b8700 1 -- 172.21.15.12:0/633733475 >> v2:172.21.15.31:3300/0 conn(0x7f5ef80a9eb0 msgr2=0x7f5ef80b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:13.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efe9b8700 1 --2- 172.21.15.12:0/633733475 >> v2:172.21.15.31:3300/0 conn(0x7f5ef80a9eb0 0x7f5ef80b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efe9b8700 1 -- 172.21.15.12:0/633733475 >> v1:172.21.15.12:6789/0 conn(0x7f5ef80b3130 legacy=0x7f5ef814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efe9b8700 1 -- 172.21.15.12:0/633733475 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8148410 con 0x7f5ef80af070 2021-10-20T23:23:13.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efe1b7700 1 --2- 172.21.15.12:0/633733475 >> v2:172.21.15.31:3300/0 conn(0x7f5ef80a9eb0 0x7f5ef80b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:13.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efe9b8700 1 --2- 172.21.15.12:0/633733475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 0x7f5ef8144480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5ee8002f70 tx=0x7f5ee8006df0).ready entity=mon.2 client_cookie=f228ed15712a533f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:13.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efd1b5700 1 -- 172.21.15.12:0/633733475 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee800d4a0 con 0x7f5ef80af070 2021-10-20T23:23:13.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efd1b5700 1 -- 172.21.15.12:0/633733475 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8000e90 con 0x7f5ef80af070 2021-10-20T23:23:13.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.238+0000 7f5efd1b5700 1 -- 172.21.15.12:0/633733475 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee800d7f0 con 0x7f5ef80af070 2021-10-20T23:23:13.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 -- 172.21.15.12:0/633733475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 msgr2=0x7f5ef8144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 --2- 172.21.15.12:0/633733475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 0x7f5ef8144480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5ee8002f70 tx=0x7f5ee8006df0).stop 2021-10-20T23:23:13.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 -- 172.21.15.12:0/633733475 shutdown_connections 2021-10-20T23:23:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 --2- 172.21.15.12:0/633733475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 0x7f5ef8144480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 --2- 172.21.15.12:0/633733475 >> v2:172.21.15.31:3300/0 conn(0x7f5ef80a9eb0 0x7f5ef80b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 -- 172.21.15.12:0/633733475 >> 172.21.15.12:0/633733475 conn(0x7f5ef80607c0 msgr2=0x7f5ef8060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 -- 172.21.15.12:0/633733475 shutdown_connections 2021-10-20T23:23:13.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 -- 172.21.15.12:0/633733475 wait complete. 2021-10-20T23:23:13.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 Processor -- start 2021-10-20T23:23:13.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 -- start start 2021-10-20T23:23:13.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef80a9eb0 0x7f5ef814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 0x7f5ef8156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ef80b3130 0x7f5ef8157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef81568a0 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef815aaa0 con 0x7f5ef80b3130 2021-10-20T23:23:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5f0041b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8156a90 con 0x7f5ef80af070 2021-10-20T23:23:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe1b7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef80a9eb0 0x7f5ef814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe1b7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef80a9eb0 0x7f5ef814e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39076/0 (socket says 172.21.15.12:39076) 2021-10-20T23:23:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe1b7700 1 -- 172.21.15.12:0/2639414605 learned_addr learned my addr 172.21.15.12:0/2639414605 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efd9b6700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 0x7f5ef8156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe9b8700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ef80b3130 0x7f5ef8157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe1b7700 1 -- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 msgr2=0x7f5ef8156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe1b7700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 0x7f5ef8156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe1b7700 1 -- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ef80b3130 msgr2=0x7f5ef8157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe1b7700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ef80b3130 0x7f5ef8157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe1b7700 1 -- 172.21.15.12:0/2639414605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec00b180 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.242+0000 7f5efe1b7700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef80a9eb0 0x7f5ef814e8e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f5eec00c000 tx=0x7f5eec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:13.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5ef77fe700 1 -- 172.21.15.12:0/2639414605 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eec00c7e0 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5ef77fe700 1 -- 172.21.15.12:0/2639414605 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec00c940 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee800b180 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5ef77fe700 1 -- 172.21.15.12:0/2639414605 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eec00cca0 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef813f580 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef815ac60 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5ef77fe700 1 -- 172.21.15.12:0/2639414605 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5eec01c460 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5ef77fe700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ed8053580 0x7f5ed8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5ef77fe700 1 -- 172.21.15.12:0/2639414605 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f5eec06c130 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.246+0000 7f5efd9b6700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ed8053580 0x7f5ed8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.250+0000 7f5efd9b6700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ed8053580 0x7f5ed8055a40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5ef000d000 tx=0x7f5ef0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:13.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.254+0000 7f5ef77fe700 1 -- 172.21.15.12:0/2639414605 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5eec046e60 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ef8156c50 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5ef77fe700 1 -- 172.21.15.12:0/2639414605 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2130 (secure 0 0 0) 0x7f5eec042f70 con 0x7f5ef80a9eb0 2021-10-20T23:23:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:13.425 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:21:50.499039+0000","modified":"2021-10-20T23:23:13.101558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-20T23:23:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ed8053580 msgr2=0x7f5ed8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ed8053580 0x7f5ed8055a40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5ef000d000 tx=0x7f5ef0009040).stop 2021-10-20T23:23:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef80a9eb0 msgr2=0x7f5ef814e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef80a9eb0 0x7f5ef814e8e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f5eec00c000 tx=0x7f5eec006df0).stop 2021-10-20T23:23:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 shutdown_connections 2021-10-20T23:23:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5ed8053580 0x7f5ed8055a40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ef80b3130 0x7f5ef8157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ef80af070 0x7f5ef8156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 --2- 172.21.15.12:0/2639414605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef80a9eb0 0x7f5ef814e8e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 >> 172.21.15.12:0/2639414605 conn(0x7f5ef80607c0 msgr2=0x7f5ef8060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 shutdown_connections 2021-10-20T23:23:13.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.422+0000 7f5f0041b700 1 -- 172.21.15.12:0/2639414605 wait complete. 2021-10-20T23:23:13.429 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 20 2021-10-20T23:23:13.438 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:23:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5724e700 1 Processor -- start 2021-10-20T23:23:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5724e700 1 -- start start 2021-10-20T23:23:13.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5724e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe500ad5c0 0x7fbe50061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5724e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe50140440 0x7fbe501408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5724e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500aecf0 con 0x7fbe50061320 2021-10-20T23:23:13.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5724e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe500b6f20 con 0x7fbe500ad5c0 2021-10-20T23:23:13.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5724e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500aef20 con 0x7fbe50140440 2021-10-20T23:23:13.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5624c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbe50061320 0x7fbe500b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37678/0 (socket says 172.21.15.12:37678) 2021-10-20T23:23:13.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5624c700 1 -- 172.21.15.12:0/4167919896 learned_addr learned my addr 172.21.15.12:0/4167919896 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe55a4b700 1 --2- 172.21.15.12:0/4167919896 >> v2:172.21.15.31:3300/0 conn(0x7fbe500ad5c0 0x7fbe50061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe56a4d700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe50140440 0x7fbe501408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222709857 0 0) 0x7fbe500aecf0 con 0x7fbe50061320 2021-10-20T23:23:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe3c003260 con 0x7fbe50061320 2021-10-20T23:23:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124123451 0 0) 0x7fbe3c003260 con 0x7fbe50061320 2021-10-20T23:23:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe50140440 msgr2=0x7fbe501408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe50140440 0x7fbe501408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 >> v2:172.21.15.31:3300/0 conn(0x7fbe500ad5c0 msgr2=0x7fbe50061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 --2- 172.21.15.12:0/4167919896 >> v2:172.21.15.31:3300/0 conn(0x7fbe500ad5c0 0x7fbe50061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500af1c0 con 0x7fbe50061320 2021-10-20T23:23:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fbe4c001660 con 0x7fbe50061320 2021-10-20T23:23:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe55a4b700 1 --2- 172.21.15.12:0/4167919896 >> v2:172.21.15.31:3300/0 conn(0x7fbe500ad5c0 0x7fbe50061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 >> v1:172.21.15.12:6789/0 conn(0x7fbe50061320 legacy=0x7fbe500b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe3c003750 0x7fbe3c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c004500 0x7fbe3c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe50140440 0x7fbe3c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b6f20 con 0x7fbe3c004500 2021-10-20T23:23:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500aef20 con 0x7fbe3c003750 2021-10-20T23:23:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c00b750 con 0x7fbe50140440 2021-10-20T23:23:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe55a4b700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c004500 0x7fbe3c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe5624c700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe3c003750 0x7fbe3c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe56a4d700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe50140440 0x7fbe3c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe55a4b700 1 -- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe50140440 msgr2=0x7fbe3c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe55a4b700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe50140440 0x7fbe3c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe55a4b700 1 -- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe3c003750 msgr2=0x7fbe3c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe55a4b700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe3c003750 0x7fbe3c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.546+0000 7fbe55a4b700 1 -- 172.21.15.12:0/4167919896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c003260 con 0x7fbe3c004500 2021-10-20T23:23:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe55a4b700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c004500 0x7fbe3c004980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fbe4800c000 tx=0x7fbe480091d0).ready entity=mon.0 client_cookie=cdc40b7bcc8f2966 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe4800e8f0 con 0x7fbe3c004500 2021-10-20T23:23:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800ea50 con 0x7fbe3c004500 2021-10-20T23:23:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe5524a700 1 -- 172.21.15.12:0/4167919896 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe4800edb0 con 0x7fbe3c004500 2021-10-20T23:23:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe5724e700 1 -- 172.21.15.12:0/4167919896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c004500 msgr2=0x7fbe3c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe5724e700 1 --2- 172.21.15.12:0/4167919896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c004500 0x7fbe3c004980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fbe4800c000 tx=0x7fbe480091d0).stop 2021-10-20T23:23:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe56a4d700 1 -- 172.21.15.12:0/4167919896 reap_dead start 2021-10-20T23:23:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe5724e700 1 -- 172.21.15.12:0/4167919896 shutdown_connections 2021-10-20T23:23:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe5724e700 1 -- 172.21.15.12:0/4167919896 >> 172.21.15.12:0/4167919896 conn(0x7fbe50066de0 msgr2=0x7fbe500671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe5724e700 1 -- 172.21.15.12:0/4167919896 shutdown_connections 2021-10-20T23:23:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.550+0000 7fbe5724e700 1 -- 172.21.15.12:0/4167919896 wait complete. 2021-10-20T23:23:13.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 Processor -- start 2021-10-20T23:23:13.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 -- start start 2021-10-20T23:23:13.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe5014a2b0 0x7fbe500b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe5009ec30 0x7fbe500ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe500b1d50 0x7fbe500ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b2c60 con 0x7fbe500b1d50 2021-10-20T23:23:13.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50155a70 con 0x7fbe5009ec30 2021-10-20T23:23:13.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b1b20 con 0x7fbe5014a2b0 2021-10-20T23:23:13.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe56a4d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe500b1d50 0x7fbe500ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe56a4d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe500b1d50 0x7fbe500ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39100/0 (socket says 172.21.15.12:39100) 2021-10-20T23:23:13.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe56a4d700 1 -- 172.21.15.12:0/1215668052 learned_addr learned my addr 172.21.15.12:0/1215668052 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:13.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5624c700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe5014a2b0 0x7fbe500b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe55a4b700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe5009ec30 0x7fbe500ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe56a4d700 1 -- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe5014a2b0 msgr2=0x7fbe500b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe56a4d700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe5014a2b0 0x7fbe500b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe56a4d700 1 -- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe5009ec30 msgr2=0x7fbe500ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:13.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe56a4d700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe5009ec30 0x7fbe500ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:13.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe56a4d700 1 -- 172.21.15.12:0/1215668052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5014a690 con 0x7fbe500b1d50 2021-10-20T23:23:13.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe56a4d700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe500b1d50 0x7fbe500ac8a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fbe5009f070 tx=0x7fbe40006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:13.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe477fe700 1 -- 172.21.15.12:0/1215668052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe40019070 con 0x7fbe500b1d50 2021-10-20T23:23:13.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe477fe700 1 -- 172.21.15.12:0/1215668052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40000e90 con 0x7fbe500b1d50 2021-10-20T23:23:13.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe500b3510 con 0x7fbe500b1d50 2021-10-20T23:23:13.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe477fe700 1 -- 172.21.15.12:0/1215668052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe4000bea0 con 0x7fbe500b1d50 2021-10-20T23:23:13.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.554+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe500b1810 con 0x7fbe500b1d50 2021-10-20T23:23:13.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.558+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe500b39b0 con 0x7fbe500b1d50 2021-10-20T23:23:13.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.558+0000 7fbe477fe700 1 -- 172.21.15.12:0/1215668052 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbe4000f8c0 con 0x7fbe500b1d50 2021-10-20T23:23:13.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.558+0000 7fbe477fe700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe300536d0 0x7fbe30055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:13.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.558+0000 7fbe477fe700 1 -- 172.21.15.12:0/1215668052 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fbe4006b5a0 con 0x7fbe500b1d50 2021-10-20T23:23:13.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.558+0000 7fbe5624c700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe300536d0 0x7fbe30055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:13.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.558+0000 7fbe5624c700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe300536d0 0x7fbe30055b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fbe4c005000 tx=0x7fbe4c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:13.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.566+0000 7fbe477fe700 1 -- 172.21.15.12:0/1215668052 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe40042550 con 0x7fbe500b1d50 2021-10-20T23:23:13.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:13.726+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbe500acf30 con 0x7fbe500b1d50 2021-10-20T23:23:14.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.126+0000 7fbe477fe700 1 -- 172.21.15.12:0/1215668052 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbe40045b70 con 0x7fbe500b1d50 2021-10-20T23:23:14.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe300536d0 msgr2=0x7fbe30055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:14.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe300536d0 0x7fbe30055b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fbe4c005000 tx=0x7fbe4c009040).stop 2021-10-20T23:23:14.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe500b1d50 msgr2=0x7fbe500ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:14.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe500b1d50 0x7fbe500ac8a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fbe5009f070 tx=0x7fbe40006df0).stop 2021-10-20T23:23:14.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 shutdown_connections 2021-10-20T23:23:14.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe300536d0 0x7fbe30055b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:14.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe500b1d50 0x7fbe500ac8a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:14.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe5009ec30 0x7fbe500ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:14.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 --2- 172.21.15.12:0/1215668052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe5014a2b0 0x7fbe500b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:14.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 >> 172.21.15.12:0/1215668052 conn(0x7fbe50066de0 msgr2=0x7fbe500b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:14.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 shutdown_connections 2021-10-20T23:23:14.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.130+0000 7fbe5724e700 1 -- 172.21.15.12:0/1215668052 wait complete. 2021-10-20T23:23:14.152 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:23:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.266+0000 7fc190e9d700 1 Processor -- start 2021-10-20T23:23:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.266+0000 7fc190e9d700 1 -- start start 2021-10-20T23:23:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc18c0b43c0 0x7fc18c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc18c0b6960 0x7fc18c12ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c1440b0 con 0x7fc18c0b6580 2021-10-20T23:23:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c143b70 con 0x7fc18c0b43c0 2021-10-20T23:23:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c143e10 con 0x7fc18c0b6960 2021-10-20T23:23:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc189d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc18c0b43c0 0x7fc18c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc189d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc18c0b43c0 0x7fc18c0b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39104/0 (socket says 172.21.15.12:39104) 2021-10-20T23:23:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc189d9b700 1 -- 172.21.15.12:0/1251653510 learned_addr learned my addr 172.21.15.12:0/1251653510 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:14.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc18ad9d700 1 --2- 172.21.15.12:0/1251653510 >> v2:172.21.15.31:3300/0 conn(0x7fc18c0b6960 0x7fc18c12ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:14.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc189d9b700 1 -- 172.21.15.12:0/1251653510 >> v2:172.21.15.31:3300/0 conn(0x7fc18c0b6960 msgr2=0x7fc18c12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc189d9b700 1 --2- 172.21.15.12:0/1251653510 >> v2:172.21.15.31:3300/0 conn(0x7fc18c0b6960 0x7fc18c12ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc189d9b700 1 -- 172.21.15.12:0/1251653510 >> v1:172.21.15.31:6789/0 conn(0x7fc18c0b6580 legacy=0x7fc18c061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc189d9b700 1 -- 172.21.15.12:0/1251653510 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0615f0 con 0x7fc18c0b43c0 2021-10-20T23:23:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc189d9b700 1 --2- 172.21.15.12:0/1251653510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 0x7fc18c0b5bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fc18c143120 tx=0x7fc180006eb0).ready entity=mon.0 client_cookie=2788b20ee0a18f8a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc18959a700 1 -- 172.21.15.12:0/1251653510 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc18000d610 con 0x7fc18c0b43c0 2021-10-20T23:23:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc18959a700 1 -- 172.21.15.12:0/1251653510 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc180000e90 con 0x7fc18c0b43c0 2021-10-20T23:23:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc18959a700 1 -- 172.21.15.12:0/1251653510 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc18000d9a0 con 0x7fc18c0b43c0 2021-10-20T23:23:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 -- 172.21.15.12:0/1251653510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 msgr2=0x7fc18c0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 --2- 172.21.15.12:0/1251653510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 0x7fc18c0b5bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fc18c143120 tx=0x7fc180006eb0).stop 2021-10-20T23:23:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 -- 172.21.15.12:0/1251653510 shutdown_connections 2021-10-20T23:23:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 --2- 172.21.15.12:0/1251653510 >> v2:172.21.15.31:3300/0 conn(0x7fc18c0b6960 0x7fc18c12ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 --2- 172.21.15.12:0/1251653510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 0x7fc18c0b5bf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 -- 172.21.15.12:0/1251653510 >> 172.21.15.12:0/1251653510 conn(0x7fc18c05c490 msgr2=0x7fc18c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 -- 172.21.15.12:0/1251653510 shutdown_connections 2021-10-20T23:23:14.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.270+0000 7fc190e9d700 1 -- 172.21.15.12:0/1251653510 wait complete. 2021-10-20T23:23:14.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 Processor -- start 2021-10-20T23:23:14.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 -- start start 2021-10-20T23:23:14.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 0x7fc18c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:14.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0b6580 0x7fc18c155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:14.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc18c0b6960 0x7fc18c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:14.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c155a70 con 0x7fc18c0b43c0 2021-10-20T23:23:14.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c12a040 con 0x7fc18c0b6580 2021-10-20T23:23:14.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c129b00 con 0x7fc18c0b6960 2021-10-20T23:23:14.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 0x7fc18c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:14.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 0x7fc18c1412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39110/0 (socket says 172.21.15.12:39110) 2021-10-20T23:23:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc189d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0b6580 0x7fc18c155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18a59c700 1 -- 172.21.15.12:0/309325740 learned_addr learned my addr 172.21.15.12:0/309325740 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18ad9d700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc18c0b6960 0x7fc18c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18a59c700 1 -- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc18c0b6960 msgr2=0x7fc18c1563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18a59c700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc18c0b6960 0x7fc18c1563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18a59c700 1 -- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0b6580 msgr2=0x7fc18c155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18a59c700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0b6580 0x7fc18c155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18a59c700 1 -- 172.21.15.12:0/309325740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18000b1e0 con 0x7fc18c0b43c0 2021-10-20T23:23:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc18a59c700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 0x7fc18c1412d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fc18c0b1c80 tx=0x7fc17c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:14.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc17b7fe700 1 -- 172.21.15.12:0/309325740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17c012400 con 0x7fc18c0b43c0 2021-10-20T23:23:14.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc17b7fe700 1 -- 172.21.15.12:0/309325740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c012560 con 0x7fc18c0b43c0 2021-10-20T23:23:14.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c129da0 con 0x7fc18c0b43c0 2021-10-20T23:23:14.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc17b7fe700 1 -- 172.21.15.12:0/309325740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17c0128c0 con 0x7fc18c0b43c0 2021-10-20T23:23:14.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.274+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c12a230 con 0x7fc18c0b43c0 2021-10-20T23:23:14.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.278+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c061890 con 0x7fc18c0b43c0 2021-10-20T23:23:14.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.278+0000 7fc17b7fe700 1 -- 172.21.15.12:0/309325740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc17c019030 con 0x7fc18c0b43c0 2021-10-20T23:23:14.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.278+0000 7fc17b7fe700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1680536a0 0x7fc168055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:14.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.278+0000 7fc17b7fe700 1 -- 172.21.15.12:0/309325740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fc17c06ae20 con 0x7fc18c0b43c0 2021-10-20T23:23:14.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.278+0000 7fc189d9b700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1680536a0 0x7fc168055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.278+0000 7fc189d9b700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1680536a0 0x7fc168055b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fc18001c000 tx=0x7fc180015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.286+0000 7fc17b7fe700 1 -- 172.21.15.12:0/309325740 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc17c041d70 con 0x7fc18c0b43c0 2021-10-20T23:23:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:14.410+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc18c057350 con 0x7fc18c0b43c0 2021-10-20T23:23:15.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.182+0000 7fc17b7fe700 1 -- 172.21.15.12:0/309325740 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc17c045390 con 0x7fc18c0b43c0 2021-10-20T23:23:15.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1680536a0 msgr2=0x7fc168055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:15.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1680536a0 0x7fc168055b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fc18001c000 tx=0x7fc180015000).stop 2021-10-20T23:23:15.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 msgr2=0x7fc18c1412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:15.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 0x7fc18c1412d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fc18c0b1c80 tx=0x7fc17c007c50).stop 2021-10-20T23:23:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 shutdown_connections 2021-10-20T23:23:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc1680536a0 0x7fc168055b60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc18c0b6960 0x7fc18c1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0b6580 0x7fc18c155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 --2- 172.21.15.12:0/309325740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc18c0b43c0 0x7fc18c1412d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:15.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 >> 172.21.15.12:0/309325740 conn(0x7fc18c05c490 msgr2=0x7fc18c141f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:15.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 shutdown_connections 2021-10-20T23:23:15.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.198+0000 7fc190e9d700 1 -- 172.21.15.12:0/309325740 wait complete. 2021-10-20T23:23:15.203 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:23:15.213 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:23:15.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04db25b700 1 Processor -- start 2021-10-20T23:23:15.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04db25b700 1 -- start start 2021-10-20T23:23:15.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04db25b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b43c0 0x7f04d40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04db25b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04d40b6960 0x7f04d412ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04db25b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d41440b0 con 0x7f04d40b6580 2021-10-20T23:23:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04db25b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d4143b70 con 0x7f04d40b6960 2021-10-20T23:23:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04db25b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4143e10 con 0x7f04d40b43c0 2021-10-20T23:23:15.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04d97f8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04d40b6960 0x7f04d412ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:15.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04d97f8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04d40b6960 0x7f04d412ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39122/0 (socket says 172.21.15.12:39122) 2021-10-20T23:23:15.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04d97f8700 1 -- 172.21.15.12:0/3724395822 learned_addr learned my addr 172.21.15.12:0/3724395822 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:15.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.326+0000 7f04d3fff700 1 --2- 172.21.15.12:0/3724395822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b43c0 0x7f04d40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:15.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d37fe700 1 -- 172.21.15.12:0/3724395822 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113108937 0 0) 0x7f04d41440b0 con 0x7f04d40b6580 2021-10-20T23:23:15.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d37fe700 1 -- 172.21.15.12:0/3724395822 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b4003260 con 0x7f04d40b6580 2021-10-20T23:23:15.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d97f8700 1 -- 172.21.15.12:0/3724395822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b43c0 msgr2=0x7f04d40b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:15.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d97f8700 1 --2- 172.21.15.12:0/3724395822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b43c0 0x7f04d40b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:15.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d97f8700 1 -- 172.21.15.12:0/3724395822 >> v1:172.21.15.31:6789/0 conn(0x7f04d40b6580 legacy=0x7f04d4061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:15.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d97f8700 1 -- 172.21.15.12:0/3724395822 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40615f0 con 0x7f04d40b6960 2021-10-20T23:23:15.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d97f8700 1 --2- 172.21.15.12:0/3724395822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 0x7f04d412ba00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f04cc0032f0 tx=0x7f04cc009290).ready entity=mon.0 client_cookie=69ac831d52f77205 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:15.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d37fe700 1 -- 172.21.15.12:0/3724395822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04cc00b6c0 con 0x7f04d40b6960 2021-10-20T23:23:15.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d37fe700 1 -- 172.21.15.12:0/3724395822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc00b820 con 0x7f04d40b6960 2021-10-20T23:23:15.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04d37fe700 1 -- 172.21.15.12:0/3724395822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04cc00b990 con 0x7f04d40b6960 2021-10-20T23:23:15.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 -- 172.21.15.12:0/3724395822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 msgr2=0x7f04d412ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:15.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 --2- 172.21.15.12:0/3724395822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 0x7f04d412ba00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f04cc0032f0 tx=0x7f04cc009290).stop 2021-10-20T23:23:15.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 -- 172.21.15.12:0/3724395822 shutdown_connections 2021-10-20T23:23:15.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 --2- 172.21.15.12:0/3724395822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 0x7f04d412ba00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:15.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 --2- 172.21.15.12:0/3724395822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b43c0 0x7f04d40b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:15.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 -- 172.21.15.12:0/3724395822 >> 172.21.15.12:0/3724395822 conn(0x7f04d405c490 msgr2=0x7f04d405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:15.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 -- 172.21.15.12:0/3724395822 shutdown_connections 2021-10-20T23:23:15.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 -- 172.21.15.12:0/3724395822 wait complete. 2021-10-20T23:23:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 Processor -- start 2021-10-20T23:23:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 -- start start 2021-10-20T23:23:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d40b43c0 0x7f04d4128a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.330+0000 7f04db25b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b6580 0x7f04d40b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:15.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04db25b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 0x7f04d40b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:15.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04db25b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40ad960 con 0x7f04d40b6960 2021-10-20T23:23:15.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04db25b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40ae7f0 con 0x7f04d40b43c0 2021-10-20T23:23:15.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04db25b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40aea90 con 0x7f04d40b6580 2021-10-20T23:23:15.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d97f8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 0x7f04d40b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:15.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d97f8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 0x7f04d40b82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39128/0 (socket says 172.21.15.12:39128) 2021-10-20T23:23:15.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d97f8700 1 -- 172.21.15.12:0/1615953693 learned_addr learned my addr 172.21.15.12:0/1615953693 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:15.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d8ff7700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d40b43c0 0x7f04d4128a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:15.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d3fff700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b6580 0x7f04d40b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:15.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d97f8700 1 -- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b6580 msgr2=0x7f04d40b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:15.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d97f8700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b6580 0x7f04d40b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:15.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d97f8700 1 -- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d40b43c0 msgr2=0x7f04d4128a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:15.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d97f8700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d40b43c0 0x7f04d4128a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:15.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d97f8700 1 -- 172.21.15.12:0/1615953693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc009530 con 0x7f04d40b6960 2021-10-20T23:23:15.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d8ff7700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d40b43c0 0x7f04d4128a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:15.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d97f8700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 0x7f04d40b82d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f04cc0032f0 tx=0x7f04cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:15.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d1ffb700 1 -- 172.21.15.12:0/1615953693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04cc00b990 con 0x7f04d40b6960 2021-10-20T23:23:15.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d1ffb700 1 -- 172.21.15.12:0/1615953693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc0107a0 con 0x7f04d40b6960 2021-10-20T23:23:15.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d40ad6c0 con 0x7f04d40b6960 2021-10-20T23:23:15.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d1ffb700 1 -- 172.21.15.12:0/1615953693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04cc00b6c0 con 0x7f04d40b6960 2021-10-20T23:23:15.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d40adea0 con 0x7f04d40b6960 2021-10-20T23:23:15.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d4061890 con 0x7f04d40b6960 2021-10-20T23:23:15.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d1ffb700 1 -- 172.21.15.12:0/1615953693 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f04cc00f070 con 0x7f04d40b6960 2021-10-20T23:23:15.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d1ffb700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04b80536a0 0x7f04b8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:15.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d1ffb700 1 -- 172.21.15.12:0/1615953693 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f04cc06ccc0 con 0x7f04d40b6960 2021-10-20T23:23:15.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.334+0000 7f04d8ff7700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04b80536a0 0x7f04b8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:15.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.338+0000 7f04d8ff7700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04b80536a0 0x7f04b8055b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f04bc00b000 tx=0x7f04bc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:15.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.342+0000 7f04d1ffb700 1 -- 172.21.15.12:0/1615953693 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04cc043e20 con 0x7f04d40b6960 2021-10-20T23:23:15.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:15.474+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04d4057350 con 0x7f04d40b6960 2021-10-20T23:23:16.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.190+0000 7f04d1ffb700 1 -- 172.21.15.12:0/1615953693 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) v1 ==== 173+0+0 (secure 0 0 0) 0x7f04cc015020 con 0x7f04d40b6960 2021-10-20T23:23:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.194+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04b80536a0 msgr2=0x7f04b8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.194+0000 7f04db25b700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04b80536a0 0x7f04b8055b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f04bc00b000 tx=0x7f04bc009040).stop 2021-10-20T23:23:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.194+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 msgr2=0x7f04d40b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.194+0000 7f04db25b700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 0x7f04d40b82d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f04cc0032f0 tx=0x7f04cc016000).stop 2021-10-20T23:23:16.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.198+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 shutdown_connections 2021-10-20T23:23:16.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.198+0000 7f04db25b700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04b80536a0 0x7f04b8055b60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.198+0000 7f04db25b700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d40b6960 0x7f04d40b82d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.198+0000 7f04db25b700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d40b6580 0x7f04d40b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.198+0000 7f04db25b700 1 --2- 172.21.15.12:0/1615953693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d40b43c0 0x7f04d4128a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.198+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 >> 172.21.15.12:0/1615953693 conn(0x7f04d405c490 msgr2=0x7f04d4143160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:16.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.198+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 shutdown_connections 2021-10-20T23:23:16.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.198+0000 7f04db25b700 1 -- 172.21.15.12:0/1615953693 wait complete. 2021-10-20T23:23:16.202 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:23:16.213 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:23:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f759e700 1 Processor -- start 2021-10-20T23:23:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f759e700 1 -- start start 2021-10-20T23:23:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3f80b21b0 0x7fa3f805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 0x7fa3f812c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f80b3c40 con 0x7fa3f8060d20 2021-10-20T23:23:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f8063df0 con 0x7fa3f80b21b0 2021-10-20T23:23:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80b2590 con 0x7fa3f8143c90 2021-10-20T23:23:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3f80b21b0 0x7fa3f805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3effff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa3f8060d20 0x7fa3f80b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37728/0 (socket says 172.21.15.12:37728) 2021-10-20T23:23:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3effff700 1 -- 172.21.15.12:0/467882176 learned_addr learned my addr 172.21.15.12:0/467882176 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f6d9d700 1 --2- 172.21.15.12:0/467882176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 0x7fa3f812c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f5d9b700 1 -- 172.21.15.12:0/467882176 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332072661 0 0) 0x7fa3f80b3c40 con 0x7fa3f8060d20 2021-10-20T23:23:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f5d9b700 1 -- 172.21.15.12:0/467882176 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d8003260 con 0x7fa3f8060d20 2021-10-20T23:23:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f659c700 1 -- 172.21.15.12:0/467882176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 msgr2=0x7fa3f812c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f659c700 1 --2- 172.21.15.12:0/467882176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 0x7fa3f812c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f659c700 1 -- 172.21.15.12:0/467882176 >> v1:172.21.15.12:6789/0 conn(0x7fa3f8060d20 legacy=0x7fa3f80b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f659c700 1 -- 172.21.15.12:0/467882176 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80b2e30 con 0x7fa3f80b21b0 2021-10-20T23:23:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f659c700 1 --2- 172.21.15.12:0/467882176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 0x7fa3f805f6b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fa3e8002f70 tx=0x7fa3e8006df0).ready entity=mon.0 client_cookie=1adcdb3b48072ee8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f5d9b700 1 -- 172.21.15.12:0/467882176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e800d570 con 0x7fa3f80b21b0 2021-10-20T23:23:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f5d9b700 1 -- 172.21.15.12:0/467882176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e8000e90 con 0x7fa3f80b21b0 2021-10-20T23:23:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.314+0000 7fa3f5d9b700 1 -- 172.21.15.12:0/467882176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e800d8c0 con 0x7fa3f80b21b0 2021-10-20T23:23:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 -- 172.21.15.12:0/467882176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 msgr2=0x7fa3f805f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 --2- 172.21.15.12:0/467882176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 0x7fa3f805f6b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fa3e8002f70 tx=0x7fa3e8006df0).stop 2021-10-20T23:23:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 -- 172.21.15.12:0/467882176 shutdown_connections 2021-10-20T23:23:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 --2- 172.21.15.12:0/467882176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 0x7fa3f812c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 --2- 172.21.15.12:0/467882176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 0x7fa3f805f6b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 -- 172.21.15.12:0/467882176 >> 172.21.15.12:0/467882176 conn(0x7fa3f805c490 msgr2=0x7fa3f805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 -- 172.21.15.12:0/467882176 shutdown_connections 2021-10-20T23:23:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 -- 172.21.15.12:0/467882176 wait complete. 2021-10-20T23:23:16.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 Processor -- start 2021-10-20T23:23:16.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.318+0000 7fa3f759e700 1 -- start start 2021-10-20T23:23:16.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3f8060d20 0x7fa3f8145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 0x7fa3f8146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 0x7fa3f80669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8065b70 con 0x7fa3f80b21b0 2021-10-20T23:23:16.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8065910 con 0x7fa3f8060d20 2021-10-20T23:23:16.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8066220 con 0x7fa3f8143c90 2021-10-20T23:23:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3effff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 0x7fa3f8146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3f8060d20 0x7fa3f8145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3effff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 0x7fa3f8146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39140/0 (socket says 172.21.15.12:39140) 2021-10-20T23:23:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3effff700 1 -- 172.21.15.12:0/1647804440 learned_addr learned my addr 172.21.15.12:0/1647804440 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:16.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3f8060d20 0x7fa3f8145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:54112/0 (socket says 172.21.15.12:54112) 2021-10-20T23:23:16.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f6d9d700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 0x7fa3f80669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3effff700 1 -- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 msgr2=0x7fa3f80669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3effff700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 0x7fa3f80669c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3effff700 1 -- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3f8060d20 msgr2=0x7fa3f8145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3effff700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3f8060d20 0x7fa3f8145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3effff700 1 -- 172.21.15.12:0/1647804440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e800b180 con 0x7fa3f80b21b0 2021-10-20T23:23:16.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3effff700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 0x7fa3f8146bd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fa3e0001110 tx=0x7fa3e0007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:16.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3ef7fe700 1 -- 172.21.15.12:0/1647804440 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e00070d0 con 0x7fa3f80b21b0 2021-10-20T23:23:16.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3ef7fe700 1 -- 172.21.15.12:0/1647804440 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0007230 con 0x7fa3f80b21b0 2021-10-20T23:23:16.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f80664c0 con 0x7fa3f80b21b0 2021-10-20T23:23:16.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3ef7fe700 1 -- 172.21.15.12:0/1647804440 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e0005610 con 0x7fa3f80b21b0 2021-10-20T23:23:16.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.322+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f8144490 con 0x7fa3f80b21b0 2021-10-20T23:23:16.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.326+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f8066720 con 0x7fa3f80b21b0 2021-10-20T23:23:16.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.326+0000 7fa3ef7fe700 1 -- 172.21.15.12:0/1647804440 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa3e0010070 con 0x7fa3f80b21b0 2021-10-20T23:23:16.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.326+0000 7fa3ef7fe700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3dc0536a0 0x7fa3dc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.326+0000 7fa3ef7fe700 1 -- 172.21.15.12:0/1647804440 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fa3e006af20 con 0x7fa3f80b21b0 2021-10-20T23:23:16.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.326+0000 7fa3f659c700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3dc0536a0 0x7fa3dc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.326+0000 7fa3f659c700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3dc0536a0 0x7fa3dc055b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fa3e801a000 tx=0x7fa3e8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:16.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.334+0000 7fa3ef7fe700 1 -- 172.21.15.12:0/1647804440 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3f8066720 con 0x7fa3f80b21b0 2021-10-20T23:23:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.458+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa3f8066720 con 0x7fa3f80b21b0 2021-10-20T23:23:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.462+0000 7fa3ef7fe700 1 -- 172.21.15.12:0/1647804440 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa3f8066720 con 0x7fa3f80b21b0 2021-10-20T23:23:16.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3dc0536a0 msgr2=0x7fa3dc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3dc0536a0 0x7fa3dc055b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fa3e801a000 tx=0x7fa3e8014000).stop 2021-10-20T23:23:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 msgr2=0x7fa3f8146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 0x7fa3f8146bd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fa3e0001110 tx=0x7fa3e0007ad0).stop 2021-10-20T23:23:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 shutdown_connections 2021-10-20T23:23:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3dc0536a0 0x7fa3dc055b60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3f8143c90 0x7fa3f80669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3f80b21b0 0x7fa3f8146bd0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 --2- 172.21.15.12:0/1647804440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3f8060d20 0x7fa3f8145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 >> 172.21.15.12:0/1647804440 conn(0x7fa3f805c490 msgr2=0x7fa3f8142f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:16.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 shutdown_connections 2021-10-20T23:23:16.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.466+0000 7fa3f759e700 1 -- 172.21.15.12:0/1647804440 wait complete. 2021-10-20T23:23:16.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-10-20T23:23:16.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d0359e700 1 Processor -- start 2021-10-20T23:23:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d0359e700 1 -- start start 2021-10-20T23:23:16.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d0359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d040b2580 0x7f8d0414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d0359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d040b0010 0x7f8d0414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d0359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040afbd0 0x7f8d040a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d0359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d040a70c0 con 0x7f8d040b0010 2021-10-20T23:23:16.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d0359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d040a72f0 con 0x7f8d040b2580 2021-10-20T23:23:16.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d0359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d040a7590 con 0x7f8d040afbd0 2021-10-20T23:23:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d01d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d040b0010 0x7f8d0414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d01d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d040b0010 0x7f8d0414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39146/0 (socket says 172.21.15.12:39146) 2021-10-20T23:23:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d01d9b700 1 -- 172.21.15.12:0/55268427 learned_addr learned my addr 172.21.15.12:0/55268427 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d02d9d700 1 --2- 172.21.15.12:0/55268427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040afbd0 0x7f8d040a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d0259c700 1 --2- 172.21.15.12:0/55268427 >> v2:172.21.15.31:3300/0 conn(0x7f8d040b2580 0x7f8d0414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d01d9b700 1 -- 172.21.15.12:0/55268427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040afbd0 msgr2=0x7f8d040a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:16.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d01d9b700 1 --2- 172.21.15.12:0/55268427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040afbd0 0x7f8d040a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d01d9b700 1 -- 172.21.15.12:0/55268427 >> v2:172.21.15.31:3300/0 conn(0x7f8d040b2580 msgr2=0x7f8d0414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:16.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d01d9b700 1 --2- 172.21.15.12:0/55268427 >> v2:172.21.15.31:3300/0 conn(0x7f8d040b2580 0x7f8d0414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.590+0000 7f8d01d9b700 1 -- 172.21.15.12:0/55268427 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d040a7830 con 0x7f8d040b0010 2021-10-20T23:23:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d01d9b700 1 --2- 172.21.15.12:0/55268427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 0x7f8d0414b330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f8cf40032f0 tx=0x7f8cf4009290).ready entity=mon.0 client_cookie=67c3ab081f163afe server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0159a700 1 -- 172.21.15.12:0/55268427 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf400b870 con 0x7f8d040b0010 2021-10-20T23:23:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0159a700 1 -- 172.21.15.12:0/55268427 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf400b9d0 con 0x7f8d040b0010 2021-10-20T23:23:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0159a700 1 -- 172.21.15.12:0/55268427 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf400bb40 con 0x7f8d040b0010 2021-10-20T23:23:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 -- 172.21.15.12:0/55268427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 msgr2=0x7f8d0414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 --2- 172.21.15.12:0/55268427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 0x7f8d0414b330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f8cf40032f0 tx=0x7f8cf4009290).stop 2021-10-20T23:23:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 -- 172.21.15.12:0/55268427 shutdown_connections 2021-10-20T23:23:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 --2- 172.21.15.12:0/55268427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040afbd0 0x7f8d040a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 --2- 172.21.15.12:0/55268427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 0x7f8d0414b330 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 --2- 172.21.15.12:0/55268427 >> v2:172.21.15.31:3300/0 conn(0x7f8d040b2580 0x7f8d0414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 -- 172.21.15.12:0/55268427 >> 172.21.15.12:0/55268427 conn(0x7f8d04060180 msgr2=0x7f8d040b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 -- 172.21.15.12:0/55268427 shutdown_connections 2021-10-20T23:23:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 -- 172.21.15.12:0/55268427 wait complete. 2021-10-20T23:23:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 Processor -- start 2021-10-20T23:23:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.594+0000 7f8d0359e700 1 -- start start 2021-10-20T23:23:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d0359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d040afbd0 0x7f8d040aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d0359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 0x7f8d04067580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d0359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040b2580 0x7f8d0414b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d0359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d040ab7c0 con 0x7f8d040b0010 2021-10-20T23:23:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d0359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d040a9f90 con 0x7f8d040afbd0 2021-10-20T23:23:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d0359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d040a9650 con 0x7f8d040b2580 2021-10-20T23:23:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d01d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 0x7f8d04067580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d01d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 0x7f8d04067580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39152/0 (socket says 172.21.15.12:39152) 2021-10-20T23:23:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d01d9b700 1 -- 172.21.15.12:0/1793025061 learned_addr learned my addr 172.21.15.12:0/1793025061 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:16.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d02d9d700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040b2580 0x7f8d0414b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d0259c700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d040afbd0 0x7f8d040aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d01d9b700 1 -- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040b2580 msgr2=0x7f8d0414b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d01d9b700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040b2580 0x7f8d0414b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d01d9b700 1 -- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d040afbd0 msgr2=0x7f8d040aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d01d9b700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d040afbd0 0x7f8d040aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d01d9b700 1 -- 172.21.15.12:0/1793025061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009530 con 0x7f8d040b0010 2021-10-20T23:23:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d01d9b700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 0x7f8d04067580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f8d040b3340 tx=0x7f8cf4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8cfb7fe700 1 -- 172.21.15.12:0/1793025061 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf4021430 con 0x7f8d040b0010 2021-10-20T23:23:16.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8cfb7fe700 1 -- 172.21.15.12:0/1793025061 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf4021590 con 0x7f8d040b0010 2021-10-20T23:23:16.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d040aaf80 con 0x7f8d040b0010 2021-10-20T23:23:16.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8cfb7fe700 1 -- 172.21.15.12:0/1793025061 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf40218f0 con 0x7f8d040b0010 2021-10-20T23:23:16.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.598+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d040aa1c0 con 0x7f8d040b0010 2021-10-20T23:23:16.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.602+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d04057350 con 0x7f8d040b0010 2021-10-20T23:23:16.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.602+0000 7f8cfb7fe700 1 -- 172.21.15.12:0/1793025061 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8cf4028070 con 0x7f8d040b0010 2021-10-20T23:23:16.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.602+0000 7f8cfb7fe700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ce80536a0 0x7f8ce8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:16.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.602+0000 7f8cfb7fe700 1 -- 172.21.15.12:0/1793025061 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f8cf406c510 con 0x7f8d040b0010 2021-10-20T23:23:16.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.602+0000 7f8d0259c700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ce80536a0 0x7f8ce8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:16.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.602+0000 7f8d0259c700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ce80536a0 0x7f8ce8055b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f8cec00c000 tx=0x7f8cec008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:16.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.606+0000 7f8cfb7fe700 1 -- 172.21.15.12:0/1793025061 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8cf40437f0 con 0x7f8d040b0010 2021-10-20T23:23:16.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:16.778+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f8d040a9790 con 0x7f8d040b0010 2021-10-20T23:23:17.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.194+0000 7f8cfb7fe700 1 -- 172.21.15.12:0/1793025061 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v153) v1 ==== 144+0+0 (secure 0 0 0) 0x7f8cf4015070 con 0x7f8d040b0010 2021-10-20T23:23:17.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ce80536a0 msgr2=0x7f8ce8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:17.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ce80536a0 0x7f8ce8055b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f8cec00c000 tx=0x7f8cec008040).stop 2021-10-20T23:23:17.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 msgr2=0x7f8d04067580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:17.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 0x7f8d04067580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f8d040b3340 tx=0x7f8cf4016000).stop 2021-10-20T23:23:17.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 shutdown_connections 2021-10-20T23:23:17.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ce80536a0 0x7f8ce8055b60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:17.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d040b2580 0x7f8d0414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:17.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d040b0010 0x7f8d04067580 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:17.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 --2- 172.21.15.12:0/1793025061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d040afbd0 0x7f8d040aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:17.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 >> 172.21.15.12:0/1793025061 conn(0x7f8d04060180 msgr2=0x7f8d041486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:17.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 shutdown_connections 2021-10-20T23:23:17.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.198+0000 7f8d0359e700 1 -- 172.21.15.12:0/1793025061 wait complete. 2021-10-20T23:23:17.219 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-10-20T23:23:17.219 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-10-20T23:23:17.220 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-10-20T23:23:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.322+0000 7f46af59e700 1 Processor -- start 2021-10-20T23:23:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.322+0000 7f46af59e700 1 -- start start 2021-10-20T23:23:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.322+0000 7f46af59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46b00a8ac0 0x7f46b0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.322+0000 7f46af59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b00a70c0 con 0x7f46b00b0010 2021-10-20T23:23:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.322+0000 7f46af59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b00a72f0 con 0x7f46b00b2580 2021-10-20T23:23:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.322+0000 7f46af59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b00a7590 con 0x7f46b00a8ac0 2021-10-20T23:23:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.322+0000 7f46add9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f46b00b0010 0x7f46b00a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37756/0 (socket says 172.21.15.12:37756) 2021-10-20T23:23:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.322+0000 7f46add9b700 1 -- 172.21.15.12:0/2729962986 learned_addr learned my addr 172.21.15.12:0/2729962986 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46aed9d700 1 --2- 172.21.15.12:0/2729962986 >> v2:172.21.15.31:3300/0 conn(0x7f46b00a8ac0 0x7f46b0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46ad59a700 1 -- 172.21.15.12:0/2729962986 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43253297 0 0) 0x7f46b00a70c0 con 0x7f46b00b0010 2021-10-20T23:23:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46ad59a700 1 -- 172.21.15.12:0/2729962986 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4694003260 con 0x7f46b00b0010 2021-10-20T23:23:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46aed9d700 1 -- 172.21.15.12:0/2729962986 >> v1:172.21.15.31:6789/0 conn(0x7f46b00b2580 legacy=0x7f46b014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46aed9d700 1 -- 172.21.15.12:0/2729962986 >> v1:172.21.15.12:6789/0 conn(0x7f46b00b0010 legacy=0x7f46b00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46aed9d700 1 -- 172.21.15.12:0/2729962986 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00a7830 con 0x7f46b00a8ac0 2021-10-20T23:23:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46aed9d700 1 --2- 172.21.15.12:0/2729962986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b00a8ac0 0x7f46b0152be0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f46a80032f0 tx=0x7f46a80091d0).ready entity=mon.1 client_cookie=26e9d6be687c39c8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:17.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46ad59a700 1 -- 172.21.15.12:0/2729962986 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46a800b6c0 con 0x7f46b00a8ac0 2021-10-20T23:23:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46ad59a700 1 -- 172.21.15.12:0/2729962986 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a800b820 con 0x7f46b00a8ac0 2021-10-20T23:23:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46ad59a700 1 -- 172.21.15.12:0/2729962986 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46a800b990 con 0x7f46b00a8ac0 2021-10-20T23:23:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46af59e700 1 -- 172.21.15.12:0/2729962986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b00a8ac0 msgr2=0x7f46b0152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46af59e700 1 --2- 172.21.15.12:0/2729962986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b00a8ac0 0x7f46b0152be0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f46a80032f0 tx=0x7f46a80091d0).stop 2021-10-20T23:23:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46af59e700 1 -- 172.21.15.12:0/2729962986 shutdown_connections 2021-10-20T23:23:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46af59e700 1 --2- 172.21.15.12:0/2729962986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b00a8ac0 0x7f46b0152be0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46af59e700 1 -- 172.21.15.12:0/2729962986 >> 172.21.15.12:0/2729962986 conn(0x7f46b0060180 msgr2=0x7f46b00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46af59e700 1 -- 172.21.15.12:0/2729962986 shutdown_connections 2021-10-20T23:23:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.326+0000 7f46af59e700 1 -- 172.21.15.12:0/2729962986 wait complete. 2021-10-20T23:23:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 Processor -- start 2021-10-20T23:23:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 -- start start 2021-10-20T23:23:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b00a8ac0 0x7f46b00b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b00b0010 0x7f46b00b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b00b2580 0x7f46b00a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00b5830 con 0x7f46b00a8ac0 2021-10-20T23:23:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00b3ea0 con 0x7f46b00b2580 2021-10-20T23:23:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00b4140 con 0x7f46b00b0010 2021-10-20T23:23:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46ae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b00a8ac0 0x7f46b00b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46aed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b00b2580 0x7f46b00a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46ae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b00a8ac0 0x7f46b00b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39170/0 (socket says 172.21.15.12:39170) 2021-10-20T23:23:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46ae59c700 1 -- 172.21.15.12:0/3424428311 learned_addr learned my addr 172.21.15.12:0/3424428311 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46add9b700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b00b0010 0x7f46b00b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46ae59c700 1 -- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b00b0010 msgr2=0x7f46b00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46ae59c700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b00b0010 0x7f46b00b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46ae59c700 1 -- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b00b2580 msgr2=0x7f46b00a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46ae59c700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b00b2580 0x7f46b00a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46ae59c700 1 -- 172.21.15.12:0/3424428311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8009470 con 0x7f46b00a8ac0 2021-10-20T23:23:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46ae59c700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b00a8ac0 0x7f46b00b3310 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f46b0061a80 tx=0x7f46a4007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f469f7fe700 1 -- 172.21.15.12:0/3424428311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46a4007e70 con 0x7f46b00a8ac0 2021-10-20T23:23:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f469f7fe700 1 -- 172.21.15.12:0/3424428311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a4007030 con 0x7f46b00a8ac0 2021-10-20T23:23:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b00b50f0 con 0x7f46b00a8ac0 2021-10-20T23:23:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f469f7fe700 1 -- 172.21.15.12:0/3424428311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46a4007390 con 0x7f46b00a8ac0 2021-10-20T23:23:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b014d0a0 con 0x7f46b00a8ac0 2021-10-20T23:23:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.330+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b0057350 con 0x7f46b00a8ac0 2021-10-20T23:23:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.334+0000 7f469f7fe700 1 -- 172.21.15.12:0/3424428311 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f46a4010030 con 0x7f46b00a8ac0 2021-10-20T23:23:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.334+0000 7f469f7fe700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f468c053580 0x7f468c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.334+0000 7f46add9b700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f468c053580 0x7f468c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.334+0000 7f469f7fe700 1 -- 172.21.15.12:0/3424428311 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f46a406b3a0 con 0x7f46b00a8ac0 2021-10-20T23:23:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.334+0000 7f46add9b700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f468c053580 0x7f468c055a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f46a000d000 tx=0x7f46a0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.342+0000 7f469f7fe700 1 -- 172.21.15.12:0/3424428311 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46a4042570 con 0x7f46b00a8ac0 2021-10-20T23:23:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:17.510+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f46b00b5590 con 0x7f46b00a8ac0 2021-10-20T23:23:18.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.202+0000 7f469f7fe700 1 -- 172.21.15.12:0/3424428311 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v154) v1 ==== 155+0+0 (secure 0 0 0) 0x7f46a4045b90 con 0x7f46b00a8ac0 2021-10-20T23:23:18.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f468c053580 msgr2=0x7f468c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f468c053580 0x7f468c055a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f46a000d000 tx=0x7f46a0009040).stop 2021-10-20T23:23:18.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b00a8ac0 msgr2=0x7f46b00b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b00a8ac0 0x7f46b00b3310 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f46b0061a80 tx=0x7f46a4007c00).stop 2021-10-20T23:23:18.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 shutdown_connections 2021-10-20T23:23:18.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f468c053580 0x7f468c055a40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b00b2580 0x7f46b00a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b00b0010 0x7f46b00b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 --2- 172.21.15.12:0/3424428311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b00a8ac0 0x7f46b00b3310 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 >> 172.21.15.12:0/3424428311 conn(0x7f46b0060180 msgr2=0x7f46b0144b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:18.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 shutdown_connections 2021-10-20T23:23:18.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.206+0000 7f46af59e700 1 -- 172.21.15.12:0/3424428311 wait complete. 2021-10-20T23:23:18.225 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:23:18.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 Processor -- start 2021-10-20T23:23:18.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 -- start start 2021-10-20T23:23:18.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa720061680 0x7fa7200b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7200b4710 0x7fa7200ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7201439a0 0x7fa72013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7200b9680 con 0x7fa7200b4710 2021-10-20T23:23:18.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7200b6910 con 0x7fa720061680 2021-10-20T23:23:18.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7200b6bb0 con 0x7fa7201439a0 2021-10-20T23:23:18.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa725d8e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7200b4710 0x7fa7200ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa725d8e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7200b4710 0x7fa7200ba200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39176/0 (socket says 172.21.15.12:39176) 2021-10-20T23:23:18.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa725d8e700 1 -- 172.21.15.12:0/2699140031 learned_addr learned my addr 172.21.15.12:0/2699140031 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:18.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa72658f700 1 --2- 172.21.15.12:0/2699140031 >> v2:172.21.15.31:3300/0 conn(0x7fa720061680 0x7fa7200b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa726d90700 1 --2- 172.21.15.12:0/2699140031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7201439a0 0x7fa72013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa725d8e700 1 -- 172.21.15.12:0/2699140031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7201439a0 msgr2=0x7fa72013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:18.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa725d8e700 1 --2- 172.21.15.12:0/2699140031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7201439a0 0x7fa72013fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa725d8e700 1 -- 172.21.15.12:0/2699140031 >> v2:172.21.15.31:3300/0 conn(0x7fa720061680 msgr2=0x7fa7200b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:18.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa725d8e700 1 --2- 172.21.15.12:0/2699140031 >> v2:172.21.15.31:3300/0 conn(0x7fa720061680 0x7fa7200b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa725d8e700 1 -- 172.21.15.12:0/2699140031 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7200b6e50 con 0x7fa7200b4710 2021-10-20T23:23:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa725d8e700 1 --2- 172.21.15.12:0/2699140031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7200b4710 0x7fa7200ba200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fa710002f70 tx=0x7fa710006eb0).ready entity=mon.0 client_cookie=50348e6d94148d05 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa72558d700 1 -- 172.21.15.12:0/2699140031 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71000d570 con 0x7fa7200b4710 2021-10-20T23:23:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa72558d700 1 -- 172.21.15.12:0/2699140031 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa710000e90 con 0x7fa7200b4710 2021-10-20T23:23:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa72558d700 1 -- 172.21.15.12:0/2699140031 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71000d900 con 0x7fa7200b4710 2021-10-20T23:23:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 -- 172.21.15.12:0/2699140031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7200b4710 msgr2=0x7fa7200ba200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 --2- 172.21.15.12:0/2699140031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7200b4710 0x7fa7200ba200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fa710002f70 tx=0x7fa710006eb0).stop 2021-10-20T23:23:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 -- 172.21.15.12:0/2699140031 shutdown_connections 2021-10-20T23:23:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 --2- 172.21.15.12:0/2699140031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7201439a0 0x7fa72013fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 --2- 172.21.15.12:0/2699140031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7200b4710 0x7fa7200ba200 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 --2- 172.21.15.12:0/2699140031 >> v2:172.21.15.31:3300/0 conn(0x7fa720061680 0x7fa7200b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 -- 172.21.15.12:0/2699140031 >> 172.21.15.12:0/2699140031 conn(0x7fa72006adf0 msgr2=0x7fa72005f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 -- 172.21.15.12:0/2699140031 shutdown_connections 2021-10-20T23:23:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.338+0000 7fa727591700 1 -- 172.21.15.12:0/2699140031 wait complete. 2021-10-20T23:23:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 Processor -- start 2021-10-20T23:23:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 -- start start 2021-10-20T23:23:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa720061680 0x7fa720146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7201439a0 0x7fa7200af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7200b03d0 0x7fa72013ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa720145d60 con 0x7fa7201439a0 2021-10-20T23:23:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7200aefd0 con 0x7fa720061680 2021-10-20T23:23:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa720152e90 con 0x7fa7200b03d0 2021-10-20T23:23:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa725d8e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7201439a0 0x7fa7200af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa725d8e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7201439a0 0x7fa7200af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39182/0 (socket says 172.21.15.12:39182) 2021-10-20T23:23:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa725d8e700 1 -- 172.21.15.12:0/562761682 learned_addr learned my addr 172.21.15.12:0/562761682 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa72658f700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa720061680 0x7fa720146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa726d90700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7200b03d0 0x7fa72013ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa725d8e700 1 -- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7200b03d0 msgr2=0x7fa72013ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa725d8e700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7200b03d0 0x7fa72013ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa725d8e700 1 -- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa720061680 msgr2=0x7fa720146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa725d8e700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa720061680 0x7fa720146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa725d8e700 1 -- 172.21.15.12:0/562761682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71000b1e0 con 0x7fa7201439a0 2021-10-20T23:23:18.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa726d90700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7200b03d0 0x7fa72013ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:18.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa725d8e700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7201439a0 0x7fa7200af8b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fa710002f70 tx=0x7fa710015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:18.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa70f7fe700 1 -- 172.21.15.12:0/562761682 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa710011860 con 0x7fa7201439a0 2021-10-20T23:23:18.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa70f7fe700 1 -- 172.21.15.12:0/562761682 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7100119c0 con 0x7fa7201439a0 2021-10-20T23:23:18.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa70f7fe700 1 -- 172.21.15.12:0/562761682 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa710011d20 con 0x7fa7201439a0 2021-10-20T23:23:18.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa720153130 con 0x7fa7201439a0 2021-10-20T23:23:18.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.342+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa720144c10 con 0x7fa7201439a0 2021-10-20T23:23:18.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.346+0000 7fa70f7fe700 1 -- 172.21.15.12:0/562761682 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa710025030 con 0x7fa7201439a0 2021-10-20T23:23:18.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.346+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7201445d0 con 0x7fa7201439a0 2021-10-20T23:23:18.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.346+0000 7fa70f7fe700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa700053640 0x7fa700055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.346+0000 7fa70f7fe700 1 -- 172.21.15.12:0/562761682 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fa71006ca90 con 0x7fa7201439a0 2021-10-20T23:23:18.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.346+0000 7fa72658f700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa700053640 0x7fa700055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.346+0000 7fa72658f700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa700053640 0x7fa700055b00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa71c00c000 tx=0x7fa71c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:18.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.350+0000 7fa70f7fe700 1 -- 172.21.15.12:0/562761682 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa7201445d0 con 0x7fa7201439a0 2021-10-20T23:23:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.482+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa7201445d0 con 0x7fa7201439a0 2021-10-20T23:23:18.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.490+0000 7fa70f7fe700 1 -- 172.21.15.12:0/562761682 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7201445d0 con 0x7fa7201439a0 2021-10-20T23:23:18.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa700053640 msgr2=0x7fa700055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa700053640 0x7fa700055b00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa71c00c000 tx=0x7fa71c008040).stop 2021-10-20T23:23:18.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7201439a0 msgr2=0x7fa7200af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7201439a0 0x7fa7200af8b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fa710002f70 tx=0x7fa710015000).stop 2021-10-20T23:23:18.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 shutdown_connections 2021-10-20T23:23:18.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa700053640 0x7fa700055b00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7200b03d0 0x7fa72013ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7201439a0 0x7fa7200af8b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 --2- 172.21.15.12:0/562761682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa720061680 0x7fa720146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 >> 172.21.15.12:0/562761682 conn(0x7fa72006adf0 msgr2=0x7fa72013feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:18.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 shutdown_connections 2021-10-20T23:23:18.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.494+0000 7fa727591700 1 -- 172.21.15.12:0/562761682 wait complete. 2021-10-20T23:23:18.509 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:23:18.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:23:18.530 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:23:18.551 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:23:18.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:23:18.593 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:23:18.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:18.594 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:18.594 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:23:18.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:23:18.603 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:23:18.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:18.604 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:18.604 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:23:18.612 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:23:18.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:23:18.614 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:23:18.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:23:18.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe39b9eb700 1 Processor -- start 2021-10-20T23:23:18.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe39b9eb700 1 -- start start 2021-10-20T23:23:18.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe39b9eb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3940b6900 0x7fe3941447c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe39b9eb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 0x7fe39414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe39b9eb700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3940b6ce0 con 0x7fe3940aa080 2021-10-20T23:23:18.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe39b9eb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3940ac550 con 0x7fe3940b6900 2021-10-20T23:23:18.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe39b9eb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940ac7f0 con 0x7fe39405fdd0 2021-10-20T23:23:18.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe398f86700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe3940aa080 0x7fe394144cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37784/0 (socket says 172.21.15.12:37784) 2021-10-20T23:23:18.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe398f86700 1 -- 172.21.15.12:0/23757800 learned_addr learned my addr 172.21.15.12:0/23757800 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:18.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe399787700 1 --2- 172.21.15.12:0/23757800 >> v2:172.21.15.31:3300/0 conn(0x7fe3940b6900 0x7fe3941447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe399f88700 1 --2- 172.21.15.12:0/23757800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 0x7fe39414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe38bfff700 1 -- 172.21.15.12:0/23757800 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816571571 0 0) 0x7fe3940b6ce0 con 0x7fe3940aa080 2021-10-20T23:23:18.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe38bfff700 1 -- 172.21.15.12:0/23757800 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe380003260 con 0x7fe3940aa080 2021-10-20T23:23:18.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe399787700 1 -- 172.21.15.12:0/23757800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 msgr2=0x7fe39414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:18.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe399787700 1 --2- 172.21.15.12:0/23757800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 0x7fe39414abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe399787700 1 -- 172.21.15.12:0/23757800 >> v1:172.21.15.12:6789/0 conn(0x7fe3940aa080 legacy=0x7fe394144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe38bfff700 1 -- 172.21.15.12:0/23757800 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2805634225 0 0) 0x7fe380003260 con 0x7fe3940aa080 2021-10-20T23:23:18.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe399787700 1 -- 172.21.15.12:0/23757800 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3940aca90 con 0x7fe3940b6900 2021-10-20T23:23:18.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe399787700 1 --2- 172.21.15.12:0/23757800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 0x7fe3941447c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe38c001ba0 tx=0x7fe390006df0).ready entity=mon.1 client_cookie=78f4c1f9360482f0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:18.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe38bfff700 1 -- 172.21.15.12:0/23757800 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38c001a00 con 0x7fe3940b6900 2021-10-20T23:23:18.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe38bfff700 1 -- 172.21.15.12:0/23757800 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390000e90 con 0x7fe3940b6900 2021-10-20T23:23:18.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.722+0000 7fe38bfff700 1 -- 172.21.15.12:0/23757800 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe390012460 con 0x7fe3940b6900 2021-10-20T23:23:18.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 -- 172.21.15.12:0/23757800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 msgr2=0x7fe3941447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 --2- 172.21.15.12:0/23757800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 0x7fe3941447c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe38c001ba0 tx=0x7fe390006df0).stop 2021-10-20T23:23:18.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 -- 172.21.15.12:0/23757800 shutdown_connections 2021-10-20T23:23:18.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 --2- 172.21.15.12:0/23757800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 0x7fe39414abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 --2- 172.21.15.12:0/23757800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 0x7fe3941447c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 -- 172.21.15.12:0/23757800 >> 172.21.15.12:0/23757800 conn(0x7fe3940b3480 msgr2=0x7fe3940b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:18.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 -- 172.21.15.12:0/23757800 shutdown_connections 2021-10-20T23:23:18.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 -- 172.21.15.12:0/23757800 wait complete. 2021-10-20T23:23:18.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 Processor -- start 2021-10-20T23:23:18.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.726+0000 7fe39b9eb700 1 -- start start 2021-10-20T23:23:18.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe39b9eb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 0x7fe39414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe39b9eb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3940aa080 0x7fe394159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe39b9eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 0x7fe394146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe39b9eb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394145b40 con 0x7fe3940aa080 2021-10-20T23:23:18.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe39b9eb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394148700 con 0x7fe3940b6900 2021-10-20T23:23:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe39b9eb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39414ad30 con 0x7fe39405fdd0 2021-10-20T23:23:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe398f86700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3940aa080 0x7fe394159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe398f86700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3940aa080 0x7fe394159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39196/0 (socket says 172.21.15.12:39196) 2021-10-20T23:23:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe399787700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 0x7fe39414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe398f86700 1 -- 172.21.15.12:0/2841544494 learned_addr learned my addr 172.21.15.12:0/2841544494 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:18.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe399f88700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 0x7fe394146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe399f88700 1 -- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 msgr2=0x7fe39414cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe399f88700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 0x7fe39414cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe399f88700 1 -- 172.21.15.12:0/2841544494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3940aa080 msgr2=0x7fe394159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:18.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe399f88700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3940aa080 0x7fe394159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:18.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe399f88700 1 -- 172.21.15.12:0/2841544494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39000b180 con 0x7fe3940b6900 2021-10-20T23:23:18.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe398f86700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3940aa080 0x7fe394159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe399f88700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 0x7fe394146210 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe38400c000 tx=0x7fe384006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe38a7fc700 1 -- 172.21.15.12:0/2841544494 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe384011750 con 0x7fe3940b6900 2021-10-20T23:23:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe38a7fc700 1 -- 172.21.15.12:0/2841544494 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3840118b0 con 0x7fe3940b6900 2021-10-20T23:23:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe394145d70 con 0x7fe3940b6900 2021-10-20T23:23:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe38a7fc700 1 -- 172.21.15.12:0/2841544494 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe384011c10 con 0x7fe3940b6900 2021-10-20T23:23:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.730+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39414a9b0 con 0x7fe3940b6900 2021-10-20T23:23:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.734+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe394145f30 con 0x7fe3940b6900 2021-10-20T23:23:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.734+0000 7fe38a7fc700 1 -- 172.21.15.12:0/2841544494 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe384011d70 con 0x7fe3940b6900 2021-10-20T23:23:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.734+0000 7fe38a7fc700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3740534f0 0x7fe3740559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.734+0000 7fe38a7fc700 1 -- 172.21.15.12:0/2841544494 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe38406bb20 con 0x7fe3940b6900 2021-10-20T23:23:18.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.734+0000 7fe399787700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3740534f0 0x7fe3740559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:18.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.734+0000 7fe399787700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3740534f0 0x7fe3740559b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe39001a000 tx=0x7fe390014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:18.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.746+0000 7fe38a7fc700 1 -- 172.21.15.12:0/2841544494 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe38406de60 con 0x7fe3940b6900 2021-10-20T23:23:18.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.874+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe3940acd30 con 0x7fe3940b6900 2021-10-20T23:23:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.878+0000 7fe38a7fc700 1 -- 172.21.15.12:0/2841544494 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+29219 (secure 0 0 0) 0x7fe384042cf0 con 0x7fe3940b6900 2021-10-20T23:23:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:18.882 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:23:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 51, 2021-10-20T23:23:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:23:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:23:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:23:16.180073+0000", 2021-10-20T23:23:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:23:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:23:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:23:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:23:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:23:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:23:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:23:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:23:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:23:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:23:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:23:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:23:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:23:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:23:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:23:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 8, 2021-10-20T23:23:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:23:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:23:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:23:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:23:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:23:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:23:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:23:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:23:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:23:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:23:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:23:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:23:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:23:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:23:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:23:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:23:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:23:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:23:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:23:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:23:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:23:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:23:18.893 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:23:18.893 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:23:18.893 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:23:18.893 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:23:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:23:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:23:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:23:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:23:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:23:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:23:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:23:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:23:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:23:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:23:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:23:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:23:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:23:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:23:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:23:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:23:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:23:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:23:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:23:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:23:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:23:18.900 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:23:18.900 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:23:18.900 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:23:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:23:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:23:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:23:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:23:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:23:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:23:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:23:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:23:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:23:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:23:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:23:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:23:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:23:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:23:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:23:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:23:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:23:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:23:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:23:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:23:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:23:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:23:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:23:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:23:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:23:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:23:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:23:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:23:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:23:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:23:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:23:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:23:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:23:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:23:18.910 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:23:18.910 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:23:18.910 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:23:18.910 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:23:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:23:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:23:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:23:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:23:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:23:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:23:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:23:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:23:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:23:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:23:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:23:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:23:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:23:18.915 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:23:18.915 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:23:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:23:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:23:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:23:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:23:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:23:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:23:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:23:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:23:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:23:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:23:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:23:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:23:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:23:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:23:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:23:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:23:18.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:23:18.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.920 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:23:18.920 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:23:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:23:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:23:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:23:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:23:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:23:18.922 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:23:18.922 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:23:18.922 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:23:18.922 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:23:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:23:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:23:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:23:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:23:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:23:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:23:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:23:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:18.927 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:18.927 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:18.927 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:18.927 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:23:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:18.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.929 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:23:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:23:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:23:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:23:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:23:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:23:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:23:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:23:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:23:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:23:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:23:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:23:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:23:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:23:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 46, 2021-10-20T23:23:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:18.947 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:18.947 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.948 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:23:18.949 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:23:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:23:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.954 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:23:18.954 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:18.954 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.955 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.955 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:18.955 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:23:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.957 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:23:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:23:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:23:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:23:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:23:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:23:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:23:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:23:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:18.965 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:18.965 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.965 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:23:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:23:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 33, 2021-10-20T23:23:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:23:18.975 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:18.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:23:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.977 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.977 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:18.977 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:23:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:23:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.982 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:23:18.982 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:18.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.983 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:23:18.984 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:18.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.984 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.985 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:23:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:23:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:23:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:23:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:23:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:23:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:23:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:23:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:23:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:18.993 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:18.993 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:18.993 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:18.993 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:23:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:23:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:18.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:18.999 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:23:18.999 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:18.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:23:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:23:19.003 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:19.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.003 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:23:19.004 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:19.004 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.004 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.005 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:19.005 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.005 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:23:19.006 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:19.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:23:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:23:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:23:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:23:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:23:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:23:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:23:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:23:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:23:19.014 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:19.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.015 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:23:19.015 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:19.015 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.015 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.016 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:19.016 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:23:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:23:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:23:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:23:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:23:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.024 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:23:19.024 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:23:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:23:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:23:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:23:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:23:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:23:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:23:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:23:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:23:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.034 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:23:19.034 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:19.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:23:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:23:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:23:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:23:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:19.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.041 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:23:19.041 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:23:19.042 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.042 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.042 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:23:19.043 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:23:19.043 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:23:19.043 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:23:19.043 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:23:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:23:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2021-10-20T23:23:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:23:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:23:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:23:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:23:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:23:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:23:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.058 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:23:19.058 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:19.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:23:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:23:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:23:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:23:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:23:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:23:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.062 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:23:19.062 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:23:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:23:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:23:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:23:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:23:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:23:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:23:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:23:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 44, 2021-10-20T23:23:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:23:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:23:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:23:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:23:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:23:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:23:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.069 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:23:19.069 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:19.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.070 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:23:19.070 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:19.070 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.071 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.071 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:23:19.071 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:23:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:23:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:23:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:23:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:23:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:23:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:23:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:23:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:23:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:23:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:23:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:23:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:23:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:23:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:23:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:23:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:23:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:23:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:23:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:23:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:23:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:23:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:23:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:23:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:23:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:23:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:19.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.090 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:23:19.090 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:23:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:23:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:23:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:23:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:23:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:23:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:23:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:23:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:23:19.098 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:23:19.098 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:23:19.098 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:23:19.098 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:23:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:23:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:23:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:23:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:23:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:23:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:23:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.31:6835/2510327912": "2021-10-21T23:23:12.178450+0000", 2021-10-20T23:23:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.31:6834/2510327912": "2021-10-21T23:23:12.178450+0000" 2021-10-20T23:23:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:23:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:23:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:23:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:23:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:23:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:23:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:23:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:23:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:23:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:23:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:23:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:23:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:23:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:23:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:23:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:23:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:23:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:23:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:23:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:23:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:23:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:23:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:23:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:23:19.107 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:23:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3740534f0 msgr2=0x7fe3740559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3740534f0 0x7fe3740559b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe39001a000 tx=0x7fe390014000).stop 2021-10-20T23:23:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 msgr2=0x7fe394146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 0x7fe394146210 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe38400c000 tx=0x7fe384006df0).stop 2021-10-20T23:23:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 shutdown_connections 2021-10-20T23:23:19.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3740534f0 0x7fe3740559b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3940b6900 0x7fe394146210 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3940aa080 0x7fe394159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 --2- 172.21.15.12:0/2841544494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe39405fdd0 0x7fe39414cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 >> 172.21.15.12:0/2841544494 conn(0x7fe3940b3480 msgr2=0x7fe3940b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:19.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 shutdown_connections 2021-10-20T23:23:19.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:18.882+0000 7fe39b9eb700 1 -- 172.21.15.12:0/2841544494 wait complete. 2021-10-20T23:23:19.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:19.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1bd7da700 1 Processor -- start 2021-10-20T23:23:19.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1bd7da700 1 -- start start 2021-10-20T23:23:19.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1bd7da700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1b80b3000 0x7fd1b80b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1bd7da700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1b80a9c10 0x7fd1b8147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1bd7da700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80b33e0 con 0x7fd1b80b18f0 2021-10-20T23:23:19.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1bd7da700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80b27f0 con 0x7fd1b80b3000 2021-10-20T23:23:19.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1bd7da700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80b0c70 con 0x7fd1b80a9c10 2021-10-20T23:23:19.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1b80b3000 0x7fd1b80b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1b80b3000 0x7fd1b80b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39202/0 (socket says 172.21.15.12:39202) 2021-10-20T23:23:19.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b7fff700 1 -- 172.21.15.12:0/3090578043 learned_addr learned my addr 172.21.15.12:0/3090578043 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:19.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1bcfd9700 1 --2- 172.21.15.12:0/3090578043 >> v2:172.21.15.31:3300/0 conn(0x7fd1b80a9c10 0x7fd1b8147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b7fff700 1 -- 172.21.15.12:0/3090578043 >> v2:172.21.15.31:3300/0 conn(0x7fd1b80a9c10 msgr2=0x7fd1b8147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:19.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b7fff700 1 --2- 172.21.15.12:0/3090578043 >> v2:172.21.15.31:3300/0 conn(0x7fd1b80a9c10 0x7fd1b8147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b7fff700 1 -- 172.21.15.12:0/3090578043 >> v1:172.21.15.31:6789/0 conn(0x7fd1b80b18f0 legacy=0x7fd1b8065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b7fff700 1 -- 172.21.15.12:0/3090578043 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80b0f10 con 0x7fd1b80b3000 2021-10-20T23:23:19.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b7fff700 1 --2- 172.21.15.12:0/3090578043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80b3000 0x7fd1b80b2300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fd1a8002f70 tx=0x7fd1a8006eb0).ready entity=mon.0 client_cookie=fabf95fa05241b9b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:19.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b6ffd700 1 -- 172.21.15.12:0/3090578043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1a800d5c0 con 0x7fd1b80b3000 2021-10-20T23:23:19.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b6ffd700 1 -- 172.21.15.12:0/3090578043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a8000e90 con 0x7fd1b80b3000 2021-10-20T23:23:19.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.226+0000 7fd1b6ffd700 1 -- 172.21.15.12:0/3090578043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1a800d950 con 0x7fd1b80b3000 2021-10-20T23:23:19.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 -- 172.21.15.12:0/3090578043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80b3000 msgr2=0x7fd1b80b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 --2- 172.21.15.12:0/3090578043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80b3000 0x7fd1b80b2300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fd1a8002f70 tx=0x7fd1a8006eb0).stop 2021-10-20T23:23:19.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 -- 172.21.15.12:0/3090578043 shutdown_connections 2021-10-20T23:23:19.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 --2- 172.21.15.12:0/3090578043 >> v2:172.21.15.31:3300/0 conn(0x7fd1b80a9c10 0x7fd1b8147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 --2- 172.21.15.12:0/3090578043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80b3000 0x7fd1b80b2300 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 -- 172.21.15.12:0/3090578043 >> 172.21.15.12:0/3090578043 conn(0x7fd1b80636e0 msgr2=0x7fd1b8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 -- 172.21.15.12:0/3090578043 shutdown_connections 2021-10-20T23:23:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 -- 172.21.15.12:0/3090578043 wait complete. 2021-10-20T23:23:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 Processor -- start 2021-10-20T23:23:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 -- start start 2021-10-20T23:23:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80a9c10 0x7fd1b80af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1b80b18f0 0x7fd1b8149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b80b3000 0x7fd1b80afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80abb20 con 0x7fd1b80a9c10 2021-10-20T23:23:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80abdc0 con 0x7fd1b80b3000 2021-10-20T23:23:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bd7da700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80aefd0 con 0x7fd1b80b18f0 2021-10-20T23:23:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80a9c10 0x7fd1b80af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80a9c10 0x7fd1b80af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39208/0 (socket says 172.21.15.12:39208) 2021-10-20T23:23:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1bcfd9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b80b3000 0x7fd1b80afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1b7fff700 1 -- 172.21.15.12:0/1895468697 learned_addr learned my addr 172.21.15.12:0/1895468697 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.230+0000 7fd1b77fe700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1b80b18f0 0x7fd1b8149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b7fff700 1 -- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1b80b18f0 msgr2=0x7fd1b8149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b7fff700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1b80b18f0 0x7fd1b8149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b7fff700 1 -- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b80b3000 msgr2=0x7fd1b80afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b7fff700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b80b3000 0x7fd1b80afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b7fff700 1 -- 172.21.15.12:0/1895468697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a800b1e0 con 0x7fd1b80a9c10 2021-10-20T23:23:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b7fff700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80a9c10 0x7fd1b80af710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fd1a8002f70 tx=0x7fd1a8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b57fa700 1 -- 172.21.15.12:0/1895468697 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1a8011760 con 0x7fd1b80a9c10 2021-10-20T23:23:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b57fa700 1 -- 172.21.15.12:0/1895468697 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a80118c0 con 0x7fd1b80a9c10 2021-10-20T23:23:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b57fa700 1 -- 172.21.15.12:0/1895468697 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1a8011c20 con 0x7fd1b80a9c10 2021-10-20T23:23:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b80af270 con 0x7fd1b80a9c10 2021-10-20T23:23:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b814a110 con 0x7fd1b80a9c10 2021-10-20T23:23:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b8057350 con 0x7fd1b80a9c10 2021-10-20T23:23:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b57fa700 1 -- 172.21.15.12:0/1895468697 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd1a801a040 con 0x7fd1b80a9c10 2021-10-20T23:23:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b57fa700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd19c053580 0x7fd19c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.234+0000 7fd1b57fa700 1 -- 172.21.15.12:0/1895468697 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fd1a806c550 con 0x7fd1b80a9c10 2021-10-20T23:23:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.238+0000 7fd1b77fe700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd19c053580 0x7fd19c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.238+0000 7fd1b77fe700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd19c053580 0x7fd19c055a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fd1a000d000 tx=0x7fd1a0007f10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:19.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.242+0000 7fd1b57fa700 1 -- 172.21.15.12:0/1895468697 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1a8047260 con 0x7fd1b80a9c10 2021-10-20T23:23:19.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.406+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1b80698e0 con 0x7fd1b80a9c10 2021-10-20T23:23:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.406+0000 7fd1b57fa700 1 -- 172.21.15.12:0/1895468697 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fd1a8023090 con 0x7fd1b80a9c10 2021-10-20T23:23:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:19.411 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2773732661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2773732661},{"type":"v1","addr":"172.21.15.31:6835","nonce":2773732661}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":21}],"filesystems":[]} 2021-10-20T23:23:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd19c053580 msgr2=0x7fd19c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd19c053580 0x7fd19c055a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fd1a000d000 tx=0x7fd1a0007f10).stop 2021-10-20T23:23:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80a9c10 msgr2=0x7fd1b80af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80a9c10 0x7fd1b80af710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fd1a8002f70 tx=0x7fd1a8015000).stop 2021-10-20T23:23:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 shutdown_connections 2021-10-20T23:23:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd19c053580 0x7fd19c055a40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b80b3000 0x7fd1b80afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1b80b18f0 0x7fd1b8149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 --2- 172.21.15.12:0/1895468697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1b80a9c10 0x7fd1b80af710 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 >> 172.21.15.12:0/1895468697 conn(0x7fd1b80636e0 msgr2=0x7fd1b80b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:19.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 shutdown_connections 2021-10-20T23:23:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.410+0000 7fd1bd7da700 1 -- 172.21.15.12:0/1895468697 wait complete. 2021-10-20T23:23:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 21 2021-10-20T23:23:19.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:19.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f3992cf3700 1 Processor -- start 2021-10-20T23:23:19.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f3992cf3700 1 -- start start 2021-10-20T23:23:19.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f3992cf3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b00e0 0x7f398c142e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f3992cf3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f398c0ac6f0 0x7f398c143360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f3992cf3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c067880 con 0x7f398c0b2580 2021-10-20T23:23:19.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f3992cf3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c0ad5b0 con 0x7f398c0ac6f0 2021-10-20T23:23:19.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f3992cf3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c067b20 con 0x7f398c0b00e0 2021-10-20T23:23:19.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f39924f2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f398c0ac6f0 0x7f398c143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f39924f2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f398c0ac6f0 0x7f398c143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39220/0 (socket says 172.21.15.12:39220) 2021-10-20T23:23:19.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f39924f2700 1 -- 172.21.15.12:0/1048291058 learned_addr learned my addr 172.21.15.12:0/1048291058 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:19.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.526+0000 7f39914f0700 1 --2- 172.21.15.12:0/1048291058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b00e0 0x7f398c142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f39924f2700 1 -- 172.21.15.12:0/1048291058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b00e0 msgr2=0x7f398c142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:19.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f39924f2700 1 --2- 172.21.15.12:0/1048291058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b00e0 0x7f398c142e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f39924f2700 1 -- 172.21.15.12:0/1048291058 >> v1:172.21.15.31:6789/0 conn(0x7f398c0b2580 legacy=0x7f398c140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f39924f2700 1 -- 172.21.15.12:0/1048291058 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c146fd0 con 0x7f398c0ac6f0 2021-10-20T23:23:19.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f39924f2700 1 --2- 172.21.15.12:0/1048291058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0ac6f0 0x7f398c143360 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f39840032f0 tx=0x7f3984009290).ready entity=mon.0 client_cookie=f6e9ecfe93e88c79 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:19.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3990cef700 1 -- 172.21.15.12:0/1048291058 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398400b8a0 con 0x7f398c0ac6f0 2021-10-20T23:23:19.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3990cef700 1 -- 172.21.15.12:0/1048291058 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400ba00 con 0x7f398c0ac6f0 2021-10-20T23:23:19.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3990cef700 1 -- 172.21.15.12:0/1048291058 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398400bb70 con 0x7f398c0ac6f0 2021-10-20T23:23:19.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 -- 172.21.15.12:0/1048291058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0ac6f0 msgr2=0x7f398c143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 --2- 172.21.15.12:0/1048291058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0ac6f0 0x7f398c143360 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f39840032f0 tx=0x7f3984009290).stop 2021-10-20T23:23:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 -- 172.21.15.12:0/1048291058 shutdown_connections 2021-10-20T23:23:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 --2- 172.21.15.12:0/1048291058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0ac6f0 0x7f398c143360 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 --2- 172.21.15.12:0/1048291058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b00e0 0x7f398c142e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 -- 172.21.15.12:0/1048291058 >> 172.21.15.12:0/1048291058 conn(0x7f398c060180 msgr2=0x7f398c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 -- 172.21.15.12:0/1048291058 shutdown_connections 2021-10-20T23:23:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 -- 172.21.15.12:0/1048291058 wait complete. 2021-10-20T23:23:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 Processor -- start 2021-10-20T23:23:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 -- start start 2021-10-20T23:23:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.530+0000 7f3992cf3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f398c0ac6f0 0x7f398c1465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f3992cf3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0b00e0 0x7f398c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f3992cf3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b2580 0x7f398c141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f3992cf3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0ac0c0 con 0x7f398c0b00e0 2021-10-20T23:23:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f3992cf3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0ac360 con 0x7f398c0ac6f0 2021-10-20T23:23:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f3992cf3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c140d10 con 0x7f398c0b2580 2021-10-20T23:23:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39914f0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0b00e0 0x7f398c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39914f0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0b00e0 0x7f398c155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39222/0 (socket says 172.21.15.12:39222) 2021-10-20T23:23:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39914f0700 1 -- 172.21.15.12:0/264251343 learned_addr learned my addr 172.21.15.12:0/264251343 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39924f2700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b2580 0x7f398c141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f3991cf1700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f398c0ac6f0 0x7f398c1465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39914f0700 1 -- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b2580 msgr2=0x7f398c141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39914f0700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b2580 0x7f398c141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39914f0700 1 -- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f398c0ac6f0 msgr2=0x7f398c1465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39914f0700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f398c0ac6f0 0x7f398c1465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39914f0700 1 -- 172.21.15.12:0/264251343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3984009530 con 0x7f398c0b00e0 2021-10-20T23:23:19.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f39914f0700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0b00e0 0x7f398c155990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f398800c000 tx=0x7f3988006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:19.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f397affd700 1 -- 172.21.15.12:0/264251343 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3988010780 con 0x7f398c0b00e0 2021-10-20T23:23:19.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f397affd700 1 -- 172.21.15.12:0/264251343 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39880108e0 con 0x7f398c0b00e0 2021-10-20T23:23:19.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c140fb0 con 0x7f398c0b00e0 2021-10-20T23:23:19.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f397affd700 1 -- 172.21.15.12:0/264251343 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3988010c40 con 0x7f398c0b00e0 2021-10-20T23:23:19.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c141940 con 0x7f398c0b00e0 2021-10-20T23:23:19.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c141140 con 0x7f398c0b00e0 2021-10-20T23:23:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f397affd700 1 -- 172.21.15.12:0/264251343 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f398801c460 con 0x7f398c0b00e0 2021-10-20T23:23:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f397affd700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f396c053610 0x7f396c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.534+0000 7f397affd700 1 -- 172.21.15.12:0/264251343 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f398806bcf0 con 0x7f398c0b00e0 2021-10-20T23:23:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.538+0000 7f3991cf1700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f396c053610 0x7f396c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.538+0000 7f3991cf1700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f396c053610 0x7f396c055ad0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f397c00b000 tx=0x7f397c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:19.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.542+0000 7f397affd700 1 -- 172.21.15.12:0/264251343 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3988046e60 con 0x7f398c0b00e0 2021-10-20T23:23:19.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f398c057350 con 0x7f398c0b00e0 2021-10-20T23:23:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f397affd700 1 -- 172.21.15.12:0/264251343 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f3988042f70 con 0x7f398c0b00e0 2021-10-20T23:23:19.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:19.714 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3190901993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3190901993},{"type":"v1","addr":"172.21.15.12:6833","nonce":3190901993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2673649587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2673649587},{"type":"v1","addr":"172.21.15.12:6835","nonce":2673649587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2773732661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2773732661},{"type":"v1","addr":"172.21.15.31:6835","nonce":2773732661}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":21}],"filesystems":[]} 2021-10-20T23:23:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f396c053610 msgr2=0x7f396c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f396c053610 0x7f396c055ad0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f397c00b000 tx=0x7f397c009040).stop 2021-10-20T23:23:19.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0b00e0 msgr2=0x7f398c155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0b00e0 0x7f398c155990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f398800c000 tx=0x7f3988006df0).stop 2021-10-20T23:23:19.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 shutdown_connections 2021-10-20T23:23:19.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f396c053610 0x7f396c055ad0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f398c0b2580 0x7f398c141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f398c0b00e0 0x7f398c155990 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 --2- 172.21.15.12:0/264251343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f398c0ac6f0 0x7f398c1465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.710+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 >> 172.21.15.12:0/264251343 conn(0x7f398c060180 msgr2=0x7f398c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:19.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.714+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 shutdown_connections 2021-10-20T23:23:19.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.714+0000 7f3992cf3700 1 -- 172.21.15.12:0/264251343 wait complete. 2021-10-20T23:23:19.721 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 21 2021-10-20T23:23:19.728 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:23:19.728 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:23:19.729 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:23:19.729 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:23:19.729 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:23:19.729 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:23:19.730 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:23:19.730 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:23:19.730 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:23:19.731 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:23:19.731 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:23:19.732 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:23:19.746 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:23:19.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:23:19.748 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:23:19.749 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:23:19.750 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:23:19.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:23:19.759 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:23:19.760 DEBUG:teuthology.parallel:result is None 2021-10-20T23:23:19.794 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:23:19.795 DEBUG:teuthology.parallel:result is None 2021-10-20T23:23:19.796 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:23:19.797 DEBUG:teuthology.parallel:result is None 2021-10-20T23:23:19.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:23:19.828 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:23:19.869 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:23:19.873 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:23:19.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f730944d700 1 Processor -- start 2021-10-20T23:23:19.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f730944d700 1 -- start start 2021-10-20T23:23:19.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f730944d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7304061320 0x7f7304061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f730944d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7304140440 0x7f73041408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f730944d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73040aecf0 con 0x7f73040ad5c0 2021-10-20T23:23:19.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f730944d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040b6f20 con 0x7f7304140440 2021-10-20T23:23:19.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f730944d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040aef20 con 0x7f7304061320 2021-10-20T23:23:19.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7308c4c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7304140440 0x7f73041408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7308c4c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7304140440 0x7f73041408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39256/0 (socket says 172.21.15.12:39256) 2021-10-20T23:23:19.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7308c4c700 1 -- 172.21.15.12:0/2856065354 learned_addr learned my addr 172.21.15.12:0/2856065354 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:19.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7303fff700 1 --2- 172.21.15.12:0/2856065354 >> v2:172.21.15.31:3300/0 conn(0x7f7304061320 0x7f7304061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7308c4c700 1 -- 172.21.15.12:0/2856065354 >> v2:172.21.15.31:3300/0 conn(0x7f7304061320 msgr2=0x7f7304061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:19.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7308c4c700 1 --2- 172.21.15.12:0/2856065354 >> v2:172.21.15.31:3300/0 conn(0x7f7304061320 0x7f7304061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7308c4c700 1 -- 172.21.15.12:0/2856065354 >> v1:172.21.15.31:6789/0 conn(0x7f73040ad5c0 legacy=0x7f73040b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7308c4c700 1 -- 172.21.15.12:0/2856065354 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040af1c0 con 0x7f7304140440 2021-10-20T23:23:19.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7308c4c700 1 --2- 172.21.15.12:0/2856065354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 0x7f73041408d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f73040aeba0 tx=0x7f72f8006eb0).ready entity=mon.0 client_cookie=4c17bf97a5e93cf1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:19.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7302ffd700 1 -- 172.21.15.12:0/2856065354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f800d610 con 0x7f7304140440 2021-10-20T23:23:19.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7302ffd700 1 -- 172.21.15.12:0/2856065354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8000e90 con 0x7f7304140440 2021-10-20T23:23:19.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.902+0000 7f7302ffd700 1 -- 172.21.15.12:0/2856065354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f800d960 con 0x7f7304140440 2021-10-20T23:23:19.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 -- 172.21.15.12:0/2856065354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 msgr2=0x7f73041408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 --2- 172.21.15.12:0/2856065354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 0x7f73041408d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f73040aeba0 tx=0x7f72f8006eb0).stop 2021-10-20T23:23:19.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 -- 172.21.15.12:0/2856065354 shutdown_connections 2021-10-20T23:23:19.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 --2- 172.21.15.12:0/2856065354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 0x7f73041408d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 --2- 172.21.15.12:0/2856065354 >> v2:172.21.15.31:3300/0 conn(0x7f7304061320 0x7f7304061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 -- 172.21.15.12:0/2856065354 >> 172.21.15.12:0/2856065354 conn(0x7f7304066de0 msgr2=0x7f73040671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:19.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 -- 172.21.15.12:0/2856065354 shutdown_connections 2021-10-20T23:23:19.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 -- 172.21.15.12:0/2856065354 wait complete. 2021-10-20T23:23:19.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 Processor -- start 2021-10-20T23:23:19.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.906+0000 7f730944d700 1 -- start start 2021-10-20T23:23:19.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f730944d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304061320 0x7f73040afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f730944d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73040ad5c0 0x7f73040b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f730944d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 0x7f73040b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f730944d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73040b2e50 con 0x7f7304140440 2021-10-20T23:23:19.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f730944d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7304152e60 con 0x7f7304061320 2021-10-20T23:23:19.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f730944d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730409e950 con 0x7f73040ad5c0 2021-10-20T23:23:19.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7308c4c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 0x7f73040b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7308c4c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 0x7f73040b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39264/0 (socket says 172.21.15.12:39264) 2021-10-20T23:23:19.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7308c4c700 1 -- 172.21.15.12:0/3562137478 learned_addr learned my addr 172.21.15.12:0/3562137478 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:19.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7303fff700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304061320 0x7f73040afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f73037fe700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73040ad5c0 0x7f73040b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7308c4c700 1 -- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73040ad5c0 msgr2=0x7f73040b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7308c4c700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73040ad5c0 0x7f73040b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7308c4c700 1 -- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304061320 msgr2=0x7f73040afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:19.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7308c4c700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304061320 0x7f73040afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:19.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7308c4c700 1 -- 172.21.15.12:0/3562137478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f800b1e0 con 0x7f7304140440 2021-10-20T23:23:19.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f7308c4c700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 0x7f73040b1680 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f73040aeba0 tx=0x7f72f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:19.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f73017fa700 1 -- 172.21.15.12:0/3562137478 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f800d990 con 0x7f7304140440 2021-10-20T23:23:19.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73041530b0 con 0x7f7304140440 2021-10-20T23:23:19.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f73017fa700 1 -- 172.21.15.12:0/3562137478 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8002f70 con 0x7f7304140440 2021-10-20T23:23:19.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f73017fa700 1 -- 172.21.15.12:0/3562137478 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f8011d70 con 0x7f7304140440 2021-10-20T23:23:19.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.910+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73040b0a40 con 0x7f7304140440 2021-10-20T23:23:19.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.914+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730409ea90 con 0x7f7304140440 2021-10-20T23:23:19.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.914+0000 7f73017fa700 1 -- 172.21.15.12:0/3562137478 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f72f8025030 con 0x7f7304140440 2021-10-20T23:23:19.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.914+0000 7f73017fa700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72e40534f0 0x7f72e40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:19.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.914+0000 7f73017fa700 1 -- 172.21.15.12:0/3562137478 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f72f806c910 con 0x7f7304140440 2021-10-20T23:23:19.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.914+0000 7f7303fff700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72e40534f0 0x7f72e40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:19.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.914+0000 7f7303fff700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72e40534f0 0x7f72e40559b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f72f400c000 tx=0x7f72f4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:19.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:19.922+0000 7f73017fa700 1 -- 172.21.15.12:0/3562137478 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72f8043a60 con 0x7f7304140440 2021-10-20T23:23:20.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.066+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f730409ed60 con 0x7f7304140440 2021-10-20T23:23:20.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.902+0000 7f73017fa700 1 -- 172.21.15.12:0/3562137478 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7f72f8023020 con 0x7f7304140440 2021-10-20T23:23:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72e40534f0 msgr2=0x7f72e40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72e40534f0 0x7f72e40559b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f72f400c000 tx=0x7f72f4008040).stop 2021-10-20T23:23:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 msgr2=0x7f73040b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 0x7f73040b1680 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f73040aeba0 tx=0x7f72f8015000).stop 2021-10-20T23:23:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 shutdown_connections 2021-10-20T23:23:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72e40534f0 0x7f72e40559b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7304140440 0x7f73040b1680 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73040ad5c0 0x7f73040b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 --2- 172.21.15.12:0/3562137478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304061320 0x7f73040afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 >> 172.21.15.12:0/3562137478 conn(0x7f7304066de0 msgr2=0x7f73040b86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 shutdown_connections 2021-10-20T23:23:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:20.906+0000 7f730944d700 1 -- 172.21.15.12:0/3562137478 wait complete. 2021-10-20T23:23:20.912 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:23:20.924 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:23:20.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:23:21.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.030+0000 7f0d11671700 1 Processor -- start 2021-10-20T23:23:21.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.030+0000 7f0d11671700 1 -- start start 2021-10-20T23:23:21.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d11671700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d0c060910 0x7f0d0c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d11671700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c0b6ce0 con 0x7f0d0c0b6900 2021-10-20T23:23:21.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d11671700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c0611e0 con 0x7f0d0c0aa5d0 2021-10-20T23:23:21.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d11671700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c061480 con 0x7f0d0c060910 2021-10-20T23:23:21.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d0affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0d0c0b6900 0x7f0d0c0a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37864/0 (socket says 172.21.15.12:37864) 2021-10-20T23:23:21.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d0affd700 1 -- 172.21.15.12:0/3721809057 learned_addr learned my addr 172.21.15.12:0/3721809057 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:21.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d03fff700 1 --2- 172.21.15.12:0/3721809057 >> v2:172.21.15.31:3300/0 conn(0x7f0d0c060910 0x7f0d0c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d0a7fc700 1 -- 172.21.15.12:0/3721809057 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448716249 0 0) 0x7f0d0c0b6ce0 con 0x7f0d0c0b6900 2021-10-20T23:23:21.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d0a7fc700 1 -- 172.21.15.12:0/3721809057 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cec003260 con 0x7f0d0c0b6900 2021-10-20T23:23:21.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d0a7fc700 1 -- 172.21.15.12:0/3721809057 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086147073 0 0) 0x7f0d0c0611e0 con 0x7f0d0c0aa5d0 2021-10-20T23:23:21.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d0a7fc700 1 -- 172.21.15.12:0/3721809057 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d0c0b6ce0 con 0x7f0d0c0aa5d0 2021-10-20T23:23:21.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d03fff700 1 -- 172.21.15.12:0/3721809057 >> v1:172.21.15.31:6789/0 conn(0x7f0d0c0aa5d0 legacy=0x7f0d0c13c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d03fff700 1 -- 172.21.15.12:0/3721809057 >> v1:172.21.15.12:6789/0 conn(0x7f0d0c0b6900 legacy=0x7f0d0c0a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d03fff700 1 -- 172.21.15.12:0/3721809057 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c061720 con 0x7f0d0c060910 2021-10-20T23:23:21.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d03fff700 1 --2- 172.21.15.12:0/3721809057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d0c060910 0x7f0d0c0acd50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f0cf4002f70 tx=0x7f0cf4006df0).ready entity=mon.1 client_cookie=cd69ad5f74475f4c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d0a7fc700 1 -- 172.21.15.12:0/3721809057 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf400e840 con 0x7f0d0c060910 2021-10-20T23:23:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d0a7fc700 1 -- 172.21.15.12:0/3721809057 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4000e90 con 0x7f0d0c060910 2021-10-20T23:23:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.034+0000 7f0d0a7fc700 1 -- 172.21.15.12:0/3721809057 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf400eb90 con 0x7f0d0c060910 2021-10-20T23:23:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.038+0000 7f0d11671700 1 -- 172.21.15.12:0/3721809057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d0c060910 msgr2=0x7f0d0c0acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.038+0000 7f0d11671700 1 --2- 172.21.15.12:0/3721809057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d0c060910 0x7f0d0c0acd50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f0cf4002f70 tx=0x7f0cf4006df0).stop 2021-10-20T23:23:21.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.038+0000 7f0d11671700 1 -- 172.21.15.12:0/3721809057 shutdown_connections 2021-10-20T23:23:21.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.038+0000 7f0d11671700 1 --2- 172.21.15.12:0/3721809057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d0c060910 0x7f0d0c0acd50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.038+0000 7f0d11671700 1 -- 172.21.15.12:0/3721809057 >> 172.21.15.12:0/3721809057 conn(0x7f0d0c0b3480 msgr2=0x7f0d0c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:21.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.038+0000 7f0d11671700 1 -- 172.21.15.12:0/3721809057 shutdown_connections 2021-10-20T23:23:21.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.038+0000 7f0d11671700 1 -- 172.21.15.12:0/3721809057 wait complete. 2021-10-20T23:23:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.038+0000 7f0d11671700 1 Processor -- start 2021-10-20T23:23:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.038+0000 7f0d11671700 1 -- start start 2021-10-20T23:23:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d11671700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d0c060910 0x7f0d0c064080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d11671700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d0c0aa5d0 0x7f0d0c138000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d11671700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c0b6900 0x7f0d0c1384f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d11671700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0aea60 con 0x7f0d0c0b6900 2021-10-20T23:23:21.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d11671700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0afbb0 con 0x7f0d0c0aa5d0 2021-10-20T23:23:21.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d11671700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0af370 con 0x7f0d0c060910 2021-10-20T23:23:21.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c0b6900 0x7f0d0c1384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c0b6900 0x7f0d0c1384f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39280/0 (socket says 172.21.15.12:39280) 2021-10-20T23:23:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0b7fe700 1 -- 172.21.15.12:0/2949870590 learned_addr learned my addr 172.21.15.12:0/2949870590 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0affd700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d0c060910 0x7f0d0c064080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d03fff700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d0c0aa5d0 0x7f0d0c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0b7fe700 1 -- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d0c060910 msgr2=0x7f0d0c064080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0b7fe700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d0c060910 0x7f0d0c064080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0b7fe700 1 -- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d0c0aa5d0 msgr2=0x7f0d0c138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0b7fe700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d0c0aa5d0 0x7f0d0c138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0b7fe700 1 -- 172.21.15.12:0/2949870590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf400b180 con 0x7f0d0c0b6900 2021-10-20T23:23:21.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d0b7fe700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c0b6900 0x7f0d0c1384f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f0d0c0658e0 tx=0x7f0d04007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d08ff9700 1 -- 172.21.15.12:0/2949870590 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d04002500 con 0x7f0d0c0b6900 2021-10-20T23:23:21.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d08ff9700 1 -- 172.21.15.12:0/2949870590 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d04001650 con 0x7f0d0c0b6900 2021-10-20T23:23:21.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0c0afde0 con 0x7f0d0c0b6900 2021-10-20T23:23:21.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d08ff9700 1 -- 172.21.15.12:0/2949870590 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d040019b0 con 0x7f0d0c0b6900 2021-10-20T23:23:21.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.042+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c066350 con 0x7f0d0c0b6900 2021-10-20T23:23:21.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.046+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0c0acb40 con 0x7f0d0c0b6900 2021-10-20T23:23:21.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.046+0000 7f0d08ff9700 1 -- 172.21.15.12:0/2949870590 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d04001b10 con 0x7f0d0c0b6900 2021-10-20T23:23:21.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.046+0000 7f0d08ff9700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cf0053610 0x7f0cf0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.046+0000 7f0d08ff9700 1 -- 172.21.15.12:0/2949870590 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f0d0406d9a0 con 0x7f0d0c0b6900 2021-10-20T23:23:21.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.046+0000 7f0d0affd700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cf0053610 0x7f0cf0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.046+0000 7f0d0affd700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cf0053610 0x7f0cf0055ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f0cfc00d000 tx=0x7f0cfc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.054+0000 7f0d08ff9700 1 -- 172.21.15.12:0/2949870590 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d04044ce0 con 0x7f0d0c0b6900 2021-10-20T23:23:21.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.218+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0d0c0aff70 con 0x7f0d0c0b6900 2021-10-20T23:23:21.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.222+0000 7f0d08ff9700 1 -- 172.21.15.12:0/2949870590 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f0d04048300 con 0x7f0d0c0b6900 2021-10-20T23:23:21.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:21.225 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:23:21.226 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:23:21.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.226 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:23:21.226 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:23:21.227 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.227 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:23:21.227 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.227 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.228 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.228 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:23:21.229 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:23:21.229 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.229 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:23:21.229 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.229 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.230 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.230 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.231 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:23:21.231 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:23:21.231 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.231 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:23:21.231 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.232 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.232 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.232 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.233 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:23:21.233 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:23:21.233 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.233 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.234 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.234 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.235 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.235 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:23:21.235 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:23:21.236 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.236 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.236 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.236 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.237 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.237 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:23:21.237 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:23:21.238 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.238 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.238 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.238 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.239 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.239 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:23:21.239 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:23:21.240 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.240 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.240 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.240 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.241 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.241 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:23:21.242 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:23:21.242 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.242 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.242 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.242 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.243 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.244 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:23:21.244 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:23:21.244 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.244 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.245 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.245 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.246 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.246 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:23:21.246 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:23:21.247 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.247 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.247 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.247 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.248 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:23:21.249 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:23:21.249 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.249 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.249 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.249 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.250 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.250 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:23:21.251 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:23:21.251 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.251 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:23:21.251 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:23:21.251 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:23:21.252 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.252 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:23:21.252 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:23:21.253 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.253 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:23:21.253 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:23:21.253 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:23:21.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.254 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:23:21.254 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:23:21.255 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.255 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:23:21.255 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:23:21.256 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:23:21.256 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.257 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:23:21.257 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:23:21.257 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.258 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:23:21.258 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:23:21.258 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:21.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:21.259 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:23:21.259 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:23:21.260 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:23:21.260 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:23:21.260 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:23:21.260 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:23:21.260 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.261 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:21.261 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:23:21.261 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:23:21.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.222+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cf0053610 msgr2=0x7f0cf0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.222+0000 7f0d11671700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cf0053610 0x7f0cf0055ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f0cfc00d000 tx=0x7f0cfc009040).stop 2021-10-20T23:23:21.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.222+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c0b6900 msgr2=0x7f0d0c1384f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.222+0000 7f0d11671700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c0b6900 0x7f0d0c1384f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f0d0c0658e0 tx=0x7f0d04007dd0).stop 2021-10-20T23:23:21.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.226+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 shutdown_connections 2021-10-20T23:23:21.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.226+0000 7f0d11671700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cf0053610 0x7f0cf0055ad0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.226+0000 7f0d11671700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c0b6900 0x7f0d0c1384f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.226+0000 7f0d11671700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d0c0aa5d0 0x7f0d0c138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.226+0000 7f0d11671700 1 --2- 172.21.15.12:0/2949870590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d0c060910 0x7f0d0c064080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.226+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 >> 172.21.15.12:0/2949870590 conn(0x7f0d0c0b3480 msgr2=0x7f0d0c0b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:21.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.226+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 shutdown_connections 2021-10-20T23:23:21.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.226+0000 7f0d11671700 1 -- 172.21.15.12:0/2949870590 wait complete. 2021-10-20T23:23:21.267 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:23:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 Processor -- start 2021-10-20T23:23:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 -- start start 2021-10-20T23:23:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2cc0b6900 0x7fd2cc0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2cc0a9ec0 0x7fd2cc0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc0b6ce0 con 0x7fd2cc060910 2021-10-20T23:23:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc05cba0 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc0611e0 con 0x7fd2cc0b6900 2021-10-20T23:23:21.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2caffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd2cc060910 0x7fd2cc05c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37880/0 (socket says 172.21.15.12:37880) 2021-10-20T23:23:21.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2cbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2cc0a9ec0 0x7fd2cc0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2caffd700 1 -- 172.21.15.12:0/110780572 learned_addr learned my addr 172.21.15.12:0/110780572 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:21.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2cb7fe700 1 --2- 172.21.15.12:0/110780572 >> v2:172.21.15.31:3300/0 conn(0x7fd2cc0b6900 0x7fd2cc0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2ca7fc700 1 -- 172.21.15.12:0/110780572 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522862027 0 0) 0x7fd2cc0b6ce0 con 0x7fd2cc060910 2021-10-20T23:23:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2ca7fc700 1 -- 172.21.15.12:0/110780572 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2ac003260 con 0x7fd2cc060910 2021-10-20T23:23:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2cbfff700 1 -- 172.21.15.12:0/110780572 >> v2:172.21.15.31:3300/0 conn(0x7fd2cc0b6900 msgr2=0x7fd2cc0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2cbfff700 1 --2- 172.21.15.12:0/110780572 >> v2:172.21.15.31:3300/0 conn(0x7fd2cc0b6900 0x7fd2cc0acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2cbfff700 1 -- 172.21.15.12:0/110780572 >> v1:172.21.15.12:6789/0 conn(0x7fd2cc060910 legacy=0x7fd2cc05c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2cbfff700 1 -- 172.21.15.12:0/110780572 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc061480 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2cbfff700 1 --2- 172.21.15.12:0/110780572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 0x7fd2cc0aa330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fd2c4002f70 tx=0x7fd2c4006df0).ready entity=mon.0 client_cookie=f3874c94a14fec5c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2ca7fc700 1 -- 172.21.15.12:0/110780572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c400d4f0 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2ca7fc700 1 -- 172.21.15.12:0/110780572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c4000e90 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2ca7fc700 1 -- 172.21.15.12:0/110780572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c400d840 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/110780572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 msgr2=0x7fd2cc0aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 --2- 172.21.15.12:0/110780572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 0x7fd2cc0aa330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fd2c4002f70 tx=0x7fd2c4006df0).stop 2021-10-20T23:23:21.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/110780572 shutdown_connections 2021-10-20T23:23:21.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 --2- 172.21.15.12:0/110780572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 0x7fd2cc0aa330 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 --2- 172.21.15.12:0/110780572 >> v2:172.21.15.31:3300/0 conn(0x7fd2cc0b6900 0x7fd2cc0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/110780572 >> 172.21.15.12:0/110780572 conn(0x7fd2cc0b3480 msgr2=0x7fd2cc0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:21.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/110780572 shutdown_connections 2021-10-20T23:23:21.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.374+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/110780572 wait complete. 2021-10-20T23:23:21.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 Processor -- start 2021-10-20T23:23:21.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 -- start start 2021-10-20T23:23:21.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2cc060910 0x7fd2cc0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 0x7fd2cc1436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2cc0b6900 0x7fd2cc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc140c40 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc140ee0 con 0x7fd2cc060910 2021-10-20T23:23:21.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0aed70 con 0x7fd2cc0b6900 2021-10-20T23:23:21.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2caffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 0x7fd2cc1436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2caffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 0x7fd2cc1436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39292/0 (socket says 172.21.15.12:39292) 2021-10-20T23:23:21.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2caffd700 1 -- 172.21.15.12:0/2621080174 learned_addr learned my addr 172.21.15.12:0/2621080174 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:21.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2cb7fe700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2cc060910 0x7fd2cc0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2cbfff700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2cc0b6900 0x7fd2cc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2caffd700 1 -- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2cc0b6900 msgr2=0x7fd2cc0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2caffd700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2cc0b6900 0x7fd2cc0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2caffd700 1 -- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2cc060910 msgr2=0x7fd2cc0af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2caffd700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2cc060910 0x7fd2cc0af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2caffd700 1 -- 172.21.15.12:0/2621080174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c400b180 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2cb7fe700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2cc060910 0x7fd2cc0af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:21.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2caffd700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 0x7fd2cc1436d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fd2bc001490 tx=0x7fd2bc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2c8ff9700 1 -- 172.21.15.12:0/2621080174 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2bc005ba0 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2c8ff9700 1 -- 172.21.15.12:0/2621080174 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc005d00 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc0af010 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2c8ff9700 1 -- 172.21.15.12:0/2621080174 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2bc0072c0 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.378+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc1430e0 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.382+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc0af1a0 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.382+0000 7fd2c8ff9700 1 -- 172.21.15.12:0/2621080174 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd2bc01a060 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.382+0000 7fd2c8ff9700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b00534f0 0x7fd2b00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.382+0000 7fd2c8ff9700 1 -- 172.21.15.12:0/2621080174 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fd2bc06b290 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.382+0000 7fd2cb7fe700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b00534f0 0x7fd2b00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.382+0000 7fd2cb7fe700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b00534f0 0x7fd2b00559b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fd2b400b000 tx=0x7fd2b4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.390+0000 7fd2c8ff9700 1 -- 172.21.15.12:0/2621080174 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2bc0425d0 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2cc057350 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2c8ff9700 1 -- 172.21.15.12:0/2621080174 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+13414 (secure 0 0 0) 0x7fd2bc018020 con 0x7fd2cc0a9ec0 2021-10-20T23:23:21.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:21.521 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":54,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:23:20.891974+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:23:21.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b00534f0 msgr2=0x7fd2b00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b00534f0 0x7fd2b00559b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fd2b400b000 tx=0x7fd2b4008040).stop 2021-10-20T23:23:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 msgr2=0x7fd2cc1436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 0x7fd2cc1436d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fd2bc001490 tx=0x7fd2bc007e20).stop 2021-10-20T23:23:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 shutdown_connections 2021-10-20T23:23:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd2b00534f0 0x7fd2b00559b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2cc0b6900 0x7fd2cc0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2cc0a9ec0 0x7fd2cc1436d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 --2- 172.21.15.12:0/2621080174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2cc060910 0x7fd2cc0af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.518+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 >> 172.21.15.12:0/2621080174 conn(0x7fd2cc0b3480 msgr2=0x7fd2cc1385c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:21.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.522+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 shutdown_connections 2021-10-20T23:23:21.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.522+0000 7fd2d1dbb700 1 -- 172.21.15.12:0/2621080174 wait complete. 2021-10-20T23:23:21.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:23:21.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:23:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a359e700 1 Processor -- start 2021-10-20T23:23:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a359e700 1 -- start start 2021-10-20T23:23:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a40b3000 0x7fd9a4060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd9a40b25a0 0x7fd9a4061000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a4065330 con 0x7fd9a4066520 2021-10-20T23:23:21.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a4062000 con 0x7fd9a40b25a0 2021-10-20T23:23:21.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40b33e0 con 0x7fd9a40b3000 2021-10-20T23:23:21.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a40b3000 0x7fd9a4060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a1d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd9a40b25a0 0x7fd9a4061000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a1d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd9a40b25a0 0x7fd9a4061000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:54274/0 (socket says 172.21.15.12:54274) 2021-10-20T23:23:21.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a1d9b700 1 -- 172.21.15.12:0/51409375 learned_addr learned my addr 172.21.15.12:0/51409375 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:21.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a1d9b700 1 -- 172.21.15.12:0/51409375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a40b3000 msgr2=0x7fd9a4060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:21.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a1d9b700 1 --2- 172.21.15.12:0/51409375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a40b3000 0x7fd9a4060b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a1d9b700 1 -- 172.21.15.12:0/51409375 >> v1:172.21.15.31:6789/0 conn(0x7fd9a4066520 legacy=0x7fd9a4066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.642+0000 7fd9a1d9b700 1 -- 172.21.15.12:0/51409375 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a405fa60 con 0x7fd9a40b25a0 2021-10-20T23:23:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a1d9b700 1 --2- 172.21.15.12:0/51409375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9a40b25a0 0x7fd9a4061000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd998002f70 tx=0x7fd998006eb0).ready entity=mon.1 client_cookie=25a496c91abd1b03 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a159a700 1 -- 172.21.15.12:0/51409375 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd99800d570 con 0x7fd9a40b25a0 2021-10-20T23:23:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a159a700 1 -- 172.21.15.12:0/51409375 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd998000e90 con 0x7fd9a40b25a0 2021-10-20T23:23:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a159a700 1 -- 172.21.15.12:0/51409375 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd99800d900 con 0x7fd9a40b25a0 2021-10-20T23:23:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a359e700 1 -- 172.21.15.12:0/51409375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9a40b25a0 msgr2=0x7fd9a4061000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a359e700 1 --2- 172.21.15.12:0/51409375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9a40b25a0 0x7fd9a4061000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd998002f70 tx=0x7fd998006eb0).stop 2021-10-20T23:23:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a359e700 1 -- 172.21.15.12:0/51409375 shutdown_connections 2021-10-20T23:23:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a359e700 1 --2- 172.21.15.12:0/51409375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9a40b25a0 0x7fd9a4061000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a359e700 1 --2- 172.21.15.12:0/51409375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a40b3000 0x7fd9a4060b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a359e700 1 -- 172.21.15.12:0/51409375 >> 172.21.15.12:0/51409375 conn(0x7fd9a40636e0 msgr2=0x7fd9a4063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a359e700 1 -- 172.21.15.12:0/51409375 shutdown_connections 2021-10-20T23:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.646+0000 7fd9a359e700 1 -- 172.21.15.12:0/51409375 wait complete. 2021-10-20T23:23:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a359e700 1 Processor -- start 2021-10-20T23:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a359e700 1 -- start start 2021-10-20T23:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a4066520 0x7fd9a40b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a40b25a0 0x7fd9a4152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9a40b3000 0x7fd9a4152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40aee90 con 0x7fd9a40b25a0 2021-10-20T23:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40af130 con 0x7fd9a40b3000 2021-10-20T23:23:21.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40af3d0 con 0x7fd9a4066520 2021-10-20T23:23:21.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a40b25a0 0x7fd9a4152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a4066520 0x7fd9a40b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a4066520 0x7fd9a40b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45062/0 (socket says 172.21.15.12:45062) 2021-10-20T23:23:21.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a259c700 1 -- 172.21.15.12:0/1728009369 learned_addr learned my addr 172.21.15.12:0/1728009369 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a2d9d700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9a40b3000 0x7fd9a4152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a1d9b700 1 -- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a4066520 msgr2=0x7fd9a40b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a1d9b700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a4066520 0x7fd9a40b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a1d9b700 1 -- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9a40b3000 msgr2=0x7fd9a4152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a1d9b700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9a40b3000 0x7fd9a4152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a1d9b700 1 -- 172.21.15.12:0/1728009369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99800b1e0 con 0x7fd9a40b25a0 2021-10-20T23:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.650+0000 7fd9a1d9b700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a40b25a0 0x7fd9a4152290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fd998002f70 tx=0x7fd998015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9937fe700 1 -- 172.21.15.12:0/1728009369 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd998011760 con 0x7fd9a40b25a0 2021-10-20T23:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9937fe700 1 -- 172.21.15.12:0/1728009369 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9980118c0 con 0x7fd9a40b25a0 2021-10-20T23:23:21.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a40af670 con 0x7fd9a40b25a0 2021-10-20T23:23:21.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9937fe700 1 -- 172.21.15.12:0/1728009369 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd998011c20 con 0x7fd9a40b25a0 2021-10-20T23:23:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a40ab480 con 0x7fd9a40b25a0 2021-10-20T23:23:21.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a40af800 con 0x7fd9a40b25a0 2021-10-20T23:23:21.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9937fe700 1 -- 172.21.15.12:0/1728009369 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd998025030 con 0x7fd9a40b25a0 2021-10-20T23:23:21.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9937fe700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9800536d0 0x7fd980055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9937fe700 1 -- 172.21.15.12:0/1728009369 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fd99806c670 con 0x7fd9a40b25a0 2021-10-20T23:23:21.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.654+0000 7fd9a259c700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9800536d0 0x7fd980055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.658+0000 7fd9a259c700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9800536d0 0x7fd980055b90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fd99400b000 tx=0x7fd994006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.658+0000 7fd9937fe700 1 -- 172.21.15.12:0/1728009369 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd9980439b0 con 0x7fd9a40b25a0 2021-10-20T23:23:21.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd9a405fd00 con 0x7fd9a40b25a0 2021-10-20T23:23:21.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9937fe700 1 -- 172.21.15.12:0/1728009369 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v54) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd9980230b0 con 0x7fd9a40b25a0 2021-10-20T23:23:21.785 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:23:21.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9800536d0 msgr2=0x7fd980055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9800536d0 0x7fd980055b90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fd99400b000 tx=0x7fd994006df0).stop 2021-10-20T23:23:21.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a40b25a0 msgr2=0x7fd9a4152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a40b25a0 0x7fd9a4152290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fd998002f70 tx=0x7fd998015000).stop 2021-10-20T23:23:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 shutdown_connections 2021-10-20T23:23:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9800536d0 0x7fd980055b90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9a40b3000 0x7fd9a4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a40b25a0 0x7fd9a4152290 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 --2- 172.21.15.12:0/1728009369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9a4066520 0x7fd9a40b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 >> 172.21.15.12:0/1728009369 conn(0x7fd9a40636e0 msgr2=0x7fd9a4146400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:21.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 shutdown_connections 2021-10-20T23:23:21.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.782+0000 7fd9a359e700 1 -- 172.21.15.12:0/1728009369 wait complete. 2021-10-20T23:23:21.799 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:23:21.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa205a2e700 1 Processor -- start 2021-10-20T23:23:21.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa205a2e700 1 -- start start 2021-10-20T23:23:21.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa205a2e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa200146950 0x7fa200140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa205a2e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2000b4690 0x7fa2000b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa205a2e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa200143b60 con 0x7fa2000b4180 2021-10-20T23:23:21.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa205a2e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa200147510 con 0x7fa2000b4690 2021-10-20T23:23:21.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa205a2e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa200143e00 con 0x7fa200146950 2021-10-20T23:23:21.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa1ff7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2000b4690 0x7fa2000b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa1ff7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2000b4690 0x7fa2000b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39316/0 (socket says 172.21.15.12:39316) 2021-10-20T23:23:21.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa1ff7fe700 1 -- 172.21.15.12:0/3341227319 learned_addr learned my addr 172.21.15.12:0/3341227319 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:21.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.910+0000 7fa1feffd700 1 --2- 172.21.15.12:0/3341227319 >> v2:172.21.15.31:3300/0 conn(0x7fa200146950 0x7fa200140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa1ff7fe700 1 -- 172.21.15.12:0/3341227319 >> v2:172.21.15.31:3300/0 conn(0x7fa200146950 msgr2=0x7fa200140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:21.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa1ff7fe700 1 --2- 172.21.15.12:0/3341227319 >> v2:172.21.15.31:3300/0 conn(0x7fa200146950 0x7fa200140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa1ff7fe700 1 -- 172.21.15.12:0/3341227319 >> v1:172.21.15.31:6789/0 conn(0x7fa2000b4180 legacy=0x7fa200140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa1ff7fe700 1 -- 172.21.15.12:0/3341227319 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2000b0c90 con 0x7fa2000b4690 2021-10-20T23:23:21.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa1ff7fe700 1 --2- 172.21.15.12:0/3341227319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 0x7fa2000b4ed0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fa1f80032f0 tx=0x7fa1f8009290).ready entity=mon.0 client_cookie=6d401752e077ef4d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa1fdffb700 1 -- 172.21.15.12:0/3341227319 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f800b870 con 0x7fa2000b4690 2021-10-20T23:23:21.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa1fdffb700 1 -- 172.21.15.12:0/3341227319 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f800b9d0 con 0x7fa2000b4690 2021-10-20T23:23:21.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa1fdffb700 1 -- 172.21.15.12:0/3341227319 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f800bb40 con 0x7fa2000b4690 2021-10-20T23:23:21.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 -- 172.21.15.12:0/3341227319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 msgr2=0x7fa2000b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 --2- 172.21.15.12:0/3341227319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 0x7fa2000b4ed0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fa1f80032f0 tx=0x7fa1f8009290).stop 2021-10-20T23:23:21.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 -- 172.21.15.12:0/3341227319 shutdown_connections 2021-10-20T23:23:21.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 --2- 172.21.15.12:0/3341227319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 0x7fa2000b4ed0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 --2- 172.21.15.12:0/3341227319 >> v2:172.21.15.31:3300/0 conn(0x7fa200146950 0x7fa200140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 -- 172.21.15.12:0/3341227319 >> 172.21.15.12:0/3341227319 conn(0x7fa20005c490 msgr2=0x7fa20005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:21.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 -- 172.21.15.12:0/3341227319 shutdown_connections 2021-10-20T23:23:21.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 -- 172.21.15.12:0/3341227319 wait complete. 2021-10-20T23:23:21.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 Processor -- start 2021-10-20T23:23:21.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.914+0000 7fa205a2e700 1 -- start start 2021-10-20T23:23:21.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa205a2e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b4180 0x7fa2000adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa205a2e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 0x7fa200152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa205a2e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa200146950 0x7fa2000af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa205a2e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000b78e0 con 0x7fa2000b4690 2021-10-20T23:23:21.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa205a2e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000b8640 con 0x7fa200146950 2021-10-20T23:23:21.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa205a2e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000b88e0 con 0x7fa2000b4180 2021-10-20T23:23:21.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1fe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 0x7fa200152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1fe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 0x7fa200152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39320/0 (socket says 172.21.15.12:39320) 2021-10-20T23:23:21.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1fe7fc700 1 -- 172.21.15.12:0/1214965148 learned_addr learned my addr 172.21.15.12:0/1214965148 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:21.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1ff7fe700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa200146950 0x7fa2000af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1feffd700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b4180 0x7fa2000adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1fe7fc700 1 -- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b4180 msgr2=0x7fa2000adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1fe7fc700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b4180 0x7fa2000adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1fe7fc700 1 -- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa200146950 msgr2=0x7fa2000af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:21.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1fe7fc700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa200146950 0x7fa2000af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1fe7fc700 1 -- 172.21.15.12:0/1214965148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009530 con 0x7fa2000b4690 2021-10-20T23:23:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1feffd700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b4180 0x7fa2000adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1fe7fc700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 0x7fa200152ce0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fa200060c50 tx=0x7fa1f0007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1f7fff700 1 -- 172.21.15.12:0/1214965148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f000ce50 con 0x7fa2000b4690 2021-10-20T23:23:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1f7fff700 1 -- 172.21.15.12:0/1214965148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0007030 con 0x7fa2000b4690 2021-10-20T23:23:21.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2000b8b80 con 0x7fa2000b4690 2021-10-20T23:23:21.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1f7fff700 1 -- 172.21.15.12:0/1214965148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f0007390 con 0x7fa2000b4690 2021-10-20T23:23:21.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2001531d0 con 0x7fa2000b4690 2021-10-20T23:23:21.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa1f7fff700 1 -- 172.21.15.12:0/1214965148 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa1f0010030 con 0x7fa2000b4690 2021-10-20T23:23:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.918+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa200057350 con 0x7fa2000b4690 2021-10-20T23:23:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.922+0000 7fa1f7fff700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1e4053580 0x7fa1e4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.922+0000 7fa1f7fff700 1 -- 172.21.15.12:0/1214965148 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa1f006b3c0 con 0x7fa2000b4690 2021-10-20T23:23:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.922+0000 7fa1feffd700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1e4053580 0x7fa1e4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.922+0000 7fa1feffd700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1e4053580 0x7fa1e4055a40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fa1e800b000 tx=0x7fa1e8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:21.930+0000 7fa1f7fff700 1 -- 172.21.15.12:0/1214965148 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1f0042600 con 0x7fa2000b4690 2021-10-20T23:23:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.058+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa2000b90a0 con 0x7fa2000b4690 2021-10-20T23:23:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.058+0000 7fa1f7fff700 1 -- 172.21.15.12:0/1214965148 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa1f0045c20 con 0x7fa2000b4690 2021-10-20T23:23:22.062 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:23:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1e4053580 msgr2=0x7fa1e4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1e4053580 0x7fa1e4055a40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fa1e800b000 tx=0x7fa1e8008040).stop 2021-10-20T23:23:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 msgr2=0x7fa200152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 0x7fa200152ce0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fa200060c50 tx=0x7fa1f0007bd0).stop 2021-10-20T23:23:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 shutdown_connections 2021-10-20T23:23:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1e4053580 0x7fa1e4055a40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa200146950 0x7fa2000af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000b4690 0x7fa200152ce0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 --2- 172.21.15.12:0/1214965148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b4180 0x7fa2000adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 >> 172.21.15.12:0/1214965148 conn(0x7fa20005c490 msgr2=0x7fa20013e710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:22.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 shutdown_connections 2021-10-20T23:23:22.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.062+0000 7fa205a2e700 1 -- 172.21.15.12:0/1214965148 wait complete. 2021-10-20T23:23:22.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:23:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72de49b700 1 Processor -- start 2021-10-20T23:23:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72de49b700 1 -- start start 2021-10-20T23:23:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72de49b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f72d8140cf0 0x7f72d80ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72de49b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f72d80a8c70 0x7f72d80aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72de49b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d80af090 con 0x7f72d80b1280 2021-10-20T23:23:22.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72de49b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d8140310 con 0x7f72d8140cf0 2021-10-20T23:23:22.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72de49b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d81405b0 con 0x7f72d80a8c70 2021-10-20T23:23:22.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72cffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f72d8140cf0 0x7f72d80ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72cffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f72d8140cf0 0x7f72d80ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39326/0 (socket says 172.21.15.12:39326) 2021-10-20T23:23:22.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72cffff700 1 -- 172.21.15.12:0/427089822 learned_addr learned my addr 172.21.15.12:0/427089822 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:22.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72dca38700 1 --2- 172.21.15.12:0/427089822 >> v2:172.21.15.31:3300/0 conn(0x7f72d80a8c70 0x7f72d80aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72cffff700 1 -- 172.21.15.12:0/427089822 >> v2:172.21.15.31:3300/0 conn(0x7f72d80a8c70 msgr2=0x7f72d80aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:22.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72cffff700 1 --2- 172.21.15.12:0/427089822 >> v2:172.21.15.31:3300/0 conn(0x7f72d80a8c70 0x7f72d80aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72cffff700 1 -- 172.21.15.12:0/427089822 >> v1:172.21.15.12:6789/0 conn(0x7f72d80b1280 legacy=0x7f72d80b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.170+0000 7f72cffff700 1 -- 172.21.15.12:0/427089822 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8140850 con 0x7f72d8140cf0 2021-10-20T23:23:22.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72cffff700 1 --2- 172.21.15.12:0/427089822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 0x7f72d80ae6b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f72c0002f70 tx=0x7f72c0006eb0).ready entity=mon.0 client_cookie=4dfb8fefc5608051 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:22.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72d77fe700 1 -- 172.21.15.12:0/427089822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72c000d610 con 0x7f72d8140cf0 2021-10-20T23:23:22.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72d77fe700 1 -- 172.21.15.12:0/427089822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c0000e90 con 0x7f72d8140cf0 2021-10-20T23:23:22.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72d77fe700 1 -- 172.21.15.12:0/427089822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72c000d9a0 con 0x7f72d8140cf0 2021-10-20T23:23:22.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72de49b700 1 -- 172.21.15.12:0/427089822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 msgr2=0x7f72d80ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72de49b700 1 --2- 172.21.15.12:0/427089822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 0x7f72d80ae6b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f72c0002f70 tx=0x7f72c0006eb0).stop 2021-10-20T23:23:22.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72de49b700 1 -- 172.21.15.12:0/427089822 shutdown_connections 2021-10-20T23:23:22.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72de49b700 1 --2- 172.21.15.12:0/427089822 >> v2:172.21.15.31:3300/0 conn(0x7f72d80a8c70 0x7f72d80aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72de49b700 1 --2- 172.21.15.12:0/427089822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 0x7f72d80ae6b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72de49b700 1 -- 172.21.15.12:0/427089822 >> 172.21.15.12:0/427089822 conn(0x7f72d805f6b0 msgr2=0x7f72d805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:22.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72de49b700 1 -- 172.21.15.12:0/427089822 shutdown_connections 2021-10-20T23:23:22.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72de49b700 1 -- 172.21.15.12:0/427089822 wait complete. 2021-10-20T23:23:22.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.174+0000 7f72de49b700 1 Processor -- start 2021-10-20T23:23:22.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 -- start start 2021-10-20T23:23:22.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72d80a8c70 0x7f72d8066f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72d80b1280 0x7f72d8141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 0x7f72d8143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80ab5a0 con 0x7f72d8140cf0 2021-10-20T23:23:22.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d8144320 con 0x7f72d80b1280 2021-10-20T23:23:22.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d81434a0 con 0x7f72d80a8c70 2021-10-20T23:23:22.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72dca38700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 0x7f72d8143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72dca38700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 0x7f72d8143900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39334/0 (socket says 172.21.15.12:39334) 2021-10-20T23:23:22.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72dca38700 1 -- 172.21.15.12:0/127633438 learned_addr learned my addr 172.21.15.12:0/127633438 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:22.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72d7fff700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72d80a8c70 0x7f72d8066f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72cffff700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72d80b1280 0x7f72d8141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72dca38700 1 -- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72d80a8c70 msgr2=0x7f72d8066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72dca38700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72d80a8c70 0x7f72d8066f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72dca38700 1 -- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72d80b1280 msgr2=0x7f72d8141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72dca38700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72d80b1280 0x7f72d8141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72dca38700 1 -- 172.21.15.12:0/127633438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c000b1e0 con 0x7f72d8140cf0 2021-10-20T23:23:22.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72dca38700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 0x7f72d8143900 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f72d000a000 tx=0x7f72d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:22.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72d5ffb700 1 -- 172.21.15.12:0/127633438 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d0013620 con 0x7f72d8140cf0 2021-10-20T23:23:22.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72d5ffb700 1 -- 172.21.15.12:0/127633438 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d0013780 con 0x7f72d8140cf0 2021-10-20T23:23:22.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d80ab7d0 con 0x7f72d8140cf0 2021-10-20T23:23:22.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72d5ffb700 1 -- 172.21.15.12:0/127633438 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d0013ae0 con 0x7f72d8140cf0 2021-10-20T23:23:22.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d80aa750 con 0x7f72d8140cf0 2021-10-20T23:23:22.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d8140000 con 0x7f72d8140cf0 2021-10-20T23:23:22.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.178+0000 7f72d5ffb700 1 -- 172.21.15.12:0/127633438 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f72d0013c40 con 0x7f72d8140cf0 2021-10-20T23:23:22.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.182+0000 7f72d5ffb700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72bc0536d0 0x7f72bc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.182+0000 7f72d5ffb700 1 -- 172.21.15.12:0/127633438 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f72d006ba60 con 0x7f72d8140cf0 2021-10-20T23:23:22.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.182+0000 7f72d7fff700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72bc0536d0 0x7f72bc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.182+0000 7f72d7fff700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72bc0536d0 0x7f72bc055b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f72c800b000 tx=0x7f72c8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:22.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.186+0000 7f72d5ffb700 1 -- 172.21.15.12:0/127633438 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72d0042d00 con 0x7f72d8140cf0 2021-10-20T23:23:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f72d8057350 con 0x7f72d8140cf0 2021-10-20T23:23:22.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72d5ffb700 1 -- 172.21.15.12:0/127633438 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) v1 ==== 84+0+143 (secure 0 0 0) 0x7f72d0046320 con 0x7f72d8140cf0 2021-10-20T23:23:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:22.325 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:23:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:23:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:23:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:23:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:23:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:23:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:22.327 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:23:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72bc0536d0 msgr2=0x7f72bc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72bc0536d0 0x7f72bc055b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f72c800b000 tx=0x7f72c8009040).stop 2021-10-20T23:23:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 msgr2=0x7f72d8143900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 0x7f72d8143900 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f72d000a000 tx=0x7f72d0008040).stop 2021-10-20T23:23:22.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 shutdown_connections 2021-10-20T23:23:22.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72bc0536d0 0x7f72bc055b90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72d8140cf0 0x7f72d8143900 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72d80b1280 0x7f72d8141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 --2- 172.21.15.12:0/127633438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72d80a8c70 0x7f72d8066f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 >> 172.21.15.12:0/127633438 conn(0x7f72d805f6b0 msgr2=0x7f72d8139950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.322+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 shutdown_connections 2021-10-20T23:23:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.326+0000 7f72de49b700 1 -- 172.21.15.12:0/127633438 wait complete. 2021-10-20T23:23:22.338 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:23:22.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:23:22.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f70e1700 1 Processor -- start 2021-10-20T23:23:22.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f70e1700 1 -- start start 2021-10-20T23:23:22.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f70e1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f0061680 0x7f64f00b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f70e1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64f01439a0 0x7f64f01404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f70e1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f00b6910 con 0x7f64f00b4710 2021-10-20T23:23:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f70e1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f00b9680 con 0x7f64f01439a0 2021-10-20T23:23:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f70e1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f00b6bb0 con 0x7f64f0061680 2021-10-20T23:23:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f60df700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f0061680 0x7f64f00b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f68e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64f01439a0 0x7f64f01404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f60df700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f0061680 0x7f64f00b9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45102/0 (socket says 172.21.15.12:45102) 2021-10-20T23:23:22.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f58de700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f64f00b4710 0x7f64f013fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:44998/0 (socket says 172.21.15.12:44998) 2021-10-20T23:23:22.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f60df700 1 -- 172.21.15.12:0/2785334822 learned_addr learned my addr 172.21.15.12:0/2785334822 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:22.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.442+0000 7f64f50dd700 1 -- 172.21.15.12:0/2785334822 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059822456 0 0) 0x7f64f00b6910 con 0x7f64f00b4710 2021-10-20T23:23:22.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f50dd700 1 -- 172.21.15.12:0/2785334822 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d8003260 con 0x7f64f00b4710 2021-10-20T23:23:22.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f60df700 1 -- 172.21.15.12:0/2785334822 >> v2:172.21.15.31:3300/0 conn(0x7f64f01439a0 msgr2=0x7f64f01404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:22.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f60df700 1 --2- 172.21.15.12:0/2785334822 >> v2:172.21.15.31:3300/0 conn(0x7f64f01439a0 0x7f64f01404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f60df700 1 -- 172.21.15.12:0/2785334822 >> v1:172.21.15.31:6789/0 conn(0x7f64f00b4710 legacy=0x7f64f013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f60df700 1 -- 172.21.15.12:0/2785334822 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f00b6e50 con 0x7f64f0061680 2021-10-20T23:23:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f68e0700 1 --2- 172.21.15.12:0/2785334822 >> v2:172.21.15.31:3300/0 conn(0x7f64f01439a0 0x7f64f01404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f60df700 1 --2- 172.21.15.12:0/2785334822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f0061680 0x7f64f00b9d10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f64ec002f70 tx=0x7f64ec006eb0).ready entity=mon.2 client_cookie=aa198de8bf03ba60 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:22.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f50dd700 1 -- 172.21.15.12:0/2785334822 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec00d5c0 con 0x7f64f0061680 2021-10-20T23:23:22.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f50dd700 1 -- 172.21.15.12:0/2785334822 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec000e90 con 0x7f64f0061680 2021-10-20T23:23:22.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f50dd700 1 -- 172.21.15.12:0/2785334822 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec00d950 con 0x7f64f0061680 2021-10-20T23:23:22.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 -- 172.21.15.12:0/2785334822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f0061680 msgr2=0x7f64f00b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 --2- 172.21.15.12:0/2785334822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f0061680 0x7f64f00b9d10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f64ec002f70 tx=0x7f64ec006eb0).stop 2021-10-20T23:23:22.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 -- 172.21.15.12:0/2785334822 shutdown_connections 2021-10-20T23:23:22.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 --2- 172.21.15.12:0/2785334822 >> v2:172.21.15.31:3300/0 conn(0x7f64f01439a0 0x7f64f01404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 --2- 172.21.15.12:0/2785334822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f0061680 0x7f64f00b9d10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 -- 172.21.15.12:0/2785334822 >> 172.21.15.12:0/2785334822 conn(0x7f64f006adf0 msgr2=0x7f64f005f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:22.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 -- 172.21.15.12:0/2785334822 shutdown_connections 2021-10-20T23:23:22.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 -- 172.21.15.12:0/2785334822 wait complete. 2021-10-20T23:23:22.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 Processor -- start 2021-10-20T23:23:22.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.446+0000 7f64f70e1700 1 -- start start 2021-10-20T23:23:22.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f70e1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64f0061680 0x7f64f014a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f70e1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f01439a0 0x7f64f00af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f70e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0112b70 0x7f64f013ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f70e1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0155d60 con 0x7f64f0061680 2021-10-20T23:23:22.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f70e1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0145a70 con 0x7f64f0112b70 2021-10-20T23:23:22.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f70e1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0147270 con 0x7f64f01439a0 2021-10-20T23:23:22.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f60df700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64f0061680 0x7f64f014a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f68e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0112b70 0x7f64f013ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f60df700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64f0061680 0x7f64f014a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39346/0 (socket says 172.21.15.12:39346) 2021-10-20T23:23:22.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f60df700 1 -- 172.21.15.12:0/2763160724 learned_addr learned my addr 172.21.15.12:0/2763160724 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:22.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f58de700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f01439a0 0x7f64f00af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f60df700 1 -- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f01439a0 msgr2=0x7f64f00af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f60df700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f01439a0 0x7f64f00af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f60df700 1 -- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0112b70 msgr2=0x7f64f013ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:22.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f60df700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0112b70 0x7f64f013ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:22.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f60df700 1 -- 172.21.15.12:0/2763160724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e8009470 con 0x7f64f0061680 2021-10-20T23:23:22.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f58de700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f01439a0 0x7f64f00af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:23:22.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f60df700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64f0061680 0x7f64f014a1b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f64f0147400 tx=0x7f64ec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:22.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64e37fe700 1 -- 172.21.15.12:0/2763160724 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec00de20 con 0x7f64f0061680 2021-10-20T23:23:22.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64e37fe700 1 -- 172.21.15.12:0/2763160724 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec011c60 con 0x7f64f0061680 2021-10-20T23:23:22.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec00b1e0 con 0x7f64f0061680 2021-10-20T23:23:22.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64e37fe700 1 -- 172.21.15.12:0/2763160724 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec01e460 con 0x7f64f0061680 2021-10-20T23:23:22.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f0146fd0 con 0x7f64f0061680 2021-10-20T23:23:22.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.450+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f0057350 con 0x7f64f0061680 2021-10-20T23:23:22.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.454+0000 7f64e37fe700 1 -- 172.21.15.12:0/2763160724 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f64ec025030 con 0x7f64f0061680 2021-10-20T23:23:22.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.454+0000 7f64e37fe700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64d00536a0 0x7f64d0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.454+0000 7f64e37fe700 1 -- 172.21.15.12:0/2763160724 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f64ec06c9e0 con 0x7f64f0061680 2021-10-20T23:23:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.454+0000 7f64f58de700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64d00536a0 0x7f64d0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.454+0000 7f64f58de700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64d00536a0 0x7f64d0055b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f64e4008000 tx=0x7f64e4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.458+0000 7f64e37fe700 1 -- 172.21.15.12:0/2763160724 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64ec043d20 con 0x7f64f0061680 2021-10-20T23:23:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:22.582+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f64f00b0b10 con 0x7f64f0061680 2021-10-20T23:23:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.230+0000 7f64e37fe700 1 -- 172.21.15.12:0/2763160724 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v55) v1 ==== 133+0+0 (secure 0 0 0) 0x7f64ec023070 con 0x7f64f0061680 2021-10-20T23:23:23.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.234+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64d00536a0 msgr2=0x7f64d0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:23.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.234+0000 7f64f70e1700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64d00536a0 0x7f64d0055b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f64e4008000 tx=0x7f64e4009040).stop 2021-10-20T23:23:23.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.234+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64f0061680 msgr2=0x7f64f014a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:23.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.234+0000 7f64f70e1700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64f0061680 0x7f64f014a1b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f64f0147400 tx=0x7f64ec015000).stop 2021-10-20T23:23:23.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.238+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 shutdown_connections 2021-10-20T23:23:23.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.238+0000 7f64f70e1700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64d00536a0 0x7f64d0055b60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.238+0000 7f64f70e1700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0112b70 0x7f64f013ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.238+0000 7f64f70e1700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f01439a0 0x7f64f00af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.238+0000 7f64f70e1700 1 --2- 172.21.15.12:0/2763160724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64f0061680 0x7f64f014a1b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.238+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 >> 172.21.15.12:0/2763160724 conn(0x7f64f006adf0 msgr2=0x7f64f013ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:23.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.238+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 shutdown_connections 2021-10-20T23:23:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.238+0000 7f64f70e1700 1 -- 172.21.15.12:0/2763160724 wait complete. 2021-10-20T23:23:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:23:23.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:23:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.386+0000 7f72a7246700 1 Processor -- start 2021-10-20T23:23:23.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.386+0000 7f72a7246700 1 -- start start 2021-10-20T23:23:23.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.386+0000 7f72a7246700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00b0710 0x7f72a0142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:23.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.386+0000 7f72a7246700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a0143920 con 0x7f72a00b30d0 2021-10-20T23:23:23.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.386+0000 7f72a7246700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a00b0af0 con 0x7f72a00ace70 2021-10-20T23:23:23.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.386+0000 7f72a7246700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00ae680 con 0x7f72a00b0710 2021-10-20T23:23:23.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a6244700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00b0710 0x7f72a0142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:23.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a5a43700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f72a00b30d0 0x7f72a0143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37950/0 (socket says 172.21.15.12:37950) 2021-10-20T23:23:23.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a5a43700 1 -- 172.21.15.12:0/2774263822 learned_addr learned my addr 172.21.15.12:0/2774263822 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:23.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a6a45700 1 --1- 172.21.15.12:0/2774263822 >> v1:172.21.15.31:6789/0 conn(0x7f72a00ace70 0x7f72a013f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45016/0 (socket says 172.21.15.12:45016) 2021-10-20T23:23:23.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a6244700 1 -- 172.21.15.12:0/2774263822 >> v1:172.21.15.31:6789/0 conn(0x7f72a00ace70 legacy=0x7f72a013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:23.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a5242700 1 -- 172.21.15.12:0/2774263822 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809108518 0 0) 0x7f72a00b0af0 con 0x7f72a00ace70 2021-10-20T23:23:23.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a6244700 1 -- 172.21.15.12:0/2774263822 >> v1:172.21.15.12:6789/0 conn(0x7f72a00b30d0 legacy=0x7f72a0143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:23.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a6244700 1 -- 172.21.15.12:0/2774263822 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a00ae920 con 0x7f72a00b0710 2021-10-20T23:23:23.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a6244700 1 --2- 172.21.15.12:0/2774263822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00b0710 0x7f72a0142d20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f729c001110 tx=0x7f7294006df0).ready entity=mon.2 client_cookie=a318834c30488c74 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:23.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a5242700 1 -- 172.21.15.12:0/2774263822 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7294014070 con 0x7f72a00b0710 2021-10-20T23:23:23.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a5242700 1 -- 172.21.15.12:0/2774263822 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294000e90 con 0x7f72a00b0710 2021-10-20T23:23:23.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a5242700 1 -- 172.21.15.12:0/2774263822 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729400fb60 con 0x7f72a00b0710 2021-10-20T23:23:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a7246700 1 -- 172.21.15.12:0/2774263822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00b0710 msgr2=0x7f72a0142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a7246700 1 --2- 172.21.15.12:0/2774263822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00b0710 0x7f72a0142d20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f729c001110 tx=0x7f7294006df0).stop 2021-10-20T23:23:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a7246700 1 -- 172.21.15.12:0/2774263822 shutdown_connections 2021-10-20T23:23:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a7246700 1 --2- 172.21.15.12:0/2774263822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00b0710 0x7f72a0142d20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a7246700 1 -- 172.21.15.12:0/2774263822 >> 172.21.15.12:0/2774263822 conn(0x7f72a0061140 msgr2=0x7f72a0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a7246700 1 -- 172.21.15.12:0/2774263822 shutdown_connections 2021-10-20T23:23:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a7246700 1 -- 172.21.15.12:0/2774263822 wait complete. 2021-10-20T23:23:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.390+0000 7f72a7246700 1 Processor -- start 2021-10-20T23:23:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a7246700 1 -- start start 2021-10-20T23:23:23.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a7246700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00ace70 0x7f72a00b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:23.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a7246700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a00b0710 0x7f72a00a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:23.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a7246700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72a00b30d0 0x7f72a00a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:23.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a7246700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00a31c0 con 0x7f72a00b0710 2021-10-20T23:23:23.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a7246700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a009fb40 con 0x7f72a00b30d0 2021-10-20T23:23:23.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a7246700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a009f600 con 0x7f72a00ace70 2021-10-20T23:23:23.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a5a43700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a00b0710 0x7f72a00a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:23.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a5a43700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a00b0710 0x7f72a00a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39360/0 (socket says 172.21.15.12:39360) 2021-10-20T23:23:23.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a5a43700 1 -- 172.21.15.12:0/67627991 learned_addr learned my addr 172.21.15.12:0/67627991 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:23.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a6244700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00ace70 0x7f72a00b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:23.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a6a45700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72a00b30d0 0x7f72a00a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:23.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a6244700 1 -- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72a00b30d0 msgr2=0x7f72a00a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:23.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a6244700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72a00b30d0 0x7f72a00a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a6244700 1 -- 172.21.15.12:0/67627991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a00b0710 msgr2=0x7f72a00a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:23.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a6244700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a00b0710 0x7f72a00a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a6244700 1 -- 172.21.15.12:0/67627991 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729400b180 con 0x7f72a00ace70 2021-10-20T23:23:23.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a5a43700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a00b0710 0x7f72a00a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:23.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a6244700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00ace70 0x7f72a00b3ba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f729c001110 tx=0x7f7294016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:23.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72937fe700 1 -- 172.21.15.12:0/67627991 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7294010bb0 con 0x7f72a00ace70 2021-10-20T23:23:23.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72937fe700 1 -- 172.21.15.12:0/67627991 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294010d10 con 0x7f72a00ace70 2021-10-20T23:23:23.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a009f8a0 con 0x7f72a00ace70 2021-10-20T23:23:23.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72937fe700 1 -- 172.21.15.12:0/67627991 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729401c630 con 0x7f72a00ace70 2021-10-20T23:23:23.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.394+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a009ecc0 con 0x7f72a00ace70 2021-10-20T23:23:23.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.398+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c003410 con 0x7f72a00ace70 2021-10-20T23:23:23.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.398+0000 7f72937fe700 1 -- 172.21.15.12:0/67627991 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7294022020 con 0x7f72a00ace70 2021-10-20T23:23:23.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.398+0000 7f72937fe700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72800535b0 0x7f7280055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:23.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.398+0000 7f72937fe700 1 -- 172.21.15.12:0/67627991 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f729406d2a0 con 0x7f72a00ace70 2021-10-20T23:23:23.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.398+0000 7f72a5a43700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72800535b0 0x7f7280055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:23.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.398+0000 7f72a5a43700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72800535b0 0x7f7280055a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f729c00d000 tx=0x7f729c007c10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:23.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.406+0000 7f72937fe700 1 -- 172.21.15.12:0/67627991 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72940444b0 con 0x7f72a00ace70 2021-10-20T23:23:23.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.534+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f727c003c40 con 0x7f72a00ace70 2021-10-20T23:23:23.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.926+0000 7f72937fe700 1 -- 172.21.15.12:0/67627991 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v56) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7294047ad0 con 0x7f72a00ace70 2021-10-20T23:23:23.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72800535b0 msgr2=0x7f7280055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:23.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72800535b0 0x7f7280055a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f729c00d000 tx=0x7f729c007c10).stop 2021-10-20T23:23:23.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00ace70 msgr2=0x7f72a00b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:23.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00ace70 0x7f72a00b3ba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f729c001110 tx=0x7f7294016000).stop 2021-10-20T23:23:23.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 shutdown_connections 2021-10-20T23:23:23.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f72800535b0 0x7f7280055a70 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0x7f729c00d000 tx=0x7f729c007c10).stop 2021-10-20T23:23:23.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72a00b30d0 0x7f72a00a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a00b0710 0x7f72a00a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 --2- 172.21.15.12:0/67627991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72a00ace70 0x7f72a00b3ba0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:23.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 >> 172.21.15.12:0/67627991 conn(0x7f72a0061140 msgr2=0x7f72a0140ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:23.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 shutdown_connections 2021-10-20T23:23:23.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:23.934+0000 7f72a7246700 1 -- 172.21.15.12:0/67627991 wait complete. 2021-10-20T23:23:23.939 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:23:23.949 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:23:24.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.058+0000 7f67588aa700 1 Processor -- start 2021-10-20T23:23:24.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.058+0000 7f67588aa700 1 -- start start 2021-10-20T23:23:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67540ad030 0x7f6754143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67540673d0 con 0x7f67540b06e0 2021-10-20T23:23:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67540affd0 con 0x7f6754066ff0 2021-10-20T23:23:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67540b0270 con 0x7f67540ad030 2021-10-20T23:23:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f67540b06e0 0x7f67540b0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37966/0 (socket says 172.21.15.12:37966) 2021-10-20T23:23:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 -- 172.21.15.12:0/512463364 learned_addr learned my addr 172.21.15.12:0/512463364 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6751d9b700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67540ad030 0x7f6754143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106603105 0 0) 0x7f67540673d0 con 0x7f67540b06e0 2021-10-20T23:23:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6734003260 con 0x7f67540b06e0 2021-10-20T23:23:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564539877 0 0) 0x7f67540affd0 con 0x7f6754066ff0 2021-10-20T23:23:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67540673d0 con 0x7f6754066ff0 2021-10-20T23:23:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 513621100 0 0) 0x7f6734003260 con 0x7f67540b06e0 2021-10-20T23:23:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67540ad030 msgr2=0x7f6754143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67540ad030 0x7f6754143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 >> v1:172.21.15.31:6789/0 conn(0x7f6754066ff0 legacy=0x7f67541438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540af3a0 con 0x7f67540b06e0 2021-10-20T23:23:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f674c001a00 con 0x7f67540b06e0 2021-10-20T23:23:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 >> v1:172.21.15.12:6789/0 conn(0x7f67540b06e0 legacy=0x7f67540b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6734003910 0x7f6734003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6734004500 0x7f6734004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6734004e70 0x7f673400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67540b0270 con 0x7f6734004e70 2021-10-20T23:23:24.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673400bc40 con 0x7f6734004500 2021-10-20T23:23:24.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673400bdd0 con 0x7f6734003910 2021-10-20T23:23:24.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6734004e70 0x7f673400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6751d9b700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6734004500 0x7f6734004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675259c700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6734003910 0x7f6734003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 -- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6734003910 msgr2=0x7f6734003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6734003910 0x7f6734003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 -- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6734004500 msgr2=0x7f6734004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6734004500 0x7f6734004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 -- 172.21.15.12:0/512463364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734003260 con 0x7f6734004e70 2021-10-20T23:23:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6734004e70 0x7f673400b750 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f67340054d0 tx=0x7f67540afd60).ready entity=mon.0 client_cookie=d0fa819c98bff396 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c00cae0 con 0x7f6734004e70 2021-10-20T23:23:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c00cc40 con 0x7f6734004e70 2021-10-20T23:23:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f675159a700 1 -- 172.21.15.12:0/512463364 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c004960 con 0x7f6734004e70 2021-10-20T23:23:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 -- 172.21.15.12:0/512463364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6734004e70 msgr2=0x7f673400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 --2- 172.21.15.12:0/512463364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6734004e70 0x7f673400b750 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f67340054d0 tx=0x7f67540afd60).stop 2021-10-20T23:23:24.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f6752d9d700 1 -- 172.21.15.12:0/512463364 reap_dead start 2021-10-20T23:23:24.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 -- 172.21.15.12:0/512463364 shutdown_connections 2021-10-20T23:23:24.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 -- 172.21.15.12:0/512463364 >> 172.21.15.12:0/512463364 conn(0x7f675405f6b0 msgr2=0x7f675405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:24.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 -- 172.21.15.12:0/512463364 shutdown_connections 2021-10-20T23:23:24.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.062+0000 7f67588aa700 1 -- 172.21.15.12:0/512463364 wait complete. 2021-10-20T23:23:24.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f67588aa700 1 Processor -- start 2021-10-20T23:23:24.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f67588aa700 1 -- start start 2021-10-20T23:23:24.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f67588aa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67541428c0 0x7f67540b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f67588aa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6754148d00 0x7f675413c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f67588aa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f675409e8b0 0x7f675413cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f67588aa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675413d2b0 con 0x7f6754148d00 2021-10-20T23:23:24.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f67588aa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6754142ca0 con 0x7f675409e8b0 2021-10-20T23:23:24.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f67588aa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67541496f0 con 0x7f67541428c0 2021-10-20T23:23:24.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f6751d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6754148d00 0x7f675413c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f6751d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6754148d00 0x7f675413c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39382/0 (socket says 172.21.15.12:39382) 2021-10-20T23:23:24.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f6751d9b700 1 -- 172.21.15.12:0/1053005693 learned_addr learned my addr 172.21.15.12:0/1053005693 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:24.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f6752d9d700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f675409e8b0 0x7f675413cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f675259c700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67541428c0 0x7f67540b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f6751d9b700 1 -- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67541428c0 msgr2=0x7f67540b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f6751d9b700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67541428c0 0x7f67540b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f6751d9b700 1 -- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f675409e8b0 msgr2=0x7f675413cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.066+0000 7f6751d9b700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f675409e8b0 0x7f675413cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f6751d9b700 1 -- 172.21.15.12:0/1053005693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675413e380 con 0x7f6754148d00 2021-10-20T23:23:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f6752d9d700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f675409e8b0 0x7f675413cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f6751d9b700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6754148d00 0x7f675413c8d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f674400b000 tx=0x7f6744006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f674b7fe700 1 -- 172.21.15.12:0/1053005693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674400b540 con 0x7f6754148d00 2021-10-20T23:23:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f674b7fe700 1 -- 172.21.15.12:0/1053005693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674400f940 con 0x7f6754148d00 2021-10-20T23:23:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f674b7fe700 1 -- 172.21.15.12:0/1053005693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674400fce0 con 0x7f6754148d00 2021-10-20T23:23:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67540b3ca0 con 0x7f6754148d00 2021-10-20T23:23:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67540b36f0 con 0x7f6754148d00 2021-10-20T23:23:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675413e080 con 0x7f6754148d00 2021-10-20T23:23:24.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f674b7fe700 1 -- 172.21.15.12:0/1053005693 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6744014440 con 0x7f6754148d00 2021-10-20T23:23:24.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.070+0000 7f674b7fe700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f67380536d0 0x7f6738055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.074+0000 7f674b7fe700 1 -- 172.21.15.12:0/1053005693 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f674406cbb0 con 0x7f6754148d00 2021-10-20T23:23:24.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.074+0000 7f675259c700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f67380536d0 0x7f6738055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.074+0000 7f675259c700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f67380536d0 0x7f6738055b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f673c003000 tx=0x7f673c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.078+0000 7f674b7fe700 1 -- 172.21.15.12:0/1053005693 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6744043bd0 con 0x7f6754148d00 2021-10-20T23:23:24.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.242+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f6754057350 con 0x7f6754148d00 2021-10-20T23:23:24.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.258+0000 7f674b7fe700 1 -- 172.21.15.12:0/1053005693 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v24) v1 ==== 188+0+0 (secure 0 0 0) 0x7f6744018070 con 0x7f6754148d00 2021-10-20T23:23:24.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f67380536d0 msgr2=0x7f6738055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f67380536d0 0x7f6738055b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f673c003000 tx=0x7f673c009040).stop 2021-10-20T23:23:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6754148d00 msgr2=0x7f675413c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6754148d00 0x7f675413c8d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f674400b000 tx=0x7f6744006df0).stop 2021-10-20T23:23:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 shutdown_connections 2021-10-20T23:23:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f67380536d0 0x7f6738055b90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f675409e8b0 0x7f675413cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6754148d00 0x7f675413c8d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 --2- 172.21.15.12:0/1053005693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67541428c0 0x7f67540b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 >> 172.21.15.12:0/1053005693 conn(0x7f675405f6b0 msgr2=0x7f6754145e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 shutdown_connections 2021-10-20T23:23:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.262+0000 7f67588aa700 1 -- 172.21.15.12:0/1053005693 wait complete. 2021-10-20T23:23:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 9 and data pool 10 2021-10-20T23:23:24.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:23:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.382+0000 7fd059e06700 1 Processor -- start 2021-10-20T23:23:24.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.382+0000 7fd059e06700 1 -- start start 2021-10-20T23:23:24.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd059e06700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0540b30d0 0x7fd054143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd059e06700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd054143920 con 0x7fd0540b0710 2021-10-20T23:23:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd058e04700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd0540b0710 0x7fd054142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37994/0 (socket says 172.21.15.12:37994) 2021-10-20T23:23:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd058e04700 1 -- 172.21.15.12:0/2910830190 learned_addr learned my addr 172.21.15.12:0/2910830190 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd059e06700 1 -- 172.21.15.12:0/2910830190 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540b0af0 con 0x7fd0540ace70 2021-10-20T23:23:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd059e06700 1 -- 172.21.15.12:0/2910830190 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0540ae680 con 0x7fd0540b30d0 2021-10-20T23:23:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213127497 0 0) 0x7fd054143920 con 0x7fd0540b0710 2021-10-20T23:23:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd038003260 con 0x7fd0540b0710 2021-10-20T23:23:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd053fff700 1 --2- 172.21.15.12:0/2910830190 >> v2:172.21.15.31:3300/0 conn(0x7fd0540b30d0 0x7fd054143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943165352 0 0) 0x7fd038003260 con 0x7fd0540b0710 2021-10-20T23:23:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 >> v2:172.21.15.31:3300/0 conn(0x7fd0540b30d0 msgr2=0x7fd054143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 --2- 172.21.15.12:0/2910830190 >> v2:172.21.15.31:3300/0 conn(0x7fd0540b30d0 0x7fd054143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 >> v1:172.21.15.31:6789/0 conn(0x7fd0540ace70 legacy=0x7fd05413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540ae920 con 0x7fd0540b0710 2021-10-20T23:23:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fd048001660 con 0x7fd0540b0710 2021-10-20T23:23:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 >> v1:172.21.15.12:6789/0 conn(0x7fd0540b0710 legacy=0x7fd054142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd038003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd038004500 0x7fd038004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038004ec0 0x7fd03800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540ae680 con 0x7fd038004ec0 2021-10-20T23:23:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03800bd80 con 0x7fd038004500 2021-10-20T23:23:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03800bf40 con 0x7fd0380037a0 2021-10-20T23:23:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd058e04700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd038003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd059605700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038004ec0 0x7fd03800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.386+0000 7fd053fff700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd038004500 0x7fd038004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd058e04700 1 -- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd038004500 msgr2=0x7fd038004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd058e04700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd038004500 0x7fd038004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd058e04700 1 -- 172.21.15.12:0/2910830190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038004ec0 msgr2=0x7fd03800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd058e04700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038004ec0 0x7fd03800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd058e04700 1 -- 172.21.15.12:0/2910830190 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038003260 con 0x7fd0380037a0 2021-10-20T23:23:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059605700 1 -- 172.21.15.12:0/2910830190 reap_dead start 2021-10-20T23:23:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd058e04700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd038003be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd048001370 tx=0x7fd054061720).ready entity=mon.2 client_cookie=5cfd5b0e06d5e207 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0480070d0 con 0x7fd0380037a0 2021-10-20T23:23:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd048007230 con 0x7fd0380037a0 2021-10-20T23:23:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd0537fe700 1 -- 172.21.15.12:0/2910830190 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd04800c8f0 con 0x7fd0380037a0 2021-10-20T23:23:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059e06700 1 -- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 msgr2=0x7fd038003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059e06700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd038003be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd048001370 tx=0x7fd054061720).stop 2021-10-20T23:23:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059e06700 1 -- 172.21.15.12:0/2910830190 shutdown_connections 2021-10-20T23:23:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059e06700 1 --2- 172.21.15.12:0/2910830190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd038003be0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059e06700 1 -- 172.21.15.12:0/2910830190 >> 172.21.15.12:0/2910830190 conn(0x7fd054061140 msgr2=0x7fd054062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059e06700 1 -- 172.21.15.12:0/2910830190 shutdown_connections 2021-10-20T23:23:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059e06700 1 -- 172.21.15.12:0/2910830190 wait complete. 2021-10-20T23:23:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059e06700 1 Processor -- start 2021-10-20T23:23:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.390+0000 7fd059e06700 1 -- start start 2021-10-20T23:23:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059e06700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd054064c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059e06700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd054145120 0x7fd054144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059e06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd054066c90 0x7fd05413fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059e06700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054143e70 con 0x7fd054145120 2021-10-20T23:23:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059e06700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05414dcb0 con 0x7fd054066c90 2021-10-20T23:23:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059e06700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd054067880 con 0x7fd0380037a0 2021-10-20T23:23:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd053fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd054145120 0x7fd054144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd058e04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd054064c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd053fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd054145120 0x7fd054144340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39414/0 (socket says 172.21.15.12:39414) 2021-10-20T23:23:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd053fff700 1 -- 172.21.15.12:0/2798522994 learned_addr learned my addr 172.21.15.12:0/2798522994 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd058e04700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd054064c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45170/0 (socket says 172.21.15.12:45170) 2021-10-20T23:23:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059605700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd054066c90 0x7fd05413fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd053fff700 1 -- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 msgr2=0x7fd054064c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd053fff700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd054064c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd053fff700 1 -- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd054066c90 msgr2=0x7fd05413fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd053fff700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd054066c90 0x7fd05413fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd053fff700 1 -- 172.21.15.12:0/2798522994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054144830 con 0x7fd054145120 2021-10-20T23:23:24.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd058e04700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd054064c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:24.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd053fff700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd054145120 0x7fd054144340 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd04000b000 tx=0x7fd040006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd051ffb700 1 -- 172.21.15.12:0/2798522994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd040011e70 con 0x7fd054145120 2021-10-20T23:23:24.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd051ffb700 1 -- 172.21.15.12:0/2798522994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04000f8e0 con 0x7fd054145120 2021-10-20T23:23:24.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd051ffb700 1 -- 172.21.15.12:0/2798522994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd04000fc40 con 0x7fd054145120 2021-10-20T23:23:24.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05414da10 con 0x7fd054145120 2021-10-20T23:23:24.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd054147260 con 0x7fd054145120 2021-10-20T23:23:24.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.394+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd054057350 con 0x7fd054145120 2021-10-20T23:23:24.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.398+0000 7fd051ffb700 1 -- 172.21.15.12:0/2798522994 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd040014440 con 0x7fd054145120 2021-10-20T23:23:24.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.398+0000 7fd051ffb700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd034053610 0x7fd034055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.398+0000 7fd051ffb700 1 -- 172.21.15.12:0/2798522994 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd04006c470 con 0x7fd054145120 2021-10-20T23:23:24.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.398+0000 7fd058e04700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd034053610 0x7fd034055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.398+0000 7fd058e04700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd034053610 0x7fd034055ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fd048019000 tx=0x7fd048013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.406+0000 7fd051ffb700 1 -- 172.21.15.12:0/2798522994 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd040069e90 con 0x7fd054145120 2021-10-20T23:23:24.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.534+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0540b2c70 con 0x7fd054145120 2021-10-20T23:23:24.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd051ffb700 1 -- 172.21.15.12:0/2798522994 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16286 (secure 0 0 0) 0x7fd040018020 con 0x7fd054145120 2021-10-20T23:23:24.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:24.541 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:23:24.252736+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:23:22.639987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-20T23:23:23.594440+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:23:24.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd034053610 msgr2=0x7fd034055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd034053610 0x7fd034055ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fd048019000 tx=0x7fd048013000).stop 2021-10-20T23:23:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd054145120 msgr2=0x7fd054144340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd054145120 0x7fd054144340 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd04000b000 tx=0x7fd040006df0).stop 2021-10-20T23:23:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 shutdown_connections 2021-10-20T23:23:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd034053610 0x7fd034055ad0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd054066c90 0x7fd05413fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd054145120 0x7fd054144340 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 --2- 172.21.15.12:0/2798522994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0380037a0 0x7fd054064c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 >> 172.21.15.12:0/2798522994 conn(0x7fd054061140 msgr2=0x7fd0540b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:24.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 shutdown_connections 2021-10-20T23:23:24.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.538+0000 7fd059e06700 1 -- 172.21.15.12:0/2798522994 wait complete. 2021-10-20T23:23:24.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:23:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b759e700 1 Processor -- start 2021-10-20T23:23:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b759e700 1 -- start start 2021-10-20T23:23:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28b80a9190 0x7f28b8146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28b80b0b80 0x7f28b8146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80b03d0 0x7f28b81401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b80b1140 con 0x7f28b80a9190 2021-10-20T23:23:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b80a9570 con 0x7f28b80b0b80 2021-10-20T23:23:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80b1370 con 0x7f28b80b03d0 2021-10-20T23:23:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28b80a9190 0x7f28b8146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28b80a9190 0x7f28b8146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39420/0 (socket says 172.21.15.12:39420) 2021-10-20T23:23:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b659c700 1 -- 172.21.15.12:0/805591284 learned_addr learned my addr 172.21.15.12:0/805591284 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b6d9d700 1 --2- 172.21.15.12:0/805591284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80b03d0 0x7f28b81401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b5d9b700 1 --2- 172.21.15.12:0/805591284 >> v2:172.21.15.31:3300/0 conn(0x7f28b80b0b80 0x7f28b8146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b659c700 1 -- 172.21.15.12:0/805591284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80b03d0 msgr2=0x7f28b81401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b659c700 1 --2- 172.21.15.12:0/805591284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80b03d0 0x7f28b81401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b659c700 1 -- 172.21.15.12:0/805591284 >> v2:172.21.15.31:3300/0 conn(0x7f28b80b0b80 msgr2=0x7f28b8146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b659c700 1 --2- 172.21.15.12:0/805591284 >> v2:172.21.15.31:3300/0 conn(0x7f28b80b0b80 0x7f28b8146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.658+0000 7f28b659c700 1 -- 172.21.15.12:0/805591284 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80b1610 con 0x7f28b80a9190 2021-10-20T23:23:24.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b659c700 1 --2- 172.21.15.12:0/805591284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80a9190 0x7f28b8146550 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f28a8002f70 tx=0x7f28a8006eb0).ready entity=mon.0 client_cookie=69198a7c7341718a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b559a700 1 -- 172.21.15.12:0/805591284 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28a800d570 con 0x7f28b80a9190 2021-10-20T23:23:24.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b559a700 1 -- 172.21.15.12:0/805591284 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a8000e90 con 0x7f28b80a9190 2021-10-20T23:23:24.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b559a700 1 -- 172.21.15.12:0/805591284 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28a800d900 con 0x7f28b80a9190 2021-10-20T23:23:24.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b759e700 1 -- 172.21.15.12:0/805591284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80a9190 msgr2=0x7f28b8146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b759e700 1 --2- 172.21.15.12:0/805591284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80a9190 0x7f28b8146550 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f28a8002f70 tx=0x7f28a8006eb0).stop 2021-10-20T23:23:24.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b759e700 1 -- 172.21.15.12:0/805591284 shutdown_connections 2021-10-20T23:23:24.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b759e700 1 --2- 172.21.15.12:0/805591284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80b03d0 0x7f28b81401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b759e700 1 --2- 172.21.15.12:0/805591284 >> v2:172.21.15.31:3300/0 conn(0x7f28b80b0b80 0x7f28b8146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b759e700 1 --2- 172.21.15.12:0/805591284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80a9190 0x7f28b8146550 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b759e700 1 -- 172.21.15.12:0/805591284 >> 172.21.15.12:0/805591284 conn(0x7f28b8061140 msgr2=0x7f28b8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:24.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b759e700 1 -- 172.21.15.12:0/805591284 shutdown_connections 2021-10-20T23:23:24.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.662+0000 7f28b759e700 1 -- 172.21.15.12:0/805591284 wait complete. 2021-10-20T23:23:24.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 Processor -- start 2021-10-20T23:23:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 -- start start 2021-10-20T23:23:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80a9190 0x7f28b80647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b80b03d0 0x7f28b8063ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80b0b80 0x7f28b8067350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8152af0 con 0x7f28b80b0b80 2021-10-20T23:23:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8152d10 con 0x7f28b80b03d0 2021-10-20T23:23:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8063870 con 0x7f28b80a9190 2021-10-20T23:23:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80b0b80 0x7f28b8067350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80b0b80 0x7f28b8067350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39430/0 (socket says 172.21.15.12:39430) 2021-10-20T23:23:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b6d9d700 1 -- 172.21.15.12:0/2514056073 learned_addr learned my addr 172.21.15.12:0/2514056073 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b659c700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80a9190 0x7f28b80647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b5d9b700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b80b03d0 0x7f28b8063ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b6d9d700 1 -- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80a9190 msgr2=0x7f28b80647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b6d9d700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80a9190 0x7f28b80647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b6d9d700 1 -- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b80b03d0 msgr2=0x7f28b8063ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b6d9d700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b80b03d0 0x7f28b8063ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b6d9d700 1 -- 172.21.15.12:0/2514056073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a800b1e0 con 0x7f28b80b0b80 2021-10-20T23:23:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b6d9d700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80b0b80 0x7f28b8067350 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f28b0006e00 tx=0x7f28b00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28a77fe700 1 -- 172.21.15.12:0/2514056073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b0012600 con 0x7f28b80b0b80 2021-10-20T23:23:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28a77fe700 1 -- 172.21.15.12:0/2514056073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0012760 con 0x7f28b80b0b80 2021-10-20T23:23:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b80643b0 con 0x7f28b80b0b80 2021-10-20T23:23:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28a77fe700 1 -- 172.21.15.12:0/2514056073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b0012ac0 con 0x7f28b80b0b80 2021-10-20T23:23:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.666+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b80ae7f0 con 0x7f28b80b0b80 2021-10-20T23:23:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.670+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b8057350 con 0x7f28b80b0b80 2021-10-20T23:23:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.670+0000 7f28a77fe700 1 -- 172.21.15.12:0/2514056073 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f28b0022070 con 0x7f28b80b0b80 2021-10-20T23:23:24.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.670+0000 7f28a77fe700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28940536a0 0x7f2894055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.670+0000 7f28a77fe700 1 -- 172.21.15.12:0/2514056073 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f28b006c0e0 con 0x7f28b80b0b80 2021-10-20T23:23:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.670+0000 7f28b659c700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28940536a0 0x7f2894055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.670+0000 7f28b659c700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28940536a0 0x7f2894055b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f28a801c000 tx=0x7f28a8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.678+0000 7f28a77fe700 1 -- 172.21.15.12:0/2514056073 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28b0042f50 con 0x7f28b80b0b80 2021-10-20T23:23:24.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.802+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28b8147430 con 0x7f28b80b0b80 2021-10-20T23:23:24.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28a77fe700 1 -- 172.21.15.12:0/2514056073 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f28b0016090 con 0x7f28b80b0b80 2021-10-20T23:23:24.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:24.809 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:23:24.252736+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:23:22.639987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-20T23:23:23.594440+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:23:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28940536a0 msgr2=0x7f2894055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28940536a0 0x7f2894055b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f28a801c000 tx=0x7f28a8015000).stop 2021-10-20T23:23:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80b0b80 msgr2=0x7f28b8067350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80b0b80 0x7f28b8067350 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f28b0006e00 tx=0x7f28b00091d0).stop 2021-10-20T23:23:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 shutdown_connections 2021-10-20T23:23:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f28940536a0 0x7f2894055b60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28b80b0b80 0x7f28b8067350 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b80b03d0 0x7f28b8063ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 --2- 172.21.15.12:0/2514056073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28b80a9190 0x7f28b80647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 >> 172.21.15.12:0/2514056073 conn(0x7f28b8061140 msgr2=0x7f28b813bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 shutdown_connections 2021-10-20T23:23:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.806+0000 7f28b759e700 1 -- 172.21.15.12:0/2514056073 wait complete. 2021-10-20T23:23:24.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:23:24.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.922+0000 7fe3cb2ca700 1 Processor -- start 2021-10-20T23:23:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.922+0000 7fe3cb2ca700 1 -- start start 2021-10-20T23:23:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.922+0000 7fe3cb2ca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3c4061320 0x7fe3c4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c40aecf0 con 0x7fe3c4140440 2021-10-20T23:23:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c40b6f20 con 0x7fe3c40ad5c0 2021-10-20T23:23:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40aef20 con 0x7fe3c4061320 2021-10-20T23:23:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3caac9700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe3c4140440 0x7fe3c4146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38032/0 (socket says 172.21.15.12:38032) 2021-10-20T23:23:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3caac9700 1 -- 172.21.15.12:0/456331527 learned_addr learned my addr 172.21.15.12:0/456331527 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3ca2c8700 1 --2- 172.21.15.12:0/456331527 >> v2:172.21.15.31:3300/0 conn(0x7fe3c4061320 0x7fe3c4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614241828 0 0) 0x7fe3c40aecf0 con 0x7fe3c4140440 2021-10-20T23:23:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3ac003260 con 0x7fe3c4140440 2021-10-20T23:23:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3712377342 0 0) 0x7fe3ac003260 con 0x7fe3c4140440 2021-10-20T23:23:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 >> v2:172.21.15.31:3300/0 conn(0x7fe3c4061320 msgr2=0x7fe3c4061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 --2- 172.21.15.12:0/456331527 >> v2:172.21.15.31:3300/0 conn(0x7fe3c4061320 0x7fe3c4061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 >> v1:172.21.15.31:6789/0 conn(0x7fe3c40ad5c0 legacy=0x7fe3c40b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40af1c0 con 0x7fe3c4140440 2021-10-20T23:23:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fe3bc0019e0 con 0x7fe3c4140440 2021-10-20T23:23:24.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 >> v1:172.21.15.12:6789/0 conn(0x7fe3c4140440 legacy=0x7fe3c4146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3ac003750 0x7fe3ac003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3ac004500 0x7fe3ac004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3ac004e70 0x7fe3ac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40aef20 con 0x7fe3ac003750 2021-10-20T23:23:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac00bc70 con 0x7fe3ac004e70 2021-10-20T23:23:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac00be30 con 0x7fe3ac004500 2021-10-20T23:23:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3ca2c8700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3ac003750 0x7fe3ac003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3caac9700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3ac004e70 0x7fe3ac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c9ac7700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3ac004500 0x7fe3ac004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3ca2c8700 1 -- 172.21.15.12:0/456331527 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3ac004500 msgr2=0x7fe3ac004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3ca2c8700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3ac004500 0x7fe3ac004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3ca2c8700 1 -- 172.21.15.12:0/456331527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3ac004e70 msgr2=0x7fe3ac00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3ca2c8700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3ac004e70 0x7fe3ac00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3caac9700 1 -- 172.21.15.12:0/456331527 reap_dead start 2021-10-20T23:23:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3ca2c8700 1 -- 172.21.15.12:0/456331527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac003260 con 0x7fe3ac003750 2021-10-20T23:23:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3ca2c8700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3ac003750 0x7fe3ac003b30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fe3c000c000 tx=0x7fe3c0006df0).ready entity=mon.0 client_cookie=75914d18d675d511 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c000e830 con 0x7fe3ac003750 2021-10-20T23:23:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000e990 con 0x7fe3ac003750 2021-10-20T23:23:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3c92c6700 1 -- 172.21.15.12:0/456331527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c000ecf0 con 0x7fe3ac003750 2021-10-20T23:23:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/456331527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3ac003750 msgr2=0x7fe3ac003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3ac003750 0x7fe3ac003b30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fe3c000c000 tx=0x7fe3c0006df0).stop 2021-10-20T23:23:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/456331527 shutdown_connections 2021-10-20T23:23:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 --2- 172.21.15.12:0/456331527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3ac003750 0x7fe3ac003b30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/456331527 >> 172.21.15.12:0/456331527 conn(0x7fe3c4066de0 msgr2=0x7fe3c40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/456331527 shutdown_connections 2021-10-20T23:23:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.926+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/456331527 wait complete. 2021-10-20T23:23:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 Processor -- start 2021-10-20T23:23:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 -- start start 2021-10-20T23:23:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3ac003750 0x7fe3c4155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4156000 0x7fe3c40ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40acd20 0x7fe3c413f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40ad1a0 con 0x7fe3c4156000 2021-10-20T23:23:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40aa7f0 con 0x7fe3ac003750 2021-10-20T23:23:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40ab720 con 0x7fe3c40acd20 2021-10-20T23:23:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3c9ac7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4156000 0x7fe3c40ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3c9ac7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4156000 0x7fe3c40ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39446/0 (socket says 172.21.15.12:39446) 2021-10-20T23:23:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3c9ac7700 1 -- 172.21.15.12:0/2412541322 learned_addr learned my addr 172.21.15.12:0/2412541322 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3caac9700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40acd20 0x7fe3c413f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3ca2c8700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3ac003750 0x7fe3c4155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3c9ac7700 1 -- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40acd20 msgr2=0x7fe3c413f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3c9ac7700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40acd20 0x7fe3c413f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3c9ac7700 1 -- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3ac003750 msgr2=0x7fe3c4155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3c9ac7700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3ac003750 0x7fe3c4155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3c9ac7700 1 -- 172.21.15.12:0/2412541322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40aaa20 con 0x7fe3c4156000 2021-10-20T23:23:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3caac9700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40acd20 0x7fe3c413f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3c9ac7700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4156000 0x7fe3c40ac830 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fe3c40b0250 tx=0x7fe3b40079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3b37fe700 1 -- 172.21.15.12:0/2412541322 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3b4011780 con 0x7fe3c4156000 2021-10-20T23:23:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3b37fe700 1 -- 172.21.15.12:0/2412541322 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b40118e0 con 0x7fe3c4156000 2021-10-20T23:23:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c40aacc0 con 0x7fe3c4156000 2021-10-20T23:23:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3b37fe700 1 -- 172.21.15.12:0/2412541322 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3b4011c40 con 0x7fe3c4156000 2021-10-20T23:23:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4147aa0 con 0x7fe3c4156000 2021-10-20T23:23:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.930+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c40aae50 con 0x7fe3c4156000 2021-10-20T23:23:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.934+0000 7fe3b37fe700 1 -- 172.21.15.12:0/2412541322 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe3b401b030 con 0x7fe3c4156000 2021-10-20T23:23:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.934+0000 7fe3b37fe700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053640 0x7fe3a4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.934+0000 7fe3b37fe700 1 -- 172.21.15.12:0/2412541322 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe3b406bc50 con 0x7fe3c4156000 2021-10-20T23:23:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.934+0000 7fe3ca2c8700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053640 0x7fe3a4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.934+0000 7fe3ca2c8700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053640 0x7fe3a4055b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fe3c001b000 tx=0x7fe3c0019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:24.938+0000 7fe3b37fe700 1 -- 172.21.15.12:0/2412541322 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3b4042b40 con 0x7fe3c4156000 2021-10-20T23:23:25.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.102+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe3c40af460 con 0x7fe3c4156000 2021-10-20T23:23:25.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.258+0000 7fe3b37fe700 1 -- 172.21.15.12:0/2412541322 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe3b4046160 con 0x7fe3c4156000 2021-10-20T23:23:25.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053640 msgr2=0x7fe3a4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053640 0x7fe3a4055b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fe3c001b000 tx=0x7fe3c0019000).stop 2021-10-20T23:23:25.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4156000 msgr2=0x7fe3c40ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4156000 0x7fe3c40ac830 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fe3c40b0250 tx=0x7fe3b40079e0).stop 2021-10-20T23:23:25.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 shutdown_connections 2021-10-20T23:23:25.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053640 0x7fe3a4055b00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40acd20 0x7fe3c413f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4156000 0x7fe3c40ac830 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 --2- 172.21.15.12:0/2412541322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3ac003750 0x7fe3c4155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 >> 172.21.15.12:0/2412541322 conn(0x7fe3c4066de0 msgr2=0x7fe3c41442e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:25.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 shutdown_connections 2021-10-20T23:23:25.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.262+0000 7fe3cb2ca700 1 -- 172.21.15.12:0/2412541322 wait complete. 2021-10-20T23:23:25.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.390+0000 7ff315e80700 1 Processor -- start 2021-10-20T23:23:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.390+0000 7ff315e80700 1 -- start start 2021-10-20T23:23:25.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.390+0000 7ff315e80700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad320 0x7ff3100af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.390+0000 7ff315e80700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff3100ad850 0x7ff3100a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100afda0 con 0x7ff3100af2c0 2021-10-20T23:23:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31005c610 con 0x7ff3100ad850 2021-10-20T23:23:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff310140800 con 0x7ff3100ad320 2021-10-20T23:23:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff314e7e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff3100af2c0 0x7ff310143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38048/0 (socket says 172.21.15.12:38048) 2021-10-20T23:23:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff314e7e700 1 -- 172.21.15.12:0/1683549419 learned_addr learned my addr 172.21.15.12:0/1683549419 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff31567f700 1 --2- 172.21.15.12:0/1683549419 >> v2:172.21.15.12:3300/0 conn(0x7ff3100ad850 0x7ff3100a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff30ffff700 1 --2- 172.21.15.12:0/1683549419 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad320 0x7ff3100af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff30f7fe700 1 -- 172.21.15.12:0/1683549419 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050739240 0 0) 0x7ff3100afda0 con 0x7ff3100af2c0 2021-10-20T23:23:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff30f7fe700 1 -- 172.21.15.12:0/1683549419 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2fc003260 con 0x7ff3100af2c0 2021-10-20T23:23:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff31567f700 1 -- 172.21.15.12:0/1683549419 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad320 msgr2=0x7ff3100af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff30f7fe700 1 -- 172.21.15.12:0/1683549419 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4032496369 0 0) 0x7ff2fc003260 con 0x7ff3100af2c0 2021-10-20T23:23:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff31567f700 1 --2- 172.21.15.12:0/1683549419 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad320 0x7ff3100af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff31567f700 1 -- 172.21.15.12:0/1683549419 >> v1:172.21.15.12:6789/0 conn(0x7ff3100af2c0 legacy=0x7ff310143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff31567f700 1 -- 172.21.15.12:0/1683549419 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff310143860 con 0x7ff3100ad850 2021-10-20T23:23:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff31567f700 1 --2- 172.21.15.12:0/1683549419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad850 0x7ff3100a8cb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7ff300001800 tx=0x7ff3080091d0).ready entity=mon.0 client_cookie=5ea6bc48ae8d2fca server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff30f7fe700 1 -- 172.21.15.12:0/1683549419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff300001660 con 0x7ff3100ad850 2021-10-20T23:23:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff30f7fe700 1 -- 172.21.15.12:0/1683549419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30800f510 con 0x7ff3100ad850 2021-10-20T23:23:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff30f7fe700 1 -- 172.21.15.12:0/1683549419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff30800f680 con 0x7ff3100ad850 2021-10-20T23:23:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 -- 172.21.15.12:0/1683549419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad850 msgr2=0x7ff3100a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 --2- 172.21.15.12:0/1683549419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad850 0x7ff3100a8cb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7ff300001800 tx=0x7ff3080091d0).stop 2021-10-20T23:23:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 -- 172.21.15.12:0/1683549419 shutdown_connections 2021-10-20T23:23:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 --2- 172.21.15.12:0/1683549419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad850 0x7ff3100a8cb0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 --2- 172.21.15.12:0/1683549419 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad320 0x7ff3100af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 -- 172.21.15.12:0/1683549419 >> 172.21.15.12:0/1683549419 conn(0x7ff310061140 msgr2=0x7ff310062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 -- 172.21.15.12:0/1683549419 shutdown_connections 2021-10-20T23:23:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.394+0000 7ff315e80700 1 -- 172.21.15.12:0/1683549419 wait complete. 2021-10-20T23:23:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 Processor -- start 2021-10-20T23:23:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 -- start start 2021-10-20T23:23:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad320 0x7ff310151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad850 0x7ff3100a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3100af2c0 0x7ff310141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff310142bf0 con 0x7ff3100ad320 2021-10-20T23:23:25.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3101513a0 con 0x7ff3100af2c0 2021-10-20T23:23:25.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff310151640 con 0x7ff3100ad850 2021-10-20T23:23:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff314e7e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad320 0x7ff310151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff314e7e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad320 0x7ff310151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39460/0 (socket says 172.21.15.12:39460) 2021-10-20T23:23:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff314e7e700 1 -- 172.21.15.12:0/1805338310 learned_addr learned my addr 172.21.15.12:0/1805338310 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff31567f700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3100af2c0 0x7ff310141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff30ffff700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad850 0x7ff3100a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff314e7e700 1 -- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad850 msgr2=0x7ff3100a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff314e7e700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad850 0x7ff3100a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff314e7e700 1 -- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3100af2c0 msgr2=0x7ff310141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff314e7e700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3100af2c0 0x7ff310141c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff314e7e700 1 -- 172.21.15.12:0/1805338310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff308009470 con 0x7ff3100ad320 2021-10-20T23:23:25.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff314e7e700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad320 0x7ff310151d80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff3000018c0 tx=0x7ff300001a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:25.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff30dffb700 1 -- 172.21.15.12:0/1805338310 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff300007170 con 0x7ff3100ad320 2021-10-20T23:23:25.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff30dffb700 1 -- 172.21.15.12:0/1805338310 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3000072d0 con 0x7ff3100ad320 2021-10-20T23:23:25.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff30dffb700 1 -- 172.21.15.12:0/1805338310 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff300004920 con 0x7ff3100ad320 2021-10-20T23:23:25.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3101518e0 con 0x7ff3100ad320 2021-10-20T23:23:25.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.398+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff310141060 con 0x7ff3100ad320 2021-10-20T23:23:25.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.402+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff310151a70 con 0x7ff3100ad320 2021-10-20T23:23:25.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.402+0000 7ff30dffb700 1 -- 172.21.15.12:0/1805338310 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff30001b070 con 0x7ff3100ad320 2021-10-20T23:23:25.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.402+0000 7ff30dffb700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2f0053610 0x7ff2f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.402+0000 7ff30dffb700 1 -- 172.21.15.12:0/1805338310 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff30006b210 con 0x7ff3100ad320 2021-10-20T23:23:25.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.402+0000 7ff30ffff700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2f0053610 0x7ff2f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.402+0000 7ff30ffff700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2f0053610 0x7ff2f0055ad0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff30400f000 tx=0x7ff30400f040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:25.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.410+0000 7ff30dffb700 1 -- 172.21.15.12:0/1805338310 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff300042210 con 0x7ff3100ad320 2021-10-20T23:23:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.574+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff310057350 con 0x7ff3100ad320 2021-10-20T23:23:25.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.574+0000 7ff30dffb700 1 -- 172.21.15.12:0/1805338310 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2489 (secure 0 0 0) 0x7ff300045830 con 0x7ff3100ad320 2021-10-20T23:23:25.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:25.579 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:23:24.253029+0000","modified":"2021-10-20T23:23:25.255689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3232971526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3232971526},{"type":"v1","addr":"172.21.15.12:6835","nonce":3232971526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-20T23:23:25.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2f0053610 msgr2=0x7ff2f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2f0053610 0x7ff2f0055ad0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff30400f000 tx=0x7ff30400f040).stop 2021-10-20T23:23:25.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad320 msgr2=0x7ff310151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad320 0x7ff310151d80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff3000018c0 tx=0x7ff300001a90).stop 2021-10-20T23:23:25.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 shutdown_connections 2021-10-20T23:23:25.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2f0053610 0x7ff2f0055ad0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3100af2c0 0x7ff310141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3100ad850 0x7ff3100a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 --2- 172.21.15.12:0/1805338310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3100ad320 0x7ff310151d80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 >> 172.21.15.12:0/1805338310 conn(0x7ff310061140 msgr2=0x7ff31013f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:25.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 shutdown_connections 2021-10-20T23:23:25.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.578+0000 7ff315e80700 1 -- 172.21.15.12:0/1805338310 wait complete. 2021-10-20T23:23:25.584 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2021-10-20T23:23:25.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:23:25.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.686+0000 7fbf212c8700 1 Processor -- start 2021-10-20T23:23:25.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.686+0000 7fbf212c8700 1 -- start start 2021-10-20T23:23:25.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c060100 0x7fbf1c0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf1c067300 0x7fbf1c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0aabb0 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1c0604e0 con 0x7fbf1c067300 2021-10-20T23:23:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c066ea0 con 0x7fbf1c060100 2021-10-20T23:23:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf1affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c060100 0x7fbf1c0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf1a7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf1c067300 0x7fbf1c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf1a7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf1c067300 0x7fbf1c1438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:54442/0 (socket says 172.21.15.12:54442) 2021-10-20T23:23:25.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf1a7fc700 1 -- 172.21.15.12:0/3209754019 learned_addr learned my addr 172.21.15.12:0/3209754019 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:25.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf1a7fc700 1 -- 172.21.15.12:0/3209754019 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c060100 msgr2=0x7fbf1c0b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:25.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf1a7fc700 1 --2- 172.21.15.12:0/3209754019 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c060100 0x7fbf1c0b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf1a7fc700 1 -- 172.21.15.12:0/3209754019 >> v1:172.21.15.31:6789/0 conn(0x7fbf1c0b4c40 legacy=0x7fbf1c144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf1a7fc700 1 -- 172.21.15.12:0/3209754019 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0b33b0 con 0x7fbf1c067300 2021-10-20T23:23:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf1a7fc700 1 --2- 172.21.15.12:0/3209754019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 0x7fbf1c1438f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbf04002f70 tx=0x7fbf04006eb0).ready entity=mon.1 client_cookie=84775d5e5f4a6a97 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf19ffb700 1 -- 172.21.15.12:0/3209754019 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0400d570 con 0x7fbf1c067300 2021-10-20T23:23:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf19ffb700 1 -- 172.21.15.12:0/3209754019 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04000e90 con 0x7fbf1c067300 2021-10-20T23:23:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf19ffb700 1 -- 172.21.15.12:0/3209754019 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0400d900 con 0x7fbf1c067300 2021-10-20T23:23:25.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 -- 172.21.15.12:0/3209754019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 msgr2=0x7fbf1c1438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 --2- 172.21.15.12:0/3209754019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 0x7fbf1c1438f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbf04002f70 tx=0x7fbf04006eb0).stop 2021-10-20T23:23:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 -- 172.21.15.12:0/3209754019 shutdown_connections 2021-10-20T23:23:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 --2- 172.21.15.12:0/3209754019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 0x7fbf1c1438f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 --2- 172.21.15.12:0/3209754019 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c060100 0x7fbf1c0b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 -- 172.21.15.12:0/3209754019 >> 172.21.15.12:0/3209754019 conn(0x7fbf1c05cf30 msgr2=0x7fbf1c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 -- 172.21.15.12:0/3209754019 shutdown_connections 2021-10-20T23:23:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.690+0000 7fbf212c8700 1 -- 172.21.15.12:0/3209754019 wait complete. 2021-10-20T23:23:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf212c8700 1 Processor -- start 2021-10-20T23:23:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf212c8700 1 -- start start 2021-10-20T23:23:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf212c8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf1c060100 0x7fbf1c0a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf212c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 0x7fbf1c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf212c8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c0b4c40 0x7fbf1c09f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf212c8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0ad5c0 con 0x7fbf1c060100 2021-10-20T23:23:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf212c8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0ad7f0 con 0x7fbf1c067300 2021-10-20T23:23:25.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf212c8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0ada90 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf1affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf1c060100 0x7fbf1c0a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf1a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 0x7fbf1c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf1b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c0b4c40 0x7fbf1c09f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf1b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c0b4c40 0x7fbf1c09f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45232/0 (socket says 172.21.15.12:45232) 2021-10-20T23:23:25.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.694+0000 7fbf1b7fe700 1 -- 172.21.15.12:0/3186283239 learned_addr learned my addr 172.21.15.12:0/3186283239 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:25.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf1b7fe700 1 -- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 msgr2=0x7fbf1c1443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf1b7fe700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 0x7fbf1c1443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf1b7fe700 1 -- 172.21.15.12:0/3186283239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf1c060100 msgr2=0x7fbf1c0a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf1b7fe700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf1c060100 0x7fbf1c0a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf1b7fe700 1 -- 172.21.15.12:0/3186283239 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0400b1e0 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf1a7fc700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 0x7fbf1c1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:25.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf1b7fe700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c0b4c40 0x7fbf1c09f7f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbf1c0671e0 tx=0x7fbf14007f40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:25.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf13fff700 1 -- 172.21.15.12:0/3186283239 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14006aa0 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf13fff700 1 -- 172.21.15.12:0/3186283239 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14006c00 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c1503a0 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf13fff700 1 -- 172.21.15.12:0/3186283239 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14007030 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c09ef60 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1c057350 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf13fff700 1 -- 172.21.15.12:0/3186283239 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf14010030 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf13fff700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf00053610 0x7fbf00055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.698+0000 7fbf13fff700 1 -- 172.21.15.12:0/3186283239 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbf1406ba20 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.702+0000 7fbf1affd700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf00053610 0x7fbf00055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.702+0000 7fbf1affd700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf00053610 0x7fbf00055ad0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbf0c00b000 tx=0x7fbf0c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:25.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.710+0000 7fbf13fff700 1 -- 172.21.15.12:0/3186283239 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf14042910 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.834+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf1c0698e0 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf13fff700 1 -- 172.21.15.12:0/3186283239 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16273 (secure 0 0 0) 0x7fbf14045f30 con 0x7fbf1c0b4c40 2021-10-20T23:23:25.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:25.841 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":58,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:23:25.256255+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:23:22.639987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-20T23:23:23.594440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:23:25.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf00053610 msgr2=0x7fbf00055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf00053610 0x7fbf00055ad0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbf0c00b000 tx=0x7fbf0c006df0).stop 2021-10-20T23:23:25.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c0b4c40 msgr2=0x7fbf1c09f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c0b4c40 0x7fbf1c09f7f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbf1c0671e0 tx=0x7fbf14007f40).stop 2021-10-20T23:23:25.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 shutdown_connections 2021-10-20T23:23:25.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf00053610 0x7fbf00055ad0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf1c0b4c40 0x7fbf1c09f7f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1c067300 0x7fbf1c1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 --2- 172.21.15.12:0/3186283239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf1c060100 0x7fbf1c0a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 >> 172.21.15.12:0/3186283239 conn(0x7fbf1c05cf30 msgr2=0x7fbf1c0b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:25.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 shutdown_connections 2021-10-20T23:23:25.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.838+0000 7fbf212c8700 1 -- 172.21.15.12:0/3186283239 wait complete. 2021-10-20T23:23:25.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:23:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f9505563700 1 Processor -- start 2021-10-20T23:23:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f9505563700 1 -- start start 2021-10-20T23:23:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f9505563700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b43c0 0x7f95000b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f9505563700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95001440b0 con 0x7f95000b6960 2021-10-20T23:23:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f9505563700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9500143b70 con 0x7f95000b6580 2021-10-20T23:23:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f9505563700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9500143e10 con 0x7f95000b43c0 2021-10-20T23:23:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94ff7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f95000b6960 0x7f950012ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38080/0 (socket says 172.21.15.12:38080) 2021-10-20T23:23:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94ff7fe700 1 -- 172.21.15.12:0/1179099093 learned_addr learned my addr 172.21.15.12:0/1179099093 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fe7fc700 1 --2- 172.21.15.12:0/1179099093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b43c0 0x7f95000b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fdffb700 1 -- 172.21.15.12:0/1179099093 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977716787 0 0) 0x7f95001440b0 con 0x7f95000b6960 2021-10-20T23:23:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fdffb700 1 -- 172.21.15.12:0/1179099093 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e0003260 con 0x7f95000b6960 2021-10-20T23:23:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fdffb700 1 -- 172.21.15.12:0/1179099093 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900236610 0 0) 0x7f9500143b70 con 0x7f95000b6580 2021-10-20T23:23:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fdffb700 1 -- 172.21.15.12:0/1179099093 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95001440b0 con 0x7f95000b6580 2021-10-20T23:23:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fe7fc700 1 -- 172.21.15.12:0/1179099093 >> v1:172.21.15.31:6789/0 conn(0x7f95000b6580 legacy=0x7f9500061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fe7fc700 1 -- 172.21.15.12:0/1179099093 >> v1:172.21.15.12:6789/0 conn(0x7f95000b6960 legacy=0x7f950012ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fe7fc700 1 -- 172.21.15.12:0/1179099093 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95000615f0 con 0x7f95000b43c0 2021-10-20T23:23:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fe7fc700 1 --2- 172.21.15.12:0/1179099093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b43c0 0x7f95000b5bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f94e8002f70 tx=0x7f94e8006df0).ready entity=mon.2 client_cookie=85932875ea4068ab server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.966+0000 7f94fdffb700 1 -- 172.21.15.12:0/1179099093 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e800d5c0 con 0x7f95000b43c0 2021-10-20T23:23:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f94fdffb700 1 -- 172.21.15.12:0/1179099093 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e8000e90 con 0x7f95000b43c0 2021-10-20T23:23:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f94fdffb700 1 -- 172.21.15.12:0/1179099093 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e800d910 con 0x7f95000b43c0 2021-10-20T23:23:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f9505563700 1 -- 172.21.15.12:0/1179099093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b43c0 msgr2=0x7f95000b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f9505563700 1 --2- 172.21.15.12:0/1179099093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b43c0 0x7f95000b5bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f94e8002f70 tx=0x7f94e8006df0).stop 2021-10-20T23:23:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f9505563700 1 -- 172.21.15.12:0/1179099093 shutdown_connections 2021-10-20T23:23:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f9505563700 1 --2- 172.21.15.12:0/1179099093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b43c0 0x7f95000b5bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f9505563700 1 -- 172.21.15.12:0/1179099093 >> 172.21.15.12:0/1179099093 conn(0x7f950005c490 msgr2=0x7f950005c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f9505563700 1 -- 172.21.15.12:0/1179099093 shutdown_connections 2021-10-20T23:23:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f9505563700 1 -- 172.21.15.12:0/1179099093 wait complete. 2021-10-20T23:23:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f9505563700 1 Processor -- start 2021-10-20T23:23:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.970+0000 7f9505563700 1 -- start start 2021-10-20T23:23:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f9505563700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95000b43c0 0x7f9500127700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f9505563700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b6580 0x7f9500140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f9505563700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95000b6960 0x7f95001413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f9505563700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500153250 con 0x7f95000b43c0 2021-10-20T23:23:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f9505563700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500155950 con 0x7f95000b6960 2021-10-20T23:23:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f9505563700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9500126610 con 0x7f95000b6580 2021-10-20T23:23:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94feffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95000b43c0 0x7f9500127700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94feffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95000b43c0 0x7f9500127700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39488/0 (socket says 172.21.15.12:39488) 2021-10-20T23:23:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94feffd700 1 -- 172.21.15.12:0/3242879043 learned_addr learned my addr 172.21.15.12:0/3242879043 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94fe7fc700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b6580 0x7f9500140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94ff7fe700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95000b6960 0x7f95001413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94feffd700 1 -- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b6580 msgr2=0x7f9500140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94feffd700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b6580 0x7f9500140ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94feffd700 1 -- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95000b6960 msgr2=0x7f95001413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94feffd700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95000b6960 0x7f95001413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94feffd700 1 -- 172.21.15.12:0/3242879043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e800b180 con 0x7f95000b43c0 2021-10-20T23:23:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94ff7fe700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95000b6960 0x7f95001413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94feffd700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95000b43c0 0x7f9500127700 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f95001267a0 tx=0x7f94f0007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94f7fff700 1 -- 172.21.15.12:0/3242879043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94f0012400 con 0x7f95000b43c0 2021-10-20T23:23:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94f7fff700 1 -- 172.21.15.12:0/3242879043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f0012560 con 0x7f95000b43c0 2021-10-20T23:23:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95000b3c50 con 0x7f95000b43c0 2021-10-20T23:23:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f94f7fff700 1 -- 172.21.15.12:0/3242879043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94f00128c0 con 0x7f95000b43c0 2021-10-20T23:23:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95000b3990 con 0x7f95000b43c0 2021-10-20T23:23:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.974+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9500061890 con 0x7f95000b43c0 2021-10-20T23:23:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.978+0000 7f94f7fff700 1 -- 172.21.15.12:0/3242879043 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f94f0019030 con 0x7f95000b43c0 2021-10-20T23:23:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.978+0000 7f94f7fff700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94e40535b0 0x7f94e4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.978+0000 7f94f7fff700 1 -- 172.21.15.12:0/3242879043 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f94f006ae60 con 0x7f95000b43c0 2021-10-20T23:23:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.978+0000 7f94fe7fc700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94e40535b0 0x7f94e4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.978+0000 7f94fe7fc700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94e40535b0 0x7f94e4055a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f94e801a000 tx=0x7f94e8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:25.986+0000 7f94f7fff700 1 -- 172.21.15.12:0/3242879043 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f94f0041e60 con 0x7f95000b43c0 2021-10-20T23:23:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.154+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9500057350 con 0x7f95000b43c0 2021-10-20T23:23:26.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.158+0000 7f94f7fff700 1 -- 172.21.15.12:0/3242879043 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f94f0045480 con 0x7f95000b43c0 2021-10-20T23:23:26.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94e40535b0 msgr2=0x7f94e4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94e40535b0 0x7f94e4055a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f94e801a000 tx=0x7f94e8014000).stop 2021-10-20T23:23:26.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95000b43c0 msgr2=0x7f9500127700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95000b43c0 0x7f9500127700 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f95001267a0 tx=0x7f94f0007ae0).stop 2021-10-20T23:23:26.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 shutdown_connections 2021-10-20T23:23:26.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f94e40535b0 0x7f94e4055a70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95000b6960 0x7f95001413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95000b6580 0x7f9500140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 --2- 172.21.15.12:0/3242879043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95000b43c0 0x7f9500127700 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 >> 172.21.15.12:0/3242879043 conn(0x7f950005c490 msgr2=0x7f9500148890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 shutdown_connections 2021-10-20T23:23:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.162+0000 7f9505563700 1 -- 172.21.15.12:0/3242879043 wait complete. 2021-10-20T23:23:26.168 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:23:26.177 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:23:26.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.290+0000 7fd5e8a5d700 1 Processor -- start 2021-10-20T23:23:26.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.290+0000 7fd5e8a5d700 1 -- start start 2021-10-20T23:23:26.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.290+0000 7fd5e8a5d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 0x7fd5e40b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.290+0000 7fd5e8a5d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5e40a9b70 0x7fd5e40b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.290+0000 7fd5e8a5d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e40aa390 con 0x7fd5e40b00c0 2021-10-20T23:23:26.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.290+0000 7fd5e8a5d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e40ab260 con 0x7fd5e40a9b70 2021-10-20T23:23:26.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.290+0000 7fd5e8a5d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e40b04a0 con 0x7fd5e40b1f10 2021-10-20T23:23:26.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.290+0000 7fd5e259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd5e40b00c0 0x7fd5e40aab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38090/0 (socket says 172.21.15.12:38090) 2021-10-20T23:23:26.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e259c700 1 -- 172.21.15.12:0/3916810159 learned_addr learned my addr 172.21.15.12:0/3916810159 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:26.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e2d9d700 1 --2- 172.21.15.12:0/3916810159 >> v2:172.21.15.31:3300/0 conn(0x7fd5e40a9b70 0x7fd5e40b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e1d9b700 1 --2- 172.21.15.12:0/3916810159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 0x7fd5e40b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e159a700 1 -- 172.21.15.12:0/3916810159 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282814249 0 0) 0x7fd5e40aa390 con 0x7fd5e40b00c0 2021-10-20T23:23:26.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e159a700 1 -- 172.21.15.12:0/3916810159 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c4003260 con 0x7fd5e40b00c0 2021-10-20T23:23:26.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e2d9d700 1 -- 172.21.15.12:0/3916810159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 msgr2=0x7fd5e40b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:26.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e2d9d700 1 --2- 172.21.15.12:0/3916810159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 0x7fd5e40b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e2d9d700 1 -- 172.21.15.12:0/3916810159 >> v1:172.21.15.12:6789/0 conn(0x7fd5e40b00c0 legacy=0x7fd5e40aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e2d9d700 1 -- 172.21.15.12:0/3916810159 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e40aa0f0 con 0x7fd5e40a9b70 2021-10-20T23:23:26.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e2d9d700 1 --2- 172.21.15.12:0/3916810159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e40a9b70 0x7fd5e40b2e30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fd5dc0032f0 tx=0x7fd5dc0091d0).ready entity=mon.1 client_cookie=b75206d077357300 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:26.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e159a700 1 -- 172.21.15.12:0/3916810159 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5dc00b600 con 0x7fd5e40a9b70 2021-10-20T23:23:26.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e159a700 1 -- 172.21.15.12:0/3916810159 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc00b760 con 0x7fd5e40a9b70 2021-10-20T23:23:26.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e159a700 1 -- 172.21.15.12:0/3916810159 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5dc00b8d0 con 0x7fd5e40a9b70 2021-10-20T23:23:26.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/3916810159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e40a9b70 msgr2=0x7fd5e40b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e8a5d700 1 --2- 172.21.15.12:0/3916810159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e40a9b70 0x7fd5e40b2e30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fd5dc0032f0 tx=0x7fd5dc0091d0).stop 2021-10-20T23:23:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/3916810159 shutdown_connections 2021-10-20T23:23:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e8a5d700 1 --2- 172.21.15.12:0/3916810159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e40a9b70 0x7fd5e40b2e30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e8a5d700 1 --2- 172.21.15.12:0/3916810159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 0x7fd5e40b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/3916810159 >> 172.21.15.12:0/3916810159 conn(0x7fd5e40607c0 msgr2=0x7fd5e4060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/3916810159 shutdown_connections 2021-10-20T23:23:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.294+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/3916810159 wait complete. 2021-10-20T23:23:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 Processor -- start 2021-10-20T23:23:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 -- start start 2021-10-20T23:23:26.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5e40a9b70 0x7fd5e413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e40b00c0 0x7fd5e4066f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 0x7fd5e4067480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e4146840 con 0x7fd5e40a9b70 2021-10-20T23:23:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e413f320 con 0x7fd5e40b00c0 2021-10-20T23:23:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e4064a50 con 0x7fd5e40b1f10 2021-10-20T23:23:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5e40a9b70 0x7fd5e413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5e40a9b70 0x7fd5e413fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39502/0 (socket says 172.21.15.12:39502) 2021-10-20T23:23:26.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e259c700 1 -- 172.21.15.12:0/38460707 learned_addr learned my addr 172.21.15.12:0/38460707 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:26.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e1d9b700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e40b00c0 0x7fd5e4066f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e2d9d700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 0x7fd5e4067480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e259c700 1 -- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 msgr2=0x7fd5e4067480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e259c700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 0x7fd5e4067480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e259c700 1 -- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e40b00c0 msgr2=0x7fd5e4066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e259c700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e40b00c0 0x7fd5e4066f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e259c700 1 -- 172.21.15.12:0/38460707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc009470 con 0x7fd5e40a9b70 2021-10-20T23:23:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e259c700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5e40a9b70 0x7fd5e413fd20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fd5d4001110 tx=0x7fd5d4007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:26.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5db7fe700 1 -- 172.21.15.12:0/38460707 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5d400ce80 con 0x7fd5e40a9b70 2021-10-20T23:23:26.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5db7fe700 1 -- 172.21.15.12:0/38460707 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d40070d0 con 0x7fd5e40a9b70 2021-10-20T23:23:26.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e4067970 con 0x7fd5e40a9b70 2021-10-20T23:23:26.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5db7fe700 1 -- 172.21.15.12:0/38460707 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5d4007430 con 0x7fd5e40a9b70 2021-10-20T23:23:26.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.298+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e4145a90 con 0x7fd5e40a9b70 2021-10-20T23:23:26.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.302+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e4150480 con 0x7fd5e40a9b70 2021-10-20T23:23:26.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.302+0000 7fd5db7fe700 1 -- 172.21.15.12:0/38460707 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd5d4010070 con 0x7fd5e40a9b70 2021-10-20T23:23:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.302+0000 7fd5db7fe700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5c80534f0 0x7fd5c80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.302+0000 7fd5db7fe700 1 -- 172.21.15.12:0/38460707 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd5d406b000 con 0x7fd5e40a9b70 2021-10-20T23:23:26.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.302+0000 7fd5e1d9b700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5c80534f0 0x7fd5c80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.302+0000 7fd5e1d9b700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5c80534f0 0x7fd5c80559b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fd5cc00b000 tx=0x7fd5cc006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:26.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.306+0000 7fd5db7fe700 1 -- 172.21.15.12:0/38460707 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5d4041fa0 con 0x7fd5e40a9b70 2021-10-20T23:23:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.474+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd5e4057350 con 0x7fd5e40a9b70 2021-10-20T23:23:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.482+0000 7fd5db7fe700 1 -- 172.21.15.12:0/38460707 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd5d40455c0 con 0x7fd5e40a9b70 2021-10-20T23:23:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5c80534f0 msgr2=0x7fd5c80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5c80534f0 0x7fd5c80559b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fd5cc00b000 tx=0x7fd5cc006df0).stop 2021-10-20T23:23:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5e40a9b70 msgr2=0x7fd5e413fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5e40a9b70 0x7fd5e413fd20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fd5d4001110 tx=0x7fd5d4007aa0).stop 2021-10-20T23:23:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 shutdown_connections 2021-10-20T23:23:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5c80534f0 0x7fd5c80559b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5e40b1f10 0x7fd5e4067480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e40b00c0 0x7fd5e4066f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 --2- 172.21.15.12:0/38460707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5e40a9b70 0x7fd5e413fd20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 >> 172.21.15.12:0/38460707 conn(0x7fd5e40607c0 msgr2=0x7fd5e40b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 shutdown_connections 2021-10-20T23:23:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.486+0000 7fd5e8a5d700 1 -- 172.21.15.12:0/38460707 wait complete. 2021-10-20T23:23:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:23:26.502 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.602+0000 7ffbd8900700 1 Processor -- start 2021-10-20T23:23:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.602+0000 7ffbd8900700 1 -- start start 2021-10-20T23:23:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd40ad4e0 0x7ffbd40b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffbd413f8b0 0x7ffbd413fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd40b0ab0 con 0x7ffbd40aef90 2021-10-20T23:23:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd40b0d50 con 0x7ffbd413f8b0 2021-10-20T23:23:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40ae850 con 0x7ffbd40ad4e0 2021-10-20T23:23:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffbd413f8b0 0x7ffbd413fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd40ad4e0 0x7ffbd40b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd2ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffbd40aef90 0x7ffbd40b1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45168/0 (socket says 172.21.15.12:45168) 2021-10-20T23:23:26.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd2ffd700 1 -- 172.21.15.12:0/2760031611 learned_addr learned my addr 172.21.15.12:0/2760031611 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:26.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd3fff700 1 -- 172.21.15.12:0/2760031611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd40ad4e0 msgr2=0x7ffbd40b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:26.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd3fff700 1 --2- 172.21.15.12:0/2760031611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd40ad4e0 0x7ffbd40b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd3fff700 1 -- 172.21.15.12:0/2760031611 >> v1:172.21.15.31:6789/0 conn(0x7ffbd40aef90 legacy=0x7ffbd40b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd3fff700 1 -- 172.21.15.12:0/2760031611 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40aeaf0 con 0x7ffbd413f8b0 2021-10-20T23:23:26.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd3fff700 1 --2- 172.21.15.12:0/2760031611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd413f8b0 0x7ffbd413fd40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7ffbcc002f70 tx=0x7ffbcc006df0).ready entity=mon.1 client_cookie=e91e6d3274b0295b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:26.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd27fc700 1 -- 172.21.15.12:0/2760031611 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbcc00d570 con 0x7ffbd413f8b0 2021-10-20T23:23:26.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd27fc700 1 -- 172.21.15.12:0/2760031611 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc000e90 con 0x7ffbd413f8b0 2021-10-20T23:23:26.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd27fc700 1 -- 172.21.15.12:0/2760031611 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbcc00d8c0 con 0x7ffbd413f8b0 2021-10-20T23:23:26.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 -- 172.21.15.12:0/2760031611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd413f8b0 msgr2=0x7ffbd413fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 --2- 172.21.15.12:0/2760031611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd413f8b0 0x7ffbd413fd40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7ffbcc002f70 tx=0x7ffbcc006df0).stop 2021-10-20T23:23:26.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 -- 172.21.15.12:0/2760031611 shutdown_connections 2021-10-20T23:23:26.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 --2- 172.21.15.12:0/2760031611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd413f8b0 0x7ffbd413fd40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 --2- 172.21.15.12:0/2760031611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd40ad4e0 0x7ffbd40b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 -- 172.21.15.12:0/2760031611 >> 172.21.15.12:0/2760031611 conn(0x7ffbd40611d0 msgr2=0x7ffbd4062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:26.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 -- 172.21.15.12:0/2760031611 shutdown_connections 2021-10-20T23:23:26.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.606+0000 7ffbd8900700 1 -- 172.21.15.12:0/2760031611 wait complete. 2021-10-20T23:23:26.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 Processor -- start 2021-10-20T23:23:26.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 -- start start 2021-10-20T23:23:26.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd40ad4e0 0x7ffbd41514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbd40aef90 0x7ffbd4153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd413f8b0 0x7ffbd4135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4153610 con 0x7ffbd40aef90 2021-10-20T23:23:26.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40aa080 con 0x7ffbd40ad4e0 2021-10-20T23:23:26.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4153840 con 0x7ffbd413f8b0 2021-10-20T23:23:26.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbd40aef90 0x7ffbd4153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbd40aef90 0x7ffbd4153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39520/0 (socket says 172.21.15.12:39520) 2021-10-20T23:23:26.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd2ffd700 1 -- 172.21.15.12:0/3073726954 learned_addr learned my addr 172.21.15.12:0/3073726954 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:26.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd3fff700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd413f8b0 0x7ffbd4135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd37fe700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd40ad4e0 0x7ffbd41514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd2ffd700 1 -- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd413f8b0 msgr2=0x7ffbd4135bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd2ffd700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd413f8b0 0x7ffbd4135bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd2ffd700 1 -- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd40ad4e0 msgr2=0x7ffbd41514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd2ffd700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd40ad4e0 0x7ffbd41514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd2ffd700 1 -- 172.21.15.12:0/3073726954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc00b180 con 0x7ffbd40aef90 2021-10-20T23:23:26.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd2ffd700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbd40aef90 0x7ffbd4153ce0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7ffbd40b38e0 tx=0x7ffbc400c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:26.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd0ff9700 1 -- 172.21.15.12:0/3073726954 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc4005ba0 con 0x7ffbd40aef90 2021-10-20T23:23:26.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd0ff9700 1 -- 172.21.15.12:0/3073726954 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4005d00 con 0x7ffbd40aef90 2021-10-20T23:23:26.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd40aa320 con 0x7ffbd40aef90 2021-10-20T23:23:26.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd0ff9700 1 -- 172.21.15.12:0/3073726954 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc40072c0 con 0x7ffbd40aef90 2021-10-20T23:23:26.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.610+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd41541d0 con 0x7ffbd40aef90 2021-10-20T23:23:26.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.614+0000 7ffbd0ff9700 1 -- 172.21.15.12:0/3073726954 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffbc401a060 con 0x7ffbd40aef90 2021-10-20T23:23:26.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.614+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd4153a00 con 0x7ffbd40aef90 2021-10-20T23:23:26.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.614+0000 7ffbd0ff9700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffbb4053640 0x7ffbb4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:26.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.614+0000 7ffbd0ff9700 1 -- 172.21.15.12:0/3073726954 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ffbc406b150 con 0x7ffbd40aef90 2021-10-20T23:23:26.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.614+0000 7ffbd37fe700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffbb4053640 0x7ffbb4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:26.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.614+0000 7ffbd37fe700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffbb4053640 0x7ffbb4055b00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7ffbc800b000 tx=0x7ffbc8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:26.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.622+0000 7ffbd0ff9700 1 -- 172.21.15.12:0/3073726954 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffbc4042150 con 0x7ffbd40aef90 2021-10-20T23:23:26.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.778+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbd40b3350 con 0x7ffbd40aef90 2021-10-20T23:23:26.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd0ff9700 1 -- 172.21.15.12:0/3073726954 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2489 (secure 0 0 0) 0x7ffbc4018020 con 0x7ffbd40aef90 2021-10-20T23:23:26.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:26.784 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:23:24.253029+0000","modified":"2021-10-20T23:23:25.255689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3232971526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3232971526},{"type":"v1","addr":"172.21.15.12:6835","nonce":3232971526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-20T23:23:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffbb4053640 msgr2=0x7ffbb4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffbb4053640 0x7ffbb4055b00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7ffbc800b000 tx=0x7ffbc8008040).stop 2021-10-20T23:23:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbd40aef90 msgr2=0x7ffbd4153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbd40aef90 0x7ffbd4153ce0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7ffbd40b38e0 tx=0x7ffbc400c890).stop 2021-10-20T23:23:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 shutdown_connections 2021-10-20T23:23:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffbb4053640 0x7ffbb4055b00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbd413f8b0 0x7ffbd4135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbd40aef90 0x7ffbd4153ce0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 --2- 172.21.15.12:0/3073726954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd40ad4e0 0x7ffbd41514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 >> 172.21.15.12:0/3073726954 conn(0x7ffbd40611d0 msgr2=0x7ffbd405fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 shutdown_connections 2021-10-20T23:23:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:26.782+0000 7ffbd8900700 1 -- 172.21.15.12:0/3073726954 wait complete. 2021-10-20T23:23:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2021-10-20T23:23:27.099 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:23:24.253029+0000', 'modified': '2021-10-20T23:23:25.255689+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5586}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5586': {'gid': 5586, 'name': 'c', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/3232971526', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 3232971526}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 3232971526}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:23:27.100 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:23:27.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":5586,"want_state":"up:active","state":"up:active","rank_uptime":2.9549647160000001,"mdsmap_epoch":25,"osdmap_epoch":58,"osdmap_epoch_barrier":57,"uptime":7.3349454459999999} 2021-10-20T23:23:27.220 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 5586, "mdsmap_epoch": 25, "osdmap_epoch": 58, "osdmap_epoch_barrier": 57, "rank_uptime": 2.954964716, "state": "up:active", "uptime": 7.334945446, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:23:27.220 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:23:27.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.330+0000 7f07918dc700 1 Processor -- start 2021-10-20T23:23:27.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.330+0000 7f07918dc700 1 -- start start 2021-10-20T23:23:27.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0af2c0 0x7f078c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c0afda0 con 0x7f078c0ad850 2021-10-20T23:23:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c05c610 con 0x7f078c0ad320 2021-10-20T23:23:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c140800 con 0x7f078c0af2c0 2021-10-20T23:23:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07910db700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f078c0ad850 0x7f078c0a8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38122/0 (socket says 172.21.15.12:38122) 2021-10-20T23:23:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07910db700 1 -- 172.21.15.12:0/654992522 learned_addr learned my addr 172.21.15.12:0/654992522 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07908da700 1 --2- 172.21.15.12:0/654992522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0af2c0 0x7f078c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f078b7fe700 1 -- 172.21.15.12:0/654992522 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628724336 0 0) 0x7f078c0afda0 con 0x7f078c0ad850 2021-10-20T23:23:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f078b7fe700 1 -- 172.21.15.12:0/654992522 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0778003260 con 0x7f078c0ad850 2021-10-20T23:23:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f078b7fe700 1 -- 172.21.15.12:0/654992522 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376711440 0 0) 0x7f078c05c610 con 0x7f078c0ad320 2021-10-20T23:23:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f078b7fe700 1 -- 172.21.15.12:0/654992522 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f078c0afda0 con 0x7f078c0ad320 2021-10-20T23:23:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07908da700 1 -- 172.21.15.12:0/654992522 >> v1:172.21.15.31:6789/0 conn(0x7f078c0ad320 legacy=0x7f078c143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07908da700 1 -- 172.21.15.12:0/654992522 >> v1:172.21.15.12:6789/0 conn(0x7f078c0ad850 legacy=0x7f078c0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f078b7fe700 1 -- 172.21.15.12:0/654992522 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1508398240 0 0) 0x7f0778003260 con 0x7f078c0ad850 2021-10-20T23:23:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07908da700 1 -- 172.21.15.12:0/654992522 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c143860 con 0x7f078c0af2c0 2021-10-20T23:23:27.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07908da700 1 --2- 172.21.15.12:0/654992522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0af2c0 0x7f078c0af6a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0784001490 tx=0x7f077c006df0).ready entity=mon.2 client_cookie=b22ebdf2ecb90534 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f078b7fe700 1 -- 172.21.15.12:0/654992522 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07840019e0 con 0x7f078c0af2c0 2021-10-20T23:23:27.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f078b7fe700 1 -- 172.21.15.12:0/654992522 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c000e90 con 0x7f078c0af2c0 2021-10-20T23:23:27.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f078b7fe700 1 -- 172.21.15.12:0/654992522 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077c012460 con 0x7f078c0af2c0 2021-10-20T23:23:27.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 -- 172.21.15.12:0/654992522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0af2c0 msgr2=0x7f078c0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 --2- 172.21.15.12:0/654992522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0af2c0 0x7f078c0af6a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0784001490 tx=0x7f077c006df0).stop 2021-10-20T23:23:27.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 -- 172.21.15.12:0/654992522 shutdown_connections 2021-10-20T23:23:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 --2- 172.21.15.12:0/654992522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0af2c0 0x7f078c0af6a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 -- 172.21.15.12:0/654992522 >> 172.21.15.12:0/654992522 conn(0x7f078c061140 msgr2=0x7f078c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 -- 172.21.15.12:0/654992522 shutdown_connections 2021-10-20T23:23:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.334+0000 7f07918dc700 1 -- 172.21.15.12:0/654992522 wait complete. 2021-10-20T23:23:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 Processor -- start 2021-10-20T23:23:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 -- start start 2021-10-20T23:23:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0ad320 0x7f078c0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078c0ad850 0x7f078c152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078c0af2c0 0x7f078c0abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0b4ed0 con 0x7f078c0af2c0 2021-10-20T23:23:27.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0aa750 con 0x7f078c0ad850 2021-10-20T23:23:27.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c153220 con 0x7f078c0ad320 2021-10-20T23:23:27.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07910db700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078c0af2c0 0x7f078c0abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07910db700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078c0af2c0 0x7f078c0abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39534/0 (socket says 172.21.15.12:39534) 2021-10-20T23:23:27.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07910db700 1 -- 172.21.15.12:0/2763956541 learned_addr learned my addr 172.21.15.12:0/2763956541 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:27.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07908da700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0ad320 0x7f078c0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f078bfff700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078c0ad850 0x7f078c152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07910db700 1 -- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0ad320 msgr2=0x7f078c0b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07910db700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0ad320 0x7f078c0b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07910db700 1 -- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078c0ad850 msgr2=0x7f078c152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07910db700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078c0ad850 0x7f078c152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07910db700 1 -- 172.21.15.12:0/2763956541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c00b180 con 0x7f078c0af2c0 2021-10-20T23:23:27.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07910db700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078c0af2c0 0x7f078c0abd80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f0784001360 tx=0x7f0784001d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:27.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f0789ffb700 1 -- 172.21.15.12:0/2763956541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0784016070 con 0x7f078c0af2c0 2021-10-20T23:23:27.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f0789ffb700 1 -- 172.21.15.12:0/2763956541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0784004ca0 con 0x7f078c0af2c0 2021-10-20T23:23:27.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c14cd80 con 0x7f078c0af2c0 2021-10-20T23:23:27.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f0789ffb700 1 -- 172.21.15.12:0/2763956541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0784007170 con 0x7f078c0af2c0 2021-10-20T23:23:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.338+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c0b6560 con 0x7f078c0af2c0 2021-10-20T23:23:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.342+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c0ac410 con 0x7f078c0af2c0 2021-10-20T23:23:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.342+0000 7f0789ffb700 1 -- 172.21.15.12:0/2763956541 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f07840072d0 con 0x7f078c0af2c0 2021-10-20T23:23:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.342+0000 7f0789ffb700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f076c053580 0x7f076c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.342+0000 7f0789ffb700 1 -- 172.21.15.12:0/2763956541 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f078406e120 con 0x7f078c0af2c0 2021-10-20T23:23:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.342+0000 7f07908da700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f076c053580 0x7f076c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.342+0000 7f07908da700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f076c053580 0x7f076c055a40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f077c01a000 tx=0x7f077c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.350+0000 7f0789ffb700 1 -- 172.21.15.12:0/2763956541 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f07840450c0 con 0x7f078c0af2c0 2021-10-20T23:23:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.474+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f078c057350 con 0x7f078c0af2c0 2021-10-20T23:23:27.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.474+0000 7f0789ffb700 1 -- 172.21.15.12:0/2763956541 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16273 (secure 0 0 0) 0x7f07840486e0 con 0x7f078c0af2c0 2021-10-20T23:23:27.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:27.480 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":58,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:23:25.256255+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:23:22.639987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-20T23:23:23.594440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:23:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f076c053580 msgr2=0x7f076c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f076c053580 0x7f076c055a40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f077c01a000 tx=0x7f077c014000).stop 2021-10-20T23:23:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078c0af2c0 msgr2=0x7f078c0abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078c0af2c0 0x7f078c0abd80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f0784001360 tx=0x7f0784001d80).stop 2021-10-20T23:23:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 shutdown_connections 2021-10-20T23:23:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f076c053580 0x7f076c055a40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078c0af2c0 0x7f078c0abd80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078c0ad850 0x7f078c152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 --2- 172.21.15.12:0/2763956541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078c0ad320 0x7f078c0b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 >> 172.21.15.12:0/2763956541 conn(0x7f078c061140 msgr2=0x7f078c0a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 shutdown_connections 2021-10-20T23:23:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.478+0000 7f07918dc700 1 -- 172.21.15.12:0/2763956541 wait complete. 2021-10-20T23:23:27.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:23:22.639987+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:23:23.594440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:23:27.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:23:27.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.606+0000 7f9d15692700 1 Processor -- start 2021-10-20T23:23:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.606+0000 7f9d15692700 1 -- start start 2021-10-20T23:23:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.606+0000 7f9d15692700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d100b7370 0x7f9d100b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.606+0000 7f9d15692700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d100b3060 0x7f9d1013e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d100b2380 con 0x7f9d1013e710 2021-10-20T23:23:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d10144250 con 0x7f9d100b7370 2021-10-20T23:23:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100b3570 con 0x7f9d100b3060 2021-10-20T23:23:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d100b3060 0x7f9d1013e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d100b7370 0x7f9d100b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d14e91700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9d1013e710 0x7f9d10064ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45200/0 (socket says 172.21.15.12:45200) 2021-10-20T23:23:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d14e91700 1 -- 172.21.15.12:0/2318719352 learned_addr learned my addr 172.21.15.12:0/2318719352 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0effd700 1 -- 172.21.15.12:0/2318719352 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429238336 0 0) 0x7f9d100b2380 con 0x7f9d1013e710 2021-10-20T23:23:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0f7fe700 1 -- 172.21.15.12:0/2318719352 >> v2:172.21.15.31:3300/0 conn(0x7f9d100b7370 msgr2=0x7f9d100b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0f7fe700 1 --2- 172.21.15.12:0/2318719352 >> v2:172.21.15.31:3300/0 conn(0x7f9d100b7370 0x7f9d100b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0f7fe700 1 -- 172.21.15.12:0/2318719352 >> v1:172.21.15.31:6789/0 conn(0x7f9d1013e710 legacy=0x7f9d10064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0f7fe700 1 -- 172.21.15.12:0/2318719352 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100b25b0 con 0x7f9d100b3060 2021-10-20T23:23:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0ffff700 1 --2- 172.21.15.12:0/2318719352 >> v2:172.21.15.31:3300/0 conn(0x7f9d100b7370 0x7f9d100b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0f7fe700 1 --2- 172.21.15.12:0/2318719352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d100b3060 0x7f9d1013e220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9cf8002f70 tx=0x7f9cf8006df0).ready entity=mon.2 client_cookie=10afeca7d8f4b355 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0effd700 1 -- 172.21.15.12:0/2318719352 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf800d570 con 0x7f9d100b3060 2021-10-20T23:23:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0effd700 1 -- 172.21.15.12:0/2318719352 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8000e90 con 0x7f9d100b3060 2021-10-20T23:23:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d0effd700 1 -- 172.21.15.12:0/2318719352 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf800d8c0 con 0x7f9d100b3060 2021-10-20T23:23:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 -- 172.21.15.12:0/2318719352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d100b3060 msgr2=0x7f9d1013e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 --2- 172.21.15.12:0/2318719352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d100b3060 0x7f9d1013e220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9cf8002f70 tx=0x7f9cf8006df0).stop 2021-10-20T23:23:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 -- 172.21.15.12:0/2318719352 shutdown_connections 2021-10-20T23:23:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 --2- 172.21.15.12:0/2318719352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d100b3060 0x7f9d1013e220 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 --2- 172.21.15.12:0/2318719352 >> v2:172.21.15.31:3300/0 conn(0x7f9d100b7370 0x7f9d100b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 -- 172.21.15.12:0/2318719352 >> 172.21.15.12:0/2318719352 conn(0x7f9d1005f6b0 msgr2=0x7f9d1005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 -- 172.21.15.12:0/2318719352 shutdown_connections 2021-10-20T23:23:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.610+0000 7f9d15692700 1 -- 172.21.15.12:0/2318719352 wait complete. 2021-10-20T23:23:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d15692700 1 Processor -- start 2021-10-20T23:23:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d15692700 1 -- start start 2021-10-20T23:23:27.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d15692700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d100b3060 0x7f9d100ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d15692700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d100b7370 0x7f9d100ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d15692700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d1013e710 0x7f9d10141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d15692700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10150b60 con 0x7f9d100b3060 2021-10-20T23:23:27.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d15692700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100ac130 con 0x7f9d100b7370 2021-10-20T23:23:27.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d15692700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10150d90 con 0x7f9d1013e710 2021-10-20T23:23:27.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d100b3060 0x7f9d100ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d100b3060 0x7f9d100ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39544/0 (socket says 172.21.15.12:39544) 2021-10-20T23:23:27.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0ffff700 1 -- 172.21.15.12:0/1056058244 learned_addr learned my addr 172.21.15.12:0/1056058244 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:27.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0f7fe700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d100b7370 0x7f9d100ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d14e91700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d1013e710 0x7f9d10141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0ffff700 1 -- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d1013e710 msgr2=0x7f9d10141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0ffff700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d1013e710 0x7f9d10141930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0ffff700 1 -- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d100b7370 msgr2=0x7f9d100ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0ffff700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d100b7370 0x7f9d100ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0ffff700 1 -- 172.21.15.12:0/1056058244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0000b120 con 0x7f9d100b3060 2021-10-20T23:23:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.614+0000 7f9d0ffff700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d100b3060 0x7f9d100ad550 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f9d0000c000 tx=0x7f9d00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d0d7fa700 1 -- 172.21.15.12:0/1056058244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d00012600 con 0x7f9d100b3060 2021-10-20T23:23:27.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d0d7fa700 1 -- 172.21.15.12:0/1056058244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d00012760 con 0x7f9d100b3060 2021-10-20T23:23:27.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf800b180 con 0x7f9d100b3060 2021-10-20T23:23:27.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d0d7fa700 1 -- 172.21.15.12:0/1056058244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d00012ac0 con 0x7f9d100b3060 2021-10-20T23:23:27.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d100ac3d0 con 0x7f9d100b3060 2021-10-20T23:23:27.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d0d7fa700 1 -- 172.21.15.12:0/1056058244 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9d00012c20 con 0x7f9d100b3060 2021-10-20T23:23:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d100ac910 con 0x7f9d100b3060 2021-10-20T23:23:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d0d7fa700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9cf4053610 0x7f9cf4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d0d7fa700 1 -- 172.21.15.12:0/1056058244 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9d0006bc70 con 0x7f9d100b3060 2021-10-20T23:23:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d0f7fe700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9cf4053610 0x7f9cf4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.618+0000 7f9d0f7fe700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9cf4053610 0x7f9cf4055ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9cf801a000 tx=0x7f9cf8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.630+0000 7f9d0d7fa700 1 -- 172.21.15.12:0/1056058244 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d100ac910 con 0x7f9d100b3060 2021-10-20T23:23:27.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.758+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9d100ac910 con 0x7f9d100b3060 2021-10-20T23:23:27.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.758+0000 7f9d0d7fa700 1 -- 172.21.15.12:0/1056058244 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v58) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9d100ac910 con 0x7f9d100b3060 2021-10-20T23:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:23:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9cf4053610 msgr2=0x7f9cf4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9cf4053610 0x7f9cf4055ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9cf801a000 tx=0x7f9cf8014000).stop 2021-10-20T23:23:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d100b3060 msgr2=0x7f9d100ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d100b3060 0x7f9d100ad550 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f9d0000c000 tx=0x7f9d00008040).stop 2021-10-20T23:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 shutdown_connections 2021-10-20T23:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9cf4053610 0x7f9cf4055ad0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d1013e710 0x7f9d10141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d100b7370 0x7f9d100ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 --2- 172.21.15.12:0/1056058244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d100b3060 0x7f9d100ad550 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 >> 172.21.15.12:0/1056058244 conn(0x7f9d1005f6b0 msgr2=0x7f9d1013dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 shutdown_connections 2021-10-20T23:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.762+0000 7f9d15692700 1 -- 172.21.15.12:0/1056058244 wait complete. 2021-10-20T23:23:27.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:23:27.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed8e13700 1 Processor -- start 2021-10-20T23:23:27.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed8e13700 1 -- start start 2021-10-20T23:23:27.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed8e13700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ed4061320 0x7f9ed4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed8e13700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ed40ad5c0 0x7f9ed40b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed8e13700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed4140440 0x7f9ed41408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed8e13700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40aecf0 con 0x7f9ed4061320 2021-10-20T23:23:27.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed8e13700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40b6f20 con 0x7f9ed40ad5c0 2021-10-20T23:23:27.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed8e13700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40aef20 con 0x7f9ed4140440 2021-10-20T23:23:27.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ed4061320 0x7f9ed4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ed4061320 0x7f9ed4061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39552/0 (socket says 172.21.15.12:39552) 2021-10-20T23:23:27.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed37fe700 1 -- 172.21.15.12:0/3765678290 learned_addr learned my addr 172.21.15.12:0/3765678290 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:27.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed3fff700 1 --2- 172.21.15.12:0/3765678290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed4140440 0x7f9ed41408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed2ffd700 1 --2- 172.21.15.12:0/3765678290 >> v2:172.21.15.31:3300/0 conn(0x7f9ed40ad5c0 0x7f9ed40b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed37fe700 1 -- 172.21.15.12:0/3765678290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed4140440 msgr2=0x7f9ed41408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:27.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed37fe700 1 --2- 172.21.15.12:0/3765678290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed4140440 0x7f9ed41408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed37fe700 1 -- 172.21.15.12:0/3765678290 >> v2:172.21.15.31:3300/0 conn(0x7f9ed40ad5c0 msgr2=0x7f9ed40b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:27.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed37fe700 1 --2- 172.21.15.12:0/3765678290 >> v2:172.21.15.31:3300/0 conn(0x7f9ed40ad5c0 0x7f9ed40b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed37fe700 1 -- 172.21.15.12:0/3765678290 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40af1c0 con 0x7f9ed4061320 2021-10-20T23:23:27.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed2ffd700 1 --2- 172.21.15.12:0/3765678290 >> v2:172.21.15.31:3300/0 conn(0x7f9ed40ad5c0 0x7f9ed40b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:27.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.882+0000 7f9ed37fe700 1 --2- 172.21.15.12:0/3765678290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4061320 0x7f9ed4061700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f9ed40aeba0 tx=0x7f9ec4006eb0).ready entity=mon.0 client_cookie=5715b199462842cc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:27.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed27fc700 1 -- 172.21.15.12:0/3765678290 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec400d570 con 0x7f9ed4061320 2021-10-20T23:23:27.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed27fc700 1 -- 172.21.15.12:0/3765678290 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec4000e90 con 0x7f9ed4061320 2021-10-20T23:23:27.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed27fc700 1 -- 172.21.15.12:0/3765678290 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec400d900 con 0x7f9ed4061320 2021-10-20T23:23:27.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3765678290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4061320 msgr2=0x7f9ed4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3765678290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4061320 0x7f9ed4061700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f9ed40aeba0 tx=0x7f9ec4006eb0).stop 2021-10-20T23:23:27.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3765678290 shutdown_connections 2021-10-20T23:23:27.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3765678290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed4140440 0x7f9ed41408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3765678290 >> v2:172.21.15.31:3300/0 conn(0x7f9ed40ad5c0 0x7f9ed40b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3765678290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4061320 0x7f9ed4061700 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3765678290 >> 172.21.15.12:0/3765678290 conn(0x7f9ed4066de0 msgr2=0x7f9ed40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3765678290 shutdown_connections 2021-10-20T23:23:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.886+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3765678290 wait complete. 2021-10-20T23:23:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 Processor -- start 2021-10-20T23:23:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 -- start start 2021-10-20T23:23:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ed4061320 0x7f9ed40b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed40ad5c0 0x7f9ed40afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4140440 0x7f9ed40ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed409e950 con 0x7f9ed4140440 2021-10-20T23:23:27.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed409ebf0 con 0x7f9ed4061320 2021-10-20T23:23:27.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40b1da0 con 0x7f9ed40ad5c0 2021-10-20T23:23:27.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4140440 0x7f9ed40ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4140440 0x7f9ed40ac330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39562/0 (socket says 172.21.15.12:39562) 2021-10-20T23:23:27.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed3fff700 1 -- 172.21.15.12:0/3239708041 learned_addr learned my addr 172.21.15.12:0/3239708041 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:27.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed2ffd700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed40ad5c0 0x7f9ed40afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed37fe700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ed4061320 0x7f9ed40b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed3fff700 1 -- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed40ad5c0 msgr2=0x7f9ed40afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed3fff700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed40ad5c0 0x7f9ed40afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed3fff700 1 -- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ed4061320 msgr2=0x7f9ed40b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed3fff700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ed4061320 0x7f9ed40b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed3fff700 1 -- 172.21.15.12:0/3239708041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec400b1e0 con 0x7f9ed4140440 2021-10-20T23:23:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed3fff700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4140440 0x7f9ed40ac330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f9ecc006e00 tx=0x7f9ecc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed0ff9700 1 -- 172.21.15.12:0/3239708041 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ecc012600 con 0x7f9ed4140440 2021-10-20T23:23:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed0ff9700 1 -- 172.21.15.12:0/3239708041 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc012760 con 0x7f9ed4140440 2021-10-20T23:23:27.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed40b07d0 con 0x7f9ed4140440 2021-10-20T23:23:27.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed0ff9700 1 -- 172.21.15.12:0/3239708041 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ecc012ac0 con 0x7f9ed4140440 2021-10-20T23:23:27.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.890+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed40b3ce0 con 0x7f9ed4140440 2021-10-20T23:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.894+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed409edf0 con 0x7f9ed4140440 2021-10-20T23:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.894+0000 7f9ed0ff9700 1 -- 172.21.15.12:0/3239708041 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ecc022070 con 0x7f9ed4140440 2021-10-20T23:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.894+0000 7f9ed0ff9700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9eb4053610 0x7f9eb4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.894+0000 7f9ed0ff9700 1 -- 172.21.15.12:0/3239708041 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9ecc06c100 con 0x7f9ed4140440 2021-10-20T23:23:27.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.894+0000 7f9ed37fe700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9eb4053610 0x7f9eb4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:27.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.898+0000 7f9ed37fe700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9eb4053610 0x7f9eb4055ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9ec401c000 tx=0x7f9ec4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:27.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:27.898+0000 7f9ed0ff9700 1 -- 172.21.15.12:0/3239708041 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ed409edf0 con 0x7f9ed4140440 2021-10-20T23:23:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ed40b1be0 con 0x7f9ed4140440 2021-10-20T23:23:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed0ff9700 1 -- 172.21.15.12:0/3239708041 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ecc016020 con 0x7f9ed4140440 2021-10-20T23:23:28.024 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:23:28.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9eb4053610 msgr2=0x7f9eb4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9eb4053610 0x7f9eb4055ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9ec401c000 tx=0x7f9ec4015000).stop 2021-10-20T23:23:28.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4140440 msgr2=0x7f9ed40ac330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4140440 0x7f9ed40ac330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f9ecc006e00 tx=0x7f9ecc0091d0).stop 2021-10-20T23:23:28.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 shutdown_connections 2021-10-20T23:23:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9eb4053610 0x7f9eb4055ad0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ed4140440 0x7f9ed40ac330 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ed40ad5c0 0x7f9ed40afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 --2- 172.21.15.12:0/3239708041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ed4061320 0x7f9ed40b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 >> 172.21.15.12:0/3239708041 conn(0x7f9ed4066de0 msgr2=0x7f9ed41447e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:28.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 shutdown_connections 2021-10-20T23:23:28.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.022+0000 7f9ed8e13700 1 -- 172.21.15.12:0/3239708041 wait complete. 2021-10-20T23:23:28.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:23:28.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 Processor -- start 2021-10-20T23:23:28.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 -- start start 2021-10-20T23:23:28.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f3414ab80 0x7f8f3405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f340ac9b0 0x7f8f3414af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f34061360 con 0x7f8f340aff10 2021-10-20T23:23:28.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3414b5e0 con 0x7f8f340ac9b0 2021-10-20T23:23:28.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3414b880 con 0x7f8f3414ab80 2021-10-20T23:23:28.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f32d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f340ac9b0 0x7f8f3414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f31d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8f340aff10 0x7f8f340af1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38162/0 (socket says 172.21.15.12:38162) 2021-10-20T23:23:28.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f31d9b700 1 -- 172.21.15.12:0/1773373301 learned_addr learned my addr 172.21.15.12:0/1773373301 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:28.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f3259c700 1 --2- 172.21.15.12:0/1773373301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f3414ab80 0x7f8f3405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f32d9d700 1 -- 172.21.15.12:0/1773373301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f3414ab80 msgr2=0x7f8f3405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:28.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f32d9d700 1 --2- 172.21.15.12:0/1773373301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f3414ab80 0x7f8f3405f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f32d9d700 1 -- 172.21.15.12:0/1773373301 >> v1:172.21.15.12:6789/0 conn(0x7f8f340aff10 legacy=0x7f8f340af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f32d9d700 1 -- 172.21.15.12:0/1773373301 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f340aed20 con 0x7f8f340ac9b0 2021-10-20T23:23:28.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f3159a700 1 -- 172.21.15.12:0/1773373301 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139155665 0 0) 0x7f8f34061360 con 0x7f8f340aff10 2021-10-20T23:23:28.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f32d9d700 1 --2- 172.21.15.12:0/1773373301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340ac9b0 0x7f8f3414af60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f8f2c0032f0 tx=0x7f8f2c0091d0).ready entity=mon.0 client_cookie=9dffe4ec9e1fe11f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:28.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f3159a700 1 -- 172.21.15.12:0/1773373301 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f2c00b6c0 con 0x7f8f340ac9b0 2021-10-20T23:23:28.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f3159a700 1 -- 172.21.15.12:0/1773373301 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c00b820 con 0x7f8f340ac9b0 2021-10-20T23:23:28.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f3159a700 1 -- 172.21.15.12:0/1773373301 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f2c00b990 con 0x7f8f340ac9b0 2021-10-20T23:23:28.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 -- 172.21.15.12:0/1773373301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340ac9b0 msgr2=0x7f8f3414af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 --2- 172.21.15.12:0/1773373301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340ac9b0 0x7f8f3414af60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f8f2c0032f0 tx=0x7f8f2c0091d0).stop 2021-10-20T23:23:28.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 -- 172.21.15.12:0/1773373301 shutdown_connections 2021-10-20T23:23:28.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 --2- 172.21.15.12:0/1773373301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340ac9b0 0x7f8f3414af60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 --2- 172.21.15.12:0/1773373301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f3414ab80 0x7f8f3405f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 -- 172.21.15.12:0/1773373301 >> 172.21.15.12:0/1773373301 conn(0x7f8f340b5570 msgr2=0x7f8f340b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:28.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 -- 172.21.15.12:0/1773373301 shutdown_connections 2021-10-20T23:23:28.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.142+0000 7f8f38b20700 1 -- 172.21.15.12:0/1773373301 wait complete. 2021-10-20T23:23:28.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 Processor -- start 2021-10-20T23:23:28.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 -- start start 2021-10-20T23:23:28.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f340ac9b0 0x7f8f3413df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340aff10 0x7f8f340b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f3414ab80 0x7f8f3413b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34147df0 con 0x7f8f340aff10 2021-10-20T23:23:28.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34141b10 con 0x7f8f3414ab80 2021-10-20T23:23:28.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34141db0 con 0x7f8f340ac9b0 2021-10-20T23:23:28.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f31d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340aff10 0x7f8f340b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f31d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340aff10 0x7f8f340b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39574/0 (socket says 172.21.15.12:39574) 2021-10-20T23:23:28.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f31d9b700 1 -- 172.21.15.12:0/3324938509 learned_addr learned my addr 172.21.15.12:0/3324938509 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:28.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f3259c700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f340ac9b0 0x7f8f3413df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f32d9d700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f3414ab80 0x7f8f3413b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f31d9b700 1 -- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f340ac9b0 msgr2=0x7f8f3413df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f31d9b700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f340ac9b0 0x7f8f3413df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f31d9b700 1 -- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f3414ab80 msgr2=0x7f8f3413b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f31d9b700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f3414ab80 0x7f8f3413b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f31d9b700 1 -- 172.21.15.12:0/3324938509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009470 con 0x7f8f340aff10 2021-10-20T23:23:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f3259c700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f340ac9b0 0x7f8f3413df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f31d9b700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340aff10 0x7f8f340b43a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f8f1c000ed0 tx=0x7f8f1c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:28.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f2b7fe700 1 -- 172.21.15.12:0/3324938509 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f1c0070d0 con 0x7f8f340aff10 2021-10-20T23:23:28.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f2b7fe700 1 -- 172.21.15.12:0/3324938509 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c007230 con 0x7f8f340aff10 2021-10-20T23:23:28.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f2b7fe700 1 -- 172.21.15.12:0/3324938509 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f1c005610 con 0x7f8f340aff10 2021-10-20T23:23:28.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f341458a0 con 0x7f8f340aff10 2021-10-20T23:23:28.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.146+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f340b5240 con 0x7f8f340aff10 2021-10-20T23:23:28.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.150+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f340af8d0 con 0x7f8f340aff10 2021-10-20T23:23:28.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.150+0000 7f8f2b7fe700 1 -- 172.21.15.12:0/3324938509 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8f1c010070 con 0x7f8f340aff10 2021-10-20T23:23:28.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.150+0000 7f8f2b7fe700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f18053610 0x7f8f18055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.150+0000 7f8f2b7fe700 1 -- 172.21.15.12:0/3324938509 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8f1c06b2a0 con 0x7f8f340aff10 2021-10-20T23:23:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.150+0000 7f8f3259c700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f18053610 0x7f8f18055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.150+0000 7f8f3259c700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f18053610 0x7f8f18055ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f8f2400b000 tx=0x7f8f24008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.154+0000 7f8f2b7fe700 1 -- 172.21.15.12:0/3324938509 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f1c042190 con 0x7f8f340aff10 2021-10-20T23:23:28.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.286+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f34057350 con 0x7f8f340aff10 2021-10-20T23:23:28.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.286+0000 7f8f2b7fe700 1 -- 172.21.15.12:0/3324938509 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8f1c0457b0 con 0x7f8f340aff10 2021-10-20T23:23:28.289 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:23:28.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f18053610 msgr2=0x7f8f18055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f18053610 0x7f8f18055ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f8f2400b000 tx=0x7f8f24008040).stop 2021-10-20T23:23:28.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340aff10 msgr2=0x7f8f340b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340aff10 0x7f8f340b43a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f8f1c000ed0 tx=0x7f8f1c007a80).stop 2021-10-20T23:23:28.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 shutdown_connections 2021-10-20T23:23:28.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f18053610 0x7f8f18055ad0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f3414ab80 0x7f8f3413b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f340aff10 0x7f8f340b43a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 --2- 172.21.15.12:0/3324938509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f340ac9b0 0x7f8f3413df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 >> 172.21.15.12:0/3324938509 conn(0x7f8f340b5570 msgr2=0x7f8f34149a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:28.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 shutdown_connections 2021-10-20T23:23:28.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.290+0000 7f8f38b20700 1 -- 172.21.15.12:0/3324938509 wait complete. 2021-10-20T23:23:28.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:23:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb4a1d70700 1 Processor -- start 2021-10-20T23:23:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb4a1d70700 1 -- start start 2021-10-20T23:23:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb4a1d70700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb49c061320 0x7fb49c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb4a1d70700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49c0aecf0 con 0x7fb49c0ad5c0 2021-10-20T23:23:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb4a1d70700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49c0b6f20 con 0x7fb49c140440 2021-10-20T23:23:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb4a1d70700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49c0aef20 con 0x7fb49c061320 2021-10-20T23:23:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb49bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb49c0ad5c0 0x7fb49c0b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38174/0 (socket says 172.21.15.12:38174) 2021-10-20T23:23:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb49bfff700 1 -- 172.21.15.12:0/2507208382 learned_addr learned my addr 172.21.15.12:0/2507208382 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb4a0d6e700 1 --2- 172.21.15.12:0/2507208382 >> v2:172.21.15.31:3300/0 conn(0x7fb49c061320 0x7fb49c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.414+0000 7fb49b7fe700 1 -- 172.21.15.12:0/2507208382 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516684265 0 0) 0x7fb49c0aecf0 con 0x7fb49c0ad5c0 2021-10-20T23:23:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb49b7fe700 1 -- 172.21.15.12:0/2507208382 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb488003260 con 0x7fb49c0ad5c0 2021-10-20T23:23:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a0d6e700 1 -- 172.21.15.12:0/2507208382 >> v1:172.21.15.31:6789/0 conn(0x7fb49c140440 legacy=0x7fb49c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a0d6e700 1 -- 172.21.15.12:0/2507208382 >> v1:172.21.15.12:6789/0 conn(0x7fb49c0ad5c0 legacy=0x7fb49c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a0d6e700 1 -- 172.21.15.12:0/2507208382 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c0af1c0 con 0x7fb49c061320 2021-10-20T23:23:28.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a0d6e700 1 --2- 172.21.15.12:0/2507208382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49c061320 0x7fb49c061700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fb49c0aeba0 tx=0x7fb490006df0).ready entity=mon.1 client_cookie=5404bd1a362495f1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:28.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb49b7fe700 1 -- 172.21.15.12:0/2507208382 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49000d610 con 0x7fb49c061320 2021-10-20T23:23:28.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb49b7fe700 1 -- 172.21.15.12:0/2507208382 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490000e90 con 0x7fb49c061320 2021-10-20T23:23:28.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb49b7fe700 1 -- 172.21.15.12:0/2507208382 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49000d960 con 0x7fb49c061320 2021-10-20T23:23:28.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a1d70700 1 -- 172.21.15.12:0/2507208382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49c061320 msgr2=0x7fb49c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a1d70700 1 --2- 172.21.15.12:0/2507208382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49c061320 0x7fb49c061700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fb49c0aeba0 tx=0x7fb490006df0).stop 2021-10-20T23:23:28.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a1d70700 1 -- 172.21.15.12:0/2507208382 shutdown_connections 2021-10-20T23:23:28.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a1d70700 1 --2- 172.21.15.12:0/2507208382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49c061320 0x7fb49c061700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a1d70700 1 -- 172.21.15.12:0/2507208382 >> 172.21.15.12:0/2507208382 conn(0x7fb49c066de0 msgr2=0x7fb49c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:28.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a1d70700 1 -- 172.21.15.12:0/2507208382 shutdown_connections 2021-10-20T23:23:28.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.418+0000 7fb4a1d70700 1 -- 172.21.15.12:0/2507208382 wait complete. 2021-10-20T23:23:28.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a1d70700 1 Processor -- start 2021-10-20T23:23:28.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a1d70700 1 -- start start 2021-10-20T23:23:28.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a1d70700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49c061320 0x7fb49c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a1d70700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb49c0ad5c0 0x7fb49c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a1d70700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb49c140440 0x7fb49c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a1d70700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0b3700 con 0x7fb49c140440 2021-10-20T23:23:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a1d70700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0b1340 con 0x7fb49c061320 2021-10-20T23:23:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a1d70700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0b0e40 con 0x7fb49c0ad5c0 2021-10-20T23:23:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a156f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb49c140440 0x7fb49c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a156f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb49c140440 0x7fb49c152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39590/0 (socket says 172.21.15.12:39590) 2021-10-20T23:23:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a156f700 1 -- 172.21.15.12:0/3726194932 learned_addr learned my addr 172.21.15.12:0/3726194932 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a0d6e700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49c061320 0x7fb49c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb49bfff700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb49c0ad5c0 0x7fb49c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a156f700 1 -- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb49c0ad5c0 msgr2=0x7fb49c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a156f700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb49c0ad5c0 0x7fb49c156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a156f700 1 -- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49c061320 msgr2=0x7fb49c0b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a156f700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49c061320 0x7fb49c0b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a156f700 1 -- 172.21.15.12:0/3726194932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49000b180 con 0x7fb49c140440 2021-10-20T23:23:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb4a156f700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb49c140440 0x7fb49c152280 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fb49c0af7e0 tx=0x7fb4940013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.422+0000 7fb499ffb700 1 -- 172.21.15.12:0/3726194932 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb494006aa0 con 0x7fb49c140440 2021-10-20T23:23:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb499ffb700 1 -- 172.21.15.12:0/3726194932 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494006c00 con 0x7fb49c140440 2021-10-20T23:23:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49c0afc10 con 0x7fb49c140440 2021-10-20T23:23:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb499ffb700 1 -- 172.21.15.12:0/3726194932 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb494007030 con 0x7fb49c140440 2021-10-20T23:23:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49c0b02b0 con 0x7fb49c140440 2021-10-20T23:23:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49c0b0470 con 0x7fb49c140440 2021-10-20T23:23:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb499ffb700 1 -- 172.21.15.12:0/3726194932 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb494010030 con 0x7fb49c140440 2021-10-20T23:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb499ffb700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb47c053610 0x7fb47c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb499ffb700 1 -- 172.21.15.12:0/3726194932 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb49406baa0 con 0x7fb49c140440 2021-10-20T23:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb4a0d6e700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb47c053610 0x7fb47c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.426+0000 7fb4a0d6e700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb47c053610 0x7fb47c055ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fb490018000 tx=0x7fb490014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.430+0000 7fb499ffb700 1 -- 172.21.15.12:0/3726194932 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb494042a00 con 0x7fb49c140440 2021-10-20T23:23:28.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.558+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb49c0b08f0 con 0x7fb49c140440 2021-10-20T23:23:28.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb499ffb700 1 -- 172.21.15.12:0/3726194932 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb494046020 con 0x7fb49c140440 2021-10-20T23:23:28.563 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:23:28.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb47c053610 msgr2=0x7fb47c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb47c053610 0x7fb47c055ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fb490018000 tx=0x7fb490014000).stop 2021-10-20T23:23:28.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb49c140440 msgr2=0x7fb49c152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb49c140440 0x7fb49c152280 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fb49c0af7e0 tx=0x7fb4940013a0).stop 2021-10-20T23:23:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 shutdown_connections 2021-10-20T23:23:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb47c053610 0x7fb47c055ad0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb49c140440 0x7fb49c152280 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb49c0ad5c0 0x7fb49c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 --2- 172.21.15.12:0/3726194932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49c061320 0x7fb49c0b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.562+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 >> 172.21.15.12:0/3726194932 conn(0x7fb49c066de0 msgr2=0x7fb49c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.566+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 shutdown_connections 2021-10-20T23:23:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.566+0000 7fb4a1d70700 1 -- 172.21.15.12:0/3726194932 wait complete. 2021-10-20T23:23:28.581 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:23:28.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:28.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 Processor -- start 2021-10-20T23:23:28.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 -- start start 2021-10-20T23:23:28.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b2580 0x7f4ea814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ea80a8ac0 0x7f4ea814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea80a70c0 con 0x7f4ea80b0010 2021-10-20T23:23:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80a72f0 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80a7590 con 0x7f4ea80b2580 2021-10-20T23:23:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4ead455700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4ea80b0010 0x7f4ea80a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38188/0 (socket says 172.21.15.12:38188) 2021-10-20T23:23:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4ead455700 1 -- 172.21.15.12:0/4269725159 learned_addr learned my addr 172.21.15.12:0/4269725159 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eae457700 1 --2- 172.21.15.12:0/4269725159 >> v2:172.21.15.12:3300/0 conn(0x7f4ea80a8ac0 0x7f4ea814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eadc56700 1 --2- 172.21.15.12:0/4269725159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b2580 0x7f4ea814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eacc54700 1 -- 172.21.15.12:0/4269725159 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934512946 0 0) 0x7f4ea80a70c0 con 0x7f4ea80b0010 2021-10-20T23:23:28.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eacc54700 1 -- 172.21.15.12:0/4269725159 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e8c003260 con 0x7f4ea80b0010 2021-10-20T23:23:28.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eae457700 1 -- 172.21.15.12:0/4269725159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b2580 msgr2=0x7f4ea814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:28.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eae457700 1 --2- 172.21.15.12:0/4269725159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b2580 0x7f4ea814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eae457700 1 -- 172.21.15.12:0/4269725159 >> v1:172.21.15.12:6789/0 conn(0x7f4ea80b0010 legacy=0x7f4ea80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eae457700 1 -- 172.21.15.12:0/4269725159 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80a7830 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eae457700 1 --2- 172.21.15.12:0/4269725159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 0x7f4ea814b330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f4ea4002f70 tx=0x7f4ea4006df0).ready entity=mon.0 client_cookie=e3cfe4e63c3d984c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:28.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eacc54700 1 -- 172.21.15.12:0/4269725159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ea400d4a0 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eacc54700 1 -- 172.21.15.12:0/4269725159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea4000e90 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eacc54700 1 -- 172.21.15.12:0/4269725159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ea400d7f0 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 -- 172.21.15.12:0/4269725159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 msgr2=0x7f4ea814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 --2- 172.21.15.12:0/4269725159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 0x7f4ea814b330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f4ea4002f70 tx=0x7f4ea4006df0).stop 2021-10-20T23:23:28.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 -- 172.21.15.12:0/4269725159 shutdown_connections 2021-10-20T23:23:28.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 --2- 172.21.15.12:0/4269725159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 0x7f4ea814b330 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 --2- 172.21.15.12:0/4269725159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b2580 0x7f4ea814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 -- 172.21.15.12:0/4269725159 >> 172.21.15.12:0/4269725159 conn(0x7f4ea8060180 msgr2=0x7f4ea80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:28.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 -- 172.21.15.12:0/4269725159 shutdown_connections 2021-10-20T23:23:28.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.686+0000 7f4eaec58700 1 -- 172.21.15.12:0/4269725159 wait complete. 2021-10-20T23:23:28.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eaec58700 1 Processor -- start 2021-10-20T23:23:28.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eaec58700 1 -- start start 2021-10-20T23:23:28.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eaec58700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 0x7f4ea81563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eaec58700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b0010 0x7f4ea80ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eaec58700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ea80b2580 0x7f4ea814cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eaec58700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80a9140 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eaec58700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b3590 con 0x7f4ea80b2580 2021-10-20T23:23:28.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eaec58700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b4710 con 0x7f4ea80b0010 2021-10-20T23:23:28.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eadc56700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 0x7f4ea81563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eadc56700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 0x7f4ea81563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39600/0 (socket says 172.21.15.12:39600) 2021-10-20T23:23:28.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eadc56700 1 -- 172.21.15.12:0/346168408 learned_addr learned my addr 172.21.15.12:0/346168408 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:28.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4ead455700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b0010 0x7f4ea80ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eae457700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ea80b2580 0x7f4ea814cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eadc56700 1 -- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b0010 msgr2=0x7f4ea80ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eadc56700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b0010 0x7f4ea80ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eadc56700 1 -- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ea80b2580 msgr2=0x7f4ea814cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eadc56700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ea80b2580 0x7f4ea814cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eadc56700 1 -- 172.21.15.12:0/346168408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea400b180 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.690+0000 7f4eadc56700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 0x7f4ea81563f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f4e9c00c000 tx=0x7f4e9c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:28.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4e9affd700 1 -- 172.21.15.12:0/346168408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e9c011750 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4e9affd700 1 -- 172.21.15.12:0/346168408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0118b0 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea80aeed0 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4e9affd700 1 -- 172.21.15.12:0/346168408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e9c011c10 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea80b3a90 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea80a92b0 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4e9affd700 1 -- 172.21.15.12:0/346168408 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4e9c011d70 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4e9affd700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4e90053640 0x7f4e90055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:28.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4e9affd700 1 -- 172.21.15.12:0/346168408 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4e9c06bfa0 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4ead455700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4e90053640 0x7f4e90055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:28.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.694+0000 7f4ead455700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4e90053640 0x7f4e90055b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f4ea000d000 tx=0x7f4ea0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.702+0000 7f4e9affd700 1 -- 172.21.15.12:0/346168408 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4ea80a92b0 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.866+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ea80a9280 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.866+0000 7f4e9affd700 1 -- 172.21.15.12:0/346168408 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f4e9c042ea0 con 0x7f4ea80a8ac0 2021-10-20T23:23:28.870 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:28.871 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:23:24.253029+0000","modified":"2021-10-20T23:23:25.255689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3232971526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3232971526},{"type":"v1","addr":"172.21.15.12:6835","nonce":3232971526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-20T23:23:28.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4e90053640 msgr2=0x7f4e90055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4e90053640 0x7f4e90055b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f4ea000d000 tx=0x7f4ea0009040).stop 2021-10-20T23:23:28.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 msgr2=0x7f4ea81563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:28.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 0x7f4ea81563f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f4e9c00c000 tx=0x7f4e9c006df0).stop 2021-10-20T23:23:28.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 shutdown_connections 2021-10-20T23:23:28.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4e90053640 0x7f4e90055b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ea80b2580 0x7f4ea814cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ea80b0010 0x7f4ea80ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 --2- 172.21.15.12:0/346168408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ea80a8ac0 0x7f4ea81563f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:28.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 >> 172.21.15.12:0/346168408 conn(0x7f4ea8060180 msgr2=0x7f4ea8144ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:28.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 shutdown_connections 2021-10-20T23:23:28.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:28.870+0000 7f4eaec58700 1 -- 172.21.15.12:0/346168408 wait complete. 2021-10-20T23:23:28.875 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2021-10-20T23:23:29.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:23:24.253029+0000', 'modified': '2021-10-20T23:23:25.255689+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5586}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5586': {'gid': 5586, 'name': 'c', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/3232971526', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 3232971526}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 3232971526}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:23:29.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:23:29.187 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:23:29.310 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":5586,"want_state":"up:active","state":"up:active","rank_uptime":5.045746512,"mdsmap_epoch":25,"osdmap_epoch":58,"osdmap_epoch_barrier":57,"uptime":9.4257401079999994} 2021-10-20T23:23:29.311 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 5586, "mdsmap_epoch": 25, "osdmap_epoch": 58, "osdmap_epoch_barrier": 57, "rank_uptime": 5.045746512, "state": "up:active", "uptime": 9.425740108, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:23:29.311 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:23:29.312 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:23:29.312 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:23:29.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:29.313 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:29.324 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:23:29.341 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:23:29.342 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:23:29.400 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:23:29.401 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:23:29.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:29.402 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:23:29.410 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:23:29.411 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:29.414 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:23:29.435 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:23:29.436 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:23:29.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:23:29.485+0000 7f1f13546080 -1 init, newargv = 0x55631984dca0 newargc=9 2021-10-20T23:23:29.491 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14091]: starting ceph client 2021-10-20T23:23:29.491 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:23:29.492 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:23:29.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:29.493 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:23:29.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14091]: starting fuse 2021-10-20T23:23:30.599 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:23:30.617 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:23:30.618 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:23:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:23:30.676 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:23:30.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:30.677 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:23:30.682 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:23:30.683 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:23:30.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:30.684 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:23:30.684 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:23:30.685 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:23:30.685 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:23:30.685 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:23:30.686 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:30.686 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:23:30.687 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:23:30.687 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:23:30.688 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:30.688 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:23:30.688 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:23:30.689 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:23:30.689 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:23:30.690 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:30.691 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:23:30.691 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:23:30.692 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:23:30.692 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:23:30.693 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:23:30.694 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:30.694 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:23:30.694 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:23:30.771 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14091.asok 2021-10-20T23:23:30.775 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14091.asok 2021-10-20T23:23:30.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:30.776 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14091.asok status 2021-10-20T23:23:30.865 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:23:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:23:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:23:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:23:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:23:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:23:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:23:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14091", 2021-10-20T23:23:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:23:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:23:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:23:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:23:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5755, 2021-10-20T23:23:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:23:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:23:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:23:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5755 2021-10-20T23:23:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:23:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:23:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:23:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:23:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3258165892 2021-10-20T23:23:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:23:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:23:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:23:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:23:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:23:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3258165892 2021-10-20T23:23:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:23:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5755 172.21.15.119:0/3258165892", 2021-10-20T23:23:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/3258165892", 2021-10-20T23:23:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:23:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 25, 2021-10-20T23:23:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 58, 2021-10-20T23:23:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:23:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:23:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:23:30.874 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:23:30.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:30.877 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:30.877 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:30.884 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:23:30.885 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:23:30.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:30.886 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:30.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:30.946 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:30.947 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:30.954 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:23:30.955 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:23:30.956 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-20T23:23:30.956 DEBUG:teuthology.orchestra.run.smithi119:> import sys 2021-10-20T23:23:30.956 DEBUG:teuthology.orchestra.run.smithi119:> import time 2021-10-20T23:23:30.957 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:23:30.957 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:30.958 DEBUG:teuthology.orchestra.run.smithi119:> n = 1000 2021-10-20T23:23:30.958 DEBUG:teuthology.orchestra.run.smithi119:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-10-20T23:23:30.958 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:30.959 DEBUG:teuthology.orchestra.run.smithi119:> if not os.path.exists(os.path.dirname(abs_path)): 2021-10-20T23:23:30.959 DEBUG:teuthology.orchestra.run.smithi119:> os.makedirs(os.path.dirname(abs_path)) 2021-10-20T23:23:30.960 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:30.960 DEBUG:teuthology.orchestra.run.smithi119:> for i in range(0, n): 2021-10-20T23:23:30.960 DEBUG:teuthology.orchestra.run.smithi119:> fname = "{0}_{1}".format(abs_path, i) 2021-10-20T23:23:30.961 DEBUG:teuthology.orchestra.run.smithi119:> with open(fname, '"'"'w'"'"') as f: 2021-10-20T23:23:30.961 DEBUG:teuthology.orchestra.run.smithi119:> f.write('"'"'content'"'"') 2021-10-20T23:23:30.962 DEBUG:teuthology.orchestra.run.smithi119:> if True: 2021-10-20T23:23:30.962 DEBUG:teuthology.orchestra.run.smithi119:> f.flush() 2021-10-20T23:23:30.962 DEBUG:teuthology.orchestra.run.smithi119:> os.fsync(f.fileno()) 2021-10-20T23:23:30.963 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:23:36.488 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:23:36.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:23:36.494 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:23:36.497 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:23:42.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb16cde700 1 Processor -- start 2021-10-20T23:23:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb16cde700 1 -- start start 2021-10-20T23:23:42.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb16cde700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcb100b65c0 0x7fcb100b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb16cde700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 0x7fcb100ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb16cde700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb100acc90 con 0x7fcb10060d70 2021-10-20T23:23:42.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb16cde700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb100ae560 con 0x7fcb100b65c0 2021-10-20T23:23:42.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb16cde700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101446e0 con 0x7fcb101450c0 2021-10-20T23:23:42.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb14a7a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcb100b65c0 0x7fcb100b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb14a7a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcb100b65c0 0x7fcb100b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39608/0 (socket says 172.21.15.12:39608) 2021-10-20T23:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb14a7a700 1 -- 172.21.15.12:0/3675661319 learned_addr learned my addr 172.21.15.12:0/3675661319 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb1527b700 1 --2- 172.21.15.12:0/3675661319 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 0x7fcb100ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb14a7a700 1 -- 172.21.15.12:0/3675661319 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 msgr2=0x7fcb100ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb14a7a700 1 --2- 172.21.15.12:0/3675661319 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 0x7fcb100ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb14a7a700 1 -- 172.21.15.12:0/3675661319 >> v1:172.21.15.12:6789/0 conn(0x7fcb10060d70 legacy=0x7fcb10141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb14a7a700 1 -- 172.21.15.12:0/3675661319 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10144980 con 0x7fcb100b65c0 2021-10-20T23:23:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb14a7a700 1 --2- 172.21.15.12:0/3675661319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb100b65c0 0x7fcb100b69a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fcb080032f0 tx=0x7fcb08009290).ready entity=mon.0 client_cookie=cf68533f56c4f418 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb0f7fe700 1 -- 172.21.15.12:0/3675661319 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb0800b8a0 con 0x7fcb100b65c0 2021-10-20T23:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb0f7fe700 1 -- 172.21.15.12:0/3675661319 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0800ba00 con 0x7fcb100b65c0 2021-10-20T23:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.153+0000 7fcb0f7fe700 1 -- 172.21.15.12:0/3675661319 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb0800bb70 con 0x7fcb100b65c0 2021-10-20T23:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 -- 172.21.15.12:0/3675661319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb100b65c0 msgr2=0x7fcb100b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 --2- 172.21.15.12:0/3675661319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb100b65c0 0x7fcb100b69a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fcb080032f0 tx=0x7fcb08009290).stop 2021-10-20T23:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 -- 172.21.15.12:0/3675661319 shutdown_connections 2021-10-20T23:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 --2- 172.21.15.12:0/3675661319 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 0x7fcb100ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 --2- 172.21.15.12:0/3675661319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb100b65c0 0x7fcb100b69a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 -- 172.21.15.12:0/3675661319 >> 172.21.15.12:0/3675661319 conn(0x7fcb100b3480 msgr2=0x7fcb100b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 -- 172.21.15.12:0/3675661319 shutdown_connections 2021-10-20T23:23:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 -- 172.21.15.12:0/3675661319 wait complete. 2021-10-20T23:23:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 Processor -- start 2021-10-20T23:23:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 -- start start 2021-10-20T23:23:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb10060d70 0x7fcb100b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb100b65c0 0x7fcb10136140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 0x7fcb10136630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1013cd50 con 0x7fcb10060d70 2021-10-20T23:23:42.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1013e6a0 con 0x7fcb100b65c0 2021-10-20T23:23:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb16cde700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101544d0 con 0x7fcb101450c0 2021-10-20T23:23:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb14a7a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb10060d70 0x7fcb100b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb14a7a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb10060d70 0x7fcb100b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39614/0 (socket says 172.21.15.12:39614) 2021-10-20T23:23:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb14a7a700 1 -- 172.21.15.12:0/3425003433 learned_addr learned my addr 172.21.15.12:0/3425003433 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb0ffff700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb100b65c0 0x7fcb10136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.157+0000 7fcb1527b700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 0x7fcb10136630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb14a7a700 1 -- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 msgr2=0x7fcb10136630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb14a7a700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 0x7fcb10136630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb14a7a700 1 -- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb100b65c0 msgr2=0x7fcb10136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb14a7a700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb100b65c0 0x7fcb10136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb14a7a700 1 -- 172.21.15.12:0/3425003433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08009530 con 0x7fcb10060d70 2021-10-20T23:23:42.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb14a7a700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb10060d70 0x7fcb100b5200 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fcb1013e7e0 tx=0x7fcb08016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:42.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb0dffb700 1 -- 172.21.15.12:0/3425003433 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb0800b8a0 con 0x7fcb10060d70 2021-10-20T23:23:42.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb0dffb700 1 -- 172.21.15.12:0/3425003433 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb08021440 con 0x7fcb10060d70 2021-10-20T23:23:42.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb10154770 con 0x7fcb10060d70 2021-10-20T23:23:42.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb0dffb700 1 -- 172.21.15.12:0/3425003433 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb080217a0 con 0x7fcb10060d70 2021-10-20T23:23:42.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb10136b20 con 0x7fcb10060d70 2021-10-20T23:23:42.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1013ee30 con 0x7fcb10060d70 2021-10-20T23:23:42.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb0dffb700 1 -- 172.21.15.12:0/3425003433 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcb08028070 con 0x7fcb10060d70 2021-10-20T23:23:42.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb0dffb700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaf00534f0 0x7fcaf00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb0dffb700 1 -- 172.21.15.12:0/3425003433 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcb0806cb60 con 0x7fcb10060d70 2021-10-20T23:23:42.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.161+0000 7fcb0ffff700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaf00534f0 0x7fcaf00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.165+0000 7fcb0ffff700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaf00534f0 0x7fcaf00559b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fcb0400d000 tx=0x7fcb04007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:42.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.169+0000 7fcb0dffb700 1 -- 172.21.15.12:0/3425003433 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcb08043b60 con 0x7fcb10060d70 2021-10-20T23:23:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.333+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb10154900 con 0x7fcb10060d70 2021-10-20T23:23:42.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb0dffb700 1 -- 172.21.15.12:0/3425003433 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2489 (secure 0 0 0) 0x7fcb08015070 con 0x7fcb10060d70 2021-10-20T23:23:42.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:42.340 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:23:24.253029+0000","modified":"2021-10-20T23:23:25.255689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3232971526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3232971526},{"type":"v1","addr":"172.21.15.12:6835","nonce":3232971526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-20T23:23:42.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaf00534f0 msgr2=0x7fcaf00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaf00534f0 0x7fcaf00559b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fcb0400d000 tx=0x7fcb04007b90).stop 2021-10-20T23:23:42.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb10060d70 msgr2=0x7fcb100b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb10060d70 0x7fcb100b5200 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fcb1013e7e0 tx=0x7fcb08016000).stop 2021-10-20T23:23:42.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 shutdown_connections 2021-10-20T23:23:42.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaf00534f0 0x7fcaf00559b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb101450c0 0x7fcb10136630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb100b65c0 0x7fcb10136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 --2- 172.21.15.12:0/3425003433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb10060d70 0x7fcb100b5200 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 >> 172.21.15.12:0/3425003433 conn(0x7fcb100b3480 msgr2=0x7fcb10139ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:42.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.337+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 shutdown_connections 2021-10-20T23:23:42.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.341+0000 7fcb16cde700 1 -- 172.21.15.12:0/3425003433 wait complete. 2021-10-20T23:23:42.347 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2021-10-20T23:23:42.360 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_caps 20 2021-10-20T23:23:42.461 INFO:teuthology.orchestra.run.smithi012.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-10-20T23:23:42.461 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-10-20T23:23:42.462 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:42.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 Processor -- start 2021-10-20T23:23:42.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 -- start start 2021-10-20T23:23:42.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f961c0b1260 0x7f961c0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c0add80 con 0x7f961c0b1790 2021-10-20T23:23:42.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c0ae020 con 0x7f961c0b2580 2021-10-20T23:23:42.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961c0a9390 con 0x7f961c0b1260 2021-10-20T23:23:42.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96210ae700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f961c0b1790 0x7f961c14a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38220/0 (socket says 172.21.15.12:38220) 2021-10-20T23:23:42.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96210ae700 1 -- 172.21.15.12:0/3996725615 learned_addr learned my addr 172.21.15.12:0/3996725615 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:42.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961bfff700 1 --2- 172.21.15.12:0/3996725615 >> v2:172.21.15.31:3300/0 conn(0x7f961c0b1260 0x7f961c0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961b7fe700 1 -- 172.21.15.12:0/3996725615 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660960672 0 0) 0x7f961c0add80 con 0x7f961c0b1790 2021-10-20T23:23:42.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961b7fe700 1 -- 172.21.15.12:0/3996725615 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95fc003260 con 0x7f961c0b1790 2021-10-20T23:23:42.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961bfff700 1 -- 172.21.15.12:0/3996725615 >> v1:172.21.15.31:6789/0 conn(0x7f961c0b2580 legacy=0x7f961c0abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961b7fe700 1 -- 172.21.15.12:0/3996725615 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1581769855 0 0) 0x7f95fc003260 con 0x7f961c0b1790 2021-10-20T23:23:42.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961bfff700 1 -- 172.21.15.12:0/3996725615 >> v1:172.21.15.12:6789/0 conn(0x7f961c0b1790 legacy=0x7f961c14a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961bfff700 1 -- 172.21.15.12:0/3996725615 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c0a9830 con 0x7f961c0b1260 2021-10-20T23:23:42.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961bfff700 1 --2- 172.21.15.12:0/3996725615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0b1260 0x7f961c0afbd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f9614001800 tx=0x7f960c0091d0).ready entity=mon.1 client_cookie=94d06100a5e1afd5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:42.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961b7fe700 1 -- 172.21.15.12:0/3996725615 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9614001660 con 0x7f961c0b1260 2021-10-20T23:23:42.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961b7fe700 1 -- 172.21.15.12:0/3996725615 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c00b580 con 0x7f961c0b1260 2021-10-20T23:23:42.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f961b7fe700 1 -- 172.21.15.12:0/3996725615 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960c00b6f0 con 0x7f961c0b1260 2021-10-20T23:23:42.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 -- 172.21.15.12:0/3996725615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0b1260 msgr2=0x7f961c0afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 --2- 172.21.15.12:0/3996725615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0b1260 0x7f961c0afbd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f9614001800 tx=0x7f960c0091d0).stop 2021-10-20T23:23:42.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 -- 172.21.15.12:0/3996725615 shutdown_connections 2021-10-20T23:23:42.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 --2- 172.21.15.12:0/3996725615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0b1260 0x7f961c0afbd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 -- 172.21.15.12:0/3996725615 >> 172.21.15.12:0/3996725615 conn(0x7f961c060180 msgr2=0x7f961c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:42.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 -- 172.21.15.12:0/3996725615 shutdown_connections 2021-10-20T23:23:42.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.565+0000 7f96218af700 1 -- 172.21.15.12:0/3996725615 wait complete. 2021-10-20T23:23:42.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 Processor -- start 2021-10-20T23:23:42.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 -- start start 2021-10-20T23:23:42.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c0b1260 0x7f961c13e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0b1790 0x7f961c13d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f961c0b2580 0x7f961c065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0abe20 con 0x7f961c0b1260 2021-10-20T23:23:42.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0ac050 con 0x7f961c0b1790 2021-10-20T23:23:42.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0654b0 con 0x7f961c0b2580 2021-10-20T23:23:42.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96208ad700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c0b1260 0x7f961c13e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96208ad700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c0b1260 0x7f961c13e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39630/0 (socket says 172.21.15.12:39630) 2021-10-20T23:23:42.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96208ad700 1 -- 172.21.15.12:0/5099732 learned_addr learned my addr 172.21.15.12:0/5099732 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:42.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96210ae700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f961c0b2580 0x7f961c065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f961bfff700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0b1790 0x7f961c13d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96208ad700 1 -- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f961c0b2580 msgr2=0x7f961c065950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96208ad700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f961c0b2580 0x7f961c065950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96208ad700 1 -- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0b1790 msgr2=0x7f961c13d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96208ad700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0b1790 0x7f961c13d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96208ad700 1 -- 172.21.15.12:0/5099732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c009470 con 0x7f961c0b1260 2021-10-20T23:23:42.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96208ad700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c0b1260 0x7f961c13e980 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f961c061f20 tx=0x7f9604007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:42.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f9619ffb700 1 -- 172.21.15.12:0/5099732 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9604012400 con 0x7f961c0b1260 2021-10-20T23:23:42.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c0ab3a0 con 0x7f961c0b1260 2021-10-20T23:23:42.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f9619ffb700 1 -- 172.21.15.12:0/5099732 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604012560 con 0x7f961c0b1260 2021-10-20T23:23:42.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f9619ffb700 1 -- 172.21.15.12:0/5099732 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96040128c0 con 0x7f961c0b1260 2021-10-20T23:23:42.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.569+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c0b2dd0 con 0x7f961c0b1260 2021-10-20T23:23:42.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.573+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c057350 con 0x7f961c0b1260 2021-10-20T23:23:42.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.573+0000 7f9619ffb700 1 -- 172.21.15.12:0/5099732 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9604019030 con 0x7f961c0b1260 2021-10-20T23:23:42.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.573+0000 7f9619ffb700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f96000535b0 0x7f9600055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:42.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.573+0000 7f9619ffb700 1 -- 172.21.15.12:0/5099732 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f960406ae20 con 0x7f961c0b1260 2021-10-20T23:23:42.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.573+0000 7f961bfff700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f96000535b0 0x7f9600055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:42.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.573+0000 7f961bfff700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f96000535b0 0x7f9600055a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f960c01b000 tx=0x7f960c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:42.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.581+0000 7f9619ffb700 1 -- 172.21.15.12:0/5099732 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9604041d80 con 0x7f961c0b1260 2021-10-20T23:23:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.745+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f961c065670 con 0x7f961c0b1260 2021-10-20T23:23:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.745+0000 7f9619ffb700 1 -- 172.21.15.12:0/5099732 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f96040453a0 con 0x7f961c0b1260 2021-10-20T23:23:42.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:42.751 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:23:24.253029+0000","modified":"2021-10-20T23:23:25.255689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3232971526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3232971526},{"type":"v1","addr":"172.21.15.12:6835","nonce":3232971526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-20T23:23:42.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f96000535b0 msgr2=0x7f9600055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f96000535b0 0x7f9600055a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f960c01b000 tx=0x7f960c016000).stop 2021-10-20T23:23:42.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c0b1260 msgr2=0x7f961c13e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c0b1260 0x7f961c13e980 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f961c061f20 tx=0x7f9604007c50).stop 2021-10-20T23:23:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 shutdown_connections 2021-10-20T23:23:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f96000535b0 0x7f9600055a70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f961c0b2580 0x7f961c065950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0b1790 0x7f961c13d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 --2- 172.21.15.12:0/5099732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c0b1260 0x7f961c13e980 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 >> 172.21.15.12:0/5099732 conn(0x7f961c060180 msgr2=0x7f961c143260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 shutdown_connections 2021-10-20T23:23:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.749+0000 7f96218af700 1 -- 172.21.15.12:0/5099732 wait complete. 2021-10-20T23:23:42.756 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2021-10-20T23:23:42.764 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_decay_threshold 400 2021-10-20T23:23:42.870 INFO:teuthology.orchestra.run.smithi012.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-10-20T23:23:42.871 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-10-20T23:23:42.872 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:23:42.889 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:42.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.989+0000 7f1ddddf1700 1 Processor -- start 2021-10-20T23:23:42.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.989+0000 7f1ddddf1700 1 -- start start 2021-10-20T23:23:42.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1dd80b1db0 0x7f1dd80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1dd81483a0 0x7f1dd80b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd80b0350 con 0x7f1dd80a70c0 2021-10-20T23:23:43.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd80a90c0 con 0x7f1dd80b1db0 2021-10-20T23:23:43.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd80b05f0 con 0x7f1dd81483a0 2021-10-20T23:23:43.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd7fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1dd80a70c0 0x7f1dd8144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38234/0 (socket says 172.21.15.12:38234) 2021-10-20T23:23:43.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd7fff700 1 -- 172.21.15.12:0/2697121642 learned_addr learned my addr 172.21.15.12:0/2697121642 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:43.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd77fe700 1 --2- 172.21.15.12:0/2697121642 >> v2:172.21.15.12:3300/0 conn(0x7f1dd80b1db0 0x7f1dd80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd6ffd700 1 --2- 172.21.15.12:0/2697121642 >> v2:172.21.15.31:3300/0 conn(0x7f1dd81483a0 0x7f1dd80b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299645551 0 0) 0x7f1dd80b0350 con 0x7f1dd80a70c0 2021-10-20T23:23:43.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc4003260 con 0x7f1dd80a70c0 2021-10-20T23:23:43.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2970325030 0 0) 0x7f1dc4003260 con 0x7f1dd80a70c0 2021-10-20T23:23:43.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 >> v2:172.21.15.31:3300/0 conn(0x7f1dd81483a0 msgr2=0x7f1dd80b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 --2- 172.21.15.12:0/2697121642 >> v2:172.21.15.31:3300/0 conn(0x7f1dd81483a0 0x7f1dd80b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 >> v2:172.21.15.12:3300/0 conn(0x7f1dd80b1db0 msgr2=0x7f1dd80b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 --2- 172.21.15.12:0/2697121642 >> v2:172.21.15.12:3300/0 conn(0x7f1dd80b1db0 0x7f1dd80b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd80b0890 con 0x7f1dd80a70c0 2021-10-20T23:23:43.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f1dd00019e0 con 0x7f1dd80a70c0 2021-10-20T23:23:43.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 >> v1:172.21.15.12:6789/0 conn(0x7f1dd80a70c0 legacy=0x7f1dd8144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc4003750 0x7f1dc4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dc4004500 0x7f1dc4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4004e70 0x7f1dc400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80b05f0 con 0x7f1dc4003750 2021-10-20T23:23:43.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc400bc40 con 0x7f1dc4004e70 2021-10-20T23:23:43.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc400bd80 con 0x7f1dc4004500 2021-10-20T23:23:43.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd77fe700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc4003750 0x7f1dc4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd6ffd700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dc4004500 0x7f1dc4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd7fff700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4004e70 0x7f1dc400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd77fe700 1 -- 172.21.15.12:0/2697121642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dc4004500 msgr2=0x7f1dc4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd77fe700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dc4004500 0x7f1dc4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd77fe700 1 -- 172.21.15.12:0/2697121642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4004e70 msgr2=0x7f1dc400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd77fe700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4004e70 0x7f1dc400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd7fff700 1 -- 172.21.15.12:0/2697121642 reap_dead start 2021-10-20T23:23:43.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd77fe700 1 -- 172.21.15.12:0/2697121642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4003260 con 0x7f1dc4003750 2021-10-20T23:23:43.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd6ffd700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dc4004500 0x7f1dc4004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:43.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd77fe700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc4003750 0x7f1dc4003b70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f1dcc00c000 tx=0x7f1dcc006df0).ready entity=mon.0 client_cookie=fc8e1431b56b41a6 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dcc00e7d0 con 0x7f1dc4003750 2021-10-20T23:23:43.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc00e930 con 0x7f1dc4003750 2021-10-20T23:23:43.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1dd67fc700 1 -- 172.21.15.12:0/2697121642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dcc00ec90 con 0x7f1dc4003750 2021-10-20T23:23:43.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2697121642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc4003750 msgr2=0x7f1dc4003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc4003750 0x7f1dc4003b70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f1dcc00c000 tx=0x7f1dcc006df0).stop 2021-10-20T23:23:43.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2697121642 shutdown_connections 2021-10-20T23:23:43.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 --2- 172.21.15.12:0/2697121642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc4003750 0x7f1dc4003b70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2697121642 >> 172.21.15.12:0/2697121642 conn(0x7f1dd805f6b0 msgr2=0x7f1dd805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:43.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2697121642 shutdown_connections 2021-10-20T23:23:43.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.993+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2697121642 wait complete. 2021-10-20T23:23:43.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 Processor -- start 2021-10-20T23:23:43.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 -- start start 2021-10-20T23:23:43.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4003750 0x7f1dd80ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd80ab470 0x7f1dd80a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dd80a9b90 0x7f1dd815a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80ac890 con 0x7f1dd80ab470 2021-10-20T23:23:43.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80aa040 con 0x7f1dc4003750 2021-10-20T23:23:43.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd814a1b0 con 0x7f1dd80a9b90 2021-10-20T23:23:43.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd80ab470 0x7f1dd80a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd80ab470 0x7f1dd80a96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39650/0 (socket says 172.21.15.12:39650) 2021-10-20T23:23:43.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd6ffd700 1 -- 172.21.15.12:0/2128045751 learned_addr learned my addr 172.21.15.12:0/2128045751 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:43.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd77fe700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4003750 0x7f1dd80ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd7fff700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dd80a9b90 0x7f1dd815a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd6ffd700 1 -- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dd80a9b90 msgr2=0x7f1dd815a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd6ffd700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dd80a9b90 0x7f1dd815a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd6ffd700 1 -- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4003750 msgr2=0x7f1dd80ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd6ffd700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4003750 0x7f1dd80ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd6ffd700 1 -- 172.21.15.12:0/2128045751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd814a450 con 0x7f1dd80ab470 2021-10-20T23:23:43.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd6ffd700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd80ab470 0x7f1dd80a96a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f1dc800b000 tx=0x7f1dc8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd4ff9700 1 -- 172.21.15.12:0/2128045751 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc80135e0 con 0x7f1dd80ab470 2021-10-20T23:23:43.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd4ff9700 1 -- 172.21.15.12:0/2128045751 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8013740 con 0x7f1dd80ab470 2021-10-20T23:23:43.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd814a6f0 con 0x7f1dd80ab470 2021-10-20T23:23:43.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1dd4ff9700 1 -- 172.21.15.12:0/2128045751 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc8013aa0 con 0x7f1dd80ab470 2021-10-20T23:23:43.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:42.997+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd80ab8d0 con 0x7f1dd80ab470 2021-10-20T23:23:43.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.001+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd814af50 con 0x7f1dd80ab470 2021-10-20T23:23:43.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.001+0000 7f1dd4ff9700 1 -- 172.21.15.12:0/2128045751 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1dc8013c00 con 0x7f1dd80ab470 2021-10-20T23:23:43.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.001+0000 7f1dd4ff9700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1db8053610 0x7f1db8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.001+0000 7f1dd4ff9700 1 -- 172.21.15.12:0/2128045751 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1dc806c370 con 0x7f1dd80ab470 2021-10-20T23:23:43.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.001+0000 7f1dd77fe700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1db8053610 0x7f1db8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.001+0000 7f1dd77fe700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1db8053610 0x7f1db8055ad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f1dcc01b000 tx=0x7f1dcc019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.009+0000 7f1dd4ff9700 1 -- 172.21.15.12:0/2128045751 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1dc8043260 con 0x7f1dd80ab470 2021-10-20T23:23:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.169+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dd80a9440 con 0x7f1dd80ab470 2021-10-20T23:23:43.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1dd4ff9700 1 -- 172.21.15.12:0/2128045751 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f1dc8046880 con 0x7f1dd80ab470 2021-10-20T23:23:43.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:43.177 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:23:24.253029+0000","modified":"2021-10-20T23:23:25.255689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3232971526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3232971526},{"type":"v1","addr":"172.21.15.12:6835","nonce":3232971526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-20T23:23:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1db8053610 msgr2=0x7f1db8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1db8053610 0x7f1db8055ad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f1dcc01b000 tx=0x7f1dcc019000).stop 2021-10-20T23:23:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd80ab470 msgr2=0x7f1dd80a96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd80ab470 0x7f1dd80a96a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f1dc800b000 tx=0x7f1dc8008040).stop 2021-10-20T23:23:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 shutdown_connections 2021-10-20T23:23:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1db8053610 0x7f1db8055ad0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dd80a9b90 0x7f1dd815a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dd80ab470 0x7f1dd80a96a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 --2- 172.21.15.12:0/2128045751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4003750 0x7f1dd80ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 >> 172.21.15.12:0/2128045751 conn(0x7f1dd805f6b0 msgr2=0x7f1dd80b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 shutdown_connections 2021-10-20T23:23:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.173+0000 7f1ddddf1700 1 -- 172.21.15.12:0/2128045751 wait complete. 2021-10-20T23:23:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2021-10-20T23:23:43.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c cache drop 5 2021-10-20T23:23:43.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.293+0000 7fcefffff700 1 Processor -- start 2021-10-20T23:23:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.293+0000 7fcefffff700 1 -- start start 2021-10-20T23:23:43.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.293+0000 7fcefffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf000ad5c0 0x7fcf00061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.293+0000 7fcefffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000aecf0 con 0x7fcf00140440 2021-10-20T23:23:43.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.293+0000 7fcefffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000b6f20 con 0x7fcf00061320 2021-10-20T23:23:43.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.293+0000 7fcefffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000aef20 con 0x7fcf000ad5c0 2021-10-20T23:23:43.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.293+0000 7fceff7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcf00140440 0x7fcf00146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38254/0 (socket says 172.21.15.12:38254) 2021-10-20T23:23:43.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.293+0000 7fceff7fe700 1 -- 172.21.15.12:0/3333148508 learned_addr learned my addr 172.21.15.12:0/3333148508 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:43.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.293+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/3333148508 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf000ad5c0 0x7fcf00061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefdffb700 1 -- 172.21.15.12:0/3333148508 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164138005 0 0) 0x7fcf000aecf0 con 0x7fcf00140440 2021-10-20T23:23:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefdffb700 1 -- 172.21.15.12:0/3333148508 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee0003260 con 0x7fcf00140440 2021-10-20T23:23:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefdffb700 1 -- 172.21.15.12:0/3333148508 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901835412 0 0) 0x7fcf000b6f20 con 0x7fcf00061320 2021-10-20T23:23:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefdffb700 1 -- 172.21.15.12:0/3333148508 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf000aecf0 con 0x7fcf00061320 2021-10-20T23:23:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefe7fc700 1 -- 172.21.15.12:0/3333148508 >> v1:172.21.15.31:6789/0 conn(0x7fcf00061320 legacy=0x7fcf000b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefe7fc700 1 -- 172.21.15.12:0/3333148508 >> v1:172.21.15.12:6789/0 conn(0x7fcf00140440 legacy=0x7fcf00146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefe7fc700 1 -- 172.21.15.12:0/3333148508 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000af1c0 con 0x7fcf000ad5c0 2021-10-20T23:23:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/3333148508 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf000ad5c0 0x7fcf00061700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fcef0002f70 tx=0x7fcef0006df0).ready entity=mon.2 client_cookie=d5ee774e5dff141f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefdffb700 1 -- 172.21.15.12:0/3333148508 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef000d5c0 con 0x7fcf000ad5c0 2021-10-20T23:23:43.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefdffb700 1 -- 172.21.15.12:0/3333148508 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef0000e90 con 0x7fcf000ad5c0 2021-10-20T23:23:43.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefdffb700 1 -- 172.21.15.12:0/3333148508 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef000d910 con 0x7fcf000ad5c0 2021-10-20T23:23:43.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefffff700 1 -- 172.21.15.12:0/3333148508 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf000ad5c0 msgr2=0x7fcf00061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefffff700 1 --2- 172.21.15.12:0/3333148508 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf000ad5c0 0x7fcf00061700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fcef0002f70 tx=0x7fcef0006df0).stop 2021-10-20T23:23:43.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefffff700 1 -- 172.21.15.12:0/3333148508 shutdown_connections 2021-10-20T23:23:43.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefffff700 1 --2- 172.21.15.12:0/3333148508 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf000ad5c0 0x7fcf00061700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefffff700 1 -- 172.21.15.12:0/3333148508 >> 172.21.15.12:0/3333148508 conn(0x7fcf00066de0 msgr2=0x7fcf000671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:43.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefffff700 1 -- 172.21.15.12:0/3333148508 shutdown_connections 2021-10-20T23:23:43.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.297+0000 7fcefffff700 1 -- 172.21.15.12:0/3333148508 wait complete. 2021-10-20T23:23:43.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 Processor -- start 2021-10-20T23:23:43.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 -- start start 2021-10-20T23:23:43.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf00061320 0x7fcf000b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf000ad5c0 0x7fcf000b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf00140440 0x7fcf00155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000b0420 con 0x7fcf00061320 2021-10-20T23:23:43.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf00153390 con 0x7fcf000ad5c0 2021-10-20T23:23:43.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000b27b0 con 0x7fcf00140440 2021-10-20T23:23:43.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf00061320 0x7fcf000b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf00061320 0x7fcf000b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39662/0 (socket says 172.21.15.12:39662) 2021-10-20T23:23:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefeffd700 1 -- 172.21.15.12:0/1877546849 learned_addr learned my addr 172.21.15.12:0/1877546849 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf000ad5c0 0x7fcf000b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fceff7fe700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf00140440 0x7fcf00155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefeffd700 1 -- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf00140440 msgr2=0x7fcf00155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefeffd700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf00140440 0x7fcf00155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefeffd700 1 -- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf000ad5c0 msgr2=0x7fcf000b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefeffd700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf000ad5c0 0x7fcf000b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefeffd700 1 -- 172.21.15.12:0/1877546849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef000b180 con 0x7fcf00061320 2021-10-20T23:23:43.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf000ad5c0 0x7fcf000b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fceff7fe700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf00140440 0x7fcf00155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefeffd700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf00061320 0x7fcf000b0b70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fcee8001110 tx=0x7fcee8007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcef7fff700 1 -- 172.21.15.12:0/1877546849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcee800f470 con 0x7fcf00061320 2021-10-20T23:23:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcef7fff700 1 -- 172.21.15.12:0/1877546849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee800f5d0 con 0x7fcf00061320 2021-10-20T23:23:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 -- 172.21.15.12:0/1877546849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf00152ef0 con 0x7fcf00061320 2021-10-20T23:23:43.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcef7fff700 1 -- 172.21.15.12:0/1877546849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcee800f930 con 0x7fcf00061320 2021-10-20T23:23:43.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.301+0000 7fcefffff700 1 -- 172.21.15.12:0/1877546849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf000b1060 con 0x7fcf00061320 2021-10-20T23:23:43.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.305+0000 7fcef7fff700 1 -- 172.21.15.12:0/1877546849 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcee8019030 con 0x7fcf00061320 2021-10-20T23:23:43.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.305+0000 7fcef7fff700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcee4053610 0x7fcee4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.305+0000 7fcef7fff700 1 -- 172.21.15.12:0/1877546849 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcee806b0c0 con 0x7fcf00061320 2021-10-20T23:23:43.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.305+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcee4053610 0x7fcee4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.305+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcee4053610 0x7fcee4055ad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fcef0018000 tx=0x7fcef0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.305+0000 7fcf0f55c740 1 Processor -- start 2021-10-20T23:23:43.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.305+0000 7fcf0f55c740 1 -- start start 2021-10-20T23:23:43.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xe9a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xecfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 0xecb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0xe0a240 con 0xe975c0 2021-10-20T23:23:43.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0xdea8d0 con 0xe94b30 2021-10-20T23:23:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0xe95cf0 con 0xed0150 2021-10-20T23:23:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xecfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xecfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39672/0 (socket says 172.21.15.12:39672) 2021-10-20T23:23:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefe7fc700 1 -- 172.21.15.12:0/949329539 learned_addr learned my addr 172.21.15.12:0/949329539 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefeffd700 1 --2- 172.21.15.12:0/949329539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xe9a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fceff7fe700 1 --2- 172.21.15.12:0/949329539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 0xecb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefe7fc700 1 -- 172.21.15.12:0/949329539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 msgr2=0xecb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/949329539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 0xecb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefe7fc700 1 -- 172.21.15.12:0/949329539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 msgr2=0xe9a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/949329539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xe9a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefe7fc700 1 -- 172.21.15.12:0/949329539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe41d00 con 0xe975c0 2021-10-20T23:23:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/949329539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xecfc60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0xed0550 tx=0x7fcef001e000).ready entity=mon.0 client_cookie=50b6f329f3522188 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefffff700 1 -- 172.21.15.12:0/949329539 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef0013570 con 0xe975c0 2021-10-20T23:23:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefffff700 1 -- 172.21.15.12:0/949329539 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef00136d0 con 0xe975c0 2021-10-20T23:23:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcefffff700 1 -- 172.21.15.12:0/949329539 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef0013a30 con 0xe975c0 2021-10-20T23:23:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 -- 172.21.15.12:0/949329539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 msgr2=0xecfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/949329539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xecfc60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0xed0550 tx=0x7fcef001e000).stop 2021-10-20T23:23:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 -- 172.21.15.12:0/949329539 shutdown_connections 2021-10-20T23:23:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/949329539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 0xecb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/949329539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xecfc60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/949329539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xe9a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 -- 172.21.15.12:0/949329539 >> 172.21.15.12:0/949329539 conn(0xe97030 msgr2=0xe96730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 -- 172.21.15.12:0/949329539 shutdown_connections 2021-10-20T23:23:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.309+0000 7fcf0f55c740 1 -- 172.21.15.12:0/949329539 wait complete. 2021-10-20T23:23:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcf0f55c740 1 -- start start 2021-10-20T23:23:43.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcf0f55c740 1 Processor -- start 2021-10-20T23:23:43.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xed3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xed6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 0xe9ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0xed74b0 con 0xe975c0 2021-10-20T23:23:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0xed5190 con 0xe94b30 2021-10-20T23:23:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0xed5430 con 0xed0150 2021-10-20T23:23:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcf0f55c740 10 client.0 ll_register_callbacks cb 0xe512e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-20T23:23:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcefe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xed6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcefe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xed6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39678/0 (socket says 172.21.15.12:39678) 2021-10-20T23:23:43.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcefe7fc700 1 -- 172.21.15.12:0/2925921073 learned_addr learned my addr 172.21.15.12:0/2925921073 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:43.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fceff7fe700 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 0xe9ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.313+0000 7fcefeffd700 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xed3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcefe7fc700 1 -- 172.21.15.12:0/2925921073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 msgr2=0xe9ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 0xe9ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcefe7fc700 1 -- 172.21.15.12:0/2925921073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 msgr2=0xed3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xed3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcefe7fc700 1 -- 172.21.15.12:0/2925921073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf000af1c0 con 0xe975c0 2021-10-20T23:23:43.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xed6810 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0xed0550 tx=0x7fcef0027000).ready entity=mon.0 client_cookie=eeb5ca1386f82b21 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2021-10-20T23:23:43.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 1 -- 172.21.15.12:0/2925921073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef0031070 con 0xe975c0 2021-10-20T23:23:43.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 1 -- 172.21.15.12:0/2925921073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcef002b640 con 0xe975c0 2021-10-20T23:23:43.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 -- 172.21.15.12:0/2925921073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe00220 con 0xe975c0 2021-10-20T23:23:43.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 1 -- 172.21.15.12:0/2925921073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcef0013e50 con 0xe975c0 2021-10-20T23:23:43.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 10 client.5766 fetch_fsmap learned FSMap version 25 2021-10-20T23:23:43.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 -- 172.21.15.12:0/2925921073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0xdf9b00 con 0xe975c0 2021-10-20T23:23:43.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 1 -- 172.21.15.12:0/2925921073 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe00220 con 0xe975c0 2021-10-20T23:23:43.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 1 -- 172.21.15.12:0/2925921073 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fcef001f420 con 0xe975c0 2021-10-20T23:23:43.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 10 client.5766 fetch_fsmap finished waiting for FSMap version 25 2021-10-20T23:23:43.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 10 client.5766 resolve_mds: resolved ID 'c' to GID 5586 2021-10-20T23:23:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 20 client.5766 populate_metadata read hostname 'smithi012' 2021-10-20T23:23:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] conn(0xec7dc0 0xee1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 4 client.5766 mds_command: new command op to 5586 tid=0[{"prefix": "get_command_descriptions"}] 2021-10-20T23:23:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 -- 172.21.15.12:0/2925921073 --> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xdf8590 con 0xec7dc0 2021-10-20T23:23:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcefeffd700 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] conn(0xec7dc0 0xee1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 10 client.5766 ms_handle_connect on v2:172.21.15.12:6834/3232971526 2021-10-20T23:23:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcefeffd700 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] conn(0xec7dc0 0xee1d90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d5f8494be749fcb server_cookie=46345faa1818f3c0 in_seq=0 out_seq=0 2021-10-20T23:23:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 1 -- 172.21.15.12:0/2925921073 <== mds.0 v2:172.21.15.12:6834/3232971526 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0xdf8590 con 0xec7dc0 2021-10-20T23:23:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 10 client.5766 handle_command_reply: tid=0 2021-10-20T23:23:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 client.5766 shutdown 2021-10-20T23:23:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 -- 172.21.15.12:0/2925921073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 msgr2=0xed6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xed6810 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0xed0550 tx=0x7fcef0027000).stop 2021-10-20T23:23:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 -- 172.21.15.12:0/2925921073 shutdown_connections 2021-10-20T23:23:43.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] conn(0xec7dc0 0xee1d90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xed0150 0xe9ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xed6810 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/2925921073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xed3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fceddffb700 0 client.5766 ms_handle_reset on v2:172.21.15.12:6834/3232971526 2021-10-20T23:23:43.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 -- 172.21.15.12:0/2925921073 >> 172.21.15.12:0/2925921073 conn(0xe97030 msgr2=0xe99080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:43.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 -- 172.21.15.12:0/2925921073 shutdown_connections 2021-10-20T23:23:43.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 1 -- 172.21.15.12:0/2925921073 wait complete. 2021-10-20T23:23:43.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.317+0000 7fcf0f55c740 20 client.5766 trim_cache size 0 max 16384 2021-10-20T23:23:43.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 Processor -- start 2021-10-20T23:23:43.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 -- start start 2021-10-20T23:23:43.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xe98790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe975c0 0xe99080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xec7dc0 0xe9bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0xe9a740 con 0xec7dc0 2021-10-20T23:23:43.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0xe97480 con 0xe94b30 2021-10-20T23:23:43.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0xe07530 con 0xe975c0 2021-10-20T23:23:43.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fceff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xec7dc0 0xe9bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fceff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xec7dc0 0xe9bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39688/0 (socket says 172.21.15.12:39688) 2021-10-20T23:23:43.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fceff7fe700 1 -- 172.21.15.12:0/4043122098 learned_addr learned my addr 172.21.15.12:0/4043122098 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:43.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe975c0 0xe99080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcefeffd700 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xe98790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fceff7fe700 1 -- 172.21.15.12:0/4043122098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe975c0 msgr2=0xe99080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fceff7fe700 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe975c0 0xe99080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fceff7fe700 1 -- 172.21.15.12:0/4043122098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 msgr2=0xe98790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fceff7fe700 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xe98790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fceff7fe700 1 -- 172.21.15.12:0/4043122098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe02400 con 0xec7dc0 2021-10-20T23:23:43.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe975c0 0xe99080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:43.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fceff7fe700 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xec7dc0 0xe9bc90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fcef800d000 tx=0x7fcef8009040).ready entity=mon.0 client_cookie=f126d9b696a71bc0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcedffff700 1 -- 172.21.15.12:0/4043122098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef8005e40 con 0xec7dc0 2021-10-20T23:23:43.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcedffff700 1 -- 172.21.15.12:0/4043122098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef80070d0 con 0xec7dc0 2021-10-20T23:23:43.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcedffff700 1 -- 172.21.15.12:0/4043122098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef8007430 con 0xec7dc0 2021-10-20T23:23:43.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 -- 172.21.15.12:0/4043122098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xec7dc0 msgr2=0xe9bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:43.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xec7dc0 0xe9bc90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fcef800d000 tx=0x7fcef8009040).stop 2021-10-20T23:23:43.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 -- 172.21.15.12:0/4043122098 shutdown_connections 2021-10-20T23:23:43.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xec7dc0 0xe9bc90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe975c0 0xe99080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/4043122098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xe94b30 0xe98790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 -- 172.21.15.12:0/4043122098 >> 172.21.15.12:0/4043122098 conn(0xe97030 msgr2=0xecfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:43.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.337+0000 7fcf0f55c740 1 -- 172.21.15.12:0/4043122098 shutdown_connections 2021-10-20T23:23:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 -- 172.21.15.12:0/4043122098 wait complete. 2021-10-20T23:23:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 -- start start 2021-10-20T23:23:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 Processor -- start 2021-10-20T23:23:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe94b30 0xe9ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xe9b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xec7dc0 0xf2ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0xed7cb0 con 0xe975c0 2021-10-20T23:23:43.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0xed4050 con 0xec7dc0 2021-10-20T23:23:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0xee28f0 con 0xe94b30 2021-10-20T23:23:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 10 client.0 ll_register_callbacks cb 0xed1080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-20T23:23:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xe9b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xe9b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39692/0 (socket says 172.21.15.12:39692) 2021-10-20T23:23:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefe7fc700 1 -- 172.21.15.12:0/1420002887 learned_addr learned my addr 172.21.15.12:0/1420002887 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefeffd700 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe94b30 0xe9ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fceff7fe700 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xec7dc0 0xf2ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefe7fc700 1 -- 172.21.15.12:0/1420002887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe94b30 msgr2=0xe9ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe94b30 0xe9ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefe7fc700 1 -- 172.21.15.12:0/1420002887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xec7dc0 msgr2=0xf2ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xec7dc0 0xf2ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefe7fc700 1 -- 172.21.15.12:0/1420002887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xdf9b00 con 0xe975c0 2021-10-20T23:23:43.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fceff7fe700 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xec7dc0 0xf2ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:43.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefe7fc700 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xe9b170 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0xeeef20 tx=0x7fcef0031000).ready entity=mon.0 client_cookie=aea0920325247e2e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:43.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcedeffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2021-10-20T23:23:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcedeffd700 1 -- 172.21.15.12:0/1420002887 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef001f420 con 0xe975c0 2021-10-20T23:23:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcedeffd700 1 -- 172.21.15.12:0/1420002887 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcef0042dc0 con 0xe975c0 2021-10-20T23:23:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 -- 172.21.15.12:0/1420002887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcef00136d0 con 0xe975c0 2021-10-20T23:23:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcedeffd700 1 -- 172.21.15.12:0/1420002887 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcef001f580 con 0xe975c0 2021-10-20T23:23:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 10 client.5772 fetch_fsmap learned FSMap version 25 2021-10-20T23:23:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 -- 172.21.15.12:0/1420002887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x7fcef800f040 con 0xe975c0 2021-10-20T23:23:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcedeffd700 1 -- 172.21.15.12:0/1420002887 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef00136d0 con 0xe975c0 2021-10-20T23:23:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcedeffd700 1 -- 172.21.15.12:0/1420002887 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fcef00056f0 con 0xe975c0 2021-10-20T23:23:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 10 client.5772 fetch_fsmap finished waiting for FSMap version 25 2021-10-20T23:23:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 10 client.5772 resolve_mds: resolved ID 'c' to GID 5586 2021-10-20T23:23:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 20 client.5772 populate_metadata read hostname 'smithi012' 2021-10-20T23:23:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] conn(0xed0150 0xf2f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 4 client.5772 mds_command: new command op to 5586 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-10-20T23:23:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcf0f55c740 1 -- 172.21.15.12:0/1420002887 --> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0xcee5e0 con 0xed0150 2021-10-20T23:23:43.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.341+0000 7fcefeffd700 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] conn(0xed0150 0xf2f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:43.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.345+0000 7fcedeffd700 10 client.5772 ms_handle_connect on v2:172.21.15.12:6834/3232971526 2021-10-20T23:23:43.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:43.345+0000 7fcefeffd700 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] conn(0xed0150 0xf2f370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=79dba3551e13bc75 server_cookie=72eba1fccc030842 in_seq=0 out_seq=0 2021-10-20T23:23:48.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcedeffd700 1 -- 172.21.15.12:0/1420002887 <== mds.0 v2:172.21.15.12:6834/3232971526 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0xcee5e0 con 0xed0150 2021-10-20T23:23:48.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcedeffd700 10 client.5772 handle_command_reply: tid=0 2021-10-20T23:23:48.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 client.5772 shutdown 2021-10-20T23:23:48.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 -- 172.21.15.12:0/1420002887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 msgr2=0xe9b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:48.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xe9b170 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0xeeef20 tx=0x7fcef0031000).stop 2021-10-20T23:23:48.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 -- 172.21.15.12:0/1420002887 shutdown_connections 2021-10-20T23:23:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.12:6834/3232971526,v1:172.21.15.12:6835/3232971526] conn(0xed0150 0xf2f370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0xec7dc0 0xf2ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0xe975c0 0xe9b170 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcedeffd700 0 client.5772 ms_handle_reset on v2:172.21.15.12:6834/3232971526 2021-10-20T23:23:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 --2- 172.21.15.12:0/1420002887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0xe94b30 0xe9ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 -- 172.21.15.12:0/1420002887 >> 172.21.15.12:0/1420002887 conn(0xe97030 msgr2=0xe98580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 -- 172.21.15.12:0/1420002887 shutdown_connections 2021-10-20T23:23:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 1 -- 172.21.15.12:0/1420002887 wait complete. 2021-10-20T23:23:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcf0f55c740 20 client.5772 trim_cache size 0 max 16384 2021-10-20T23:23:48.533 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:23:48.533 INFO:teuthology.orchestra.run.smithi012.stdout: "client_recall": { 2021-10-20T23:23:48.533 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": -110, 2021-10-20T23:23:48.534 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "(110) Connection timed out", 2021-10-20T23:23:48.534 INFO:teuthology.orchestra.run.smithi012.stdout: "recalled": 120 2021-10-20T23:23:48.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:48.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flush_journal": { 2021-10-20T23:23:48.535 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2021-10-20T23:23:48.535 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "" 2021-10-20T23:23:48.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:48.536 INFO:teuthology.orchestra.run.smithi012.stdout: "trim_cache": { 2021-10-20T23:23:48.536 INFO:teuthology.orchestra.run.smithi012.stdout: "trimmed": 0 2021-10-20T23:23:48.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:48.537 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2021-10-20T23:23:48.537 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": { 2021-10-20T23:23:48.537 INFO:teuthology.orchestra.run.smithi012.stdout: "items": 19981, 2021-10-20T23:23:48.537 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes": 3099104 2021-10-20T23:23:48.537 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:23:48.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:23:48.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1801880999999996 2021-10-20T23:23:48.538 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:23:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 -- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcee4053610 msgr2=0x7fcee4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcee4053610 0x7fcee4055ad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fcef0018000 tx=0x7fcef0014000).stop 2021-10-20T23:23:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 -- 172.21.15.12:0/1877546849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf00061320 msgr2=0x7fcf000b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:48.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf00061320 0x7fcf000b0b70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fcee8001110 tx=0x7fcee8007ae0).stop 2021-10-20T23:23:48.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 -- 172.21.15.12:0/1877546849 shutdown_connections 2021-10-20T23:23:48.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcee4053610 0x7fcee4055ad0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf00140440 0x7fcf00155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf000ad5c0 0x7fcf000b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 --2- 172.21.15.12:0/1877546849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf00061320 0x7fcf000b0b70 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 -- 172.21.15.12:0/1877546849 >> 172.21.15.12:0/1877546849 conn(0x7fcf00066de0 msgr2=0x7fcf000671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:48.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 -- 172.21.15.12:0/1877546849 shutdown_connections 2021-10-20T23:23:48.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.525+0000 7fcefffff700 1 -- 172.21.15.12:0/1877546849 wait complete. 2021-10-20T23:23:48.543 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-10-20T23:23:48.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:48.544 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:48.544 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:48.552 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-10-20T23:23:48.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:23:48.553 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-10-20T23:23:48.554 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:23:48.554 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:23:48.555 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:48.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:48.575 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:48.576 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:48.622 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:23:48.624 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:23:48.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:23:48.625 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:48.632 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:23:48.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32c92f700 1 Processor -- start 2021-10-20T23:23:48.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32c92f700 1 -- start start 2021-10-20T23:23:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32c92f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b2580 0x7fd32814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32c92f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd3280b0010 0x7fd32814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32c92f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3280a70c0 con 0x7fd3280afbd0 2021-10-20T23:23:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32c92f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3280a72f0 con 0x7fd3280b0010 2021-10-20T23:23:48.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32c92f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280a7590 con 0x7fd3280b2580 2021-10-20T23:23:48.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32759e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd3280afbd0 0x7fd3280a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38302/0 (socket says 172.21.15.12:38302) 2021-10-20T23:23:48.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32759e700 1 -- 172.21.15.12:0/3713268057 learned_addr learned my addr 172.21.15.12:0/3713268057 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:48.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32659c700 1 --2- 172.21.15.12:0/3713268057 >> v2:172.21.15.31:3300/0 conn(0x7fd3280b0010 0x7fd32814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:48.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd326d9d700 1 --2- 172.21.15.12:0/3713268057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b2580 0x7fd32814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:48.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd325d9b700 1 -- 172.21.15.12:0/3713268057 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201989185 0 0) 0x7fd3280a70c0 con 0x7fd3280afbd0 2021-10-20T23:23:48.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd325d9b700 1 -- 172.21.15.12:0/3713268057 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd308003260 con 0x7fd3280afbd0 2021-10-20T23:23:48.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32659c700 1 -- 172.21.15.12:0/3713268057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b2580 msgr2=0x7fd32814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:48.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32659c700 1 --2- 172.21.15.12:0/3713268057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b2580 0x7fd32814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32659c700 1 -- 172.21.15.12:0/3713268057 >> v1:172.21.15.12:6789/0 conn(0x7fd3280afbd0 legacy=0x7fd3280a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:48.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd325d9b700 1 -- 172.21.15.12:0/3713268057 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4077481214 0 0) 0x7fd308003260 con 0x7fd3280afbd0 2021-10-20T23:23:48.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32659c700 1 -- 172.21.15.12:0/3713268057 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280a7830 con 0x7fd3280b0010 2021-10-20T23:23:48.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd32659c700 1 --2- 172.21.15.12:0/3713268057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b0010 0x7fd32814b330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fd3200032f0 tx=0x7fd3200091d0).ready entity=mon.1 client_cookie=a0189d8adfbedff server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:48.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd325d9b700 1 -- 172.21.15.12:0/3713268057 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd32000b600 con 0x7fd3280b0010 2021-10-20T23:23:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd325d9b700 1 -- 172.21.15.12:0/3713268057 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32000b760 con 0x7fd3280b0010 2021-10-20T23:23:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.741+0000 7fd325d9b700 1 -- 172.21.15.12:0/3713268057 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd32000b8d0 con 0x7fd3280b0010 2021-10-20T23:23:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 -- 172.21.15.12:0/3713268057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b0010 msgr2=0x7fd32814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:48.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 --2- 172.21.15.12:0/3713268057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b0010 0x7fd32814b330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fd3200032f0 tx=0x7fd3200091d0).stop 2021-10-20T23:23:48.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 -- 172.21.15.12:0/3713268057 shutdown_connections 2021-10-20T23:23:48.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 --2- 172.21.15.12:0/3713268057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b0010 0x7fd32814b330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 --2- 172.21.15.12:0/3713268057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b2580 0x7fd32814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 -- 172.21.15.12:0/3713268057 >> 172.21.15.12:0/3713268057 conn(0x7fd328060180 msgr2=0x7fd3280b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:48.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 -- 172.21.15.12:0/3713268057 shutdown_connections 2021-10-20T23:23:48.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 -- 172.21.15.12:0/3713268057 wait complete. 2021-10-20T23:23:48.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 Processor -- start 2021-10-20T23:23:48.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 -- start start 2021-10-20T23:23:48.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3280afbd0 0x7fd328143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:48.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b0010 0x7fd328141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:48.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b2580 0x7fd328141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:48.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280a9df0 con 0x7fd3280afbd0 2021-10-20T23:23:48.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32814c320 con 0x7fd3280b2580 2021-10-20T23:23:48.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32c92f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b0520 con 0x7fd3280b0010 2021-10-20T23:23:48.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd326d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3280afbd0 0x7fd328143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:48.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd326d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3280afbd0 0x7fd328143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39712/0 (socket says 172.21.15.12:39712) 2021-10-20T23:23:48.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd32659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b0010 0x7fd328141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:48.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.745+0000 7fd326d9d700 1 -- 172.21.15.12:0/1108799184 learned_addr learned my addr 172.21.15.12:0/1108799184 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:48.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd32759e700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b2580 0x7fd328141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:48.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd326d9d700 1 -- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b0010 msgr2=0x7fd328141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:48.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd326d9d700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b0010 0x7fd328141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd326d9d700 1 -- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b2580 msgr2=0x7fd328141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:48.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd326d9d700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b2580 0x7fd328141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd326d9d700 1 -- 172.21.15.12:0/1108799184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd320009470 con 0x7fd3280afbd0 2021-10-20T23:23:48.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd32759e700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b2580 0x7fd328141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:48.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd326d9d700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3280afbd0 0x7fd328143b90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fd3280ab690 tx=0x7fd310006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:48.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd31ffff700 1 -- 172.21.15.12:0/1108799184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd310010780 con 0x7fd3280afbd0 2021-10-20T23:23:48.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd31ffff700 1 -- 172.21.15.12:0/1108799184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3100108e0 con 0x7fd3280afbd0 2021-10-20T23:23:48.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32814cd20 con 0x7fd3280afbd0 2021-10-20T23:23:48.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd31ffff700 1 -- 172.21.15.12:0/1108799184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd310010c40 con 0x7fd3280afbd0 2021-10-20T23:23:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32814c550 con 0x7fd3280afbd0 2021-10-20T23:23:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.749+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd328057350 con 0x7fd3280afbd0 2021-10-20T23:23:48.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.753+0000 7fd31ffff700 1 -- 172.21.15.12:0/1108799184 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd31001c460 con 0x7fd3280afbd0 2021-10-20T23:23:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.753+0000 7fd31ffff700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd30c053610 0x7fd30c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.753+0000 7fd31ffff700 1 -- 172.21.15.12:0/1108799184 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd31006be60 con 0x7fd3280afbd0 2021-10-20T23:23:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.753+0000 7fd32659c700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd30c053610 0x7fd30c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.753+0000 7fd32659c700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd30c053610 0x7fd30c055ad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fd320019000 tx=0x7fd320016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:48.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.757+0000 7fd31ffff700 1 -- 172.21.15.12:0/1108799184 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd310042d80 con 0x7fd3280afbd0 2021-10-20T23:23:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.881+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd32814c750 con 0x7fd3280afbd0 2021-10-20T23:23:48.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.881+0000 7fd31ffff700 1 -- 172.21.15.12:0/1108799184 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16273 (secure 0 0 0) 0x7fd3100463a0 con 0x7fd3280afbd0 2021-10-20T23:23:48.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:48.887 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":58,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:23:25.256255+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:23:22.639987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-20T23:23:23.594440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:23:48.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd30c053610 msgr2=0x7fd30c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:48.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd30c053610 0x7fd30c055ad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fd320019000 tx=0x7fd320016000).stop 2021-10-20T23:23:48.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3280afbd0 msgr2=0x7fd328143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:48.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3280afbd0 0x7fd328143b90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fd3280ab690 tx=0x7fd310006df0).stop 2021-10-20T23:23:48.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 shutdown_connections 2021-10-20T23:23:48.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd30c053610 0x7fd30c055ad0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3280b2580 0x7fd328141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3280b0010 0x7fd328141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 --2- 172.21.15.12:0/1108799184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3280afbd0 0x7fd328143b90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:48.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 >> 172.21.15.12:0/1108799184 conn(0x7fd328060180 msgr2=0x7fd3281486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:48.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 shutdown_connections 2021-10-20T23:23:48.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:48.885+0000 7fd32c92f700 1 -- 172.21.15.12:0/1108799184 wait complete. 2021-10-20T23:23:48.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:23:22.639987+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:23:23.594440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:23:48.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:23:49.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.013+0000 7ff8ba997700 1 Processor -- start 2021-10-20T23:23:49.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.013+0000 7ff8ba997700 1 -- start start 2021-10-20T23:23:49.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff8b40b7370 0x7ff8b40b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b40b2380 con 0x7ff8b40b3060 2021-10-20T23:23:49.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b4144250 con 0x7ff8b40aac20 2021-10-20T23:23:49.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40b3570 con 0x7ff8b40b7370 2021-10-20T23:23:49.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b9194700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff8b40b3060 0x7ff8b413e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38314/0 (socket says 172.21.15.12:38314) 2021-10-20T23:23:49.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b9194700 1 -- 172.21.15.12:0/1506135502 learned_addr learned my addr 172.21.15.12:0/1506135502 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:49.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b9995700 1 --2- 172.21.15.12:0/1506135502 >> v2:172.21.15.31:3300/0 conn(0x7ff8b40b7370 0x7ff8b40b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b8993700 1 -- 172.21.15.12:0/1506135502 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350541778 0 0) 0x7ff8b40b2380 con 0x7ff8b40b3060 2021-10-20T23:23:49.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b8993700 1 -- 172.21.15.12:0/1506135502 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff89c003260 con 0x7ff8b40b3060 2021-10-20T23:23:49.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b8993700 1 -- 172.21.15.12:0/1506135502 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868936416 0 0) 0x7ff8b4144250 con 0x7ff8b40aac20 2021-10-20T23:23:49.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b8993700 1 -- 172.21.15.12:0/1506135502 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b40b2380 con 0x7ff8b40aac20 2021-10-20T23:23:49.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b8993700 1 -- 172.21.15.12:0/1506135502 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 751233358 0 0) 0x7ff89c003260 con 0x7ff8b40b3060 2021-10-20T23:23:49.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b9995700 1 -- 172.21.15.12:0/1506135502 >> v1:172.21.15.31:6789/0 conn(0x7ff8b40aac20 legacy=0x7ff8b4064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b9995700 1 -- 172.21.15.12:0/1506135502 >> v1:172.21.15.12:6789/0 conn(0x7ff8b40b3060 legacy=0x7ff8b413e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b9995700 1 -- 172.21.15.12:0/1506135502 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40b25b0 con 0x7ff8b40b7370 2021-10-20T23:23:49.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b9995700 1 --2- 172.21.15.12:0/1506135502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8b40b7370 0x7ff8b40b7750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ff8b0001110 tx=0x7ff8a8006d90).ready entity=mon.1 client_cookie=9b1aa528f83a237e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b8993700 1 -- 172.21.15.12:0/1506135502 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b0001660 con 0x7ff8b40b7370 2021-10-20T23:23:49.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b8993700 1 -- 172.21.15.12:0/1506135502 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8000e90 con 0x7ff8b40b7370 2021-10-20T23:23:49.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8b8993700 1 -- 172.21.15.12:0/1506135502 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a800beb0 con 0x7ff8b40b7370 2021-10-20T23:23:49.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 -- 172.21.15.12:0/1506135502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8b40b7370 msgr2=0x7ff8b40b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 --2- 172.21.15.12:0/1506135502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8b40b7370 0x7ff8b40b7750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ff8b0001110 tx=0x7ff8a8006d90).stop 2021-10-20T23:23:49.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 -- 172.21.15.12:0/1506135502 shutdown_connections 2021-10-20T23:23:49.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 --2- 172.21.15.12:0/1506135502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8b40b7370 0x7ff8b40b7750 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 -- 172.21.15.12:0/1506135502 >> 172.21.15.12:0/1506135502 conn(0x7ff8b405f6b0 msgr2=0x7ff8b405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:49.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 -- 172.21.15.12:0/1506135502 shutdown_connections 2021-10-20T23:23:49.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 -- 172.21.15.12:0/1506135502 wait complete. 2021-10-20T23:23:49.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.017+0000 7ff8ba997700 1 Processor -- start 2021-10-20T23:23:49.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 -- start start 2021-10-20T23:23:49.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8b40aac20 0x7ff8b4141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8b40b3060 0x7ff8b413cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8b40b7370 0x7ff8b4155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40afd70 con 0x7ff8b40b7370 2021-10-20T23:23:49.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40b16d0 con 0x7ff8b40b3060 2021-10-20T23:23:49.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b409ea30 con 0x7ff8b40aac20 2021-10-20T23:23:49.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba196700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8b40b7370 0x7ff8b4155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba196700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8b40b7370 0x7ff8b4155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39728/0 (socket says 172.21.15.12:39728) 2021-10-20T23:23:49.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba196700 1 -- 172.21.15.12:0/2032442021 learned_addr learned my addr 172.21.15.12:0/2032442021 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:49.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8b9194700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8b40b3060 0x7ff8b413cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8b9995700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8b40aac20 0x7ff8b4141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba196700 1 -- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8b40aac20 msgr2=0x7ff8b4141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba196700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8b40aac20 0x7ff8b4141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba196700 1 -- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8b40b3060 msgr2=0x7ff8b413cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba196700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8b40b3060 0x7ff8b413cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba196700 1 -- 172.21.15.12:0/2032442021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a800b120 con 0x7ff8b40b7370 2021-10-20T23:23:49.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba196700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8b40b7370 0x7ff8b4155850 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7ff8ac001490 tx=0x7ff8ac007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8a6ffd700 1 -- 172.21.15.12:0/2032442021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8ac002310 con 0x7ff8b40b7370 2021-10-20T23:23:49.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b409ecd0 con 0x7ff8b40b7370 2021-10-20T23:23:49.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8a6ffd700 1 -- 172.21.15.12:0/2032442021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac002470 con 0x7ff8b40b7370 2021-10-20T23:23:49.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8a6ffd700 1 -- 172.21.15.12:0/2032442021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8ac001840 con 0x7ff8b40b7370 2021-10-20T23:23:49.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b414fd50 con 0x7ff8b40b7370 2021-10-20T23:23:49.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.021+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b40a1360 con 0x7ff8b40b7370 2021-10-20T23:23:49.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.025+0000 7ff8a6ffd700 1 -- 172.21.15.12:0/2032442021 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff8ac010030 con 0x7ff8b40b7370 2021-10-20T23:23:49.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.025+0000 7ff8a6ffd700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8940536a0 0x7ff894055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.025+0000 7ff8a6ffd700 1 -- 172.21.15.12:0/2032442021 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff8ac06baf0 con 0x7ff8b40b7370 2021-10-20T23:23:49.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.025+0000 7ff8b9995700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8940536a0 0x7ff894055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.025+0000 7ff8b9995700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8940536a0 0x7ff894055b60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff8a801a000 tx=0x7ff8a8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.029+0000 7ff8a6ffd700 1 -- 172.21.15.12:0/2032442021 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8ac042a50 con 0x7ff8b40b7370 2021-10-20T23:23:49.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.153+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff8b409ee60 con 0x7ff8b40b7370 2021-10-20T23:23:49.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.153+0000 7ff8a6ffd700 1 -- 172.21.15.12:0/2032442021 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v58) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff8ac046070 con 0x7ff8b40b7370 2021-10-20T23:23:49.158 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:23:49.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8940536a0 msgr2=0x7ff894055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8940536a0 0x7ff894055b60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff8a801a000 tx=0x7ff8a8014000).stop 2021-10-20T23:23:49.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8b40b7370 msgr2=0x7ff8b4155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8b40b7370 0x7ff8b4155850 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7ff8ac001490 tx=0x7ff8ac007dd0).stop 2021-10-20T23:23:49.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 shutdown_connections 2021-10-20T23:23:49.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff8940536a0 0x7ff894055b60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8b40b7370 0x7ff8b4155850 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8b40b3060 0x7ff8b413cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 --2- 172.21.15.12:0/2032442021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8b40aac20 0x7ff8b4141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 >> 172.21.15.12:0/2032442021 conn(0x7ff8b405f6b0 msgr2=0x7ff8b40b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:49.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 shutdown_connections 2021-10-20T23:23:49.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.157+0000 7ff8ba997700 1 -- 172.21.15.12:0/2032442021 wait complete. 2021-10-20T23:23:49.171 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:23:49.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.273+0000 7ffaf1331700 1 Processor -- start 2021-10-20T23:23:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.273+0000 7ffaf1331700 1 -- start start 2021-10-20T23:23:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4180 0x7ffaec140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffaec0b4690 0x7ffaec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaec143b60 con 0x7ffaec146950 2021-10-20T23:23:49.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec147510 con 0x7ffaec0b4690 2021-10-20T23:23:49.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec143e00 con 0x7ffaec0b4180 2021-10-20T23:23:49.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaeaffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffaec146950 0x7ffaec140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38326/0 (socket says 172.21.15.12:38326) 2021-10-20T23:23:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaeaffd700 1 -- 172.21.15.12:0/4197520933 learned_addr learned my addr 172.21.15.12:0/4197520933 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaeb7fe700 1 --2- 172.21.15.12:0/4197520933 >> v2:172.21.15.31:3300/0 conn(0x7ffaec0b4690 0x7ffaec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaea7fc700 1 --2- 172.21.15.12:0/4197520933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4180 0x7ffaec140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffae9ffb700 1 -- 172.21.15.12:0/4197520933 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240011514 0 0) 0x7ffaec143b60 con 0x7ffaec146950 2021-10-20T23:23:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffae9ffb700 1 -- 172.21.15.12:0/4197520933 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffacc003260 con 0x7ffaec146950 2021-10-20T23:23:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaeb7fe700 1 -- 172.21.15.12:0/4197520933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4180 msgr2=0x7ffaec140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaeb7fe700 1 --2- 172.21.15.12:0/4197520933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4180 0x7ffaec140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaeb7fe700 1 -- 172.21.15.12:0/4197520933 >> v1:172.21.15.12:6789/0 conn(0x7ffaec146950 legacy=0x7ffaec140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffae9ffb700 1 -- 172.21.15.12:0/4197520933 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167666992 0 0) 0x7ffacc003260 con 0x7ffaec146950 2021-10-20T23:23:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaeb7fe700 1 -- 172.21.15.12:0/4197520933 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec0b0c90 con 0x7ffaec0b4690 2021-10-20T23:23:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaeb7fe700 1 --2- 172.21.15.12:0/4197520933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec0b4690 0x7ffaec0b4ed0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ffadc001800 tx=0x7ffae40091d0).ready entity=mon.1 client_cookie=c862a00c646c0726 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffae9ffb700 1 -- 172.21.15.12:0/4197520933 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffadc001660 con 0x7ffaec0b4690 2021-10-20T23:23:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffae9ffb700 1 -- 172.21.15.12:0/4197520933 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae400f510 con 0x7ffaec0b4690 2021-10-20T23:23:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffae9ffb700 1 -- 172.21.15.12:0/4197520933 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae400f680 con 0x7ffaec0b4690 2021-10-20T23:23:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 -- 172.21.15.12:0/4197520933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec0b4690 msgr2=0x7ffaec0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 --2- 172.21.15.12:0/4197520933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec0b4690 0x7ffaec0b4ed0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ffadc001800 tx=0x7ffae40091d0).stop 2021-10-20T23:23:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 -- 172.21.15.12:0/4197520933 shutdown_connections 2021-10-20T23:23:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 --2- 172.21.15.12:0/4197520933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec0b4690 0x7ffaec0b4ed0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 --2- 172.21.15.12:0/4197520933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4180 0x7ffaec140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 -- 172.21.15.12:0/4197520933 >> 172.21.15.12:0/4197520933 conn(0x7ffaec05c490 msgr2=0x7ffaec05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 -- 172.21.15.12:0/4197520933 shutdown_connections 2021-10-20T23:23:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.277+0000 7ffaf1331700 1 -- 172.21.15.12:0/4197520933 wait complete. 2021-10-20T23:23:49.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 Processor -- start 2021-10-20T23:23:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 -- start start 2021-10-20T23:23:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaec0b4180 0x7ffaec0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4690 0x7ffaec0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec146950 0x7ffaec140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0af5c0 con 0x7ffaec0b4180 2021-10-20T23:23:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec142bd0 con 0x7ffaec146950 2021-10-20T23:23:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec142350 con 0x7ffaec0b4690 2021-10-20T23:23:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaec0b4180 0x7ffaec0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec146950 0x7ffaec140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaea7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4690 0x7ffaec0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaec0b4180 0x7ffaec0b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39740/0 (socket says 172.21.15.12:39740) 2021-10-20T23:23:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeaffd700 1 -- 172.21.15.12:0/1429755206 learned_addr learned my addr 172.21.15.12:0/1429755206 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeb7fe700 1 -- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4690 msgr2=0x7ffaec0b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeb7fe700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4690 0x7ffaec0b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeb7fe700 1 -- 172.21.15.12:0/1429755206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaec0b4180 msgr2=0x7ffaec0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeb7fe700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaec0b4180 0x7ffaec0b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeb7fe700 1 -- 172.21.15.12:0/1429755206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4009470 con 0x7ffaec146950 2021-10-20T23:23:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaeb7fe700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec146950 0x7ffaec140ee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7ffaec0b5ec0 tx=0x7ffae4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffae3fff700 1 -- 172.21.15.12:0/1429755206 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae40032f0 con 0x7ffaec146950 2021-10-20T23:23:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffae3fff700 1 -- 172.21.15.12:0/1429755206 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4011bf0 con 0x7ffaec146950 2021-10-20T23:23:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec146380 con 0x7ffaec146950 2021-10-20T23:23:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffae3fff700 1 -- 172.21.15.12:0/1429755206 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae4021480 con 0x7ffaec146950 2021-10-20T23:23:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.281+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec1425b0 con 0x7ffaec146950 2021-10-20T23:23:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.285+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec057350 con 0x7ffaec146950 2021-10-20T23:23:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.285+0000 7ffae3fff700 1 -- 172.21.15.12:0/1429755206 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffae400f070 con 0x7ffaec146950 2021-10-20T23:23:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.285+0000 7ffae3fff700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffad0053610 0x7ffad0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.285+0000 7ffae3fff700 1 -- 172.21.15.12:0/1429755206 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ffae406cd80 con 0x7ffaec146950 2021-10-20T23:23:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.285+0000 7ffaeaffd700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffad0053610 0x7ffad0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.285+0000 7ffaeaffd700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffad0053610 0x7ffad0055ad0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ffadc00d000 tx=0x7ffadc0011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.293+0000 7ffae3fff700 1 -- 172.21.15.12:0/1429755206 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffae4043c70 con 0x7ffaec146950 2021-10-20T23:23:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.421+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffaec142d10 con 0x7ffaec146950 2021-10-20T23:23:49.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.421+0000 7ffae3fff700 1 -- 172.21.15.12:0/1429755206 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffae4047290 con 0x7ffaec146950 2021-10-20T23:23:49.426 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:23:49.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffad0053610 msgr2=0x7ffad0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffad0053610 0x7ffad0055ad0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ffadc00d000 tx=0x7ffadc0011a0).stop 2021-10-20T23:23:49.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec146950 msgr2=0x7ffaec140ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec146950 0x7ffaec140ee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7ffaec0b5ec0 tx=0x7ffae4016000).stop 2021-10-20T23:23:49.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 shutdown_connections 2021-10-20T23:23:49.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffad0053610 0x7ffad0055ad0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaec146950 0x7ffaec140ee0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaec0b4690 0x7ffaec0b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 --2- 172.21.15.12:0/1429755206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaec0b4180 0x7ffaec0b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 >> 172.21.15.12:0/1429755206 conn(0x7ffaec05c490 msgr2=0x7ffaec1441a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:49.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 shutdown_connections 2021-10-20T23:23:49.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.425+0000 7ffaf1331700 1 -- 172.21.15.12:0/1429755206 wait complete. 2021-10-20T23:23:49.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:23:49.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.541+0000 7f7bbb433700 1 Processor -- start 2021-10-20T23:23:49.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.541+0000 7f7bbb433700 1 -- start start 2021-10-20T23:23:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7bb40b1460 0x7f7bb4141040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7bb4141530 0x7f7bb4141980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb40aef20 con 0x7f7bb40b5300 2021-10-20T23:23:49.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb40ac300 con 0x7f7bb4141530 2021-10-20T23:23:49.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb40af150 con 0x7f7bb40b1460 2021-10-20T23:23:49.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbac32700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7bb4141530 0x7f7bb4141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbac32700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7bb4141530 0x7f7bb4141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39750/0 (socket says 172.21.15.12:39750) 2021-10-20T23:23:49.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbac32700 1 -- 172.21.15.12:0/1545922023 learned_addr learned my addr 172.21.15.12:0/1545922023 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:49.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bb9c30700 1 --2- 172.21.15.12:0/1545922023 >> v2:172.21.15.31:3300/0 conn(0x7f7bb40b1460 0x7f7bb4141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbac32700 1 -- 172.21.15.12:0/1545922023 >> v2:172.21.15.31:3300/0 conn(0x7f7bb40b1460 msgr2=0x7f7bb4141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:49.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbac32700 1 --2- 172.21.15.12:0/1545922023 >> v2:172.21.15.31:3300/0 conn(0x7f7bb40b1460 0x7f7bb4141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbac32700 1 -- 172.21.15.12:0/1545922023 >> v1:172.21.15.31:6789/0 conn(0x7f7bb40b5300 legacy=0x7f7bb413e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbac32700 1 -- 172.21.15.12:0/1545922023 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb40af3f0 con 0x7f7bb4141530 2021-10-20T23:23:49.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbac32700 1 --2- 172.21.15.12:0/1545922023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb4141530 0x7f7bb4141980 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f7bac0032f0 tx=0x7f7bac009290).ready entity=mon.0 client_cookie=6acae3f6b14ebe8a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bb942f700 1 -- 172.21.15.12:0/1545922023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bac00b870 con 0x7f7bb4141530 2021-10-20T23:23:49.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bb942f700 1 -- 172.21.15.12:0/1545922023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac00b9d0 con 0x7f7bb4141530 2021-10-20T23:23:49.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bb942f700 1 -- 172.21.15.12:0/1545922023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bac00bb40 con 0x7f7bb4141530 2021-10-20T23:23:49.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 -- 172.21.15.12:0/1545922023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb4141530 msgr2=0x7f7bb4141980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 --2- 172.21.15.12:0/1545922023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb4141530 0x7f7bb4141980 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f7bac0032f0 tx=0x7f7bac009290).stop 2021-10-20T23:23:49.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 -- 172.21.15.12:0/1545922023 shutdown_connections 2021-10-20T23:23:49.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 --2- 172.21.15.12:0/1545922023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb4141530 0x7f7bb4141980 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 --2- 172.21.15.12:0/1545922023 >> v2:172.21.15.31:3300/0 conn(0x7f7bb40b1460 0x7f7bb4141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 -- 172.21.15.12:0/1545922023 >> 172.21.15.12:0/1545922023 conn(0x7f7bb4062560 msgr2=0x7f7bb4062940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:49.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 -- 172.21.15.12:0/1545922023 shutdown_connections 2021-10-20T23:23:49.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 -- 172.21.15.12:0/1545922023 wait complete. 2021-10-20T23:23:49.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 Processor -- start 2021-10-20T23:23:49.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.545+0000 7f7bbb433700 1 -- start start 2021-10-20T23:23:49.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bbb433700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bb40b1460 0x7f7bb4142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bbb433700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb40b5300 0x7f7bb4142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bbb433700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bb4141530 0x7f7bb414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bbb433700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb4142ef0 con 0x7f7bb40b5300 2021-10-20T23:23:49.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bbb433700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb40b4d10 con 0x7f7bb40b1460 2021-10-20T23:23:49.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bbb433700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb41511e0 con 0x7f7bb4141530 2021-10-20T23:23:49.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bb9c30700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb40b5300 0x7f7bb4142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bb9c30700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb40b5300 0x7f7bb4142a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39752/0 (socket says 172.21.15.12:39752) 2021-10-20T23:23:49.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bb9c30700 1 -- 172.21.15.12:0/1597042010 learned_addr learned my addr 172.21.15.12:0/1597042010 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:49.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bba431700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bb40b1460 0x7f7bb4142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bbac32700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bb4141530 0x7f7bb414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bb9c30700 1 -- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bb4141530 msgr2=0x7f7bb414d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bb9c30700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bb4141530 0x7f7bb414d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bb9c30700 1 -- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bb40b1460 msgr2=0x7f7bb4142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bb9c30700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bb40b1460 0x7f7bb4142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bb9c30700 1 -- 172.21.15.12:0/1597042010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac009530 con 0x7f7bb40b5300 2021-10-20T23:23:49.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bb9c30700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb40b5300 0x7f7bb4142a00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f7bb000c000 tx=0x7f7bb0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7ba37fe700 1 -- 172.21.15.12:0/1597042010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb0011750 con 0x7f7bb40b5300 2021-10-20T23:23:49.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7ba37fe700 1 -- 172.21.15.12:0/1597042010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb00118b0 con 0x7f7bb40b5300 2021-10-20T23:23:49.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7ba37fe700 1 -- 172.21.15.12:0/1597042010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb0011c10 con 0x7f7bb40b5300 2021-10-20T23:23:49.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb40b3ff0 con 0x7f7bb40b5300 2021-10-20T23:23:49.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.549+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb40b4710 con 0x7f7bb40b5300 2021-10-20T23:23:49.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.553+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb4151020 con 0x7f7bb40b5300 2021-10-20T23:23:49.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.553+0000 7f7ba37fe700 1 -- 172.21.15.12:0/1597042010 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7bb0011d70 con 0x7f7bb40b5300 2021-10-20T23:23:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.553+0000 7f7ba37fe700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b94053610 0x7f7b94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.553+0000 7f7ba37fe700 1 -- 172.21.15.12:0/1597042010 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7bb006bec0 con 0x7f7bb40b5300 2021-10-20T23:23:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.553+0000 7f7bba431700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b94053610 0x7f7b94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.553+0000 7f7bba431700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b94053610 0x7f7b94055ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7ba400d000 tx=0x7f7ba4007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.561+0000 7f7ba37fe700 1 -- 172.21.15.12:0/1597042010 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7bb0042ec0 con 0x7f7bb40b5300 2021-10-20T23:23:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.685+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bb40afbf0 con 0x7f7bb40b5300 2021-10-20T23:23:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7ba37fe700 1 -- 172.21.15.12:0/1597042010 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7bb00464e0 con 0x7f7bb40b5300 2021-10-20T23:23:49.693 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:23:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b94053610 msgr2=0x7f7b94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b94053610 0x7f7b94055ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7ba400d000 tx=0x7f7ba4007b70).stop 2021-10-20T23:23:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb40b5300 msgr2=0x7f7bb4142a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb40b5300 0x7f7bb4142a00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f7bb000c000 tx=0x7f7bb0006df0).stop 2021-10-20T23:23:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 shutdown_connections 2021-10-20T23:23:49.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b94053610 0x7f7b94055ad0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bb4141530 0x7f7bb414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bb40b5300 0x7f7bb4142a00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 --2- 172.21.15.12:0/1597042010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bb40b1460 0x7f7bb4142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 >> 172.21.15.12:0/1597042010 conn(0x7f7bb4062560 msgr2=0x7f7bb4140480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 shutdown_connections 2021-10-20T23:23:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.689+0000 7f7bbb433700 1 -- 172.21.15.12:0/1597042010 wait complete. 2021-10-20T23:23:49.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:23:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda6246700 1 Processor -- start 2021-10-20T23:23:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda6246700 1 -- start start 2021-10-20T23:23:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda6246700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda6246700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcda0140440 0x7fcda01408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda6246700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda00aecf0 con 0x7fcda0061320 2021-10-20T23:23:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda6246700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda00b6f20 con 0x7fcda0140440 2021-10-20T23:23:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda6246700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00aef20 con 0x7fcda00ad5c0 2021-10-20T23:23:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda5244700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcda0061320 0x7fcda00b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45418/0 (socket says 172.21.15.12:45418) 2021-10-20T23:23:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda5244700 1 -- 172.21.15.12:0/1080360599 learned_addr learned my addr 172.21.15.12:0/1080360599 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:23:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda4a43700 1 --2- 172.21.15.12:0/1080360599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda5a45700 1 --2- 172.21.15.12:0/1080360599 >> v2:172.21.15.31:3300/0 conn(0x7fcda0140440 0x7fcda01408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcd97fff700 1 -- 172.21.15.12:0/1080360599 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358436078 0 0) 0x7fcda00aecf0 con 0x7fcda0061320 2021-10-20T23:23:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcd97fff700 1 -- 172.21.15.12:0/1080360599 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd84003260 con 0x7fcda0061320 2021-10-20T23:23:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda4a43700 1 -- 172.21.15.12:0/1080360599 >> v2:172.21.15.31:3300/0 conn(0x7fcda0140440 msgr2=0x7fcda01408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda4a43700 1 --2- 172.21.15.12:0/1080360599 >> v2:172.21.15.31:3300/0 conn(0x7fcda0140440 0x7fcda01408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda4a43700 1 -- 172.21.15.12:0/1080360599 >> v1:172.21.15.31:6789/0 conn(0x7fcda0061320 legacy=0x7fcda00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda4a43700 1 -- 172.21.15.12:0/1080360599 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00af1c0 con 0x7fcda00ad5c0 2021-10-20T23:23:49.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda5a45700 1 --2- 172.21.15.12:0/1080360599 >> v2:172.21.15.31:3300/0 conn(0x7fcda0140440 0x7fcda01408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:23:49.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcda4a43700 1 --2- 172.21.15.12:0/1080360599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0061700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fcd90002f70 tx=0x7fcd90006df0).ready entity=mon.2 client_cookie=885f5de3389ea40b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcd97fff700 1 -- 172.21.15.12:0/1080360599 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd9000d570 con 0x7fcda00ad5c0 2021-10-20T23:23:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcd97fff700 1 -- 172.21.15.12:0/1080360599 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90000e90 con 0x7fcda00ad5c0 2021-10-20T23:23:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.813+0000 7fcd97fff700 1 -- 172.21.15.12:0/1080360599 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd9000d8c0 con 0x7fcda00ad5c0 2021-10-20T23:23:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 -- 172.21.15.12:0/1080360599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 msgr2=0x7fcda0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 --2- 172.21.15.12:0/1080360599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0061700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fcd90002f70 tx=0x7fcd90006df0).stop 2021-10-20T23:23:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 -- 172.21.15.12:0/1080360599 shutdown_connections 2021-10-20T23:23:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 --2- 172.21.15.12:0/1080360599 >> v2:172.21.15.31:3300/0 conn(0x7fcda0140440 0x7fcda01408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 --2- 172.21.15.12:0/1080360599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0061700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 -- 172.21.15.12:0/1080360599 >> 172.21.15.12:0/1080360599 conn(0x7fcda0066de0 msgr2=0x7fcda00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 -- 172.21.15.12:0/1080360599 shutdown_connections 2021-10-20T23:23:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 -- 172.21.15.12:0/1080360599 wait complete. 2021-10-20T23:23:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 Processor -- start 2021-10-20T23:23:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.817+0000 7fcda6246700 1 -- start start 2021-10-20T23:23:49.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda6246700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda0061320 0x7fcda00b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda6246700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda6246700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda0140440 0x7fcda0152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda6246700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00b19c0 con 0x7fcda0061320 2021-10-20T23:23:49.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda6246700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00afeb0 con 0x7fcda0140440 2021-10-20T23:23:49.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda6246700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00b1bf0 con 0x7fcda00ad5c0 2021-10-20T23:23:49.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda5244700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda0061320 0x7fcda00b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda4a43700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda5244700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda0061320 0x7fcda00b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39766/0 (socket says 172.21.15.12:39766) 2021-10-20T23:23:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda5244700 1 -- 172.21.15.12:0/3591992555 learned_addr learned my addr 172.21.15.12:0/3591992555 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda5a45700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda0140440 0x7fcda0152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda4a43700 1 -- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda0140440 msgr2=0x7fcda0152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda4a43700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda0140440 0x7fcda0152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda4a43700 1 -- 172.21.15.12:0/3591992555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda0061320 msgr2=0x7fcda00b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda4a43700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda0061320 0x7fcda00b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda4a43700 1 -- 172.21.15.12:0/3591992555 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9000b180 con 0x7fcda00ad5c0 2021-10-20T23:23:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda5244700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda0061320 0x7fcda00b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda4a43700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0152440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcd90002f70 tx=0x7fcd90014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcd967fc700 1 -- 172.21.15.12:0/3591992555 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd9000dea0 con 0x7fcda00ad5c0 2021-10-20T23:23:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcd967fc700 1 -- 172.21.15.12:0/3591992555 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90013de0 con 0x7fcda00ad5c0 2021-10-20T23:23:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda00b1e90 con 0x7fcda00ad5c0 2021-10-20T23:23:49.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcd967fc700 1 -- 172.21.15.12:0/3591992555 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd9001e5f0 con 0x7fcda00ad5c0 2021-10-20T23:23:49.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda00af930 con 0x7fcda00ad5c0 2021-10-20T23:23:49.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda00b2020 con 0x7fcda00ad5c0 2021-10-20T23:23:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.821+0000 7fcd967fc700 1 -- 172.21.15.12:0/3591992555 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcd90025030 con 0x7fcda00ad5c0 2021-10-20T23:23:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.825+0000 7fcd967fc700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd880534f0 0x7fcd880559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.825+0000 7fcd967fc700 1 -- 172.21.15.12:0/3591992555 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcd9006ca20 con 0x7fcda00ad5c0 2021-10-20T23:23:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.825+0000 7fcda5244700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd880534f0 0x7fcd880559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.825+0000 7fcda5244700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd880534f0 0x7fcd880559b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fcd9c00d000 tx=0x7fcd9c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:49.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.833+0000 7fcd967fc700 1 -- 172.21.15.12:0/3591992555 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd90043a20 con 0x7fcda00ad5c0 2021-10-20T23:23:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.953+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcda0057350 con 0x7fcda00ad5c0 2021-10-20T23:23:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcd967fc700 1 -- 172.21.15.12:0/3591992555 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcd90023020 con 0x7fcda00ad5c0 2021-10-20T23:23:49.960 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:23:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd880534f0 msgr2=0x7fcd880559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd880534f0 0x7fcd880559b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fcd9c00d000 tx=0x7fcd9c009040).stop 2021-10-20T23:23:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 msgr2=0x7fcda0152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0152440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcd90002f70 tx=0x7fcd90014000).stop 2021-10-20T23:23:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 shutdown_connections 2021-10-20T23:23:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd880534f0 0x7fcd880559b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda0140440 0x7fcda0152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcda00ad5c0 0x7fcda0152440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 --2- 172.21.15.12:0/3591992555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda0061320 0x7fcda00b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 >> 172.21.15.12:0/3591992555 conn(0x7fcda0066de0 msgr2=0x7fcda00b7760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 shutdown_connections 2021-10-20T23:23:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:49.957+0000 7fcda6246700 1 -- 172.21.15.12:0/3591992555 wait complete. 2021-10-20T23:23:49.975 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:23:49.976 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:23:50.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7fead583c700 1 Processor -- start 2021-10-20T23:23:50.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7fead583c700 1 -- start start 2021-10-20T23:23:50.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7fead583c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fead00b0010 0x7fead00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:50.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7fead583c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fead00afbd0 0x7fead00a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:50.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7fead583c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead00a70c0 con 0x7fead00b2580 2021-10-20T23:23:50.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7fead583c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00a72f0 con 0x7fead00b0010 2021-10-20T23:23:50.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7fead583c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00a7590 con 0x7fead00afbd0 2021-10-20T23:23:50.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7feacffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fead00b0010 0x7fead00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:50.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7feacffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fead00b0010 0x7fead00a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39776/0 (socket says 172.21.15.12:39776) 2021-10-20T23:23:50.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7feacffff700 1 -- 172.21.15.12:0/1220822558 learned_addr learned my addr 172.21.15.12:0/1220822558 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:50.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.077+0000 7fead503b700 1 --2- 172.21.15.12:0/1220822558 >> v2:172.21.15.31:3300/0 conn(0x7fead00afbd0 0x7fead00a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:50.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7feacffff700 1 -- 172.21.15.12:0/1220822558 >> v2:172.21.15.31:3300/0 conn(0x7fead00afbd0 msgr2=0x7fead00a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:50.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7feacffff700 1 --2- 172.21.15.12:0/1220822558 >> v2:172.21.15.31:3300/0 conn(0x7fead00afbd0 0x7fead00a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:50.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7feacffff700 1 -- 172.21.15.12:0/1220822558 >> v1:172.21.15.31:6789/0 conn(0x7fead00b2580 legacy=0x7fead014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:23:50.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7feacffff700 1 -- 172.21.15.12:0/1220822558 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00a7830 con 0x7fead00b0010 2021-10-20T23:23:50.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7feacffff700 1 --2- 172.21.15.12:0/1220822558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b0010 0x7fead00a83b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fead006b7c0 tx=0x7feac0006eb0).ready entity=mon.0 client_cookie=b993aea8b713c366 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:50.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7feacf7fe700 1 -- 172.21.15.12:0/1220822558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac000d5c0 con 0x7fead00b0010 2021-10-20T23:23:50.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7feacf7fe700 1 -- 172.21.15.12:0/1220822558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac0000e90 con 0x7fead00b0010 2021-10-20T23:23:50.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7feacf7fe700 1 -- 172.21.15.12:0/1220822558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac000d910 con 0x7fead00b0010 2021-10-20T23:23:50.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7fead583c700 1 -- 172.21.15.12:0/1220822558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b0010 msgr2=0x7fead00a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:50.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7fead583c700 1 --2- 172.21.15.12:0/1220822558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b0010 0x7fead00a83b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fead006b7c0 tx=0x7feac0006eb0).stop 2021-10-20T23:23:50.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7fead583c700 1 -- 172.21.15.12:0/1220822558 shutdown_connections 2021-10-20T23:23:50.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7fead583c700 1 --2- 172.21.15.12:0/1220822558 >> v2:172.21.15.31:3300/0 conn(0x7fead00afbd0 0x7fead00a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:50.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7fead583c700 1 --2- 172.21.15.12:0/1220822558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b0010 0x7fead00a83b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:50.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7fead583c700 1 -- 172.21.15.12:0/1220822558 >> 172.21.15.12:0/1220822558 conn(0x7fead0060180 msgr2=0x7fead00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:50.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7fead583c700 1 -- 172.21.15.12:0/1220822558 shutdown_connections 2021-10-20T23:23:50.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.081+0000 7fead583c700 1 -- 172.21.15.12:0/1220822558 wait complete. 2021-10-20T23:23:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 Processor -- start 2021-10-20T23:23:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 -- start start 2021-10-20T23:23:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fead00afbd0 0x7fead00ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b0010 0x7fead01454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b2580 0x7fead01459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead0063310 con 0x7fead00b2580 2021-10-20T23:23:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00abae0 con 0x7fead00b0010 2021-10-20T23:23:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead0067380 con 0x7fead00afbd0 2021-10-20T23:23:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead503b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b2580 0x7fead01459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b0010 0x7fead01454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead483a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fead00afbd0 0x7fead00ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead503b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b2580 0x7fead01459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39784/0 (socket says 172.21.15.12:39784) 2021-10-20T23:23:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead503b700 1 -- 172.21.15.12:0/1604004299 learned_addr learned my addr 172.21.15.12:0/1604004299 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:23:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacffff700 1 -- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fead00afbd0 msgr2=0x7fead00ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacffff700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fead00afbd0 0x7fead00ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacffff700 1 -- 172.21.15.12:0/1604004299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b2580 msgr2=0x7fead01459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacffff700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b2580 0x7fead01459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacffff700 1 -- 172.21.15.12:0/1604004299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac000b1e0 con 0x7fead00b0010 2021-10-20T23:23:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead503b700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b2580 0x7fead01459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:23:50.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacffff700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b0010 0x7fead01454e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fead0063450 tx=0x7feac0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:50.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacdffb700 1 -- 172.21.15.12:0/1604004299 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac000bec0 con 0x7fead00b0010 2021-10-20T23:23:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacdffb700 1 -- 172.21.15.12:0/1604004299 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac000d940 con 0x7fead00b0010 2021-10-20T23:23:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7feacdffb700 1 -- 172.21.15.12:0/1604004299 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac0011cf0 con 0x7fead00b0010 2021-10-20T23:23:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead00abd10 con 0x7fead00b0010 2021-10-20T23:23:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.085+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead0063000 con 0x7fead00b0010 2021-10-20T23:23:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.089+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead00671e0 con 0x7fead00b0010 2021-10-20T23:23:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.089+0000 7feacdffb700 1 -- 172.21.15.12:0/1604004299 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feac001a040 con 0x7fead00b0010 2021-10-20T23:23:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.089+0000 7feacdffb700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feab0053610 0x7feab0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:23:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.089+0000 7feacdffb700 1 -- 172.21.15.12:0/1604004299 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7feac006c9d0 con 0x7fead00b0010 2021-10-20T23:23:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.089+0000 7fead483a700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feab0053610 0x7feab0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:23:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.089+0000 7fead483a700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feab0053610 0x7feab0055ad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7feac400c000 tx=0x7feac4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:23:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.097+0000 7feacdffb700 1 -- 172.21.15.12:0/1604004299 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fead00671e0 con 0x7fead00b0010 2021-10-20T23:23:50.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.261+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fead00671e0 con 0x7fead00b0010 2021-10-20T23:23:50.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.265+0000 7feacdffb700 1 -- 172.21.15.12:0/1604004299 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2489 (secure 0 0 0) 0x7fead00671e0 con 0x7fead00b0010 2021-10-20T23:23:50.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:23:50.269 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:23:24.253029+0000","modified":"2021-10-20T23:23:25.255689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3232971526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3232971526},{"type":"v1","addr":"172.21.15.12:6835","nonce":3232971526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-20T23:23:50.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feab0053610 msgr2=0x7feab0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:50.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feab0053610 0x7feab0055ad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7feac400c000 tx=0x7feac4008040).stop 2021-10-20T23:23:50.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b0010 msgr2=0x7fead01454e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:23:50.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b0010 0x7fead01454e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fead0063450 tx=0x7feac0015000).stop 2021-10-20T23:23:50.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 shutdown_connections 2021-10-20T23:23:50.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feab0053610 0x7feab0055ad0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:50.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fead00b2580 0x7fead01459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:50.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b0010 0x7fead01454e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:50.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 --2- 172.21.15.12:0/1604004299 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fead00afbd0 0x7fead00ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:23:50.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 >> 172.21.15.12:0/1604004299 conn(0x7fead0060180 msgr2=0x7fead0146550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:23:50.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 shutdown_connections 2021-10-20T23:23:50.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:23:50.269+0000 7fead583c700 1 -- 172.21.15.12:0/1604004299 wait complete. 2021-10-20T23:23:50.275 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2021-10-20T23:23:50.590 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:23:24.253029+0000', 'modified': '2021-10-20T23:23:25.255689+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5586}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5586': {'gid': 5586, 'name': 'c', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/3232971526', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 3232971526}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 3232971526}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:23:50.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:23:50.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:23:50.712 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":5586,"want_state":"up:active","state":"up:active","rank_uptime":26.446435654999998,"mdsmap_epoch":25,"osdmap_epoch":58,"osdmap_epoch_barrier":57,"uptime":30.826426720000001} 2021-10-20T23:23:50.713 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 5586, "mdsmap_epoch": 25, "osdmap_epoch": 58, "osdmap_epoch_barrier": 57, "rank_uptime": 26.446435655, "state": "up:active", "uptime": 30.82642672, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:23:50.714 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:23:50.714 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:23:50.715 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:23:50.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:50.717 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:50.726 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:23:50.744 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:23:50.745 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:23:50.763 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:23:50.764 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:23:50.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:50.766 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:23:50.815 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:23:50.817 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:50.821 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:23:50.840 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:23:50.841 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:23:50.894 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:23:50.896 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:23:50.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:50.897 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:23:50.898 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:23:50.888+0000 7f2ddbf5a080 -1 init, newargv = 0x555b41cb2b90 newargc=9 2021-10-20T23:23:50.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14172]: starting ceph client 2021-10-20T23:23:50.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14172]: starting fuse 2021-10-20T23:23:52.006 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:23:52.025 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:23:52.026 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:23:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:23:52.085 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:23:52.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:52.086 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:23:52.094 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:23:52.094 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:23:52.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:52.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:23:52.096 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:23:52.097 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:23:52.097 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:23:52.098 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:23:52.098 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:52.098 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:23:52.099 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:23:52.099 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:23:52.100 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:52.100 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:23:52.102 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:23:52.102 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:23:52.103 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:23:52.103 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:52.104 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:23:52.104 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:23:52.105 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:23:52.105 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:23:52.105 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:23:52.106 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:23:52.106 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:23:52.107 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:23:52.151 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14172.asok 2021-10-20T23:23:52.157 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14172.asok 2021-10-20T23:23:52.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:52.159 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14172.asok status 2021-10-20T23:23:52.255 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:23:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:23:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:23:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:23:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:23:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:23:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:23:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14172", 2021-10-20T23:23:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:23:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:23:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:23:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:23:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5405, 2021-10-20T23:23:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:23:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:23:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:23:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5405 2021-10-20T23:23:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:23:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:23:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:23:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:23:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2694159003 2021-10-20T23:23:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:23:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:23:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:23:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:23:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:23:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2694159003 2021-10-20T23:23:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:23:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5405 172.21.15.119:0/2694159003", 2021-10-20T23:23:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/2694159003", 2021-10-20T23:23:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:23:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 25, 2021-10-20T23:23:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 58, 2021-10-20T23:23:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:23:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:23:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:23:52.269 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:23:52.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:52.271 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:23:52.271 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:23:52.281 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:23:52.281 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:23:52.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:23:52.285 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:24:06.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:24:06.579 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:24:06.581 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:24:06.584 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:24:36.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:24:36.643 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:24:36.646 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:24:36.648 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:24:44.885 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:24:44.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:24:44.907 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:24:44.929 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:24:44.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:24:44.972 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:24:44.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:24:44.973 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:24:44.974 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:24:45.000 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:24:45.001 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:24:45.001 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:24:45.002 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:24:45.002 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:24:45.017 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14172]: fuse finished with error 0 and tester_r 0 2021-10-20T23:24:45.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:24:45.019 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:24:45.020 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:24:45.026 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:24:45.027 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:24:45.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:24:45.148 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:24:45.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:24:45.157 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:24:45.157 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:24:45.165 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:24:45.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:24:45.167 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:24:45.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:24:45.168 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:24:45.174 INFO:teuthology.orchestra.run.smithi136.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:24:45.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:24:45.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:24:45.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cb4a82700 1 Processor -- start 2021-10-20T23:24:45.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cb4a82700 1 -- start start 2021-10-20T23:24:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cb4a82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b0fd0 0x7f0cb0144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cb4a82700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb00b0350 con 0x7f0cb00b1db0 2021-10-20T23:24:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cb4a82700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb00b05f0 con 0x7f0cb01483a0 2021-10-20T23:24:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cb4a82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00a90c0 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cae59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0cb00b1db0 0x7f0cb00b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38382/0 (socket says 172.21.15.12:38382) 2021-10-20T23:24:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cae59c700 1 -- 172.21.15.12:0/867680537 learned_addr learned my addr 172.21.15.12:0/867680537 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0caed9d700 1 --2- 172.21.15.12:0/867680537 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b0fd0 0x7f0cb0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cadd9b700 1 -- 172.21.15.12:0/867680537 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137275389 0 0) 0x7f0cb00b0350 con 0x7f0cb00b1db0 2021-10-20T23:24:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cadd9b700 1 -- 172.21.15.12:0/867680537 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c90003260 con 0x7f0cb00b1db0 2021-10-20T23:24:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cadd9b700 1 -- 172.21.15.12:0/867680537 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275051839 0 0) 0x7f0cb00b05f0 con 0x7f0cb01483a0 2021-10-20T23:24:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cadd9b700 1 -- 172.21.15.12:0/867680537 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb00b0350 con 0x7f0cb01483a0 2021-10-20T23:24:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0caed9d700 1 -- 172.21.15.12:0/867680537 >> v1:172.21.15.31:6789/0 conn(0x7f0cb01483a0 legacy=0x7f0cb00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0caed9d700 1 -- 172.21.15.12:0/867680537 >> v1:172.21.15.12:6789/0 conn(0x7f0cb00b1db0 legacy=0x7f0cb00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0caed9d700 1 -- 172.21.15.12:0/867680537 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00b0890 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0caed9d700 1 --2- 172.21.15.12:0/867680537 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b0fd0 0x7f0cb0144720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0cb0147730 tx=0x7f0ca80091d0).ready entity=mon.2 client_cookie=b758fa5c87d87d7f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cadd9b700 1 -- 172.21.15.12:0/867680537 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ca800b600 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cadd9b700 1 -- 172.21.15.12:0/867680537 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca800b760 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.284+0000 7f0cadd9b700 1 -- 172.21.15.12:0/867680537 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ca800b8d0 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.288+0000 7f0cb4a82700 1 -- 172.21.15.12:0/867680537 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b0fd0 msgr2=0x7f0cb0144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.288+0000 7f0cb4a82700 1 --2- 172.21.15.12:0/867680537 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b0fd0 0x7f0cb0144720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0cb0147730 tx=0x7f0ca80091d0).stop 2021-10-20T23:24:45.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.288+0000 7f0cb4a82700 1 -- 172.21.15.12:0/867680537 shutdown_connections 2021-10-20T23:24:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.288+0000 7f0cb4a82700 1 --2- 172.21.15.12:0/867680537 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b0fd0 0x7f0cb0144720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.288+0000 7f0cb4a82700 1 -- 172.21.15.12:0/867680537 >> 172.21.15.12:0/867680537 conn(0x7f0cb005f6b0 msgr2=0x7f0cb005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.288+0000 7f0cb4a82700 1 -- 172.21.15.12:0/867680537 shutdown_connections 2021-10-20T23:24:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.288+0000 7f0cb4a82700 1 -- 172.21.15.12:0/867680537 wait complete. 2021-10-20T23:24:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.288+0000 7f0cb4a82700 1 Processor -- start 2021-10-20T23:24:45.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.288+0000 7f0cb4a82700 1 -- start start 2021-10-20T23:24:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cb4a82700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb00b0fd0 0x7f0cb014d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cb4a82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b1db0 0x7f0cb00aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cb4a82700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb01483a0 0x7f0cb015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cb4a82700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00a9ba0 con 0x7f0cb01483a0 2021-10-20T23:24:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cb4a82700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb014cad0 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cb4a82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb014db20 con 0x7f0cb00b1db0 2021-10-20T23:24:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0caed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb01483a0 0x7f0cb015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb00b0fd0 0x7f0cb014d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0ca5d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b1db0 0x7f0cb00aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb00b0fd0 0x7f0cb014d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:54768/0 (socket says 172.21.15.12:54768) 2021-10-20T23:24:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0caed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb01483a0 0x7f0cb015a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39798/0 (socket says 172.21.15.12:39798) 2021-10-20T23:24:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cae59c700 1 -- 172.21.15.12:0/4223325372 learned_addr learned my addr 172.21.15.12:0/4223325372 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cae59c700 1 -- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b1db0 msgr2=0x7f0cb00aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cae59c700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b1db0 0x7f0cb00aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cae59c700 1 -- 172.21.15.12:0/4223325372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb01483a0 msgr2=0x7f0cb015a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cae59c700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb01483a0 0x7f0cb015a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cae59c700 1 -- 172.21.15.12:0/4223325372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009470 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0caed9d700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb01483a0 0x7f0cb015a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cae59c700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb00b0fd0 0x7f0cb014d630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f0ca00011d0 tx=0x7f0ca0007b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0ca7fff700 1 -- 172.21.15.12:0/4223325372 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ca00070d0 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0ca7fff700 1 -- 172.21.15.12:0/4223325372 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0007230 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb00aa0e0 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0ca7fff700 1 -- 172.21.15.12:0/4223325372 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ca0005610 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.292+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb014e090 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.296+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb00a9e20 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.296+0000 7f0ca7fff700 1 -- 172.21.15.12:0/4223325372 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ca0010070 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.296+0000 7f0ca7fff700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c94053520 0x7f0c940559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.296+0000 7f0ca7fff700 1 -- 172.21.15.12:0/4223325372 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0ca006b080 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.296+0000 7f0ca5d9b700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c94053520 0x7f0c940559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.296+0000 7f0ca5d9b700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c94053520 0x7f0c940559e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f0c9800d000 tx=0x7f0c98007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.304+0000 7f0ca7fff700 1 -- 172.21.15.12:0/4223325372 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0cb00a9e20 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.436+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0cb00a9dd0 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.440+0000 7f0ca7fff700 1 -- 172.21.15.12:0/4223325372 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v58) v1 ==== 81+0+34039 (secure 0 0 0) 0x7f0ca0042080 con 0x7f0cb00b0fd0 2021-10-20T23:24:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:45.448 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:24:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 58, 2021-10-20T23:24:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:24:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:24:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:23:25.256255+0000", 2021-10-20T23:24:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:24:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:24:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:24:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:24:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:24:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:24:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:24:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:24:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:24:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:24:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:24:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:24:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:24:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:24:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:24:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 10, 2021-10-20T23:24:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:24:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:24:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:24:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:24:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:24:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:24:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:24:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:24:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:24:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:24:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:24:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:24:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:24:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:24:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:24:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:24:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:24:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:24:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:24:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:24:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:24:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:24:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:24:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:24:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:24:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:24:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:24:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:24:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:24:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:24:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:24:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:24:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:24:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:24:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:24:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:24:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:24:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:24:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:24:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:24:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:24:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:24:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:24:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:24:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:24:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:24:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:24:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:24:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:24:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:24:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:24:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:24:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:24:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:24:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:24:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:24:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:24:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:24:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:24:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:24:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:24:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:24:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:24:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:24:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:24:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:24:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:24:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:24:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:24:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:24:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:24:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:24:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:24:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:24:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:24:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:24:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:24:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:24:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:24:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:24:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:24:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:24:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:24:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:24:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:24:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:24:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:24:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:24:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:24:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:24:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:24:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:24:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:24:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:24:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:24:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:24:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:24:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:24:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:24:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:24:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:24:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:24:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:24:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:24:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:24:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:24:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:24:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:24:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:24:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:24:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:24:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:24:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:24:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:24:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:24:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:24:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:24:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:24:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:24:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:24:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:24:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:24:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:24:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:24:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:24:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:24:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:24:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:24:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:24:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:24:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:24:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:24:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:24:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:24:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 9, 2021-10-20T23:24:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:24:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:23:22.639987+0000", 2021-10-20T23:24:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:24:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:24:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:24:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:24:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:24:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:24:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:24:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:24:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:24:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:24:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:24:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:24:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:24:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:24:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:24:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:24:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:24:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:24:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:24:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:24:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "57", 2021-10-20T23:24:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:24:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:24:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:24:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:24:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:24:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:24:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:24:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:24:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:24:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:24:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:24:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:24:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:24:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:24:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:24:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:24:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:24:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:24:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:24:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:24:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:24:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:24:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:24:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:24:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:24:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:24:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:24:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:24:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:24:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:24:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:24:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:24:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:24:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:24:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:24:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:24:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:24:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:24:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:24:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:24:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:24:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:24:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:24:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:24:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 10, 2021-10-20T23:24:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:24:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:23:23.594440+0000", 2021-10-20T23:24:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:24:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:24:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:24:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:24:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:24:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:24:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:24:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:24:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:24:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:24:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:24:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:24:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:24:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:24:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:24:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:24:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:24:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:24:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:24:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:24:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "58", 2021-10-20T23:24:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:24:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:24:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:24:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:24:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:24:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:24:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:24:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:24:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:24:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:24:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:24:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:24:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:24:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:24:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:24:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:24:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:24:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:24:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:24:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:24:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:24:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:24:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:24:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:24:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:24:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:24:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:24:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:24:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:24:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:24:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:24:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:24:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:24:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:24:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:24:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:24:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:24:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:24:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:24:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:24:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:24:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:24:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:24:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:24:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:24:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:24:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:24:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:24:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:24:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:24:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:24:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:24:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:24:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:24:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:24:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:24:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:24:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:24:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:24:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:24:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:24:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:24:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:24:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:24:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:24:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:24:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:24:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:24:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:24:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:24:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:24:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:24:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:24:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:24:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:24:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:24:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:24:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:24:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:24:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:24:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:24:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:24:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:24:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:24:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:24:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:24:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:24:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 55, 2021-10-20T23:24:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:24:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:24:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:24:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:24:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:24:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:24:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:24:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:24:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:24:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:24:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:24:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:24:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:24:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:24:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:24:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:24:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:24:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:24:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:24:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:24:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:24:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:24:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:24:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:24:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:24:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:24:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:24:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:24:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:24:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:24:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:24:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:24:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:24:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:24:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:24:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:24:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:24:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:24:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:24:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:24:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:45.634 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.634 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:24:45.635 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:24:45.635 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:45.635 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:45.635 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:24:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:24:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:24:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:24:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:24:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:24:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:24:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:24:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:24:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:24:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:24:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:24:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:24:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:24:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 55, 2021-10-20T23:24:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:24:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:24:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:24:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:24:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:24:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:24:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:24:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:24:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:24:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:24:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:24:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:24:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:24:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:24:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:24:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:24:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:24:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:24:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:24:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:24:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:24:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:24:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:24:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:24:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:24:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:24:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:24:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:24:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:24:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:24:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:24:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:24:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:24:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:24:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:24:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:24:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:24:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:24:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:24:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:24:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:24:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:24:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:24:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:24:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:24:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:24:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:24:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:24:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:24:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:24:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:24:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:24:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:24:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:24:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:24:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:24:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:24:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:24:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:24:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:24:45.696 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:24:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c94053520 msgr2=0x7f0c940559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c94053520 0x7f0c940559e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f0c9800d000 tx=0x7f0c98007a20).stop 2021-10-20T23:24:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb00b0fd0 msgr2=0x7f0cb014d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb00b0fd0 0x7f0cb014d630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f0ca00011d0 tx=0x7f0ca0007b50).stop 2021-10-20T23:24:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 shutdown_connections 2021-10-20T23:24:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c94053520 0x7f0c940559e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb01483a0 0x7f0cb015a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb00b1db0 0x7f0cb00aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 --2- 172.21.15.12:0/4223325372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb00b0fd0 0x7f0cb014d630 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 >> 172.21.15.12:0/4223325372 conn(0x7f0cb005f6b0 msgr2=0x7f0cb00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:45.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 shutdown_connections 2021-10-20T23:24:45.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.444+0000 7f0cb4a82700 1 -- 172.21.15.12:0/4223325372 wait complete. 2021-10-20T23:24:45.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:24:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.808+0000 7ff3b0d25700 1 Processor -- start 2021-10-20T23:24:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.808+0000 7ff3b0d25700 1 -- start start 2021-10-20T23:24:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.808+0000 7ff3b0d25700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3ac0b3040 0x7ff3ac065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.808+0000 7ff3b0d25700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ac066ea0 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.808+0000 7ff3b0d25700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ac0b3420 con 0x7ff3ac140140 2021-10-20T23:24:45.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.808+0000 7ff3b0d25700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac0648e0 con 0x7ff3ac0b3040 2021-10-20T23:24:45.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.808+0000 7ff3aaffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff3ac0a9c10 0x7ff3ac0607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38396/0 (socket says 172.21.15.12:38396) 2021-10-20T23:24:45.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.808+0000 7ff3aaffd700 1 -- 172.21.15.12:0/2947464539 learned_addr learned my addr 172.21.15.12:0/2947464539 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:45.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.808+0000 7ff3ab7fe700 1 --2- 172.21.15.12:0/2947464539 >> v2:172.21.15.31:3300/0 conn(0x7ff3ac0b3040 0x7ff3ac065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3aa7fc700 1 -- 172.21.15.12:0/2947464539 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815375675 0 0) 0x7ff3ac066ea0 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3aa7fc700 1 -- 172.21.15.12:0/2947464539 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff398003260 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3aa7fc700 1 -- 172.21.15.12:0/2947464539 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1759442950 0 0) 0x7ff398003260 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3ab7fe700 1 -- 172.21.15.12:0/2947464539 >> v1:172.21.15.31:6789/0 conn(0x7ff3ac140140 legacy=0x7ff3ac1405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3ab7fe700 1 -- 172.21.15.12:0/2947464539 >> v1:172.21.15.12:6789/0 conn(0x7ff3ac0a9c10 legacy=0x7ff3ac0607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3ab7fe700 1 -- 172.21.15.12:0/2947464539 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac066960 con 0x7ff3ac0b3040 2021-10-20T23:24:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3ab7fe700 1 --2- 172.21.15.12:0/2947464539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0b3040 0x7ff3ac065e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7ff39c001820 tx=0x7ff3a0006df0).ready entity=mon.1 client_cookie=458cd7532ce704ee server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3aa7fc700 1 -- 172.21.15.12:0/2947464539 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39c001680 con 0x7ff3ac0b3040 2021-10-20T23:24:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3aa7fc700 1 -- 172.21.15.12:0/2947464539 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0000e90 con 0x7ff3ac0b3040 2021-10-20T23:24:45.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3aa7fc700 1 -- 172.21.15.12:0/2947464539 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a000d4f0 con 0x7ff3ac0b3040 2021-10-20T23:24:45.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3b0d25700 1 -- 172.21.15.12:0/2947464539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0b3040 msgr2=0x7ff3ac065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3b0d25700 1 --2- 172.21.15.12:0/2947464539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0b3040 0x7ff3ac065e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7ff39c001820 tx=0x7ff3a0006df0).stop 2021-10-20T23:24:45.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3b0d25700 1 -- 172.21.15.12:0/2947464539 shutdown_connections 2021-10-20T23:24:45.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3b0d25700 1 --2- 172.21.15.12:0/2947464539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0b3040 0x7ff3ac065e90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3b0d25700 1 -- 172.21.15.12:0/2947464539 >> 172.21.15.12:0/2947464539 conn(0x7ff3ac0636e0 msgr2=0x7ff3ac063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:45.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3b0d25700 1 -- 172.21.15.12:0/2947464539 shutdown_connections 2021-10-20T23:24:45.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.812+0000 7ff3b0d25700 1 -- 172.21.15.12:0/2947464539 wait complete. 2021-10-20T23:24:45.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3b0d25700 1 Processor -- start 2021-10-20T23:24:45.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3b0d25700 1 -- start start 2021-10-20T23:24:45.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3b0d25700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0a9c10 0x7ff3ac0b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3b0d25700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3ac0b3040 0x7ff3ac0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3b0d25700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac140140 0x7ff3ac0afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3b0d25700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0b12b0 con 0x7ff3ac140140 2021-10-20T23:24:45.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3b0d25700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac09f7d0 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3b0d25700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0b00b0 con 0x7ff3ac0b3040 2021-10-20T23:24:45.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3ab7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0a9c10 0x7ff3ac0b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3abfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac140140 0x7ff3ac0afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3aaffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3ac0b3040 0x7ff3ac0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3ab7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0a9c10 0x7ff3ac0b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:54782/0 (socket says 172.21.15.12:54782) 2021-10-20T23:24:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.816+0000 7ff3ab7fe700 1 -- 172.21.15.12:0/761544047 learned_addr learned my addr 172.21.15.12:0/761544047 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3ab7fe700 1 -- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3ac0b3040 msgr2=0x7ff3ac0af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3ab7fe700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3ac0b3040 0x7ff3ac0af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3ab7fe700 1 -- 172.21.15.12:0/761544047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac140140 msgr2=0x7ff3ac0afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3ab7fe700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac140140 0x7ff3ac0afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3ab7fe700 1 -- 172.21.15.12:0/761544047 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a000b180 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3abfff700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac140140 0x7ff3ac0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3ab7fe700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0a9c10 0x7ff3ac0b4c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7ff39c001820 tx=0x7ff3a0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3a8ff9700 1 -- 172.21.15.12:0/761544047 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a0016030 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3a8ff9700 1 -- 172.21.15.12:0/761544047 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0013b30 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ac0aee30 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3a8ff9700 1 -- 172.21.15.12:0/761544047 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a000d4f0 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac0ae030 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ac0ae470 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.820+0000 7ff3a8ff9700 1 -- 172.21.15.12:0/761544047 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff3a0024020 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.824+0000 7ff3a8ff9700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff38c053580 0x7ff38c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.824+0000 7ff3a8ff9700 1 -- 172.21.15.12:0/761544047 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff3a0017070 con 0x7ff3ac0a9c10 2021-10-20T23:24:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.824+0000 7ff3aaffd700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff38c053580 0x7ff38c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.824+0000 7ff3aaffd700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff38c053580 0x7ff38c055a40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ff39c00d000 tx=0x7ff39c000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:45.832+0000 7ff3a8ff9700 1 -- 172.21.15.12:0/761544047 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3a0043920 con 0x7ff3ac0a9c10 2021-10-20T23:24:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.004+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3ac066c00 con 0x7ff3ac0a9c10 2021-10-20T23:24:46.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.004+0000 7ff3a8ff9700 1 -- 172.21.15.12:0/761544047 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2489 (secure 0 0 0) 0x7ff3a0046ec0 con 0x7ff3ac0a9c10 2021-10-20T23:24:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:46.011 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:23:24.253029+0000","modified":"2021-10-20T23:23:25.255689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3232971526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3232971526},{"type":"v1","addr":"172.21.15.12:6835","nonce":3232971526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-20T23:24:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.004+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff38c053580 msgr2=0x7ff38c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.004+0000 7ff3b0d25700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff38c053580 0x7ff38c055a40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ff39c00d000 tx=0x7ff39c000bc0).stop 2021-10-20T23:24:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.004+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0a9c10 msgr2=0x7ff3ac0b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.004+0000 7ff3b0d25700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0a9c10 0x7ff3ac0b4c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7ff39c001820 tx=0x7ff3a0014000).stop 2021-10-20T23:24:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.008+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 shutdown_connections 2021-10-20T23:24:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.008+0000 7ff3b0d25700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff38c053580 0x7ff38c055a40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.008+0000 7ff3b0d25700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac140140 0x7ff3ac0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:46.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.008+0000 7ff3b0d25700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3ac0b3040 0x7ff3ac0af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:46.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.008+0000 7ff3b0d25700 1 --2- 172.21.15.12:0/761544047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3ac0a9c10 0x7ff3ac0b4c10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:46.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.008+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 >> 172.21.15.12:0/761544047 conn(0x7ff3ac0636e0 msgr2=0x7ff3ac0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:46.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.008+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 shutdown_connections 2021-10-20T23:24:46.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.008+0000 7ff3b0d25700 1 -- 172.21.15.12:0/761544047 wait complete. 2021-10-20T23:24:46.016 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2021-10-20T23:24:46.025 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:24:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.116+0000 7f7a7d58b700 1 Processor -- start 2021-10-20T23:24:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.116+0000 7f7a7d58b700 1 -- start start 2021-10-20T23:24:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.116+0000 7f7a7d58b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a780ab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.116+0000 7f7a7d58b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a780b2960 0x7f7a780aba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.116+0000 7f7a7d58b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a781434c0 con 0x7f7a78139ae0 2021-10-20T23:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.116+0000 7f7a7d58b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a780b3010 con 0x7f7a780b2960 2021-10-20T23:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.116+0000 7f7a7d58b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780af320 con 0x7f7a780b1c50 2021-10-20T23:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.116+0000 7f7a767fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a780ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a767fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a780ab530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45576/0 (socket says 172.21.15.12:45576) 2021-10-20T23:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a767fc700 1 -- 172.21.15.12:0/4081958219 learned_addr learned my addr 172.21.15.12:0/4081958219 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a76ffd700 1 --1- 172.21.15.12:0/4081958219 >> v1:172.21.15.31:6789/0 conn(0x7f7a78139ae0 0x7f7a78142db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45474/0 (socket says 172.21.15.12:45474) 2021-10-20T23:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.116+0000 7f7a777fe700 1 --2- 172.21.15.12:0/4081958219 >> v2:172.21.15.31:3300/0 conn(0x7f7a780b2960 0x7f7a780aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a767fc700 1 -- 172.21.15.12:0/4081958219 >> v2:172.21.15.31:3300/0 conn(0x7f7a780b2960 msgr2=0x7f7a780aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a767fc700 1 --2- 172.21.15.12:0/4081958219 >> v2:172.21.15.31:3300/0 conn(0x7f7a780b2960 0x7f7a780aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a767fc700 1 -- 172.21.15.12:0/4081958219 >> v1:172.21.15.31:6789/0 conn(0x7f7a78139ae0 legacy=0x7f7a78142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a767fc700 1 -- 172.21.15.12:0/4081958219 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a780ac470 con 0x7f7a780b1c50 2021-10-20T23:24:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a767fc700 1 --2- 172.21.15.12:0/4081958219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a780ab530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7a700032f0 tx=0x7f7a70009290).ready entity=mon.2 client_cookie=ad9d52b130cd3970 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a75ffb700 1 -- 172.21.15.12:0/4081958219 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a7000b8a0 con 0x7f7a780b1c50 2021-10-20T23:24:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a75ffb700 1 -- 172.21.15.12:0/4081958219 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7000ba00 con 0x7f7a780b1c50 2021-10-20T23:24:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a75ffb700 1 -- 172.21.15.12:0/4081958219 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a7000bb70 con 0x7f7a780b1c50 2021-10-20T23:24:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a7d58b700 1 -- 172.21.15.12:0/4081958219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 msgr2=0x7f7a780ab530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a7d58b700 1 --2- 172.21.15.12:0/4081958219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a780ab530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7a700032f0 tx=0x7f7a70009290).stop 2021-10-20T23:24:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a7d58b700 1 -- 172.21.15.12:0/4081958219 shutdown_connections 2021-10-20T23:24:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a7d58b700 1 --2- 172.21.15.12:0/4081958219 >> v2:172.21.15.31:3300/0 conn(0x7f7a780b2960 0x7f7a780aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a7d58b700 1 --2- 172.21.15.12:0/4081958219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a780ab530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.120+0000 7f7a7d58b700 1 -- 172.21.15.12:0/4081958219 >> 172.21.15.12:0/4081958219 conn(0x7f7a7805f6b0 msgr2=0x7f7a7805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 -- 172.21.15.12:0/4081958219 shutdown_connections 2021-10-20T23:24:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 -- 172.21.15.12:0/4081958219 wait complete. 2021-10-20T23:24:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 Processor -- start 2021-10-20T23:24:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 -- start start 2021-10-20T23:24:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a7813d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a780b2960 0x7f7a781343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7813db70 0x7f7a7813e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780632b0 con 0x7f7a7813db70 2021-10-20T23:24:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a781546e0 con 0x7f7a780b2960 2021-10-20T23:24:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780628d0 con 0x7f7a780b1c50 2021-10-20T23:24:46.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7813db70 0x7f7a7813e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:46.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7813db70 0x7f7a7813e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39826/0 (socket says 172.21.15.12:39826) 2021-10-20T23:24:46.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a76ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a7813d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:46.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a777fe700 1 -- 172.21.15.12:0/2523983900 learned_addr learned my addr 172.21.15.12:0/2523983900 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a767fc700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a780b2960 0x7f7a781343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a777fe700 1 -- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 msgr2=0x7f7a7813d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a777fe700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a7813d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a777fe700 1 -- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a780b2960 msgr2=0x7f7a781343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a777fe700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a780b2960 0x7f7a781343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a777fe700 1 -- 172.21.15.12:0/2523983900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70009530 con 0x7f7a7813db70 2021-10-20T23:24:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a777fe700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7813db70 0x7f7a7813e820 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f7a6c00c000 tx=0x7f7a6c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a67fff700 1 -- 172.21.15.12:0/2523983900 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a6c011750 con 0x7f7a7813db70 2021-10-20T23:24:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a67fff700 1 -- 172.21.15.12:0/2523983900 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c0118b0 con 0x7f7a7813db70 2021-10-20T23:24:46.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a78062b70 con 0x7f7a7813db70 2021-10-20T23:24:46.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a67fff700 1 -- 172.21.15.12:0/2523983900 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a6c011c10 con 0x7f7a7813db70 2021-10-20T23:24:46.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.124+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7813e360 con 0x7f7a7813db70 2021-10-20T23:24:46.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.128+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a78143730 con 0x7f7a7813db70 2021-10-20T23:24:46.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.128+0000 7f7a67fff700 1 -- 172.21.15.12:0/2523983900 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7a6c011d70 con 0x7f7a7813db70 2021-10-20T23:24:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.128+0000 7f7a67fff700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7a54053580 0x7f7a54055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.128+0000 7f7a67fff700 1 -- 172.21.15.12:0/2523983900 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7a6c06bdd0 con 0x7f7a7813db70 2021-10-20T23:24:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.128+0000 7f7a76ffd700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7a54053580 0x7f7a54055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.128+0000 7f7a76ffd700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7a54053580 0x7f7a54055a40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f7a6800d000 tx=0x7f7a68007b80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:46.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.132+0000 7f7a67fff700 1 -- 172.21.15.12:0/2523983900 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7a6c042dd0 con 0x7f7a7813db70 2021-10-20T23:24:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:46.300+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7a78057350 con 0x7f7a7813db70 2021-10-20T23:24:47.123 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:24:47.116+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:24:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a67fff700 1 -- 172.21.15.12:0/2523983900 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7a6c0463f0 con 0x7f7a7813db70 2021-10-20T23:24:47.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7a54053580 msgr2=0x7f7a54055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7a54053580 0x7f7a54055a40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f7a6800d000 tx=0x7f7a68007b80).stop 2021-10-20T23:24:47.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7813db70 msgr2=0x7f7a7813e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7813db70 0x7f7a7813e820 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f7a6c00c000 tx=0x7f7a6c006df0).stop 2021-10-20T23:24:47.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 shutdown_connections 2021-10-20T23:24:47.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7a54053580 0x7f7a54055a40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7813db70 0x7f7a7813e820 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a780b2960 0x7f7a781343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 --2- 172.21.15.12:0/2523983900 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a780b1c50 0x7f7a7813d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 >> 172.21.15.12:0/2523983900 conn(0x7f7a7805f6b0 msgr2=0x7f7a780ace90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 shutdown_connections 2021-10-20T23:24:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.128+0000 7f7a7d58b700 1 -- 172.21.15.12:0/2523983900 wait complete. 2021-10-20T23:24:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:24:47.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:24:47.171 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:24:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 Processor -- start 2021-10-20T23:24:47.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 -- start start 2021-10-20T23:24:47.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b40a9c10 0x7f09b40607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b4066ea0 con 0x7f09b40b3040 2021-10-20T23:24:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b40b3420 con 0x7f09b4140140 2021-10-20T23:24:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40648e0 con 0x7f09b40a9c10 2021-10-20T23:24:47.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b2ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f09b40b3040 0x7f09b4065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38436/0 (socket says 172.21.15.12:38436) 2021-10-20T23:24:47.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b2ffd700 1 -- 172.21.15.12:0/278675288 learned_addr learned my addr 172.21.15.12:0/278675288 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:47.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b27fc700 1 --2- 172.21.15.12:0/278675288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b40a9c10 0x7f09b40607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b1ffb700 1 -- 172.21.15.12:0/278675288 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489380105 0 0) 0x7f09b4066ea0 con 0x7f09b40b3040 2021-10-20T23:24:47.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b1ffb700 1 -- 172.21.15.12:0/278675288 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0998003260 con 0x7f09b40b3040 2021-10-20T23:24:47.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b1ffb700 1 -- 172.21.15.12:0/278675288 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581133119 0 0) 0x7f09b40b3420 con 0x7f09b4140140 2021-10-20T23:24:47.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b27fc700 1 -- 172.21.15.12:0/278675288 >> v1:172.21.15.31:6789/0 conn(0x7f09b4140140 legacy=0x7f09b41405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b27fc700 1 -- 172.21.15.12:0/278675288 >> v1:172.21.15.12:6789/0 conn(0x7f09b40b3040 legacy=0x7f09b4065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b27fc700 1 -- 172.21.15.12:0/278675288 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b4066960 con 0x7f09b40a9c10 2021-10-20T23:24:47.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b27fc700 1 --2- 172.21.15.12:0/278675288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b40a9c10 0x7f09b40607c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f09a8002f70 tx=0x7f09a8006df0).ready entity=mon.2 client_cookie=f1f07b4d7ea01735 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:47.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b1ffb700 1 -- 172.21.15.12:0/278675288 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a800d570 con 0x7f09b40a9c10 2021-10-20T23:24:47.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b1ffb700 1 -- 172.21.15.12:0/278675288 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a8000e90 con 0x7f09b40a9c10 2021-10-20T23:24:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b1ffb700 1 -- 172.21.15.12:0/278675288 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a800d8c0 con 0x7f09b40a9c10 2021-10-20T23:24:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 -- 172.21.15.12:0/278675288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b40a9c10 msgr2=0x7f09b40607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 --2- 172.21.15.12:0/278675288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b40a9c10 0x7f09b40607c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f09a8002f70 tx=0x7f09a8006df0).stop 2021-10-20T23:24:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 -- 172.21.15.12:0/278675288 shutdown_connections 2021-10-20T23:24:47.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 --2- 172.21.15.12:0/278675288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b40a9c10 0x7f09b40607c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 -- 172.21.15.12:0/278675288 >> 172.21.15.12:0/278675288 conn(0x7f09b40636e0 msgr2=0x7f09b4063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:47.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 -- 172.21.15.12:0/278675288 shutdown_connections 2021-10-20T23:24:47.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.252+0000 7f09b3fff700 1 -- 172.21.15.12:0/278675288 wait complete. 2021-10-20T23:24:47.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 Processor -- start 2021-10-20T23:24:47.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 -- start start 2021-10-20T23:24:47.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09b40a9c10 0x7f09b4145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40b3040 0x7f09b413d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b4140140 0x7f09b4141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b4144630 con 0x7f09b40b3040 2021-10-20T23:24:47.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b413cd00 con 0x7f09b40a9c10 2021-10-20T23:24:47.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b413e4b0 con 0x7f09b4140140 2021-10-20T23:24:47.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b4140140 0x7f09b4141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09b40a9c10 0x7f09b4145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40b3040 0x7f09b413d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09b40a9c10 0x7f09b4145ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:54822/0 (socket says 172.21.15.12:54822) 2021-10-20T23:24:47.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b2ffd700 1 -- 172.21.15.12:0/3195018492 learned_addr learned my addr 172.21.15.12:0/3195018492 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:47.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b37fe700 1 -- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09b40a9c10 msgr2=0x7f09b4145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b37fe700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09b40a9c10 0x7f09b4145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b37fe700 1 -- 172.21.15.12:0/3195018492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40b3040 msgr2=0x7f09b413d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b37fe700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40b3040 0x7f09b413d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b37fe700 1 -- 172.21.15.12:0/3195018492 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a800b180 con 0x7f09b4140140 2021-10-20T23:24:47.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b27fc700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40b3040 0x7f09b413d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:47.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b37fe700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b4140140 0x7f09b4141850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f09b413e7c0 tx=0x7f09ac007ed0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:47.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09a3fff700 1 -- 172.21.15.12:0/3195018492 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac006890 con 0x7f09b4140140 2021-10-20T23:24:47.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09a3fff700 1 -- 172.21.15.12:0/3195018492 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac0069f0 con 0x7f09b4140140 2021-10-20T23:24:47.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b4145fc0 con 0x7f09b4140140 2021-10-20T23:24:47.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09a3fff700 1 -- 172.21.15.12:0/3195018492 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac006d50 con 0x7f09b4140140 2021-10-20T23:24:47.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.256+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b413d1d0 con 0x7f09b4140140 2021-10-20T23:24:47.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.260+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b4066c00 con 0x7f09b4140140 2021-10-20T23:24:47.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.260+0000 7f09a3fff700 1 -- 172.21.15.12:0/3195018492 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f09ac01b060 con 0x7f09b4140140 2021-10-20T23:24:47.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.260+0000 7f09a3fff700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0990053520 0x7f09900559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.260+0000 7f09a3fff700 1 -- 172.21.15.12:0/3195018492 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f09ac06b810 con 0x7f09b4140140 2021-10-20T23:24:47.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.260+0000 7f09b2ffd700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0990053520 0x7f09900559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.260+0000 7f09b2ffd700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0990053520 0x7f09900559e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f09a400d000 tx=0x7f09a4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:47.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.272+0000 7f09a3fff700 1 -- 172.21.15.12:0/3195018492 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f09ac0427c0 con 0x7f09b4140140 2021-10-20T23:24:47.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.432+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09b4057350 con 0x7f09b4140140 2021-10-20T23:24:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09a3fff700 1 -- 172.21.15.12:0/3195018492 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2128 (secure 0 0 0) 0x7f09ac019030 con 0x7f09b4140140 2021-10-20T23:24:47.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:47.442 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:23:24.253029+0000","modified":"2021-10-20T23:24:47.121485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-20T23:24:47.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0990053520 msgr2=0x7f09900559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0990053520 0x7f09900559e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f09a400d000 tx=0x7f09a4009040).stop 2021-10-20T23:24:47.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b4140140 msgr2=0x7f09b4141850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b4140140 0x7f09b4141850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f09b413e7c0 tx=0x7f09ac007ed0).stop 2021-10-20T23:24:47.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 shutdown_connections 2021-10-20T23:24:47.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0990053520 0x7f09900559e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09b4140140 0x7f09b4141850 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40b3040 0x7f09b413d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 --2- 172.21.15.12:0/3195018492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09b40a9c10 0x7f09b4145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 >> 172.21.15.12:0/3195018492 conn(0x7f09b40636e0 msgr2=0x7f09b40b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:47.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 shutdown_connections 2021-10-20T23:24:47.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.436+0000 7f09b3fff700 1 -- 172.21.15.12:0/3195018492 wait complete. 2021-10-20T23:24:47.448 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2021-10-20T23:24:47.459 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:24:47.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff36d874700 1 Processor -- start 2021-10-20T23:24:47.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff36d874700 1 -- start start 2021-10-20T23:24:47.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff36d874700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff368146950 0x7ff368140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff36d874700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3680b4180 0x7ff368140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff36d874700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4690 0x7ff3680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff36d874700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff368147510 con 0x7ff368146950 2021-10-20T23:24:47.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff36d874700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff368143b60 con 0x7ff3680b4180 2021-10-20T23:24:47.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff36d874700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff368143e00 con 0x7ff3680b4690 2021-10-20T23:24:47.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff366ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff368146950 0x7ff368140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff366ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff368146950 0x7ff368140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39856/0 (socket says 172.21.15.12:39856) 2021-10-20T23:24:47.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff366ffd700 1 -- 172.21.15.12:0/1777635203 learned_addr learned my addr 172.21.15.12:0/1777635203 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:47.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff3677fe700 1 --2- 172.21.15.12:0/1777635203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4690 0x7ff3680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.560+0000 7ff3667fc700 1 --2- 172.21.15.12:0/1777635203 >> v2:172.21.15.31:3300/0 conn(0x7ff3680b4180 0x7ff368140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff366ffd700 1 -- 172.21.15.12:0/1777635203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4690 msgr2=0x7ff3680b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:47.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff366ffd700 1 --2- 172.21.15.12:0/1777635203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4690 0x7ff3680b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff366ffd700 1 -- 172.21.15.12:0/1777635203 >> v2:172.21.15.31:3300/0 conn(0x7ff3680b4180 msgr2=0x7ff368140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:47.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff366ffd700 1 --2- 172.21.15.12:0/1777635203 >> v2:172.21.15.31:3300/0 conn(0x7ff3680b4180 0x7ff368140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff366ffd700 1 -- 172.21.15.12:0/1777635203 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3680b0c90 con 0x7ff368146950 2021-10-20T23:24:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3667fc700 1 --2- 172.21.15.12:0/1777635203 >> v2:172.21.15.31:3300/0 conn(0x7ff3680b4180 0x7ff368140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3677fe700 1 --2- 172.21.15.12:0/1777635203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4690 0x7ff3680b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff366ffd700 1 --2- 172.21.15.12:0/1777635203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff368146950 0x7ff368140230 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7ff35c002f70 tx=0x7ff35c006eb0).ready entity=mon.0 client_cookie=fd2c1c51c141fb88 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:47.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff365ffb700 1 -- 172.21.15.12:0/1777635203 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff35c00d570 con 0x7ff368146950 2021-10-20T23:24:47.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff365ffb700 1 -- 172.21.15.12:0/1777635203 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c000e90 con 0x7ff368146950 2021-10-20T23:24:47.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff365ffb700 1 -- 172.21.15.12:0/1777635203 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff35c00d900 con 0x7ff368146950 2021-10-20T23:24:47.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 -- 172.21.15.12:0/1777635203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff368146950 msgr2=0x7ff368140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 --2- 172.21.15.12:0/1777635203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff368146950 0x7ff368140230 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7ff35c002f70 tx=0x7ff35c006eb0).stop 2021-10-20T23:24:47.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 -- 172.21.15.12:0/1777635203 shutdown_connections 2021-10-20T23:24:47.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 --2- 172.21.15.12:0/1777635203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4690 0x7ff3680b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 --2- 172.21.15.12:0/1777635203 >> v2:172.21.15.31:3300/0 conn(0x7ff3680b4180 0x7ff368140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 --2- 172.21.15.12:0/1777635203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff368146950 0x7ff368140230 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 -- 172.21.15.12:0/1777635203 >> 172.21.15.12:0/1777635203 conn(0x7ff36805c490 msgr2=0x7ff36805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 -- 172.21.15.12:0/1777635203 shutdown_connections 2021-10-20T23:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 -- 172.21.15.12:0/1777635203 wait complete. 2021-10-20T23:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 Processor -- start 2021-10-20T23:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 -- start start 2021-10-20T23:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4180 0x7ff36813e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3680b4690 0x7ff368155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff368146950 0x7ff3681563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680aeca0 con 0x7ff3680b4690 2021-10-20T23:24:47.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b9020 con 0x7ff368146950 2021-10-20T23:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff36d874700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680ae760 con 0x7ff3680b4180 2021-10-20T23:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3667fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3680b4690 0x7ff368155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3667fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3680b4690 0x7ff368155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39864/0 (socket says 172.21.15.12:39864) 2021-10-20T23:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3667fc700 1 -- 172.21.15.12:0/3810530130 learned_addr learned my addr 172.21.15.12:0/3810530130 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff366ffd700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4180 0x7ff36813e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3677fe700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff368146950 0x7ff3681563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3667fc700 1 -- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4180 msgr2=0x7ff36813e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3667fc700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4180 0x7ff36813e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3667fc700 1 -- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff368146950 msgr2=0x7ff3681563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:47.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.564+0000 7ff3667fc700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff368146950 0x7ff3681563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:47.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff3667fc700 1 -- 172.21.15.12:0/3810530130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35800b180 con 0x7ff3680b4690 2021-10-20T23:24:47.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff3677fe700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff368146950 0x7ff3681563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:24:47.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff3667fc700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3680b4690 0x7ff368155ee0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ff35800c000 tx=0x7ff358006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:47.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff357fff700 1 -- 172.21.15.12:0/3810530130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff358010780 con 0x7ff3680b4690 2021-10-20T23:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff357fff700 1 -- 172.21.15.12:0/3810530130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3580108e0 con 0x7ff3680b4690 2021-10-20T23:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff360009470 con 0x7ff3680b4690 2021-10-20T23:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff357fff700 1 -- 172.21.15.12:0/3810530130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff358010c40 con 0x7ff3680b4690 2021-10-20T23:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c00b1e0 con 0x7ff3680b4690 2021-10-20T23:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff357fff700 1 -- 172.21.15.12:0/3810530130 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff35801c460 con 0x7ff3680b4690 2021-10-20T23:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff368156a60 con 0x7ff3680b4690 2021-10-20T23:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff357fff700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff344053610 0x7ff344055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff357fff700 1 -- 172.21.15.12:0/3810530130 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6506+0+0 (secure 0 0 0) 0x7ff35806c100 con 0x7ff3680b4690 2021-10-20T23:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.568+0000 7ff366ffd700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff344053610 0x7ff344055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:47.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.572+0000 7ff366ffd700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff344053610 0x7ff344055ad0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff35c01c000 tx=0x7ff35c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:47.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.576+0000 7ff357fff700 1 -- 172.21.15.12:0/3810530130 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff358042f40 con 0x7ff3680b4690 2021-10-20T23:24:47.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:47.744+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff368057350 con 0x7ff3680b4690 2021-10-20T23:24:48.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.140+0000 7ff357fff700 1 -- 172.21.15.12:0/3810530130 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff358046560 con 0x7ff3680b4690 2021-10-20T23:24:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff344053610 msgr2=0x7ff344055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff344053610 0x7ff344055ad0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff35c01c000 tx=0x7ff35c015000).stop 2021-10-20T23:24:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3680b4690 msgr2=0x7ff368155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3680b4690 0x7ff368155ee0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ff35800c000 tx=0x7ff358006df0).stop 2021-10-20T23:24:48.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 shutdown_connections 2021-10-20T23:24:48.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff344053610 0x7ff344055ad0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:48.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff368146950 0x7ff3681563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:48.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3680b4690 0x7ff368155ee0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:48.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 --2- 172.21.15.12:0/3810530130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3680b4180 0x7ff36813e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:48.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 >> 172.21.15.12:0/3810530130 conn(0x7ff36805c490 msgr2=0x7ff36813b430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:48.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 shutdown_connections 2021-10-20T23:24:48.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.144+0000 7ff36d874700 1 -- 172.21.15.12:0/3810530130 wait complete. 2021-10-20T23:24:48.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:24:48.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.279+0000 7f9173fff700 1 Processor -- start 2021-10-20T23:24:48.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.279+0000 7f9173fff700 1 -- start start 2021-10-20T23:24:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91740ad5c0 0x7f9174061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9174140440 0x7f91741408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91740aecf0 con 0x7f9174061320 2021-10-20T23:24:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91740b6f20 con 0x7f9174140440 2021-10-20T23:24:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91740aef20 con 0x7f91740ad5c0 2021-10-20T23:24:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9172ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9174061320 0x7f91740b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38464/0 (socket says 172.21.15.12:38464) 2021-10-20T23:24:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9172ffd700 1 -- 172.21.15.12:0/3982431500 learned_addr learned my addr 172.21.15.12:0/3982431500 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f91727fc700 1 --2- 172.21.15.12:0/3982431500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91740ad5c0 0x7f9174061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f91737fe700 1 --2- 172.21.15.12:0/3982431500 >> v2:172.21.15.31:3300/0 conn(0x7f9174140440 0x7f91741408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9171ffb700 1 -- 172.21.15.12:0/3982431500 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163423092 0 0) 0x7f91740aecf0 con 0x7f9174061320 2021-10-20T23:24:48.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9171ffb700 1 -- 172.21.15.12:0/3982431500 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9158003260 con 0x7f9174061320 2021-10-20T23:24:48.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f91737fe700 1 -- 172.21.15.12:0/3982431500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91740ad5c0 msgr2=0x7f9174061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:48.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f91737fe700 1 --2- 172.21.15.12:0/3982431500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91740ad5c0 0x7f9174061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:48.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f91737fe700 1 -- 172.21.15.12:0/3982431500 >> v1:172.21.15.12:6789/0 conn(0x7f9174061320 legacy=0x7f91740b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:48.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f91737fe700 1 -- 172.21.15.12:0/3982431500 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740af1c0 con 0x7f9174140440 2021-10-20T23:24:48.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f91727fc700 1 --2- 172.21.15.12:0/3982431500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91740ad5c0 0x7f9174061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:48.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f91737fe700 1 --2- 172.21.15.12:0/3982431500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 0x7f91741408f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f916c0032f0 tx=0x7f916c0091d0).ready entity=mon.1 client_cookie=ac5292c610fc7d2f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:48.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9171ffb700 1 -- 172.21.15.12:0/3982431500 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f916c00b600 con 0x7f9174140440 2021-10-20T23:24:48.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9171ffb700 1 -- 172.21.15.12:0/3982431500 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00b760 con 0x7f9174140440 2021-10-20T23:24:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9171ffb700 1 -- 172.21.15.12:0/3982431500 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f916c00b8d0 con 0x7f9174140440 2021-10-20T23:24:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 -- 172.21.15.12:0/3982431500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 msgr2=0x7f91741408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 --2- 172.21.15.12:0/3982431500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 0x7f91741408f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f916c0032f0 tx=0x7f916c0091d0).stop 2021-10-20T23:24:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 -- 172.21.15.12:0/3982431500 shutdown_connections 2021-10-20T23:24:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 --2- 172.21.15.12:0/3982431500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 0x7f91741408f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:48.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 --2- 172.21.15.12:0/3982431500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91740ad5c0 0x7f9174061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:48.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 -- 172.21.15.12:0/3982431500 >> 172.21.15.12:0/3982431500 conn(0x7f9174066de0 msgr2=0x7f91740671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 -- 172.21.15.12:0/3982431500 shutdown_connections 2021-10-20T23:24:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.283+0000 7f9173fff700 1 -- 172.21.15.12:0/3982431500 wait complete. 2021-10-20T23:24:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 Processor -- start 2021-10-20T23:24:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 -- start start 2021-10-20T23:24:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9174061320 0x7f917409e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:48.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91740ad5c0 0x7f9174142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:48.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 0x7f9174152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:48.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9174146340 con 0x7f91740ad5c0 2021-10-20T23:24:48.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917409eee0 con 0x7f9174140440 2021-10-20T23:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91741527c0 con 0x7f9174061320 2021-10-20T23:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91727fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91740ad5c0 0x7f9174142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9172ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9174061320 0x7f917409e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91727fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91740ad5c0 0x7f9174142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39880/0 (socket says 172.21.15.12:39880) 2021-10-20T23:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9172ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9174061320 0x7f917409e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45634/0 (socket says 172.21.15.12:45634) 2021-10-20T23:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91727fc700 1 -- 172.21.15.12:0/2956755263 learned_addr learned my addr 172.21.15.12:0/2956755263 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91737fe700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 0x7f9174152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91737fe700 1 -- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9174061320 msgr2=0x7f917409e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91737fe700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9174061320 0x7f917409e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91737fe700 1 -- 172.21.15.12:0/2956755263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91740ad5c0 msgr2=0x7f9174142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91737fe700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91740ad5c0 0x7f9174142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91737fe700 1 -- 172.21.15.12:0/2956755263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916400b180 con 0x7f9174140440 2021-10-20T23:24:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91727fc700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91740ad5c0 0x7f9174142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9172ffd700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9174061320 0x7f917409e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f91737fe700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 0x7f9174152f00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f916c0032f0 tx=0x7f916c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9163fff700 1 -- 172.21.15.12:0/2956755263 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f916c00b600 con 0x7f9174140440 2021-10-20T23:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9163fff700 1 -- 172.21.15.12:0/2956755263 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c011b60 con 0x7f9174140440 2021-10-20T23:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c009470 con 0x7f9174140440 2021-10-20T23:24:48.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9163fff700 1 -- 172.21.15.12:0/2956755263 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f916c01f3f0 con 0x7f9174140440 2021-10-20T23:24:48.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.287+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9174142c80 con 0x7f9174140440 2021-10-20T23:24:48.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.291+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91740af460 con 0x7f9174140440 2021-10-20T23:24:48.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.291+0000 7f9163fff700 1 -- 172.21.15.12:0/2956755263 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f916c026030 con 0x7f9174140440 2021-10-20T23:24:48.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.291+0000 7f9163fff700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91500534f0 0x7f91500559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:48.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.291+0000 7f9163fff700 1 -- 172.21.15.12:0/2956755263 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f916c06c450 con 0x7f9174140440 2021-10-20T23:24:48.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.291+0000 7f9172ffd700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91500534f0 0x7f91500559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.291+0000 7f9172ffd700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91500534f0 0x7f91500559b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f916800d000 tx=0x7f9168009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.307+0000 7f9163fff700 1 -- 172.21.15.12:0/2956755263 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f916c043330 con 0x7f9174140440 2021-10-20T23:24:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:48.435+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9174057350 con 0x7f9174140440 2021-10-20T23:24:49.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.147+0000 7f9163fff700 1 -- 172.21.15.12:0/2956755263 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 185+0+0 (secure 0 0 0) 0x7f916c0150e0 con 0x7f9174140440 2021-10-20T23:24:49.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91500534f0 msgr2=0x7f91500559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:49.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91500534f0 0x7f91500559b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f916800d000 tx=0x7f9168009040).stop 2021-10-20T23:24:49.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 msgr2=0x7f9174152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:49.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 0x7f9174152f00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f916c0032f0 tx=0x7f916c016000).stop 2021-10-20T23:24:49.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 shutdown_connections 2021-10-20T23:24:49.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91500534f0 0x7f91500559b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:49.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9174140440 0x7f9174152f00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:49.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91740ad5c0 0x7f9174142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:49.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 --2- 172.21.15.12:0/2956755263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9174061320 0x7f917409e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:49.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 >> 172.21.15.12:0/2956755263 conn(0x7f9174066de0 msgr2=0x7f91740b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:49.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 shutdown_connections 2021-10-20T23:24:49.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.155+0000 7f9173fff700 1 -- 172.21.15.12:0/2956755263 wait complete. 2021-10-20T23:24:49.161 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:24:49.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:24:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.283+0000 7f095d276700 1 Processor -- start 2021-10-20T23:24:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.283+0000 7f095d276700 1 -- start start 2021-10-20T23:24:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b7370 0x7f09580b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f09580aac20 0x7f0958064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580b2380 con 0x7f09580b3060 2021-10-20T23:24:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0958144250 con 0x7f09580aac20 2021-10-20T23:24:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580b3570 con 0x7f09580b7370 2021-10-20T23:24:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095ca75700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f09580aac20 0x7f0958064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f094f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f09580b3060 0x7f095813e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38478/0 (socket says 172.21.15.12:38478) 2021-10-20T23:24:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f094f7fe700 1 -- 172.21.15.12:0/4202454893 learned_addr learned my addr 172.21.15.12:0/4202454893 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f0957fff700 1 --2- 172.21.15.12:0/4202454893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b7370 0x7f09580b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f09577fe700 1 -- 172.21.15.12:0/4202454893 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845230413 0 0) 0x7f09580b2380 con 0x7f09580b3060 2021-10-20T23:24:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f09577fe700 1 -- 172.21.15.12:0/4202454893 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0938003260 con 0x7f09580b3060 2021-10-20T23:24:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095ca75700 1 -- 172.21.15.12:0/4202454893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b7370 msgr2=0x7f09580b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095ca75700 1 --2- 172.21.15.12:0/4202454893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b7370 0x7f09580b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095ca75700 1 -- 172.21.15.12:0/4202454893 >> v1:172.21.15.12:6789/0 conn(0x7f09580b3060 legacy=0x7f095813e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095ca75700 1 -- 172.21.15.12:0/4202454893 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580b25b0 con 0x7f09580aac20 2021-10-20T23:24:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095ca75700 1 --2- 172.21.15.12:0/4202454893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580aac20 0x7f0958064ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f09500032f0 tx=0x7f09500091d0).ready entity=mon.0 client_cookie=79da99271590ff82 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f09577fe700 1 -- 172.21.15.12:0/4202454893 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095000b600 con 0x7f09580aac20 2021-10-20T23:24:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f09577fe700 1 -- 172.21.15.12:0/4202454893 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095000b760 con 0x7f09580aac20 2021-10-20T23:24:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f09577fe700 1 -- 172.21.15.12:0/4202454893 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095000b8d0 con 0x7f09580aac20 2021-10-20T23:24:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 -- 172.21.15.12:0/4202454893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580aac20 msgr2=0x7f0958064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 --2- 172.21.15.12:0/4202454893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580aac20 0x7f0958064ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f09500032f0 tx=0x7f09500091d0).stop 2021-10-20T23:24:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 -- 172.21.15.12:0/4202454893 shutdown_connections 2021-10-20T23:24:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 --2- 172.21.15.12:0/4202454893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580aac20 0x7f0958064ba0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 --2- 172.21.15.12:0/4202454893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b7370 0x7f09580b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 -- 172.21.15.12:0/4202454893 >> 172.21.15.12:0/4202454893 conn(0x7f095805f6b0 msgr2=0x7f095805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 -- 172.21.15.12:0/4202454893 shutdown_connections 2021-10-20T23:24:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.287+0000 7f095d276700 1 -- 172.21.15.12:0/4202454893 wait complete. 2021-10-20T23:24:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 Processor -- start 2021-10-20T23:24:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 -- start start 2021-10-20T23:24:49.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09580aac20 0x7f09580ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:49.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b3060 0x7f09580ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:49.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580b7370 0x7f09580b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:49.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095814ea20 con 0x7f09580b7370 2021-10-20T23:24:49.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580ada20 con 0x7f09580aac20 2021-10-20T23:24:49.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580acda0 con 0x7f09580b3060 2021-10-20T23:24:49.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095ca75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580b7370 0x7f09580b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:49.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095ca75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580b7370 0x7f09580b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39894/0 (socket says 172.21.15.12:39894) 2021-10-20T23:24:49.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f0957fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09580aac20 0x7f09580ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:49.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095ca75700 1 -- 172.21.15.12:0/2937961689 learned_addr learned my addr 172.21.15.12:0/2937961689 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:49.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f094f7fe700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b3060 0x7f09580ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:49.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095ca75700 1 -- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b3060 msgr2=0x7f09580ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:49.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095ca75700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b3060 0x7f09580ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095ca75700 1 -- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09580aac20 msgr2=0x7f09580ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095ca75700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09580aac20 0x7f09580ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095ca75700 1 -- 172.21.15.12:0/2937961689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950009470 con 0x7f09580b7370 2021-10-20T23:24:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095ca75700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580b7370 0x7f09580b1470 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f09500032f0 tx=0x7f0950016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f0955ffb700 1 -- 172.21.15.12:0/2937961689 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095000b8d0 con 0x7f09580b7370 2021-10-20T23:24:49.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09580ab9e0 con 0x7f09580b7370 2021-10-20T23:24:49.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f0955ffb700 1 -- 172.21.15.12:0/2937961689 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0950021630 con 0x7f09580b7370 2021-10-20T23:24:49.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f0955ffb700 1 -- 172.21.15.12:0/2937961689 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095000b600 con 0x7f09580b7370 2021-10-20T23:24:49.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.291+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09580b6c80 con 0x7f09580b7370 2021-10-20T23:24:49.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.295+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095814ebf0 con 0x7f09580b7370 2021-10-20T23:24:49.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.295+0000 7f0955ffb700 1 -- 172.21.15.12:0/2937961689 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0950029070 con 0x7f09580b7370 2021-10-20T23:24:49.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.295+0000 7f0955ffb700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f093c053580 0x7f093c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:49.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.295+0000 7f0955ffb700 1 -- 172.21.15.12:0/2937961689 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f095006caf0 con 0x7f09580b7370 2021-10-20T23:24:49.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.295+0000 7f0957fff700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f093c053580 0x7f093c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:49.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.295+0000 7f0957fff700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f093c053580 0x7f093c055a40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f0948006000 tx=0x7f0948011040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:49.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.303+0000 7f0955ffb700 1 -- 172.21.15.12:0/2937961689 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f095814ebf0 con 0x7f09580b7370 2021-10-20T23:24:49.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:49.435+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0958057350 con 0x7f09580b7370 2021-10-20T23:24:50.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.155+0000 7f0955ffb700 1 -- 172.21.15.12:0/2937961689 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0950015020 con 0x7f09580b7370 2021-10-20T23:24:50.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f093c053580 msgr2=0x7f093c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f093c053580 0x7f093c055a40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f0948006000 tx=0x7f0948011040).stop 2021-10-20T23:24:50.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580b7370 msgr2=0x7f09580b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580b7370 0x7f09580b1470 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f09500032f0 tx=0x7f0950016000).stop 2021-10-20T23:24:50.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 shutdown_connections 2021-10-20T23:24:50.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f093c053580 0x7f093c055a40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09580b7370 0x7f09580b1470 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09580b3060 0x7f09580ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 --2- 172.21.15.12:0/2937961689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09580aac20 0x7f09580ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 >> 172.21.15.12:0/2937961689 conn(0x7f095805f6b0 msgr2=0x7f095813f900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:50.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 shutdown_connections 2021-10-20T23:24:50.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.163+0000 7f095d276700 1 -- 172.21.15.12:0/2937961689 wait complete. 2021-10-20T23:24:50.171 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:24:50.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:24:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.279+0000 7f3653e10700 1 Processor -- start 2021-10-20T23:24:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.279+0000 7f3653e10700 1 -- start start 2021-10-20T23:24:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.279+0000 7f3653e10700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 0x7f364c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.279+0000 7f3653e10700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f364c0b0790 0x7f364c13dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.279+0000 7f3653e10700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c0b3ff0 con 0x7f364c0b43c0 2021-10-20T23:24:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.279+0000 7f3653e10700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364c13ed20 con 0x7f364c0b0790 2021-10-20T23:24:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.279+0000 7f3653e10700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c05ca50 con 0x7f364c0af780 2021-10-20T23:24:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f364c0b0790 0x7f364c13dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f364c0b0790 0x7f364c13dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39900/0 (socket says 172.21.15.12:39900) 2021-10-20T23:24:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36523ad700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f364c0b43c0 0x7f364c13e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38496/0 (socket says 172.21.15.12:38496) 2021-10-20T23:24:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 -- 172.21.15.12:0/886218992 learned_addr learned my addr 172.21.15.12:0/886218992 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3651bac700 1 --2- 172.21.15.12:0/886218992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 0x7f364c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 -- 172.21.15.12:0/886218992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 msgr2=0x7f364c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 --2- 172.21.15.12:0/886218992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 0x7f364c0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 -- 172.21.15.12:0/886218992 >> v1:172.21.15.12:6789/0 conn(0x7f364c0b43c0 legacy=0x7f364c13e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 -- 172.21.15.12:0/886218992 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c0afb60 con 0x7f364c0b0790 2021-10-20T23:24:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3650baa700 1 -- 172.21.15.12:0/886218992 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145442969 0 0) 0x7f364c0b3ff0 con 0x7f364c0b43c0 2021-10-20T23:24:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 --2- 172.21.15.12:0/886218992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 0x7f364c13dfa0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f3640002f70 tx=0x7f3640006eb0).ready entity=mon.0 client_cookie=b720c265b2f52c85 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3650baa700 1 -- 172.21.15.12:0/886218992 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f364000d570 con 0x7f364c0b0790 2021-10-20T23:24:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3650baa700 1 -- 172.21.15.12:0/886218992 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640000e90 con 0x7f364c0b0790 2021-10-20T23:24:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3650baa700 1 -- 172.21.15.12:0/886218992 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f364000d8c0 con 0x7f364c0b0790 2021-10-20T23:24:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 -- 172.21.15.12:0/886218992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 msgr2=0x7f364c13dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 --2- 172.21.15.12:0/886218992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 0x7f364c13dfa0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f3640002f70 tx=0x7f3640006eb0).stop 2021-10-20T23:24:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 -- 172.21.15.12:0/886218992 shutdown_connections 2021-10-20T23:24:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 --2- 172.21.15.12:0/886218992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 0x7f364c13dfa0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 --2- 172.21.15.12:0/886218992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 0x7f364c0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 -- 172.21.15.12:0/886218992 >> 172.21.15.12:0/886218992 conn(0x7f364c06a110 msgr2=0x7f364c05cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 -- 172.21.15.12:0/886218992 shutdown_connections 2021-10-20T23:24:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 -- 172.21.15.12:0/886218992 wait complete. 2021-10-20T23:24:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 Processor -- start 2021-10-20T23:24:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 -- start start 2021-10-20T23:24:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 0x7f364c1434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 0x7f364c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f364c0b43c0 0x7f364c152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c152410 con 0x7f364c0b0790 2021-10-20T23:24:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c153220 con 0x7f364c0b43c0 2021-10-20T23:24:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3653e10700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c145f00 con 0x7f364c0af780 2021-10-20T23:24:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 0x7f364c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 0x7f364c152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39906/0 (socket says 172.21.15.12:39906) 2021-10-20T23:24:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 -- 172.21.15.12:0/3690883603 learned_addr learned my addr 172.21.15.12:0/3690883603 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f3651bac700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 0x7f364c1434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36523ad700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f364c0b43c0 0x7f364c152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 -- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 msgr2=0x7f364c1434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 0x7f364c1434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 -- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f364c0b43c0 msgr2=0x7f364c152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f364c0b43c0 0x7f364c152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.283+0000 7f36513ab700 1 -- 172.21.15.12:0/3690883603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364000b1e0 con 0x7f364c0b0790 2021-10-20T23:24:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f36513ab700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 0x7f364c152840 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f3640002f70 tx=0x7f3640015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f364affd700 1 -- 172.21.15.12:0/3690883603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3640011860 con 0x7f364c0b0790 2021-10-20T23:24:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f364affd700 1 -- 172.21.15.12:0/3690883603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400119c0 con 0x7f364c0b0790 2021-10-20T23:24:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c156460 con 0x7f364c0b0790 2021-10-20T23:24:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f364affd700 1 -- 172.21.15.12:0/3690883603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3640011d20 con 0x7f364c0b0790 2021-10-20T23:24:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c146900 con 0x7f364c0b0790 2021-10-20T23:24:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c152580 con 0x7f364c0b0790 2021-10-20T23:24:50.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f364affd700 1 -- 172.21.15.12:0/3690883603 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3640025030 con 0x7f364c0b0790 2021-10-20T23:24:50.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f364affd700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f362c0535b0 0x7f362c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f364affd700 1 -- 172.21.15.12:0/3690883603 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f364006c880 con 0x7f364c0b0790 2021-10-20T23:24:50.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f3651bac700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f362c0535b0 0x7f362c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.287+0000 7f3651bac700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f362c0535b0 0x7f362c055a70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f363c00b000 tx=0x7f363c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:50.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.291+0000 7f364affd700 1 -- 172.21.15.12:0/3690883603 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f364c152580 con 0x7f364c0b0790 2021-10-20T23:24:50.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.415+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f364c1562a0 con 0x7f364c0b0790 2021-10-20T23:24:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f364affd700 1 -- 172.21.15.12:0/3690883603 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3640023020 con 0x7f364c0b0790 2021-10-20T23:24:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f362c0535b0 msgr2=0x7f362c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f362c0535b0 0x7f362c055a70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f363c00b000 tx=0x7f363c006df0).stop 2021-10-20T23:24:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 msgr2=0x7f364c152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 0x7f364c152840 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f3640002f70 tx=0x7f3640015000).stop 2021-10-20T23:24:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 shutdown_connections 2021-10-20T23:24:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f362c0535b0 0x7f362c055a70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f364c0b43c0 0x7f364c152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c0b0790 0x7f364c152840 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 --2- 172.21.15.12:0/3690883603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f364c0af780 0x7f364c1434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 >> 172.21.15.12:0/3690883603 conn(0x7f364c06a110 msgr2=0x7f364c0b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 shutdown_connections 2021-10-20T23:24:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.423+0000 7f3653e10700 1 -- 172.21.15.12:0/3690883603 wait complete. 2021-10-20T23:24:50.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-10-20T23:24:50.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.539+0000 7fb48f265700 1 Processor -- start 2021-10-20T23:24:50.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.539+0000 7fb48f265700 1 -- start start 2021-10-20T23:24:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b00e0 0x7fb488142e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb488067880 con 0x7fb4880b2580 2021-10-20T23:24:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb488067b20 con 0x7fb4880ac6f0 2021-10-20T23:24:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880ad5b0 con 0x7fb4880b00e0 2021-10-20T23:24:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48e263700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb4880b2580 0x7fb488140050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38506/0 (socket says 172.21.15.12:38506) 2021-10-20T23:24:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48e263700 1 -- 172.21.15.12:0/420262015 learned_addr learned my addr 172.21.15.12:0/420262015 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48da62700 1 --2- 172.21.15.12:0/420262015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b00e0 0x7fb488142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48d261700 1 -- 172.21.15.12:0/420262015 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035280563 0 0) 0x7fb488067880 con 0x7fb4880b2580 2021-10-20T23:24:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48d261700 1 -- 172.21.15.12:0/420262015 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb470003260 con 0x7fb4880b2580 2021-10-20T23:24:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48da62700 1 -- 172.21.15.12:0/420262015 >> v1:172.21.15.31:6789/0 conn(0x7fb4880ac6f0 legacy=0x7fb488143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48da62700 1 -- 172.21.15.12:0/420262015 >> v1:172.21.15.12:6789/0 conn(0x7fb4880b2580 legacy=0x7fb488140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48da62700 1 -- 172.21.15.12:0/420262015 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488146fd0 con 0x7fb4880b00e0 2021-10-20T23:24:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48da62700 1 --2- 172.21.15.12:0/420262015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b00e0 0x7fb488142e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb484002f70 tx=0x7fb484006df0).ready entity=mon.2 client_cookie=d386aca38f48fb39 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48d261700 1 -- 172.21.15.12:0/420262015 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb48400d570 con 0x7fb4880b00e0 2021-10-20T23:24:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48d261700 1 -- 172.21.15.12:0/420262015 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb484000e90 con 0x7fb4880b00e0 2021-10-20T23:24:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48d261700 1 -- 172.21.15.12:0/420262015 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb48400d8c0 con 0x7fb4880b00e0 2021-10-20T23:24:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 -- 172.21.15.12:0/420262015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b00e0 msgr2=0x7fb488142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 --2- 172.21.15.12:0/420262015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b00e0 0x7fb488142e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb484002f70 tx=0x7fb484006df0).stop 2021-10-20T23:24:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 -- 172.21.15.12:0/420262015 shutdown_connections 2021-10-20T23:24:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 --2- 172.21.15.12:0/420262015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b00e0 0x7fb488142e70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 -- 172.21.15.12:0/420262015 >> 172.21.15.12:0/420262015 conn(0x7fb488060180 msgr2=0x7fb4880b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 -- 172.21.15.12:0/420262015 shutdown_connections 2021-10-20T23:24:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.543+0000 7fb48f265700 1 -- 172.21.15.12:0/420262015 wait complete. 2021-10-20T23:24:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 Processor -- start 2021-10-20T23:24:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 -- start start 2021-10-20T23:24:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4880ac6f0 0x7fb488146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4880b00e0 0x7fb48809ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b2580 0x7fb4880a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880a08e0 con 0x7fb4880ac6f0 2021-10-20T23:24:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881534c0 con 0x7fb4880b00e0 2021-10-20T23:24:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881525a0 con 0x7fb4880b2580 2021-10-20T23:24:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48e263700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4880ac6f0 0x7fb488146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48e263700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4880ac6f0 0x7fb488146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39918/0 (socket says 172.21.15.12:39918) 2021-10-20T23:24:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48e263700 1 -- 172.21.15.12:0/3638601086 learned_addr learned my addr 172.21.15.12:0/3638601086 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48da62700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4880b00e0 0x7fb48809ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48ea64700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b2580 0x7fb4880a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48e263700 1 -- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b2580 msgr2=0x7fb4880a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48e263700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b2580 0x7fb4880a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48e263700 1 -- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4880b00e0 msgr2=0x7fb48809ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48e263700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4880b00e0 0x7fb48809ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48e263700 1 -- 172.21.15.12:0/3638601086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48400b180 con 0x7fb4880ac6f0 2021-10-20T23:24:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48e263700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4880ac6f0 0x7fb488146500 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fb478001110 tx=0x7fb478007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb4777fe700 1 -- 172.21.15.12:0/3638601086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4780070d0 con 0x7fb4880ac6f0 2021-10-20T23:24:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb488152840 con 0x7fb4880ac6f0 2021-10-20T23:24:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb488152d80 con 0x7fb4880ac6f0 2021-10-20T23:24:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb4777fe700 1 -- 172.21.15.12:0/3638601086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb478007230 con 0x7fb4880ac6f0 2021-10-20T23:24:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.547+0000 7fb4777fe700 1 -- 172.21.15.12:0/3638601086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4780055f0 con 0x7fb4880ac6f0 2021-10-20T23:24:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.551+0000 7fb4777fe700 1 -- 172.21.15.12:0/3638601086 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb47801a060 con 0x7fb4880ac6f0 2021-10-20T23:24:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.551+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb464003410 con 0x7fb4880ac6f0 2021-10-20T23:24:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.551+0000 7fb4777fe700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb468053640 0x7fb468055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.551+0000 7fb4777fe700 1 -- 172.21.15.12:0/3638601086 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb47806aea0 con 0x7fb4880ac6f0 2021-10-20T23:24:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.551+0000 7fb48da62700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb468053640 0x7fb468055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.551+0000 7fb48da62700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb468053640 0x7fb468055b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fb48401a000 tx=0x7fb484014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.559+0000 7fb4777fe700 1 -- 172.21.15.12:0/3638601086 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb4780420e0 con 0x7fb4880ac6f0 2021-10-20T23:24:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:50.731+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7fb464003c40 con 0x7fb4880ac6f0 2021-10-20T23:24:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.159+0000 7fb4777fe700 1 -- 172.21.15.12:0/3638601086 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v213) v1 ==== 152+0+0 (secure 0 0 0) 0x7fb4780180d0 con 0x7fb4880ac6f0 2021-10-20T23:24:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb468053640 msgr2=0x7fb468055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb468053640 0x7fb468055b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fb48401a000 tx=0x7fb484014000).stop 2021-10-20T23:24:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4880ac6f0 msgr2=0x7fb488146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4880ac6f0 0x7fb488146500 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fb478001110 tx=0x7fb478007ad0).stop 2021-10-20T23:24:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 shutdown_connections 2021-10-20T23:24:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb468053640 0x7fb468055b00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4880b2580 0x7fb4880a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4880b00e0 0x7fb48809ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 --2- 172.21.15.12:0/3638601086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4880ac6f0 0x7fb488146500 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 >> 172.21.15.12:0/3638601086 conn(0x7fb488060180 msgr2=0x7fb48805cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 shutdown_connections 2021-10-20T23:24:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.163+0000 7fb48f265700 1 -- 172.21.15.12:0/3638601086 wait complete. 2021-10-20T23:24:51.184 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-10-20T23:24:51.185 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-10-20T23:24:51.186 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-10-20T23:24:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 Processor -- start 2021-10-20T23:24:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 -- start start 2021-10-20T23:24:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc7800607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc780140140 0x7fc7801405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:51.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc780066ea0 con 0x7fc7800b3040 2021-10-20T23:24:51.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7800648e0 con 0x7fc780140140 2021-10-20T23:24:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc780061dd0 con 0x7fc7800a9c10 2021-10-20T23:24:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77dd9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc7800607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc780140140 0x7fc7801405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc780140140 0x7fc7801405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:54904/0 (socket says 172.21.15.12:54904) 2021-10-20T23:24:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77dd9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc7800607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45686/0 (socket says 172.21.15.12:45686) 2021-10-20T23:24:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77ed9d700 1 -- 172.21.15.12:0/3943611166 learned_addr learned my addr 172.21.15.12:0/3943611166 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77e59c700 1 --1- 172.21.15.12:0/3943611166 >> v1:172.21.15.31:6789/0 conn(0x7fc7800b3040 0x7fc780065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45584/0 (socket says 172.21.15.12:45584) 2021-10-20T23:24:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77ed9d700 1 -- 172.21.15.12:0/3943611166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 msgr2=0x7fc7800607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77ed9d700 1 --2- 172.21.15.12:0/3943611166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc7800607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77ed9d700 1 -- 172.21.15.12:0/3943611166 >> v1:172.21.15.31:6789/0 conn(0x7fc7800b3040 legacy=0x7fc780065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77ed9d700 1 -- 172.21.15.12:0/3943611166 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7800b3420 con 0x7fc780140140 2021-10-20T23:24:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77dd9b700 1 --2- 172.21.15.12:0/3943611166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc7800607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77ed9d700 1 --2- 172.21.15.12:0/3943611166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc780140140 0x7fc7801405d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fc7780032f0 tx=0x7fc77800b530).ready entity=mon.1 client_cookie=b848d02387911efb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:51.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77d59a700 1 -- 172.21.15.12:0/3943611166 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc77800ddf0 con 0x7fc780140140 2021-10-20T23:24:51.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77d59a700 1 -- 172.21.15.12:0/3943611166 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778010470 con 0x7fc780140140 2021-10-20T23:24:51.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77d59a700 1 -- 172.21.15.12:0/3943611166 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc778010810 con 0x7fc780140140 2021-10-20T23:24:51.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 -- 172.21.15.12:0/3943611166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc780140140 msgr2=0x7fc7801405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:51.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 --2- 172.21.15.12:0/3943611166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc780140140 0x7fc7801405d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fc7780032f0 tx=0x7fc77800b530).stop 2021-10-20T23:24:51.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 -- 172.21.15.12:0/3943611166 shutdown_connections 2021-10-20T23:24:51.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 --2- 172.21.15.12:0/3943611166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc780140140 0x7fc7801405d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 --2- 172.21.15.12:0/3943611166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc7800607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.291+0000 7fc77f59e700 1 -- 172.21.15.12:0/3943611166 >> 172.21.15.12:0/3943611166 conn(0x7fc7800636e0 msgr2=0x7fc780063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 -- 172.21.15.12:0/3943611166 shutdown_connections 2021-10-20T23:24:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 -- 172.21.15.12:0/3943611166 wait complete. 2021-10-20T23:24:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 Processor -- start 2021-10-20T23:24:51.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 -- start start 2021-10-20T23:24:51.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc780137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:51.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7800b3040 0x7fc7801385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:51.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc780140140 0x7fc780138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:51.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78013ee50 con 0x7fc780140140 2021-10-20T23:24:51.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78013f3c0 con 0x7fc7800b3040 2021-10-20T23:24:51.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78013f660 con 0x7fc7800a9c10 2021-10-20T23:24:51.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc780140140 0x7fc780138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:51.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc780140140 0x7fc780138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39936/0 (socket says 172.21.15.12:39936) 2021-10-20T23:24:51.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77ed9d700 1 -- 172.21.15.12:0/1353122585 learned_addr learned my addr 172.21.15.12:0/1353122585 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:51.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77dd9b700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7800b3040 0x7fc7801385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:51.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77e59c700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc780137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:51.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77ed9d700 1 -- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 msgr2=0x7fc780137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:51.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77ed9d700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc780137880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:51.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77ed9d700 1 -- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7800b3040 msgr2=0x7fc7801385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:51.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77ed9d700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7800b3040 0x7fc7801385d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:51.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77ed9d700 1 -- 172.21.15.12:0/1353122585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77400b180 con 0x7fc780140140 2021-10-20T23:24:51.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77ed9d700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc780140140 0x7fc780138ac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fc7780032f0 tx=0x7fc7800671d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:51.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc76f7fe700 1 -- 172.21.15.12:0/1353122585 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc778018610 con 0x7fc780140140 2021-10-20T23:24:51.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc76f7fe700 1 -- 172.21.15.12:0/1353122585 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778018770 con 0x7fc780140140 2021-10-20T23:24:51.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77800b7d0 con 0x7fc780140140 2021-10-20T23:24:51.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc76f7fe700 1 -- 172.21.15.12:0/1353122585 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc778018ad0 con 0x7fc780140140 2021-10-20T23:24:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.295+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78013e3c0 con 0x7fc780140140 2021-10-20T23:24:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.299+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78013f050 con 0x7fc780140140 2021-10-20T23:24:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.299+0000 7fc76f7fe700 1 -- 172.21.15.12:0/1353122585 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc778021020 con 0x7fc780140140 2021-10-20T23:24:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.299+0000 7fc76f7fe700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc75c053640 0x7fc75c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.299+0000 7fc76f7fe700 1 -- 172.21.15.12:0/1353122585 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc77806f2d0 con 0x7fc780140140 2021-10-20T23:24:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.299+0000 7fc77e59c700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc75c053640 0x7fc75c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.299+0000 7fc77e59c700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc75c053640 0x7fc75c055b00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fc77000d000 tx=0x7fc770007b80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.303+0000 7fc76f7fe700 1 -- 172.21.15.12:0/1353122585 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc778046510 con 0x7fc780140140 2021-10-20T23:24:51.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:51.471+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7fc78013f220 con 0x7fc780140140 2021-10-20T23:24:52.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.163+0000 7fc76f7fe700 1 -- 172.21.15.12:0/1353122585 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v214) v1 ==== 150+0+0 (secure 0 0 0) 0x7fc78013f220 con 0x7fc780140140 2021-10-20T23:24:52.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc75c053640 msgr2=0x7fc75c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc75c053640 0x7fc75c055b00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fc77000d000 tx=0x7fc770007b80).stop 2021-10-20T23:24:52.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc780140140 msgr2=0x7fc780138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc780140140 0x7fc780138ac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fc7780032f0 tx=0x7fc7800671d0).stop 2021-10-20T23:24:52.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 shutdown_connections 2021-10-20T23:24:52.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc75c053640 0x7fc75c055b00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc780140140 0x7fc780138ac0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7800b3040 0x7fc7801385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 --2- 172.21.15.12:0/1353122585 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7800a9c10 0x7fc780137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 >> 172.21.15.12:0/1353122585 conn(0x7fc7800636e0 msgr2=0x7fc780063ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 shutdown_connections 2021-10-20T23:24:52.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.167+0000 7fc77f59e700 1 -- 172.21.15.12:0/1353122585 wait complete. 2021-10-20T23:24:52.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:24:52.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7f1f2700 1 Processor -- start 2021-10-20T23:24:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7f1f2700 1 -- start start 2021-10-20T23:24:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7f1f2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc780b1440 0x7fdc780b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7f1f2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc780b5520 con 0x7fdc7813d3b0 2021-10-20T23:24:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7f1f2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc780b1c40 con 0x7fdc780b5140 2021-10-20T23:24:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7f1f2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc780ae000 con 0x7fdc780b1440 2021-10-20T23:24:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7d78f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdc7813d3b0 0x7fdc7814a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38540/0 (socket says 172.21.15.12:38540) 2021-10-20T23:24:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7d78f700 1 -- 172.21.15.12:0/1880862180 learned_addr learned my addr 172.21.15.12:0/1880862180 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc77fff700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc780b1440 0x7fdc780b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439179372 0 0) 0x7fdc780b5520 con 0x7fdc7813d3b0 2021-10-20T23:24:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc58003260 con 0x7fdc7813d3b0 2021-10-20T23:24:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3066019387 0 0) 0x7fdc58003260 con 0x7fdc7813d3b0 2021-10-20T23:24:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc780b1440 msgr2=0x7fdc780b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc780b1440 0x7fdc780b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 >> v1:172.21.15.31:6789/0 conn(0x7fdc780b5140 legacy=0x7fdc780af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc780b1ea0 con 0x7fdc7813d3b0 2021-10-20T23:24:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fdc70001660 con 0x7fdc7813d3b0 2021-10-20T23:24:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 >> v1:172.21.15.12:6789/0 conn(0x7fdc7813d3b0 legacy=0x7fdc7814a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc58003780 0x7fdc58003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc780b1440 0x7fdc58004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc580049f0 0x7fdc58004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc780ae000 con 0x7fdc580049f0 2021-10-20T23:24:52.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5800b780 con 0x7fdc58003780 2021-10-20T23:24:52.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5800b940 con 0x7fdc780b1440 2021-10-20T23:24:52.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7d78f700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc580049f0 0x7fdc58004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7cf8e700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc58003780 0x7fdc58003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc77fff700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc780b1440 0x7fdc58004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7d78f700 1 -- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc780b1440 msgr2=0x7fdc58004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:52.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7d78f700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc780b1440 0x7fdc58004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7d78f700 1 -- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc58003780 msgr2=0x7fdc58003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:52.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7d78f700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc58003780 0x7fdc58003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7d78f700 1 -- 172.21.15.12:0/1880862180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc58003260 con 0x7fdc580049f0 2021-10-20T23:24:52.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc77fff700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc780b1440 0x7fdc58004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:24:52.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc7d78f700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc580049f0 0x7fdc58004e70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fdc70001370 tx=0x7fdc780ae730).ready entity=mon.0 client_cookie=6c1341621807c36e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:52.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.299+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc700070d0 con 0x7fdc580049f0 2021-10-20T23:24:52.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70007230 con 0x7fdc580049f0 2021-10-20T23:24:52.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc777fe700 1 -- 172.21.15.12:0/1880862180 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc7000c8f0 con 0x7fdc580049f0 2021-10-20T23:24:52.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/1880862180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc580049f0 msgr2=0x7fdc58004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 --2- 172.21.15.12:0/1880862180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc580049f0 0x7fdc58004e70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fdc70001370 tx=0x7fdc780ae730).stop 2021-10-20T23:24:52.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7d78f700 1 -- 172.21.15.12:0/1880862180 reap_dead start 2021-10-20T23:24:52.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/1880862180 shutdown_connections 2021-10-20T23:24:52.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/1880862180 >> 172.21.15.12:0/1880862180 conn(0x7fdc7806a110 msgr2=0x7fdc7805cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:52.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/1880862180 shutdown_connections 2021-10-20T23:24:52.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/1880862180 wait complete. 2021-10-20T23:24:52.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 Processor -- start 2021-10-20T23:24:52.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- start start 2021-10-20T23:24:52.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc7813f540 0x7fdc78156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc78065a80 0x7fdc78156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc78156a40 0x7fdc78139d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7813f920 con 0x7fdc7813f540 2021-10-20T23:24:52.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc78142500 con 0x7fdc78156a40 2021-10-20T23:24:52.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc78064f10 con 0x7fdc78065a80 2021-10-20T23:24:52.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7cf8e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc7813f540 0x7fdc78156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7cf8e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc7813f540 0x7fdc78156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39954/0 (socket says 172.21.15.12:39954) 2021-10-20T23:24:52.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7cf8e700 1 -- 172.21.15.12:0/2650242483 learned_addr learned my addr 172.21.15.12:0/2650242483 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7d78f700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc78156a40 0x7fdc78139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc77fff700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc78065a80 0x7fdc78156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7cf8e700 1 -- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc78065a80 msgr2=0x7fdc78156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7cf8e700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc78065a80 0x7fdc78156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7cf8e700 1 -- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc78156a40 msgr2=0x7fdc78139d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7cf8e700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc78156a40 0x7fdc78139d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7cf8e700 1 -- 172.21.15.12:0/2650242483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc780651b0 con 0x7fdc7813f540 2021-10-20T23:24:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7d78f700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc78156a40 0x7fdc78139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:24:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7cf8e700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc7813f540 0x7fdc78156060 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fdc6800d000 tx=0x7fdc68007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc75ffb700 1 -- 172.21.15.12:0/2650242483 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc68011780 con 0x7fdc7813f540 2021-10-20T23:24:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc75ffb700 1 -- 172.21.15.12:0/2650242483 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc680118e0 con 0x7fdc7813f540 2021-10-20T23:24:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc78065450 con 0x7fdc7813f540 2021-10-20T23:24:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.303+0000 7fdc75ffb700 1 -- 172.21.15.12:0/2650242483 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc68011c40 con 0x7fdc7813f540 2021-10-20T23:24:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.307+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc78142db0 con 0x7fdc7813f540 2021-10-20T23:24:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.307+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc780658f0 con 0x7fdc7813f540 2021-10-20T23:24:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.307+0000 7fdc75ffb700 1 -- 172.21.15.12:0/2650242483 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc6801d460 con 0x7fdc7813f540 2021-10-20T23:24:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.307+0000 7fdc75ffb700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdc5c053610 0x7fdc5c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.307+0000 7fdc75ffb700 1 -- 172.21.15.12:0/2650242483 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fdc6806be80 con 0x7fdc7813f540 2021-10-20T23:24:52.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.307+0000 7fdc77fff700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdc5c053610 0x7fdc5c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.307+0000 7fdc77fff700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdc5c053610 0x7fdc5c055ad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fdc6000b000 tx=0x7fdc60008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:52.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.315+0000 7fdc75ffb700 1 -- 172.21.15.12:0/2650242483 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc68043100 con 0x7fdc7813f540 2021-10-20T23:24:52.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.439+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdc780b2140 con 0x7fdc7813f540 2021-10-20T23:24:52.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc75ffb700 1 -- 172.21.15.12:0/2650242483 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc68046720 con 0x7fdc7813f540 2021-10-20T23:24:52.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdc5c053610 msgr2=0x7fdc5c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdc5c053610 0x7fdc5c055ad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fdc6000b000 tx=0x7fdc60008040).stop 2021-10-20T23:24:52.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc7813f540 msgr2=0x7fdc78156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc7813f540 0x7fdc78156060 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fdc6800d000 tx=0x7fdc68007d60).stop 2021-10-20T23:24:52.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 shutdown_connections 2021-10-20T23:24:52.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdc5c053610 0x7fdc5c055ad0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc78156a40 0x7fdc78139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc78065a80 0x7fdc78156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 --2- 172.21.15.12:0/2650242483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc7813f540 0x7fdc78156060 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.447+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 >> 172.21.15.12:0/2650242483 conn(0x7fdc7806a110 msgr2=0x7fdc7805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:52.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.451+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 shutdown_connections 2021-10-20T23:24:52.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.451+0000 7fdc7f1f2700 1 -- 172.21.15.12:0/2650242483 wait complete. 2021-10-20T23:24:52.466 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:24:52.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:24:52.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:24:52.509 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:24:52.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:24:52.553 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:24:52.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:24:52.554 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:24:52.555 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:24:52.579 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:24:52.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:24:52.580 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:24:52.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:24:52.581 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:24:52.581 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:24:52.603 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:24:52.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:24:52.604 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:24:52.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:24:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.711+0000 7f192df26700 1 Processor -- start 2021-10-20T23:24:52.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.711+0000 7f192df26700 1 -- start start 2021-10-20T23:24:52.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 0x7f192814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19280b0010 0x7f192814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19280afbd0 0x7f19280a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280a70c0 con 0x7f19280afbd0 2021-10-20T23:24:52.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280a72f0 con 0x7f19280b0010 2021-10-20T23:24:52.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19280a7590 con 0x7f19280b2580 2021-10-20T23:24:52.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192d725700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19280afbd0 0x7f19280a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192cf24700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 0x7f192814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f1927fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19280b0010 0x7f192814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192d725700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19280afbd0 0x7f19280a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39966/0 (socket says 172.21.15.12:39966) 2021-10-20T23:24:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192d725700 1 -- 172.21.15.12:0/1763591999 learned_addr learned my addr 172.21.15.12:0/1763591999 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:52.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192d725700 1 -- 172.21.15.12:0/1763591999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 msgr2=0x7f192814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192d725700 1 --2- 172.21.15.12:0/1763591999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 0x7f192814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192d725700 1 -- 172.21.15.12:0/1763591999 >> v2:172.21.15.31:3300/0 conn(0x7f19280b0010 msgr2=0x7f192814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192d725700 1 --2- 172.21.15.12:0/1763591999 >> v2:172.21.15.31:3300/0 conn(0x7f19280b0010 0x7f192814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192d725700 1 -- 172.21.15.12:0/1763591999 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280a7830 con 0x7f19280afbd0 2021-10-20T23:24:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192d725700 1 --2- 172.21.15.12:0/1763591999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 0x7f19280a83b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f1920002f70 tx=0x7f1920006eb0).ready entity=mon.0 client_cookie=8f0b1ebc09f3b65 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f19277fe700 1 -- 172.21.15.12:0/1763591999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f192000d570 con 0x7f19280afbd0 2021-10-20T23:24:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f19277fe700 1 -- 172.21.15.12:0/1763591999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920000e90 con 0x7f19280afbd0 2021-10-20T23:24:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f19277fe700 1 -- 172.21.15.12:0/1763591999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f192000d900 con 0x7f19280afbd0 2021-10-20T23:24:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 -- 172.21.15.12:0/1763591999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 msgr2=0x7f19280a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 --2- 172.21.15.12:0/1763591999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 0x7f19280a83b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f1920002f70 tx=0x7f1920006eb0).stop 2021-10-20T23:24:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 -- 172.21.15.12:0/1763591999 shutdown_connections 2021-10-20T23:24:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 --2- 172.21.15.12:0/1763591999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 0x7f19280a83b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 --2- 172.21.15.12:0/1763591999 >> v2:172.21.15.31:3300/0 conn(0x7f19280b0010 0x7f192814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 --2- 172.21.15.12:0/1763591999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 0x7f192814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 -- 172.21.15.12:0/1763591999 >> 172.21.15.12:0/1763591999 conn(0x7f1928060180 msgr2=0x7f19280b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 -- 172.21.15.12:0/1763591999 shutdown_connections 2021-10-20T23:24:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.715+0000 7f192df26700 1 -- 172.21.15.12:0/1763591999 wait complete. 2021-10-20T23:24:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192df26700 1 Processor -- start 2021-10-20T23:24:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192df26700 1 -- start start 2021-10-20T23:24:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192df26700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 0x7f19280b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192df26700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19280b0010 0x7f192814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192df26700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 0x7f1928141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192df26700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280b5e00 con 0x7f19280afbd0 2021-10-20T23:24:52.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192df26700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1928143ae0 con 0x7f19280b0010 2021-10-20T23:24:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192df26700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1928143d80 con 0x7f19280b2580 2021-10-20T23:24:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192cf24700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 0x7f19280b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.719+0000 7f192cf24700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 0x7f19280b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39968/0 (socket says 172.21.15.12:39968) 2021-10-20T23:24:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192cf24700 1 -- 172.21.15.12:0/4084004368 learned_addr learned my addr 172.21.15.12:0/4084004368 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f1927fff700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19280b0010 0x7f192814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192d725700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 0x7f1928141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192cf24700 1 -- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 msgr2=0x7f1928141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192cf24700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 0x7f1928141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192cf24700 1 -- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19280b0010 msgr2=0x7f192814cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192cf24700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19280b0010 0x7f192814cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192cf24700 1 -- 172.21.15.12:0/4084004368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192000b1e0 con 0x7f19280afbd0 2021-10-20T23:24:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192cf24700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 0x7f19280b4470 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f191c00c000 tx=0x7f191c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f1925ffb700 1 -- 172.21.15.12:0/4084004368 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c011750 con 0x7f19280afbd0 2021-10-20T23:24:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f1925ffb700 1 -- 172.21.15.12:0/4084004368 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c0118b0 con 0x7f19280afbd0 2021-10-20T23:24:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1928144020 con 0x7f19280afbd0 2021-10-20T23:24:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f1925ffb700 1 -- 172.21.15.12:0/4084004368 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c011c10 con 0x7f19280afbd0 2021-10-20T23:24:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1928156ed0 con 0x7f19280afbd0 2021-10-20T23:24:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19281441b0 con 0x7f19280afbd0 2021-10-20T23:24:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.723+0000 7f1925ffb700 1 -- 172.21.15.12:0/4084004368 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f191c011d70 con 0x7f19280afbd0 2021-10-20T23:24:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.727+0000 7f1925ffb700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19080536a0 0x7f1908055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.727+0000 7f1925ffb700 1 -- 172.21.15.12:0/4084004368 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f191c06bcb0 con 0x7f19280afbd0 2021-10-20T23:24:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.727+0000 7f1927fff700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19080536a0 0x7f1908055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.727+0000 7f1927fff700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19080536a0 0x7f1908055b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f191800b000 tx=0x7f19180091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.731+0000 7f1925ffb700 1 -- 172.21.15.12:0/4084004368 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f191c042e20 con 0x7f19280afbd0 2021-10-20T23:24:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.863+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1928057350 con 0x7f19280afbd0 2021-10-20T23:24:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.863+0000 7f1925ffb700 1 -- 172.21.15.12:0/4084004368 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v61) v1 ==== 81+0+29220 (secure 0 0 0) 0x7f191c046440 con 0x7f19280afbd0 2021-10-20T23:24:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:52.868 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:24:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 61, 2021-10-20T23:24:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:24:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:24:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:24:50.145150+0000", 2021-10-20T23:24:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:24:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:24:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:24:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:24:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:24:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:24:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:24:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:24:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:24:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:24:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:24:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:24:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:24:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:24:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:24:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 10, 2021-10-20T23:24:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:24:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:24:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:24:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:24:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:24:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:24:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:24:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:24:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:24:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:24:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:24:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:24:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:24:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:24:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:24:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:24:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:24:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:24:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:24:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:24:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:24:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:24:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:24:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:24:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:24:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:24:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:24:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:24:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:24:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:24:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:24:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:24:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:24:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:24:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:24:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:24:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:24:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:24:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:24:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:24:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:24:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:24:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:24:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:24:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:24:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:24:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:24:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:24:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:24:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:24:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:24:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:24:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:24:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:24:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:24:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:24:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:24:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:24:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:24:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:24:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:24:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:24:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:24:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:24:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:24:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:24:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:24:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:24:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:24:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:24:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:24:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:24:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:24:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:24:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:24:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:24:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:24:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:24:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:24:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:24:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:24:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:24:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:24:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:24:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:24:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:24:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:24:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:24:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:24:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:24:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:24:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:24:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:24:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:24:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:24:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:24:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:24:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:24:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:24:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:24:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:24:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:24:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:24:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:24:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:24:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:24:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:24:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:24:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:24:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:24:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:24:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:24:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:24:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:24:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:24:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:24:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:24:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:24:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:24:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:24:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:24:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:24:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:24:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:24:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:24:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:24:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:24:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:24:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:24:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:24:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:24:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:24:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:24:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:24:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:24:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:24:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:24:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:24:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:24:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:24:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:24:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:24:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:24:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:24:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:24:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:24:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:24:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:24:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:24:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:24:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:24:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:24:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:24:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:24:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:24:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:24:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:24:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:24:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:24:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:24:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:24:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:24:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:24:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:24:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:24:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:24:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:24:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:24:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:24:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:24:52.945 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:52.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.945 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:24:52.947 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:52.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.947 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:24:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:24:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:52.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.950 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:24:52.951 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:52.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.951 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.951 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:24:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:24:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:24:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:24:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:24:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:24:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:24:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:52.956 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:52.956 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:24:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:24:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:52.958 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:52.958 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:52.958 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:52.958 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 55, 2021-10-20T23:24:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:24:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.961 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:24:52.961 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:52.961 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.962 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.962 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:52.962 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:24:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:24:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.965 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.965 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:52.965 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.966 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:24:52.966 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:52.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:24:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.969 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:24:52.969 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:24:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:24:52.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.971 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.971 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:24:52.971 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:24:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:24:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:24:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:52.973 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.973 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:24:52.974 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:24:52.974 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:52.974 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:52.974 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:52.974 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:52.975 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:52.975 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:52.975 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:52.975 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:24:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:24:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.979 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:52.979 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:24:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:24:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.982 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:52.982 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:24:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:24:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.985 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:52.985 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:24:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.987 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:24:52.987 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:24:52.987 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:24:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:24:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:24:52.989 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:24:52.989 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:52.989 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:52.989 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:24:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:24:52.991 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:52.991 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:52.991 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:52.991 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:52.993 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:52.993 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:52.993 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.994 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:24:52.994 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:52.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:24:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:52.996 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:52.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.996 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:52.996 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:52.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:52.997 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:24:52.998 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:52.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:52.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:52.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:52.999 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:24:53.000 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:53.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.001 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.002 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:53.002 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.003 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:24:53.003 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:53.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.005 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:24:53.005 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:53.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.006 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.007 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:53.007 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.008 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:24:53.008 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:53.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.010 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:24:53.010 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:24:53.011 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.011 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.012 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:24:53.012 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:24:53.012 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:24:53.013 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:24:53.013 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:53.013 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:53.014 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:53.014 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.015 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:24:53.016 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:24:53.016 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:53.016 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:53.017 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:53.017 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:53.017 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:53.018 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:53.018 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:53.019 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 56, 2021-10-20T23:24:53.019 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:53.019 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:53.020 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:53.020 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.021 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:24:53.021 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:53.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.023 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:24:53.023 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:53.024 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.024 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.025 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:53.025 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.026 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:24:53.026 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:53.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.028 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:24:53.028 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:53.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.029 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.029 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:53.029 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.030 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:24:53.030 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:53.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.031 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:24:53.031 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:53.031 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.032 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.032 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:53.032 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.033 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:24:53.033 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:53.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.034 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:24:53.034 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:24:53.034 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.034 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.035 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:24:53.035 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:24:53.035 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:24:53.035 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:24:53.036 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:53.036 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:53.036 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:53.036 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.037 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:24:53.037 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:24:53.037 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:24:53.038 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:24:53.038 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:24:53.038 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:24:53.038 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:24:53.038 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:24:53.039 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:24:53.039 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 55, 2021-10-20T23:24:53.039 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:24:53.039 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:24:53.039 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:24:53.040 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.040 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:24:53.040 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:53.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.041 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:24:53.042 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:53.042 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.042 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.042 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:24:53.043 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.043 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:24:53.043 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:53.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.044 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.044 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:24:53.044 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:53.045 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.045 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.045 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:24:53.045 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.046 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:24:53.046 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:53.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.047 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:24:53.047 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:53.048 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.048 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.048 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:24:53.048 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:24:53.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:24:53.049 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:24:53.049 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:53.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:24:53.050 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:24:53.050 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:24:53.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.051 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.051 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:24:53.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:24:53.052 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:24:53.052 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:24:53.052 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:24:53.052 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:24:53.052 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:24:53.053 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:53.053 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.053 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:24:53.053 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:24:53.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.054 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:24:53.054 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:53.054 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:53.055 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:53.055 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:53.055 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:53.055 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:24:53.055 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:53.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.056 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:24:53.056 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:53.057 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:53.057 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:53.057 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:53.057 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:53.057 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:24:53.058 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:53.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.058 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:24:53.058 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:53.059 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:53.059 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:53.059 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:53.059 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:53.059 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:24:53.060 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:53.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.060 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:24:53.061 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:53.061 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:53.061 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:53.061 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:53.061 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:53.062 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:24:53.062 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:53.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.062 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:24:53.063 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:53.063 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:53.063 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:53.063 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:53.064 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:53.064 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:24:53.064 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:53.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.065 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:24:53.065 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:53.065 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:53.065 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:53.066 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:53.066 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:53.066 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:24:53.066 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:53.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.067 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:24:53.067 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:53.067 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:53.067 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:53.068 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:53.068 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:53.068 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:24:53.068 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:53.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:53.069 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:24:53.069 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:24:53.069 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:24:53.070 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:24:53.070 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:24:53.070 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:24:53.070 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:24:53.070 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:24:53.071 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.071 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:24:53.071 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:24:53.071 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:24:53.071 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:24:53.072 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:24:53.072 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:24:53.072 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6835/3232971526": "2021-10-21T23:24:46.305568+0000", 2021-10-20T23:24:53.072 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6834/3232971526": "2021-10-21T23:24:46.305568+0000" 2021-10-20T23:24:53.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.073 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:24:53.073 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:24:53.073 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:24:53.073 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:24:53.073 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:24:53.074 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:24:53.074 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:24:53.074 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:24:53.074 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:24:53.075 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:24:53.075 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:24:53.075 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:24:53.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.075 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:24:53.076 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:24:53.076 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:24:53.076 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:24:53.076 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:24:53.076 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:24:53.077 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:24:53.077 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:53.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:53.077 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:24:53.077 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:24:53.078 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:24:53.078 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:24:53.078 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:24:53.078 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:24:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19080536a0 msgr2=0x7f1908055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19080536a0 0x7f1908055b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f191800b000 tx=0x7f19180091d0).stop 2021-10-20T23:24:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 msgr2=0x7f19280b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 0x7f19280b4470 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f191c00c000 tx=0x7f191c006df0).stop 2021-10-20T23:24:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 shutdown_connections 2021-10-20T23:24:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19080536a0 0x7f1908055b60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19280b2580 0x7f1928141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19280b0010 0x7f192814cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 --2- 172.21.15.12:0/4084004368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19280afbd0 0x7f19280b4470 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 >> 172.21.15.12:0/4084004368 conn(0x7f1928060180 msgr2=0x7f1928144ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:53.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 shutdown_connections 2021-10-20T23:24:53.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:52.867+0000 7f192df26700 1 -- 172.21.15.12:0/4084004368 wait complete. 2021-10-20T23:24:53.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:24:53.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.191+0000 7fb168d80700 1 Processor -- start 2021-10-20T23:24:53.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.191+0000 7fb168d80700 1 -- start start 2021-10-20T23:24:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1640b25a0 0x7fb164066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb164066a10 0x7fb16414d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb164065330 con 0x7fb1640b3000 2021-10-20T23:24:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb164062000 con 0x7fb164066a10 2021-10-20T23:24:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1640b33e0 con 0x7fb1640b25a0 2021-10-20T23:24:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb163fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb164066a10 0x7fb16414d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb1637fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb1640b3000 0x7fb164060b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38570/0 (socket says 172.21.15.12:38570) 2021-10-20T23:24:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb1637fe700 1 -- 172.21.15.12:0/3438002046 learned_addr learned my addr 172.21.15.12:0/3438002046 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb162ffd700 1 --2- 172.21.15.12:0/3438002046 >> v2:172.21.15.31:3300/0 conn(0x7fb1640b25a0 0x7fb164066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb163fff700 1 -- 172.21.15.12:0/3438002046 >> v2:172.21.15.31:3300/0 conn(0x7fb1640b25a0 msgr2=0x7fb164066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb163fff700 1 --2- 172.21.15.12:0/3438002046 >> v2:172.21.15.31:3300/0 conn(0x7fb1640b25a0 0x7fb164066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb163fff700 1 -- 172.21.15.12:0/3438002046 >> v1:172.21.15.12:6789/0 conn(0x7fb1640b3000 legacy=0x7fb164060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb163fff700 1 -- 172.21.15.12:0/3438002046 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16405fa60 con 0x7fb164066a10 2021-10-20T23:24:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb163fff700 1 --2- 172.21.15.12:0/3438002046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb164066a10 0x7fb16414d920 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fb15c0032f0 tx=0x7fb15c0091d0).ready entity=mon.0 client_cookie=85e0628205475472 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb1627fc700 1 -- 172.21.15.12:0/3438002046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb15c00b680 con 0x7fb164066a10 2021-10-20T23:24:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb1627fc700 1 -- 172.21.15.12:0/3438002046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c00b7e0 con 0x7fb164066a10 2021-10-20T23:24:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb1627fc700 1 -- 172.21.15.12:0/3438002046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb15c00b950 con 0x7fb164066a10 2021-10-20T23:24:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 -- 172.21.15.12:0/3438002046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb164066a10 msgr2=0x7fb16414d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 --2- 172.21.15.12:0/3438002046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb164066a10 0x7fb16414d920 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fb15c0032f0 tx=0x7fb15c0091d0).stop 2021-10-20T23:24:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 -- 172.21.15.12:0/3438002046 shutdown_connections 2021-10-20T23:24:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 --2- 172.21.15.12:0/3438002046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb164066a10 0x7fb16414d920 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 --2- 172.21.15.12:0/3438002046 >> v2:172.21.15.31:3300/0 conn(0x7fb1640b25a0 0x7fb164066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 -- 172.21.15.12:0/3438002046 >> 172.21.15.12:0/3438002046 conn(0x7fb1640636e0 msgr2=0x7fb164063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 -- 172.21.15.12:0/3438002046 shutdown_connections 2021-10-20T23:24:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.195+0000 7fb168d80700 1 -- 172.21.15.12:0/3438002046 wait complete. 2021-10-20T23:24:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 Processor -- start 2021-10-20T23:24:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 -- start start 2021-10-20T23:24:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb164066a10 0x7fb164156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640b25a0 0x7fb16414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1640b3000 0x7fb1640b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16413e850 con 0x7fb1640b25a0 2021-10-20T23:24:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164152230 con 0x7fb164066a10 2021-10-20T23:24:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb164156680 con 0x7fb1640b3000 2021-10-20T23:24:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb162ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640b25a0 0x7fb16414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb162ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640b25a0 0x7fb16414a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39984/0 (socket says 172.21.15.12:39984) 2021-10-20T23:24:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb162ffd700 1 -- 172.21.15.12:0/2402948789 learned_addr learned my addr 172.21.15.12:0/2402948789 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb1637fe700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb164066a10 0x7fb164156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb163fff700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1640b3000 0x7fb1640b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb162ffd700 1 -- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1640b3000 msgr2=0x7fb1640b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb162ffd700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1640b3000 0x7fb1640b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb162ffd700 1 -- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb164066a10 msgr2=0x7fb164156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb162ffd700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb164066a10 0x7fb164156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb162ffd700 1 -- 172.21.15.12:0/2402948789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c009470 con 0x7fb1640b25a0 2021-10-20T23:24:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb162ffd700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640b25a0 0x7fb16414a090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fb15800c000 tx=0x7fb158006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb160ff9700 1 -- 172.21.15.12:0/2402948789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb158010780 con 0x7fb1640b25a0 2021-10-20T23:24:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb160ff9700 1 -- 172.21.15.12:0/2402948789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1580108e0 con 0x7fb1640b25a0 2021-10-20T23:24:53.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1640b5b30 con 0x7fb1640b25a0 2021-10-20T23:24:53.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb160ff9700 1 -- 172.21.15.12:0/2402948789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb158010c40 con 0x7fb1640b25a0 2021-10-20T23:24:53.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.199+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1640a4070 con 0x7fb1640b25a0 2021-10-20T23:24:53.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.203+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16405fd00 con 0x7fb1640b25a0 2021-10-20T23:24:53.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.203+0000 7fb160ff9700 1 -- 172.21.15.12:0/2402948789 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb15801c460 con 0x7fb1640b25a0 2021-10-20T23:24:53.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.203+0000 7fb160ff9700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1440536a0 0x7fb144055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.203+0000 7fb160ff9700 1 -- 172.21.15.12:0/2402948789 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb15806bc10 con 0x7fb1640b25a0 2021-10-20T23:24:53.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.203+0000 7fb1637fe700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1440536a0 0x7fb144055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.203+0000 7fb1637fe700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1440536a0 0x7fb144055b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fb15400d000 tx=0x7fb154000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.211+0000 7fb160ff9700 1 -- 172.21.15.12:0/2402948789 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb158042df0 con 0x7fb1640b25a0 2021-10-20T23:24:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.375+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb164057350 con 0x7fb1640b25a0 2021-10-20T23:24:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.375+0000 7fb160ff9700 1 -- 172.21.15.12:0/2402948789 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1559 (secure 0 0 0) 0x7fb158046410 con 0x7fb1640b25a0 2021-10-20T23:24:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:53.381 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23},{"gid":5829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2823655313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2823655313},{"type":"v1","addr":"172.21.15.12:6835","nonce":2823655313}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[]} 2021-10-20T23:24:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1440536a0 msgr2=0x7fb144055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1440536a0 0x7fb144055b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fb15400d000 tx=0x7fb154000bc0).stop 2021-10-20T23:24:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640b25a0 msgr2=0x7fb16414a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640b25a0 0x7fb16414a090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fb15800c000 tx=0x7fb158006df0).stop 2021-10-20T23:24:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 shutdown_connections 2021-10-20T23:24:53.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1440536a0 0x7fb144055b60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1640b3000 0x7fb1640b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640b25a0 0x7fb16414a090 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 --2- 172.21.15.12:0/2402948789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb164066a10 0x7fb164156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 >> 172.21.15.12:0/2402948789 conn(0x7fb1640636e0 msgr2=0x7fb164147660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:53.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 shutdown_connections 2021-10-20T23:24:53.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.379+0000 7fb168d80700 1 -- 172.21.15.12:0/2402948789 wait complete. 2021-10-20T23:24:53.389 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2021-10-20T23:24:53.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:24:53.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.491+0000 7f1a2ffff700 1 Processor -- start 2021-10-20T23:24:53.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.491+0000 7f1a2ffff700 1 -- start start 2021-10-20T23:24:53.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a300b2600 0x7f1a3005c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a300b1e20 0x7f1a301436e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a30147020 con 0x7f1a30143bd0 2021-10-20T23:24:53.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a300ad440 con 0x7f1a300b1e20 2021-10-20T23:24:53.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a30143fb0 con 0x7f1a300b2600 2021-10-20T23:24:53.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a27fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a300b1e20 0x7f1a301436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a27fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a300b1e20 0x7f1a301436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39990/0 (socket says 172.21.15.12:39990) 2021-10-20T23:24:53.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a27fff700 1 -- 172.21.15.12:0/3337965494 learned_addr learned my addr 172.21.15.12:0/3337965494 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:53.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2effd700 1 --2- 172.21.15.12:0/3337965494 >> v2:172.21.15.31:3300/0 conn(0x7f1a300b2600 0x7f1a3005c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a27fff700 1 -- 172.21.15.12:0/3337965494 >> v2:172.21.15.31:3300/0 conn(0x7f1a300b2600 msgr2=0x7f1a3005c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:53.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a27fff700 1 --2- 172.21.15.12:0/3337965494 >> v2:172.21.15.31:3300/0 conn(0x7f1a300b2600 0x7f1a3005c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a27fff700 1 -- 172.21.15.12:0/3337965494 >> v1:172.21.15.12:6789/0 conn(0x7f1a30143bd0 legacy=0x7f1a3013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a27fff700 1 -- 172.21.15.12:0/3337965494 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a301472c0 con 0x7f1a300b1e20 2021-10-20T23:24:53.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a27fff700 1 --2- 172.21.15.12:0/3337965494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b1e20 0x7f1a301436e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f1a18002f70 tx=0x7f1a18006eb0).ready entity=mon.0 client_cookie=bb9f9111e35ef2d9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:53.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2e7fc700 1 -- 172.21.15.12:0/3337965494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1800d610 con 0x7f1a300b1e20 2021-10-20T23:24:53.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2e7fc700 1 -- 172.21.15.12:0/3337965494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a18000e90 con 0x7f1a300b1e20 2021-10-20T23:24:53.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2e7fc700 1 -- 172.21.15.12:0/3337965494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1800d9a0 con 0x7f1a300b1e20 2021-10-20T23:24:53.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 -- 172.21.15.12:0/3337965494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b1e20 msgr2=0x7f1a301436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 --2- 172.21.15.12:0/3337965494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b1e20 0x7f1a301436e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f1a18002f70 tx=0x7f1a18006eb0).stop 2021-10-20T23:24:53.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 -- 172.21.15.12:0/3337965494 shutdown_connections 2021-10-20T23:24:53.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 --2- 172.21.15.12:0/3337965494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b1e20 0x7f1a301436e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 --2- 172.21.15.12:0/3337965494 >> v2:172.21.15.31:3300/0 conn(0x7f1a300b2600 0x7f1a3005c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 -- 172.21.15.12:0/3337965494 >> 172.21.15.12:0/3337965494 conn(0x7f1a300611d0 msgr2=0x7f1a30062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:53.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 -- 172.21.15.12:0/3337965494 shutdown_connections 2021-10-20T23:24:53.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 -- 172.21.15.12:0/3337965494 wait complete. 2021-10-20T23:24:53.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 Processor -- start 2021-10-20T23:24:53.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.495+0000 7f1a2ffff700 1 -- start start 2021-10-20T23:24:53.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a300b1e20 0x7f1a30152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b2600 0x7f1a300a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a30143bd0 0x7f1a30155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a300ab870 con 0x7f1a300b2600 2021-10-20T23:24:53.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a300abb10 con 0x7f1a300b1e20 2021-10-20T23:24:53.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a300abdb0 con 0x7f1a30143bd0 2021-10-20T23:24:53.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a27fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b2600 0x7f1a300a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a27fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b2600 0x7f1a300a9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40000/0 (socket says 172.21.15.12:40000) 2021-10-20T23:24:53.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a27fff700 1 -- 172.21.15.12:0/554297114 learned_addr learned my addr 172.21.15.12:0/554297114 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:53.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2f7fe700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a30143bd0 0x7f1a30155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2effd700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a300b1e20 0x7f1a30152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a27fff700 1 -- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a30143bd0 msgr2=0x7f1a30155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a27fff700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a30143bd0 0x7f1a30155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a27fff700 1 -- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a300b1e20 msgr2=0x7f1a30152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a27fff700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a300b1e20 0x7f1a30152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a27fff700 1 -- 172.21.15.12:0/554297114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1800b1e0 con 0x7f1a300b2600 2021-10-20T23:24:53.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a27fff700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b2600 0x7f1a300a9b90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f1a18002f70 tx=0x7f1a18015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:53.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2cff9700 1 -- 172.21.15.12:0/554297114 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a18011860 con 0x7f1a300b2600 2021-10-20T23:24:53.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2cff9700 1 -- 172.21.15.12:0/554297114 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a180119c0 con 0x7f1a300b2600 2021-10-20T23:24:53.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a300ac250 con 0x7f1a300b2600 2021-10-20T23:24:53.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2cff9700 1 -- 172.21.15.12:0/554297114 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a18011d20 con 0x7f1a300b2600 2021-10-20T23:24:53.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.499+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a30146600 con 0x7f1a300b2600 2021-10-20T23:24:53.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.503+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a30142fa0 con 0x7f1a300b2600 2021-10-20T23:24:53.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.503+0000 7f1a2cff9700 1 -- 172.21.15.12:0/554297114 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a18025030 con 0x7f1a300b2600 2021-10-20T23:24:53.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.503+0000 7f1a2cff9700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a14053610 0x7f1a14055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.503+0000 7f1a2cff9700 1 -- 172.21.15.12:0/554297114 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f1a1806c850 con 0x7f1a300b2600 2021-10-20T23:24:53.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.503+0000 7f1a2effd700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a14053610 0x7f1a14055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.503+0000 7f1a2effd700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a14053610 0x7f1a14055ad0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f1a2000c000 tx=0x7f1a20008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:53.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.511+0000 7f1a2cff9700 1 -- 172.21.15.12:0/554297114 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a18043b30 con 0x7f1a300b2600 2021-10-20T23:24:53.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a30057350 con 0x7f1a300b2600 2021-10-20T23:24:53.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2cff9700 1 -- 172.21.15.12:0/554297114 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f1a18023070 con 0x7f1a300b2600 2021-10-20T23:24:53.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:53.675 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2378840268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2378840268},{"type":"v1","addr":"172.21.15.31:6835","nonce":2378840268}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/635027657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":635027657},{"type":"v1","addr":"172.21.15.12:6833","nonce":635027657}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23},{"gid":5829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2823655313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2823655313},{"type":"v1","addr":"172.21.15.12:6835","nonce":2823655313}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[]} 2021-10-20T23:24:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a14053610 msgr2=0x7f1a14055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a14053610 0x7f1a14055ad0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f1a2000c000 tx=0x7f1a20008040).stop 2021-10-20T23:24:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b2600 msgr2=0x7f1a300a9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b2600 0x7f1a300a9b90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f1a18002f70 tx=0x7f1a18015000).stop 2021-10-20T23:24:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 shutdown_connections 2021-10-20T23:24:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a14053610 0x7f1a14055ad0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a30143bd0 0x7f1a30155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a300b2600 0x7f1a300a9b90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 --2- 172.21.15.12:0/554297114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a300b1e20 0x7f1a30152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 >> 172.21.15.12:0/554297114 conn(0x7f1a300611d0 msgr2=0x7f1a301426b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 shutdown_connections 2021-10-20T23:24:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.671+0000 7f1a2ffff700 1 -- 172.21.15.12:0/554297114 wait complete. 2021-10-20T23:24:53.680 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2021-10-20T23:24:53.687 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:24:53.688 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:24:53.688 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:24:53.689 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:24:53.689 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:24:53.689 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:24:53.690 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:24:53.690 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:24:53.691 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:24:53.691 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:24:53.691 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:24:53.692 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:24:53.703 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:24:53.703 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:24:53.705 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:24:53.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:24:53.707 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:24:53.707 DEBUG:teuthology.parallel:result is None 2021-10-20T23:24:53.708 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:24:53.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:24:53.709 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:24:53.710 DEBUG:teuthology.parallel:result is None 2021-10-20T23:24:53.751 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:24:53.752 DEBUG:teuthology.parallel:result is None 2021-10-20T23:24:53.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:24:53.775 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:24:53.776 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:24:53.832 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:24:53.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.851+0000 7f9528dea700 1 Processor -- start 2021-10-20T23:24:53.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.851+0000 7f9528dea700 1 -- start start 2021-10-20T23:24:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240669d0 0x7f952413e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952405f750 con 0x7f95240b1a30 2021-10-20T23:24:53.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95240b14a0 con 0x7f95240665f0 2021-10-20T23:24:53.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952405f980 con 0x7f95240669d0 2021-10-20T23:24:53.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9522ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f95240b1a30 0x7f9524140cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38624/0 (socket says 172.21.15.12:38624) 2021-10-20T23:24:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9522ffd700 1 -- 172.21.15.12:0/3318395739 learned_addr learned my addr 172.21.15.12:0/3318395739 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f95237fe700 1 --1- 172.21.15.12:0/3318395739 >> v1:172.21.15.31:6789/0 conn(0x7f95240665f0 0x7f952405fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45686/0 (socket says 172.21.15.12:45686) 2021-10-20T23:24:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9523fff700 1 --2- 172.21.15.12:0/3318395739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240669d0 0x7f952413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f95227fc700 1 -- 172.21.15.12:0/3318395739 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861592415 0 0) 0x7f952405f750 con 0x7f95240b1a30 2021-10-20T23:24:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f95227fc700 1 -- 172.21.15.12:0/3318395739 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9504003260 con 0x7f95240b1a30 2021-10-20T23:24:53.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f95227fc700 1 -- 172.21.15.12:0/3318395739 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049310256 0 0) 0x7f95240b14a0 con 0x7f95240665f0 2021-10-20T23:24:53.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f95227fc700 1 -- 172.21.15.12:0/3318395739 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f952405f750 con 0x7f95240665f0 2021-10-20T23:24:53.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9523fff700 1 -- 172.21.15.12:0/3318395739 >> v1:172.21.15.31:6789/0 conn(0x7f95240665f0 legacy=0x7f952405fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9523fff700 1 -- 172.21.15.12:0/3318395739 >> v1:172.21.15.12:6789/0 conn(0x7f95240b1a30 legacy=0x7f9524140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9523fff700 1 -- 172.21.15.12:0/3318395739 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240b1740 con 0x7f95240669d0 2021-10-20T23:24:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9523fff700 1 --2- 172.21.15.12:0/3318395739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240669d0 0x7f952413e120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f951c0032f0 tx=0x7f951c0091d0).ready entity=mon.2 client_cookie=6ee2b5789066d851 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f95227fc700 1 -- 172.21.15.12:0/3318395739 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951c00b640 con 0x7f95240669d0 2021-10-20T23:24:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f95227fc700 1 -- 172.21.15.12:0/3318395739 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c00b7a0 con 0x7f95240669d0 2021-10-20T23:24:53.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f95227fc700 1 -- 172.21.15.12:0/3318395739 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951c00b910 con 0x7f95240669d0 2021-10-20T23:24:53.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 -- 172.21.15.12:0/3318395739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240669d0 msgr2=0x7f952413e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 --2- 172.21.15.12:0/3318395739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240669d0 0x7f952413e120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f951c0032f0 tx=0x7f951c0091d0).stop 2021-10-20T23:24:53.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 -- 172.21.15.12:0/3318395739 shutdown_connections 2021-10-20T23:24:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 --2- 172.21.15.12:0/3318395739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240669d0 0x7f952413e120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 -- 172.21.15.12:0/3318395739 >> 172.21.15.12:0/3318395739 conn(0x7f95240636e0 msgr2=0x7f9524063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 -- 172.21.15.12:0/3318395739 shutdown_connections 2021-10-20T23:24:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 -- 172.21.15.12:0/3318395739 wait complete. 2021-10-20T23:24:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 Processor -- start 2021-10-20T23:24:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.855+0000 7f9528dea700 1 -- start start 2021-10-20T23:24:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9528dea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240665f0 0x7f95240ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9528dea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95240669d0 0x7f9524153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9528dea700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95240b1a30 0x7f9524153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9528dea700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524142ae0 con 0x7f95240b1a30 2021-10-20T23:24:53.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9528dea700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95240b0790 con 0x7f95240669d0 2021-10-20T23:24:53.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9528dea700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9524142840 con 0x7f95240665f0 2021-10-20T23:24:53.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9523fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95240b1a30 0x7f9524153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9522ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95240669d0 0x7f9524153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9523fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95240b1a30 0x7f9524153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40038/0 (socket says 172.21.15.12:40038) 2021-10-20T23:24:53.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f95237fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240665f0 0x7f95240ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9523fff700 1 -- 172.21.15.12:0/4099636519 learned_addr learned my addr 172.21.15.12:0/4099636519 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:53.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9523fff700 1 -- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240665f0 msgr2=0x7f95240ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9523fff700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240665f0 0x7f95240ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9523fff700 1 -- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95240669d0 msgr2=0x7f9524153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:53.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9523fff700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95240669d0 0x7f9524153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:53.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9523fff700 1 -- 172.21.15.12:0/4099636519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c009470 con 0x7f95240b1a30 2021-10-20T23:24:53.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9522ffd700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95240669d0 0x7f9524153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:53.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9523fff700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95240b1a30 0x7f9524153a60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f951c0032f0 tx=0x7f951c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:53.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9520ff9700 1 -- 172.21.15.12:0/4099636519 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951c00b910 con 0x7f95240b1a30 2021-10-20T23:24:53.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9520ff9700 1 -- 172.21.15.12:0/4099636519 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c01f3f0 con 0x7f95240b1a30 2021-10-20T23:24:53.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95240b04f0 con 0x7f95240b1a30 2021-10-20T23:24:53.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9520ff9700 1 -- 172.21.15.12:0/4099636519 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951c00b640 con 0x7f95240b1a30 2021-10-20T23:24:53.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952414dbd0 con 0x7f95240b1a30 2021-10-20T23:24:53.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9524150d30 con 0x7f95240b1a30 2021-10-20T23:24:53.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.859+0000 7f9520ff9700 1 -- 172.21.15.12:0/4099636519 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f951c026030 con 0x7f95240b1a30 2021-10-20T23:24:53.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.863+0000 7f9520ff9700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9508053610 0x7f9508055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:53.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.863+0000 7f9520ff9700 1 -- 172.21.15.12:0/4099636519 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f951c06c230 con 0x7f95240b1a30 2021-10-20T23:24:53.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.863+0000 7f95237fe700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9508053610 0x7f9508055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:53.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.863+0000 7f95237fe700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9508053610 0x7f9508055ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f951400d000 tx=0x7f9514007a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:53.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:53.867+0000 7f9520ff9700 1 -- 172.21.15.12:0/4099636519 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9524150d30 con 0x7f95240b1a30 2021-10-20T23:24:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.011+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9524150d30 con 0x7f95240b1a30 2021-10-20T23:24:54.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.859+0000 7f9520ff9700 1 -- 172.21.15.12:0/4099636519 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9524150d30 con 0x7f95240b1a30 2021-10-20T23:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9508053610 msgr2=0x7f9508055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9508053610 0x7f9508055ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f951400d000 tx=0x7f9514007a10).stop 2021-10-20T23:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95240b1a30 msgr2=0x7f9524153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95240b1a30 0x7f9524153a60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f951c0032f0 tx=0x7f951c016000).stop 2021-10-20T23:24:54.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 shutdown_connections 2021-10-20T23:24:54.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9508053610 0x7f9508055ad0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:54.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95240b1a30 0x7f9524153a60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:54.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95240669d0 0x7f9524153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:54.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 --2- 172.21.15.12:0/4099636519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95240665f0 0x7f95240ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:54.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 >> 172.21.15.12:0/4099636519 conn(0x7f95240636e0 msgr2=0x7f952413d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:54.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 shutdown_connections 2021-10-20T23:24:54.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:54.863+0000 7f9528dea700 1 -- 172.21.15.12:0/4099636519 wait complete. 2021-10-20T23:24:54.871 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:24:54.886 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:24:54.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:24:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.035+0000 7f5cb0011700 1 Processor -- start 2021-10-20T23:24:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.035+0000 7f5cb0011700 1 -- start start 2021-10-20T23:24:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ca80af780 0x7f5ca8143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80a9f40 0x7f5ca8140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca80b3880 con 0x7f5ca80b34a0 2021-10-20T23:24:55.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca8144260 con 0x7f5ca80af780 2021-10-20T23:24:55.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81469b0 con 0x7f5ca80a9f40 2021-10-20T23:24:55.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cae5ae700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80a9f40 0x7f5ca8140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cad5ac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ca80af780 0x7f5ca8143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cad5ac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ca80af780 0x7f5ca8143d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:55018/0 (socket says 172.21.15.12:55018) 2021-10-20T23:24:55.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cad5ac700 1 -- 172.21.15.12:0/4164420173 learned_addr learned my addr 172.21.15.12:0/4164420173 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:55.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cae5ae700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80a9f40 0x7f5ca8140110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45806/0 (socket says 172.21.15.12:45806) 2021-10-20T23:24:55.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5caddad700 1 --1- 172.21.15.12:0/4164420173 >> v1:172.21.15.31:6789/0 conn(0x7f5ca80b34a0 0x7f5ca80af070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45702/0 (socket says 172.21.15.12:45702) 2021-10-20T23:24:55.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cad5ac700 1 -- 172.21.15.12:0/4164420173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80a9f40 msgr2=0x7f5ca8140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:55.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cad5ac700 1 --2- 172.21.15.12:0/4164420173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80a9f40 0x7f5ca8140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cad5ac700 1 -- 172.21.15.12:0/4164420173 >> v1:172.21.15.31:6789/0 conn(0x7f5ca80b34a0 legacy=0x7f5ca80af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cad5ac700 1 -- 172.21.15.12:0/4164420173 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca8146c50 con 0x7f5ca80af780 2021-10-20T23:24:55.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cae5ae700 1 --2- 172.21.15.12:0/4164420173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80a9f40 0x7f5ca8140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:55.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cad5ac700 1 --2- 172.21.15.12:0/4164420173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca80af780 0x7f5ca8143d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f5c98002f70 tx=0x7f5c98006eb0).ready entity=mon.1 client_cookie=f3b0c255e48dfaf6 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cacdab700 1 -- 172.21.15.12:0/4164420173 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9800d570 con 0x7f5ca80af780 2021-10-20T23:24:55.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cacdab700 1 -- 172.21.15.12:0/4164420173 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c98000e90 con 0x7f5ca80af780 2021-10-20T23:24:55.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cacdab700 1 -- 172.21.15.12:0/4164420173 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9800d900 con 0x7f5ca80af780 2021-10-20T23:24:55.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 -- 172.21.15.12:0/4164420173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca80af780 msgr2=0x7f5ca8143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 --2- 172.21.15.12:0/4164420173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca80af780 0x7f5ca8143d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f5c98002f70 tx=0x7f5c98006eb0).stop 2021-10-20T23:24:55.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 -- 172.21.15.12:0/4164420173 shutdown_connections 2021-10-20T23:24:55.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 --2- 172.21.15.12:0/4164420173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80a9f40 0x7f5ca8140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 --2- 172.21.15.12:0/4164420173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca80af780 0x7f5ca8143d70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 -- 172.21.15.12:0/4164420173 >> 172.21.15.12:0/4164420173 conn(0x7f5ca80607c0 msgr2=0x7f5ca8060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:55.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 -- 172.21.15.12:0/4164420173 shutdown_connections 2021-10-20T23:24:55.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.039+0000 7f5cb0011700 1 -- 172.21.15.12:0/4164420173 wait complete. 2021-10-20T23:24:55.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 Processor -- start 2021-10-20T23:24:55.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 -- start start 2021-10-20T23:24:55.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca80a9f40 0x7f5ca81404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80af780 0x7f5ca81560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca80b34a0 0x7f5ca81416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81565d0 con 0x7f5ca80b34a0 2021-10-20T23:24:55.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8156860 con 0x7f5ca80a9f40 2021-10-20T23:24:55.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8156b00 con 0x7f5ca80af780 2021-10-20T23:24:55.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cae5ae700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca80b34a0 0x7f5ca81416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cae5ae700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca80b34a0 0x7f5ca81416d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40054/0 (socket says 172.21.15.12:40054) 2021-10-20T23:24:55.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cae5ae700 1 -- 172.21.15.12:0/2761500244 learned_addr learned my addr 172.21.15.12:0/2761500244 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:55.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5caddad700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca80a9f40 0x7f5ca81404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cad5ac700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80af780 0x7f5ca81560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cae5ae700 1 -- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80af780 msgr2=0x7f5ca81560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cae5ae700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80af780 0x7f5ca81560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cae5ae700 1 -- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca80a9f40 msgr2=0x7f5ca81404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cae5ae700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca80a9f40 0x7f5ca81404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cae5ae700 1 -- 172.21.15.12:0/2761500244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0009470 con 0x7f5ca80b34a0 2021-10-20T23:24:55.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cae5ae700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca80b34a0 0x7f5ca81416d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f5ca000c000 tx=0x7f5ca00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5c96ffd700 1 -- 172.21.15.12:0/2761500244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca000ee60 con 0x7f5ca80b34a0 2021-10-20T23:24:55.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5c96ffd700 1 -- 172.21.15.12:0/2761500244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca000c850 con 0x7f5ca80b34a0 2021-10-20T23:24:55.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9800b1e0 con 0x7f5ca80b34a0 2021-10-20T23:24:55.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5c96ffd700 1 -- 172.21.15.12:0/2761500244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca000cbb0 con 0x7f5ca80b34a0 2021-10-20T23:24:55.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.043+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca80b1aa0 con 0x7f5ca80b34a0 2021-10-20T23:24:55.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.047+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca8142b00 con 0x7f5ca80b34a0 2021-10-20T23:24:55.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.047+0000 7f5c96ffd700 1 -- 172.21.15.12:0/2761500244 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ca0022070 con 0x7f5ca80b34a0 2021-10-20T23:24:55.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.047+0000 7f5c96ffd700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c880536d0 0x7f5c88055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.047+0000 7f5c96ffd700 1 -- 172.21.15.12:0/2761500244 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f5ca006bdf0 con 0x7f5ca80b34a0 2021-10-20T23:24:55.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.047+0000 7f5caddad700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c880536d0 0x7f5c88055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.047+0000 7f5caddad700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c880536d0 0x7f5c88055b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f5ca400d000 tx=0x7f5ca4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.055+0000 7f5c96ffd700 1 -- 172.21.15.12:0/2761500244 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ca8142b00 con 0x7f5ca80b34a0 2021-10-20T23:24:55.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.231+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5ca8142b00 con 0x7f5ca80b34a0 2021-10-20T23:24:55.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.231+0000 7f5c96ffd700 1 -- 172.21.15.12:0/2761500244 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f5ca8142b00 con 0x7f5ca80b34a0 2021-10-20T23:24:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:55.237 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:24:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:24:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:24:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:24:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:24:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:24:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:24:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:24:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:24:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:24:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:24:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:24:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:24:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:24:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:24:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:24:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:24:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:24:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:24:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:24:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:24:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:24:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:24:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:24:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:24:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:24:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:24:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:24:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:24:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:24:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:24:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:24:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:24:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:24:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:24:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:24:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:24:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:24:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:24:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:24:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:24:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:24:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:24:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:24:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:24:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:24:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:24:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:24:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:24:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:24:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:24:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:24:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:24:55.274 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:24:55.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c880536d0 msgr2=0x7f5c88055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c880536d0 0x7f5c88055b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f5ca400d000 tx=0x7f5ca4009040).stop 2021-10-20T23:24:55.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca80b34a0 msgr2=0x7f5ca81416d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca80b34a0 0x7f5ca81416d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f5ca000c000 tx=0x7f5ca00091d0).stop 2021-10-20T23:24:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 shutdown_connections 2021-10-20T23:24:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c880536d0 0x7f5c88055b90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca80b34a0 0x7f5ca81416d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca80af780 0x7f5ca81560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 --2- 172.21.15.12:0/2761500244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca80a9f40 0x7f5ca81404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 >> 172.21.15.12:0/2761500244 conn(0x7f5ca80607c0 msgr2=0x7f5ca80b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 shutdown_connections 2021-10-20T23:24:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.235+0000 7f5cb0011700 1 -- 172.21.15.12:0/2761500244 wait complete. 2021-10-20T23:24:55.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:24:55.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.379+0000 7feac94ba700 1 Processor -- start 2021-10-20T23:24:55.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.379+0000 7feac94ba700 1 -- start start 2021-10-20T23:24:55.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feac40af3c0 0x7feac40b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feac40601a0 0x7feac4144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac4144940 0x7feac40a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac40b1450 con 0x7feac40af3c0 2021-10-20T23:24:55.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac40aa4a0 con 0x7feac40601a0 2021-10-20T23:24:55.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac405f6b0 con 0x7feac4144940 2021-10-20T23:24:55.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feac40af3c0 0x7feac40b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feac40af3c0 0x7feac40b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40058/0 (socket says 172.21.15.12:40058) 2021-10-20T23:24:55.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac3fff700 1 -- 172.21.15.12:0/2933230512 learned_addr learned my addr 172.21.15.12:0/2933230512 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:55.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac8cb9700 1 --2- 172.21.15.12:0/2933230512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac4144940 0x7feac40a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feabb7fe700 1 --2- 172.21.15.12:0/2933230512 >> v2:172.21.15.31:3300/0 conn(0x7feac40601a0 0x7feac4144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac3fff700 1 -- 172.21.15.12:0/2933230512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac4144940 msgr2=0x7feac40a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac3fff700 1 --2- 172.21.15.12:0/2933230512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac4144940 0x7feac40a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac3fff700 1 -- 172.21.15.12:0/2933230512 >> v2:172.21.15.31:3300/0 conn(0x7feac40601a0 msgr2=0x7feac4144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac3fff700 1 --2- 172.21.15.12:0/2933230512 >> v2:172.21.15.31:3300/0 conn(0x7feac40601a0 0x7feac4144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac3fff700 1 -- 172.21.15.12:0/2933230512 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac405fb80 con 0x7feac40af3c0 2021-10-20T23:24:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac8cb9700 1 --2- 172.21.15.12:0/2933230512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac4144940 0x7feac40a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:24:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac3fff700 1 --2- 172.21.15.12:0/2933230512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac40af3c0 0x7feac40b0cb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7feab4002f70 tx=0x7feab4006eb0).ready entity=mon.0 client_cookie=5b8728589ebb29c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac37fe700 1 -- 172.21.15.12:0/2933230512 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feab400d570 con 0x7feac40af3c0 2021-10-20T23:24:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac37fe700 1 -- 172.21.15.12:0/2933230512 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab4000e90 con 0x7feac40af3c0 2021-10-20T23:24:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac37fe700 1 -- 172.21.15.12:0/2933230512 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feab400d900 con 0x7feac40af3c0 2021-10-20T23:24:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 -- 172.21.15.12:0/2933230512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac40af3c0 msgr2=0x7feac40b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 --2- 172.21.15.12:0/2933230512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac40af3c0 0x7feac40b0cb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7feab4002f70 tx=0x7feab4006eb0).stop 2021-10-20T23:24:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 -- 172.21.15.12:0/2933230512 shutdown_connections 2021-10-20T23:24:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 --2- 172.21.15.12:0/2933230512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac4144940 0x7feac40a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 --2- 172.21.15.12:0/2933230512 >> v2:172.21.15.31:3300/0 conn(0x7feac40601a0 0x7feac4144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 --2- 172.21.15.12:0/2933230512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac40af3c0 0x7feac40b0cb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 -- 172.21.15.12:0/2933230512 >> 172.21.15.12:0/2933230512 conn(0x7feac4061140 msgr2=0x7feac4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 -- 172.21.15.12:0/2933230512 shutdown_connections 2021-10-20T23:24:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.383+0000 7feac94ba700 1 -- 172.21.15.12:0/2933230512 wait complete. 2021-10-20T23:24:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac94ba700 1 Processor -- start 2021-10-20T23:24:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac94ba700 1 -- start start 2021-10-20T23:24:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac94ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac40601a0 0x7feac4150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac94ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac40af3c0 0x7feac4143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac94ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac4144940 0x7feac4153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac94ba700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac409f650 con 0x7feac4144940 2021-10-20T23:24:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac94ba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac40659b0 con 0x7feac40af3c0 2021-10-20T23:24:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac94ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac414fcb0 con 0x7feac40601a0 2021-10-20T23:24:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac8cb9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac4144940 0x7feac4153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac8cb9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac4144940 0x7feac4153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40068/0 (socket says 172.21.15.12:40068) 2021-10-20T23:24:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac8cb9700 1 -- 172.21.15.12:0/1724053611 learned_addr learned my addr 172.21.15.12:0/1724053611 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac3fff700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac40601a0 0x7feac4150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feabb7fe700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac40af3c0 0x7feac4143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac8cb9700 1 -- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac40601a0 msgr2=0x7feac4150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac8cb9700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac40601a0 0x7feac4150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac8cb9700 1 -- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac40af3c0 msgr2=0x7feac4143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.387+0000 7feac8cb9700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac40af3c0 0x7feac4143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac8cb9700 1 -- 172.21.15.12:0/1724053611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab400b1e0 con 0x7feac4144940 2021-10-20T23:24:55.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac3fff700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac40601a0 0x7feac4150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:24:55.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac8cb9700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac4144940 0x7feac4153280 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7feabc006cc0 tx=0x7feabc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac1ffb700 1 -- 172.21.15.12:0/1724053611 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feabc013620 con 0x7feac4144940 2021-10-20T23:24:55.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac1ffb700 1 -- 172.21.15.12:0/1724053611 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc013780 con 0x7feac4144940 2021-10-20T23:24:55.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac414ffb0 con 0x7feac4144940 2021-10-20T23:24:55.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac1ffb700 1 -- 172.21.15.12:0/1724053611 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feabc013ae0 con 0x7feac4144940 2021-10-20T23:24:55.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac4143660 con 0x7feac4144940 2021-10-20T23:24:55.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac4057350 con 0x7feac4144940 2021-10-20T23:24:55.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.391+0000 7feac1ffb700 1 -- 172.21.15.12:0/1724053611 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feabc013c40 con 0x7feac4144940 2021-10-20T23:24:55.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.395+0000 7feac1ffb700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaa8053520 0x7feaa80559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.395+0000 7feac1ffb700 1 -- 172.21.15.12:0/1724053611 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5600+0+0 (secure 0 0 0) 0x7feabc06b810 con 0x7feac4144940 2021-10-20T23:24:55.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.395+0000 7feac3fff700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaa8053520 0x7feaa80559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.395+0000 7feac3fff700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaa8053520 0x7feaa80559e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7feab401a000 tx=0x7feab4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.399+0000 7feac1ffb700 1 -- 172.21.15.12:0/1724053611 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feabc042af0 con 0x7feac4144940 2021-10-20T23:24:55.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.527+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feac40698e0 con 0x7feac4144940 2021-10-20T23:24:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac1ffb700 1 -- 172.21.15.12:0/1724053611 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+13415 (secure 0 0 0) 0x7feabc046110 con 0x7feac4144940 2021-10-20T23:24:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:55.533 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":64,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:24:54.849926+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:24:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaa8053520 msgr2=0x7feaa80559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaa8053520 0x7feaa80559e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7feab401a000 tx=0x7feab4015000).stop 2021-10-20T23:24:55.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac4144940 msgr2=0x7feac4153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac4144940 0x7feac4153280 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7feabc006cc0 tx=0x7feabc008040).stop 2021-10-20T23:24:55.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 shutdown_connections 2021-10-20T23:24:55.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaa8053520 0x7feaa80559e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac4144940 0x7feac4153280 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac40af3c0 0x7feac4143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 --2- 172.21.15.12:0/1724053611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac40601a0 0x7feac4150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 >> 172.21.15.12:0/1724053611 conn(0x7feac4061140 msgr2=0x7feac40b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 shutdown_connections 2021-10-20T23:24:55.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.531+0000 7feac94ba700 1 -- 172.21.15.12:0/1724053611 wait complete. 2021-10-20T23:24:55.547 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:24:55.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:24:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.655+0000 7f3342e0b700 1 Processor -- start 2021-10-20T23:24:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.655+0000 7f3342e0b700 1 -- start start 2021-10-20T23:24:55.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3342e0b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f333c0a9190 0x7f333c146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3342e0b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3342e0b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c0b1140 con 0x7f333c0b03d0 2021-10-20T23:24:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3342e0b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0a9570 con 0x7f333c0a9190 2021-10-20T23:24:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3342e0b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0b1370 con 0x7f333c0b0b80 2021-10-20T23:24:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341608700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341e09700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f333c0a9190 0x7f333c146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341608700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45830/0 (socket says 172.21.15.12:45830) 2021-10-20T23:24:55.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f334260a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f333c0b03d0 0x7f333c1401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45734/0 (socket says 172.21.15.12:45734) 2021-10-20T23:24:55.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341608700 1 -- 172.21.15.12:0/4139989045 learned_addr learned my addr 172.21.15.12:0/4139989045 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:55.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341e09700 1 -- 172.21.15.12:0/4139989045 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 msgr2=0x7f333c146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:55.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341e09700 1 --2- 172.21.15.12:0/4139989045 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341e09700 1 -- 172.21.15.12:0/4139989045 >> v1:172.21.15.31:6789/0 conn(0x7f333c0b03d0 legacy=0x7f333c1401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341e09700 1 -- 172.21.15.12:0/4139989045 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0b1610 con 0x7f333c0a9190 2021-10-20T23:24:55.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341608700 1 --2- 172.21.15.12:0/4139989045 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:55.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3341e09700 1 --2- 172.21.15.12:0/4139989045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c0a9190 0x7f333c146550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f3338002f70 tx=0x7f3338006df0).ready entity=mon.1 client_cookie=deab64ad92139931 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3340e07700 1 -- 172.21.15.12:0/4139989045 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f333800d570 con 0x7f333c0a9190 2021-10-20T23:24:55.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3340e07700 1 -- 172.21.15.12:0/4139989045 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338000e90 con 0x7f333c0a9190 2021-10-20T23:24:55.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.659+0000 7f3340e07700 1 -- 172.21.15.12:0/4139989045 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f333800d8c0 con 0x7f333c0a9190 2021-10-20T23:24:55.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 -- 172.21.15.12:0/4139989045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c0a9190 msgr2=0x7f333c146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 --2- 172.21.15.12:0/4139989045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c0a9190 0x7f333c146550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f3338002f70 tx=0x7f3338006df0).stop 2021-10-20T23:24:55.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 -- 172.21.15.12:0/4139989045 shutdown_connections 2021-10-20T23:24:55.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 --2- 172.21.15.12:0/4139989045 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 --2- 172.21.15.12:0/4139989045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c0a9190 0x7f333c146550 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 -- 172.21.15.12:0/4139989045 >> 172.21.15.12:0/4139989045 conn(0x7f333c061140 msgr2=0x7f333c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:55.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 -- 172.21.15.12:0/4139989045 shutdown_connections 2021-10-20T23:24:55.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 -- 172.21.15.12:0/4139989045 wait complete. 2021-10-20T23:24:55.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 Processor -- start 2021-10-20T23:24:55.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.663+0000 7f3342e0b700 1 -- start start 2021-10-20T23:24:55.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3342e0b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c0a9190 0x7f333c0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3342e0b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c0b03d0 0x7f333c0aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3342e0b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3342e0b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0ab830 con 0x7f333c0a9190 2021-10-20T23:24:55.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3342e0b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0aa3a0 con 0x7f333c0b03d0 2021-10-20T23:24:55.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3342e0b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0aa640 con 0x7f333c0b0b80 2021-10-20T23:24:55.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341e09700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c0a9190 0x7f333c0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341e09700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c0a9190 0x7f333c0ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40078/0 (socket says 172.21.15.12:40078) 2021-10-20T23:24:55.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341e09700 1 -- 172.21.15.12:0/4073817126 learned_addr learned my addr 172.21.15.12:0/4073817126 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:55.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341608700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c0b03d0 0x7f333c0aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f334260a700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341e09700 1 -- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 msgr2=0x7f333c154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341e09700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341e09700 1 -- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c0b03d0 msgr2=0x7f333c0aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341e09700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c0b03d0 0x7f333c0aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341e09700 1 -- 172.21.15.12:0/4073817126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c00b1e0 con 0x7f333c0a9190 2021-10-20T23:24:55.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3341e09700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c0a9190 0x7f333c0ae090 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f3338002f70 tx=0x7f3338014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f332affd700 1 -- 172.21.15.12:0/4073817126 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f333800dea0 con 0x7f333c0a9190 2021-10-20T23:24:55.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f332affd700 1 -- 172.21.15.12:0/4073817126 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338013e90 con 0x7f333c0a9190 2021-10-20T23:24:55.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333800b180 con 0x7f333c0a9190 2021-10-20T23:24:55.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f332affd700 1 -- 172.21.15.12:0/4073817126 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f333801e5f0 con 0x7f333c0a9190 2021-10-20T23:24:55.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.667+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c153d90 con 0x7f333c0a9190 2021-10-20T23:24:55.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.671+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c05cb10 con 0x7f333c0a9190 2021-10-20T23:24:55.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.671+0000 7f332affd700 1 -- 172.21.15.12:0/4073817126 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3338025030 con 0x7f333c0a9190 2021-10-20T23:24:55.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.671+0000 7f332affd700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f331c053520 0x7f331c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.671+0000 7f332affd700 1 -- 172.21.15.12:0/4073817126 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f333806c5d0 con 0x7f333c0a9190 2021-10-20T23:24:55.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.671+0000 7f3341608700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f331c053520 0x7f331c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.671+0000 7f3341608700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f331c053520 0x7f331c0559e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f332c00b000 tx=0x7f332c006eb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.675+0000 7f332affd700 1 -- 172.21.15.12:0/4073817126 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f333c05cb10 con 0x7f333c0a9190 2021-10-20T23:24:55.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.803+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f333c05cb10 con 0x7f333c0a9190 2021-10-20T23:24:55.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.803+0000 7f332affd700 1 -- 172.21.15.12:0/4073817126 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v64) v1 ==== 110+0+10 (secure 0 0 0) 0x7f333c05cb10 con 0x7f333c0a9190 2021-10-20T23:24:55.809 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:24:55.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f331c053520 msgr2=0x7f331c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f331c053520 0x7f331c0559e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f332c00b000 tx=0x7f332c006eb0).stop 2021-10-20T23:24:55.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c0a9190 msgr2=0x7f333c0ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c0a9190 0x7f333c0ae090 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f3338002f70 tx=0x7f3338014000).stop 2021-10-20T23:24:55.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 shutdown_connections 2021-10-20T23:24:55.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f331c053520 0x7f331c0559e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f333c0b0b80 0x7f333c154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c0b03d0 0x7f333c0aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 --2- 172.21.15.12:0/4073817126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c0a9190 0x7f333c0ae090 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 >> 172.21.15.12:0/4073817126 conn(0x7f333c061140 msgr2=0x7f333c146390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:55.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 shutdown_connections 2021-10-20T23:24:55.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.807+0000 7f3342e0b700 1 -- 172.21.15.12:0/4073817126 wait complete. 2021-10-20T23:24:55.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:24:55.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.931+0000 7f4c8f573700 1 Processor -- start 2021-10-20T23:24:55.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.931+0000 7f4c8f573700 1 -- start start 2021-10-20T23:24:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.931+0000 7f4c8f573700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c880b6290 0x7f4c88061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.931+0000 7f4c8f573700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b4060 0x7f4c88061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.931+0000 7f4c8f573700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c880b5f50 con 0x7f4c88061e50 2021-10-20T23:24:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.931+0000 7f4c8f573700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c880b1f70 con 0x7f4c880b6290 2021-10-20T23:24:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.931+0000 7f4c8f573700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880b2210 con 0x7f4c880b4060 2021-10-20T23:24:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8dd70700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b4060 0x7f4c88061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8e571700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c880b6290 0x7f4c88061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8ed72700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4c88061e50 0x7f4c88146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45748/0 (socket says 172.21.15.12:45748) 2021-10-20T23:24:55.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8ed72700 1 -- 172.21.15.12:0/3107914061 learned_addr learned my addr 172.21.15.12:0/3107914061 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:55.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8dd70700 1 -- 172.21.15.12:0/3107914061 >> v2:172.21.15.31:3300/0 conn(0x7f4c880b6290 msgr2=0x7f4c88061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:55.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8dd70700 1 --2- 172.21.15.12:0/3107914061 >> v2:172.21.15.31:3300/0 conn(0x7f4c880b6290 0x7f4c88061470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8dd70700 1 -- 172.21.15.12:0/3107914061 >> v1:172.21.15.31:6789/0 conn(0x7f4c88061e50 legacy=0x7f4c88146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8dd70700 1 -- 172.21.15.12:0/3107914061 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c880b24b0 con 0x7f4c880b4060 2021-10-20T23:24:55.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8dd70700 1 --2- 172.21.15.12:0/3107914061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b4060 0x7f4c88061960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f4c78002f70 tx=0x7f4c78006df0).ready entity=mon.2 client_cookie=e66058a36538c68f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8d56f700 1 -- 172.21.15.12:0/3107914061 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7800d570 con 0x7f4c880b4060 2021-10-20T23:24:55.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8d56f700 1 -- 172.21.15.12:0/3107914061 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c78000e90 con 0x7f4c880b4060 2021-10-20T23:24:55.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8d56f700 1 -- 172.21.15.12:0/3107914061 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7800d8c0 con 0x7f4c880b4060 2021-10-20T23:24:55.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8f573700 1 -- 172.21.15.12:0/3107914061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b4060 msgr2=0x7f4c88061960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8f573700 1 --2- 172.21.15.12:0/3107914061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b4060 0x7f4c88061960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f4c78002f70 tx=0x7f4c78006df0).stop 2021-10-20T23:24:55.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8f573700 1 -- 172.21.15.12:0/3107914061 shutdown_connections 2021-10-20T23:24:55.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8f573700 1 --2- 172.21.15.12:0/3107914061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b4060 0x7f4c88061960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8f573700 1 --2- 172.21.15.12:0/3107914061 >> v2:172.21.15.31:3300/0 conn(0x7f4c880b6290 0x7f4c88061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8f573700 1 -- 172.21.15.12:0/3107914061 >> 172.21.15.12:0/3107914061 conn(0x7f4c8805c490 msgr2=0x7f4c8805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:55.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8f573700 1 -- 172.21.15.12:0/3107914061 shutdown_connections 2021-10-20T23:24:55.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.935+0000 7f4c8f573700 1 -- 172.21.15.12:0/3107914061 wait complete. 2021-10-20T23:24:55.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 Processor -- start 2021-10-20T23:24:55.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 -- start start 2021-10-20T23:24:55.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c88061e50 0x7f4c880b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c880b4060 0x7f4c88155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b6290 0x7f4c88156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881525f0 con 0x7f4c880b4060 2021-10-20T23:24:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881422a0 con 0x7f4c88061e50 2021-10-20T23:24:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c88142540 con 0x7f4c880b6290 2021-10-20T23:24:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8dd70700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c880b4060 0x7f4c88155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8e571700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c88061e50 0x7f4c880b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8dd70700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c880b4060 0x7f4c88155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40094/0 (socket says 172.21.15.12:40094) 2021-10-20T23:24:55.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8dd70700 1 -- 172.21.15.12:0/1847535878 learned_addr learned my addr 172.21.15.12:0/1847535878 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:55.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8ed72700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b6290 0x7f4c88156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8e571700 1 -- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b6290 msgr2=0x7f4c88156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8e571700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b6290 0x7f4c88156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8e571700 1 -- 172.21.15.12:0/1847535878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c880b4060 msgr2=0x7f4c88155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:55.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8e571700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c880b4060 0x7f4c88155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:55.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8e571700 1 -- 172.21.15.12:0/1847535878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7800b180 con 0x7f4c88061e50 2021-10-20T23:24:55.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8e571700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c88061e50 0x7f4c880b8230 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f4c8400c000 tx=0x7f4c84006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c777fe700 1 -- 172.21.15.12:0/1847535878 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c84011750 con 0x7f4c88061e50 2021-10-20T23:24:55.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c777fe700 1 -- 172.21.15.12:0/1847535878 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c840118b0 con 0x7f4c88061e50 2021-10-20T23:24:55.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c88142dd0 con 0x7f4c88061e50 2021-10-20T23:24:55.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c777fe700 1 -- 172.21.15.12:0/1847535878 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c84011c10 con 0x7f4c88061e50 2021-10-20T23:24:55.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.939+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c88140d00 con 0x7f4c88061e50 2021-10-20T23:24:55.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.943+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c88142700 con 0x7f4c88061e50 2021-10-20T23:24:55.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.943+0000 7f4c777fe700 1 -- 172.21.15.12:0/1847535878 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c84011d70 con 0x7f4c88061e50 2021-10-20T23:24:55.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.943+0000 7f4c777fe700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c68053610 0x7f4c68055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:55.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.943+0000 7f4c777fe700 1 -- 172.21.15.12:0/1847535878 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f4c8406baf0 con 0x7f4c88061e50 2021-10-20T23:24:55.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.943+0000 7f4c8dd70700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c68053610 0x7f4c68055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:55.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.943+0000 7f4c8dd70700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c68053610 0x7f4c68055ad0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f4c7801a000 tx=0x7f4c78014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:55.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:55.955+0000 7f4c777fe700 1 -- 172.21.15.12:0/1847535878 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c84042d30 con 0x7f4c88061e50 2021-10-20T23:24:56.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.083+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c880b2750 con 0x7f4c88061e50 2021-10-20T23:24:56.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c777fe700 1 -- 172.21.15.12:0/1847535878 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c84046350 con 0x7f4c88061e50 2021-10-20T23:24:56.091 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:24:56.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c68053610 msgr2=0x7f4c68055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c68053610 0x7f4c68055ad0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f4c7801a000 tx=0x7f4c78014000).stop 2021-10-20T23:24:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c88061e50 msgr2=0x7f4c880b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c88061e50 0x7f4c880b8230 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f4c8400c000 tx=0x7f4c84006df0).stop 2021-10-20T23:24:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 shutdown_connections 2021-10-20T23:24:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c68053610 0x7f4c68055ad0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c880b6290 0x7f4c88156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c880b4060 0x7f4c88155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 --2- 172.21.15.12:0/1847535878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c88061e50 0x7f4c880b8230 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.087+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 >> 172.21.15.12:0/1847535878 conn(0x7f4c8805c490 msgr2=0x7f4c8812b250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:56.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.091+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 shutdown_connections 2021-10-20T23:24:56.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.091+0000 7f4c8f573700 1 -- 172.21.15.12:0/1847535878 wait complete. 2021-10-20T23:24:56.109 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd89759e700 1 Processor -- start 2021-10-20T23:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd89759e700 1 -- start start 2021-10-20T23:24:56.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd89759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8980b0010 0x7fd8980a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd89759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd8980afbd0 0x7fd8980a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd89759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8980a70c0 con 0x7fd8980b2580 2021-10-20T23:24:56.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd89759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8980a72f0 con 0x7fd8980afbd0 2021-10-20T23:24:56.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd89759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8980a7590 con 0x7fd8980b0010 2021-10-20T23:24:56.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd896d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd8980afbd0 0x7fd8980a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd896d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd8980afbd0 0x7fd8980a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40104/0 (socket says 172.21.15.12:40104) 2021-10-20T23:24:56.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd896d9d700 1 -- 172.21.15.12:0/4118495569 learned_addr learned my addr 172.21.15.12:0/4118495569 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:56.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd895d9b700 1 --2- 172.21.15.12:0/4118495569 >> v2:172.21.15.31:3300/0 conn(0x7fd8980b0010 0x7fd8980a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd896d9d700 1 -- 172.21.15.12:0/4118495569 >> v2:172.21.15.31:3300/0 conn(0x7fd8980b0010 msgr2=0x7fd8980a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:56.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd896d9d700 1 --2- 172.21.15.12:0/4118495569 >> v2:172.21.15.31:3300/0 conn(0x7fd8980b0010 0x7fd8980a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd896d9d700 1 -- 172.21.15.12:0/4118495569 >> v1:172.21.15.31:6789/0 conn(0x7fd8980b2580 legacy=0x7fd89814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.211+0000 7fd896d9d700 1 -- 172.21.15.12:0/4118495569 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8980a7830 con 0x7fd8980afbd0 2021-10-20T23:24:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd896d9d700 1 --2- 172.21.15.12:0/4118495569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980afbd0 0x7fd8980a88a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fd888002f70 tx=0x7fd888006eb0).ready entity=mon.0 client_cookie=be30c941711981b6 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89559a700 1 -- 172.21.15.12:0/4118495569 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd88800d5c0 con 0x7fd8980afbd0 2021-10-20T23:24:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89559a700 1 -- 172.21.15.12:0/4118495569 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888000e90 con 0x7fd8980afbd0 2021-10-20T23:24:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89559a700 1 -- 172.21.15.12:0/4118495569 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd88800d950 con 0x7fd8980afbd0 2021-10-20T23:24:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 -- 172.21.15.12:0/4118495569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980afbd0 msgr2=0x7fd8980a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 --2- 172.21.15.12:0/4118495569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980afbd0 0x7fd8980a88a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fd888002f70 tx=0x7fd888006eb0).stop 2021-10-20T23:24:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 -- 172.21.15.12:0/4118495569 shutdown_connections 2021-10-20T23:24:56.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 --2- 172.21.15.12:0/4118495569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980afbd0 0x7fd8980a88a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 --2- 172.21.15.12:0/4118495569 >> v2:172.21.15.31:3300/0 conn(0x7fd8980b0010 0x7fd8980a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 -- 172.21.15.12:0/4118495569 >> 172.21.15.12:0/4118495569 conn(0x7fd898060180 msgr2=0x7fd8980b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:56.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 -- 172.21.15.12:0/4118495569 shutdown_connections 2021-10-20T23:24:56.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 -- 172.21.15.12:0/4118495569 wait complete. 2021-10-20T23:24:56.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 Processor -- start 2021-10-20T23:24:56.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.215+0000 7fd89759e700 1 -- start start 2021-10-20T23:24:56.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8980afbd0 0x7fd89814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980b0010 0x7fd89815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8980b2580 0x7fd89815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd898157490 con 0x7fd8980b0010 2021-10-20T23:24:56.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd895d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980b0010 0x7fd89815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8980afbd0 0x7fd89814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd898156490 con 0x7fd8980afbd0 2021-10-20T23:24:56.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd898156680 con 0x7fd8980b2580 2021-10-20T23:24:56.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8980afbd0 0x7fd89814e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:55080/0 (socket says 172.21.15.12:55080) 2021-10-20T23:24:56.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89659c700 1 -- 172.21.15.12:0/2804179508 learned_addr learned my addr 172.21.15.12:0/2804179508 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:56.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd896d9d700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8980b2580 0x7fd89815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd895d9b700 1 -- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8980b2580 msgr2=0x7fd89815a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd895d9b700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8980b2580 0x7fd89815a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd895d9b700 1 -- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8980afbd0 msgr2=0x7fd89814e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd895d9b700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8980afbd0 0x7fd89814e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd895d9b700 1 -- 172.21.15.12:0/2804179508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88800b1e0 con 0x7fd8980b0010 2021-10-20T23:24:56.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89659c700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8980afbd0 0x7fd89814e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:24:56.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd895d9b700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980b0010 0x7fd89815a040 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd89814d3b0 tx=0x7fd880006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:56.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd88f7fe700 1 -- 172.21.15.12:0/2804179508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd880011750 con 0x7fd8980b0010 2021-10-20T23:24:56.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd88f7fe700 1 -- 172.21.15.12:0/2804179508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8800118b0 con 0x7fd8980b0010 2021-10-20T23:24:56.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd898159ba0 con 0x7fd8980b0010 2021-10-20T23:24:56.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd88f7fe700 1 -- 172.21.15.12:0/2804179508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd880011c10 con 0x7fd8980b0010 2021-10-20T23:24:56.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8980a9260 con 0x7fd8980b0010 2021-10-20T23:24:56.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.219+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd898159d30 con 0x7fd8980b0010 2021-10-20T23:24:56.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.223+0000 7fd88f7fe700 1 -- 172.21.15.12:0/2804179508 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd880011d70 con 0x7fd8980b0010 2021-10-20T23:24:56.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.223+0000 7fd88f7fe700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd87c0536a0 0x7fd87c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.223+0000 7fd88f7fe700 1 -- 172.21.15.12:0/2804179508 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fd88006b6c0 con 0x7fd8980b0010 2021-10-20T23:24:56.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.223+0000 7fd89659c700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd87c0536a0 0x7fd87c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.223+0000 7fd89659c700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd87c0536a0 0x7fd87c055b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fd89000d000 tx=0x7fd890009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:56.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.227+0000 7fd88f7fe700 1 -- 172.21.15.12:0/2804179508 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8800429a0 con 0x7fd8980b0010 2021-10-20T23:24:56.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.355+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd898057350 con 0x7fd8980b0010 2021-10-20T23:24:56.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd88f7fe700 1 -- 172.21.15.12:0/2804179508 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd880045fc0 con 0x7fd8980b0010 2021-10-20T23:24:56.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:56.362 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:24:56.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:56.363 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:24:56.363 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:24:56.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:24:56.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:24:56.364 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:24:56.364 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:24:56.364 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:24:56.364 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:24:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd87c0536a0 msgr2=0x7fd87c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd87c0536a0 0x7fd87c055b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fd89000d000 tx=0x7fd890009040).stop 2021-10-20T23:24:56.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980b0010 msgr2=0x7fd89815a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980b0010 0x7fd89815a040 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd89814d3b0 tx=0x7fd880006df0).stop 2021-10-20T23:24:56.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 shutdown_connections 2021-10-20T23:24:56.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd87c0536a0 0x7fd87c055b60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8980b2580 0x7fd89815a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8980b0010 0x7fd89815a040 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 --2- 172.21.15.12:0/2804179508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8980afbd0 0x7fd89814e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 >> 172.21.15.12:0/2804179508 conn(0x7fd898060180 msgr2=0x7fd898148920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 shutdown_connections 2021-10-20T23:24:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.359+0000 7fd89759e700 1 -- 172.21.15.12:0/2804179508 wait complete. 2021-10-20T23:24:56.375 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:24:56.375 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:24:56.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5688881700 1 Processor -- start 2021-10-20T23:24:56.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5688881700 1 -- start start 2021-10-20T23:24:56.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5688881700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56840619e0 0x7f5684061dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5688881700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684143a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5688881700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56840601b0 con 0x7f56840b3c50 2021-10-20T23:24:56.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5688881700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56840ae9c0 con 0x7f56840619e0 2021-10-20T23:24:56.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5688881700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56840b6a10 con 0x7f56840b65d0 2021-10-20T23:24:56.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f568259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56840619e0 0x7f5684061dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5682d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5682d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684143a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:45872/0 (socket says 172.21.15.12:45872) 2021-10-20T23:24:56.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f567bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f56840b3c50 0x7f568405f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45772/0 (socket says 172.21.15.12:45772) 2021-10-20T23:24:56.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5682d9d700 1 -- 172.21.15.12:0/3667277569 learned_addr learned my addr 172.21.15.12:0/3667277569 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:56.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5681d9b700 1 -- 172.21.15.12:0/3667277569 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176603228 0 0) 0x7f56840601b0 con 0x7f56840b3c50 2021-10-20T23:24:56.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5682d9d700 1 -- 172.21.15.12:0/3667277569 >> v2:172.21.15.31:3300/0 conn(0x7f56840619e0 msgr2=0x7f5684061dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:56.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5682d9d700 1 --2- 172.21.15.12:0/3667277569 >> v2:172.21.15.31:3300/0 conn(0x7f56840619e0 0x7f5684061dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5682d9d700 1 -- 172.21.15.12:0/3667277569 >> v1:172.21.15.31:6789/0 conn(0x7f56840b3c50 legacy=0x7f568405f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5682d9d700 1 -- 172.21.15.12:0/3667277569 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568405ff10 con 0x7f56840b65d0 2021-10-20T23:24:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5682d9d700 1 --2- 172.21.15.12:0/3667277569 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684143a60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f567c0032f0 tx=0x7f567c009290).ready entity=mon.2 client_cookie=e319d59eddcb9666 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5681d9b700 1 -- 172.21.15.12:0/3667277569 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f567c00b8a0 con 0x7f56840b65d0 2021-10-20T23:24:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5681d9b700 1 -- 172.21.15.12:0/3667277569 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c00ba00 con 0x7f56840b65d0 2021-10-20T23:24:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.487+0000 7f5681d9b700 1 -- 172.21.15.12:0/3667277569 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f567c00bb70 con 0x7f56840b65d0 2021-10-20T23:24:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 -- 172.21.15.12:0/3667277569 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 msgr2=0x7f5684143a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 --2- 172.21.15.12:0/3667277569 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684143a60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f567c0032f0 tx=0x7f567c009290).stop 2021-10-20T23:24:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 -- 172.21.15.12:0/3667277569 shutdown_connections 2021-10-20T23:24:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 --2- 172.21.15.12:0/3667277569 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684143a60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 --2- 172.21.15.12:0/3667277569 >> v2:172.21.15.31:3300/0 conn(0x7f56840619e0 0x7f5684061dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 -- 172.21.15.12:0/3667277569 >> 172.21.15.12:0/3667277569 conn(0x7f56840639b0 msgr2=0x7f5684063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 -- 172.21.15.12:0/3667277569 shutdown_connections 2021-10-20T23:24:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 -- 172.21.15.12:0/3667277569 wait complete. 2021-10-20T23:24:56.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 Processor -- start 2021-10-20T23:24:56.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.491+0000 7f5688881700 1 -- start start 2021-10-20T23:24:56.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5688881700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56840619e0 0x7f5684067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5688881700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840b3c50 0x7f5684064690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5688881700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5688881700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5684155630 con 0x7f56840619e0 2021-10-20T23:24:56.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5688881700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5684064b80 con 0x7f56840b3c50 2021-10-20T23:24:56.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5688881700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5684066a10 con 0x7f56840b65d0 2021-10-20T23:24:56.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f568259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56840619e0 0x7f5684067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f568259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56840619e0 0x7f5684067530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40118/0 (socket says 172.21.15.12:40118) 2021-10-20T23:24:56.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f568259c700 1 -- 172.21.15.12:0/2175783284 learned_addr learned my addr 172.21.15.12:0/2175783284 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:56.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5682d9d700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f567bfff700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840b3c50 0x7f5684064690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f568259c700 1 -- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 msgr2=0x7f5684155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f568259c700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f568259c700 1 -- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840b3c50 msgr2=0x7f5684064690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:56.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f568259c700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840b3c50 0x7f5684064690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:56.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f568259c700 1 -- 172.21.15.12:0/2175783284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c009530 con 0x7f56840619e0 2021-10-20T23:24:56.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f568259c700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56840619e0 0x7f5684067530 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f567400c000 tx=0x7f5674006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:56.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f567b7fe700 1 -- 172.21.15.12:0/2175783284 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5674010780 con 0x7f56840619e0 2021-10-20T23:24:56.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f567b7fe700 1 -- 172.21.15.12:0/2175783284 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56740108e0 con 0x7f56840619e0 2021-10-20T23:24:56.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f567b7fe700 1 -- 172.21.15.12:0/2175783284 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5674010c40 con 0x7f56840619e0 2021-10-20T23:24:56.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56840b4320 con 0x7f56840619e0 2021-10-20T23:24:56.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56840b4ef0 con 0x7f56840619e0 2021-10-20T23:24:56.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.495+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5684066f20 con 0x7f56840619e0 2021-10-20T23:24:56.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.499+0000 7f567b7fe700 1 -- 172.21.15.12:0/2175783284 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f567401c460 con 0x7f56840619e0 2021-10-20T23:24:56.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.499+0000 7f567b7fe700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5668053610 0x7f5668055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:56.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.499+0000 7f567b7fe700 1 -- 172.21.15.12:0/2175783284 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f567406ba70 con 0x7f56840619e0 2021-10-20T23:24:56.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.499+0000 7f567bfff700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5668053610 0x7f5668055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:56.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.499+0000 7f567bfff700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5668053610 0x7f5668055ad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f566c00d000 tx=0x7f566c007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:56.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.503+0000 7f567b7fe700 1 -- 172.21.15.12:0/2175783284 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5684066f20 con 0x7f56840619e0 2021-10-20T23:24:56.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:56.635+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5684066f20 con 0x7f56840619e0 2021-10-20T23:24:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.191+0000 7f567b7fe700 1 -- 172.21.15.12:0/2175783284 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v65) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5684066f20 con 0x7f56840619e0 2021-10-20T23:24:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5668053610 msgr2=0x7f5668055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5668053610 0x7f5668055ad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f566c00d000 tx=0x7f566c007a00).stop 2021-10-20T23:24:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56840619e0 msgr2=0x7f5684067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56840619e0 0x7f5684067530 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f567400c000 tx=0x7f5674006df0).stop 2021-10-20T23:24:57.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 shutdown_connections 2021-10-20T23:24:57.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5668053610 0x7f5668055ad0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56840b65d0 0x7f5684155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840b3c50 0x7f5684064690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 --2- 172.21.15.12:0/2175783284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56840619e0 0x7f5684067530 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 >> 172.21.15.12:0/2175783284 conn(0x7f56840639b0 msgr2=0x7f568413e600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:57.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 shutdown_connections 2021-10-20T23:24:57.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.195+0000 7f5688881700 1 -- 172.21.15.12:0/2175783284 wait complete. 2021-10-20T23:24:57.203 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:24:57.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:24:57.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.323+0000 7f4cf3fff700 1 Processor -- start 2021-10-20T23:24:57.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.323+0000 7f4cf3fff700 1 -- start start 2021-10-20T23:24:57.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4cf40b2580 0x7f4cf40abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4cf40b02e0 0x7f4cf40ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf40add80 con 0x7f4cf40b1260 2021-10-20T23:24:57.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf40ae020 con 0x7f4cf40b02e0 2021-10-20T23:24:57.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf40a9390 con 0x7f4cf40b2580 2021-10-20T23:24:57.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4cf40b02e0 0x7f4cf40ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4cf40b02e0 0x7f4cf40ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40130/0 (socket says 172.21.15.12:40130) 2021-10-20T23:24:57.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf37fe700 1 -- 172.21.15.12:0/4102426570 learned_addr learned my addr 172.21.15.12:0/4102426570 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:57.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf2ffd700 1 --2- 172.21.15.12:0/4102426570 >> v2:172.21.15.31:3300/0 conn(0x7f4cf40b2580 0x7f4cf40abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf37fe700 1 -- 172.21.15.12:0/4102426570 >> v2:172.21.15.31:3300/0 conn(0x7f4cf40b2580 msgr2=0x7f4cf40abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:57.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf37fe700 1 --2- 172.21.15.12:0/4102426570 >> v2:172.21.15.31:3300/0 conn(0x7f4cf40b2580 0x7f4cf40abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf37fe700 1 -- 172.21.15.12:0/4102426570 >> v1:172.21.15.31:6789/0 conn(0x7f4cf40b1260 legacy=0x7f4cf40afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf37fe700 1 -- 172.21.15.12:0/4102426570 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf40a9830 con 0x7f4cf40b02e0 2021-10-20T23:24:57.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf37fe700 1 --2- 172.21.15.12:0/4102426570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b02e0 0x7f4cf40ac000 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f4cec0032f0 tx=0x7f4cec009290).ready entity=mon.0 client_cookie=9f4fe59f6f9b6d90 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:57.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf1ffb700 1 -- 172.21.15.12:0/4102426570 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cec00b870 con 0x7f4cf40b02e0 2021-10-20T23:24:57.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf1ffb700 1 -- 172.21.15.12:0/4102426570 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec00b9d0 con 0x7f4cf40b02e0 2021-10-20T23:24:57.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf1ffb700 1 -- 172.21.15.12:0/4102426570 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cec00bb40 con 0x7f4cf40b02e0 2021-10-20T23:24:57.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 -- 172.21.15.12:0/4102426570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b02e0 msgr2=0x7f4cf40ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 --2- 172.21.15.12:0/4102426570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b02e0 0x7f4cf40ac000 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f4cec0032f0 tx=0x7f4cec009290).stop 2021-10-20T23:24:57.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 -- 172.21.15.12:0/4102426570 shutdown_connections 2021-10-20T23:24:57.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 --2- 172.21.15.12:0/4102426570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b02e0 0x7f4cf40ac000 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 --2- 172.21.15.12:0/4102426570 >> v2:172.21.15.31:3300/0 conn(0x7f4cf40b2580 0x7f4cf40abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 -- 172.21.15.12:0/4102426570 >> 172.21.15.12:0/4102426570 conn(0x7f4cf4060180 msgr2=0x7f4cf40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:57.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 -- 172.21.15.12:0/4102426570 shutdown_connections 2021-10-20T23:24:57.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.327+0000 7f4cf3fff700 1 -- 172.21.15.12:0/4102426570 wait complete. 2021-10-20T23:24:57.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 Processor -- start 2021-10-20T23:24:57.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 -- start start 2021-10-20T23:24:57.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cf40b02e0 0x7f4cf40662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b1260 0x7f4cf4066c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cf40b2580 0x7f4cf40a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40a0410 con 0x7f4cf40b1260 2021-10-20T23:24:57.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40672b0 con 0x7f4cf40b2580 2021-10-20T23:24:57.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4067550 con 0x7f4cf40b02e0 2021-10-20T23:24:57.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b1260 0x7f4cf4066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b1260 0x7f4cf4066c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40134/0 (socket says 172.21.15.12:40134) 2021-10-20T23:24:57.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf27fc700 1 -- 172.21.15.12:0/250460757 learned_addr learned my addr 172.21.15.12:0/250460757 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:57.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf2ffd700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cf40b02e0 0x7f4cf40662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf37fe700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cf40b2580 0x7f4cf40a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf27fc700 1 -- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cf40b02e0 msgr2=0x7f4cf40662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf27fc700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cf40b02e0 0x7f4cf40662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf27fc700 1 -- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cf40b2580 msgr2=0x7f4cf40a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf27fc700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cf40b2580 0x7f4cf40a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf27fc700 1 -- 172.21.15.12:0/250460757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec009530 con 0x7f4cf40b1260 2021-10-20T23:24:57.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf37fe700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cf40b2580 0x7f4cf40a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:24:57.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf27fc700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b1260 0x7f4cf4066c80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4cf4060680 tx=0x7f4ce8007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:57.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4ce3fff700 1 -- 172.21.15.12:0/250460757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce8007030 con 0x7f4cf40b1260 2021-10-20T23:24:57.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4ce3fff700 1 -- 172.21.15.12:0/250460757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8007190 con 0x7f4cf40b1260 2021-10-20T23:24:57.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf40a0640 con 0x7f4cf40b1260 2021-10-20T23:24:57.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4ce3fff700 1 -- 172.21.15.12:0/250460757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce8006510 con 0x7f4cf40b1260 2021-10-20T23:24:57.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.331+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf4065af0 con 0x7f4cf40b1260 2021-10-20T23:24:57.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.335+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf40a07d0 con 0x7f4cf40b1260 2021-10-20T23:24:57.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.335+0000 7f4ce3fff700 1 -- 172.21.15.12:0/250460757 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4ce8010030 con 0x7f4cf40b1260 2021-10-20T23:24:57.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.335+0000 7f4ce3fff700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4cd0053580 0x7f4cd0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.335+0000 7f4ce3fff700 1 -- 172.21.15.12:0/250460757 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f4ce806b490 con 0x7f4cf40b1260 2021-10-20T23:24:57.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.335+0000 7f4cf2ffd700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4cd0053580 0x7f4cd0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.335+0000 7f4cf2ffd700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4cd0053580 0x7f4cd0055a40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f4ce400b000 tx=0x7f4ce4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:57.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.343+0000 7f4ce3fff700 1 -- 172.21.15.12:0/250460757 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4ce8042660 con 0x7f4cf40b1260 2021-10-20T23:24:57.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.471+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4cf4057350 con 0x7f4cf40b1260 2021-10-20T23:24:57.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.787+0000 7f4ce3fff700 1 -- 172.21.15.12:0/250460757 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v66) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4ce8045c80 con 0x7f4cf40b1260 2021-10-20T23:24:57.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4cd0053580 msgr2=0x7f4cd0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4cd0053580 0x7f4cd0055a40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f4ce400b000 tx=0x7f4ce4008040).stop 2021-10-20T23:24:57.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b1260 msgr2=0x7f4cf4066c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b1260 0x7f4cf4066c80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4cf4060680 tx=0x7f4ce8007bd0).stop 2021-10-20T23:24:57.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 shutdown_connections 2021-10-20T23:24:57.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4cd0053580 0x7f4cd0055a40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cf40b2580 0x7f4cf40a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cf40b1260 0x7f4cf4066c80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 --2- 172.21.15.12:0/250460757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cf40b02e0 0x7f4cf40662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 >> 172.21.15.12:0/250460757 conn(0x7f4cf4060180 msgr2=0x7f4cf40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:57.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 shutdown_connections 2021-10-20T23:24:57.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.799+0000 7f4cf3fff700 1 -- 172.21.15.12:0/250460757 wait complete. 2021-10-20T23:24:57.807 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:24:57.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:24:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.919+0000 7febd4fa6700 1 Processor -- start 2021-10-20T23:24:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.919+0000 7febd4fa6700 1 -- start start 2021-10-20T23:24:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febd4fa6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7febd00b7370 0x7febd00b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febd4fa6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7febd00b3060 0x7febd013e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febd4fa6700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd00b2380 con 0x7febd013e710 2021-10-20T23:24:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febd4fa6700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd0144250 con 0x7febd00b7370 2021-10-20T23:24:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febd4fa6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd00b3570 con 0x7febd00b3060 2021-10-20T23:24:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febcf7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7febd00b7370 0x7febd00b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febcffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7febd013e710 0x7febd0064ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38738/0 (socket says 172.21.15.12:38738) 2021-10-20T23:24:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febcffff700 1 -- 172.21.15.12:0/776127633 learned_addr learned my addr 172.21.15.12:0/776127633 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febc6ffd700 1 --2- 172.21.15.12:0/776127633 >> v2:172.21.15.31:3300/0 conn(0x7febd00b3060 0x7febd013e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febceffd700 1 -- 172.21.15.12:0/776127633 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177142537 0 0) 0x7febd00b2380 con 0x7febd013e710 2021-10-20T23:24:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febceffd700 1 -- 172.21.15.12:0/776127633 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb0003260 con 0x7febd013e710 2021-10-20T23:24:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febcf7fe700 1 -- 172.21.15.12:0/776127633 >> v2:172.21.15.31:3300/0 conn(0x7febd00b3060 msgr2=0x7febd013e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febcf7fe700 1 --2- 172.21.15.12:0/776127633 >> v2:172.21.15.31:3300/0 conn(0x7febd00b3060 0x7febd013e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febcf7fe700 1 -- 172.21.15.12:0/776127633 >> v1:172.21.15.12:6789/0 conn(0x7febd013e710 legacy=0x7febd0064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febcf7fe700 1 -- 172.21.15.12:0/776127633 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd00b25b0 con 0x7febd00b7370 2021-10-20T23:24:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febcf7fe700 1 --2- 172.21.15.12:0/776127633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd00b7370 0x7febd00b7750 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7febc0002f70 tx=0x7febc0006d90).ready entity=mon.0 client_cookie=db9cdaf5bf669ede server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febceffd700 1 -- 172.21.15.12:0/776127633 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc000e470 con 0x7febd00b7370 2021-10-20T23:24:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febceffd700 1 -- 172.21.15.12:0/776127633 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc0000e90 con 0x7febd00b7370 2021-10-20T23:24:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.923+0000 7febceffd700 1 -- 172.21.15.12:0/776127633 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc000e7c0 con 0x7febd00b7370 2021-10-20T23:24:57.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 -- 172.21.15.12:0/776127633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd00b7370 msgr2=0x7febd00b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 --2- 172.21.15.12:0/776127633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd00b7370 0x7febd00b7750 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7febc0002f70 tx=0x7febc0006d90).stop 2021-10-20T23:24:57.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 -- 172.21.15.12:0/776127633 shutdown_connections 2021-10-20T23:24:57.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 --2- 172.21.15.12:0/776127633 >> v2:172.21.15.31:3300/0 conn(0x7febd00b3060 0x7febd013e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 --2- 172.21.15.12:0/776127633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd00b7370 0x7febd00b7750 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 -- 172.21.15.12:0/776127633 >> 172.21.15.12:0/776127633 conn(0x7febd005f6b0 msgr2=0x7febd005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 -- 172.21.15.12:0/776127633 shutdown_connections 2021-10-20T23:24:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 -- 172.21.15.12:0/776127633 wait complete. 2021-10-20T23:24:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 Processor -- start 2021-10-20T23:24:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.927+0000 7febd4fa6700 1 -- start start 2021-10-20T23:24:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febd4fa6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd00b3060 0x7febd009f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febd4fa6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febd00b7370 0x7febd009fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febd4fa6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd013e710 0x7febd00aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febd4fa6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd00a01c0 con 0x7febd013e710 2021-10-20T23:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febd4fa6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd00af510 con 0x7febd00b3060 2021-10-20T23:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febd4fa6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd00af0a0 con 0x7febd00b7370 2021-10-20T23:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd013e710 0x7febd00aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd013e710 0x7febd00aa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40150/0 (socket says 172.21.15.12:40150) 2021-10-20T23:24:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcffff700 1 -- 172.21.15.12:0/3122257872 learned_addr learned my addr 172.21.15.12:0/3122257872 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febc6ffd700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febd00b7370 0x7febd009fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcf7fe700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd00b3060 0x7febd009f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcffff700 1 -- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febd00b7370 msgr2=0x7febd009fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcffff700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febd00b7370 0x7febd009fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcffff700 1 -- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd00b3060 msgr2=0x7febd009f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcffff700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd00b3060 0x7febd009f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcffff700 1 -- 172.21.15.12:0/3122257872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc000b120 con 0x7febd013e710 2021-10-20T23:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcffff700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd013e710 0x7febd00aa3e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7febc8001490 tx=0x7febc8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcd7fa700 1 -- 172.21.15.12:0/3122257872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc8005ba0 con 0x7febd013e710 2021-10-20T23:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcd7fa700 1 -- 172.21.15.12:0/3122257872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8005d00 con 0x7febd013e710 2021-10-20T23:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd01509f0 con 0x7febd013e710 2021-10-20T23:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febcd7fa700 1 -- 172.21.15.12:0/3122257872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc80072c0 con 0x7febd013e710 2021-10-20T23:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.931+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd00ae360 con 0x7febd013e710 2021-10-20T23:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.935+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd0057350 con 0x7febd013e710 2021-10-20T23:24:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.935+0000 7febcd7fa700 1 -- 172.21.15.12:0/3122257872 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7febc8010070 con 0x7febd013e710 2021-10-20T23:24:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.935+0000 7febcd7fa700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febb4053640 0x7febb4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.935+0000 7febcd7fa700 1 -- 172.21.15.12:0/3122257872 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6304+0+0 (secure 0 0 0) 0x7febc806b450 con 0x7febd013e710 2021-10-20T23:24:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.935+0000 7febcf7fe700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febb4053640 0x7febb4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.935+0000 7febcf7fe700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febb4053640 0x7febb4055b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7febc001a000 tx=0x7febc0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:57.943+0000 7febcd7fa700 1 -- 172.21.15.12:0/3122257872 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7febc80423c0 con 0x7febd013e710 2021-10-20T23:24:58.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.103+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7febd00601a0 con 0x7febd013e710 2021-10-20T23:24:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febcd7fa700 1 -- 172.21.15.12:0/3122257872 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v30) v1 ==== 189+0+0 (secure 0 0 0) 0x7febc80459e0 con 0x7febd013e710 2021-10-20T23:24:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febb4053640 msgr2=0x7febb4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febb4053640 0x7febb4055b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7febc001a000 tx=0x7febc0014000).stop 2021-10-20T23:24:58.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd013e710 msgr2=0x7febd00aa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd013e710 0x7febd00aa3e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7febc8001490 tx=0x7febc8007e00).stop 2021-10-20T23:24:58.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 shutdown_connections 2021-10-20T23:24:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7febb4053640 0x7febb4055b00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febd013e710 0x7febd00aa3e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febd00b7370 0x7febd009fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 --2- 172.21.15.12:0/3122257872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd00b3060 0x7febd009f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 >> 172.21.15.12:0/3122257872 conn(0x7febd005f6b0 msgr2=0x7febd00b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 shutdown_connections 2021-10-20T23:24:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.115+0000 7febd4fa6700 1 -- 172.21.15.12:0/3122257872 wait complete. 2021-10-20T23:24:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 11 and data pool 12 2021-10-20T23:24:58.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:24:58.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 Processor -- start 2021-10-20T23:24:58.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 -- start start 2021-10-20T23:24:58.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7400b2580 0x7fd74014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd7400a8ac0 0x7fd74014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7400a70c0 con 0x7fd7400b0010 2021-10-20T23:24:58.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7400a72f0 con 0x7fd7400b2580 2021-10-20T23:24:58.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7400a7590 con 0x7fd7400a8ac0 2021-10-20T23:24:58.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7400b2580 0x7fd74014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7400b2580 0x7fd74014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40168/0 (socket says 172.21.15.12:40168) 2021-10-20T23:24:58.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73ffff700 1 -- 172.21.15.12:0/2516145504 learned_addr learned my addr 172.21.15.12:0/2516145504 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:58.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd744875700 1 --2- 172.21.15.12:0/2516145504 >> v2:172.21.15.31:3300/0 conn(0x7fd7400a8ac0 0x7fd74014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73ffff700 1 -- 172.21.15.12:0/2516145504 >> v2:172.21.15.31:3300/0 conn(0x7fd7400a8ac0 msgr2=0x7fd74014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:58.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73ffff700 1 --2- 172.21.15.12:0/2516145504 >> v2:172.21.15.31:3300/0 conn(0x7fd7400a8ac0 0x7fd74014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73ffff700 1 -- 172.21.15.12:0/2516145504 >> v1:172.21.15.31:6789/0 conn(0x7fd7400b0010 legacy=0x7fd7400a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73ffff700 1 -- 172.21.15.12:0/2516145504 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7400a7830 con 0x7fd7400b2580 2021-10-20T23:24:58.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73ffff700 1 --2- 172.21.15.12:0/2516145504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7400b2580 0x7fd74014ae40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fd730002f70 tx=0x7fd730006eb0).ready entity=mon.0 client_cookie=cfa8806cc0700a5b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:58.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73effd700 1 -- 172.21.15.12:0/2516145504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd73000d610 con 0x7fd7400b2580 2021-10-20T23:24:58.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73effd700 1 -- 172.21.15.12:0/2516145504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd730000e90 con 0x7fd7400b2580 2021-10-20T23:24:58.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd73effd700 1 -- 172.21.15.12:0/2516145504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd73000d9a0 con 0x7fd7400b2580 2021-10-20T23:24:58.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 -- 172.21.15.12:0/2516145504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7400b2580 msgr2=0x7fd74014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 --2- 172.21.15.12:0/2516145504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7400b2580 0x7fd74014ae40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fd730002f70 tx=0x7fd730006eb0).stop 2021-10-20T23:24:58.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 -- 172.21.15.12:0/2516145504 shutdown_connections 2021-10-20T23:24:58.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 --2- 172.21.15.12:0/2516145504 >> v2:172.21.15.31:3300/0 conn(0x7fd7400a8ac0 0x7fd74014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 --2- 172.21.15.12:0/2516145504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7400b2580 0x7fd74014ae40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 -- 172.21.15.12:0/2516145504 >> 172.21.15.12:0/2516145504 conn(0x7fd740060180 msgr2=0x7fd7400b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:58.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 -- 172.21.15.12:0/2516145504 shutdown_connections 2021-10-20T23:24:58.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.227+0000 7fd745076700 1 -- 172.21.15.12:0/2516145504 wait complete. 2021-10-20T23:24:58.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd745076700 1 Processor -- start 2021-10-20T23:24:58.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd745076700 1 -- start start 2021-10-20T23:24:58.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd745076700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7400a8ac0 0x7fd740148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd745076700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7400b0010 0x7fd7400b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd745076700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7400b2580 0x7fd7400b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd745076700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd740142900 con 0x7fd7400b2580 2021-10-20T23:24:58.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd745076700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400b49e0 con 0x7fd7400a8ac0 2021-10-20T23:24:58.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd745076700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400b4c10 con 0x7fd7400b0010 2021-10-20T23:24:58.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd73ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7400a8ac0 0x7fd740148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd744875700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7400b2580 0x7fd7400b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd73ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7400a8ac0 0x7fd740148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:55148/0 (socket says 172.21.15.12:55148) 2021-10-20T23:24:58.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd73ffff700 1 -- 172.21.15.12:0/781167624 learned_addr learned my addr 172.21.15.12:0/781167624 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:58.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.231+0000 7fd73f7fe700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7400b0010 0x7fd7400b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73ffff700 1 -- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7400b0010 msgr2=0x7fd7400b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73ffff700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7400b0010 0x7fd7400b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73ffff700 1 -- 172.21.15.12:0/781167624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7400b2580 msgr2=0x7fd7400b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73ffff700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7400b2580 0x7fd7400b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73ffff700 1 -- 172.21.15.12:0/781167624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73000b1e0 con 0x7fd7400a8ac0 2021-10-20T23:24:58.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73ffff700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7400a8ac0 0x7fd740148ec0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd730002f70 tx=0x7fd730015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:58.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73d7fa700 1 -- 172.21.15.12:0/781167624 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd730011860 con 0x7fd7400a8ac0 2021-10-20T23:24:58.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73d7fa700 1 -- 172.21.15.12:0/781167624 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7300119c0 con 0x7fd7400a8ac0 2021-10-20T23:24:58.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73d7fa700 1 -- 172.21.15.12:0/781167624 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd730011d20 con 0x7fd7400a8ac0 2021-10-20T23:24:58.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7400b4eb0 con 0x7fd7400a8ac0 2021-10-20T23:24:58.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7400aa6f0 con 0x7fd7400a8ac0 2021-10-20T23:24:58.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd740057350 con 0x7fd7400a8ac0 2021-10-20T23:24:58.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73d7fa700 1 -- 172.21.15.12:0/781167624 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd73001a040 con 0x7fd7400a8ac0 2021-10-20T23:24:58.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73d7fa700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7200536a0 0x7fd720055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73d7fa700 1 -- 172.21.15.12:0/781167624 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd73006c9b0 con 0x7fd7400a8ac0 2021-10-20T23:24:58.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.235+0000 7fd73f7fe700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7200536a0 0x7fd720055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.239+0000 7fd73f7fe700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7200536a0 0x7fd720055b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fd73400d000 tx=0x7fd734007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:58.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.243+0000 7fd73d7fa700 1 -- 172.21.15.12:0/781167624 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd7300439d0 con 0x7fd7400a8ac0 2021-10-20T23:24:58.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.379+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7400b3a00 con 0x7fd7400a8ac0 2021-10-20T23:24:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.379+0000 7fd73d7fa700 1 -- 172.21.15.12:0/781167624 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16287 (secure 0 0 0) 0x7fd730023070 con 0x7fd7400a8ac0 2021-10-20T23:24:58.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:58.386 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":67,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:24:58.106241+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:24:56.691138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-10-20T23:24:57.527415+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7200536a0 msgr2=0x7fd720055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7200536a0 0x7fd720055b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fd73400d000 tx=0x7fd734007b90).stop 2021-10-20T23:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7400a8ac0 msgr2=0x7fd740148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7400a8ac0 0x7fd740148ec0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd730002f70 tx=0x7fd730015000).stop 2021-10-20T23:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 shutdown_connections 2021-10-20T23:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd7200536a0 0x7fd720055b60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7400b2580 0x7fd7400b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7400b0010 0x7fd7400b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 --2- 172.21.15.12:0/781167624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7400a8ac0 0x7fd740148ec0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 >> 172.21.15.12:0/781167624 conn(0x7fd740060180 msgr2=0x7fd740145610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 shutdown_connections 2021-10-20T23:24:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.383+0000 7fd745076700 1 -- 172.21.15.12:0/781167624 wait complete. 2021-10-20T23:24:58.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:24:58.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.499+0000 7f258bfff700 1 Processor -- start 2021-10-20T23:24:58.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 -- start start 2021-10-20T23:24:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f258c0b0710 0x7f258c142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0b30d0 0x7f258c143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c0b0af0 con 0x7f258c0ace70 2021-10-20T23:24:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258c0ae680 con 0x7f258c0b0710 2021-10-20T23:24:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0ae920 con 0x7f258c0b30d0 2021-10-20T23:24:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f258c0ace70 0x7f258c05f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38778/0 (socket says 172.21.15.12:38778) 2021-10-20T23:24:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258b7fe700 1 -- 172.21.15.12:0/720238178 learned_addr learned my addr 172.21.15.12:0/720238178 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258affd700 1 --2- 172.21.15.12:0/720238178 >> v2:172.21.15.31:3300/0 conn(0x7f258c0b0710 0x7f258c142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f2583fff700 1 --2- 172.21.15.12:0/720238178 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0b30d0 0x7f258c143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258a7fc700 1 -- 172.21.15.12:0/720238178 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784147429 0 0) 0x7f258c0b0af0 con 0x7f258c0ace70 2021-10-20T23:24:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258a7fc700 1 -- 172.21.15.12:0/720238178 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f256c003260 con 0x7f258c0ace70 2021-10-20T23:24:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258affd700 1 -- 172.21.15.12:0/720238178 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0b30d0 msgr2=0x7f258c143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258affd700 1 --2- 172.21.15.12:0/720238178 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0b30d0 0x7f258c143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258affd700 1 -- 172.21.15.12:0/720238178 >> v1:172.21.15.12:6789/0 conn(0x7f258c0ace70 legacy=0x7f258c05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258affd700 1 -- 172.21.15.12:0/720238178 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0aebc0 con 0x7f258c0b0710 2021-10-20T23:24:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258affd700 1 --2- 172.21.15.12:0/720238178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b0710 0x7f258c142d20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f257c002f70 tx=0x7f257c006df0).ready entity=mon.1 client_cookie=3866770d3c8b0f8e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258a7fc700 1 -- 172.21.15.12:0/720238178 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257c00d4a0 con 0x7f258c0b0710 2021-10-20T23:24:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258a7fc700 1 -- 172.21.15.12:0/720238178 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c000e90 con 0x7f258c0b0710 2021-10-20T23:24:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258a7fc700 1 -- 172.21.15.12:0/720238178 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257c00d7f0 con 0x7f258c0b0710 2021-10-20T23:24:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 -- 172.21.15.12:0/720238178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b0710 msgr2=0x7f258c142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 --2- 172.21.15.12:0/720238178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b0710 0x7f258c142d20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f257c002f70 tx=0x7f257c006df0).stop 2021-10-20T23:24:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 -- 172.21.15.12:0/720238178 shutdown_connections 2021-10-20T23:24:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 --2- 172.21.15.12:0/720238178 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0b30d0 0x7f258c143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 --2- 172.21.15.12:0/720238178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b0710 0x7f258c142d20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.503+0000 7f258bfff700 1 -- 172.21.15.12:0/720238178 >> 172.21.15.12:0/720238178 conn(0x7f258c061140 msgr2=0x7f258c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 -- 172.21.15.12:0/720238178 shutdown_connections 2021-10-20T23:24:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 -- 172.21.15.12:0/720238178 wait complete. 2021-10-20T23:24:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 Processor -- start 2021-10-20T23:24:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 -- start start 2021-10-20T23:24:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0ace70 0x7f258c0ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c0b0710 0x7f258c064280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b30d0 0x7f258c064770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c1503a0 con 0x7f258c0b0710 2021-10-20T23:24:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c150640 con 0x7f258c0b30d0 2021-10-20T23:24:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c1508e0 con 0x7f258c0ace70 2021-10-20T23:24:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2583fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c0b0710 0x7f258c064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2583fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c0b0710 0x7f258c064280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40190/0 (socket says 172.21.15.12:40190) 2021-10-20T23:24:58.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2583fff700 1 -- 172.21.15.12:0/4270916502 learned_addr learned my addr 172.21.15.12:0/4270916502 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:58.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258affd700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0ace70 0x7f258c0ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258b7fe700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b30d0 0x7f258c064770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2583fff700 1 -- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0ace70 msgr2=0x7f258c0ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2583fff700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0ace70 0x7f258c0ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2583fff700 1 -- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b30d0 msgr2=0x7f258c064770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2583fff700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b30d0 0x7f258c064770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2583fff700 1 -- 172.21.15.12:0/4270916502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c00b180 con 0x7f258c0b0710 2021-10-20T23:24:58.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258b7fe700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b30d0 0x7f258c064770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:24:58.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2583fff700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c0b0710 0x7f258c064280 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f257400c000 tx=0x7f2574006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:58.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2588ff9700 1 -- 172.21.15.12:0/4270916502 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2574010780 con 0x7f258c0b0710 2021-10-20T23:24:58.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2588ff9700 1 -- 172.21.15.12:0/4270916502 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25740108e0 con 0x7f258c0b0710 2021-10-20T23:24:58.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c150b80 con 0x7f258c0b0710 2021-10-20T23:24:58.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f2588ff9700 1 -- 172.21.15.12:0/4270916502 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2574010c40 con 0x7f258c0b0710 2021-10-20T23:24:58.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.507+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c063c40 con 0x7f258c0b0710 2021-10-20T23:24:58.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.511+0000 7f2588ff9700 1 -- 172.21.15.12:0/4270916502 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f257401c460 con 0x7f258c0b0710 2021-10-20T23:24:58.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.511+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c057350 con 0x7f258c0b0710 2021-10-20T23:24:58.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.511+0000 7f2588ff9700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2570053610 0x7f2570055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.511+0000 7f2588ff9700 1 -- 172.21.15.12:0/4270916502 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f257406bef0 con 0x7f258c0b0710 2021-10-20T23:24:58.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.511+0000 7f258affd700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2570053610 0x7f2570055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.511+0000 7f258affd700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2570053610 0x7f2570055ad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f257c01a000 tx=0x7f257c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:58.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.515+0000 7f2588ff9700 1 -- 172.21.15.12:0/4270916502 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2574042df0 con 0x7f258c0b0710 2021-10-20T23:24:58.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.647+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f258c0698e0 con 0x7f258c0b0710 2021-10-20T23:24:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.647+0000 7f2588ff9700 1 -- 172.21.15.12:0/4270916502 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f2574046410 con 0x7f258c0b0710 2021-10-20T23:24:58.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:58.652 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":67,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:24:58.106241+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:24:56.691138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-10-20T23:24:57.527415+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:24:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2570053610 msgr2=0x7f2570055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2570053610 0x7f2570055ad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f257c01a000 tx=0x7f257c014000).stop 2021-10-20T23:24:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c0b0710 msgr2=0x7f258c064280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c0b0710 0x7f258c064280 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f257400c000 tx=0x7f2574006df0).stop 2021-10-20T23:24:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 shutdown_connections 2021-10-20T23:24:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2570053610 0x7f2570055ad0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b30d0 0x7f258c064770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c0b0710 0x7f258c064280 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 --2- 172.21.15.12:0/4270916502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f258c0ace70 0x7f258c0ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 >> 172.21.15.12:0/4270916502 conn(0x7f258c061140 msgr2=0x7f258c140f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 shutdown_connections 2021-10-20T23:24:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.651+0000 7f258bfff700 1 -- 172.21.15.12:0/4270916502 wait complete. 2021-10-20T23:24:58.666 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:24:58.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37d868700 1 Processor -- start 2021-10-20T23:24:58.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37d868700 1 -- start start 2021-10-20T23:24:58.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37d868700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3780b1a30 0x7fd3780669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37d868700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 0x7fd37813e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37d868700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37805f750 con 0x7fd3780665f0 2021-10-20T23:24:58.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37d868700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3780b14a0 con 0x7fd3780b1a30 2021-10-20T23:24:58.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37d868700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37805f980 con 0x7fd378140cb0 2021-10-20T23:24:58.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37c866700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd3780665f0 0x7fd37805fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38790/0 (socket says 172.21.15.12:38790) 2021-10-20T23:24:58.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd377fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3780b1a30 0x7fd3780669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37c866700 1 -- 172.21.15.12:0/4158200769 learned_addr learned my addr 172.21.15.12:0/4158200769 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:58.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd37d067700 1 --2- 172.21.15.12:0/4158200769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 0x7fd37813e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd377fff700 1 -- 172.21.15.12:0/4158200769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 msgr2=0x7fd37813e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:58.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd377fff700 1 --2- 172.21.15.12:0/4158200769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 0x7fd37813e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd377fff700 1 -- 172.21.15.12:0/4158200769 >> v1:172.21.15.12:6789/0 conn(0x7fd3780665f0 legacy=0x7fd37805fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.775+0000 7fd3777fe700 1 -- 172.21.15.12:0/4158200769 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190162279 0 0) 0x7fd37805f750 con 0x7fd3780665f0 2021-10-20T23:24:58.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd377fff700 1 -- 172.21.15.12:0/4158200769 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3780b1740 con 0x7fd3780b1a30 2021-10-20T23:24:58.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd377fff700 1 --2- 172.21.15.12:0/4158200769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780b1a30 0x7fd3780669d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fd360002f70 tx=0x7fd360006df0).ready entity=mon.0 client_cookie=14aa9c3cc744b77c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:58.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd3777fe700 1 -- 172.21.15.12:0/4158200769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36000d570 con 0x7fd3780b1a30 2021-10-20T23:24:58.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd3777fe700 1 -- 172.21.15.12:0/4158200769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360000e90 con 0x7fd3780b1a30 2021-10-20T23:24:58.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd3777fe700 1 -- 172.21.15.12:0/4158200769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36000d8c0 con 0x7fd3780b1a30 2021-10-20T23:24:58.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 -- 172.21.15.12:0/4158200769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780b1a30 msgr2=0x7fd3780669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 --2- 172.21.15.12:0/4158200769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780b1a30 0x7fd3780669d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fd360002f70 tx=0x7fd360006df0).stop 2021-10-20T23:24:58.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 -- 172.21.15.12:0/4158200769 shutdown_connections 2021-10-20T23:24:58.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 --2- 172.21.15.12:0/4158200769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 0x7fd37813e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 --2- 172.21.15.12:0/4158200769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780b1a30 0x7fd3780669d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 -- 172.21.15.12:0/4158200769 >> 172.21.15.12:0/4158200769 conn(0x7fd3780636e0 msgr2=0x7fd378063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:58.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 -- 172.21.15.12:0/4158200769 shutdown_connections 2021-10-20T23:24:58.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 -- 172.21.15.12:0/4158200769 wait complete. 2021-10-20T23:24:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 Processor -- start 2021-10-20T23:24:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.779+0000 7fd37d868700 1 -- start start 2021-10-20T23:24:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d868700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780665f0 0x7fd378150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d868700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3780b1a30 0x7fd3780b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d868700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 0x7fd3781526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d868700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378150c80 con 0x7fd3780665f0 2021-10-20T23:24:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d868700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3781511e0 con 0x7fd3780b1a30 2021-10-20T23:24:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d868700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37813b8a0 con 0x7fd378140cb0 2021-10-20T23:24:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37c866700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780665f0 0x7fd378150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37c866700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780665f0 0x7fd378150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40202/0 (socket says 172.21.15.12:40202) 2021-10-20T23:24:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37c866700 1 -- 172.21.15.12:0/3794683837 learned_addr learned my addr 172.21.15.12:0/3794683837 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd377fff700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3780b1a30 0x7fd3780b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d067700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 0x7fd3781526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd377fff700 1 -- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 msgr2=0x7fd3781526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd377fff700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 0x7fd3781526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd377fff700 1 -- 172.21.15.12:0/3794683837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780665f0 msgr2=0x7fd378150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd377fff700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780665f0 0x7fd378150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd377fff700 1 -- 172.21.15.12:0/3794683837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36000b180 con 0x7fd3780b1a30 2021-10-20T23:24:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd377fff700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3780b1a30 0x7fd3780b20b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fd3780ab060 tx=0x7fd360014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd375ffb700 1 -- 172.21.15.12:0/3794683837 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36000dea0 con 0x7fd3780b1a30 2021-10-20T23:24:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd375ffb700 1 -- 172.21.15.12:0/3794683837 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360013e50 con 0x7fd3780b1a30 2021-10-20T23:24:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37813bb40 con 0x7fd3780b1a30 2021-10-20T23:24:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd375ffb700 1 -- 172.21.15.12:0/3794683837 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36001e5f0 con 0x7fd3780b1a30 2021-10-20T23:24:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3780b25a0 con 0x7fd3780b1a30 2021-10-20T23:24:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd378144950 con 0x7fd3780b1a30 2021-10-20T23:24:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd375ffb700 1 -- 172.21.15.12:0/3794683837 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd36001c070 con 0x7fd3780b1a30 2021-10-20T23:24:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.783+0000 7fd375ffb700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd35c0536a0 0x7fd35c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.787+0000 7fd375ffb700 1 -- 172.21.15.12:0/3794683837 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd36006c510 con 0x7fd3780b1a30 2021-10-20T23:24:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.787+0000 7fd37c866700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd35c0536a0 0x7fd35c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.787+0000 7fd37c866700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd35c0536a0 0x7fd35c055b60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fd36800d000 tx=0x7fd368009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:58.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.795+0000 7fd375ffb700 1 -- 172.21.15.12:0/3794683837 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd378144950 con 0x7fd3780b1a30 2021-10-20T23:24:58.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:58.955+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd378144950 con 0x7fd3780b1a30 2021-10-20T23:24:59.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.115+0000 7fd375ffb700 1 -- 172.21.15.12:0/3794683837 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd378144950 con 0x7fd3780b1a30 2021-10-20T23:24:59.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd35c0536a0 msgr2=0x7fd35c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd35c0536a0 0x7fd35c055b60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fd36800d000 tx=0x7fd368009040).stop 2021-10-20T23:24:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3780b1a30 msgr2=0x7fd3780b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3780b1a30 0x7fd3780b20b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fd3780ab060 tx=0x7fd360014000).stop 2021-10-20T23:24:59.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 shutdown_connections 2021-10-20T23:24:59.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd35c0536a0 0x7fd35c055b60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd378140cb0 0x7fd3781526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3780b1a30 0x7fd3780b20b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 --2- 172.21.15.12:0/3794683837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3780665f0 0x7fd378150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 >> 172.21.15.12:0/3794683837 conn(0x7fd3780636e0 msgr2=0x7fd378141330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:59.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 shutdown_connections 2021-10-20T23:24:59.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.119+0000 7fd37d868700 1 -- 172.21.15.12:0/3794683837 wait complete. 2021-10-20T23:24:59.140 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:24:59.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc926315700 1 Processor -- start 2021-10-20T23:24:59.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc926315700 1 -- start start 2021-10-20T23:24:59.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc926315700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc9200b30d0 0x7fc920143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc926315700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc920143920 con 0x7fc9200b0710 2021-10-20T23:24:59.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc926315700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9200b0af0 con 0x7fc9200ace70 2021-10-20T23:24:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc926315700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9200ae680 con 0x7fc9200b30d0 2021-10-20T23:24:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc925313700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc9200b0710 0x7fc920142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38806/0 (socket says 172.21.15.12:38806) 2021-10-20T23:24:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc925313700 1 -- 172.21.15.12:0/2016529428 learned_addr learned my addr 172.21.15.12:0/2016529428 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:59.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc924b12700 1 --2- 172.21.15.12:0/2016529428 >> v2:172.21.15.31:3300/0 conn(0x7fc9200b30d0 0x7fc920143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc917fff700 1 -- 172.21.15.12:0/2016529428 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783087966 0 0) 0x7fc920143920 con 0x7fc9200b0710 2021-10-20T23:24:59.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc917fff700 1 -- 172.21.15.12:0/2016529428 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc904003260 con 0x7fc9200b0710 2021-10-20T23:24:59.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc924b12700 1 -- 172.21.15.12:0/2016529428 >> v1:172.21.15.31:6789/0 conn(0x7fc9200ace70 legacy=0x7fc92013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc924b12700 1 -- 172.21.15.12:0/2016529428 >> v1:172.21.15.12:6789/0 conn(0x7fc9200b0710 legacy=0x7fc920142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.239+0000 7fc924b12700 1 -- 172.21.15.12:0/2016529428 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200ae920 con 0x7fc9200b30d0 2021-10-20T23:24:59.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc924b12700 1 --2- 172.21.15.12:0/2016529428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9200b30d0 0x7fc920143430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fc910002f70 tx=0x7fc910006df0).ready entity=mon.1 client_cookie=6f15d74e497f2262 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc917fff700 1 -- 172.21.15.12:0/2016529428 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91000d5c0 con 0x7fc9200b30d0 2021-10-20T23:24:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc917fff700 1 -- 172.21.15.12:0/2016529428 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910000e90 con 0x7fc9200b30d0 2021-10-20T23:24:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc917fff700 1 -- 172.21.15.12:0/2016529428 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91000d910 con 0x7fc9200b30d0 2021-10-20T23:24:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc926315700 1 -- 172.21.15.12:0/2016529428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9200b30d0 msgr2=0x7fc920143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc926315700 1 --2- 172.21.15.12:0/2016529428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9200b30d0 0x7fc920143430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fc910002f70 tx=0x7fc910006df0).stop 2021-10-20T23:24:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc926315700 1 -- 172.21.15.12:0/2016529428 shutdown_connections 2021-10-20T23:24:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc926315700 1 --2- 172.21.15.12:0/2016529428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9200b30d0 0x7fc920143430 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc926315700 1 -- 172.21.15.12:0/2016529428 >> 172.21.15.12:0/2016529428 conn(0x7fc920061140 msgr2=0x7fc920062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc926315700 1 -- 172.21.15.12:0/2016529428 shutdown_connections 2021-10-20T23:24:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc926315700 1 -- 172.21.15.12:0/2016529428 wait complete. 2021-10-20T23:24:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc926315700 1 Processor -- start 2021-10-20T23:24:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.243+0000 7fc926315700 1 -- start start 2021-10-20T23:24:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc926315700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9200ace70 0x7fc92013f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc926315700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9200b0710 0x7fc920152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc926315700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9200b30d0 0x7fc920152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc926315700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920155880 con 0x7fc9200b30d0 2021-10-20T23:24:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc926315700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920064e00 con 0x7fc9200ace70 2021-10-20T23:24:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc926315700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200650a0 con 0x7fc9200b0710 2021-10-20T23:24:59.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925b14700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9200b30d0 0x7fc920152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925b14700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9200b30d0 0x7fc920152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40220/0 (socket says 172.21.15.12:40220) 2021-10-20T23:24:59.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc924b12700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9200b0710 0x7fc920152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925b14700 1 -- 172.21.15.12:0/1495002787 learned_addr learned my addr 172.21.15.12:0/1495002787 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925313700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9200ace70 0x7fc92013f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925b14700 1 -- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9200b0710 msgr2=0x7fc920152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925b14700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9200b0710 0x7fc920152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925b14700 1 -- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9200ace70 msgr2=0x7fc92013f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925b14700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9200ace70 0x7fc92013f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925b14700 1 -- 172.21.15.12:0/1495002787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91000b180 con 0x7fc9200b30d0 2021-10-20T23:24:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc925b14700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9200b30d0 0x7fc920152cf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fc9200b0290 tx=0x7fc918007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc9167fc700 1 -- 172.21.15.12:0/1495002787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc918012400 con 0x7fc9200b30d0 2021-10-20T23:24:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc9167fc700 1 -- 172.21.15.12:0/1495002787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc918012560 con 0x7fc9200b30d0 2021-10-20T23:24:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc920065340 con 0x7fc9200b30d0 2021-10-20T23:24:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc9167fc700 1 -- 172.21.15.12:0/1495002787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9180128c0 con 0x7fc9200b30d0 2021-10-20T23:24:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9201531e0 con 0x7fc9200b30d0 2021-10-20T23:24:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc920057350 con 0x7fc9200b30d0 2021-10-20T23:24:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.247+0000 7fc9167fc700 1 -- 172.21.15.12:0/1495002787 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc918019030 con 0x7fc9200b30d0 2021-10-20T23:24:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.251+0000 7fc9167fc700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc908053640 0x7fc908055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.251+0000 7fc9167fc700 1 -- 172.21.15.12:0/1495002787 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc91806ad00 con 0x7fc9200b30d0 2021-10-20T23:24:59.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.251+0000 7fc925313700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc908053640 0x7fc908055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.251+0000 7fc925313700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc908053640 0x7fc908055b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fc91c00d000 tx=0x7fc91c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:59.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.255+0000 7fc9167fc700 1 -- 172.21.15.12:0/1495002787 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc91806e030 con 0x7fc9200b30d0 2021-10-20T23:24:59.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.419+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9200b2c70 con 0x7fc9200b30d0 2021-10-20T23:24:59.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.419+0000 7fc9167fc700 1 -- 172.21.15.12:0/1495002787 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fc918041ca0 con 0x7fc9200b30d0 2021-10-20T23:24:59.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:24:58.106627+0000","modified":"2021-10-20T23:24:59.110023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5944":{"gid":5944,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/242443509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":242443509},{"type":"v1","addr":"172.21.15.12:6833","nonce":242443509}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-20T23:24:59.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc908053640 msgr2=0x7fc908055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc908053640 0x7fc908055b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fc91c00d000 tx=0x7fc91c009040).stop 2021-10-20T23:24:59.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9200b30d0 msgr2=0x7fc920152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9200b30d0 0x7fc920152cf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fc9200b0290 tx=0x7fc918007bc0).stop 2021-10-20T23:24:59.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 shutdown_connections 2021-10-20T23:24:59.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc908053640 0x7fc908055b00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9200b30d0 0x7fc920152cf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9200b0710 0x7fc920152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 --2- 172.21.15.12:0/1495002787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9200ace70 0x7fc92013f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 >> 172.21.15.12:0/1495002787 conn(0x7fc920061140 msgr2=0x7fc9200b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:59.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 shutdown_connections 2021-10-20T23:24:59.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.423+0000 7fc926315700 1 -- 172.21.15.12:0/1495002787 wait complete. 2021-10-20T23:24:59.430 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2021-10-20T23:24:59.438 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:24:59.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.535+0000 7feb8dd78700 1 Processor -- start 2021-10-20T23:24:59.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.535+0000 7feb8dd78700 1 -- start start 2021-10-20T23:24:59.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb88061320 0x7feb88061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 0x7feb881408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb880aecf0 con 0x7feb880ad5c0 2021-10-20T23:24:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb880b6f20 con 0x7feb88061320 2021-10-20T23:24:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb880aef20 con 0x7feb88140440 2021-10-20T23:24:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8cd76700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb88061320 0x7feb88061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8d577700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 0x7feb881408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8cd76700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb88061320 0x7feb88061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40226/0 (socket says 172.21.15.12:40226) 2021-10-20T23:24:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb87fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feb880ad5c0 0x7feb880b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45882/0 (socket says 172.21.15.12:45882) 2021-10-20T23:24:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8cd76700 1 -- 172.21.15.12:0/489652072 learned_addr learned my addr 172.21.15.12:0/489652072 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8cd76700 1 -- 172.21.15.12:0/489652072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 msgr2=0x7feb881408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:24:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb877fe700 1 -- 172.21.15.12:0/489652072 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388436486 0 0) 0x7feb880aecf0 con 0x7feb880ad5c0 2021-10-20T23:24:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8cd76700 1 --2- 172.21.15.12:0/489652072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 0x7feb881408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8cd76700 1 -- 172.21.15.12:0/489652072 >> v1:172.21.15.31:6789/0 conn(0x7feb880ad5c0 legacy=0x7feb880b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8cd76700 1 -- 172.21.15.12:0/489652072 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880af1c0 con 0x7feb88061320 2021-10-20T23:24:59.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8cd76700 1 --2- 172.21.15.12:0/489652072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb88061320 0x7feb88061700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7feb880aeba0 tx=0x7feb7c006eb0).ready entity=mon.0 client_cookie=b934ce7b8eeff0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:59.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb877fe700 1 -- 172.21.15.12:0/489652072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb7c00d5c0 con 0x7feb88061320 2021-10-20T23:24:59.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb877fe700 1 -- 172.21.15.12:0/489652072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c000e90 con 0x7feb88061320 2021-10-20T23:24:59.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb877fe700 1 -- 172.21.15.12:0/489652072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb7c00d910 con 0x7feb88061320 2021-10-20T23:24:59.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 -- 172.21.15.12:0/489652072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb88061320 msgr2=0x7feb88061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 --2- 172.21.15.12:0/489652072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb88061320 0x7feb88061700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7feb880aeba0 tx=0x7feb7c006eb0).stop 2021-10-20T23:24:59.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 -- 172.21.15.12:0/489652072 shutdown_connections 2021-10-20T23:24:59.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 --2- 172.21.15.12:0/489652072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 0x7feb881408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 --2- 172.21.15.12:0/489652072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb88061320 0x7feb88061700 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 -- 172.21.15.12:0/489652072 >> 172.21.15.12:0/489652072 conn(0x7feb88066de0 msgr2=0x7feb880671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:59.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 -- 172.21.15.12:0/489652072 shutdown_connections 2021-10-20T23:24:59.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.539+0000 7feb8dd78700 1 -- 172.21.15.12:0/489652072 wait complete. 2021-10-20T23:24:59.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.543+0000 7feb8dd78700 1 Processor -- start 2021-10-20T23:24:59.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.543+0000 7feb8dd78700 1 -- start start 2021-10-20T23:24:59.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8dd78700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb88061320 0x7feb880b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8dd78700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb880ad5c0 0x7feb880b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8dd78700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 0x7feb880ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8dd78700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880b1550 con 0x7feb880ad5c0 2021-10-20T23:24:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8dd78700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88141fc0 con 0x7feb88061320 2021-10-20T23:24:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8dd78700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb880ad080 con 0x7feb88140440 2021-10-20T23:24:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb880ad5c0 0x7feb880b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb880ad5c0 0x7feb880b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40232/0 (socket says 172.21.15.12:40232) 2021-10-20T23:24:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb87fff700 1 -- 172.21.15.12:0/2251746345 learned_addr learned my addr 172.21.15.12:0/2251746345 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8cd76700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb88061320 0x7feb880b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8d577700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 0x7feb880ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb87fff700 1 -- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 msgr2=0x7feb880ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb87fff700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 0x7feb880ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb87fff700 1 -- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb88061320 msgr2=0x7feb880b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb87fff700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb88061320 0x7feb880b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb87fff700 1 -- 172.21.15.12:0/2251746345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c00b1e0 con 0x7feb880ad5c0 2021-10-20T23:24:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb87fff700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb880ad5c0 0x7feb880b1060 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7feb88140eb0 tx=0x7feb78007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb85ffb700 1 -- 172.21.15.12:0/2251746345 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb7800ce60 con 0x7feb880ad5c0 2021-10-20T23:24:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb85ffb700 1 -- 172.21.15.12:0/2251746345 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb780070d0 con 0x7feb880ad5c0 2021-10-20T23:24:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb88156500 con 0x7feb880ad5c0 2021-10-20T23:24:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb85ffb700 1 -- 172.21.15.12:0/2251746345 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb78005550 con 0x7feb880ad5c0 2021-10-20T23:24:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb881423f0 con 0x7feb880ad5c0 2021-10-20T23:24:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb881417b0 con 0x7feb880ad5c0 2021-10-20T23:24:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.547+0000 7feb85ffb700 1 -- 172.21.15.12:0/2251746345 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feb7801a060 con 0x7feb880ad5c0 2021-10-20T23:24:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.551+0000 7feb85ffb700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb680534f0 0x7feb680559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.551+0000 7feb85ffb700 1 -- 172.21.15.12:0/2251746345 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7feb7806adf0 con 0x7feb880ad5c0 2021-10-20T23:24:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.551+0000 7feb8cd76700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb680534f0 0x7feb680559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.551+0000 7feb8cd76700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb680534f0 0x7feb680559b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7feb7c01c000 tx=0x7feb7c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.555+0000 7feb85ffb700 1 -- 172.21.15.12:0/2251746345 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feb78041ce0 con 0x7feb880ad5c0 2021-10-20T23:24:59.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.683+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb88156340 con 0x7feb880ad5c0 2021-10-20T23:24:59.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.683+0000 7feb85ffb700 1 -- 172.21.15.12:0/2251746345 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16274 (secure 0 0 0) 0x7feb78018070 con 0x7feb880ad5c0 2021-10-20T23:24:59.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:24:59.690 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":68,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:24:59.110746+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:24:56.691138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-10-20T23:24:57.527415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:24:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb680534f0 msgr2=0x7feb680559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb680534f0 0x7feb680559b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7feb7c01c000 tx=0x7feb7c015000).stop 2021-10-20T23:24:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb880ad5c0 msgr2=0x7feb880b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb880ad5c0 0x7feb880b1060 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7feb88140eb0 tx=0x7feb78007a60).stop 2021-10-20T23:24:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 shutdown_connections 2021-10-20T23:24:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb680534f0 0x7feb680559b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb88140440 0x7feb880ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb880ad5c0 0x7feb880b1060 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 --2- 172.21.15.12:0/2251746345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb88061320 0x7feb880b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 >> 172.21.15.12:0/2251746345 conn(0x7feb88066de0 msgr2=0x7feb88145340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 shutdown_connections 2021-10-20T23:24:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.687+0000 7feb8dd78700 1 -- 172.21.15.12:0/2251746345 wait complete. 2021-10-20T23:24:59.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:24:59.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d21fe1700 1 Processor -- start 2021-10-20T23:24:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d21fe1700 1 -- start start 2021-10-20T23:24:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d21fe1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d1c0b6580 0x7f0d1c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d21fe1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c1440b0 con 0x7f0d1c0b43c0 2021-10-20T23:24:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d21fe1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c143b70 con 0x7f0d1c0b6960 2021-10-20T23:24:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d21fe1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1c143e10 con 0x7f0d1c0b6580 2021-10-20T23:24:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d1b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d1c0b6580 0x7f0d1c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d1affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0d1c0b43c0 0x7f0d1c061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38832/0 (socket says 172.21.15.12:38832) 2021-10-20T23:24:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d1affd700 1 -- 172.21.15.12:0/1143852966 learned_addr learned my addr 172.21.15.12:0/1143852966 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:24:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d1a7fc700 1 -- 172.21.15.12:0/1143852966 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505634066 0 0) 0x7f0d1c1440b0 con 0x7f0d1c0b43c0 2021-10-20T23:24:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d1a7fc700 1 -- 172.21.15.12:0/1143852966 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d08003260 con 0x7f0d1c0b43c0 2021-10-20T23:24:59.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d1b7fe700 1 -- 172.21.15.12:0/1143852966 >> v1:172.21.15.31:6789/0 conn(0x7f0d1c0b6960 legacy=0x7f0d1c12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d1a7fc700 1 -- 172.21.15.12:0/1143852966 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089692173 0 0) 0x7f0d1c143b70 con 0x7f0d1c0b6960 2021-10-20T23:24:59.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.815+0000 7f0d1b7fe700 1 -- 172.21.15.12:0/1143852966 >> v1:172.21.15.12:6789/0 conn(0x7f0d1c0b43c0 legacy=0x7f0d1c061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d1b7fe700 1 -- 172.21.15.12:0/1143852966 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c0615f0 con 0x7f0d1c0b6580 2021-10-20T23:24:59.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d1b7fe700 1 --2- 172.21.15.12:0/1143852966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6580 0x7f0d1c0b5bf0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f0d1c143120 tx=0x7f0d10006df0).ready entity=mon.0 client_cookie=32cfb30178a43a5a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:59.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d1a7fc700 1 -- 172.21.15.12:0/1143852966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d1000d610 con 0x7f0d1c0b6580 2021-10-20T23:24:59.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d1a7fc700 1 -- 172.21.15.12:0/1143852966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10000e90 con 0x7f0d1c0b6580 2021-10-20T23:24:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d1a7fc700 1 -- 172.21.15.12:0/1143852966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d1000d960 con 0x7f0d1c0b6580 2021-10-20T23:24:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d21fe1700 1 -- 172.21.15.12:0/1143852966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6580 msgr2=0x7f0d1c0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d21fe1700 1 --2- 172.21.15.12:0/1143852966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6580 0x7f0d1c0b5bf0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f0d1c143120 tx=0x7f0d10006df0).stop 2021-10-20T23:24:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d21fe1700 1 -- 172.21.15.12:0/1143852966 shutdown_connections 2021-10-20T23:24:59.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d21fe1700 1 --2- 172.21.15.12:0/1143852966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6580 0x7f0d1c0b5bf0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d21fe1700 1 -- 172.21.15.12:0/1143852966 >> 172.21.15.12:0/1143852966 conn(0x7f0d1c05c490 msgr2=0x7f0d1c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:24:59.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d21fe1700 1 -- 172.21.15.12:0/1143852966 shutdown_connections 2021-10-20T23:24:59.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d21fe1700 1 -- 172.21.15.12:0/1143852966 wait complete. 2021-10-20T23:24:59.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d21fe1700 1 Processor -- start 2021-10-20T23:24:59.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.819+0000 7f0d21fe1700 1 -- start start 2021-10-20T23:24:59.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d21fe1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d1c0b43c0 0x7f0d1c144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d21fe1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6960 0x7f0d1c152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d21fe1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d1c0b71b0 0x7f0d1c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d21fe1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c152100 con 0x7f0d1c0b6960 2021-10-20T23:24:59.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d21fe1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c0af560 con 0x7f0d1c0b43c0 2021-10-20T23:24:59.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d21fe1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c0aff90 con 0x7f0d1c0b71b0 2021-10-20T23:24:59.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6960 0x7f0d1c152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6960 0x7f0d1c152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40246/0 (socket says 172.21.15.12:40246) 2021-10-20T23:24:59.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1affd700 1 -- 172.21.15.12:0/777649287 learned_addr learned my addr 172.21.15.12:0/777649287 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:24:59.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1b7fe700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d1c0b43c0 0x7f0d1c144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1bfff700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d1c0b71b0 0x7f0d1c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1affd700 1 -- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d1c0b71b0 msgr2=0x7f0d1c152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1affd700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d1c0b71b0 0x7f0d1c152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1affd700 1 -- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d1c0b43c0 msgr2=0x7f0d1c144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:24:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1affd700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d1c0b43c0 0x7f0d1c144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:24:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1affd700 1 -- 172.21.15.12:0/777649287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1000b180 con 0x7f0d1c0b6960 2021-10-20T23:24:59.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d1affd700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6960 0x7f0d1c152790 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f0d1c0af6a0 tx=0x7f0d0c007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:59.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d18ff9700 1 -- 172.21.15.12:0/777649287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d0c00cea0 con 0x7f0d1c0b6960 2021-10-20T23:24:59.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d18ff9700 1 -- 172.21.15.12:0/777649287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c0070d0 con 0x7f0d1c0b6960 2021-10-20T23:24:59.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c0b01c0 con 0x7f0d1c0b6960 2021-10-20T23:24:59.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d18ff9700 1 -- 172.21.15.12:0/777649287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d0c007430 con 0x7f0d1c0b6960 2021-10-20T23:24:59.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c1522f0 con 0x7f0d1c0b6960 2021-10-20T23:24:59.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.823+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c1524b0 con 0x7f0d1c0b6960 2021-10-20T23:24:59.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.827+0000 7f0d18ff9700 1 -- 172.21.15.12:0/777649287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d0c01a070 con 0x7f0d1c0b6960 2021-10-20T23:24:59.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.827+0000 7f0d18ff9700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cfc0536a0 0x7f0cfc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:24:59.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.827+0000 7f0d18ff9700 1 -- 172.21.15.12:0/777649287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0d0c06a9e0 con 0x7f0d1c0b6960 2021-10-20T23:24:59.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.827+0000 7f0d1b7fe700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cfc0536a0 0x7f0cfc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:24:59.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.827+0000 7f0d1b7fe700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cfc0536a0 0x7f0cfc055b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f0d1001a000 tx=0x7f0d10014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:24:59.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.831+0000 7f0d18ff9700 1 -- 172.21.15.12:0/777649287 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d0c0419e0 con 0x7f0d1c0b6960 2021-10-20T23:25:00.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:24:59.999+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0d1c061890 con 0x7f0d1c0b6960 2021-10-20T23:25:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.007+0000 7f0d18ff9700 1 -- 172.21.15.12:0/777649287 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0d0c045000 con 0x7f0d1c0b6960 2021-10-20T23:25:00.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cfc0536a0 msgr2=0x7f0cfc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cfc0536a0 0x7f0cfc055b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f0d1001a000 tx=0x7f0d10014000).stop 2021-10-20T23:25:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6960 msgr2=0x7f0d1c152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6960 0x7f0d1c152790 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f0d1c0af6a0 tx=0x7f0d0c007a60).stop 2021-10-20T23:25:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 shutdown_connections 2021-10-20T23:25:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cfc0536a0 0x7f0cfc055b60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d1c0b71b0 0x7f0d1c152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d1c0b6960 0x7f0d1c152790 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 --2- 172.21.15.12:0/777649287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d1c0b43c0 0x7f0d1c144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 >> 172.21.15.12:0/777649287 conn(0x7f0d1c05c490 msgr2=0x7f0d1c141570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:00.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 shutdown_connections 2021-10-20T23:25:00.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.011+0000 7f0d21fe1700 1 -- 172.21.15.12:0/777649287 wait complete. 2021-10-20T23:25:00.017 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:25:00.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:25:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2413684700 1 Processor -- start 2021-10-20T23:25:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2413684700 1 -- start start 2021-10-20T23:25:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2413684700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c060d70 0x7f240c0b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2413684700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f240c1450c0 0x7f240c0ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2413684700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c0acc90 con 0x7f240c0b65c0 2021-10-20T23:25:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2413684700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c0ae560 con 0x7f240c1450c0 2021-10-20T23:25:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2413684700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c1446e0 con 0x7f240c060d70 2021-10-20T23:25:00.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2411c21700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f240c1450c0 0x7f240c0ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2411420700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f240c0b65c0 0x7f240c141000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45910/0 (socket says 172.21.15.12:45910) 2021-10-20T23:25:00.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2410c1f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c060d70 0x7f240c0b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.135+0000 7f2411420700 1 -- 172.21.15.12:0/3532975464 learned_addr learned my addr 172.21.15.12:0/3532975464 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2411c21700 1 -- 172.21.15.12:0/3532975464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c060d70 msgr2=0x7f240c0b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2411c21700 1 --2- 172.21.15.12:0/3532975464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c060d70 0x7f240c0b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2411c21700 1 -- 172.21.15.12:0/3532975464 >> v1:172.21.15.31:6789/0 conn(0x7f240c0b65c0 legacy=0x7f240c141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2411c21700 1 -- 172.21.15.12:0/3532975464 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c144980 con 0x7f240c1450c0 2021-10-20T23:25:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2410c1f700 1 --2- 172.21.15.12:0/3532975464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c060d70 0x7f240c0b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2411c21700 1 --2- 172.21.15.12:0/3532975464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240c1450c0 0x7f240c0ac5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f240c0ad9e0 tx=0x7f2404006df0).ready entity=mon.1 client_cookie=7504f5725d0a4ae0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f240bfff700 1 -- 172.21.15.12:0/3532975464 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f240400d570 con 0x7f240c1450c0 2021-10-20T23:25:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f240bfff700 1 -- 172.21.15.12:0/3532975464 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2404000e90 con 0x7f240c1450c0 2021-10-20T23:25:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f240bfff700 1 -- 172.21.15.12:0/3532975464 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f240400d8c0 con 0x7f240c1450c0 2021-10-20T23:25:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2413684700 1 -- 172.21.15.12:0/3532975464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240c1450c0 msgr2=0x7f240c0ac5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2413684700 1 --2- 172.21.15.12:0/3532975464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240c1450c0 0x7f240c0ac5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f240c0ad9e0 tx=0x7f2404006df0).stop 2021-10-20T23:25:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2413684700 1 -- 172.21.15.12:0/3532975464 shutdown_connections 2021-10-20T23:25:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2413684700 1 --2- 172.21.15.12:0/3532975464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240c1450c0 0x7f240c0ac5f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2413684700 1 --2- 172.21.15.12:0/3532975464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c060d70 0x7f240c0b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2413684700 1 -- 172.21.15.12:0/3532975464 >> 172.21.15.12:0/3532975464 conn(0x7f240c0b3480 msgr2=0x7f240c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2413684700 1 -- 172.21.15.12:0/3532975464 shutdown_connections 2021-10-20T23:25:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.139+0000 7f2413684700 1 -- 172.21.15.12:0/3532975464 wait complete. 2021-10-20T23:25:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 Processor -- start 2021-10-20T23:25:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 -- start start 2021-10-20T23:25:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f240c060d70 0x7f240c0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240c0b65c0 0x7f240c140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c1450c0 0x7f240c151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c065220 con 0x7f240c060d70 2021-10-20T23:25:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0b0920 con 0x7f240c0b65c0 2021-10-20T23:25:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c150650 con 0x7f240c1450c0 2021-10-20T23:25:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411420700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f240c060d70 0x7f240c0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411420700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f240c060d70 0x7f240c0b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40258/0 (socket says 172.21.15.12:40258) 2021-10-20T23:25:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411420700 1 -- 172.21.15.12:0/3884257086 learned_addr learned my addr 172.21.15.12:0/3884257086 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2410c1f700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240c0b65c0 0x7f240c140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411c21700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c1450c0 0x7f240c151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411420700 1 -- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c1450c0 msgr2=0x7f240c151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411420700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c1450c0 0x7f240c151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411420700 1 -- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240c0b65c0 msgr2=0x7f240c140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411420700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240c0b65c0 0x7f240c140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411420700 1 -- 172.21.15.12:0/3884257086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240000b180 con 0x7f240c060d70 2021-10-20T23:25:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411c21700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c1450c0 0x7f240c151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2411420700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f240c060d70 0x7f240c0b02f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f240c0ac290 tx=0x7f23fc0014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f240a7fc700 1 -- 172.21.15.12:0/3884257086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23fc005ba0 con 0x7f240c060d70 2021-10-20T23:25:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f240a7fc700 1 -- 172.21.15.12:0/3884257086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc005d00 con 0x7f240c060d70 2021-10-20T23:25:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240400b180 con 0x7f240c060d70 2021-10-20T23:25:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f240a7fc700 1 -- 172.21.15.12:0/3884257086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23fc0072c0 con 0x7f240c060d70 2021-10-20T23:25:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.143+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c150b90 con 0x7f240c060d70 2021-10-20T23:25:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.147+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c144c20 con 0x7f240c060d70 2021-10-20T23:25:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.147+0000 7f240a7fc700 1 -- 172.21.15.12:0/3884257086 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f23fc010070 con 0x7f240c060d70 2021-10-20T23:25:00.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.147+0000 7f240a7fc700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23ec053580 0x7f23ec055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.147+0000 7f240a7fc700 1 -- 172.21.15.12:0/3884257086 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f23fc06b510 con 0x7f240c060d70 2021-10-20T23:25:00.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.147+0000 7f2410c1f700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23ec053580 0x7f23ec055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.147+0000 7f2410c1f700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23ec053580 0x7f23ec055a40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f240000b000 tx=0x7f2400006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:00.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.151+0000 7f240a7fc700 1 -- 172.21.15.12:0/3884257086 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23fc042400 con 0x7f240c060d70 2021-10-20T23:25:00.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.315+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f240c057350 con 0x7f240c060d70 2021-10-20T23:25:00.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.323+0000 7f240a7fc700 1 -- 172.21.15.12:0/3884257086 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f23fc045a20 con 0x7f240c060d70 2021-10-20T23:25:00.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23ec053580 msgr2=0x7f23ec055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23ec053580 0x7f23ec055a40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f240000b000 tx=0x7f2400006df0).stop 2021-10-20T23:25:00.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f240c060d70 msgr2=0x7f240c0b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f240c060d70 0x7f240c0b02f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f240c0ac290 tx=0x7f23fc0014a0).stop 2021-10-20T23:25:00.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 shutdown_connections 2021-10-20T23:25:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23ec053580 0x7f23ec055a40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240c1450c0 0x7f240c151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240c0b65c0 0x7f240c140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 --2- 172.21.15.12:0/3884257086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f240c060d70 0x7f240c0b02f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 >> 172.21.15.12:0/3884257086 conn(0x7f240c0b3480 msgr2=0x7f240c0b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:00.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 shutdown_connections 2021-10-20T23:25:00.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.327+0000 7f2413684700 1 -- 172.21.15.12:0/3884257086 wait complete. 2021-10-20T23:25:00.335 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:25:00.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:00.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.443+0000 7f46bd67f700 1 Processor -- start 2021-10-20T23:25:00.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.443+0000 7f46bd67f700 1 -- start start 2021-10-20T23:25:00.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.443+0000 7f46bd67f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46b80b2ee0 0x7f46b8065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.443+0000 7f46bd67f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b80b2a90 con 0x7f46b814aeb0 2021-10-20T23:25:00.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.443+0000 7f46bd67f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b80b7a90 con 0x7f46b80b76b0 2021-10-20T23:25:00.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.443+0000 7f46bd67f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b80616a0 con 0x7f46b80b2ee0 2021-10-20T23:25:00.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46b77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46b80b2ee0 0x7f46b8065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46bce7e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f46b814aeb0 0x7f46b814b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38864/0 (socket says 172.21.15.12:38864) 2021-10-20T23:25:00.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46bce7e700 1 -- 172.21.15.12:0/3982268791 learned_addr learned my addr 172.21.15.12:0/3982268791 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:00.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46b77fe700 1 -- 172.21.15.12:0/3982268791 >> v1:172.21.15.31:6789/0 conn(0x7f46b80b76b0 legacy=0x7f46b8060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46b77fe700 1 -- 172.21.15.12:0/3982268791 >> v1:172.21.15.12:6789/0 conn(0x7f46b814aeb0 legacy=0x7f46b814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46b6ffd700 1 -- 172.21.15.12:0/3982268791 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323805201 0 0) 0x7f46b80b2a90 con 0x7f46b814aeb0 2021-10-20T23:25:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46b77fe700 1 -- 172.21.15.12:0/3982268791 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b80b27f0 con 0x7f46b80b2ee0 2021-10-20T23:25:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46b77fe700 1 --2- 172.21.15.12:0/3982268791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b2ee0 0x7f46b8065590 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f46a8002f70 tx=0x7f46a8006df0).ready entity=mon.0 client_cookie=e27cdec4de1aacc1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46b6ffd700 1 -- 172.21.15.12:0/3982268791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46a800d610 con 0x7f46b80b2ee0 2021-10-20T23:25:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46b6ffd700 1 -- 172.21.15.12:0/3982268791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a8000e90 con 0x7f46b80b2ee0 2021-10-20T23:25:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46b6ffd700 1 -- 172.21.15.12:0/3982268791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46a800d960 con 0x7f46b80b2ee0 2021-10-20T23:25:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46bd67f700 1 -- 172.21.15.12:0/3982268791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b2ee0 msgr2=0x7f46b8065590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46bd67f700 1 --2- 172.21.15.12:0/3982268791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b2ee0 0x7f46b8065590 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f46a8002f70 tx=0x7f46a8006df0).stop 2021-10-20T23:25:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46bd67f700 1 -- 172.21.15.12:0/3982268791 shutdown_connections 2021-10-20T23:25:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46bd67f700 1 --2- 172.21.15.12:0/3982268791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b2ee0 0x7f46b8065590 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46bd67f700 1 -- 172.21.15.12:0/3982268791 >> 172.21.15.12:0/3982268791 conn(0x7f46b805f6b0 msgr2=0x7f46b805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46bd67f700 1 -- 172.21.15.12:0/3982268791 shutdown_connections 2021-10-20T23:25:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.447+0000 7f46bd67f700 1 -- 172.21.15.12:0/3982268791 wait complete. 2021-10-20T23:25:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bd67f700 1 Processor -- start 2021-10-20T23:25:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bd67f700 1 -- start start 2021-10-20T23:25:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bd67f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b80b2ee0 0x7f46b80a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bd67f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b76b0 0x7f46b80af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bd67f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b814aeb0 0x7f46b809efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bd67f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b80a03b0 con 0x7f46b80b76b0 2021-10-20T23:25:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bd67f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b809ff40 con 0x7f46b80b2ee0 2021-10-20T23:25:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bd67f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b815a770 con 0x7f46b814aeb0 2021-10-20T23:25:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b76b0 0x7f46b80af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b76b0 0x7f46b80af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40274/0 (socket says 172.21.15.12:40274) 2021-10-20T23:25:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b77fe700 1 -- 172.21.15.12:0/44157079 learned_addr learned my addr 172.21.15.12:0/44157079 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b7fff700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b80b2ee0 0x7f46b80a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bce7e700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b814aeb0 0x7f46b809efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b77fe700 1 -- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b814aeb0 msgr2=0x7f46b809efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b77fe700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b814aeb0 0x7f46b809efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b77fe700 1 -- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b80b2ee0 msgr2=0x7f46b80a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b77fe700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b80b2ee0 0x7f46b80a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b77fe700 1 -- 172.21.15.12:0/44157079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a800b180 con 0x7f46b80b76b0 2021-10-20T23:25:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46bce7e700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b814aeb0 0x7f46b809efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.451+0000 7f46b77fe700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b76b0 0x7f46b80af7a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f46a8002f70 tx=0x7f46a8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46b57fa700 1 -- 172.21.15.12:0/44157079 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46a8016070 con 0x7f46b80b76b0 2021-10-20T23:25:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46b57fa700 1 -- 172.21.15.12:0/44157079 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a800de90 con 0x7f46b80b76b0 2021-10-20T23:25:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46b57fa700 1 -- 172.21.15.12:0/44157079 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46a8013e10 con 0x7f46b80b76b0 2021-10-20T23:25:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b809e8b0 con 0x7f46b80b76b0 2021-10-20T23:25:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b809f4c0 con 0x7f46b80b76b0 2021-10-20T23:25:00.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b809fda0 con 0x7f46b80b76b0 2021-10-20T23:25:00.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46b57fa700 1 -- 172.21.15.12:0/44157079 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f46a8025030 con 0x7f46b80b76b0 2021-10-20T23:25:00.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46b57fa700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f469c0534f0 0x7f469c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:00.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46b57fa700 1 -- 172.21.15.12:0/44157079 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f46a806cd90 con 0x7f46b80b76b0 2021-10-20T23:25:00.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46b7fff700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f469c0534f0 0x7f469c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:00.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.455+0000 7f46b7fff700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f469c0534f0 0x7f469c0559b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f46a000d000 tx=0x7f46a0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:00.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.459+0000 7f46b57fa700 1 -- 172.21.15.12:0/44157079 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46b809fda0 con 0x7f46b80b76b0 2021-10-20T23:25:00.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.619+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46b809fda0 con 0x7f46b80b76b0 2021-10-20T23:25:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46b57fa700 1 -- 172.21.15.12:0/44157079 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f46b809fda0 con 0x7f46b80b76b0 2021-10-20T23:25:00.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:00.627 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:24:58.106627+0000","modified":"2021-10-20T23:24:59.110023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5944":{"gid":5944,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/242443509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":242443509},{"type":"v1","addr":"172.21.15.12:6833","nonce":242443509}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-20T23:25:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f469c0534f0 msgr2=0x7f469c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f469c0534f0 0x7f469c0559b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f46a000d000 tx=0x7f46a0009040).stop 2021-10-20T23:25:00.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b76b0 msgr2=0x7f46b80af7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:00.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b76b0 0x7f46b80af7a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f46a8002f70 tx=0x7f46a8014000).stop 2021-10-20T23:25:00.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 shutdown_connections 2021-10-20T23:25:00.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f469c0534f0 0x7f469c0559b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b814aeb0 0x7f46b809efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46b80b76b0 0x7f46b80af7a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 --2- 172.21.15.12:0/44157079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b80b2ee0 0x7f46b80a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:00.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 >> 172.21.15.12:0/44157079 conn(0x7f46b805f6b0 msgr2=0x7f46b8065b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:00.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 shutdown_connections 2021-10-20T23:25:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:00.623+0000 7f46bd67f700 1 -- 172.21.15.12:0/44157079 wait complete. 2021-10-20T23:25:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2021-10-20T23:25:00.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:24:58.106627+0000', 'modified': '2021-10-20T23:24:59.110023+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5944}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5944': {'gid': 5944, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6833/242443509', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6832', 'nonce': 242443509}, {'type': 'v1', 'addr': '172.21.15.12:6833', 'nonce': 242443509}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:25:00.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:25:00.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:25:01.063 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":5944,"want_state":"up:active","state":"up:active","rank_uptime":2.9399674600000001,"mdsmap_epoch":31,"osdmap_epoch":68,"osdmap_epoch_barrier":67,"uptime":7.2768053720000001} 2021-10-20T23:25:01.064 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 5944, "mdsmap_epoch": 31, "osdmap_epoch": 68, "osdmap_epoch_barrier": 67, "rank_uptime": 2.93996746, "state": "up:active", "uptime": 7.276805372, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:25:01.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:25:01.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f84a4d700 1 Processor -- start 2021-10-20T23:25:01.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f84a4d700 1 -- start start 2021-10-20T23:25:01.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f84a4d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f800b2580 0x7f6f8014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f84a4d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 0x7f6f8014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f84a4d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f800a70c0 con 0x7f6f800afbd0 2021-10-20T23:25:01.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f84a4d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f800a72f0 con 0x7f6f800b2580 2021-10-20T23:25:01.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f84a4d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800a7590 con 0x7f6f800b0010 2021-10-20T23:25:01.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f7f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f800b2580 0x7f6f8014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f7ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6f800afbd0 0x7f6f800a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38878/0 (socket says 172.21.15.12:38878) 2021-10-20T23:25:01.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f7ffff700 1 -- 172.21.15.12:0/4205082844 learned_addr learned my addr 172.21.15.12:0/4205082844 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:01.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f7effd700 1 --2- 172.21.15.12:0/4205082844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 0x7f6f8014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f7e7fc700 1 -- 172.21.15.12:0/4205082844 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553795549 0 0) 0x7f6f800a70c0 con 0x7f6f800afbd0 2021-10-20T23:25:01.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f7e7fc700 1 -- 172.21.15.12:0/4205082844 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f6c003260 con 0x7f6f800afbd0 2021-10-20T23:25:01.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f7f7fe700 1 -- 172.21.15.12:0/4205082844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 msgr2=0x7f6f8014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:01.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f7f7fe700 1 --2- 172.21.15.12:0/4205082844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 0x7f6f8014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.171+0000 7f6f7f7fe700 1 -- 172.21.15.12:0/4205082844 >> v1:172.21.15.12:6789/0 conn(0x7f6f800afbd0 legacy=0x7f6f800a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f7f7fe700 1 -- 172.21.15.12:0/4205082844 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800a7830 con 0x7f6f800b2580 2021-10-20T23:25:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f7f7fe700 1 --2- 172.21.15.12:0/4205082844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 0x7f6f8014ae40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f6f74002f70 tx=0x7f6f74006df0).ready entity=mon.0 client_cookie=68e7377f243dbb8f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f7e7fc700 1 -- 172.21.15.12:0/4205082844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7400d4a0 con 0x7f6f800b2580 2021-10-20T23:25:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f7e7fc700 1 -- 172.21.15.12:0/4205082844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74000e90 con 0x7f6f800b2580 2021-10-20T23:25:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f7e7fc700 1 -- 172.21.15.12:0/4205082844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7400d7f0 con 0x7f6f800b2580 2021-10-20T23:25:01.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 -- 172.21.15.12:0/4205082844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 msgr2=0x7f6f8014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 --2- 172.21.15.12:0/4205082844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 0x7f6f8014ae40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f6f74002f70 tx=0x7f6f74006df0).stop 2021-10-20T23:25:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 -- 172.21.15.12:0/4205082844 shutdown_connections 2021-10-20T23:25:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 --2- 172.21.15.12:0/4205082844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 0x7f6f8014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 --2- 172.21.15.12:0/4205082844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 0x7f6f8014ae40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 -- 172.21.15.12:0/4205082844 >> 172.21.15.12:0/4205082844 conn(0x7f6f80060180 msgr2=0x7f6f800b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 -- 172.21.15.12:0/4205082844 shutdown_connections 2021-10-20T23:25:01.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 -- 172.21.15.12:0/4205082844 wait complete. 2021-10-20T23:25:01.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 Processor -- start 2021-10-20T23:25:01.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.175+0000 7f6f84a4d700 1 -- start start 2021-10-20T23:25:01.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f84a4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800afbd0 0x7f6f80143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f84a4d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 0x7f6f800a9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f84a4d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 0x7f6f80159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f84a4d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800b47e0 con 0x7f6f800b2580 2021-10-20T23:25:01.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f84a4d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80156ef0 con 0x7f6f800afbd0 2021-10-20T23:25:01.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f84a4d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80157190 con 0x7f6f800b0010 2021-10-20T23:25:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 0x7f6f80159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 0x7f6f80159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40290/0 (socket says 172.21.15.12:40290) 2021-10-20T23:25:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7ffff700 1 -- 172.21.15.12:0/231373098 learned_addr learned my addr 172.21.15.12:0/231373098 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7effd700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 0x7f6f800a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7f7fe700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800afbd0 0x7f6f80143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7ffff700 1 -- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 msgr2=0x7f6f800a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7ffff700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 0x7f6f800a9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7ffff700 1 -- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800afbd0 msgr2=0x7f6f80143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7ffff700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800afbd0 0x7f6f80143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7ffff700 1 -- 172.21.15.12:0/231373098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7400b180 con 0x7f6f800b2580 2021-10-20T23:25:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7ffff700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 0x7f6f80159920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f6f78001490 tx=0x7f6f78007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7cff9700 1 -- 172.21.15.12:0/231373098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f78005ba0 con 0x7f6f800b2580 2021-10-20T23:25:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7cff9700 1 -- 172.21.15.12:0/231373098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f78005d00 con 0x7f6f800b2580 2021-10-20T23:25:01.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f800b4510 con 0x7f6f800b2580 2021-10-20T23:25:01.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7cff9700 1 -- 172.21.15.12:0/231373098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f780072c0 con 0x7f6f800b2580 2021-10-20T23:25:01.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f800b5c70 con 0x7f6f800b2580 2021-10-20T23:25:01.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7cff9700 1 -- 172.21.15.12:0/231373098 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f78010070 con 0x7f6f800b2580 2021-10-20T23:25:01.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f7cff9700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f600534f0 0x7f6f600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.179+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f80157350 con 0x7f6f800b2580 2021-10-20T23:25:01.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.183+0000 7f6f7cff9700 1 -- 172.21.15.12:0/231373098 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6f7806b310 con 0x7f6f800b2580 2021-10-20T23:25:01.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.183+0000 7f6f7f7fe700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f600534f0 0x7f6f600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.183+0000 7f6f7f7fe700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f600534f0 0x7f6f600559b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f6f7401a000 tx=0x7f6f74014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:01.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.191+0000 7f6f7cff9700 1 -- 172.21.15.12:0/231373098 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f78042270 con 0x7f6f800b2580 2021-10-20T23:25:01.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.319+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f80057350 con 0x7f6f800b2580 2021-10-20T23:25:01.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.319+0000 7f6f7cff9700 1 -- 172.21.15.12:0/231373098 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f6f78034090 con 0x7f6f800b2580 2021-10-20T23:25:01.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:01.325 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":68,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:24:59.110746+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:24:56.691138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-10-20T23:24:57.527415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:25:01.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f600534f0 msgr2=0x7f6f600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f600534f0 0x7f6f600559b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f6f7401a000 tx=0x7f6f74014000).stop 2021-10-20T23:25:01.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 msgr2=0x7f6f80159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 0x7f6f80159920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f6f78001490 tx=0x7f6f78007da0).stop 2021-10-20T23:25:01.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 shutdown_connections 2021-10-20T23:25:01.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f600534f0 0x7f6f600559b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f800b2580 0x7f6f80159920 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f800b0010 0x7f6f800a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 --2- 172.21.15.12:0/231373098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800afbd0 0x7f6f80143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 >> 172.21.15.12:0/231373098 conn(0x7f6f80060180 msgr2=0x7f6f80144a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:01.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 shutdown_connections 2021-10-20T23:25:01.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.323+0000 7f6f84a4d700 1 -- 172.21.15.12:0/231373098 wait complete. 2021-10-20T23:25:01.338 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:24:56.691138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:24:57.527415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:25:01.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:25:01.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0cedc01700 1 Processor -- start 2021-10-20T23:25:01.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0cedc01700 1 -- start start 2021-10-20T23:25:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0cedc01700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ce80ad320 0x7f0ce80af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0cedc01700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ad850 0x7f0ce80a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0cedc01700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce80afda0 con 0x7f0ce80af2c0 2021-10-20T23:25:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0cedc01700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce805c610 con 0x7f0ce80ad320 2021-10-20T23:25:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0cedc01700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8140800 con 0x7f0ce80ad850 2021-10-20T23:25:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0ce7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ce80ad320 0x7f0ce80af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0cecbff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0ce80af2c0 0x7f0ce8143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45952/0 (socket says 172.21.15.12:45952) 2021-10-20T23:25:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0cecbff700 1 -- 172.21.15.12:0/1162904724 learned_addr learned my addr 172.21.15.12:0/1162904724 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.451+0000 7f0ced400700 1 --2- 172.21.15.12:0/1162904724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ad850 0x7f0ce80a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce77fe700 1 -- 172.21.15.12:0/1162904724 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310528750 0 0) 0x7f0ce80afda0 con 0x7f0ce80af2c0 2021-10-20T23:25:01.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce77fe700 1 -- 172.21.15.12:0/1162904724 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd4003260 con 0x7f0ce80af2c0 2021-10-20T23:25:01.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce7fff700 1 -- 172.21.15.12:0/1162904724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ad850 msgr2=0x7f0ce80a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:01.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce7fff700 1 --2- 172.21.15.12:0/1162904724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ad850 0x7f0ce80a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce7fff700 1 -- 172.21.15.12:0/1162904724 >> v1:172.21.15.31:6789/0 conn(0x7f0ce80af2c0 legacy=0x7f0ce8143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce7fff700 1 -- 172.21.15.12:0/1162904724 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8143860 con 0x7f0ce80ad320 2021-10-20T23:25:01.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ced400700 1 --2- 172.21.15.12:0/1162904724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ad850 0x7f0ce80a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:01.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce7fff700 1 --2- 172.21.15.12:0/1162904724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad320 0x7f0ce80af6a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f0ce80ad770 tx=0x7f0cdc006df0).ready entity=mon.0 client_cookie=304f2f7dfc31e946 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:01.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce77fe700 1 -- 172.21.15.12:0/1162904724 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cdc00d570 con 0x7f0ce80ad320 2021-10-20T23:25:01.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce77fe700 1 -- 172.21.15.12:0/1162904724 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc000e90 con 0x7f0ce80ad320 2021-10-20T23:25:01.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0ce77fe700 1 -- 172.21.15.12:0/1162904724 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cdc00d8c0 con 0x7f0ce80ad320 2021-10-20T23:25:01.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 -- 172.21.15.12:0/1162904724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad320 msgr2=0x7f0ce80af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 --2- 172.21.15.12:0/1162904724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad320 0x7f0ce80af6a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f0ce80ad770 tx=0x7f0cdc006df0).stop 2021-10-20T23:25:01.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 -- 172.21.15.12:0/1162904724 shutdown_connections 2021-10-20T23:25:01.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 --2- 172.21.15.12:0/1162904724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ad850 0x7f0ce80a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 --2- 172.21.15.12:0/1162904724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad320 0x7f0ce80af6a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 -- 172.21.15.12:0/1162904724 >> 172.21.15.12:0/1162904724 conn(0x7f0ce8061140 msgr2=0x7f0ce8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 -- 172.21.15.12:0/1162904724 shutdown_connections 2021-10-20T23:25:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 -- 172.21.15.12:0/1162904724 wait complete. 2021-10-20T23:25:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 Processor -- start 2021-10-20T23:25:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.455+0000 7f0cedc01700 1 -- start start 2021-10-20T23:25:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cedc01700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad850 0x7f0ce80ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cedc01700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce80af2c0 0x7f0ce80aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cedc01700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ac5a0 0x7f0ce80aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cedc01700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80ab2b0 con 0x7f0ce80ad850 2021-10-20T23:25:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cedc01700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80b6040 con 0x7f0ce80af2c0 2021-10-20T23:25:01.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cedc01700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80b6710 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cecbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad850 0x7f0ce80ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ce7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce80af2c0 0x7f0ce80aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ced400700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ac5a0 0x7f0ce80aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cecbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad850 0x7f0ce80ac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40300/0 (socket says 172.21.15.12:40300) 2021-10-20T23:25:01.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cecbff700 1 -- 172.21.15.12:0/3694315688 learned_addr learned my addr 172.21.15.12:0/3694315688 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:01.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ced400700 1 -- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce80af2c0 msgr2=0x7f0ce80aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ced400700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce80af2c0 0x7f0ce80aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ced400700 1 -- 172.21.15.12:0/3694315688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad850 msgr2=0x7f0ce80ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ced400700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad850 0x7f0ce80ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ced400700 1 -- 172.21.15.12:0/3694315688 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce000b180 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cecbff700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad850 0x7f0ce80ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ced400700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ac5a0 0x7f0ce80aa5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0ce80a9560 tx=0x7f0ce0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ce5ffb700 1 -- 172.21.15.12:0/3694315688 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce0010780 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ce5ffb700 1 -- 172.21.15.12:0/3694315688 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce00108e0 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0ce5ffb700 1 -- 172.21.15.12:0/3694315688 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce0010c40 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc00b180 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.459+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce80b6270 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.463+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce80b6400 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.463+0000 7f0ce5ffb700 1 -- 172.21.15.12:0/3694315688 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ce001c460 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.463+0000 7f0ce5ffb700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc80536d0 0x7f0cc8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.463+0000 7f0ce5ffb700 1 -- 172.21.15.12:0/3694315688 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0ce006c0b0 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.463+0000 7f0cecbff700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc80536d0 0x7f0cc8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.463+0000 7f0cecbff700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc80536d0 0x7f0cc8055b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f0cd800d000 tx=0x7f0cd8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:01.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.471+0000 7f0ce5ffb700 1 -- 172.21.15.12:0/3694315688 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ce0042ec0 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.599+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0ce8057350 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.599+0000 7f0ce5ffb700 1 -- 172.21.15.12:0/3694315688 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v68) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0ce00464e0 con 0x7f0ce80ac5a0 2021-10-20T23:25:01.604 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:25:01.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc80536d0 msgr2=0x7f0cc8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc80536d0 0x7f0cc8055b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f0cd800d000 tx=0x7f0cd8009040).stop 2021-10-20T23:25:01.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ac5a0 msgr2=0x7f0ce80aa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ac5a0 0x7f0ce80aa5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0ce80a9560 tx=0x7f0ce0006df0).stop 2021-10-20T23:25:01.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 shutdown_connections 2021-10-20T23:25:01.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc80536d0 0x7f0cc8055b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce80ac5a0 0x7f0ce80aa5b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce80af2c0 0x7f0ce80aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 --2- 172.21.15.12:0/3694315688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce80ad850 0x7f0ce80ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 >> 172.21.15.12:0/3694315688 conn(0x7f0ce8061140 msgr2=0x7f0ce813db10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:01.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 shutdown_connections 2021-10-20T23:25:01.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.603+0000 7f0cedc01700 1 -- 172.21.15.12:0/3694315688 wait complete. 2021-10-20T23:25:01.623 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:25:01.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f5805085700 1 Processor -- start 2021-10-20T23:25:01.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f5805085700 1 -- start start 2021-10-20T23:25:01.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f5805085700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58000b12d0 0x7f58000affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f5805085700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f58000b22a0 0x7f5800141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f5805085700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58000a77d0 con 0x7f58000b1ec0 2021-10-20T23:25:01.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f5805085700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58000b1740 con 0x7f58000b22a0 2021-10-20T23:25:01.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f5805085700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58000b0650 con 0x7f58000b12d0 2021-10-20T23:25:01.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57ff59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f58000b22a0 0x7f5800141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fe59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58000b12d0 0x7f58000affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fe59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58000b12d0 0x7f58000affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:55284/0 (socket says 172.21.15.12:55284) 2021-10-20T23:25:01.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fe59c700 1 -- 172.21.15.12:0/3181905975 learned_addr learned my addr 172.21.15.12:0/3181905975 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:01.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fed9d700 1 --1- 172.21.15.12:0/3181905975 >> v1:172.21.15.31:6789/0 conn(0x7f58000b1ec0 0x7f58000a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:45966/0 (socket says 172.21.15.12:45966) 2021-10-20T23:25:01.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fe59c700 1 -- 172.21.15.12:0/3181905975 >> v2:172.21.15.12:3300/0 conn(0x7f58000b22a0 msgr2=0x7f5800141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:01.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fe59c700 1 --2- 172.21.15.12:0/3181905975 >> v2:172.21.15.12:3300/0 conn(0x7f58000b22a0 0x7f5800141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fe59c700 1 -- 172.21.15.12:0/3181905975 >> v1:172.21.15.31:6789/0 conn(0x7f58000b1ec0 legacy=0x7f58000a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fe59c700 1 -- 172.21.15.12:0/3181905975 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000b08f0 con 0x7f58000b12d0 2021-10-20T23:25:01.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fdd9b700 1 -- 172.21.15.12:0/3181905975 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418413965 0 0) 0x7f58000a77d0 con 0x7f58000b1ec0 2021-10-20T23:25:01.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fe59c700 1 --2- 172.21.15.12:0/3181905975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 0x7f58000affb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f57f4002f70 tx=0x7f57f4006eb0).ready entity=mon.1 client_cookie=ba254d70656bc026 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:01.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fdd9b700 1 -- 172.21.15.12:0/3181905975 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f400d5c0 con 0x7f58000b12d0 2021-10-20T23:25:01.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fdd9b700 1 -- 172.21.15.12:0/3181905975 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f4000e90 con 0x7f58000b12d0 2021-10-20T23:25:01.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f57fdd9b700 1 -- 172.21.15.12:0/3181905975 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f400d910 con 0x7f58000b12d0 2021-10-20T23:25:01.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.755+0000 7f5805085700 1 -- 172.21.15.12:0/3181905975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 msgr2=0x7f58000affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 --2- 172.21.15.12:0/3181905975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 0x7f58000affb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f57f4002f70 tx=0x7f57f4006eb0).stop 2021-10-20T23:25:01.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 -- 172.21.15.12:0/3181905975 shutdown_connections 2021-10-20T23:25:01.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 --2- 172.21.15.12:0/3181905975 >> v2:172.21.15.12:3300/0 conn(0x7f58000b22a0 0x7f5800141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 --2- 172.21.15.12:0/3181905975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 0x7f58000affb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 -- 172.21.15.12:0/3181905975 >> 172.21.15.12:0/3181905975 conn(0x7f580005f6b0 msgr2=0x7f580005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:01.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 -- 172.21.15.12:0/3181905975 shutdown_connections 2021-10-20T23:25:01.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 -- 172.21.15.12:0/3181905975 wait complete. 2021-10-20T23:25:01.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 Processor -- start 2021-10-20T23:25:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 -- start start 2021-10-20T23:25:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 0x7f580013f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58000b1ec0 0x7f580014a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58000b22a0 0x7f58000abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58001402d0 con 0x7f58000b1ec0 2021-10-20T23:25:01.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580014b450 con 0x7f58000b12d0 2021-10-20T23:25:01.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f5805085700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580014b6f0 con 0x7f58000b22a0 2021-10-20T23:25:01.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fe59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58000b1ec0 0x7f580014a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fe59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58000b1ec0 0x7f580014a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40314/0 (socket says 172.21.15.12:40314) 2021-10-20T23:25:01.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fe59c700 1 -- 172.21.15.12:0/2935422189 learned_addr learned my addr 172.21.15.12:0/2935422189 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:01.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fed9d700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 0x7f580013f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57ff59e700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58000b22a0 0x7f58000abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fe59c700 1 -- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58000b22a0 msgr2=0x7f58000abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fe59c700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58000b22a0 0x7f58000abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fe59c700 1 -- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 msgr2=0x7f580013f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fe59c700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 0x7f580013f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fe59c700 1 -- 172.21.15.12:0/2935422189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f400b1e0 con 0x7f58000b1ec0 2021-10-20T23:25:01.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.759+0000 7f57fed9d700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 0x7f580013f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:01.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f57fe59c700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58000b1ec0 0x7f580014a5d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f57f4002f70 tx=0x7f57f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:01.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f57effff700 1 -- 172.21.15.12:0/2935422189 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f400d960 con 0x7f58000b1ec0 2021-10-20T23:25:01.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f57effff700 1 -- 172.21.15.12:0/2935422189 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f4011b80 con 0x7f58000b1ec0 2021-10-20T23:25:01.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580014b990 con 0x7f58000b1ec0 2021-10-20T23:25:01.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f57effff700 1 -- 172.21.15.12:0/2935422189 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f401e460 con 0x7f58000b1ec0 2021-10-20T23:25:01.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5800149460 con 0x7f58000b1ec0 2021-10-20T23:25:01.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5800057350 con 0x7f58000b1ec0 2021-10-20T23:25:01.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f57effff700 1 -- 172.21.15.12:0/2935422189 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f57f4025030 con 0x7f58000b1ec0 2021-10-20T23:25:01.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f57effff700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57dc053610 0x7f57dc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:01.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f57effff700 1 -- 172.21.15.12:0/2935422189 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f57f406cb70 con 0x7f58000b1ec0 2021-10-20T23:25:01.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.763+0000 7f57fed9d700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57dc053610 0x7f57dc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:01.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.767+0000 7f57fed9d700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57dc053610 0x7f57dc055ad0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f57f000d000 tx=0x7f57f0007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:01.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.771+0000 7f57effff700 1 -- 172.21.15.12:0/2935422189 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f57f4043b70 con 0x7f58000b1ec0 2021-10-20T23:25:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f58000ac760 con 0x7f58000b1ec0 2021-10-20T23:25:01.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f57effff700 1 -- 172.21.15.12:0/2935422189 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f57f4023070 con 0x7f58000b1ec0 2021-10-20T23:25:01.905 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:01.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57dc053610 msgr2=0x7f57dc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57dc053610 0x7f57dc055ad0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f57f000d000 tx=0x7f57f0007a00).stop 2021-10-20T23:25:01.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58000b1ec0 msgr2=0x7f580014a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:01.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58000b1ec0 0x7f580014a5d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f57f4002f70 tx=0x7f57f4015000).stop 2021-10-20T23:25:01.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 shutdown_connections 2021-10-20T23:25:01.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57dc053610 0x7f57dc055ad0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58000b22a0 0x7f58000abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58000b1ec0 0x7f580014a5d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 --2- 172.21.15.12:0/2935422189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58000b12d0 0x7f580013f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:01.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 >> 172.21.15.12:0/2935422189 conn(0x7f580005f6b0 msgr2=0x7f58000af500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:01.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 shutdown_connections 2021-10-20T23:25:01.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:01.899+0000 7f5805085700 1 -- 172.21.15.12:0/2935422189 wait complete. 2021-10-20T23:25:01.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:25:02.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 Processor -- start 2021-10-20T23:25:02.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 -- start start 2021-10-20T23:25:02.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3fc0b5990 0x7fe3fc0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc143f60 con 0x7fe3fc0b6560 2021-10-20T23:25:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc05ffe0 con 0x7fe3fc05fc00 2021-10-20T23:25:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0ba6b0 con 0x7fe3fc0b5990 2021-10-20T23:25:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3fa7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe3fc0b6560 0x7fe3fc0b4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38918/0 (socket says 172.21.15.12:38918) 2021-10-20T23:25:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3fa7fc700 1 -- 172.21.15.12:0/3752932765 learned_addr learned my addr 172.21.15.12:0/3752932765 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3fb7fe700 1 --2- 172.21.15.12:0/3752932765 >> v2:172.21.15.31:3300/0 conn(0x7fe3fc0b5990 0x7fe3fc0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3f9ffb700 1 -- 172.21.15.12:0/3752932765 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652902869 0 0) 0x7fe3fc143f60 con 0x7fe3fc0b6560 2021-10-20T23:25:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3f9ffb700 1 -- 172.21.15.12:0/3752932765 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e0003260 con 0x7fe3fc0b6560 2021-10-20T23:25:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3fb7fe700 1 -- 172.21.15.12:0/3752932765 >> v1:172.21.15.31:6789/0 conn(0x7fe3fc05fc00 legacy=0x7fe3fc0b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3fb7fe700 1 -- 172.21.15.12:0/3752932765 >> v1:172.21.15.12:6789/0 conn(0x7fe3fc0b6560 legacy=0x7fe3fc0b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3fb7fe700 1 -- 172.21.15.12:0/3752932765 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc143a50 con 0x7fe3fc0b5990 2021-10-20T23:25:02.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3fb7fe700 1 --2- 172.21.15.12:0/3752932765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc0b5990 0x7fe3fc0b41b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fe3f4002f70 tx=0x7fe3f4006df0).ready entity=mon.1 client_cookie=ad2627841342b6f4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:02.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3f9ffb700 1 -- 172.21.15.12:0/3752932765 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3f400d610 con 0x7fe3fc0b5990 2021-10-20T23:25:02.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3f9ffb700 1 -- 172.21.15.12:0/3752932765 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f4000e90 con 0x7fe3fc0b5990 2021-10-20T23:25:02.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe3f9ffb700 1 -- 172.21.15.12:0/3752932765 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3f400d960 con 0x7fe3fc0b5990 2021-10-20T23:25:02.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 -- 172.21.15.12:0/3752932765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc0b5990 msgr2=0x7fe3fc0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 --2- 172.21.15.12:0/3752932765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc0b5990 0x7fe3fc0b41b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fe3f4002f70 tx=0x7fe3f4006df0).stop 2021-10-20T23:25:02.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 -- 172.21.15.12:0/3752932765 shutdown_connections 2021-10-20T23:25:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 --2- 172.21.15.12:0/3752932765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc0b5990 0x7fe3fc0b41b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.027+0000 7fe4015a8700 1 -- 172.21.15.12:0/3752932765 >> 172.21.15.12:0/3752932765 conn(0x7fe3fc0623a0 msgr2=0x7fe3fc066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 -- 172.21.15.12:0/3752932765 shutdown_connections 2021-10-20T23:25:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 -- 172.21.15.12:0/3752932765 wait complete. 2021-10-20T23:25:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 Processor -- start 2021-10-20T23:25:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 -- start start 2021-10-20T23:25:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3fc05fc00 0x7fe3fc142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc0b5990 0x7fe3fc0ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc0b6560 0x7fe3fc126ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0afeb0 con 0x7fe3fc05fc00 2021-10-20T23:25:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0aee30 con 0x7fe3fc0b6560 2021-10-20T23:25:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0af320 con 0x7fe3fc0b5990 2021-10-20T23:25:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3faffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3fc05fc00 0x7fe3fc142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3faffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3fc05fc00 0x7fe3fc142750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40328/0 (socket says 172.21.15.12:40328) 2021-10-20T23:25:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3faffd700 1 -- 172.21.15.12:0/301776817 learned_addr learned my addr 172.21.15.12:0/301776817 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3fb7fe700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc0b6560 0x7fe3fc126ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3fa7fc700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc0b5990 0x7fe3fc0ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3faffd700 1 -- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc0b5990 msgr2=0x7fe3fc0ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3faffd700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc0b5990 0x7fe3fc0ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3faffd700 1 -- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc0b6560 msgr2=0x7fe3fc126ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3faffd700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc0b6560 0x7fe3fc126ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3faffd700 1 -- 172.21.15.12:0/301776817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f400b180 con 0x7fe3fc05fc00 2021-10-20T23:25:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3faffd700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3fc05fc00 0x7fe3fc142750 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fe3fc0b19e0 tx=0x7fe3ec007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3ebfff700 1 -- 172.21.15.12:0/301776817 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ec012400 con 0x7fe3fc05fc00 2021-10-20T23:25:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc0b0070 con 0x7fe3fc05fc00 2021-10-20T23:25:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc0af080 con 0x7fe3fc05fc00 2021-10-20T23:25:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3ebfff700 1 -- 172.21.15.12:0/301776817 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec007020 con 0x7fe3fc05fc00 2021-10-20T23:25:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.031+0000 7fe3ebfff700 1 -- 172.21.15.12:0/301776817 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ec007380 con 0x7fe3fc05fc00 2021-10-20T23:25:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.035+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc003410 con 0x7fe3fc05fc00 2021-10-20T23:25:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.035+0000 7fe3ebfff700 1 -- 172.21.15.12:0/301776817 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe3ec019060 con 0x7fe3fc05fc00 2021-10-20T23:25:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.035+0000 7fe3ebfff700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3d80536a0 0x7fe3d8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.035+0000 7fe3ebfff700 1 -- 172.21.15.12:0/301776817 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe3ec06ae70 con 0x7fe3fc05fc00 2021-10-20T23:25:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.035+0000 7fe3fa7fc700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3d80536a0 0x7fe3d8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.035+0000 7fe3fa7fc700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3d80536a0 0x7fe3d8055b60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fe3f000b000 tx=0x7fe3f0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.043+0000 7fe3ebfff700 1 -- 172.21.15.12:0/301776817 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3ec041d70 con 0x7fe3fc05fc00 2021-10-20T23:25:02.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.171+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3dc003c40 con 0x7fe3fc05fc00 2021-10-20T23:25:02.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.171+0000 7fe3ebfff700 1 -- 172.21.15.12:0/301776817 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe3ec045390 con 0x7fe3fc05fc00 2021-10-20T23:25:02.177 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:02.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3d80536a0 msgr2=0x7fe3d8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3d80536a0 0x7fe3d8055b60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fe3f000b000 tx=0x7fe3f0009040).stop 2021-10-20T23:25:02.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3fc05fc00 msgr2=0x7fe3fc142750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3fc05fc00 0x7fe3fc142750 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fe3fc0b19e0 tx=0x7fe3ec007c50).stop 2021-10-20T23:25:02.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 shutdown_connections 2021-10-20T23:25:02.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3d80536a0 0x7fe3d8055b60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc0b6560 0x7fe3fc126ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc0b5990 0x7fe3fc0ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 --2- 172.21.15.12:0/301776817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3fc05fc00 0x7fe3fc142750 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 >> 172.21.15.12:0/301776817 conn(0x7fe3fc0623a0 msgr2=0x7fe3fc12c160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:02.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 shutdown_connections 2021-10-20T23:25:02.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.175+0000 7fe4015a8700 1 -- 172.21.15.12:0/301776817 wait complete. 2021-10-20T23:25:02.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:25:02.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.299+0000 7fc110ba0700 1 Processor -- start 2021-10-20T23:25:02.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 -- start start 2021-10-20T23:25:02.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c13e740 0x7fc10c141080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10c0aaa90 con 0x7fc10c0b2720 2021-10-20T23:25:02.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10c0b2b00 con 0x7fc10c0b0ff0 2021-10-20T23:25:02.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c140c90 con 0x7fc10c13e740 2021-10-20T23:25:02.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc10c0b2720 0x7fc10c13e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38930/0 (socket says 172.21.15.12:38930) 2021-10-20T23:25:02.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10b7fe700 1 -- 172.21.15.12:0/509843325 learned_addr learned my addr 172.21.15.12:0/509843325 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:02.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10affd700 1 --2- 172.21.15.12:0/509843325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c13e740 0x7fc10c141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10a7fc700 1 -- 172.21.15.12:0/509843325 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236963584 0 0) 0x7fc100001110 con 0x7fc10c0b2720 2021-10-20T23:25:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10a7fc700 1 -- 172.21.15.12:0/509843325 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f8003260 con 0x7fc10c0b2720 2021-10-20T23:25:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10a7fc700 1 -- 172.21.15.12:0/509843325 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720468427 0 0) 0x7fc10c0b2b00 con 0x7fc10c0b0ff0 2021-10-20T23:25:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10a7fc700 1 -- 172.21.15.12:0/509843325 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc100001110 con 0x7fc10c0b0ff0 2021-10-20T23:25:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10affd700 1 -- 172.21.15.12:0/509843325 >> v1:172.21.15.31:6789/0 conn(0x7fc10c0b0ff0 legacy=0x7fc10c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10affd700 1 -- 172.21.15.12:0/509843325 >> v1:172.21.15.12:6789/0 conn(0x7fc10c0b2720 legacy=0x7fc10c13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10affd700 1 -- 172.21.15.12:0/509843325 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c0aa2b0 con 0x7fc10c13e740 2021-10-20T23:25:02.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10affd700 1 --2- 172.21.15.12:0/509843325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c13e740 0x7fc10c141080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc0fc002f70 tx=0x7fc0fc006df0).ready entity=mon.2 client_cookie=a8658c13240af06a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:02.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10a7fc700 1 -- 172.21.15.12:0/509843325 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0fc00d5c0 con 0x7fc10c13e740 2021-10-20T23:25:02.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10a7fc700 1 -- 172.21.15.12:0/509843325 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc000e90 con 0x7fc10c13e740 2021-10-20T23:25:02.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc10a7fc700 1 -- 172.21.15.12:0/509843325 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0fc00d910 con 0x7fc10c13e740 2021-10-20T23:25:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 -- 172.21.15.12:0/509843325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c13e740 msgr2=0x7fc10c141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 --2- 172.21.15.12:0/509843325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c13e740 0x7fc10c141080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc0fc002f70 tx=0x7fc0fc006df0).stop 2021-10-20T23:25:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 -- 172.21.15.12:0/509843325 shutdown_connections 2021-10-20T23:25:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 --2- 172.21.15.12:0/509843325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c13e740 0x7fc10c141080 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 -- 172.21.15.12:0/509843325 >> 172.21.15.12:0/509843325 conn(0x7fc10c060180 msgr2=0x7fc10c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 -- 172.21.15.12:0/509843325 shutdown_connections 2021-10-20T23:25:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.303+0000 7fc110ba0700 1 -- 172.21.15.12:0/509843325 wait complete. 2021-10-20T23:25:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 Processor -- start 2021-10-20T23:25:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 -- start start 2021-10-20T23:25:02.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c0b0ff0 0x7fc10c066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10c0b2720 0x7fc10c150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc10c150770 0x7fc10c13b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c064560 con 0x7fc10c0b2720 2021-10-20T23:25:02.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c14fe50 con 0x7fc10c150770 2021-10-20T23:25:02.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c063000 con 0x7fc10c0b0ff0 2021-10-20T23:25:02.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10c0b2720 0x7fc10c150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10c0b2720 0x7fc10c150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40342/0 (socket says 172.21.15.12:40342) 2021-10-20T23:25:02.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10affd700 1 -- 172.21.15.12:0/595148325 learned_addr learned my addr 172.21.15.12:0/595148325 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:02.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10b7fe700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c0b0ff0 0x7fc10c066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10bfff700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc10c150770 0x7fc10c13b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10affd700 1 -- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c0b0ff0 msgr2=0x7fc10c066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10affd700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c0b0ff0 0x7fc10c066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10affd700 1 -- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc10c150770 msgr2=0x7fc10c13b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10affd700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc10c150770 0x7fc10c13b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10affd700 1 -- 172.21.15.12:0/595148325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc00b180 con 0x7fc10c0b2720 2021-10-20T23:25:02.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc10affd700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10c0b2720 0x7fc10c150280 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fc0fc002f70 tx=0x7fc0fc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:02.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc108ff9700 1 -- 172.21.15.12:0/595148325 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0fc016070 con 0x7fc10c0b2720 2021-10-20T23:25:02.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc108ff9700 1 -- 172.21.15.12:0/595148325 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc0137d0 con 0x7fc10c0b2720 2021-10-20T23:25:02.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c064790 con 0x7fc10c0b2720 2021-10-20T23:25:02.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc108ff9700 1 -- 172.21.15.12:0/595148325 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0fc013b30 con 0x7fc10c0b2720 2021-10-20T23:25:02.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.307+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c143bb0 con 0x7fc10c0b2720 2021-10-20T23:25:02.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.311+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c057350 con 0x7fc10c0b2720 2021-10-20T23:25:02.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.311+0000 7fc108ff9700 1 -- 172.21.15.12:0/595148325 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc0fc025030 con 0x7fc10c0b2720 2021-10-20T23:25:02.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.311+0000 7fc108ff9700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0ec0536a0 0x7fc0ec055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.311+0000 7fc108ff9700 1 -- 172.21.15.12:0/595148325 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc0fc06ca50 con 0x7fc10c0b2720 2021-10-20T23:25:02.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.311+0000 7fc10b7fe700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0ec0536a0 0x7fc0ec055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.311+0000 7fc10b7fe700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0ec0536a0 0x7fc0ec055b60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fc10000d000 tx=0x7fc100009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:02.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.315+0000 7fc108ff9700 1 -- 172.21.15.12:0/595148325 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0fc043940 con 0x7fc10c0b2720 2021-10-20T23:25:02.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.443+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc10c0698e0 con 0x7fc10c0b2720 2021-10-20T23:25:02.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.443+0000 7fc108ff9700 1 -- 172.21.15.12:0/595148325 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc0fc0230a0 con 0x7fc10c0b2720 2021-10-20T23:25:02.449 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0ec0536a0 msgr2=0x7fc0ec055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0ec0536a0 0x7fc0ec055b60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fc10000d000 tx=0x7fc100009040).stop 2021-10-20T23:25:02.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10c0b2720 msgr2=0x7fc10c150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10c0b2720 0x7fc10c150280 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fc0fc002f70 tx=0x7fc0fc014000).stop 2021-10-20T23:25:02.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 shutdown_connections 2021-10-20T23:25:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0ec0536a0 0x7fc0ec055b60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc10c150770 0x7fc10c13b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10c0b2720 0x7fc10c150280 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 --2- 172.21.15.12:0/595148325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc10c0b0ff0 0x7fc10c066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 >> 172.21.15.12:0/595148325 conn(0x7fc10c060180 msgr2=0x7fc10c13dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:02.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 shutdown_connections 2021-10-20T23:25:02.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.447+0000 7fc110ba0700 1 -- 172.21.15.12:0/595148325 wait complete. 2021-10-20T23:25:02.467 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:25:02.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:02.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 Processor -- start 2021-10-20T23:25:02.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 -- start start 2021-10-20T23:25:02.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07800b1db0 0x7f07800b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07801483a0 0x7f07800b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07800b0350 con 0x7f07800a70c0 2021-10-20T23:25:02.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07800a90c0 con 0x7f07801483a0 2021-10-20T23:25:02.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07800b05f0 con 0x7f07800b1db0 2021-10-20T23:25:02.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07801483a0 0x7f07800b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07801483a0 0x7f07800b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40350/0 (socket says 172.21.15.12:40350) 2021-10-20T23:25:02.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077e7fc700 1 -- 172.21.15.12:0/2977567351 learned_addr learned my addr 172.21.15.12:0/2977567351 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:02.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077effd700 1 --2- 172.21.15.12:0/2977567351 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07800b1db0 0x7f07800b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077e7fc700 1 -- 172.21.15.12:0/2977567351 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07800b1db0 msgr2=0x7f07800b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:02.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077e7fc700 1 --2- 172.21.15.12:0/2977567351 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07800b1db0 0x7f07800b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077dffb700 1 -- 172.21.15.12:0/2977567351 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935189003 0 0) 0x7f07800b0350 con 0x7f07800a70c0 2021-10-20T23:25:02.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077e7fc700 1 -- 172.21.15.12:0/2977567351 >> v1:172.21.15.12:6789/0 conn(0x7f07800a70c0 legacy=0x7f0780144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077e7fc700 1 -- 172.21.15.12:0/2977567351 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07800b0890 con 0x7f07801483a0 2021-10-20T23:25:02.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077e7fc700 1 --2- 172.21.15.12:0/2977567351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07801483a0 0x7f07800b2190 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f0768002f70 tx=0x7f0768006eb0).ready entity=mon.0 client_cookie=a5eee2d63523cb41 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:02.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077dffb700 1 -- 172.21.15.12:0/2977567351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076800d570 con 0x7f07801483a0 2021-10-20T23:25:02.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077dffb700 1 -- 172.21.15.12:0/2977567351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768000e90 con 0x7f07801483a0 2021-10-20T23:25:02.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f077dffb700 1 -- 172.21.15.12:0/2977567351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076800d8c0 con 0x7f07801483a0 2021-10-20T23:25:02.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 -- 172.21.15.12:0/2977567351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07801483a0 msgr2=0x7f07800b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 --2- 172.21.15.12:0/2977567351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07801483a0 0x7f07800b2190 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f0768002f70 tx=0x7f0768006eb0).stop 2021-10-20T23:25:02.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 -- 172.21.15.12:0/2977567351 shutdown_connections 2021-10-20T23:25:02.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 --2- 172.21.15.12:0/2977567351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07801483a0 0x7f07800b2190 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 --2- 172.21.15.12:0/2977567351 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07800b1db0 0x7f07800b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 -- 172.21.15.12:0/2977567351 >> 172.21.15.12:0/2977567351 conn(0x7f078005f6b0 msgr2=0x7f078005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:02.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 -- 172.21.15.12:0/2977567351 shutdown_connections 2021-10-20T23:25:02.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.571+0000 7f07852f2700 1 -- 172.21.15.12:0/2977567351 wait complete. 2021-10-20T23:25:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 Processor -- start 2021-10-20T23:25:02.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 -- start start 2021-10-20T23:25:02.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07800a70c0 0x7f07800ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07800b1db0 0x7f0780148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07801483a0 0x7f07801572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07801569b0 con 0x7f07800b1db0 2021-10-20T23:25:02.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078014af90 con 0x7f07800a70c0 2021-10-20T23:25:02.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0780156ba0 con 0x7f07801483a0 2021-10-20T23:25:02.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07800b1db0 0x7f0780148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07800b1db0 0x7f0780148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40358/0 (socket says 172.21.15.12:40358) 2021-10-20T23:25:02.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077e7fc700 1 -- 172.21.15.12:0/640182167 learned_addr learned my addr 172.21.15.12:0/640182167 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:02.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077effd700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07800a70c0 0x7f07800ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077f7fe700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07801483a0 0x7f07801572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077e7fc700 1 -- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07801483a0 msgr2=0x7f07801572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077e7fc700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07801483a0 0x7f07801572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077e7fc700 1 -- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07800a70c0 msgr2=0x7f07800ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077e7fc700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07800a70c0 0x7f07800ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077e7fc700 1 -- 172.21.15.12:0/640182167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076800b1e0 con 0x7f07800b1db0 2021-10-20T23:25:02.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f077e7fc700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07800b1db0 0x7f0780148b00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f07800aa660 tx=0x7f0768015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:02.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f0777fff700 1 -- 172.21.15.12:0/640182167 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076800d910 con 0x7f07800b1db0 2021-10-20T23:25:02.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078014acf0 con 0x7f07800b1db0 2021-10-20T23:25:02.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f0777fff700 1 -- 172.21.15.12:0/640182167 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768011bf0 con 0x7f07800b1db0 2021-10-20T23:25:02.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f0777fff700 1 -- 172.21.15.12:0/640182167 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076801e460 con 0x7f07800b1db0 2021-10-20T23:25:02.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.575+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07800ae7a0 con 0x7f07800b1db0 2021-10-20T23:25:02.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.579+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078014a2e0 con 0x7f07800b1db0 2021-10-20T23:25:02.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.579+0000 7f0777fff700 1 -- 172.21.15.12:0/640182167 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0768025030 con 0x7f07800b1db0 2021-10-20T23:25:02.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.579+0000 7f0777fff700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0764053610 0x7f0764055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:02.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.579+0000 7f0777fff700 1 -- 172.21.15.12:0/640182167 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f076806cbf0 con 0x7f07800b1db0 2021-10-20T23:25:02.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.579+0000 7f077effd700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0764053610 0x7f0764055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:02.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.579+0000 7f077effd700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0764053610 0x7f0764055ad0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f077000b000 tx=0x7f0770006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:02.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.583+0000 7f0777fff700 1 -- 172.21.15.12:0/640182167 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0768043b50 con 0x7f07800b1db0 2021-10-20T23:25:02.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.751+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0780157930 con 0x7f07800b1db0 2021-10-20T23:25:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.751+0000 7f0777fff700 1 -- 172.21.15.12:0/640182167 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f0768023020 con 0x7f07800b1db0 2021-10-20T23:25:02.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:02.757 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:24:58.106627+0000","modified":"2021-10-20T23:24:59.110023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5944":{"gid":5944,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/242443509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":242443509},{"type":"v1","addr":"172.21.15.12:6833","nonce":242443509}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-20T23:25:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0764053610 msgr2=0x7f0764055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0764053610 0x7f0764055ad0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f077000b000 tx=0x7f0770006df0).stop 2021-10-20T23:25:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07800b1db0 msgr2=0x7f0780148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07800b1db0 0x7f0780148b00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f07800aa660 tx=0x7f0768015000).stop 2021-10-20T23:25:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 shutdown_connections 2021-10-20T23:25:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0764053610 0x7f0764055ad0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07801483a0 0x7f07801572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07800b1db0 0x7f0780148b00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 --2- 172.21.15.12:0/640182167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07800a70c0 0x7f07800ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:02.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 >> 172.21.15.12:0/640182167 conn(0x7f078005f6b0 msgr2=0x7f0780146f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 shutdown_connections 2021-10-20T23:25:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:02.755+0000 7f07852f2700 1 -- 172.21.15.12:0/640182167 wait complete. 2021-10-20T23:25:02.766 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2021-10-20T23:25:03.071 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:24:58.106627+0000', 'modified': '2021-10-20T23:24:59.110023+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5944}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5944': {'gid': 5944, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6833/242443509', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6832', 'nonce': 242443509}, {'type': 'v1', 'addr': '172.21.15.12:6833', 'nonce': 242443509}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:25:03.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:25:03.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:25:03.189 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":5944,"want_state":"up:active","state":"up:active","rank_uptime":5.0659658280000004,"mdsmap_epoch":31,"osdmap_epoch":68,"osdmap_epoch_barrier":67,"uptime":9.4028000120000002} 2021-10-20T23:25:03.189 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 5944, "mdsmap_epoch": 31, "osdmap_epoch": 68, "osdmap_epoch_barrier": 67, "rank_uptime": 5.065965828, "state": "up:active", "uptime": 9.402800012, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:25:03.190 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:25:03.190 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:25:03.191 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:25:03.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:03.192 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:03.200 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:25:03.216 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:25:03.217 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:25:03.276 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:25:03.278 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:25:03.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:03.280 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:25:03.286 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:25:03.287 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:03.290 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:25:03.309 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:25:03.310 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:25:03.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:25:03.362+0000 7f7674fc2080 -1 init, newargv = 0x56401ef0a880 newargc=9 2021-10-20T23:25:03.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14273]: starting ceph client 2021-10-20T23:25:03.367 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:25:03.368 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:25:03.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:03.369 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:25:03.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14273]: starting fuse 2021-10-20T23:25:04.477 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:25:04.496 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:25:04.496 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:25:04.551 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:25:04.552 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:25:04.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:04.554 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:25:04.559 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:25:04.559 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:25:04.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:04.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:25:04.561 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:25:04.561 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:25:04.562 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:25:04.562 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:25:04.562 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:04.563 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:25:04.563 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:25:04.564 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:25:04.564 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:04.565 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:25:04.565 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:25:04.566 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:25:04.566 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:25:04.566 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:04.567 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:25:04.567 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:25:04.568 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:25:04.568 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:25:04.569 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:25:04.569 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:04.570 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:25:04.570 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:25:04.614 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14273.asok 2021-10-20T23:25:04.619 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14273.asok 2021-10-20T23:25:04.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:04.620 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14273.asok status 2021-10-20T23:25:04.750 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:25:04.750 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:25:04.751 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:25:04.751 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:25:04.751 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:25:04.751 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:25:04.752 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:25:04.752 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14273", 2021-10-20T23:25:04.752 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:25:04.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:25:04.753 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:25:04.753 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:25:04.753 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 6118, 2021-10-20T23:25:04.753 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:25:04.754 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:25:04.754 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:25:04.754 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 6118 2021-10-20T23:25:04.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:25:04.754 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:25:04.755 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:25:04.755 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:25:04.755 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3912479653 2021-10-20T23:25:04.755 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:25:04.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:25:04.756 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:25:04.756 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:25:04.756 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:25:04.756 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3912479653 2021-10-20T23:25:04.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:25:04.757 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.6118 172.21.15.119:0/3912479653", 2021-10-20T23:25:04.757 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/3912479653", 2021-10-20T23:25:04.757 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:25:04.758 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 31, 2021-10-20T23:25:04.758 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 68, 2021-10-20T23:25:04.758 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:25:04.758 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:25:04.758 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:25:04.759 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:25:04.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:04.761 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:04.761 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:04.768 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:25:04.769 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:25:04.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:04.771 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:04.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:04.787 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:04.787 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:04.795 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:25:04.796 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:25:04.796 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-20T23:25:04.797 DEBUG:teuthology.orchestra.run.smithi119:> import sys 2021-10-20T23:25:04.797 DEBUG:teuthology.orchestra.run.smithi119:> import time 2021-10-20T23:25:04.798 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:25:04.798 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:04.798 DEBUG:teuthology.orchestra.run.smithi119:> n = 1000 2021-10-20T23:25:04.799 DEBUG:teuthology.orchestra.run.smithi119:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-10-20T23:25:04.799 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:04.800 DEBUG:teuthology.orchestra.run.smithi119:> if not os.path.exists(os.path.dirname(abs_path)): 2021-10-20T23:25:04.800 DEBUG:teuthology.orchestra.run.smithi119:> os.makedirs(os.path.dirname(abs_path)) 2021-10-20T23:25:04.800 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:04.801 DEBUG:teuthology.orchestra.run.smithi119:> for i in range(0, n): 2021-10-20T23:25:04.801 DEBUG:teuthology.orchestra.run.smithi119:> fname = "{0}_{1}".format(abs_path, i) 2021-10-20T23:25:04.802 DEBUG:teuthology.orchestra.run.smithi119:> with open(fname, '"'"'w'"'"') as f: 2021-10-20T23:25:04.802 DEBUG:teuthology.orchestra.run.smithi119:> f.write('"'"'content'"'"') 2021-10-20T23:25:04.802 DEBUG:teuthology.orchestra.run.smithi119:> if True: 2021-10-20T23:25:04.803 DEBUG:teuthology.orchestra.run.smithi119:> f.flush() 2021-10-20T23:25:04.803 DEBUG:teuthology.orchestra.run.smithi119:> os.fsync(f.fileno()) 2021-10-20T23:25:04.804 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:25:06.730 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:25:06.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:25:06.735 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:25:06.738 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:25:16.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:16.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 Processor -- start 2021-10-20T23:25:16.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 -- start start 2021-10-20T23:25:16.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f929c1483a0 0x7f929c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:16.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f929c0a70c0 0x7f929c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:16.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0b0350 con 0x7f929c0b1db0 2021-10-20T23:25:16.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c0a90c0 con 0x7f929c1483a0 2021-10-20T23:25:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c0b05f0 con 0x7f929c0a70c0 2021-10-20T23:25:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929a59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f929c1483a0 0x7f929c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929a59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f929c1483a0 0x7f929c0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40364/0 (socket says 172.21.15.12:40364) 2021-10-20T23:25:16.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929a59c700 1 -- 172.21.15.12:0/830854874 learned_addr learned my addr 172.21.15.12:0/830854874 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929b59e700 1 --2- 172.21.15.12:0/830854874 >> v2:172.21.15.31:3300/0 conn(0x7f929c0a70c0 0x7f929c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929a59c700 1 -- 172.21.15.12:0/830854874 >> v2:172.21.15.31:3300/0 conn(0x7f929c0a70c0 msgr2=0x7f929c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929a59c700 1 --2- 172.21.15.12:0/830854874 >> v2:172.21.15.31:3300/0 conn(0x7f929c0a70c0 0x7f929c144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929a59c700 1 -- 172.21.15.12:0/830854874 >> v1:172.21.15.31:6789/0 conn(0x7f929c0b1db0 legacy=0x7f929c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929a59c700 1 -- 172.21.15.12:0/830854874 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0b0890 con 0x7f929c1483a0 2021-10-20T23:25:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929b59e700 1 --2- 172.21.15.12:0/830854874 >> v2:172.21.15.31:3300/0 conn(0x7f929c0a70c0 0x7f929c144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f929a59c700 1 --2- 172.21.15.12:0/830854874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c1483a0 0x7f929c0b0fd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f929c147730 tx=0x7f9284006eb0).ready entity=mon.0 client_cookie=6dce834beae390d9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f9299d9b700 1 -- 172.21.15.12:0/830854874 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f928400d610 con 0x7f929c1483a0 2021-10-20T23:25:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f9299d9b700 1 -- 172.21.15.12:0/830854874 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9284000e90 con 0x7f929c1483a0 2021-10-20T23:25:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f9299d9b700 1 -- 172.21.15.12:0/830854874 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f928400d960 con 0x7f929c1483a0 2021-10-20T23:25:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 -- 172.21.15.12:0/830854874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c1483a0 msgr2=0x7f929c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 --2- 172.21.15.12:0/830854874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c1483a0 0x7f929c0b0fd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f929c147730 tx=0x7f9284006eb0).stop 2021-10-20T23:25:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 -- 172.21.15.12:0/830854874 shutdown_connections 2021-10-20T23:25:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 --2- 172.21.15.12:0/830854874 >> v2:172.21.15.31:3300/0 conn(0x7f929c0a70c0 0x7f929c144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 --2- 172.21.15.12:0/830854874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c1483a0 0x7f929c0b0fd0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 -- 172.21.15.12:0/830854874 >> 172.21.15.12:0/830854874 conn(0x7f929c05f6b0 msgr2=0x7f929c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 -- 172.21.15.12:0/830854874 shutdown_connections 2021-10-20T23:25:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.635+0000 7f92a1218700 1 -- 172.21.15.12:0/830854874 wait complete. 2021-10-20T23:25:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f92a1218700 1 Processor -- start 2021-10-20T23:25:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f92a1218700 1 -- start start 2021-10-20T23:25:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f92a1218700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0a70c0 0x7f929c14b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f92a1218700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c0b1db0 0x7f929c1434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f92a1218700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c1483a0 0x7f929c1439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f92a1218700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c14a290 con 0x7f929c0b1db0 2021-10-20T23:25:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f92a1218700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c149bb0 con 0x7f929c1483a0 2021-10-20T23:25:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f92a1218700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c149530 con 0x7f929c0a70c0 2021-10-20T23:25:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c0b1db0 0x7f929c1434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c0b1db0 0x7f929c1434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40372/0 (socket says 172.21.15.12:40372) 2021-10-20T23:25:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0a70c0 0x7f929c14b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c1483a0 0x7f929c1439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929a59c700 1 -- 172.21.15.12:0/402887744 learned_addr learned my addr 172.21.15.12:0/402887744 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929a59c700 1 -- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0a70c0 msgr2=0x7f929c14b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929a59c700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0a70c0 0x7f929c14b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929a59c700 1 -- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c1483a0 msgr2=0x7f929c1439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929a59c700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c1483a0 0x7f929c1439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.639+0000 7f929a59c700 1 -- 172.21.15.12:0/402887744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928400b1e0 con 0x7f929c0b1db0 2021-10-20T23:25:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f929a59c700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c0b1db0 0x7f929c1434e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f929c147730 tx=0x7f9284015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f9293fff700 1 -- 172.21.15.12:0/402887744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92840068b0 con 0x7f929c0b1db0 2021-10-20T23:25:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f9293fff700 1 -- 172.21.15.12:0/402887744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9284002f50 con 0x7f929c0b1db0 2021-10-20T23:25:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c14b810 con 0x7f929c0b1db0 2021-10-20T23:25:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f9293fff700 1 -- 172.21.15.12:0/402887744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9284011b80 con 0x7f929c0b1db0 2021-10-20T23:25:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c149230 con 0x7f929c0b1db0 2021-10-20T23:25:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c149d20 con 0x7f929c0b1db0 2021-10-20T23:25:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f9293fff700 1 -- 172.21.15.12:0/402887744 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9284025030 con 0x7f929c0b1db0 2021-10-20T23:25:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f9293fff700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.643+0000 7f9293fff700 1 -- 172.21.15.12:0/402887744 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f928406cbf0 con 0x7f929c0b1db0 2021-10-20T23:25:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.647+0000 7f929ad9d700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.647+0000 7f929ad9d700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f928c00d000 tx=0x7f928c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.651+0000 7f9293fff700 1 -- 172.21.15.12:0/402887744 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f929c149d20 con 0x7f929c0b1db0 2021-10-20T23:25:16.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.815+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f929c149d20 con 0x7f929c0b1db0 2021-10-20T23:25:16.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.815+0000 7f9293fff700 1 -- 172.21.15.12:0/402887744 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f929c149d20 con 0x7f929c0b1db0 2021-10-20T23:25:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:16.821 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:24:58.106627+0000","modified":"2021-10-20T23:24:59.110023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5944":{"gid":5944,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/242443509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":242443509},{"type":"v1","addr":"172.21.15.12:6833","nonce":242443509}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-20T23:25:16.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 msgr2=0x7f9280055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:16.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f928c00d000 tx=0x7f928c009040).stop 2021-10-20T23:25:16.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c0b1db0 msgr2=0x7f929c1434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:16.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c0b1db0 0x7f929c1434e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f929c147730 tx=0x7f9284015000).stop 2021-10-20T23:25:16.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 shutdown_connections 2021-10-20T23:25:16.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:16.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c1483a0 0x7f929c1439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:16.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c0b1db0 0x7f929c1434e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:16.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 --2- 172.21.15.12:0/402887744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0a70c0 0x7f929c14b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:16.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 >> 172.21.15.12:0/402887744 conn(0x7f929c05f6b0 msgr2=0x7f929c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:16.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 shutdown_connections 2021-10-20T23:25:16.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:16.819+0000 7f92a1218700 1 -- 172.21.15.12:0/402887744 wait complete. 2021-10-20T23:25:16.827 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2021-10-20T23:25:16.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-10-20T23:25:16.941 INFO:teuthology.orchestra.run.smithi012.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-10-20T23:25:16.941 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-10-20T23:25:16.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:17.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce3a249700 1 Processor -- start 2021-10-20T23:25:17.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce3a249700 1 -- start start 2021-10-20T23:25:17.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce3a249700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce3413e740 0x7fce34141080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce3a249700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b0ff0 0x7fce34141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce3a249700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce340aaa90 con 0x7fce340b2720 2021-10-20T23:25:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce3a249700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce34140c90 con 0x7fce3413e740 2021-10-20T23:25:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce3a249700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce340b2b00 con 0x7fce340b0ff0 2021-10-20T23:25:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce38a46700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce3413e740 0x7fce34141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce38a46700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce3413e740 0x7fce34141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40378/0 (socket says 172.21.15.12:40378) 2021-10-20T23:25:17.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce38a46700 1 -- 172.21.15.12:0/3789233740 learned_addr learned my addr 172.21.15.12:0/3789233740 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:17.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce39a48700 1 --2- 172.21.15.12:0/3789233740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b0ff0 0x7fce34141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce38a46700 1 -- 172.21.15.12:0/3789233740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b0ff0 msgr2=0x7fce34141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce38a46700 1 --2- 172.21.15.12:0/3789233740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b0ff0 0x7fce34141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce38a46700 1 -- 172.21.15.12:0/3789233740 >> v1:172.21.15.31:6789/0 conn(0x7fce340b2720 legacy=0x7fce3413e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce38a46700 1 -- 172.21.15.12:0/3789233740 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce340aa2b0 con 0x7fce3413e740 2021-10-20T23:25:17.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce39a48700 1 --2- 172.21.15.12:0/3789233740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b0ff0 0x7fce34141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:25:17.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce38a46700 1 --2- 172.21.15.12:0/3789233740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce3413e740 0x7fce34141080 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fce30002f70 tx=0x7fce30006eb0).ready entity=mon.0 client_cookie=240602d3fd2ff588 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.035+0000 7fce2bfff700 1 -- 172.21.15.12:0/3789233740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3000d5c0 con 0x7fce3413e740 2021-10-20T23:25:17.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce2bfff700 1 -- 172.21.15.12:0/3789233740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce30000e90 con 0x7fce3413e740 2021-10-20T23:25:17.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce2bfff700 1 -- 172.21.15.12:0/3789233740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3000d950 con 0x7fce3413e740 2021-10-20T23:25:17.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 -- 172.21.15.12:0/3789233740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce3413e740 msgr2=0x7fce34141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 --2- 172.21.15.12:0/3789233740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce3413e740 0x7fce34141080 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fce30002f70 tx=0x7fce30006eb0).stop 2021-10-20T23:25:17.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 -- 172.21.15.12:0/3789233740 shutdown_connections 2021-10-20T23:25:17.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 --2- 172.21.15.12:0/3789233740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b0ff0 0x7fce34141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 --2- 172.21.15.12:0/3789233740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce3413e740 0x7fce34141080 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 -- 172.21.15.12:0/3789233740 >> 172.21.15.12:0/3789233740 conn(0x7fce34060180 msgr2=0x7fce340b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:17.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 -- 172.21.15.12:0/3789233740 shutdown_connections 2021-10-20T23:25:17.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 -- 172.21.15.12:0/3789233740 wait complete. 2021-10-20T23:25:17.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 Processor -- start 2021-10-20T23:25:17.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 -- start start 2021-10-20T23:25:17.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce340b0ff0 0x7fce34141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b2720 0x7fce340ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce341428a0 0x7fce340add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340ae220 con 0x7fce340b0ff0 2021-10-20T23:25:17.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3414e190 con 0x7fce341428a0 2021-10-20T23:25:17.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce3a249700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3414e430 con 0x7fce340b2720 2021-10-20T23:25:17.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39247700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce340b0ff0 0x7fce34141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39247700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce340b0ff0 0x7fce34141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40384/0 (socket says 172.21.15.12:40384) 2021-10-20T23:25:17.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39247700 1 -- 172.21.15.12:0/3228199259 learned_addr learned my addr 172.21.15.12:0/3228199259 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:17.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39a48700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce341428a0 0x7fce340add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce38a46700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b2720 0x7fce340ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39247700 1 -- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b2720 msgr2=0x7fce340ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39247700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b2720 0x7fce340ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39247700 1 -- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce341428a0 msgr2=0x7fce340add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39247700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce341428a0 0x7fce340add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39247700 1 -- 172.21.15.12:0/3228199259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3000b1e0 con 0x7fce340b0ff0 2021-10-20T23:25:17.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39a48700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce341428a0 0x7fce340add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:17.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.039+0000 7fce39247700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce340b0ff0 0x7fce34141fe0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fce34061a80 tx=0x7fce24007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce2a7fc700 1 -- 172.21.15.12:0/3228199259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2400ce30 con 0x7fce340b0ff0 2021-10-20T23:25:17.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce2a7fc700 1 -- 172.21.15.12:0/3228199259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2400f470 con 0x7fce340b0ff0 2021-10-20T23:25:17.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3414e6d0 con 0x7fce340b0ff0 2021-10-20T23:25:17.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce2a7fc700 1 -- 172.21.15.12:0/3228199259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2400f7d0 con 0x7fce340b0ff0 2021-10-20T23:25:17.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce341424d0 con 0x7fce340b0ff0 2021-10-20T23:25:17.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce34057350 con 0x7fce340b0ff0 2021-10-20T23:25:17.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce2a7fc700 1 -- 172.21.15.12:0/3228199259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce24019030 con 0x7fce340b0ff0 2021-10-20T23:25:17.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce2a7fc700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce1c0534f0 0x7fce1c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce2a7fc700 1 -- 172.21.15.12:0/3228199259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fce2406ad60 con 0x7fce340b0ff0 2021-10-20T23:25:17.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.043+0000 7fce38a46700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce1c0534f0 0x7fce1c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.047+0000 7fce38a46700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce1c0534f0 0x7fce1c0559b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fce3001a000 tx=0x7fce30015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.051+0000 7fce2a7fc700 1 -- 172.21.15.12:0/3228199259 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce24041d60 con 0x7fce340b0ff0 2021-10-20T23:25:17.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.215+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce340aaa90 con 0x7fce340b0ff0 2021-10-20T23:25:17.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.215+0000 7fce2a7fc700 1 -- 172.21.15.12:0/3228199259 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fce340aaa90 con 0x7fce340b0ff0 2021-10-20T23:25:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:17.220 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:24:58.106627+0000","modified":"2021-10-20T23:24:59.110023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5944":{"gid":5944,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/242443509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":242443509},{"type":"v1","addr":"172.21.15.12:6833","nonce":242443509}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-20T23:25:17.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce1c0534f0 msgr2=0x7fce1c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce1c0534f0 0x7fce1c0559b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fce3001a000 tx=0x7fce30015000).stop 2021-10-20T23:25:17.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce340b0ff0 msgr2=0x7fce34141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce340b0ff0 0x7fce34141fe0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fce34061a80 tx=0x7fce24007c50).stop 2021-10-20T23:25:17.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 shutdown_connections 2021-10-20T23:25:17.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce1c0534f0 0x7fce1c0559b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce341428a0 0x7fce340add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce340b2720 0x7fce340ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 --2- 172.21.15.12:0/3228199259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce340b0ff0 0x7fce34141fe0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 >> 172.21.15.12:0/3228199259 conn(0x7fce34060180 msgr2=0x7fce3413d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:17.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 shutdown_connections 2021-10-20T23:25:17.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.219+0000 7fce3a249700 1 -- 172.21.15.12:0/3228199259 wait complete. 2021-10-20T23:25:17.225 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2021-10-20T23:25:17.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-10-20T23:25:17.338 INFO:teuthology.orchestra.run.smithi012.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-10-20T23:25:17.338 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-10-20T23:25:17.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6aadaa700 1 Processor -- start 2021-10-20T23:25:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6aadaa700 1 -- start start 2021-10-20T23:25:17.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6aadaa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40a9190 0x7fb6a4146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6aadaa700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a40b1140 con 0x7fb6a40b03d0 2021-10-20T23:25:17.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6aadaa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a40a9570 con 0x7fb6a40b0b80 2021-10-20T23:25:17.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6aadaa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40b1370 con 0x7fb6a40a9190 2021-10-20T23:25:17.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6aa5a9700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb6a40b03d0 0x7fb6a41401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38990/0 (socket says 172.21.15.12:38990) 2021-10-20T23:25:17.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6aa5a9700 1 -- 172.21.15.12:0/327246634 learned_addr learned my addr 172.21.15.12:0/327246634 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a9da8700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40a9190 0x7fb6a4146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220216652 0 0) 0x7fb6a40b1140 con 0x7fb6a40b03d0 2021-10-20T23:25:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb68c003260 con 0x7fb6a40b03d0 2021-10-20T23:25:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406566066 0 0) 0x7fb68c003260 con 0x7fb6a40b03d0 2021-10-20T23:25:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40a9190 msgr2=0x7fb6a4146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40a9190 0x7fb6a4146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 >> v1:172.21.15.31:6789/0 conn(0x7fb6a40b0b80 legacy=0x7fb6a4146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40b1610 con 0x7fb6a40b03d0 2021-10-20T23:25:17.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fb69c0019e0 con 0x7fb6a40b03d0 2021-10-20T23:25:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 >> v1:172.21.15.12:6789/0 conn(0x7fb6a40b03d0 legacy=0x7fb6a41401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb68c003780 0x7fb68c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40a9190 0x7fb68c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb68c0049f0 0x7fb68c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40b1370 con 0x7fb68c003780 2021-10-20T23:25:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c00b780 con 0x7fb68c0049f0 2021-10-20T23:25:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c00b940 con 0x7fb6a40a9190 2021-10-20T23:25:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a9da8700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb68c003780 0x7fb68c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a95a7700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40a9190 0x7fb68c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6aa5a9700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb68c0049f0 0x7fb68c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a9da8700 1 -- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40a9190 msgr2=0x7fb68c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a9da8700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40a9190 0x7fb68c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a9da8700 1 -- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb68c0049f0 msgr2=0x7fb68c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a9da8700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb68c0049f0 0x7fb68c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.439+0000 7fb6a9da8700 1 -- 172.21.15.12:0/327246634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c003260 con 0x7fb68c003780 2021-10-20T23:25:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6a9da8700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb68c003780 0x7fb68c003ba0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fb69400c000 tx=0x7fb694006df0).ready entity=mon.0 client_cookie=da03f71e8c9d7a6f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb69400e830 con 0x7fb68c003780 2021-10-20T23:25:17.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69400e990 con 0x7fb68c003780 2021-10-20T23:25:17.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6a8da6700 1 -- 172.21.15.12:0/327246634 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb69400ecf0 con 0x7fb68c003780 2021-10-20T23:25:17.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6aadaa700 1 -- 172.21.15.12:0/327246634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb68c003780 msgr2=0x7fb68c003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6aadaa700 1 --2- 172.21.15.12:0/327246634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb68c003780 0x7fb68c003ba0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fb69400c000 tx=0x7fb694006df0).stop 2021-10-20T23:25:17.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6aa5a9700 1 -- 172.21.15.12:0/327246634 reap_dead start 2021-10-20T23:25:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6aadaa700 1 -- 172.21.15.12:0/327246634 shutdown_connections 2021-10-20T23:25:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6aadaa700 1 -- 172.21.15.12:0/327246634 >> 172.21.15.12:0/327246634 conn(0x7fb6a4061140 msgr2=0x7fb6a4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6aadaa700 1 -- 172.21.15.12:0/327246634 shutdown_connections 2021-10-20T23:25:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6aadaa700 1 -- 172.21.15.12:0/327246634 wait complete. 2021-10-20T23:25:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6aadaa700 1 Processor -- start 2021-10-20T23:25:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.443+0000 7fb6aadaa700 1 -- start start 2021-10-20T23:25:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aadaa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb68c003780 0x7fb6a40b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aadaa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40b55b0 0x7fb6a41561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aadaa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a4145650 0x7fb6a4145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aadaa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a41566e0 con 0x7fb6a40b55b0 2021-10-20T23:25:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aadaa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40b4250 con 0x7fb68c003780 2021-10-20T23:25:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aadaa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40b5b30 con 0x7fb6a4145650 2021-10-20T23:25:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a95a7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40b55b0 0x7fb6a41561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a95a7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40b55b0 0x7fb6a41561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40406/0 (socket says 172.21.15.12:40406) 2021-10-20T23:25:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a95a7700 1 -- 172.21.15.12:0/2118987155 learned_addr learned my addr 172.21.15.12:0/2118987155 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a9da8700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb68c003780 0x7fb6a40b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aa5a9700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a4145650 0x7fb6a4145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a95a7700 1 -- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a4145650 msgr2=0x7fb6a4145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a95a7700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a4145650 0x7fb6a4145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a95a7700 1 -- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb68c003780 msgr2=0x7fb6a40b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a95a7700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb68c003780 0x7fb6a40b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a95a7700 1 -- 172.21.15.12:0/2118987155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40b5dd0 con 0x7fb6a40b55b0 2021-10-20T23:25:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aa5a9700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a4145650 0x7fb6a4145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6a95a7700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40b55b0 0x7fb6a41561f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fb6a000d000 tx=0x7fb6a0007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb692ffd700 1 -- 172.21.15.12:0/2118987155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a00114c0 con 0x7fb6a40b55b0 2021-10-20T23:25:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb692ffd700 1 -- 172.21.15.12:0/2118987155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a0011620 con 0x7fb6a40b55b0 2021-10-20T23:25:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a40b6070 con 0x7fb6a40b55b0 2021-10-20T23:25:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb692ffd700 1 -- 172.21.15.12:0/2118987155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a0011980 con 0x7fb6a40b55b0 2021-10-20T23:25:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a4141a20 con 0x7fb6a40b55b0 2021-10-20T23:25:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a40b6200 con 0x7fb6a40b55b0 2021-10-20T23:25:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.447+0000 7fb692ffd700 1 -- 172.21.15.12:0/2118987155 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6a001a030 con 0x7fb6a40b55b0 2021-10-20T23:25:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.451+0000 7fb692ffd700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb684053580 0x7fb684055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.451+0000 7fb692ffd700 1 -- 172.21.15.12:0/2118987155 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb6a006b3a0 con 0x7fb6a40b55b0 2021-10-20T23:25:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.451+0000 7fb6a9da8700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb684053580 0x7fb684055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.451+0000 7fb6a9da8700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb684053580 0x7fb684055a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fb69401a000 tx=0x7fb694019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.455+0000 7fb692ffd700 1 -- 172.21.15.12:0/2118987155 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6a0042450 con 0x7fb6a40b55b0 2021-10-20T23:25:17.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6a4057350 con 0x7fb6a40b55b0 2021-10-20T23:25:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb692ffd700 1 -- 172.21.15.12:0/2118987155 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fb6a0045a70 con 0x7fb6a40b55b0 2021-10-20T23:25:17.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:17.628 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:24:58.106627+0000","modified":"2021-10-20T23:24:59.110023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5944":{"gid":5944,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/242443509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":242443509},{"type":"v1","addr":"172.21.15.12:6833","nonce":242443509}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-20T23:25:17.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb684053580 msgr2=0x7fb684055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb684053580 0x7fb684055a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fb69401a000 tx=0x7fb694019000).stop 2021-10-20T23:25:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40b55b0 msgr2=0x7fb6a41561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40b55b0 0x7fb6a41561f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fb6a000d000 tx=0x7fb6a0007a00).stop 2021-10-20T23:25:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 shutdown_connections 2021-10-20T23:25:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb684053580 0x7fb684055a40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a4145650 0x7fb6a4145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40b55b0 0x7fb6a41561f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 --2- 172.21.15.12:0/2118987155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb68c003780 0x7fb6a40b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 >> 172.21.15.12:0/2118987155 conn(0x7fb6a4061140 msgr2=0x7fb6a413ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 shutdown_connections 2021-10-20T23:25:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.623+0000 7fb6aadaa700 1 -- 172.21.15.12:0/2118987155 wait complete. 2021-10-20T23:25:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2021-10-20T23:25:17.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 10 2021-10-20T23:25:17.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc41fdf700 1 Processor -- start 2021-10-20T23:25:17.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc41fdf700 1 -- start start 2021-10-20T23:25:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc41fdf700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc3c0b10f0 0x7efc3c13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc41fdf700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c13f880 con 0x7efc3c05d0b0 2021-10-20T23:25:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc41fdf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c05cbb0 con 0x7efc3c05c7d0 2021-10-20T23:25:17.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc41fdf700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c0ad540 con 0x7efc3c0b10f0 2021-10-20T23:25:17.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc417de700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc3c0b10f0 0x7efc3c13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc3bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efc3c05d0b0 0x7efc3c0aece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39010/0 (socket says 172.21.15.12:39010) 2021-10-20T23:25:17.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc417de700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc3c0b10f0 0x7efc3c13f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40412/0 (socket says 172.21.15.12:40412) 2021-10-20T23:25:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc3bfff700 1 -- 172.21.15.12:0/2432580609 learned_addr learned my addr 172.21.15.12:0/2432580609 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc417de700 1 -- 172.21.15.12:0/2432580609 >> v1:172.21.15.31:6789/0 conn(0x7efc3c05c7d0 legacy=0x7efc3c0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc417de700 1 -- 172.21.15.12:0/2432580609 >> v1:172.21.15.12:6789/0 conn(0x7efc3c05d0b0 legacy=0x7efc3c0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc417de700 1 -- 172.21.15.12:0/2432580609 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c0b1520 con 0x7efc3c0b10f0 2021-10-20T23:25:17.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc3b7fe700 1 -- 172.21.15.12:0/2432580609 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518742804 0 0) 0x7efc24001110 con 0x7efc3c05d0b0 2021-10-20T23:25:17.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc417de700 1 --2- 172.21.15.12:0/2432580609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c0b10f0 0x7efc3c13f390 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7efc34002f70 tx=0x7efc34006d80).ready entity=mon.0 client_cookie=6753b41eb35f5e8c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.747+0000 7efc3b7fe700 1 -- 172.21.15.12:0/2432580609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3400bbc0 con 0x7efc3c0b10f0 2021-10-20T23:25:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc3b7fe700 1 -- 172.21.15.12:0/2432580609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc34000e90 con 0x7efc3c0b10f0 2021-10-20T23:25:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc3b7fe700 1 -- 172.21.15.12:0/2432580609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc340153f0 con 0x7efc3c0b10f0 2021-10-20T23:25:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 -- 172.21.15.12:0/2432580609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c0b10f0 msgr2=0x7efc3c13f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 --2- 172.21.15.12:0/2432580609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c0b10f0 0x7efc3c13f390 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7efc34002f70 tx=0x7efc34006d80).stop 2021-10-20T23:25:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 -- 172.21.15.12:0/2432580609 shutdown_connections 2021-10-20T23:25:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 --2- 172.21.15.12:0/2432580609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c0b10f0 0x7efc3c13f390 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 -- 172.21.15.12:0/2432580609 >> 172.21.15.12:0/2432580609 conn(0x7efc3c060180 msgr2=0x7efc3c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 -- 172.21.15.12:0/2432580609 shutdown_connections 2021-10-20T23:25:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 -- 172.21.15.12:0/2432580609 wait complete. 2021-10-20T23:25:17.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 Processor -- start 2021-10-20T23:25:17.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 -- start start 2021-10-20T23:25:17.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c05c7d0 0x7efc3c141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c05d0b0 0x7efc3c142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3c0b10f0 0x7efc3c0631a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1391a0 con 0x7efc3c05c7d0 2021-10-20T23:25:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c14eb30 con 0x7efc3c05d0b0 2021-10-20T23:25:17.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc41fdf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c14edd0 con 0x7efc3c0b10f0 2021-10-20T23:25:17.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc40fdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c05c7d0 0x7efc3c141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc40fdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c05c7d0 0x7efc3c141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40418/0 (socket says 172.21.15.12:40418) 2021-10-20T23:25:17.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc40fdd700 1 -- 172.21.15.12:0/2733278376 learned_addr learned my addr 172.21.15.12:0/2733278376 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:17.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc417de700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3c0b10f0 0x7efc3c0631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.751+0000 7efc3bfff700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c05d0b0 0x7efc3c142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc40fdd700 1 -- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3c0b10f0 msgr2=0x7efc3c0631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc40fdd700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3c0b10f0 0x7efc3c0631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc40fdd700 1 -- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c05d0b0 msgr2=0x7efc3c142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc40fdd700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c05d0b0 0x7efc3c142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc40fdd700 1 -- 172.21.15.12:0/2733278376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3400d410 con 0x7efc3c05c7d0 2021-10-20T23:25:17.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc417de700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3c0b10f0 0x7efc3c0631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:17.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc40fdd700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c05c7d0 0x7efc3c141c90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7efc3c061f50 tx=0x7efc2c0014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc39ffb700 1 -- 172.21.15.12:0/2733278376 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c010510 con 0x7efc3c05c7d0 2021-10-20T23:25:17.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc39ffb700 1 -- 172.21.15.12:0/2733278376 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c010670 con 0x7efc3c05c7d0 2021-10-20T23:25:17.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc41fdf700 1 -- 172.21.15.12:0/2733278376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c0a92c0 con 0x7efc3c05c7d0 2021-10-20T23:25:17.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc39ffb700 1 -- 172.21.15.12:0/2733278376 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c0107e0 con 0x7efc3c05c7d0 2021-10-20T23:25:17.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc41fdf700 1 -- 172.21.15.12:0/2733278376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c0ab980 con 0x7efc3c05c7d0 2021-10-20T23:25:17.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc39ffb700 1 -- 172.21.15.12:0/2733278376 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc2c010070 con 0x7efc3c05c7d0 2021-10-20T23:25:17.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc39ffb700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc200536d0 0x7efc20055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc39ffb700 1 -- 172.21.15.12:0/2733278376 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efc2c06b750 con 0x7efc3c05c7d0 2021-10-20T23:25:17.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.755+0000 7efc3bfff700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc200536d0 0x7efc20055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc3bfff700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc200536d0 0x7efc20055b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7efc2400b000 tx=0x7efc24009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc4d485740 1 Processor -- start 2021-10-20T23:25:17.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc4d485740 1 -- start start 2021-10-20T23:25:17.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc4d485740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x28ef380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc4d485740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 0x2924c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc4d485740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x29204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc4d485740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x285f240 con 0x28e9b30 2021-10-20T23:25:17.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc4d485740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x283f8d0 con 0x28ec5c0 2021-10-20T23:25:17.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc4d485740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x28eacf0 con 0x2925150 2021-10-20T23:25:17.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc40fdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x28ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc40fdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x28ef380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40426/0 (socket says 172.21.15.12:40426) 2021-10-20T23:25:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc40fdd700 1 -- 172.21.15.12:0/3565443835 learned_addr learned my addr 172.21.15.12:0/3565443835 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc3bfff700 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 0x2924c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc417de700 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x29204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc40fdd700 1 -- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 msgr2=0x29204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc40fdd700 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x29204d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc40fdd700 1 -- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 msgr2=0x2924c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc40fdd700 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 0x2924c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc40fdd700 1 -- 172.21.15.12:0/3565443835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2896d00 con 0x28e9b30 2021-10-20T23:25:17.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc417de700 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x29204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:25:17.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc3bfff700 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 0x2924c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:25:17.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc40fdd700 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x28ef380 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x2925550 tx=0x7efc2c013000).ready entity=mon.0 client_cookie=3e46b788b05cebc8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc41fdf700 1 -- 172.21.15.12:0/3565443835 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c0457f0 con 0x28e9b30 2021-10-20T23:25:17.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc41fdf700 1 -- 172.21.15.12:0/3565443835 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c045950 con 0x28e9b30 2021-10-20T23:25:17.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.759+0000 7efc41fdf700 1 -- 172.21.15.12:0/3565443835 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c045ac0 con 0x28e9b30 2021-10-20T23:25:17.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 -- 172.21.15.12:0/3565443835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 msgr2=0x28ef380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x28ef380 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x2925550 tx=0x7efc2c013000).stop 2021-10-20T23:25:17.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 -- 172.21.15.12:0/3565443835 shutdown_connections 2021-10-20T23:25:17.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x29204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 0x2924c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 --2- 172.21.15.12:0/3565443835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x28ef380 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 -- 172.21.15.12:0/3565443835 >> 172.21.15.12:0/3565443835 conn(0x28ec030 msgr2=0x28eb730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:17.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 -- 172.21.15.12:0/3565443835 shutdown_connections 2021-10-20T23:25:17.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 -- 172.21.15.12:0/3565443835 wait complete. 2021-10-20T23:25:17.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 -- start start 2021-10-20T23:25:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 Processor -- start 2021-10-20T23:25:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x292b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x28ec5c0 0x28efc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2925150 0x2936ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x292a980 con 0x28e9b30 2021-10-20T23:25:17.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x292ac20 con 0x2925150 2021-10-20T23:25:17.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x292aec0 con 0x28ec5c0 2021-10-20T23:25:17.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc4d485740 10 client.0 ll_register_callbacks cb 0x28a62e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-20T23:25:17.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc40fdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x292b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc40fdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x292b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40432/0 (socket says 172.21.15.12:40432) 2021-10-20T23:25:17.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc40fdd700 1 -- 172.21.15.12:0/1122206850 learned_addr learned my addr 172.21.15.12:0/1122206850 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc417de700 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2925150 0x2936ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc3bfff700 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x28ec5c0 0x28efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc40fdd700 1 -- 172.21.15.12:0/1122206850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x28ec5c0 msgr2=0x28efc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc40fdd700 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x28ec5c0 0x28efc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc40fdd700 1 -- 172.21.15.12:0/1122206850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2925150 msgr2=0x2936ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc40fdd700 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2925150 0x2936ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc40fdd700 1 -- 172.21.15.12:0/1122206850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c0ab980 con 0x28e9b30 2021-10-20T23:25:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.763+0000 7efc3bfff700 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x28ec5c0 0x28efc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc40fdd700 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x292b600 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x2925550 tx=0x7efc2c06b000).ready entity=mon.0 client_cookie=bb56e7981fa4c8f0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2021-10-20T23:25:17.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 1 -- 172.21.15.12:0/1122206850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c045470 con 0x28e9b30 2021-10-20T23:25:17.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 -- 172.21.15.12:0/1122206850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2855220 con 0x28e9b30 2021-10-20T23:25:17.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 1 -- 172.21.15.12:0/1122206850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efc2c0455d0 con 0x28e9b30 2021-10-20T23:25:17.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 1 -- 172.21.15.12:0/1122206850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc2c06b0d0 con 0x28e9b30 2021-10-20T23:25:17.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 10 client.6114 fetch_fsmap learned FSMap version 31 2021-10-20T23:25:17.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 -- 172.21.15.12:0/1122206850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x284eb00 con 0x28e9b30 2021-10-20T23:25:17.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 1 -- 172.21.15.12:0/1122206850 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2855220 con 0x28e9b30 2021-10-20T23:25:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 1 -- 172.21.15.12:0/1122206850 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 1434+0+0 (secure 0 0 0) 0x7efc2c06b230 con 0x28e9b30 2021-10-20T23:25:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 10 client.6114 fetch_fsmap finished waiting for FSMap version 31 2021-10-20T23:25:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 10 client.6114 resolve_mds: resolved ID 'a' to GID 5944 2021-10-20T23:25:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 20 client.6114 populate_metadata read hostname 'smithi012' 2021-10-20T23:25:17.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] conn(0x29373e0 0x29377c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 4 client.6114 mds_command: new command op to 5944 tid=0[{"prefix": "get_command_descriptions"}] 2021-10-20T23:25:17.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 -- 172.21.15.12:0/1122206850 --> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x284d590 con 0x29373e0 2021-10-20T23:25:17.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc3bfff700 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] conn(0x29373e0 0x29377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 10 client.6114 ms_handle_connect on v2:172.21.15.12:6832/242443509 2021-10-20T23:25:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc3bfff700 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] conn(0x29373e0 0x29377c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a6e540668e3bc983 server_cookie=7b5994967eefbdc6 in_seq=0 out_seq=0 2021-10-20T23:25:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 1 -- 172.21.15.12:0/1122206850 <== mds.0 v2:172.21.15.12:6832/242443509 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x284d590 con 0x29373e0 2021-10-20T23:25:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 10 client.6114 handle_command_reply: tid=0 2021-10-20T23:25:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 client.6114 shutdown 2021-10-20T23:25:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 -- 172.21.15.12:0/1122206850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 msgr2=0x292b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x292b600 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x2925550 tx=0x7efc2c06b000).stop 2021-10-20T23:25:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 -- 172.21.15.12:0/1122206850 shutdown_connections 2021-10-20T23:25:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] conn(0x29373e0 0x29377c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2925150 0x2936ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x28ec5c0 0x28efc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 --2- 172.21.15.12:0/1122206850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x292b600 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 -- 172.21.15.12:0/1122206850 >> 172.21.15.12:0/1122206850 conn(0x28ec030 msgr2=0x2924a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc1b7fe700 0 client.6114 ms_handle_reset on v2:172.21.15.12:6832/242443509 2021-10-20T23:25:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 -- 172.21.15.12:0/1122206850 shutdown_connections 2021-10-20T23:25:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 1 -- 172.21.15.12:0/1122206850 wait complete. 2021-10-20T23:25:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.767+0000 7efc4d485740 20 client.6114 trim_cache size 0 max 16384 2021-10-20T23:25:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc4d485740 1 Processor -- start 2021-10-20T23:25:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc4d485740 1 -- start start 2021-10-20T23:25:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc4d485740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x29287e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc4d485740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 0x2928cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc4d485740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x28f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc4d485740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x292c320 con 0x28e9b30 2021-10-20T23:25:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc4d485740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x285c530 con 0x28ec5c0 2021-10-20T23:25:17.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc4d485740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x2855220 con 0x2925150 2021-10-20T23:25:17.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc40fdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x29287e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc40fdd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x29287e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40440/0 (socket says 172.21.15.12:40440) 2021-10-20T23:25:17.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc40fdd700 1 -- 172.21.15.12:0/4096690363 learned_addr learned my addr 172.21.15.12:0/4096690363 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:17.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc3bfff700 1 --2- 172.21.15.12:0/4096690363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 0x2928cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc417de700 1 --2- 172.21.15.12:0/4096690363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x28f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc40fdd700 1 -- 172.21.15.12:0/4096690363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 msgr2=0x28f0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc40fdd700 1 --2- 172.21.15.12:0/4096690363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x28f0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc40fdd700 1 -- 172.21.15.12:0/4096690363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 msgr2=0x2928cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc40fdd700 1 --2- 172.21.15.12:0/4096690363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 0x2928cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc40fdd700 1 -- 172.21.15.12:0/4096690363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2857400 con 0x28e9b30 2021-10-20T23:25:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc40fdd700 1 --2- 172.21.15.12:0/4096690363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x29287e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x2925550 tx=0x7efc2c031000).ready entity=mon.0 client_cookie=11d04235b814d7e3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc31ffb700 1 -- 172.21.15.12:0/4096690363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c069b70 con 0x28e9b30 2021-10-20T23:25:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc31ffb700 1 -- 172.21.15.12:0/4096690363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c03e070 con 0x28e9b30 2021-10-20T23:25:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.783+0000 7efc31ffb700 1 -- 172.21.15.12:0/4096690363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c042450 con 0x28e9b30 2021-10-20T23:25:17.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- 172.21.15.12:0/4096690363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 msgr2=0x29287e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:17.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 --2- 172.21.15.12:0/4096690363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x29287e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x2925550 tx=0x7efc2c031000).stop 2021-10-20T23:25:17.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- 172.21.15.12:0/4096690363 shutdown_connections 2021-10-20T23:25:17.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 --2- 172.21.15.12:0/4096690363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x28f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 --2- 172.21.15.12:0/4096690363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28ec5c0 0x2928cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 --2- 172.21.15.12:0/4096690363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28e9b30 0x29287e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- 172.21.15.12:0/4096690363 >> 172.21.15.12:0/4096690363 conn(0x28ec030 msgr2=0x2924a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:17.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- 172.21.15.12:0/4096690363 shutdown_connections 2021-10-20T23:25:17.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- 172.21.15.12:0/4096690363 wait complete. 2021-10-20T23:25:17.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- start start 2021-10-20T23:25:17.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 Processor -- start 2021-10-20T23:25:17.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28e9b30 0x298a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28ec5c0 0x298a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x28eae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x292b3a0 con 0x28ec5c0 2021-10-20T23:25:17.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x298e510 con 0x28e9b30 2021-10-20T23:25:17.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x2921040 con 0x2925150 2021-10-20T23:25:17.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 10 client.0 ll_register_callbacks cb 0x7efc2c028070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-20T23:25:17.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28ec5c0 0x298a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28ec5c0 0x298a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40448/0 (socket says 172.21.15.12:40448) 2021-10-20T23:25:17.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc3bfff700 1 -- 172.21.15.12:0/3389196230 learned_addr learned my addr 172.21.15.12:0/3389196230 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:17.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc40fdd700 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28e9b30 0x298a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc417de700 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x28eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc3bfff700 1 -- 172.21.15.12:0/3389196230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 msgr2=0x28eae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc3bfff700 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x28eae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc3bfff700 1 -- 172.21.15.12:0/3389196230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28e9b30 msgr2=0x298a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc3bfff700 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28e9b30 0x298a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc3bfff700 1 -- 172.21.15.12:0/3389196230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c0ab980 con 0x28ec5c0 2021-10-20T23:25:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc30ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2021-10-20T23:25:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc3bfff700 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28ec5c0 0x298a8a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7efc24017000 tx=0x7efc24007000).ready entity=mon.0 client_cookie=e205b43bc0e445ad server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc30ff9700 1 -- 172.21.15.12:0/3389196230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc24016850 con 0x28ec5c0 2021-10-20T23:25:17.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc30ff9700 1 -- 172.21.15.12:0/3389196230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efc240169b0 con 0x28ec5c0 2021-10-20T23:25:17.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- 172.21.15.12:0/3389196230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc2c045950 con 0x28ec5c0 2021-10-20T23:25:17.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc30ff9700 1 -- 172.21.15.12:0/3389196230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc24007170 con 0x28ec5c0 2021-10-20T23:25:17.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 10 client.6120 fetch_fsmap learned FSMap version 31 2021-10-20T23:25:17.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- 172.21.15.12:0/3389196230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x2853df0 con 0x28ec5c0 2021-10-20T23:25:17.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc30ff9700 1 -- 172.21.15.12:0/3389196230 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c045950 con 0x28ec5c0 2021-10-20T23:25:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc30ff9700 1 -- 172.21.15.12:0/3389196230 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 1434+0+0 (secure 0 0 0) 0x7efc24016b70 con 0x28ec5c0 2021-10-20T23:25:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 10 client.6120 fetch_fsmap finished waiting for FSMap version 31 2021-10-20T23:25:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 10 client.6120 resolve_mds: resolved ID 'a' to GID 5944 2021-10-20T23:25:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 20 client.6120 populate_metadata read hostname 'smithi012' 2021-10-20T23:25:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] conn(0x2928c10 0x28eb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 4 client.6120 mds_command: new command op to 5944 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-10-20T23:25:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc4d485740 1 -- 172.21.15.12:0/3389196230 --> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x27435e0 con 0x2928c10 2021-10-20T23:25:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.787+0000 7efc40fdd700 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] conn(0x2928c10 0x28eb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.791+0000 7efc30ff9700 10 client.6120 ms_handle_connect on v2:172.21.15.12:6832/242443509 2021-10-20T23:25:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:17.791+0000 7efc40fdd700 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] conn(0x2928c10 0x28eb320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a95b6405b89c74ff server_cookie=3558f1c6ef6f728b in_seq=0 out_seq=0 2021-10-20T23:25:28.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc30ff9700 1 -- 172.21.15.12:0/3389196230 <== mds.0 v2:172.21.15.12:6832/242443509 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+406 (crc 0 0 0) 0x27435e0 con 0x2928c10 2021-10-20T23:25:28.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc30ff9700 10 client.6120 handle_command_reply: tid=0 2021-10-20T23:25:28.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 client.6120 shutdown 2021-10-20T23:25:28.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 -- 172.21.15.12:0/3389196230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28ec5c0 msgr2=0x298a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28ec5c0 0x298a8a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7efc24017000 tx=0x7efc24007000).stop 2021-10-20T23:25:28.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 -- 172.21.15.12:0/3389196230 shutdown_connections 2021-10-20T23:25:28.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.12:6832/242443509,v1:172.21.15.12:6833/242443509] conn(0x2928c10 0x28eb320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x2925150 0x28eae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x28ec5c0 0x298a8a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 --2- 172.21.15.12:0/3389196230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x28e9b30 0x298a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc30ff9700 0 client.6120 ms_handle_reset on v2:172.21.15.12:6832/242443509 2021-10-20T23:25:28.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 -- 172.21.15.12:0/3389196230 >> 172.21.15.12:0/3389196230 conn(0x28ec030 msgr2=0x28ee040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:28.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 -- 172.21.15.12:0/3389196230 shutdown_connections 2021-10-20T23:25:28.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 1 -- 172.21.15.12:0/3389196230 wait complete. 2021-10-20T23:25:28.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc4d485740 20 client.6120 trim_cache size 0 max 16384 2021-10-20T23:25:28.036 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:25:28.037 INFO:teuthology.orchestra.run.smithi012.stdout: "client_recall": { 2021-10-20T23:25:28.037 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": -110, 2021-10-20T23:25:28.037 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "(110) Connection timed out", 2021-10-20T23:25:28.037 INFO:teuthology.orchestra.run.smithi012.stdout: "recalled": 240 2021-10-20T23:25:28.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flush_journal": { 2021-10-20T23:25:28.038 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2021-10-20T23:25:28.038 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "" 2021-10-20T23:25:28.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.039 INFO:teuthology.orchestra.run.smithi012.stdout: "trim_cache": { 2021-10-20T23:25:28.039 INFO:teuthology.orchestra.run.smithi012.stdout: "trimmed": 220 2021-10-20T23:25:28.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.040 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2021-10-20T23:25:28.040 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": { 2021-10-20T23:25:28.040 INFO:teuthology.orchestra.run.smithi012.stdout: "items": 15426, 2021-10-20T23:25:28.040 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes": 2428288 2021-10-20T23:25:28.040 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 10.235672212000001 2021-10-20T23:25:28.041 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:25:28.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 -- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc200536d0 msgr2=0x7efc20055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc200536d0 0x7efc20055b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7efc2400b000 tx=0x7efc24009040).stop 2021-10-20T23:25:28.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 -- 172.21.15.12:0/2733278376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c05c7d0 msgr2=0x7efc3c141c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c05c7d0 0x7efc3c141c90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7efc3c061f50 tx=0x7efc2c0014a0).stop 2021-10-20T23:25:28.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 -- 172.21.15.12:0/2733278376 shutdown_connections 2021-10-20T23:25:28.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efc200536d0 0x7efc20055b90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3c0b10f0 0x7efc3c0631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c05d0b0 0x7efc3c142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 --2- 172.21.15.12:0/2733278376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc3c05c7d0 0x7efc3c141c90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 -- 172.21.15.12:0/2733278376 >> 172.21.15.12:0/2733278376 conn(0x7efc3c060180 msgr2=0x7efc3c0b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:28.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 -- 172.21.15.12:0/2733278376 shutdown_connections 2021-10-20T23:25:28.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.026+0000 7efc41fdf700 1 -- 172.21.15.12:0/2733278376 wait complete. 2021-10-20T23:25:28.046 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:25:28.046 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:25:28.062 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:25:28.083 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:25:28.104 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:25:28.125 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:25:28.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:28.126 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:28.127 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:28.155 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:25:28.156 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:25:28.157 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:25:28.157 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:25:28.158 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:28.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14273]: fuse finished with error 0 and tester_r 0 2021-10-20T23:25:28.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:28.176 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:28.177 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:28.183 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:25:28.184 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:25:28.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:25:28.303 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:28.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:28.311 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:28.312 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:25:28.319 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:25:28.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:25:28.321 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:25:28.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:25:28.322 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:25:28.329 INFO:teuthology.orchestra.run.smithi136.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:25:28.330 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:25:28.331 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:25:28.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9783135700 1 Processor -- start 2021-10-20T23:25:28.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9783135700 1 -- start start 2021-10-20T23:25:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9783135700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f977c0b27a0 0x7f977c147470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9783135700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f977c05c490 0x7f977c0a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9783135700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c14b8e0 con 0x7f977c0b1d10 2021-10-20T23:25:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9783135700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c1451b0 con 0x7f977c05c490 2021-10-20T23:25:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9783135700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0b2b80 con 0x7f977c0b27a0 2021-10-20T23:25:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9782934700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f977c05c490 0x7f977c0a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9781932700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f977c0b1d10 0x7f977c14b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39050/0 (socket says 172.21.15.12:39050) 2021-10-20T23:25:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9781932700 1 -- 172.21.15.12:0/2405551804 learned_addr learned my addr 172.21.15.12:0/2405551804 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.438+0000 7f9782133700 1 --2- 172.21.15.12:0/2405551804 >> v2:172.21.15.31:3300/0 conn(0x7f977c0b27a0 0x7f977c147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9781131700 1 -- 172.21.15.12:0/2405551804 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983504664 0 0) 0x7f977c14b8e0 con 0x7f977c0b1d10 2021-10-20T23:25:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9781131700 1 -- 172.21.15.12:0/2405551804 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9764003260 con 0x7f977c0b1d10 2021-10-20T23:25:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9782133700 1 -- 172.21.15.12:0/2405551804 >> v2:172.21.15.12:3300/0 conn(0x7f977c05c490 msgr2=0x7f977c0a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9782133700 1 --2- 172.21.15.12:0/2405551804 >> v2:172.21.15.12:3300/0 conn(0x7f977c05c490 0x7f977c0a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9782133700 1 -- 172.21.15.12:0/2405551804 >> v1:172.21.15.12:6789/0 conn(0x7f977c0b1d10 legacy=0x7f977c14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9782133700 1 -- 172.21.15.12:0/2405551804 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c14aad0 con 0x7f977c0b27a0 2021-10-20T23:25:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9782133700 1 --2- 172.21.15.12:0/2405551804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f977c0b27a0 0x7f977c147470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f976c002f70 tx=0x7f976c006df0).ready entity=mon.1 client_cookie=710dc18f3807dc8b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:28.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9781131700 1 -- 172.21.15.12:0/2405551804 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f976c00d4f0 con 0x7f977c0b27a0 2021-10-20T23:25:28.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9781131700 1 -- 172.21.15.12:0/2405551804 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c000e90 con 0x7f977c0b27a0 2021-10-20T23:25:28.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9781131700 1 -- 172.21.15.12:0/2405551804 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f976c00d840 con 0x7f977c0b27a0 2021-10-20T23:25:28.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 -- 172.21.15.12:0/2405551804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f977c0b27a0 msgr2=0x7f977c147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 --2- 172.21.15.12:0/2405551804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f977c0b27a0 0x7f977c147470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f976c002f70 tx=0x7f976c006df0).stop 2021-10-20T23:25:28.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 -- 172.21.15.12:0/2405551804 shutdown_connections 2021-10-20T23:25:28.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 --2- 172.21.15.12:0/2405551804 >> v2:172.21.15.12:3300/0 conn(0x7f977c05c490 0x7f977c0a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 --2- 172.21.15.12:0/2405551804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f977c0b27a0 0x7f977c147470 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 -- 172.21.15.12:0/2405551804 >> 172.21.15.12:0/2405551804 conn(0x7f977c061140 msgr2=0x7f977c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:28.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 -- 172.21.15.12:0/2405551804 shutdown_connections 2021-10-20T23:25:28.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 -- 172.21.15.12:0/2405551804 wait complete. 2021-10-20T23:25:28.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 Processor -- start 2021-10-20T23:25:28.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.442+0000 7f9783135700 1 -- start start 2021-10-20T23:25:28.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9783135700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f977c05c490 0x7f977c157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9783135700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f977c0b1d10 0x7f977c0ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9783135700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977c0b27a0 0x7f977c0aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9783135700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0639d0 con 0x7f977c0b27a0 2021-10-20T23:25:28.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9783135700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c063c70 con 0x7f977c05c490 2021-10-20T23:25:28.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9783135700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c146b10 con 0x7f977c0b1d10 2021-10-20T23:25:28.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782934700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977c0b27a0 0x7f977c0aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782934700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977c0b27a0 0x7f977c0aa760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40464/0 (socket says 172.21.15.12:40464) 2021-10-20T23:25:28.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782133700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f977c05c490 0x7f977c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782934700 1 -- 172.21.15.12:0/3021622841 learned_addr learned my addr 172.21.15.12:0/3021622841 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:28.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9781932700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f977c0b1d10 0x7f977c0ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782934700 1 -- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f977c0b1d10 msgr2=0x7f977c0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782934700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f977c0b1d10 0x7f977c0ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782934700 1 -- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f977c05c490 msgr2=0x7f977c157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782934700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f977c05c490 0x7f977c157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782934700 1 -- 172.21.15.12:0/3021622841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c00b180 con 0x7f977c0b27a0 2021-10-20T23:25:28.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9782934700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977c0b27a0 0x7f977c0aa760 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f977400c000 tx=0x7f9774006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:28.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f976b7fe700 1 -- 172.21.15.12:0/3021622841 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9774011750 con 0x7f977c0b27a0 2021-10-20T23:25:28.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f976b7fe700 1 -- 172.21.15.12:0/3021622841 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97740118b0 con 0x7f977c0b27a0 2021-10-20T23:25:28.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c0aee10 con 0x7f977c0b27a0 2021-10-20T23:25:28.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f976b7fe700 1 -- 172.21.15.12:0/3021622841 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9774011c10 con 0x7f977c0b27a0 2021-10-20T23:25:28.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.446+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c0ac4d0 con 0x7f977c0b27a0 2021-10-20T23:25:28.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.450+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c063e30 con 0x7f977c0b27a0 2021-10-20T23:25:28.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.450+0000 7f976b7fe700 1 -- 172.21.15.12:0/3021622841 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9774011d70 con 0x7f977c0b27a0 2021-10-20T23:25:28.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.450+0000 7f976b7fe700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f975c0536d0 0x7f975c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.450+0000 7f976b7fe700 1 -- 172.21.15.12:0/3021622841 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f977406bcb0 con 0x7f977c0b27a0 2021-10-20T23:25:28.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.450+0000 7f9782133700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f975c0536d0 0x7f975c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.450+0000 7f9782133700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f975c0536d0 0x7f975c055b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f976c01a000 tx=0x7f976c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:28.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.458+0000 7f976b7fe700 1 -- 172.21.15.12:0/3021622841 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9774042c10 con 0x7f977c0b27a0 2021-10-20T23:25:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.586+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f977c146cd0 con 0x7f977c0b27a0 2021-10-20T23:25:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.586+0000 7f976b7fe700 1 -- 172.21.15.12:0/3021622841 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v68) v1 ==== 81+0+34040 (secure 0 0 0) 0x7f9774046230 con 0x7f977c0b27a0 2021-10-20T23:25:28.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:28.595 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:25:28.595 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 68, 2021-10-20T23:25:28.595 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:25:28.595 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:25:28.596 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:24:59.110746+0000", 2021-10-20T23:25:28.596 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:25:28.597 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:25:28.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:25:28.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:25:28.598 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:25:28.598 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:25:28.598 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:25:28.598 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:25:28.599 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:25:28.599 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:25:28.599 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:25:28.599 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:25:28.599 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:25:28.600 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:25:28.600 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:25:28.600 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 12, 2021-10-20T23:25:28.600 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:25:28.601 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:25:28.601 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:25:28.601 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:25:28.601 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:25:28.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.602 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:25:28.602 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:25:28.602 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:25:28.602 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:25:28.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:25:28.603 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:25:28.603 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:25:28.603 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:25:28.604 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:25:28.604 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:25:28.604 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:25:28.605 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:25:28.605 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:25:28.605 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:25:28.605 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:25:28.606 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:25:28.606 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:25:28.606 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:25:28.606 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:25:28.606 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:25:28.607 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:25:28.607 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:25:28.607 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:25:28.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.608 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:25:28.608 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:25:28.608 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:25:28.608 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:25:28.608 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:25:28.609 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:25:28.609 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:25:28.609 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:25:28.609 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:25:28.609 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:25:28.610 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:25:28.610 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:25:28.610 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:25:28.610 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:25:28.611 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:25:28.611 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:25:28.611 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:25:28.611 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:25:28.611 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:25:28.612 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:25:28.612 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:25:28.612 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:25:28.612 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:25:28.613 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:25:28.613 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:25:28.613 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:25:28.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:25:28.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.614 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:25:28.614 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:25:28.614 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:25:28.614 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:25:28.614 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:25:28.615 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:25:28.615 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:25:28.615 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:25:28.615 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:25:28.616 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:25:28.616 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:25:28.616 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:25:28.616 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:25:28.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.617 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:25:28.617 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:25:28.617 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.618 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:25:28.618 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:25:28.618 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:25:28.618 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:25:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:25:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:25:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:25:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:25:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:25:28.620 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:25:28.620 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:25:28.620 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:25:28.620 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:25:28.620 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:25:28.621 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:25:28.621 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:25:28.621 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:25:28.621 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:25:28.622 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:25:28.622 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:25:28.622 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:25:28.622 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:25:28.622 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:25:28.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.623 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:25:28.623 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:25:28.624 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:25:28.624 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:25:28.624 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:25:28.624 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:25:28.624 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:25:28.625 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:25:28.625 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:25:28.625 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:25:28.625 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:25:28.625 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:25:28.626 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:25:28.626 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:25:28.626 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:25:28.627 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:25:28.627 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:25:28.627 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:25:28.627 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:25:28.628 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:25:28.628 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:25:28.628 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:25:28.628 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:25:28.629 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:25:28.629 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:25:28.629 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:25:28.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:25:28.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.630 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:25:28.630 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:25:28.630 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:25:28.630 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:25:28.631 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:25:28.631 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:25:28.631 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:25:28.631 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:25:28.632 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:25:28.632 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:25:28.632 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:25:28.632 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:25:28.632 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:25:28.633 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:25:28.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.633 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 11, 2021-10-20T23:25:28.634 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:25:28.634 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:24:56.691138+0000", 2021-10-20T23:25:28.634 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:25:28.634 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:25:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:25:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:25:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:25:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:25:28.635 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:25:28.636 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:25:28.636 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:25:28.636 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:25:28.636 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:25:28.636 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:25:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:25:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:25:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:25:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:25:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:25:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:25:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:25:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:25:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "67", 2021-10-20T23:25:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:25:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:25:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:25:28.639 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:25:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:25:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:25:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:25:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:25:28.640 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:25:28.641 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:25:28.641 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:25:28.641 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:25:28.641 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:25:28.641 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:25:28.642 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:25:28.642 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:25:28.642 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:25:28.642 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:25:28.643 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:25:28.643 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:25:28.643 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:25:28.644 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:25:28.644 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:25:28.644 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:25:28.644 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:25:28.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:25:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:25:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:25:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:25:28.645 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:25:28.646 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:25:28.646 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:25:28.646 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:25:28.647 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:25:28.647 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:25:28.647 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:25:28.647 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:25:28.647 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:25:28.648 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:25:28.648 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:25:28.648 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:25:28.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:25:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:25:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:25:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 12, 2021-10-20T23:25:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:25:28.651 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:24:57.527415+0000", 2021-10-20T23:25:28.651 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:25:28.651 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:25:28.651 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:25:28.651 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:25:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:25:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:25:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:25:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:25:28.652 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:25:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:25:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:25:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:25:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:25:28.653 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:25:28.654 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:25:28.654 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:25:28.654 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:25:28.654 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:25:28.655 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:25:28.655 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:25:28.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.655 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "68", 2021-10-20T23:25:28.655 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:25:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:25:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:25:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:25:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:25:28.656 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:25:28.657 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:25:28.657 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:25:28.657 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:25:28.657 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:25:28.658 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:25:28.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:25:28.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:25:28.658 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:25:28.658 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:25:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:25:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:25:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:25:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:25:28.659 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:25:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:25:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:25:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:25:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:25:28.660 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:25:28.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:25:28.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.661 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:25:28.661 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:25:28.662 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:25:28.662 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:25:28.662 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:25:28.662 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:25:28.662 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:25:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:25:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:25:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:25:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:25:28.663 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:25:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:25:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:25:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:25:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.665 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:25:28.665 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:25:28.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:25:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:25:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:28.667 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:25:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.669 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.669 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:25:28.669 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:28.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:25:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:28.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.671 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.671 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:28.671 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.672 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.672 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:25:28.672 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:28.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.673 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:25:28.673 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:28.673 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.674 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.674 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:28.674 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.675 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.675 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:25:28.675 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:28.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.676 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:25:28.676 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:28.676 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.676 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.677 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:28.677 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.678 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.678 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:25:28.678 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:28.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.679 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:25:28.679 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:28.680 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.680 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.680 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:25:28.680 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:25:28.681 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:25:28.681 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:25:28.681 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:28.681 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:28.681 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:28.682 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.682 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:25:28.682 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:25:28.683 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:28.683 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:28.683 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:28.683 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:28.684 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:28.684 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:28.684 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:28.684 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:25:28.684 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:28.685 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:28.685 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:28.685 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.685 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.686 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:25:28.686 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:28.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.687 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.687 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:25:28.687 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:28.687 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.687 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.688 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:28.688 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.688 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.689 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:25:28.689 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:28.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.689 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.690 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:25:28.690 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:28.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.690 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.691 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:28.691 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.691 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.692 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:25:28.692 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:28.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.692 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.693 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:25:28.693 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:28.693 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.693 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.694 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:28.694 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.695 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:25:28.695 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:28.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.696 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:25:28.696 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:28.696 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.696 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.697 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:25:28.697 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:25:28.697 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:25:28.697 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:25:28.698 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:28.698 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:28.698 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:28.698 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.699 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:25:28.699 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:25:28.699 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:28.699 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:28.700 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:28.700 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:28.700 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:28.700 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:28.700 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:28.701 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 65, 2021-10-20T23:25:28.701 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:28.701 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:28.701 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:28.702 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.702 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.702 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:25:28.702 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:28.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.703 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:25:28.703 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:28.704 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.704 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.704 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:28.705 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.705 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.705 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:25:28.705 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:28.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.706 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:25:28.706 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:28.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.707 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.707 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:28.708 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.708 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.708 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:25:28.708 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:28.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.709 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.709 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:25:28.709 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:28.710 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.710 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.710 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:28.711 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.711 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:25:28.711 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:25:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:28.713 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.713 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.713 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:25:28.714 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:25:28.714 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:25:28.714 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:25:28.714 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:28.714 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:28.715 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:28.715 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.715 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:25:28.716 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:25:28.716 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:28.716 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:28.716 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:28.717 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:28.717 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:28.717 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:28.717 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:28.717 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 55, 2021-10-20T23:25:28.718 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:28.718 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:28.718 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:28.718 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.719 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.719 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:25:28.719 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:28.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.720 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.720 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:25:28.720 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:28.720 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.721 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.721 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:28.721 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.721 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.722 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.722 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:25:28.722 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:28.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.723 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.723 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:25:28.723 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:28.723 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.724 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.724 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:28.724 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.725 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.725 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:25:28.725 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:28.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.726 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.726 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:25:28.726 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:28.726 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.727 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.727 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:28.727 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.728 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.728 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:25:28.728 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:28.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.728 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.729 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.729 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:25:28.729 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:28.729 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.730 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.730 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:25:28.730 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:25:28.730 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:25:28.731 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:25:28.731 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:28.731 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:28.731 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:28.731 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.732 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:25:28.732 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:25:28.733 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:28.733 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:28.733 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:28.733 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:28.733 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:28.734 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:28.734 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:28.734 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:25:28.734 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:28.734 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:28.735 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:28.735 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.735 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.735 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:25:28.736 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:28.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.736 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.737 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:25:28.737 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:28.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.737 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.738 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:28.738 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.738 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.738 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:25:28.739 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:28.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.739 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:25:28.740 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:28.740 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.740 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.741 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:28.741 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.741 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.741 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:25:28.742 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:28.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.742 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.742 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:25:28.743 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:28.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.743 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.744 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:28.744 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.744 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.744 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:25:28.745 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:28.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.745 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.745 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:25:28.746 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:28.746 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.746 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.747 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:25:28.747 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:25:28.747 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:25:28.747 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:25:28.747 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:28.748 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:28.748 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:28.748 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.749 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:25:28.749 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:25:28.749 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:28.749 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:28.749 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:28.750 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:28.750 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:28.750 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:28.750 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:28.750 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 65, 2021-10-20T23:25:28.751 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:28.751 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:28.751 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:28.751 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.752 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.752 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:25:28.752 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:28.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.753 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.753 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:25:28.753 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:28.753 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.754 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.754 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:28.754 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.755 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.755 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:25:28.755 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:28.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.756 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.756 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:25:28.756 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:28.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.757 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.757 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:28.757 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.758 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.758 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:25:28.758 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:28.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.759 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:25:28.759 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:28.759 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.760 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.760 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:28.760 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.761 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.761 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:25:28.761 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:28.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.762 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.762 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:25:28.762 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:28.762 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.763 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.763 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:25:28.763 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:25:28.763 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:25:28.764 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:25:28.764 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:28.764 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:28.764 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:28.764 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:25:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:25:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:28.766 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:28.766 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:28.766 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:28.766 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:28.767 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:28.767 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:28.767 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:25:28.767 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:28.767 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:25:28.769 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:28.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.769 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.769 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:25:28.770 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:28.770 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.770 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.771 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:28.771 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.771 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.771 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:25:28.772 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:28.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.772 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.772 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:25:28.773 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:28.773 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.773 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.773 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:25:28.775 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:28.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.775 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.775 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:25:28.776 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:28.776 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.776 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.776 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:28.777 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.777 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.777 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:25:28.777 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:28.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.778 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.778 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:25:28.779 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:28.779 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.779 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.779 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:25:28.780 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:25:28.780 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:25:28.780 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:25:28.780 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:28.781 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:28.781 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:28.781 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.782 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:25:28.782 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:25:28.782 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:28.782 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:28.782 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:28.783 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:28.783 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:28.783 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:28.783 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:28.783 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 65, 2021-10-20T23:25:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.785 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.785 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:25:28.785 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:28.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.786 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.786 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:25:28.786 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:28.786 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.787 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.787 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:28.787 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.788 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.788 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:25:28.788 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:28.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.789 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.789 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:25:28.789 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:28.789 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.790 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.790 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:28.790 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.791 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.791 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:25:28.791 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:28.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.792 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.792 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:25:28.792 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:28.792 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.793 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.793 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:28.793 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:28.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.794 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:28.794 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:25:28.794 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:28.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:25:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.796 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.796 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:25:28.796 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:25:28.796 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:25:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:25:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:28.798 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.798 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:25:28.798 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:25:28.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:25:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:28.800 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:28.800 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:25:28.800 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:28.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.801 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:25:28.801 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:28.801 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:28.801 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:28.801 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:28.802 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:28.802 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:25:28.802 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:28.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.803 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:25:28.803 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:28.803 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:28.803 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:28.804 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:28.804 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:28.804 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:25:28.804 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:28.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.805 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:25:28.805 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:28.805 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:28.806 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:28.806 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:28.806 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:28.806 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:25:28.806 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:25:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:28.808 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:28.808 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:28.808 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:28.808 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:25:28.808 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:25:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:28.810 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:28.810 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:28.810 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:28.810 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:25:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:25:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:28.812 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:28.812 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:28.812 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:28.812 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:28.812 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:25:28.813 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:28.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:28.813 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:25:28.814 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:28.814 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:28.814 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:28.814 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:28.814 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:25:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:25:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:25:28.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:25:28.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:25:28.816 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:25:28.816 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:25:28.816 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:25:28.817 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:25:28.817 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:25:28.817 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:25:28.817 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:25:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:25:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:25:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:25:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:25:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:25:28.819 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:25:28.819 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:25:28.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.819 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:25:28.819 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:25:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:25:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:25:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:25:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:25:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:25:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:25:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:25:28.822 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:25:28.822 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:25:28.822 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:25:28.822 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:25:28.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f975c0536d0 msgr2=0x7f975c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f975c0536d0 0x7f975c055b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f976c01a000 tx=0x7f976c014000).stop 2021-10-20T23:25:28.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977c0b27a0 msgr2=0x7f977c0aa760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977c0b27a0 0x7f977c0aa760 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f977400c000 tx=0x7f9774006df0).stop 2021-10-20T23:25:28.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 shutdown_connections 2021-10-20T23:25:28.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f975c0536d0 0x7f975c055b90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977c0b27a0 0x7f977c0aa760 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f977c0b1d10 0x7f977c0ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 --2- 172.21.15.12:0/3021622841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f977c05c490 0x7f977c157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 >> 172.21.15.12:0/3021622841 conn(0x7f977c061140 msgr2=0x7f977c14b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:28.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 shutdown_connections 2021-10-20T23:25:28.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.590+0000 7f9783135700 1 -- 172.21.15.12:0/3021622841 wait complete. 2021-10-20T23:25:28.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:28.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9e4bde700 1 Processor -- start 2021-10-20T23:25:28.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9e4bde700 1 -- start start 2021-10-20T23:25:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9e4bde700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa9e0067300 0x7fa9e01438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9e4bde700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0143de0 0x7fa9e014b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9e4bde700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e00aabb0 con 0x7fa9e0060100 2021-10-20T23:25:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9e4bde700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e00604e0 con 0x7fa9e0067300 2021-10-20T23:25:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9e4bde700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0066ea0 con 0x7fa9e0143de0 2021-10-20T23:25:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9ddd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa9e0067300 0x7fa9e01438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9ded9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0143de0 0x7fa9e014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9de59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa9e0060100 0x7fa9e00b4750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:46128/0 (socket says 172.21.15.12:46128) 2021-10-20T23:25:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9de59c700 1 -- 172.21.15.12:0/1460899070 learned_addr learned my addr 172.21.15.12:0/1460899070 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9ddd9b700 1 -- 172.21.15.12:0/1460899070 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0143de0 msgr2=0x7fa9e014b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9ddd9b700 1 --2- 172.21.15.12:0/1460899070 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0143de0 0x7fa9e014b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9ddd9b700 1 -- 172.21.15.12:0/1460899070 >> v1:172.21.15.31:6789/0 conn(0x7fa9e0060100 legacy=0x7fa9e00b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9ddd9b700 1 -- 172.21.15.12:0/1460899070 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00b33b0 con 0x7fa9e0067300 2021-10-20T23:25:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9ddd9b700 1 --2- 172.21.15.12:0/1460899070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9e0067300 0x7fa9e01438f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa9d00032f0 tx=0x7fa9d00091d0).ready entity=mon.1 client_cookie=5e5b533101f9868c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:28.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9dd59a700 1 -- 172.21.15.12:0/1460899070 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d000b6c0 con 0x7fa9e0067300 2021-10-20T23:25:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9dd59a700 1 -- 172.21.15.12:0/1460899070 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d000b820 con 0x7fa9e0067300 2021-10-20T23:25:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.934+0000 7fa9dd59a700 1 -- 172.21.15.12:0/1460899070 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d000b990 con 0x7fa9e0067300 2021-10-20T23:25:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 -- 172.21.15.12:0/1460899070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9e0067300 msgr2=0x7fa9e01438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 --2- 172.21.15.12:0/1460899070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9e0067300 0x7fa9e01438f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa9d00032f0 tx=0x7fa9d00091d0).stop 2021-10-20T23:25:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 -- 172.21.15.12:0/1460899070 shutdown_connections 2021-10-20T23:25:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 --2- 172.21.15.12:0/1460899070 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0143de0 0x7fa9e014b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 --2- 172.21.15.12:0/1460899070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9e0067300 0x7fa9e01438f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 -- 172.21.15.12:0/1460899070 >> 172.21.15.12:0/1460899070 conn(0x7fa9e005cf30 msgr2=0x7fa9e005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 -- 172.21.15.12:0/1460899070 shutdown_connections 2021-10-20T23:25:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 -- 172.21.15.12:0/1460899070 wait complete. 2021-10-20T23:25:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 Processor -- start 2021-10-20T23:25:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 -- start start 2021-10-20T23:25:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0060100 0x7fa9e00b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9e0067300 0x7fa9e0150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9e0143de0 0x7fa9e00adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e009f560 con 0x7fa9e0143de0 2021-10-20T23:25:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e009f800 con 0x7fa9e0067300 2021-10-20T23:25:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.938+0000 7fa9e4bde700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e009faa0 con 0x7fa9e0060100 2021-10-20T23:25:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ded9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9e0143de0 0x7fa9e00adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ded9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9e0143de0 0x7fa9e00adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40480/0 (socket says 172.21.15.12:40480) 2021-10-20T23:25:28.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ded9d700 1 -- 172.21.15.12:0/3610621173 learned_addr learned my addr 172.21.15.12:0/3610621173 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:28.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9de59c700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0060100 0x7fa9e00b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ddd9b700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9e0067300 0x7fa9e0150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ded9d700 1 -- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0060100 msgr2=0x7fa9e00b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ded9d700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0060100 0x7fa9e00b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ded9d700 1 -- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9e0067300 msgr2=0x7fa9e0150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:28.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ded9d700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9e0067300 0x7fa9e0150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:28.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ded9d700 1 -- 172.21.15.12:0/3610621173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0009470 con 0x7fa9e0143de0 2021-10-20T23:25:28.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9ded9d700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9e0143de0 0x7fa9e00adb50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fa9d800c000 tx=0x7fa9d8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:28.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9d77fe700 1 -- 172.21.15.12:0/3610621173 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d8011750 con 0x7fa9e0143de0 2021-10-20T23:25:28.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9d77fe700 1 -- 172.21.15.12:0/3610621173 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d80118b0 con 0x7fa9e0143de0 2021-10-20T23:25:28.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e009fd40 con 0x7fa9e0143de0 2021-10-20T23:25:28.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9d77fe700 1 -- 172.21.15.12:0/3610621173 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d8011c10 con 0x7fa9e0143de0 2021-10-20T23:25:28.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e01510f0 con 0x7fa9e0143de0 2021-10-20T23:25:28.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e009fed0 con 0x7fa9e0143de0 2021-10-20T23:25:28.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.942+0000 7fa9d77fe700 1 -- 172.21.15.12:0/3610621173 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9d8011d70 con 0x7fa9e0143de0 2021-10-20T23:25:28.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.946+0000 7fa9d77fe700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa9b8053610 0x7fa9b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:28.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.946+0000 7fa9d77fe700 1 -- 172.21.15.12:0/3610621173 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa9d806be00 con 0x7fa9e0143de0 2021-10-20T23:25:28.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.946+0000 7fa9de59c700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa9b8053610 0x7fa9b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:28.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.946+0000 7fa9de59c700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa9b8053610 0x7fa9b8055ad0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fa9c800d000 tx=0x7fa9c8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:28.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:28.950+0000 7fa9d77fe700 1 -- 172.21.15.12:0/3610621173 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9d8042da0 con 0x7fa9e0143de0 2021-10-20T23:25:29.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.114+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9e0057350 con 0x7fa9e0143de0 2021-10-20T23:25:29.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.114+0000 7fa9d77fe700 1 -- 172.21.15.12:0/3610621173 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fa9d80463c0 con 0x7fa9e0143de0 2021-10-20T23:25:29.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:29.120 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:24:58.106627+0000","modified":"2021-10-20T23:24:59.110023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5944":{"gid":5944,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/242443509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":242443509},{"type":"v1","addr":"172.21.15.12:6833","nonce":242443509}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-20T23:25:29.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa9b8053610 msgr2=0x7fa9b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:29.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa9b8053610 0x7fa9b8055ad0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fa9c800d000 tx=0x7fa9c8009040).stop 2021-10-20T23:25:29.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9e0143de0 msgr2=0x7fa9e00adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:29.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9e0143de0 0x7fa9e00adb50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fa9d800c000 tx=0x7fa9d8006df0).stop 2021-10-20T23:25:29.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 shutdown_connections 2021-10-20T23:25:29.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa9b8053610 0x7fa9b8055ad0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:29.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9e0143de0 0x7fa9e00adb50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:29.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9e0067300 0x7fa9e0150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:29.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 --2- 172.21.15.12:0/3610621173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9e0060100 0x7fa9e00b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:29.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 >> 172.21.15.12:0/3610621173 conn(0x7fa9e005cf30 msgr2=0x7fa9e005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:29.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 shutdown_connections 2021-10-20T23:25:29.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.118+0000 7fa9e4bde700 1 -- 172.21.15.12:0/3610621173 wait complete. 2021-10-20T23:25:29.126 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2021-10-20T23:25:29.133 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:25:29.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e88a68700 1 Processor -- start 2021-10-20T23:25:29.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e88a68700 1 -- start start 2021-10-20T23:25:29.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e88a68700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e840b30d0 0x7f8e84143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:29.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e88a68700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e840ace70 0x7f8e8413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:29.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e88a68700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e84143920 con 0x7f8e840b0710 2021-10-20T23:25:29.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e837fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8e840b0710 0x7f8e84142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39078/0 (socket says 172.21.15.12:39078) 2021-10-20T23:25:29.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e837fe700 1 -- 172.21.15.12:0/2245026947 learned_addr learned my addr 172.21.15.12:0/2245026947 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:29.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e82ffd700 1 --2- 172.21.15.12:0/2245026947 >> v2:172.21.15.12:3300/0 conn(0x7f8e840b30d0 0x7f8e84143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:29.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e88a68700 1 -- 172.21.15.12:0/2245026947 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e840b0af0 con 0x7f8e840b30d0 2021-10-20T23:25:29.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e88a68700 1 -- 172.21.15.12:0/2245026947 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e840ae680 con 0x7f8e840ace70 2021-10-20T23:25:29.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e827fc700 1 -- 172.21.15.12:0/2245026947 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868544781 0 0) 0x7f8e84143920 con 0x7f8e840b0710 2021-10-20T23:25:29.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e83fff700 1 --2- 172.21.15.12:0/2245026947 >> v2:172.21.15.31:3300/0 conn(0x7f8e840ace70 0x7f8e8413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:29.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e827fc700 1 -- 172.21.15.12:0/2245026947 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e70003260 con 0x7f8e840b0710 2021-10-20T23:25:29.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e82ffd700 1 -- 172.21.15.12:0/2245026947 >> v2:172.21.15.31:3300/0 conn(0x7f8e840ace70 msgr2=0x7f8e8413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:29.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e82ffd700 1 --2- 172.21.15.12:0/2245026947 >> v2:172.21.15.31:3300/0 conn(0x7f8e840ace70 0x7f8e8413f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:29.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e82ffd700 1 -- 172.21.15.12:0/2245026947 >> v1:172.21.15.12:6789/0 conn(0x7f8e840b0710 legacy=0x7f8e84142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:29.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.230+0000 7f8e82ffd700 1 -- 172.21.15.12:0/2245026947 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e840ae920 con 0x7f8e840b30d0 2021-10-20T23:25:29.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e82ffd700 1 --2- 172.21.15.12:0/2245026947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b30d0 0x7f8e84143430 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f8e78002f70 tx=0x7f8e78006df0).ready entity=mon.0 client_cookie=f7d519a02fba5a3f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:29.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e827fc700 1 -- 172.21.15.12:0/2245026947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7800d570 con 0x7f8e840b30d0 2021-10-20T23:25:29.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e827fc700 1 -- 172.21.15.12:0/2245026947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e78000e90 con 0x7f8e840b30d0 2021-10-20T23:25:29.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e827fc700 1 -- 172.21.15.12:0/2245026947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7800d8c0 con 0x7f8e840b30d0 2021-10-20T23:25:29.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 -- 172.21.15.12:0/2245026947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b30d0 msgr2=0x7f8e84143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:29.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 --2- 172.21.15.12:0/2245026947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b30d0 0x7f8e84143430 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f8e78002f70 tx=0x7f8e78006df0).stop 2021-10-20T23:25:29.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 -- 172.21.15.12:0/2245026947 shutdown_connections 2021-10-20T23:25:29.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 --2- 172.21.15.12:0/2245026947 >> v2:172.21.15.31:3300/0 conn(0x7f8e840ace70 0x7f8e8413f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:29.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 --2- 172.21.15.12:0/2245026947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b30d0 0x7f8e84143430 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:29.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 -- 172.21.15.12:0/2245026947 >> 172.21.15.12:0/2245026947 conn(0x7f8e84061140 msgr2=0x7f8e84062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:29.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 -- 172.21.15.12:0/2245026947 shutdown_connections 2021-10-20T23:25:29.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 -- 172.21.15.12:0/2245026947 wait complete. 2021-10-20T23:25:29.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 Processor -- start 2021-10-20T23:25:29.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 -- start start 2021-10-20T23:25:29.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e840ace70 0x7f8e840b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:29.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b0710 0x7f8e84067080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:29.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840b30d0 0x7f8e84136810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:29.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840ab9e0 con 0x7f8e840b0710 2021-10-20T23:25:29.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840ac440 con 0x7f8e840ace70 2021-10-20T23:25:29.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e88a68700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e841531c0 con 0x7f8e840b30d0 2021-10-20T23:25:29.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e82ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b0710 0x7f8e84067080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:29.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e82ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b0710 0x7f8e84067080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40492/0 (socket says 172.21.15.12:40492) 2021-10-20T23:25:29.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e82ffd700 1 -- 172.21.15.12:0/768049288 learned_addr learned my addr 172.21.15.12:0/768049288 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:29.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e837fe700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e840ace70 0x7f8e840b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:29.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.234+0000 7f8e83fff700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840b30d0 0x7f8e84136810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:29.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e82ffd700 1 -- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840b30d0 msgr2=0x7f8e84136810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:29.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e82ffd700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840b30d0 0x7f8e84136810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:29.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e82ffd700 1 -- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e840ace70 msgr2=0x7f8e840b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:29.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e82ffd700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e840ace70 0x7f8e840b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:29.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e82ffd700 1 -- 172.21.15.12:0/768049288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7800b180 con 0x7f8e840b0710 2021-10-20T23:25:29.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e82ffd700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b0710 0x7f8e84067080 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f8e78002f70 tx=0x7f8e78014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:29.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e80ff9700 1 -- 172.21.15.12:0/768049288 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7800dea0 con 0x7f8e840b0710 2021-10-20T23:25:29.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e80ff9700 1 -- 172.21.15.12:0/768049288 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e78013de0 con 0x7f8e840b0710 2021-10-20T23:25:29.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e84153460 con 0x7f8e840b0710 2021-10-20T23:25:29.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e80ff9700 1 -- 172.21.15.12:0/768049288 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7801e5f0 con 0x7f8e840b0710 2021-10-20T23:25:29.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e84063c20 con 0x7f8e840b0710 2021-10-20T23:25:29.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e840ac640 con 0x7f8e840b0710 2021-10-20T23:25:29.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e80ff9700 1 -- 172.21.15.12:0/768049288 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8e78025030 con 0x7f8e840b0710 2021-10-20T23:25:29.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e80ff9700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e640535b0 0x7f8e64055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:29.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e80ff9700 1 -- 172.21.15.12:0/768049288 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8e7806c710 con 0x7f8e840b0710 2021-10-20T23:25:29.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e837fe700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e640535b0 0x7f8e64055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:29.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.238+0000 7f8e837fe700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e640535b0 0x7f8e64055a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f8e7400d000 tx=0x7f8e74009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:29.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.246+0000 7f8e80ff9700 1 -- 172.21.15.12:0/768049288 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8e78043710 con 0x7f8e840b0710 2021-10-20T23:25:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:29.406+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8e84153000 con 0x7f8e840b0710 2021-10-20T23:25:30.189 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:25:30.182+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:25:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.198+0000 7f8e80ff9700 1 -- 172.21.15.12:0/768049288 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8e78023090 con 0x7f8e840b0710 2021-10-20T23:25:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e640535b0 msgr2=0x7f8e64055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e640535b0 0x7f8e64055a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f8e7400d000 tx=0x7f8e74009040).stop 2021-10-20T23:25:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b0710 msgr2=0x7f8e84067080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b0710 0x7f8e84067080 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f8e78002f70 tx=0x7f8e78014000).stop 2021-10-20T23:25:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 shutdown_connections 2021-10-20T23:25:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e640535b0 0x7f8e64055a70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840b30d0 0x7f8e84136810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e840b0710 0x7f8e84067080 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 --2- 172.21.15.12:0/768049288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e840ace70 0x7f8e840b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 >> 172.21.15.12:0/768049288 conn(0x7f8e84061140 msgr2=0x7f8e84142370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:30.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 shutdown_connections 2021-10-20T23:25:30.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.202+0000 7f8e88a68700 1 -- 172.21.15.12:0/768049288 wait complete. 2021-10-20T23:25:30.213 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:25:30.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:30.250 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:25:30.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6c6754700 1 Processor -- start 2021-10-20T23:25:30.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6c6754700 1 -- start start 2021-10-20T23:25:30.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6c6754700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c00b6900 0x7fa6c00acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6c6754700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa6c0060910 0x7fa6c00a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6c6754700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c00b6ce0 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6c6754700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c00611e0 con 0x7fa6c0060910 2021-10-20T23:25:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6c6754700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c0061480 con 0x7fa6c00b6900 2021-10-20T23:25:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6c4cf1700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa6c00aa3b0 0x7fa6c00b1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39106/0 (socket says 172.21.15.12:39106) 2021-10-20T23:25:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6c4cf1700 1 -- 172.21.15.12:0/793544874 learned_addr learned my addr 172.21.15.12:0/793544874 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6bffff700 1 --2- 172.21.15.12:0/793544874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c00b6900 0x7fa6c00acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.330+0000 7fa6bf7fe700 1 --2- 172.21.15.12:0/793544874 >> v2:172.21.15.31:3300/0 conn(0x7fa6c0060910 0x7fa6c00a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6beffd700 1 -- 172.21.15.12:0/793544874 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763687564 0 0) 0x7fa6c00b6ce0 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6beffd700 1 -- 172.21.15.12:0/793544874 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6ac003260 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6bffff700 1 -- 172.21.15.12:0/793544874 >> v2:172.21.15.31:3300/0 conn(0x7fa6c0060910 msgr2=0x7fa6c00a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6bffff700 1 --2- 172.21.15.12:0/793544874 >> v2:172.21.15.31:3300/0 conn(0x7fa6c0060910 0x7fa6c00a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6bffff700 1 -- 172.21.15.12:0/793544874 >> v1:172.21.15.12:6789/0 conn(0x7fa6c00aa3b0 legacy=0x7fa6c00b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6bffff700 1 -- 172.21.15.12:0/793544874 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0061720 con 0x7fa6c00b6900 2021-10-20T23:25:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6bf7fe700 1 --2- 172.21.15.12:0/793544874 >> v2:172.21.15.31:3300/0 conn(0x7fa6c0060910 0x7fa6c00a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6bffff700 1 --2- 172.21.15.12:0/793544874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c00b6900 0x7fa6c00acd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa6b0002f70 tx=0x7fa6b0006e80).ready entity=mon.2 client_cookie=789c0560b3dbf500 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6beffd700 1 -- 172.21.15.12:0/793544874 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b000f730 con 0x7fa6c00b6900 2021-10-20T23:25:30.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6beffd700 1 -- 172.21.15.12:0/793544874 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b0000e90 con 0x7fa6c00b6900 2021-10-20T23:25:30.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6beffd700 1 -- 172.21.15.12:0/793544874 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b000fa80 con 0x7fa6c00b6900 2021-10-20T23:25:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6c6754700 1 -- 172.21.15.12:0/793544874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c00b6900 msgr2=0x7fa6c00acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6c6754700 1 --2- 172.21.15.12:0/793544874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c00b6900 0x7fa6c00acd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa6b0002f70 tx=0x7fa6b0006e80).stop 2021-10-20T23:25:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6c6754700 1 -- 172.21.15.12:0/793544874 shutdown_connections 2021-10-20T23:25:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6c6754700 1 --2- 172.21.15.12:0/793544874 >> v2:172.21.15.31:3300/0 conn(0x7fa6c0060910 0x7fa6c00a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6c6754700 1 --2- 172.21.15.12:0/793544874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c00b6900 0x7fa6c00acd50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6c6754700 1 -- 172.21.15.12:0/793544874 >> 172.21.15.12:0/793544874 conn(0x7fa6c00b3480 msgr2=0x7fa6c00b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6c6754700 1 -- 172.21.15.12:0/793544874 shutdown_connections 2021-10-20T23:25:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6c6754700 1 -- 172.21.15.12:0/793544874 wait complete. 2021-10-20T23:25:30.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.334+0000 7fa6c6754700 1 Processor -- start 2021-10-20T23:25:30.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 -- start start 2021-10-20T23:25:30.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c0060910 0x7fa6c00ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6c00aa3b0 0x7fa6c00afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c00b6900 0x7fa6c0140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c0141d10 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00aedc0 con 0x7fa6c00b6900 2021-10-20T23:25:30.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00af020 con 0x7fa6c0060910 2021-10-20T23:25:30.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6c00aa3b0 0x7fa6c00afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6c00aa3b0 0x7fa6c00afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40518/0 (socket says 172.21.15.12:40518) 2021-10-20T23:25:30.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bf7fe700 1 -- 172.21.15.12:0/2334238469 learned_addr learned my addr 172.21.15.12:0/2334238469 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:30.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bffff700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c0060910 0x7fa6c00ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c4cf1700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c00b6900 0x7fa6c0140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bf7fe700 1 -- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c0060910 msgr2=0x7fa6c00ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bf7fe700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c0060910 0x7fa6c00ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bf7fe700 1 -- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c00b6900 msgr2=0x7fa6c0140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bf7fe700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c00b6900 0x7fa6c0140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bf7fe700 1 -- 172.21.15.12:0/2334238469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b400b180 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bf7fe700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6c00aa3b0 0x7fa6c00afc50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fa6b400c000 tx=0x7fa6b4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:30.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bd7fa700 1 -- 172.21.15.12:0/2334238469 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b4010780 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bd7fa700 1 -- 172.21.15.12:0/2334238469 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b40108e0 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b000c310 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6bd7fa700 1 -- 172.21.15.12:0/2334238469 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b4010c40 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c0143470 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.338+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c00619c0 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.342+0000 7fa6bd7fa700 1 -- 172.21.15.12:0/2334238469 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa6b401c460 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.342+0000 7fa6bd7fa700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa6a00536a0 0x7fa6a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.342+0000 7fa6bd7fa700 1 -- 172.21.15.12:0/2334238469 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fa6b406bf80 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.342+0000 7fa6bffff700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa6a00536a0 0x7fa6a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.342+0000 7fa6bffff700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa6a00536a0 0x7fa6a0055b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fa6b001b000 tx=0x7fa6b0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:30.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.346+0000 7fa6bd7fa700 1 -- 172.21.15.12:0/2334238469 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa6b4042ed0 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.510+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6c0057350 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6bd7fa700 1 -- 172.21.15.12:0/2334238469 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fa6b40464f0 con 0x7fa6c00aa3b0 2021-10-20T23:25:30.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:30.520 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:24:58.106627+0000","modified":"2021-10-20T23:25:30.186698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-20T23:25:30.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa6a00536a0 msgr2=0x7fa6a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa6a00536a0 0x7fa6a0055b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fa6b001b000 tx=0x7fa6b0017000).stop 2021-10-20T23:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6c00aa3b0 msgr2=0x7fa6c00afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6c00aa3b0 0x7fa6c00afc50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fa6b400c000 tx=0x7fa6b4006df0).stop 2021-10-20T23:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 shutdown_connections 2021-10-20T23:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa6a00536a0 0x7fa6a0055b60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c00b6900 0x7fa6c0140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6c00aa3b0 0x7fa6c00afc50 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 --2- 172.21.15.12:0/2334238469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6c0060910 0x7fa6c00ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 >> 172.21.15.12:0/2334238469 conn(0x7fa6c00b3480 msgr2=0x7fa6c0138db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 shutdown_connections 2021-10-20T23:25:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.514+0000 7fa6c6754700 1 -- 172.21.15.12:0/2334238469 wait complete. 2021-10-20T23:25:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 32 2021-10-20T23:25:30.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:25:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.638+0000 7f395e391700 1 Processor -- start 2021-10-20T23:25:30.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.638+0000 7f395e391700 1 -- start start 2021-10-20T23:25:30.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.638+0000 7f395e391700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39580668c0 0x7f39580b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.638+0000 7f395e391700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39580b0cd0 0x7f39580b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.638+0000 7f395e391700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f395805fc90 0x7f39580b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.638+0000 7f395e391700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580b1570 con 0x7f39580668c0 2021-10-20T23:25:30.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.638+0000 7f395e391700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3958066ca0 con 0x7f395805fc90 2021-10-20T23:25:30.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.638+0000 7f395e391700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39580b1370 con 0x7f39580b0cd0 2021-10-20T23:25:30.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.638+0000 7f395d38f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39580668c0 0x7f39580b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395d38f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39580668c0 0x7f39580b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40526/0 (socket says 172.21.15.12:40526) 2021-10-20T23:25:30.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395db90700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f395805fc90 0x7f39580b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395d38f700 1 -- 172.21.15.12:0/460791425 learned_addr learned my addr 172.21.15.12:0/460791425 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:30.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395cb8e700 1 --2- 172.21.15.12:0/460791425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39580b0cd0 0x7f39580b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395d38f700 1 -- 172.21.15.12:0/460791425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39580b0cd0 msgr2=0x7f39580b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:30.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395d38f700 1 --2- 172.21.15.12:0/460791425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39580b0cd0 0x7f39580b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395d38f700 1 -- 172.21.15.12:0/460791425 >> v2:172.21.15.31:3300/0 conn(0x7f395805fc90 msgr2=0x7f39580b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:30.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395d38f700 1 --2- 172.21.15.12:0/460791425 >> v2:172.21.15.31:3300/0 conn(0x7f395805fc90 0x7f39580b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395d38f700 1 -- 172.21.15.12:0/460791425 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395805f830 con 0x7f39580668c0 2021-10-20T23:25:30.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395db90700 1 --2- 172.21.15.12:0/460791425 >> v2:172.21.15.31:3300/0 conn(0x7f395805fc90 0x7f39580b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:30.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395d38f700 1 --2- 172.21.15.12:0/460791425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580668c0 0x7f39580b21a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f3954002f70 tx=0x7f3954006eb0).ready entity=mon.0 client_cookie=359025ecbf13f7c0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:30.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f394bfff700 1 -- 172.21.15.12:0/460791425 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f395400d570 con 0x7f39580668c0 2021-10-20T23:25:30.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f394bfff700 1 -- 172.21.15.12:0/460791425 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3954000e90 con 0x7f39580668c0 2021-10-20T23:25:30.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f394bfff700 1 -- 172.21.15.12:0/460791425 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f395400d900 con 0x7f39580668c0 2021-10-20T23:25:30.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395e391700 1 -- 172.21.15.12:0/460791425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580668c0 msgr2=0x7f39580b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395e391700 1 --2- 172.21.15.12:0/460791425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580668c0 0x7f39580b21a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f3954002f70 tx=0x7f3954006eb0).stop 2021-10-20T23:25:30.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395e391700 1 -- 172.21.15.12:0/460791425 shutdown_connections 2021-10-20T23:25:30.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395e391700 1 --2- 172.21.15.12:0/460791425 >> v2:172.21.15.31:3300/0 conn(0x7f395805fc90 0x7f39580b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395e391700 1 --2- 172.21.15.12:0/460791425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39580b0cd0 0x7f39580b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395e391700 1 --2- 172.21.15.12:0/460791425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580668c0 0x7f39580b21a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395e391700 1 -- 172.21.15.12:0/460791425 >> 172.21.15.12:0/460791425 conn(0x7f3958063670 msgr2=0x7f3958063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:30.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395e391700 1 -- 172.21.15.12:0/460791425 shutdown_connections 2021-10-20T23:25:30.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.642+0000 7f395e391700 1 -- 172.21.15.12:0/460791425 wait complete. 2021-10-20T23:25:30.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 Processor -- start 2021-10-20T23:25:30.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 -- start start 2021-10-20T23:25:30.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f395805fc90 0x7f39580ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39580668c0 0x7f3958153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580b0cd0 0x7f3958153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958140690 con 0x7f39580b0cd0 2021-10-20T23:25:30.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39581410a0 con 0x7f39580668c0 2021-10-20T23:25:30.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3958145290 con 0x7f395805fc90 2021-10-20T23:25:30.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395db90700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580b0cd0 0x7f3958153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395db90700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580b0cd0 0x7f3958153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40534/0 (socket says 172.21.15.12:40534) 2021-10-20T23:25:30.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395db90700 1 -- 172.21.15.12:0/1756112617 learned_addr learned my addr 172.21.15.12:0/1756112617 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:30.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395cb8e700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39580668c0 0x7f3958153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395d38f700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f395805fc90 0x7f39580ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395db90700 1 -- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f395805fc90 msgr2=0x7f39580ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395db90700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f395805fc90 0x7f39580ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395db90700 1 -- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39580668c0 msgr2=0x7f3958153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:30.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395db90700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39580668c0 0x7f3958153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:30.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395db90700 1 -- 172.21.15.12:0/1756112617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950009470 con 0x7f39580b0cd0 2021-10-20T23:25:30.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395db90700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580b0cd0 0x7f3958153cf0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f39580acc00 tx=0x7f39500091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:30.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f394a7fc700 1 -- 172.21.15.12:0/1756112617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f395000c850 con 0x7f39580b0cd0 2021-10-20T23:25:30.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f394a7fc700 1 -- 172.21.15.12:0/1756112617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395000c9b0 con 0x7f39580b0cd0 2021-10-20T23:25:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395400b1e0 con 0x7f39580b0cd0 2021-10-20T23:25:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f394a7fc700 1 -- 172.21.15.12:0/1756112617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f395000cd10 con 0x7f39580b0cd0 2021-10-20T23:25:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.646+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3958150e30 con 0x7f39580b0cd0 2021-10-20T23:25:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.650+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3958060110 con 0x7f39580b0cd0 2021-10-20T23:25:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.650+0000 7f394a7fc700 1 -- 172.21.15.12:0/1756112617 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3950022070 con 0x7f39580b0cd0 2021-10-20T23:25:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.650+0000 7f394a7fc700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39400534f0 0x7f39400559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.650+0000 7f394a7fc700 1 -- 172.21.15.12:0/1756112617 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f395006c240 con 0x7f39580b0cd0 2021-10-20T23:25:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.650+0000 7f395d38f700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39400534f0 0x7f39400559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.650+0000 7f395d38f700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39400534f0 0x7f39400559b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f395401c000 tx=0x7f3954015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.658+0000 7f394a7fc700 1 -- 172.21.15.12:0/1756112617 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f39500431f0 con 0x7f39580b0cd0 2021-10-20T23:25:30.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:30.818+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3958150fc0 con 0x7f39580b0cd0 2021-10-20T23:25:31.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.422+0000 7f394a7fc700 1 -- 172.21.15.12:0/1756112617 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3950046810 con 0x7f39580b0cd0 2021-10-20T23:25:31.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39400534f0 msgr2=0x7f39400559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:31.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39400534f0 0x7f39400559b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f395401c000 tx=0x7f3954015000).stop 2021-10-20T23:25:31.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580b0cd0 msgr2=0x7f3958153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:31.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580b0cd0 0x7f3958153cf0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f39580acc00 tx=0x7f39500091d0).stop 2021-10-20T23:25:31.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 shutdown_connections 2021-10-20T23:25:31.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39400534f0 0x7f39400559b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:31.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39580b0cd0 0x7f3958153cf0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:31.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39580668c0 0x7f3958153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:31.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 --2- 172.21.15.12:0/1756112617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f395805fc90 0x7f39580ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:31.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 >> 172.21.15.12:0/1756112617 conn(0x7f3958063670 msgr2=0x7f395813a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:31.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 shutdown_connections 2021-10-20T23:25:31.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.426+0000 7f395e391700 1 -- 172.21.15.12:0/1756112617 wait complete. 2021-10-20T23:25:31.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:25:31.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbda67b700 1 Processor -- start 2021-10-20T23:25:31.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbda67b700 1 -- start start 2021-10-20T23:25:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbda67b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b6580 0x7fdbd40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbda67b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbd40b43c0 0x7fdbd40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbda67b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd41440b0 con 0x7fdbd4061d30 2021-10-20T23:25:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbda67b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40b6e50 con 0x7fdbd40b43c0 2021-10-20T23:25:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbda67b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4143b70 con 0x7fdbd40b6580 2021-10-20T23:25:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbd37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbd40b43c0 0x7fdbd40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbd37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbd40b43c0 0x7fdbd40b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40542/0 (socket says 172.21.15.12:40542) 2021-10-20T23:25:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbd37fe700 1 -- 172.21.15.12:0/3874720827 learned_addr learned my addr 172.21.15.12:0/3874720827 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.566+0000 7fdbd3fff700 1 --2- 172.21.15.12:0/3874720827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b6580 0x7fdbd40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbd37fe700 1 -- 172.21.15.12:0/3874720827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b6580 msgr2=0x7fdbd40b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbd37fe700 1 --2- 172.21.15.12:0/3874720827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b6580 0x7fdbd40b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbd37fe700 1 -- 172.21.15.12:0/3874720827 >> v1:172.21.15.31:6789/0 conn(0x7fdbd4061d30 legacy=0x7fdbd41466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbd37fe700 1 -- 172.21.15.12:0/3874720827 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd4143e10 con 0x7fdbd40b43c0 2021-10-20T23:25:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbd3fff700 1 --2- 172.21.15.12:0/3874720827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b6580 0x7fdbd40b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbd37fe700 1 --2- 172.21.15.12:0/3874720827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b43c0 0x7fdbd40b6960 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fdbc4002f70 tx=0x7fdbc4006eb0).ready entity=mon.0 client_cookie=2548b484fb64e6fd server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:31.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbd2ffd700 1 -- 172.21.15.12:0/3874720827 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc400d5c0 con 0x7fdbd40b43c0 2021-10-20T23:25:31.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbd2ffd700 1 -- 172.21.15.12:0/3874720827 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc4000e90 con 0x7fdbd40b43c0 2021-10-20T23:25:31.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbd2ffd700 1 -- 172.21.15.12:0/3874720827 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc400d950 con 0x7fdbd40b43c0 2021-10-20T23:25:31.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 -- 172.21.15.12:0/3874720827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b43c0 msgr2=0x7fdbd40b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:31.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 --2- 172.21.15.12:0/3874720827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b43c0 0x7fdbd40b6960 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fdbc4002f70 tx=0x7fdbc4006eb0).stop 2021-10-20T23:25:31.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 -- 172.21.15.12:0/3874720827 shutdown_connections 2021-10-20T23:25:31.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 --2- 172.21.15.12:0/3874720827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b43c0 0x7fdbd40b6960 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:31.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 --2- 172.21.15.12:0/3874720827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b6580 0x7fdbd40b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:31.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 -- 172.21.15.12:0/3874720827 >> 172.21.15.12:0/3874720827 conn(0x7fdbd405c490 msgr2=0x7fdbd405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:31.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 -- 172.21.15.12:0/3874720827 shutdown_connections 2021-10-20T23:25:31.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 -- 172.21.15.12:0/3874720827 wait complete. 2021-10-20T23:25:31.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 Processor -- start 2021-10-20T23:25:31.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.570+0000 7fdbda67b700 1 -- start start 2021-10-20T23:25:31.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbda67b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd4061d30 0x7fdbd4129d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:31.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbda67b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b43c0 0x7fdbd4155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:31.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbda67b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b6580 0x7fdbd41561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:31.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbda67b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd41566d0 con 0x7fdbd40b6580 2021-10-20T23:25:31.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbda67b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40b3c60 con 0x7fdbd4061d30 2021-10-20T23:25:31.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbda67b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40ba220 con 0x7fdbd40b43c0 2021-10-20T23:25:31.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd8c18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b6580 0x7fdbd41561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:31.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b43c0 0x7fdbd4155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:31.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd8c18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b6580 0x7fdbd41561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40548/0 (socket says 172.21.15.12:40548) 2021-10-20T23:25:31.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd8c18700 1 -- 172.21.15.12:0/3413386737 learned_addr learned my addr 172.21.15.12:0/3413386737 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:31.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd3fff700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd4061d30 0x7fdbd4129d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:31.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd8c18700 1 -- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b43c0 msgr2=0x7fdbd4155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:31.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd8c18700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b43c0 0x7fdbd4155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:31.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd8c18700 1 -- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd4061d30 msgr2=0x7fdbd4129d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:31.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd8c18700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd4061d30 0x7fdbd4129d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:31.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd8c18700 1 -- 172.21.15.12:0/3413386737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc400b1e0 con 0x7fdbd40b6580 2021-10-20T23:25:31.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd8c18700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b6580 0x7fdbd41561e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fdbd4060f70 tx=0x7fdbcc0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:31.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd17fa700 1 -- 172.21.15.12:0/3413386737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbcc006aa0 con 0x7fdbd40b6580 2021-10-20T23:25:31.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd17fa700 1 -- 172.21.15.12:0/3413386737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc006c00 con 0x7fdbd40b6580 2021-10-20T23:25:31.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd40ba4c0 con 0x7fdbd40b6580 2021-10-20T23:25:31.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbd17fa700 1 -- 172.21.15.12:0/3413386737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbcc007030 con 0x7fdbd40b6580 2021-10-20T23:25:31.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.574+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd412a240 con 0x7fdbd40b6580 2021-10-20T23:25:31.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.578+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd40b3a80 con 0x7fdbd40b6580 2021-10-20T23:25:31.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.578+0000 7fdbd17fa700 1 -- 172.21.15.12:0/3413386737 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdbcc010030 con 0x7fdbd40b6580 2021-10-20T23:25:31.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.578+0000 7fdbd17fa700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbb8053640 0x7fdbb8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:31.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.578+0000 7fdbd17fa700 1 -- 172.21.15.12:0/3413386737 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fdbcc06b8d0 con 0x7fdbd40b6580 2021-10-20T23:25:31.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.578+0000 7fdbd3fff700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbb8053640 0x7fdbb8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:31.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.578+0000 7fdbd3fff700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbb8053640 0x7fdbb8055b00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fdbbc00c000 tx=0x7fdbbc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:31.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.586+0000 7fdbd17fa700 1 -- 172.21.15.12:0/3413386737 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdbcc0427e0 con 0x7fdbd40b6580 2021-10-20T23:25:31.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:31.714+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbd40615f0 con 0x7fdbd40b6580 2021-10-20T23:25:32.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.426+0000 7fdbd17fa700 1 -- 172.21.15.12:0/3413386737 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 185+0+0 (secure 0 0 0) 0x7fdbcc045e00 con 0x7fdbd40b6580 2021-10-20T23:25:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.434+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbb8053640 msgr2=0x7fdbb8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.434+0000 7fdbda67b700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbb8053640 0x7fdbb8055b00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fdbbc00c000 tx=0x7fdbbc008040).stop 2021-10-20T23:25:32.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.434+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b6580 msgr2=0x7fdbd41561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:32.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.434+0000 7fdbda67b700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b6580 0x7fdbd41561e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fdbd4060f70 tx=0x7fdbcc0013a0).stop 2021-10-20T23:25:32.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.438+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 shutdown_connections 2021-10-20T23:25:32.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.438+0000 7fdbda67b700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbb8053640 0x7fdbb8055b00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.438+0000 7fdbda67b700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbd40b6580 0x7fdbd41561e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.438+0000 7fdbda67b700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40b43c0 0x7fdbd4155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.438+0000 7fdbda67b700 1 --2- 172.21.15.12:0/3413386737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd4061d30 0x7fdbd4129d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.438+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 >> 172.21.15.12:0/3413386737 conn(0x7fdbd405c490 msgr2=0x7fdbd4145570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:32.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.438+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 shutdown_connections 2021-10-20T23:25:32.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.438+0000 7fdbda67b700 1 -- 172.21.15.12:0/3413386737 wait complete. 2021-10-20T23:25:32.445 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:25:32.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:25:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.558+0000 7fd37860d700 1 Processor -- start 2021-10-20T23:25:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.558+0000 7fd37860d700 1 -- start start 2021-10-20T23:25:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 0x7fd3701438d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3700ad030 0x7fd370143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd3700b06e0 0x7fd3700b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700673d0 con 0x7fd3700ad030 2021-10-20T23:25:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700affd0 con 0x7fd3700b06e0 2021-10-20T23:25:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700b0270 con 0x7fd370066ff0 2021-10-20T23:25:32.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd375ba8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3700ad030 0x7fd370143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:32.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd375ba8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3700ad030 0x7fd370143dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40552/0 (socket says 172.21.15.12:40552) 2021-10-20T23:25:32.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd375ba8700 1 -- 172.21.15.12:0/1043324077 learned_addr learned my addr 172.21.15.12:0/1043324077 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:32.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd376baa700 1 --2- 172.21.15.12:0/1043324077 >> v2:172.21.15.31:3300/0 conn(0x7fd3700b06e0 0x7fd3700b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd3763a9700 1 --2- 172.21.15.12:0/1043324077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 0x7fd3701438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd375ba8700 1 -- 172.21.15.12:0/1043324077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 msgr2=0x7fd3701438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd375ba8700 1 --2- 172.21.15.12:0/1043324077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 0x7fd3701438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd375ba8700 1 -- 172.21.15.12:0/1043324077 >> v2:172.21.15.31:3300/0 conn(0x7fd3700b06e0 msgr2=0x7fd3700b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd375ba8700 1 --2- 172.21.15.12:0/1043324077 >> v2:172.21.15.31:3300/0 conn(0x7fd3700b06e0 0x7fd3700b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd375ba8700 1 -- 172.21.15.12:0/1043324077 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700af3a0 con 0x7fd3700ad030 2021-10-20T23:25:32.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd375ba8700 1 --2- 172.21.15.12:0/1043324077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700ad030 0x7fd370143dc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fd36c002f70 tx=0x7fd36c006eb0).ready entity=mon.0 client_cookie=51196b1b7329623c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:32.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd3753a7700 1 -- 172.21.15.12:0/1043324077 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c00d570 con 0x7fd3700ad030 2021-10-20T23:25:32.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd3753a7700 1 -- 172.21.15.12:0/1043324077 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c000e90 con 0x7fd3700ad030 2021-10-20T23:25:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd3753a7700 1 -- 172.21.15.12:0/1043324077 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c00d900 con 0x7fd3700ad030 2021-10-20T23:25:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 -- 172.21.15.12:0/1043324077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700ad030 msgr2=0x7fd370143dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 --2- 172.21.15.12:0/1043324077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700ad030 0x7fd370143dc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fd36c002f70 tx=0x7fd36c006eb0).stop 2021-10-20T23:25:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 -- 172.21.15.12:0/1043324077 shutdown_connections 2021-10-20T23:25:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 --2- 172.21.15.12:0/1043324077 >> v2:172.21.15.31:3300/0 conn(0x7fd3700b06e0 0x7fd3700b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 --2- 172.21.15.12:0/1043324077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700ad030 0x7fd370143dc0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 --2- 172.21.15.12:0/1043324077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 0x7fd3701438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 -- 172.21.15.12:0/1043324077 >> 172.21.15.12:0/1043324077 conn(0x7fd37005f6b0 msgr2=0x7fd37005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 -- 172.21.15.12:0/1043324077 shutdown_connections 2021-10-20T23:25:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.562+0000 7fd37860d700 1 -- 172.21.15.12:0/1043324077 wait complete. 2021-10-20T23:25:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 Processor -- start 2021-10-20T23:25:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 -- start start 2021-10-20T23:25:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 0x7fd370141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3700b06e0 0x7fd37013e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700b4d70 0x7fd37013e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700b4b30 con 0x7fd3700b4d70 2021-10-20T23:25:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd370152850 con 0x7fd3700b06e0 2021-10-20T23:25:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700b6530 con 0x7fd370066ff0 2021-10-20T23:25:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd376baa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700b4d70 0x7fd37013e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd376baa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700b4d70 0x7fd37013e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40562/0 (socket says 172.21.15.12:40562) 2021-10-20T23:25:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd376baa700 1 -- 172.21.15.12:0/3864112142 learned_addr learned my addr 172.21.15.12:0/3864112142 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd375ba8700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3700b06e0 0x7fd37013e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd3763a9700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 0x7fd370141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd376baa700 1 -- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 msgr2=0x7fd370141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd376baa700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 0x7fd370141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd376baa700 1 -- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3700b06e0 msgr2=0x7fd37013e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd376baa700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3700b06e0 0x7fd37013e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd376baa700 1 -- 172.21.15.12:0/3864112142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c00b1e0 con 0x7fd3700b4d70 2021-10-20T23:25:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd375ba8700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3700b06e0 0x7fd37013e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd3763a9700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 0x7fd370141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd376baa700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700b4d70 0x7fd37013e730 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fd3700a07f0 tx=0x7fd368008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd35f7fe700 1 -- 172.21.15.12:0/3864112142 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3680127e0 con 0x7fd3700b4d70 2021-10-20T23:25:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd35f7fe700 1 -- 172.21.15.12:0/3864112142 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd368012940 con 0x7fd3700b4d70 2021-10-20T23:25:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3700b4160 con 0x7fd3700b4d70 2021-10-20T23:25:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd35f7fe700 1 -- 172.21.15.12:0/3864112142 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd368012ca0 con 0x7fd3700b4d70 2021-10-20T23:25:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.566+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3700b5280 con 0x7fd3700b4d70 2021-10-20T23:25:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.570+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd370147800 con 0x7fd3700b4d70 2021-10-20T23:25:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.570+0000 7fd35f7fe700 1 -- 172.21.15.12:0/3864112142 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd368013480 con 0x7fd3700b4d70 2021-10-20T23:25:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.570+0000 7fd35f7fe700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd350053580 0x7fd350055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.570+0000 7fd35f7fe700 1 -- 172.21.15.12:0/3864112142 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fd36806bdd0 con 0x7fd3700b4d70 2021-10-20T23:25:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.570+0000 7fd3763a9700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd350053580 0x7fd350055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.570+0000 7fd3763a9700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd350053580 0x7fd350055a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fd36000c000 tx=0x7fd360008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.578+0000 7fd35f7fe700 1 -- 172.21.15.12:0/3864112142 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd368042ee0 con 0x7fd3700b4d70 2021-10-20T23:25:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:32.706+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd3700b5410 con 0x7fd3700b4d70 2021-10-20T23:25:33.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.434+0000 7fd35f7fe700 1 -- 172.21.15.12:0/3864112142 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd368012e00 con 0x7fd3700b4d70 2021-10-20T23:25:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd350053580 msgr2=0x7fd350055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd350053580 0x7fd350055a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fd36000c000 tx=0x7fd360008040).stop 2021-10-20T23:25:33.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700b4d70 msgr2=0x7fd37013e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700b4d70 0x7fd37013e730 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fd3700a07f0 tx=0x7fd368008040).stop 2021-10-20T23:25:33.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 shutdown_connections 2021-10-20T23:25:33.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd350053580 0x7fd350055a40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3700b4d70 0x7fd37013e730 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3700b06e0 0x7fd37013e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 --2- 172.21.15.12:0/3864112142 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd370066ff0 0x7fd370141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 >> 172.21.15.12:0/3864112142 conn(0x7fd37005f6b0 msgr2=0x7fd3701438d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 shutdown_connections 2021-10-20T23:25:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.446+0000 7fd37860d700 1 -- 172.21.15.12:0/3864112142 wait complete. 2021-10-20T23:25:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:25:33.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:25:33.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c359e700 1 Processor -- start 2021-10-20T23:25:33.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c359e700 1 -- start start 2021-10-20T23:25:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02c40b21b0 0x7f02c405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c40b3c40 con 0x7f02c4060d20 2021-10-20T23:25:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c40b2590 con 0x7f02c4143c90 2021-10-20T23:25:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c4063df0 con 0x7f02c40b21b0 2021-10-20T23:25:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c1d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f02c4060d20 0x7f02c40b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39162/0 (socket says 172.21.15.12:39162) 2021-10-20T23:25:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c1d9b700 1 -- 172.21.15.12:0/4054266092 learned_addr learned my addr 172.21.15.12:0/4054266092 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c259c700 1 --2- 172.21.15.12:0/4054266092 >> v2:172.21.15.31:3300/0 conn(0x7f02c40b21b0 0x7f02c405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c159a700 1 -- 172.21.15.12:0/4054266092 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117193398 0 0) 0x7f02c40b3c40 con 0x7f02c4060d20 2021-10-20T23:25:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c159a700 1 -- 172.21.15.12:0/4054266092 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a8003260 con 0x7f02c4060d20 2021-10-20T23:25:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c259c700 1 -- 172.21.15.12:0/4054266092 >> v1:172.21.15.31:6789/0 conn(0x7f02c4143c90 legacy=0x7f02c412c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c259c700 1 -- 172.21.15.12:0/4054266092 >> v1:172.21.15.12:6789/0 conn(0x7f02c4060d20 legacy=0x7f02c40b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.562+0000 7f02c259c700 1 -- 172.21.15.12:0/4054266092 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40b2e30 con 0x7f02c40b21b0 2021-10-20T23:25:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c259c700 1 --2- 172.21.15.12:0/4054266092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c40b21b0 0x7f02c405f6b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f02b4002f70 tx=0x7f02b4006df0).ready entity=mon.1 client_cookie=9f7188c6afd1cd9e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c159a700 1 -- 172.21.15.12:0/4054266092 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b400d610 con 0x7f02c40b21b0 2021-10-20T23:25:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c159a700 1 -- 172.21.15.12:0/4054266092 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4000e90 con 0x7f02c40b21b0 2021-10-20T23:25:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c159a700 1 -- 172.21.15.12:0/4054266092 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b400d960 con 0x7f02c40b21b0 2021-10-20T23:25:33.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c359e700 1 -- 172.21.15.12:0/4054266092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c40b21b0 msgr2=0x7f02c405f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c359e700 1 --2- 172.21.15.12:0/4054266092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c40b21b0 0x7f02c405f6b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f02b4002f70 tx=0x7f02b4006df0).stop 2021-10-20T23:25:33.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c359e700 1 -- 172.21.15.12:0/4054266092 shutdown_connections 2021-10-20T23:25:33.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c359e700 1 --2- 172.21.15.12:0/4054266092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c40b21b0 0x7f02c405f6b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c359e700 1 -- 172.21.15.12:0/4054266092 >> 172.21.15.12:0/4054266092 conn(0x7f02c405c490 msgr2=0x7f02c405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:33.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c359e700 1 -- 172.21.15.12:0/4054266092 shutdown_connections 2021-10-20T23:25:33.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c359e700 1 -- 172.21.15.12:0/4054266092 wait complete. 2021-10-20T23:25:33.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c359e700 1 Processor -- start 2021-10-20T23:25:33.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.566+0000 7f02c359e700 1 -- start start 2021-10-20T23:25:33.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c4060d20 0x7f02c40ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02c40b21b0 0x7f02c4140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02c4143c90 0x7f02c4064350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40b0ae0 con 0x7f02c4143c90 2021-10-20T23:25:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4146b10 con 0x7f02c4060d20 2021-10-20T23:25:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40669c0 con 0x7f02c40b21b0 2021-10-20T23:25:33.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02c4143c90 0x7f02c4064350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02c4143c90 0x7f02c4064350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40574/0 (socket says 172.21.15.12:40574) 2021-10-20T23:25:33.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c2d9d700 1 -- 172.21.15.12:0/939744328 learned_addr learned my addr 172.21.15.12:0/939744328 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:33.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c259c700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c4060d20 0x7f02c40ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c1d9b700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02c40b21b0 0x7f02c4140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c2d9d700 1 -- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02c40b21b0 msgr2=0x7f02c4140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c2d9d700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02c40b21b0 0x7f02c4140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c2d9d700 1 -- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c4060d20 msgr2=0x7f02c40ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c2d9d700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c4060d20 0x7f02c40ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c2d9d700 1 -- 172.21.15.12:0/939744328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b400b180 con 0x7f02c4143c90 2021-10-20T23:25:33.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c259c700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c4060d20 0x7f02c40ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:25:33.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c1d9b700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02c40b21b0 0x7f02c4140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:25:33.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c2d9d700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02c4143c90 0x7f02c4064350 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f02c40668e0 tx=0x7f02bc007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02b37fe700 1 -- 172.21.15.12:0/939744328 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02bc00ce20 con 0x7f02c4143c90 2021-10-20T23:25:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02b37fe700 1 -- 172.21.15.12:0/939744328 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc007240 con 0x7f02c4143c90 2021-10-20T23:25:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c4144c20 con 0x7f02c4143c90 2021-10-20T23:25:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02b37fe700 1 -- 172.21.15.12:0/939744328 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02bc006510 con 0x7f02c4143c90 2021-10-20T23:25:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c40659f0 con 0x7f02c4143c90 2021-10-20T23:25:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02b37fe700 1 -- 172.21.15.12:0/939744328 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f02bc010030 con 0x7f02c4143c90 2021-10-20T23:25:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c41474c0 con 0x7f02c4143c90 2021-10-20T23:25:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.570+0000 7f02b37fe700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f02a00535b0 0x7f02a0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.574+0000 7f02b37fe700 1 -- 172.21.15.12:0/939744328 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f02bc06b510 con 0x7f02c4143c90 2021-10-20T23:25:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.574+0000 7f02c259c700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f02a00535b0 0x7f02a0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.574+0000 7f02c259c700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f02a00535b0 0x7f02a0055a70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f02b4015000 tx=0x7f02b4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.574+0000 7f02b37fe700 1 -- 172.21.15.12:0/939744328 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f02bc042680 con 0x7f02c4143c90 2021-10-20T23:25:33.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.706+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f02c4061bd0 con 0x7f02c4143c90 2021-10-20T23:25:33.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.714+0000 7f02b37fe700 1 -- 172.21.15.12:0/939744328 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f02bc045ca0 con 0x7f02c4143c90 2021-10-20T23:25:33.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f02a00535b0 msgr2=0x7f02a0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f02a00535b0 0x7f02a0055a70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f02b4015000 tx=0x7f02b4014000).stop 2021-10-20T23:25:33.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02c4143c90 msgr2=0x7f02c4064350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02c4143c90 0x7f02c4064350 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f02c40668e0 tx=0x7f02bc007c20).stop 2021-10-20T23:25:33.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 shutdown_connections 2021-10-20T23:25:33.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f02a00535b0 0x7f02a0055a70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02c4143c90 0x7f02c4064350 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02c40b21b0 0x7f02c4140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 --2- 172.21.15.12:0/939744328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02c4060d20 0x7f02c40ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 >> 172.21.15.12:0/939744328 conn(0x7f02c405c490 msgr2=0x7f02c412b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:33.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 shutdown_connections 2021-10-20T23:25:33.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.718+0000 7f02c359e700 1 -- 172.21.15.12:0/939744328 wait complete. 2021-10-20T23:25:33.737 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-10-20T23:25:33.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.834+0000 7f02853fd700 1 Processor -- start 2021-10-20T23:25:33.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.834+0000 7f02853fd700 1 -- start start 2021-10-20T23:25:33.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02800b43c0 0x7f02800b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6960 0x7f028012ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02801440b0 con 0x7f02800b6580 2021-10-20T23:25:33.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0280143b70 con 0x7f02800b43c0 2021-10-20T23:25:33.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0280143e10 con 0x7f02800b6960 2021-10-20T23:25:33.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02800b43c0 0x7f02800b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6960 0x7f028012ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f02800b6580 0x7f0280061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:46238/0 (socket says 172.21.15.12:46238) 2021-10-20T23:25:33.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02800b43c0 0x7f02800b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:55558/0 (socket says 172.21.15.12:55558) 2021-10-20T23:25:33.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027effd700 1 -- 172.21.15.12:0/482518923 learned_addr learned my addr 172.21.15.12:0/482518923 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:33.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027f7fe700 1 -- 172.21.15.12:0/482518923 >> v2:172.21.15.31:3300/0 conn(0x7f02800b43c0 msgr2=0x7f02800b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:33.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027f7fe700 1 --2- 172.21.15.12:0/482518923 >> v2:172.21.15.31:3300/0 conn(0x7f02800b43c0 0x7f02800b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027f7fe700 1 -- 172.21.15.12:0/482518923 >> v1:172.21.15.31:6789/0 conn(0x7f02800b6580 legacy=0x7f0280061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027f7fe700 1 -- 172.21.15.12:0/482518923 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02800615f0 con 0x7f02800b6960 2021-10-20T23:25:33.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027e7fc700 1 --2- 172.21.15.12:0/482518923 >> v2:172.21.15.31:3300/0 conn(0x7f02800b43c0 0x7f02800b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:33.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027f7fe700 1 --2- 172.21.15.12:0/482518923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6960 0x7f028012ba00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f0280143120 tx=0x7f02780091d0).ready entity=mon.2 client_cookie=4f56901dbac61901 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:33.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027dffb700 1 -- 172.21.15.12:0/482518923 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f027800b680 con 0x7f02800b6960 2021-10-20T23:25:33.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027dffb700 1 -- 172.21.15.12:0/482518923 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027800b7e0 con 0x7f02800b6960 2021-10-20T23:25:33.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f027dffb700 1 -- 172.21.15.12:0/482518923 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f027800b950 con 0x7f02800b6960 2021-10-20T23:25:33.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 -- 172.21.15.12:0/482518923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6960 msgr2=0x7f028012ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 --2- 172.21.15.12:0/482518923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6960 0x7f028012ba00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f0280143120 tx=0x7f02780091d0).stop 2021-10-20T23:25:33.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 -- 172.21.15.12:0/482518923 shutdown_connections 2021-10-20T23:25:33.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 --2- 172.21.15.12:0/482518923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6960 0x7f028012ba00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 --2- 172.21.15.12:0/482518923 >> v2:172.21.15.31:3300/0 conn(0x7f02800b43c0 0x7f02800b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 -- 172.21.15.12:0/482518923 >> 172.21.15.12:0/482518923 conn(0x7f028005c490 msgr2=0x7f028005c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:33.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 -- 172.21.15.12:0/482518923 shutdown_connections 2021-10-20T23:25:33.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.838+0000 7f02853fd700 1 -- 172.21.15.12:0/482518923 wait complete. 2021-10-20T23:25:33.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f02853fd700 1 Processor -- start 2021-10-20T23:25:33.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f02853fd700 1 -- start start 2021-10-20T23:25:33.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f02853fd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02800b43c0 0x7f0280129ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f02853fd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6580 0x7f0280152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f02853fd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02800b6960 0x7f0280146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f02853fd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028012a1b0 con 0x7f02800b6960 2021-10-20T23:25:33.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f02853fd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801484d0 con 0x7f02800b43c0 2021-10-20T23:25:33.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f02853fd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0280152540 con 0x7f02800b6580 2021-10-20T23:25:33.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02800b6960 0x7f0280146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02800b6960 0x7f0280146a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40590/0 (socket says 172.21.15.12:40590) 2021-10-20T23:25:33.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027f7fe700 1 -- 172.21.15.12:0/1459926201 learned_addr learned my addr 172.21.15.12:0/1459926201 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:33.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027effd700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02800b43c0 0x7f0280129ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027e7fc700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6580 0x7f0280152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027f7fe700 1 -- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6580 msgr2=0x7f0280152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027f7fe700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6580 0x7f0280152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027f7fe700 1 -- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02800b43c0 msgr2=0x7f0280129ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:33.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027f7fe700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02800b43c0 0x7f0280129ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:33.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027f7fe700 1 -- 172.21.15.12:0/1459926201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027400b180 con 0x7f02800b6960 2021-10-20T23:25:33.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.842+0000 7f027f7fe700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02800b6960 0x7f0280146a10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f0280143120 tx=0x7f0278016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:33.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f026ffff700 1 -- 172.21.15.12:0/1459926201 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0278021630 con 0x7f02800b6960 2021-10-20T23:25:33.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f026ffff700 1 -- 172.21.15.12:0/1459926201 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0278021790 con 0x7f02800b6960 2021-10-20T23:25:33.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f026ffff700 1 -- 172.21.15.12:0/1459926201 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0278021af0 con 0x7f02800b6960 2021-10-20T23:25:33.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0278009470 con 0x7f02800b6960 2021-10-20T23:25:33.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028012bf00 con 0x7f02800b6960 2021-10-20T23:25:33.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0280152c50 con 0x7f02800b6960 2021-10-20T23:25:33.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f026ffff700 1 -- 172.21.15.12:0/1459926201 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0278027020 con 0x7f02800b6960 2021-10-20T23:25:33.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f026ffff700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f025c0536a0 0x7f025c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:33.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f026ffff700 1 -- 172.21.15.12:0/1459926201 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f027806cef0 con 0x7f02800b6960 2021-10-20T23:25:33.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.846+0000 7f027effd700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f025c0536a0 0x7f025c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:33.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.850+0000 7f027effd700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f025c0536a0 0x7f025c055b60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f027000d000 tx=0x7f0270009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:33.854+0000 7f026ffff700 1 -- 172.21.15.12:0/1459926201 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f02780441d0 con 0x7f02800b6960 2021-10-20T23:25:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.026+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f02801470a0 con 0x7f02800b6960 2021-10-20T23:25:34.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.438+0000 7f026ffff700 1 -- 172.21.15.12:0/1459926201 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v245) v1 ==== 147+0+0 (secure 0 0 0) 0x7f0278015020 con 0x7f02800b6960 2021-10-20T23:25:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f025c0536a0 msgr2=0x7f025c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f025c0536a0 0x7f025c055b60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f027000d000 tx=0x7f0270009040).stop 2021-10-20T23:25:34.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02800b6960 msgr2=0x7f0280146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:34.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02800b6960 0x7f0280146a10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f0280143120 tx=0x7f0278016000).stop 2021-10-20T23:25:34.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 shutdown_connections 2021-10-20T23:25:34.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f025c0536a0 0x7f025c055b60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:34.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02800b6960 0x7f0280146a10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02800b6580 0x7f0280152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 --2- 172.21.15.12:0/1459926201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02800b43c0 0x7f0280129ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 >> 172.21.15.12:0/1459926201 conn(0x7f028005c490 msgr2=0x7f0280141d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 shutdown_connections 2021-10-20T23:25:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.442+0000 7f02853fd700 1 -- 172.21.15.12:0/1459926201 wait complete. 2021-10-20T23:25:34.462 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-10-20T23:25:34.463 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-10-20T23:25:34.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-10-20T23:25:34.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.562+0000 7f1575c70700 1 Processor -- start 2021-10-20T23:25:34.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.562+0000 7f1575c70700 1 -- start start 2021-10-20T23:25:34.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f15700b2580 0x7f157014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:34.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15700a8ac0 0x7f157014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:34.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15700a70c0 con 0x7f15700b0010 2021-10-20T23:25:34.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15700a72f0 con 0x7f15700a8ac0 2021-10-20T23:25:34.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15700a7590 con 0x7f15700b2580 2021-10-20T23:25:34.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f157546f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15700a8ac0 0x7f157014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:34.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f157546f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15700a8ac0 0x7f157014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40598/0 (socket says 172.21.15.12:40598) 2021-10-20T23:25:34.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f157546f700 1 -- 172.21.15.12:0/2600096086 learned_addr learned my addr 172.21.15.12:0/2600096086 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:34.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1574c6e700 1 --2- 172.21.15.12:0/2600096086 >> v2:172.21.15.31:3300/0 conn(0x7f15700b2580 0x7f157014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f156f7fe700 1 -- 172.21.15.12:0/2600096086 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219239203 0 0) 0x7f15700a70c0 con 0x7f15700b0010 2021-10-20T23:25:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f157546f700 1 -- 172.21.15.12:0/2600096086 >> v2:172.21.15.31:3300/0 conn(0x7f15700b2580 msgr2=0x7f157014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f157546f700 1 --2- 172.21.15.12:0/2600096086 >> v2:172.21.15.31:3300/0 conn(0x7f15700b2580 0x7f157014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f157546f700 1 -- 172.21.15.12:0/2600096086 >> v1:172.21.15.31:6789/0 conn(0x7f15700b0010 legacy=0x7f15700a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f157546f700 1 -- 172.21.15.12:0/2600096086 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700a7830 con 0x7f15700a8ac0 2021-10-20T23:25:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f157546f700 1 --2- 172.21.15.12:0/2600096086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700a8ac0 0x7f157014b330 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f1560002f70 tx=0x7f1560006eb0).ready entity=mon.0 client_cookie=2f44fd53f793ea11 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f156f7fe700 1 -- 172.21.15.12:0/2600096086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f156000d5c0 con 0x7f15700a8ac0 2021-10-20T23:25:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f156f7fe700 1 -- 172.21.15.12:0/2600096086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1560000e90 con 0x7f15700a8ac0 2021-10-20T23:25:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f156f7fe700 1 -- 172.21.15.12:0/2600096086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f156000d910 con 0x7f15700a8ac0 2021-10-20T23:25:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 -- 172.21.15.12:0/2600096086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700a8ac0 msgr2=0x7f157014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 --2- 172.21.15.12:0/2600096086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700a8ac0 0x7f157014b330 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f1560002f70 tx=0x7f1560006eb0).stop 2021-10-20T23:25:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 -- 172.21.15.12:0/2600096086 shutdown_connections 2021-10-20T23:25:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 --2- 172.21.15.12:0/2600096086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700a8ac0 0x7f157014b330 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 --2- 172.21.15.12:0/2600096086 >> v2:172.21.15.31:3300/0 conn(0x7f15700b2580 0x7f157014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 -- 172.21.15.12:0/2600096086 >> 172.21.15.12:0/2600096086 conn(0x7f1570060180 msgr2=0x7f15700b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 -- 172.21.15.12:0/2600096086 shutdown_connections 2021-10-20T23:25:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.566+0000 7f1575c70700 1 -- 172.21.15.12:0/2600096086 wait complete. 2021-10-20T23:25:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 Processor -- start 2021-10-20T23:25:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 -- start start 2021-10-20T23:25:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15700a8ac0 0x7f15700a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15700b0010 0x7f1570156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700b2580 0x7f15700aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15700b57f0 con 0x7f15700b2580 2021-10-20T23:25:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1570157210 con 0x7f15700a8ac0 2021-10-20T23:25:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15700b5a50 con 0x7f15700b0010 2021-10-20T23:25:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f157546f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700b2580 0x7f15700aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f157546f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700b2580 0x7f15700aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40604/0 (socket says 172.21.15.12:40604) 2021-10-20T23:25:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f157546f700 1 -- 172.21.15.12:0/2671516048 learned_addr learned my addr 172.21.15.12:0/2671516048 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1574c6e700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15700a8ac0 0x7f15700a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f156ffff700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15700b0010 0x7f1570156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f157546f700 1 -- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15700b0010 msgr2=0x7f1570156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:34.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f157546f700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15700b0010 0x7f1570156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:34.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f157546f700 1 -- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15700a8ac0 msgr2=0x7f15700a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:34.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f157546f700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15700a8ac0 0x7f15700a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:34.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f157546f700 1 -- 172.21.15.12:0/2671516048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156000b1e0 con 0x7f15700b2580 2021-10-20T23:25:34.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f157546f700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700b2580 0x7f15700aa780 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f1560002f70 tx=0x7f1560015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f156dffb700 1 -- 172.21.15.12:0/2671516048 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f156000de20 con 0x7f15700b2580 2021-10-20T23:25:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f156dffb700 1 -- 172.21.15.12:0/2671516048 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1560011b80 con 0x7f15700b2580 2021-10-20T23:25:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1570063ac0 con 0x7f15700b2580 2021-10-20T23:25:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f156dffb700 1 -- 172.21.15.12:0/2671516048 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f156001e460 con 0x7f15700b2580 2021-10-20T23:25:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.570+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1570064000 con 0x7f15700b2580 2021-10-20T23:25:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.574+0000 7f156dffb700 1 -- 172.21.15.12:0/2671516048 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f156001a040 con 0x7f15700b2580 2021-10-20T23:25:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.574+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1570057350 con 0x7f15700b2580 2021-10-20T23:25:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.574+0000 7f156dffb700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f15500536d0 0x7f1550055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.574+0000 7f156dffb700 1 -- 172.21.15.12:0/2671516048 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f156006c560 con 0x7f15700b2580 2021-10-20T23:25:34.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.574+0000 7f1574c6e700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f15500536d0 0x7f1550055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:34.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.574+0000 7f1574c6e700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f15500536d0 0x7f1550055b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f156400b000 tx=0x7f1564006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:34.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.578+0000 7f156dffb700 1 -- 172.21.15.12:0/2671516048 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1560043820 con 0x7f15700b2580 2021-10-20T23:25:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:34.746+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f15700641c0 con 0x7f15700b2580 2021-10-20T23:25:35.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.442+0000 7f156dffb700 1 -- 172.21.15.12:0/2671516048 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v246) v1 ==== 142+0+0 (secure 0 0 0) 0x7f15600230d0 con 0x7f15700b2580 2021-10-20T23:25:35.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f15500536d0 msgr2=0x7f1550055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f15500536d0 0x7f1550055b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f156400b000 tx=0x7f1564006df0).stop 2021-10-20T23:25:35.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700b2580 msgr2=0x7f15700aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700b2580 0x7f15700aa780 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f1560002f70 tx=0x7f1560015000).stop 2021-10-20T23:25:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 shutdown_connections 2021-10-20T23:25:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f15500536d0 0x7f1550055b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15700b2580 0x7f15700aa780 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15700b0010 0x7f1570156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 --2- 172.21.15.12:0/2671516048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15700a8ac0 0x7f15700a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 >> 172.21.15.12:0/2671516048 conn(0x7f1570060180 msgr2=0x7f157014afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 shutdown_connections 2021-10-20T23:25:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.446+0000 7f1575c70700 1 -- 172.21.15.12:0/2671516048 wait complete. 2021-10-20T23:25:35.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:25:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26dcca3700 1 Processor -- start 2021-10-20T23:25:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26dcca3700 1 -- start start 2021-10-20T23:25:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26dcca3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f26d8061680 0x7f26d80b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26dcca3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d80b4710 0x7f26d80ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26dcca3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26d81439a0 0x7f26d813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26dcca3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d80b9680 con 0x7f26d81439a0 2021-10-20T23:25:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26dcca3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d80b6910 con 0x7f26d8061680 2021-10-20T23:25:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26dcca3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80b6bb0 con 0x7f26d80b4710 2021-10-20T23:25:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26d81439a0 0x7f26d813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26d81439a0 0x7f26d813fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40614/0 (socket says 172.21.15.12:40614) 2021-10-20T23:25:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d7fff700 1 -- 172.21.15.12:0/510785413 learned_addr learned my addr 172.21.15.12:0/510785413 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d77fe700 1 --2- 172.21.15.12:0/510785413 >> v2:172.21.15.31:3300/0 conn(0x7f26d8061680 0x7f26d80b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d6ffd700 1 --2- 172.21.15.12:0/510785413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d80b4710 0x7f26d80ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d7fff700 1 -- 172.21.15.12:0/510785413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d80b4710 msgr2=0x7f26d80ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d7fff700 1 --2- 172.21.15.12:0/510785413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d80b4710 0x7f26d80ba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d7fff700 1 -- 172.21.15.12:0/510785413 >> v2:172.21.15.31:3300/0 conn(0x7f26d8061680 msgr2=0x7f26d80b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d7fff700 1 --2- 172.21.15.12:0/510785413 >> v2:172.21.15.31:3300/0 conn(0x7f26d8061680 0x7f26d80b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d7fff700 1 -- 172.21.15.12:0/510785413 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d80b6e50 con 0x7f26d81439a0 2021-10-20T23:25:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d7fff700 1 --2- 172.21.15.12:0/510785413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 0x7f26d813fda0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f26d00032f0 tx=0x7f26d0009290).ready entity=mon.0 client_cookie=25ae812db08c499a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d67fc700 1 -- 172.21.15.12:0/510785413 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d000b870 con 0x7f26d81439a0 2021-10-20T23:25:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d67fc700 1 -- 172.21.15.12:0/510785413 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d000b9d0 con 0x7f26d81439a0 2021-10-20T23:25:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.578+0000 7f26d67fc700 1 -- 172.21.15.12:0/510785413 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d000bb40 con 0x7f26d81439a0 2021-10-20T23:25:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 -- 172.21.15.12:0/510785413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 msgr2=0x7f26d813fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 --2- 172.21.15.12:0/510785413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 0x7f26d813fda0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f26d00032f0 tx=0x7f26d0009290).stop 2021-10-20T23:25:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 -- 172.21.15.12:0/510785413 shutdown_connections 2021-10-20T23:25:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 --2- 172.21.15.12:0/510785413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 0x7f26d813fda0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 --2- 172.21.15.12:0/510785413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d80b4710 0x7f26d80ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 --2- 172.21.15.12:0/510785413 >> v2:172.21.15.31:3300/0 conn(0x7f26d8061680 0x7f26d80b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 -- 172.21.15.12:0/510785413 >> 172.21.15.12:0/510785413 conn(0x7f26d806adf0 msgr2=0x7f26d805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 -- 172.21.15.12:0/510785413 shutdown_connections 2021-10-20T23:25:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 -- 172.21.15.12:0/510785413 wait complete. 2021-10-20T23:25:35.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 Processor -- start 2021-10-20T23:25:35.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 -- start start 2021-10-20T23:25:35.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d8061680 0x7f26d8153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 0x7f26d8152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26d814f710 0x7f26d814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80b36e0 con 0x7f26d81439a0 2021-10-20T23:25:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d8152350 con 0x7f26d814f710 2021-10-20T23:25:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26dcca3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d8150090 con 0x7f26d8061680 2021-10-20T23:25:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26d6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 0x7f26d8152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26d6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 0x7f26d8152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40618/0 (socket says 172.21.15.12:40618) 2021-10-20T23:25:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26d6ffd700 1 -- 172.21.15.12:0/2734070663 learned_addr learned my addr 172.21.15.12:0/2734070663 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26d77fe700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d8061680 0x7f26d8153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.582+0000 7f26d7fff700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26d814f710 0x7f26d814fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d6ffd700 1 -- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d8061680 msgr2=0x7f26d8153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d6ffd700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d8061680 0x7f26d8153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d6ffd700 1 -- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26d814f710 msgr2=0x7f26d814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d6ffd700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26d814f710 0x7f26d814fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d6ffd700 1 -- 172.21.15.12:0/2734070663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d0009530 con 0x7f26d81439a0 2021-10-20T23:25:35.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d7fff700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26d814f710 0x7f26d814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:35.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d6ffd700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 0x7f26d8152c80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f26d81145e0 tx=0x7f26c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:35.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d4ff9700 1 -- 172.21.15.12:0/2734070663 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c8011780 con 0x7f26d81439a0 2021-10-20T23:25:35.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d8153d10 con 0x7f26d81439a0 2021-10-20T23:25:35.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d4ff9700 1 -- 172.21.15.12:0/2734070663 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c80118e0 con 0x7f26d81439a0 2021-10-20T23:25:35.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d4ff9700 1 -- 172.21.15.12:0/2734070663 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c8011c40 con 0x7f26d81439a0 2021-10-20T23:25:35.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d8152540 con 0x7f26d81439a0 2021-10-20T23:25:35.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d8152980 con 0x7f26d81439a0 2021-10-20T23:25:35.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d4ff9700 1 -- 172.21.15.12:0/2734070663 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f26c8012420 con 0x7f26d81439a0 2021-10-20T23:25:35.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d4ff9700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26bc053610 0x7f26bc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.586+0000 7f26d4ff9700 1 -- 172.21.15.12:0/2734070663 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f26c806b4f0 con 0x7f26d81439a0 2021-10-20T23:25:35.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.590+0000 7f26d77fe700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26bc053610 0x7f26bc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.590+0000 7f26d77fe700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26bc053610 0x7f26bc055ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f26c000c000 tx=0x7f26c0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:35.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.598+0000 7f26d4ff9700 1 -- 172.21.15.12:0/2734070663 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f26c80426d0 con 0x7f26d81439a0 2021-10-20T23:25:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.722+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f26d8153d10 con 0x7f26d81439a0 2021-10-20T23:25:35.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26d4ff9700 1 -- 172.21.15.12:0/2734070663 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f26d8153d10 con 0x7f26d81439a0 2021-10-20T23:25:35.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26bc053610 msgr2=0x7f26bc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26bc053610 0x7f26bc055ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f26c000c000 tx=0x7f26c0008040).stop 2021-10-20T23:25:35.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 msgr2=0x7f26d8152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 0x7f26d8152c80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f26d81145e0 tx=0x7f26c8008040).stop 2021-10-20T23:25:35.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 shutdown_connections 2021-10-20T23:25:35.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26bc053610 0x7f26bc055ad0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26d814f710 0x7f26d814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26d81439a0 0x7f26d8152c80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 --2- 172.21.15.12:0/2734070663 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26d8061680 0x7f26d8153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 >> 172.21.15.12:0/2734070663 conn(0x7f26d806adf0 msgr2=0x7f26d80b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:35.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.730+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 shutdown_connections 2021-10-20T23:25:35.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.734+0000 7f26dcca3700 1 -- 172.21.15.12:0/2734070663 wait complete. 2021-10-20T23:25:35.751 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:25:35.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:25:35.768 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:25:35.794 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:25:35.816 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:25:35.837 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:25:35.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:35.838 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:35.839 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:35.846 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:25:35.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:25:35.848 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:25:35.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:35.849 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:35.850 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:25:35.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:25:35.859 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:25:35.860 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:25:35.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:25:35.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.966+0000 7fae53fff700 1 Processor -- start 2021-10-20T23:25:35.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae53fff700 1 -- start start 2021-10-20T23:25:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae53fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 0x7fae540b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae53fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae540601a0 0x7fae54144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae53fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae540aa4a0 con 0x7fae54144940 2021-10-20T23:25:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae53fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae540b1450 con 0x7fae540601a0 2021-10-20T23:25:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae53fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae540af7a0 con 0x7fae540af3c0 2021-10-20T23:25:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae537fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae54144940 0x7fae540a8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39222/0 (socket says 172.21.15.12:39222) 2021-10-20T23:25:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae537fe700 1 -- 172.21.15.12:0/133675642 learned_addr learned my addr 172.21.15.12:0/133675642 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae4bfff700 1 --2- 172.21.15.12:0/133675642 >> v2:172.21.15.31:3300/0 conn(0x7fae540601a0 0x7fae54144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae52ffd700 1 --2- 172.21.15.12:0/133675642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 0x7fae540b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae527fc700 1 -- 172.21.15.12:0/133675642 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513322693 0 0) 0x7fae540aa4a0 con 0x7fae54144940 2021-10-20T23:25:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae527fc700 1 -- 172.21.15.12:0/133675642 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae34003260 con 0x7fae54144940 2021-10-20T23:25:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae4bfff700 1 -- 172.21.15.12:0/133675642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 msgr2=0x7fae540b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae4bfff700 1 --2- 172.21.15.12:0/133675642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 0x7fae540b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae4bfff700 1 -- 172.21.15.12:0/133675642 >> v1:172.21.15.12:6789/0 conn(0x7fae54144940 legacy=0x7fae540a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae4bfff700 1 -- 172.21.15.12:0/133675642 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5405fb80 con 0x7fae540601a0 2021-10-20T23:25:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae52ffd700 1 --2- 172.21.15.12:0/133675642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 0x7fae540b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae4bfff700 1 --2- 172.21.15.12:0/133675642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae540601a0 0x7fae54144450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fae3c002f70 tx=0x7fae3c006df0).ready entity=mon.1 client_cookie=ebfb35d8c32f1e46 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae527fc700 1 -- 172.21.15.12:0/133675642 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c00d4a0 con 0x7fae540601a0 2021-10-20T23:25:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae527fc700 1 -- 172.21.15.12:0/133675642 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c000e90 con 0x7fae540601a0 2021-10-20T23:25:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.970+0000 7fae527fc700 1 -- 172.21.15.12:0/133675642 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c00d7f0 con 0x7fae540601a0 2021-10-20T23:25:35.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 -- 172.21.15.12:0/133675642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae540601a0 msgr2=0x7fae54144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 --2- 172.21.15.12:0/133675642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae540601a0 0x7fae54144450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fae3c002f70 tx=0x7fae3c006df0).stop 2021-10-20T23:25:35.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 -- 172.21.15.12:0/133675642 shutdown_connections 2021-10-20T23:25:35.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 --2- 172.21.15.12:0/133675642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae540601a0 0x7fae54144450 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 --2- 172.21.15.12:0/133675642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 0x7fae540b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 -- 172.21.15.12:0/133675642 >> 172.21.15.12:0/133675642 conn(0x7fae54061140 msgr2=0x7fae54062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:35.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 -- 172.21.15.12:0/133675642 shutdown_connections 2021-10-20T23:25:35.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 -- 172.21.15.12:0/133675642 wait complete. 2021-10-20T23:25:35.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 Processor -- start 2021-10-20T23:25:35.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.974+0000 7fae53fff700 1 -- start start 2021-10-20T23:25:35.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae53fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540601a0 0x7fae541411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae53fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 0x7fae54152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae53fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae54144940 0x7fae54155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae53fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae54141d30 con 0x7fae540601a0 2021-10-20T23:25:35.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae53fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5409ec30 con 0x7fae54144940 2021-10-20T23:25:35.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae53fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5409eed0 con 0x7fae540af3c0 2021-10-20T23:25:35.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae52ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540601a0 0x7fae541411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae52ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540601a0 0x7fae541411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40630/0 (socket says 172.21.15.12:40630) 2021-10-20T23:25:35.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae52ffd700 1 -- 172.21.15.12:0/2071384154 learned_addr learned my addr 172.21.15.12:0/2071384154 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:35.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae4bfff700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 0x7fae54152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae537fe700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae54144940 0x7fae54155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae52ffd700 1 -- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 msgr2=0x7fae54152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae52ffd700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 0x7fae54152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae52ffd700 1 -- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae54144940 msgr2=0x7fae54155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:35.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae52ffd700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae54144940 0x7fae54155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:35.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae52ffd700 1 -- 172.21.15.12:0/2071384154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4400b180 con 0x7fae540601a0 2021-10-20T23:25:35.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae537fe700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae54144940 0x7fae54155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:25:35.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae52ffd700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540601a0 0x7fae541411f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fae4400c000 tx=0x7fae44006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:35.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae50ff9700 1 -- 172.21.15.12:0/2071384154 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae4400ca40 con 0x7fae540601a0 2021-10-20T23:25:35.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c00b180 con 0x7fae540601a0 2021-10-20T23:25:35.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae50ff9700 1 -- 172.21.15.12:0/2071384154 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4400cba0 con 0x7fae540601a0 2021-10-20T23:25:35.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae50ff9700 1 -- 172.21.15.12:0/2071384154 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae440123f0 con 0x7fae540601a0 2021-10-20T23:25:35.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5405f6b0 con 0x7fae540601a0 2021-10-20T23:25:35.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5405f8e0 con 0x7fae540601a0 2021-10-20T23:25:35.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.978+0000 7fae50ff9700 1 -- 172.21.15.12:0/2071384154 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fae44012550 con 0x7fae540601a0 2021-10-20T23:25:35.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.982+0000 7fae50ff9700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae380536a0 0x7fae38055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:35.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.982+0000 7fae50ff9700 1 -- 172.21.15.12:0/2071384154 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fae4406bf50 con 0x7fae540601a0 2021-10-20T23:25:35.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.982+0000 7fae4bfff700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae380536a0 0x7fae38055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:35.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.982+0000 7fae4bfff700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae380536a0 0x7fae38055b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fae3c018000 tx=0x7fae3c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:36.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:35.986+0000 7fae50ff9700 1 -- 172.21.15.12:0/2071384154 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae44043130 con 0x7fae540601a0 2021-10-20T23:25:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.114+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fae54057350 con 0x7fae540601a0 2021-10-20T23:25:36.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae50ff9700 1 -- 172.21.15.12:0/2071384154 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v71) v1 ==== 81+0+29218 (secure 0 0 0) 0x7fae44046750 con 0x7fae540601a0 2021-10-20T23:25:36.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:36.124 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:25:36.124 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 71, 2021-10-20T23:25:36.125 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:25:36.125 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:25:36.125 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:25:33.424942+0000", 2021-10-20T23:25:36.125 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:25:36.126 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:25:36.126 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:25:36.126 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:25:36.126 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:25:36.127 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:25:36.127 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:25:36.127 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:25:36.127 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:25:36.128 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:25:36.128 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:25:36.128 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:25:36.128 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:25:36.129 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:25:36.129 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:25:36.129 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 12, 2021-10-20T23:25:36.129 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:25:36.129 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:25:36.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:25:36.130 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:25:36.130 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:25:36.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.131 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:25:36.131 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:25:36.131 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:25:36.132 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:25:36.132 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:25:36.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:25:36.132 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:25:36.133 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:25:36.134 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:25:36.134 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:25:36.134 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:25:36.136 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:25:36.136 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:25:36.137 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:25:36.137 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:25:36.137 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:25:36.137 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:25:36.138 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:25:36.138 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:25:36.138 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:25:36.138 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:25:36.138 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:25:36.139 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:25:36.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.139 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:25:36.140 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:25:36.140 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:25:36.140 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:25:36.140 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:25:36.141 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:25:36.141 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:25:36.141 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:25:36.141 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:25:36.141 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:25:36.142 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:25:36.142 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:25:36.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:25:36.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:25:36.143 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:25:36.143 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:25:36.143 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:25:36.143 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:25:36.144 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:25:36.144 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:25:36.144 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:25:36.144 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:25:36.145 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:25:36.145 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:25:36.145 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:25:36.145 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:25:36.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:25:36.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.146 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:25:36.146 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:25:36.147 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:25:36.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:25:36.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:25:36.148 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:25:36.148 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:25:36.148 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:25:36.148 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:25:36.148 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:25:36.149 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:25:36.149 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:25:36.149 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:25:36.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.150 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:25:36.150 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:25:36.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.151 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:25:36.151 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:25:36.151 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:25:36.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:25:36.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:25:36.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:25:36.152 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:25:36.152 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:25:36.153 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:25:36.153 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:25:36.153 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:25:36.153 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:25:36.154 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:25:36.154 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:25:36.154 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:25:36.154 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:25:36.155 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:25:36.155 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:25:36.155 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:25:36.155 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:25:36.156 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:25:36.156 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:25:36.156 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:25:36.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.157 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:25:36.157 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:25:36.157 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:25:36.158 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:25:36.158 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:25:36.158 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:25:36.158 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:25:36.159 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:25:36.159 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:25:36.159 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:25:36.159 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:25:36.159 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:25:36.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:25:36.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:25:36.160 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:25:36.160 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:25:36.161 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:25:36.161 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:25:36.161 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:25:36.161 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:25:36.161 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:25:36.162 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:25:36.162 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:25:36.163 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:25:36.164 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:25:36.164 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:25:36.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:25:36.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.165 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:25:36.166 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:25:36.167 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:25:36.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:25:36.168 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:25:36.168 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:25:36.169 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:25:36.169 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:25:36.170 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:25:36.170 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:25:36.171 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:25:36.172 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:25:36.172 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:25:36.172 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:25:36.174 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.175 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.176 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:25:36.176 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:25:36.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.177 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:25:36.177 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:25:36.177 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:36.177 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:36.177 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:36.178 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:36.178 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:36.178 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:36.178 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:36.179 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:25:36.179 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:36.179 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:36.179 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:36.180 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.180 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:25:36.181 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:36.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.182 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:25:36.182 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:36.182 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.182 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.183 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:36.183 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.184 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:25:36.184 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:36.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.185 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:25:36.185 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:36.185 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.185 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.186 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:36.186 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.187 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:25:36.187 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:36.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.188 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:25:36.188 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:36.188 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.189 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.189 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:36.189 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.190 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:25:36.190 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:36.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.191 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:25:36.191 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:25:36.191 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.192 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.192 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:25:36.192 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:25:36.192 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:25:36.193 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:25:36.193 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:36.193 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:36.193 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:36.194 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.194 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:25:36.195 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:25:36.195 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:36.195 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:36.195 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:36.195 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:36.196 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:36.196 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:36.197 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:36.197 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:25:36.198 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:36.198 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:36.198 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:36.198 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.199 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:25:36.199 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:36.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.200 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.200 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:25:36.200 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:36.201 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.201 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.201 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:36.201 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.202 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:25:36.202 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:36.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.203 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:25:36.204 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:36.204 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.204 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.205 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:36.205 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.206 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:25:36.206 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:36.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.207 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:25:36.207 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:36.208 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.208 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.208 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:36.208 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.209 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:25:36.209 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:36.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.210 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:25:36.210 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:25:36.211 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.211 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.211 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:25:36.211 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:25:36.212 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:25:36.212 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:25:36.212 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:36.212 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:36.213 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:36.213 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.213 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:25:36.214 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:25:36.214 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:36.214 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:36.214 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:36.215 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:36.215 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:36.215 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:36.216 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:36.216 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 65, 2021-10-20T23:25:36.216 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:36.216 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:36.217 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:36.217 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.217 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.217 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:25:36.218 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:36.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.219 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:25:36.219 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:36.219 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.219 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.220 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:36.220 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.221 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:25:36.221 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:36.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.222 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:25:36.222 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:36.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.222 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.223 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:36.223 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.224 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:25:36.224 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:36.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.225 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:25:36.225 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:36.225 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.225 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.226 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:36.226 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.227 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:25:36.227 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:36.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.228 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:25:36.228 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:25:36.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.229 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.229 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:25:36.229 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:25:36.229 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:25:36.230 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:25:36.230 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:36.230 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:36.230 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:36.231 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.231 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:25:36.231 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:25:36.232 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:36.232 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:36.232 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:36.232 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:36.232 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:36.233 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:36.233 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:36.233 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 55, 2021-10-20T23:25:36.233 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:36.234 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:36.234 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:36.234 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.234 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.235 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:25:36.235 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:36.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.236 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:25:36.236 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:36.236 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.236 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.237 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:36.237 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.238 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:25:36.238 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:36.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.239 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:25:36.239 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:36.239 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.240 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.240 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:36.240 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.241 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.241 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:25:36.241 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:36.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.243 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:25:36.243 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:36.243 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.244 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.244 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:36.244 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.245 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.245 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:25:36.246 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:36.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.246 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.247 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:25:36.247 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:25:36.247 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.247 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.248 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:25:36.248 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:25:36.248 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:25:36.249 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:25:36.249 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:36.249 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:36.249 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:36.249 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.250 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:25:36.250 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:25:36.251 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:36.251 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:36.251 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:36.251 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:36.252 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:36.252 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:36.252 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:36.252 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:25:36.253 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:36.253 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:36.253 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:36.253 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.254 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:25:36.254 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:36.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.255 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:25:36.255 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:36.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.256 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.256 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:36.257 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.257 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.257 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:25:36.258 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:36.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.258 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:25:36.259 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:36.259 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.259 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.260 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:36.260 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.261 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:25:36.261 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:36.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.262 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:25:36.262 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:36.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.263 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.263 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:36.264 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.264 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:25:36.264 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:36.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.265 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.265 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:25:36.266 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:25:36.266 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.266 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.267 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:25:36.267 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:25:36.267 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:25:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:25:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.269 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:25:36.269 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:25:36.270 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:36.270 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:36.270 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:36.270 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:36.271 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:36.271 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:36.271 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:36.271 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 65, 2021-10-20T23:25:36.272 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:36.272 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:36.272 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:36.272 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.273 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:25:36.273 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:36.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.274 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.274 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:25:36.274 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:36.275 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.275 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.275 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:36.275 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.276 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:25:36.277 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:36.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.277 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:25:36.278 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:36.278 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.278 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.279 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:36.279 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.280 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:25:36.280 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:36.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.280 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.281 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:25:36.281 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:36.281 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.281 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.282 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:36.282 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.283 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.283 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:25:36.283 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:36.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.284 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:25:36.284 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:25:36.284 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.285 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.285 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:25:36.285 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:25:36.286 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:25:36.286 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:25:36.286 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:36.286 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:36.286 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:36.287 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.287 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:25:36.288 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:25:36.288 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:36.288 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:36.288 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:36.289 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:36.289 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:36.289 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:36.289 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:36.290 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:25:36.290 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:36.290 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:36.290 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:36.290 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.291 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.291 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:25:36.291 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:36.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.292 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:25:36.292 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:36.293 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.293 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.294 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:36.294 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.295 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:25:36.295 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:36.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.296 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:25:36.296 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:36.296 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.297 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.297 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:36.297 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.298 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:25:36.298 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:36.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.299 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:25:36.300 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:36.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.300 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.300 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:36.301 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.301 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:25:36.302 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:36.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.302 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.302 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:25:36.303 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:25:36.303 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.303 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.304 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:25:36.304 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:25:36.304 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:25:36.304 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:25:36.305 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:36.305 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:36.305 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:36.305 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.306 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:25:36.306 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:25:36.306 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:25:36.307 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:25:36.307 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:25:36.307 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:25:36.307 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:25:36.307 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:25:36.308 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:25:36.308 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 65, 2021-10-20T23:25:36.308 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:25:36.308 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:25:36.309 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:25:36.309 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.309 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:25:36.310 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:36.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.310 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.311 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:25:36.311 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:36.311 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.311 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.312 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:25:36.312 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.313 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:25:36.313 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:36.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.314 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:25:36.314 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:36.314 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.314 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.315 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:25:36.315 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.316 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:25:36.316 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:36.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.317 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:25:36.317 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:36.317 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.318 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.318 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:25:36.318 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:25:36.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.319 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:25:36.319 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:25:36.319 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:36.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:25:36.320 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:25:36.320 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:25:36.321 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.321 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.321 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:25:36.322 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:25:36.322 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:25:36.322 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:25:36.322 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:25:36.322 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:25:36.323 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:25:36.323 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:36.323 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.323 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:25:36.324 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:25:36.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.324 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:25:36.324 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:36.324 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:36.325 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:36.325 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:36.325 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:36.325 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:25:36.326 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:36.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.326 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:25:36.326 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:36.327 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:36.327 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:36.327 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:36.327 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:36.328 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:25:36.328 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:36.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.328 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:25:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:36.330 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:36.330 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:25:36.330 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:36.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.331 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:25:36.331 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:36.331 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:36.331 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:36.332 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:36.332 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:36.332 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:25:36.333 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:36.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.333 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:25:36.333 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:36.334 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:36.334 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:36.334 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:36.334 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:36.335 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:25:36.335 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:36.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.335 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:25:36.336 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:36.336 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:36.336 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:36.336 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:36.337 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:36.337 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:25:36.337 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:36.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.338 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:25:36.338 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:36.338 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:36.338 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:36.339 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:36.339 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:36.339 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:25:36.339 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:36.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:36.340 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:25:36.340 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:25:36.341 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:25:36.341 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:25:36.341 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:25:36.342 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:25:36.342 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:25:36.342 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:25:36.342 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.343 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:25:36.343 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:25:36.343 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:25:36.343 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:25:36.344 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:25:36.344 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:25:36.344 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6833/242443509": "2021-10-21T23:25:29.412206+0000", 2021-10-20T23:25:36.344 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6832/242443509": "2021-10-21T23:25:29.412206+0000" 2021-10-20T23:25:36.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.345 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:25:36.346 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:25:36.346 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:25:36.346 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:25:36.346 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:25:36.347 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:25:36.347 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:25:36.347 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:25:36.347 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:25:36.347 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:25:36.348 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:25:36.348 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:25:36.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.348 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:25:36.349 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:25:36.349 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:25:36.349 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:25:36.349 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:25:36.350 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:25:36.350 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:25:36.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:36.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:36.350 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:25:36.351 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:25:36.351 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:25:36.351 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:25:36.351 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:25:36.352 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:25:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae380536a0 msgr2=0x7fae38055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae380536a0 0x7fae38055b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fae3c018000 tx=0x7fae3c014000).stop 2021-10-20T23:25:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540601a0 msgr2=0x7fae541411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540601a0 0x7fae541411f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fae4400c000 tx=0x7fae44006df0).stop 2021-10-20T23:25:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 shutdown_connections 2021-10-20T23:25:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae380536a0 0x7fae38055b60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae54144940 0x7fae54155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae540af3c0 0x7fae54152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 --2- 172.21.15.12:0/2071384154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540601a0 0x7fae541411f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 >> 172.21.15.12:0/2071384154 conn(0x7fae54061140 msgr2=0x7fae54144080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:36.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 shutdown_connections 2021-10-20T23:25:36.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.118+0000 7fae53fff700 1 -- 172.21.15.12:0/2071384154 wait complete. 2021-10-20T23:25:36.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 Processor -- start 2021-10-20T23:25:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 -- start start 2021-10-20T23:25:36.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3a40b1a30 0x7fc3a40669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3a4140cb0 0x7fc3a413e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a405f750 con 0x7fc3a40665f0 2021-10-20T23:25:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a40b14a0 con 0x7fc3a40b1a30 2021-10-20T23:25:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a405f980 con 0x7fc3a4140cb0 2021-10-20T23:25:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a2d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc3a40665f0 0x7fc3a405fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39232/0 (socket says 172.21.15.12:39232) 2021-10-20T23:25:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a2d9d700 1 -- 172.21.15.12:0/683378032 learned_addr learned my addr 172.21.15.12:0/683378032 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a259c700 1 --2- 172.21.15.12:0/683378032 >> v2:172.21.15.12:3300/0 conn(0x7fc3a40b1a30 0x7fc3a40669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a359e700 1 --2- 172.21.15.12:0/683378032 >> v2:172.21.15.31:3300/0 conn(0x7fc3a4140cb0 0x7fc3a413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a1d9b700 1 -- 172.21.15.12:0/683378032 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291724171 0 0) 0x7fc3a405f750 con 0x7fc3a40665f0 2021-10-20T23:25:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a1d9b700 1 -- 172.21.15.12:0/683378032 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc384003260 con 0x7fc3a40665f0 2021-10-20T23:25:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a259c700 1 -- 172.21.15.12:0/683378032 >> v2:172.21.15.31:3300/0 conn(0x7fc3a4140cb0 msgr2=0x7fc3a413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a259c700 1 --2- 172.21.15.12:0/683378032 >> v2:172.21.15.31:3300/0 conn(0x7fc3a4140cb0 0x7fc3a413e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a259c700 1 -- 172.21.15.12:0/683378032 >> v1:172.21.15.12:6789/0 conn(0x7fc3a40665f0 legacy=0x7fc3a405fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a259c700 1 -- 172.21.15.12:0/683378032 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40b1740 con 0x7fc3a40b1a30 2021-10-20T23:25:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a259c700 1 --2- 172.21.15.12:0/683378032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 0x7fc3a40669d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fc38c002f70 tx=0x7fc38c006df0).ready entity=mon.0 client_cookie=1c755f184997656d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a1d9b700 1 -- 172.21.15.12:0/683378032 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc38c00d4f0 con 0x7fc3a40b1a30 2021-10-20T23:25:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a1d9b700 1 -- 172.21.15.12:0/683378032 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c000e90 con 0x7fc3a40b1a30 2021-10-20T23:25:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a1d9b700 1 -- 172.21.15.12:0/683378032 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc38c00d840 con 0x7fc3a40b1a30 2021-10-20T23:25:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 -- 172.21.15.12:0/683378032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 msgr2=0x7fc3a40669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 --2- 172.21.15.12:0/683378032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 0x7fc3a40669d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fc38c002f70 tx=0x7fc38c006df0).stop 2021-10-20T23:25:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 -- 172.21.15.12:0/683378032 shutdown_connections 2021-10-20T23:25:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 --2- 172.21.15.12:0/683378032 >> v2:172.21.15.31:3300/0 conn(0x7fc3a4140cb0 0x7fc3a413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 --2- 172.21.15.12:0/683378032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 0x7fc3a40669d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 -- 172.21.15.12:0/683378032 >> 172.21.15.12:0/683378032 conn(0x7fc3a40636e0 msgr2=0x7fc3a4063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:36.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 -- 172.21.15.12:0/683378032 shutdown_connections 2021-10-20T23:25:36.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.474+0000 7fc3a89a2700 1 -- 172.21.15.12:0/683378032 wait complete. 2021-10-20T23:25:36.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 Processor -- start 2021-10-20T23:25:36.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 -- start start 2021-10-20T23:25:36.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40665f0 0x7fc3a4146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 0x7fc3a4153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4140cb0 0x7fc3a4153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4153640 con 0x7fc3a40b1a30 2021-10-20T23:25:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4154450 con 0x7fc3a40665f0 2021-10-20T23:25:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41426a0 con 0x7fc3a4140cb0 2021-10-20T23:25:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 0x7fc3a4153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 0x7fc3a4153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40646/0 (socket says 172.21.15.12:40646) 2021-10-20T23:25:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a259c700 1 -- 172.21.15.12:0/1682664598 learned_addr learned my addr 172.21.15.12:0/1682664598 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a2d9d700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40665f0 0x7fc3a4146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a359e700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4140cb0 0x7fc3a4153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a259c700 1 -- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4140cb0 msgr2=0x7fc3a4153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a259c700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4140cb0 0x7fc3a4153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a259c700 1 -- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40665f0 msgr2=0x7fc3a4146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a259c700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40665f0 0x7fc3a4146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a259c700 1 -- 172.21.15.12:0/1682664598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c00b180 con 0x7fc3a40b1a30 2021-10-20T23:25:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a259c700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 0x7fc3a4153a70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fc38c002f70 tx=0x7fc38c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc39bfff700 1 -- 172.21.15.12:0/1682664598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc38c016070 con 0x7fc3a40b1a30 2021-10-20T23:25:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc39bfff700 1 -- 172.21.15.12:0/1682664598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c0138d0 con 0x7fc3a40b1a30 2021-10-20T23:25:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a4142940 con 0x7fc3a40b1a30 2021-10-20T23:25:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc39bfff700 1 -- 172.21.15.12:0/1682664598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc38c013c30 con 0x7fc3a40b1a30 2021-10-20T23:25:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.478+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a41500f0 con 0x7fc3a40b1a30 2021-10-20T23:25:36.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.482+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a41537b0 con 0x7fc3a40b1a30 2021-10-20T23:25:36.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.482+0000 7fc39bfff700 1 -- 172.21.15.12:0/1682664598 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc38c00f030 con 0x7fc3a40b1a30 2021-10-20T23:25:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.482+0000 7fc39bfff700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3880536d0 0x7fc388055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.482+0000 7fc39bfff700 1 -- 172.21.15.12:0/1682664598 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc38c06c340 con 0x7fc3a40b1a30 2021-10-20T23:25:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.482+0000 7fc3a2d9d700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3880536d0 0x7fc388055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.482+0000 7fc3a2d9d700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3880536d0 0x7fc388055b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fc39400d000 tx=0x7fc394009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:36.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.490+0000 7fc39bfff700 1 -- 172.21.15.12:0/1682664598 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3a41537b0 con 0x7fc3a40b1a30 2021-10-20T23:25:36.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3a4153780 con 0x7fc3a40b1a30 2021-10-20T23:25:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc39bfff700 1 -- 172.21.15.12:0/1682664598 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fc38c023020 con 0x7fc3a40b1a30 2021-10-20T23:25:36.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:36.657 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":6144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/2945214026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2945214026},{"type":"v1","addr":"172.21.15.12:6833","nonce":2945214026}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[]} 2021-10-20T23:25:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3880536d0 msgr2=0x7fc388055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3880536d0 0x7fc388055b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fc39400d000 tx=0x7fc394009040).stop 2021-10-20T23:25:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 msgr2=0x7fc3a4153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 0x7fc3a4153a70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fc38c002f70 tx=0x7fc38c014000).stop 2021-10-20T23:25:36.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 shutdown_connections 2021-10-20T23:25:36.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3880536d0 0x7fc388055b90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4140cb0 0x7fc3a4153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a40b1a30 0x7fc3a4153a70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 --2- 172.21.15.12:0/1682664598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40665f0 0x7fc3a4146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 >> 172.21.15.12:0/1682664598 conn(0x7fc3a40636e0 msgr2=0x7fc3a413cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 shutdown_connections 2021-10-20T23:25:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.650+0000 7fc3a89a2700 1 -- 172.21.15.12:0/1682664598 wait complete. 2021-10-20T23:25:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2021-10-20T23:25:36.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc227fff700 1 Processor -- start 2021-10-20T23:25:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc227fff700 1 -- start start 2021-10-20T23:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc227fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc2280b0010 0x7fc2280a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc227fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc2280afbd0 0x7fc2280a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc227fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2280a70c0 con 0x7fc2280b2580 2021-10-20T23:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc227fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2280a72f0 con 0x7fc2280b0010 2021-10-20T23:25:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc227fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2280a7590 con 0x7fc2280afbd0 2021-10-20T23:25:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc2267fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc2280b0010 0x7fc2280a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc226ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc2280b2580 0x7fc22814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39246/0 (socket says 172.21.15.12:39246) 2021-10-20T23:25:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc226ffd700 1 -- 172.21.15.12:0/3248046266 learned_addr learned my addr 172.21.15.12:0/3248046266 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc2277fe700 1 --2- 172.21.15.12:0/3248046266 >> v2:172.21.15.31:3300/0 conn(0x7fc2280afbd0 0x7fc2280a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc2267fc700 1 -- 172.21.15.12:0/3248046266 >> v2:172.21.15.31:3300/0 conn(0x7fc2280afbd0 msgr2=0x7fc2280a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc2267fc700 1 --2- 172.21.15.12:0/3248046266 >> v2:172.21.15.31:3300/0 conn(0x7fc2280afbd0 0x7fc2280a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc2267fc700 1 -- 172.21.15.12:0/3248046266 >> v1:172.21.15.12:6789/0 conn(0x7fc2280b2580 legacy=0x7fc22814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc2267fc700 1 -- 172.21.15.12:0/3248046266 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280a7830 con 0x7fc2280b0010 2021-10-20T23:25:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc2267fc700 1 --2- 172.21.15.12:0/3248046266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b0010 0x7fc2280a83b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fc218002f70 tx=0x7fc218006df0).ready entity=mon.0 client_cookie=f20bbdd1798add79 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc225ffb700 1 -- 172.21.15.12:0/3248046266 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc21800d570 con 0x7fc2280b0010 2021-10-20T23:25:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc225ffb700 1 -- 172.21.15.12:0/3248046266 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc218000e90 con 0x7fc2280b0010 2021-10-20T23:25:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.766+0000 7fc225ffb700 1 -- 172.21.15.12:0/3248046266 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc21800d8c0 con 0x7fc2280b0010 2021-10-20T23:25:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 -- 172.21.15.12:0/3248046266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b0010 msgr2=0x7fc2280a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 --2- 172.21.15.12:0/3248046266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b0010 0x7fc2280a83b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fc218002f70 tx=0x7fc218006df0).stop 2021-10-20T23:25:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 -- 172.21.15.12:0/3248046266 shutdown_connections 2021-10-20T23:25:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 --2- 172.21.15.12:0/3248046266 >> v2:172.21.15.31:3300/0 conn(0x7fc2280afbd0 0x7fc2280a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 --2- 172.21.15.12:0/3248046266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b0010 0x7fc2280a83b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 -- 172.21.15.12:0/3248046266 >> 172.21.15.12:0/3248046266 conn(0x7fc228060180 msgr2=0x7fc2280b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 -- 172.21.15.12:0/3248046266 shutdown_connections 2021-10-20T23:25:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 -- 172.21.15.12:0/3248046266 wait complete. 2021-10-20T23:25:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 Processor -- start 2021-10-20T23:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 -- start start 2021-10-20T23:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2280afbd0 0x7fc228063b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2280b0010 0x7fc228063070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b2580 0x7fc228066760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280b5ba0 con 0x7fc2280b2580 2021-10-20T23:25:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc228064010 con 0x7fc2280afbd0 2021-10-20T23:25:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc227fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280b5dd0 con 0x7fc2280b0010 2021-10-20T23:25:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc2277fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b2580 0x7fc228066760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc2277fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b2580 0x7fc228066760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40662/0 (socket says 172.21.15.12:40662) 2021-10-20T23:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc2277fe700 1 -- 172.21.15.12:0/554138256 learned_addr learned my addr 172.21.15.12:0/554138256 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc226ffd700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2280afbd0 0x7fc228063b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc2267fc700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2280b0010 0x7fc228063070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc2277fe700 1 -- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2280b0010 msgr2=0x7fc228063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc2277fe700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2280b0010 0x7fc228063070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc2277fe700 1 -- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2280afbd0 msgr2=0x7fc228063b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc2277fe700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2280afbd0 0x7fc228063b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.770+0000 7fc2277fe700 1 -- 172.21.15.12:0/554138256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21800b180 con 0x7fc2280b2580 2021-10-20T23:25:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc2277fe700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b2580 0x7fc228066760 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fc22000c000 tx=0x7fc2200091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc21ffff700 1 -- 172.21.15.12:0/554138256 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc22000c670 con 0x7fc2280b2580 2021-10-20T23:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc21ffff700 1 -- 172.21.15.12:0/554138256 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22000c7d0 con 0x7fc2280b2580 2021-10-20T23:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc228156f50 con 0x7fc2280b2580 2021-10-20T23:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc21ffff700 1 -- 172.21.15.12:0/554138256 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc22000cb30 con 0x7fc2280b2580 2021-10-20T23:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc228063560 con 0x7fc2280b2580 2021-10-20T23:25:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc228057350 con 0x7fc2280b2580 2021-10-20T23:25:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc21ffff700 1 -- 172.21.15.12:0/554138256 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc220022070 con 0x7fc2280b2580 2021-10-20T23:25:36.788 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:25:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc21ffff700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc20c0536a0 0x7fc20c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.774+0000 7fc21ffff700 1 -- 172.21.15.12:0/554138256 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc22006bea0 con 0x7fc2280b2580 2021-10-20T23:25:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.778+0000 7fc226ffd700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc20c0536a0 0x7fc20c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.778+0000 7fc226ffd700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc20c0536a0 0x7fc20c055b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fc21000d000 tx=0x7fc210000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:36.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.778+0000 7fc21ffff700 1 -- 172.21.15.12:0/554138256 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc220043100 con 0x7fc2280b2580 2021-10-20T23:25:36.792 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:25:36.796 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:25:36.799 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:25:36.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.950+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2280698e0 con 0x7fc2280b2580 2021-10-20T23:25:36.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc21ffff700 1 -- 172.21.15.12:0/554138256 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fc220016020 con 0x7fc2280b2580 2021-10-20T23:25:36.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:36.959 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3172876676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3172876676},{"type":"v1","addr":"172.21.15.31:6835","nonce":3172876676}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4065317061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4065317061},{"type":"v1","addr":"172.21.15.12:6835","nonce":4065317061}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":6144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/2945214026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2945214026},{"type":"v1","addr":"172.21.15.12:6833","nonce":2945214026}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[]} 2021-10-20T23:25:36.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc20c0536a0 msgr2=0x7fc20c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc20c0536a0 0x7fc20c055b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fc21000d000 tx=0x7fc210000bc0).stop 2021-10-20T23:25:36.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b2580 msgr2=0x7fc228066760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:36.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b2580 0x7fc228066760 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fc22000c000 tx=0x7fc2200091d0).stop 2021-10-20T23:25:36.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 shutdown_connections 2021-10-20T23:25:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc20c0536a0 0x7fc20c055b60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2280b2580 0x7fc228066760 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2280b0010 0x7fc228063070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 --2- 172.21.15.12:0/554138256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2280afbd0 0x7fc228063b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 >> 172.21.15.12:0/554138256 conn(0x7fc228060180 msgr2=0x7fc2280aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:36.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 shutdown_connections 2021-10-20T23:25:36.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:36.954+0000 7fc227fff700 1 -- 172.21.15.12:0/554138256 wait complete. 2021-10-20T23:25:36.963 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2021-10-20T23:25:36.971 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:25:36.972 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:25:36.972 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:25:36.972 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:25:36.973 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:25:36.973 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:25:36.973 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:25:36.974 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:25:36.974 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:25:36.974 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:25:36.975 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:25:36.975 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:25:36.983 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:25:36.983 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:25:36.986 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:25:36.986 DEBUG:teuthology.parallel:result is None 2021-10-20T23:25:36.987 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:25:36.987 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:25:36.989 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:25:36.990 DEBUG:teuthology.parallel:result is None 2021-10-20T23:25:36.991 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:25:36.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:25:36.994 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:25:36.994 DEBUG:teuthology.parallel:result is None 2021-10-20T23:25:36.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:25:37.060 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:25:37.061 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:25:37.069 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:25:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.082+0000 7ff35e88d700 1 Processor -- start 2021-10-20T23:25:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.082+0000 7ff35e88d700 1 -- start start 2021-10-20T23:25:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580b0710 0x7ff358142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff358143920 con 0x7ff3580ace70 2021-10-20T23:25:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3580b0af0 con 0x7ff3580b30d0 2021-10-20T23:25:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580ae680 con 0x7ff3580b0710 2021-10-20T23:25:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e08c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff3580ace70 0x7ff35813f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39286/0 (socket says 172.21.15.12:39286) 2021-10-20T23:25:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e08c700 1 -- 172.21.15.12:0/1173795354 learned_addr learned my addr 172.21.15.12:0/1173795354 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:37.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35d88b700 1 --2- 172.21.15.12:0/1173795354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580b0710 0x7ff358142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:37.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35c889700 1 -- 172.21.15.12:0/1173795354 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137374737 0 0) 0x7ff358143920 con 0x7ff3580ace70 2021-10-20T23:25:37.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35c889700 1 -- 172.21.15.12:0/1173795354 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff340003260 con 0x7ff3580ace70 2021-10-20T23:25:37.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35c889700 1 -- 172.21.15.12:0/1173795354 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292207570 0 0) 0x7ff3580b0af0 con 0x7ff3580b30d0 2021-10-20T23:25:37.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35c889700 1 -- 172.21.15.12:0/1173795354 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff358143920 con 0x7ff3580b30d0 2021-10-20T23:25:37.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35d88b700 1 -- 172.21.15.12:0/1173795354 >> v1:172.21.15.31:6789/0 conn(0x7ff3580b30d0 legacy=0x7ff358143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:37.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35d88b700 1 -- 172.21.15.12:0/1173795354 >> v1:172.21.15.12:6789/0 conn(0x7ff3580ace70 legacy=0x7ff35813f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:37.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35d88b700 1 -- 172.21.15.12:0/1173795354 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3580ae920 con 0x7ff3580b0710 2021-10-20T23:25:37.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35d88b700 1 --2- 172.21.15.12:0/1173795354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580b0710 0x7ff358142d20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff354002f70 tx=0x7ff354006e80).ready entity=mon.2 client_cookie=4867f1069e63503f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:37.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35c889700 1 -- 172.21.15.12:0/1173795354 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff354014070 con 0x7ff3580b0710 2021-10-20T23:25:37.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35c889700 1 -- 172.21.15.12:0/1173795354 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354000e90 con 0x7ff3580b0710 2021-10-20T23:25:37.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35c889700 1 -- 172.21.15.12:0/1173795354 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3540107f0 con 0x7ff3580b0710 2021-10-20T23:25:37.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 -- 172.21.15.12:0/1173795354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580b0710 msgr2=0x7ff358142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:37.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 --2- 172.21.15.12:0/1173795354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580b0710 0x7ff358142d20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff354002f70 tx=0x7ff354006e80).stop 2021-10-20T23:25:37.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 -- 172.21.15.12:0/1173795354 shutdown_connections 2021-10-20T23:25:37.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 --2- 172.21.15.12:0/1173795354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580b0710 0x7ff358142d20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:37.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 -- 172.21.15.12:0/1173795354 >> 172.21.15.12:0/1173795354 conn(0x7ff358061140 msgr2=0x7ff358062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:37.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 -- 172.21.15.12:0/1173795354 shutdown_connections 2021-10-20T23:25:37.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.086+0000 7ff35e88d700 1 -- 172.21.15.12:0/1173795354 wait complete. 2021-10-20T23:25:37.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e88d700 1 Processor -- start 2021-10-20T23:25:37.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e88d700 1 -- start start 2021-10-20T23:25:37.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e88d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580ace70 0x7ff358141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:37.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e88d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3580b0710 0x7ff358064e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:37.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e88d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3580b30d0 0x7ff358065320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:37.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e88d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580644b0 con 0x7ff3580b0710 2021-10-20T23:25:37.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e88d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580ab4a0 con 0x7ff3580b30d0 2021-10-20T23:25:37.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e88d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff358065810 con 0x7ff3580ace70 2021-10-20T23:25:37.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d08a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3580b0710 0x7ff358064e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:37.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d08a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3580b0710 0x7ff358064e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40698/0 (socket says 172.21.15.12:40698) 2021-10-20T23:25:37.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d08a700 1 -- 172.21.15.12:0/2970801215 learned_addr learned my addr 172.21.15.12:0/2970801215 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:37.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d88b700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580ace70 0x7ff358141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:37.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e08c700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3580b30d0 0x7ff358065320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:37.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d08a700 1 -- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580ace70 msgr2=0x7ff358141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:37.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d08a700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580ace70 0x7ff358141230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:37.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d08a700 1 -- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3580b30d0 msgr2=0x7ff358065320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:37.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d08a700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3580b30d0 0x7ff358065320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:37.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d08a700 1 -- 172.21.15.12:0/2970801215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35400c310 con 0x7ff3580b0710 2021-10-20T23:25:37.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e08c700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3580b30d0 0x7ff358065320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:37.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35d08a700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3580b0710 0x7ff358064e30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7ff358064ca0 tx=0x7ff348007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:37.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff346ffd700 1 -- 172.21.15.12:0/2970801215 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34800cdd0 con 0x7ff3580b0710 2021-10-20T23:25:37.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff346ffd700 1 -- 172.21.15.12:0/2970801215 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff348012400 con 0x7ff3580b0710 2021-10-20T23:25:37.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.090+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3580ab6d0 con 0x7ff3580b0710 2021-10-20T23:25:37.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.094+0000 7ff346ffd700 1 -- 172.21.15.12:0/2970801215 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff348012760 con 0x7ff3580b0710 2021-10-20T23:25:37.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.094+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3580aa670 con 0x7ff3580b0710 2021-10-20T23:25:37.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.094+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff358057350 con 0x7ff3580b0710 2021-10-20T23:25:37.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.094+0000 7ff346ffd700 1 -- 172.21.15.12:0/2970801215 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff348019030 con 0x7ff3580b0710 2021-10-20T23:25:37.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.094+0000 7ff346ffd700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff338053640 0x7ff338055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:37.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.094+0000 7ff346ffd700 1 -- 172.21.15.12:0/2970801215 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff34806aee0 con 0x7ff3580b0710 2021-10-20T23:25:37.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.094+0000 7ff35d88b700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff338053640 0x7ff338055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:37.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.098+0000 7ff35d88b700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff338053640 0x7ff338055b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff35401c000 tx=0x7ff3580a9420).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:37.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.102+0000 7ff346ffd700 1 -- 172.21.15.12:0/2970801215 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3480421c0 con 0x7ff3580b0710 2021-10-20T23:25:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:37.238+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ff3580b2c70 con 0x7ff3580b0710 2021-10-20T23:25:38.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.118+0000 7ff346ffd700 1 -- 172.21.15.12:0/2970801215 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff3480457e0 con 0x7ff3580b0710 2021-10-20T23:25:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff338053640 msgr2=0x7ff338055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff338053640 0x7ff338055b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff35401c000 tx=0x7ff3580a9420).stop 2021-10-20T23:25:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3580b0710 msgr2=0x7ff358064e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3580b0710 0x7ff358064e30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7ff358064ca0 tx=0x7ff348007a60).stop 2021-10-20T23:25:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 shutdown_connections 2021-10-20T23:25:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff338053640 0x7ff338055b00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3580b30d0 0x7ff358065320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3580b0710 0x7ff358064e30 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 --2- 172.21.15.12:0/2970801215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3580ace70 0x7ff358141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 >> 172.21.15.12:0/2970801215 conn(0x7ff358061140 msgr2=0x7ff3580a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 shutdown_connections 2021-10-20T23:25:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.122+0000 7ff35e88d700 1 -- 172.21.15.12:0/2970801215 wait complete. 2021-10-20T23:25:38.130 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:25:38.144 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:25:38.144 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:25:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 Processor -- start 2021-10-20T23:25:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 -- start start 2021-10-20T23:25:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04a80b3000 0x7f04a8060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a80b25a0 0x7f04a8061000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04a8066520 0x7f04a8066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a8062000 con 0x7f04a80b3000 2021-10-20T23:25:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a8065330 con 0x7f04a8066520 2021-10-20T23:25:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80b33e0 con 0x7f04a80b25a0 2021-10-20T23:25:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04adde6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04a80b3000 0x7f04a8060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04adde6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04a80b3000 0x7f04a8060b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40706/0 (socket says 172.21.15.12:40706) 2021-10-20T23:25:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04adde6700 1 -- 172.21.15.12:0/859967130 learned_addr learned my addr 172.21.15.12:0/859967130 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04ad5e5700 1 --2- 172.21.15.12:0/859967130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a80b25a0 0x7f04a8061000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04ae5e7700 1 --2- 172.21.15.12:0/859967130 >> v2:172.21.15.31:3300/0 conn(0x7f04a8066520 0x7f04a8066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04adde6700 1 -- 172.21.15.12:0/859967130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a80b25a0 msgr2=0x7f04a8061000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04adde6700 1 --2- 172.21.15.12:0/859967130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a80b25a0 0x7f04a8061000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04adde6700 1 -- 172.21.15.12:0/859967130 >> v2:172.21.15.31:3300/0 conn(0x7f04a8066520 msgr2=0x7f04a8066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04adde6700 1 --2- 172.21.15.12:0/859967130 >> v2:172.21.15.31:3300/0 conn(0x7f04a8066520 0x7f04a8066990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04adde6700 1 -- 172.21.15.12:0/859967130 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a805fa60 con 0x7f04a80b3000 2021-10-20T23:25:38.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04ad5e5700 1 --2- 172.21.15.12:0/859967130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a80b25a0 0x7f04a8061000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:38.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04adde6700 1 --2- 172.21.15.12:0/859967130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b3000 0x7f04a8060b10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f04a4002f70 tx=0x7f04a4006eb0).ready entity=mon.0 client_cookie=f273af9bc85161ed server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:38.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04acde4700 1 -- 172.21.15.12:0/859967130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a400d570 con 0x7f04a80b3000 2021-10-20T23:25:38.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04acde4700 1 -- 172.21.15.12:0/859967130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a4000e90 con 0x7f04a80b3000 2021-10-20T23:25:38.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04acde4700 1 -- 172.21.15.12:0/859967130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a400d900 con 0x7f04a80b3000 2021-10-20T23:25:38.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 -- 172.21.15.12:0/859967130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b3000 msgr2=0x7f04a8060b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 --2- 172.21.15.12:0/859967130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b3000 0x7f04a8060b10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f04a4002f70 tx=0x7f04a4006eb0).stop 2021-10-20T23:25:38.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 -- 172.21.15.12:0/859967130 shutdown_connections 2021-10-20T23:25:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 --2- 172.21.15.12:0/859967130 >> v2:172.21.15.31:3300/0 conn(0x7f04a8066520 0x7f04a8066990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 --2- 172.21.15.12:0/859967130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a80b25a0 0x7f04a8061000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 --2- 172.21.15.12:0/859967130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b3000 0x7f04a8060b10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 -- 172.21.15.12:0/859967130 >> 172.21.15.12:0/859967130 conn(0x7f04a80636e0 msgr2=0x7f04a8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 -- 172.21.15.12:0/859967130 shutdown_connections 2021-10-20T23:25:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.254+0000 7f04aede8700 1 -- 172.21.15.12:0/859967130 wait complete. 2021-10-20T23:25:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04aede8700 1 Processor -- start 2021-10-20T23:25:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04aede8700 1 -- start start 2021-10-20T23:25:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04aede8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a8066520 0x7f04a80b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04aede8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b25a0 0x7f04a80b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04aede8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04a80b3000 0x7f04a8152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04aede8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a8140570 con 0x7f04a80b25a0 2021-10-20T23:25:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04aede8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80b4a20 con 0x7f04a80b3000 2021-10-20T23:25:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04aede8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80b4c80 con 0x7f04a8066520 2021-10-20T23:25:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ad5e5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b25a0 0x7f04a80b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ad5e5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b25a0 0x7f04a80b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40714/0 (socket says 172.21.15.12:40714) 2021-10-20T23:25:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ad5e5700 1 -- 172.21.15.12:0/3307855237 learned_addr learned my addr 172.21.15.12:0/3307855237 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04adde6700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a8066520 0x7f04a80b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ae5e7700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04a80b3000 0x7f04a8152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ad5e5700 1 -- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a8066520 msgr2=0x7f04a80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ad5e5700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a8066520 0x7f04a80b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ad5e5700 1 -- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04a80b3000 msgr2=0x7f04a8152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ad5e5700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04a80b3000 0x7f04a8152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ad5e5700 1 -- 172.21.15.12:0/3307855237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a400b1e0 con 0x7f04a80b25a0 2021-10-20T23:25:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.258+0000 7f04ad5e5700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b25a0 0x7f04a80b57a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f049800a000 tx=0x7f0498008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:38.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f0496ffd700 1 -- 172.21.15.12:0/3307855237 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0498011780 con 0x7f04a80b25a0 2021-10-20T23:25:38.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f0496ffd700 1 -- 172.21.15.12:0/3307855237 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04980118e0 con 0x7f04a80b25a0 2021-10-20T23:25:38.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a80b4f20 con 0x7f04a80b25a0 2021-10-20T23:25:38.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f0496ffd700 1 -- 172.21.15.12:0/3307855237 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0498011c40 con 0x7f04a80b25a0 2021-10-20T23:25:38.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a8140140 con 0x7f04a80b25a0 2021-10-20T23:25:38.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a80b50b0 con 0x7f04a80b25a0 2021-10-20T23:25:38.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f0496ffd700 1 -- 172.21.15.12:0/3307855237 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f049801c460 con 0x7f04a80b25a0 2021-10-20T23:25:38.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f0496ffd700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04880536d0 0x7f0488055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f0496ffd700 1 -- 172.21.15.12:0/3307855237 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f049806b9f0 con 0x7f04a80b25a0 2021-10-20T23:25:38.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.262+0000 7f04adde6700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04880536d0 0x7f0488055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.266+0000 7f04adde6700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04880536d0 0x7f0488055b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f04a401c000 tx=0x7f04a4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:38.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.270+0000 7f0496ffd700 1 -- 172.21.15.12:0/3307855237 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0498042b40 con 0x7f04a80b25a0 2021-10-20T23:25:38.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.434+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f04a805fd00 con 0x7f04a80b25a0 2021-10-20T23:25:38.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f0496ffd700 1 -- 172.21.15.12:0/3307855237 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f0498046160 con 0x7f04a80b25a0 2021-10-20T23:25:38.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:38.443 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:25:38.443 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:25:38.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.444 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:25:38.444 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:25:38.444 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.445 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:25:38.445 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.445 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.445 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.445 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.446 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:25:38.446 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:25:38.447 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.447 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:25:38.447 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.448 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.448 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.448 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.449 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:25:38.449 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:25:38.449 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.450 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:25:38.450 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.450 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.451 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.452 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:25:38.452 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:25:38.452 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.452 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.452 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.453 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.453 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.454 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:25:38.454 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:25:38.454 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.455 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.455 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.455 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.456 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:25:38.456 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:25:38.456 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.457 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.457 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.457 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.457 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.458 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:25:38.458 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:25:38.459 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.459 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.459 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.459 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.460 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:25:38.461 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:25:38.461 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.461 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.462 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.462 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.462 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.463 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:25:38.463 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:25:38.463 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.464 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.464 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.464 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.465 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:25:38.465 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:25:38.466 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.466 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.466 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.466 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.466 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.467 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:25:38.467 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:25:38.468 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.468 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.468 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.468 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.469 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:25:38.469 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:25:38.470 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.470 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:25:38.470 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:25:38.470 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:25:38.470 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.471 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:25:38.471 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:25:38.472 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.472 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:25:38.472 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:25:38.472 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:25:38.473 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.473 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:25:38.473 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:25:38.474 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.474 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:25:38.474 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:25:38.474 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:25:38.475 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.476 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:25:38.476 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:25:38.476 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.476 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:25:38.476 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:25:38.477 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.477 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:38.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:38.477 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:25:38.478 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:25:38.478 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:25:38.478 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:25:38.478 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:25:38.479 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:25:38.479 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.479 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:38.479 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:25:38.479 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:25:38.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04880536d0 msgr2=0x7f0488055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04880536d0 0x7f0488055b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f04a401c000 tx=0x7f04a4015000).stop 2021-10-20T23:25:38.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b25a0 msgr2=0x7f04a80b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b25a0 0x7f04a80b57a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f049800a000 tx=0x7f0498008040).stop 2021-10-20T23:25:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 shutdown_connections 2021-10-20T23:25:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04880536d0 0x7f0488055b90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04a80b3000 0x7f04a8152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a80b25a0 0x7f04a80b57a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 --2- 172.21.15.12:0/3307855237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04a8066520 0x7f04a80b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 >> 172.21.15.12:0/3307855237 conn(0x7f04a80636e0 msgr2=0x7f04a80b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:38.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 shutdown_connections 2021-10-20T23:25:38.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.438+0000 7f04aede8700 1 -- 172.21.15.12:0/3307855237 wait complete. 2021-10-20T23:25:38.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:25:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.582+0000 7fb281c90700 1 Processor -- start 2021-10-20T23:25:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.582+0000 7fb281c90700 1 -- start start 2021-10-20T23:25:38.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb281c90700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb27c061320 0x7fb27c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb281c90700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c0aecf0 con 0x7fb27c140440 2021-10-20T23:25:38.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb281c90700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c0b6f20 con 0x7fb27c0ad5c0 2021-10-20T23:25:38.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb281c90700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c0aef20 con 0x7fb27c061320 2021-10-20T23:25:38.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb27c140440 0x7fb27c146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39318/0 (socket says 172.21.15.12:39318) 2021-10-20T23:25:38.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 -- 172.21.15.12:0/3918721755 learned_addr learned my addr 172.21.15.12:0/3918721755 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb280c8e700 1 --2- 172.21.15.12:0/3918721755 >> v2:172.21.15.31:3300/0 conn(0x7fb27c061320 0x7fb27c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350646313 0 0) 0x7fb27c0aecf0 con 0x7fb27c140440 2021-10-20T23:25:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb268003260 con 0x7fb27c140440 2021-10-20T23:25:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174628946 0 0) 0x7fb27c0b6f20 con 0x7fb27c0ad5c0 2021-10-20T23:25:38.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb27c0aecf0 con 0x7fb27c0ad5c0 2021-10-20T23:25:38.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3749891830 0 0) 0x7fb268003260 con 0x7fb27c140440 2021-10-20T23:25:38.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 >> v2:172.21.15.31:3300/0 conn(0x7fb27c061320 msgr2=0x7fb27c061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:38.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 --2- 172.21.15.12:0/3918721755 >> v2:172.21.15.31:3300/0 conn(0x7fb27c061320 0x7fb27c061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 >> v1:172.21.15.31:6789/0 conn(0x7fb27c0ad5c0 legacy=0x7fb27c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0af1c0 con 0x7fb27c140440 2021-10-20T23:25:38.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fb2740019e0 con 0x7fb27c140440 2021-10-20T23:25:38.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 >> v1:172.21.15.12:6789/0 conn(0x7fb27c140440 legacy=0x7fb27c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2680038e0 0x7fb268003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb268004500 0x7fb268004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb268004e70 0x7fb26800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0aef20 con 0x7fb268004e70 2021-10-20T23:25:38.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26800bcf0 con 0x7fb268004500 2021-10-20T23:25:38.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26800beb0 con 0x7fb2680038e0 2021-10-20T23:25:38.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb268004e70 0x7fb26800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb280c8e700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2680038e0 0x7fb268003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27bfff700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb268004500 0x7fb268004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 -- 172.21.15.12:0/3918721755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2680038e0 msgr2=0x7fb268003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2680038e0 0x7fb268003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 -- 172.21.15.12:0/3918721755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb268004500 msgr2=0x7fb268004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb268004500 0x7fb268004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 -- 172.21.15.12:0/3918721755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268003260 con 0x7fb268004e70 2021-10-20T23:25:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 -- 172.21.15.12:0/3918721755 reap_dead start 2021-10-20T23:25:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb28148f700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb268004e70 0x7fb26800b750 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fb2740017b0 tx=0x7fb27c0af350).ready entity=mon.0 client_cookie=aabd72b64c7906ef server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb27400cba0 con 0x7fb268004e70 2021-10-20T23:25:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27400cd00 con 0x7fb268004e70 2021-10-20T23:25:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.586+0000 7fb27b7fe700 1 -- 172.21.15.12:0/3918721755 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb274005b80 con 0x7fb268004e70 2021-10-20T23:25:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 -- 172.21.15.12:0/3918721755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb268004e70 msgr2=0x7fb26800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb268004e70 0x7fb26800b750 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fb2740017b0 tx=0x7fb27c0af350).stop 2021-10-20T23:25:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 -- 172.21.15.12:0/3918721755 shutdown_connections 2021-10-20T23:25:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 --2- 172.21.15.12:0/3918721755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb268004e70 0x7fb26800b750 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 -- 172.21.15.12:0/3918721755 >> 172.21.15.12:0/3918721755 conn(0x7fb27c066de0 msgr2=0x7fb27c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 -- 172.21.15.12:0/3918721755 shutdown_connections 2021-10-20T23:25:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 -- 172.21.15.12:0/3918721755 wait complete. 2021-10-20T23:25:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 Processor -- start 2021-10-20T23:25:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 -- start start 2021-10-20T23:25:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb268004e70 0x7fb27c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb27c0b23c0 0x7fb27c0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb27c0b1fb0 0x7fb27c13f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c1564c0 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c156760 con 0x7fb27c0b23c0 2021-10-20T23:25:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb281c90700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c143520 con 0x7fb268004e70 2021-10-20T23:25:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb28148f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb27c0b1fb0 0x7fb27c13f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb280c8e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb268004e70 0x7fb27c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb28148f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb27c0b1fb0 0x7fb27c13f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40736/0 (socket says 172.21.15.12:40736) 2021-10-20T23:25:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb280c8e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb268004e70 0x7fb27c155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46490/0 (socket says 172.21.15.12:46490) 2021-10-20T23:25:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb28148f700 1 -- 172.21.15.12:0/3652840806 learned_addr learned my addr 172.21.15.12:0/3652840806 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.590+0000 7fb27bfff700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb27c0b23c0 0x7fb27c0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb28148f700 1 -- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb268004e70 msgr2=0x7fb27c155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb28148f700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb268004e70 0x7fb27c155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb28148f700 1 -- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb27c0b23c0 msgr2=0x7fb27c0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb28148f700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb27c0b23c0 0x7fb27c0b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb28148f700 1 -- 172.21.15.12:0/3652840806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c140e70 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb280c8e700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb268004e70 0x7fb27c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb28148f700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb27c0b1fb0 0x7fb27c13f430 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fb2740017b0 tx=0x7fb274015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb279ffb700 1 -- 172.21.15.12:0/3652840806 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2740074d0 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb279ffb700 1 -- 172.21.15.12:0/3652840806 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb274007630 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c156170 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb279ffb700 1 -- 172.21.15.12:0/3652840806 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb27400ce70 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c1439c0 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c156420 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb279ffb700 1 -- 172.21.15.12:0/3652840806 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb274027070 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb279ffb700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb25c053520 0x7fb25c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.594+0000 7fb279ffb700 1 -- 172.21.15.12:0/3652840806 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fb27406c330 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.598+0000 7fb280c8e700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb25c053520 0x7fb25c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.598+0000 7fb280c8e700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb25c053520 0x7fb25c0559e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fb26c00b000 tx=0x7fb26c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.602+0000 7fb279ffb700 1 -- 172.21.15.12:0/3652840806 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb274043670 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.730+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb27c057350 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.734+0000 7fb279ffb700 1 -- 172.21.15.12:0/3652840806 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+13415 (secure 0 0 0) 0x7fb274046c90 con 0x7fb27c0b1fb0 2021-10-20T23:25:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:38.740 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:25:38.112846+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:25:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.734+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb25c053520 msgr2=0x7fb25c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.734+0000 7fb281c90700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb25c053520 0x7fb25c0559e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fb26c00b000 tx=0x7fb26c006df0).stop 2021-10-20T23:25:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.734+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb27c0b1fb0 msgr2=0x7fb27c13f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.734+0000 7fb281c90700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb27c0b1fb0 0x7fb27c13f430 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fb2740017b0 tx=0x7fb274015000).stop 2021-10-20T23:25:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.738+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 shutdown_connections 2021-10-20T23:25:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.738+0000 7fb281c90700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb25c053520 0x7fb25c0559e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.738+0000 7fb281c90700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb27c0b1fb0 0x7fb27c13f430 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.738+0000 7fb281c90700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb27c0b23c0 0x7fb27c0b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.738+0000 7fb281c90700 1 --2- 172.21.15.12:0/3652840806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb268004e70 0x7fb27c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.738+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 >> 172.21.15.12:0/3652840806 conn(0x7fb27c066de0 msgr2=0x7fb27c05c790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:38.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.738+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 shutdown_connections 2021-10-20T23:25:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.738+0000 7fb281c90700 1 -- 172.21.15.12:0/3652840806 wait complete. 2021-10-20T23:25:38.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:25:38.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:25:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4ffff700 1 Processor -- start 2021-10-20T23:25:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4ffff700 1 -- start start 2021-10-20T23:25:38.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d500b2910 0x7f2d500b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d50140a80 0x7f2d500b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4ffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d50146660 con 0x7f2d500b6380 2021-10-20T23:25:38.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d50061fb0 con 0x7f2d50140a80 2021-10-20T23:25:38.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4ffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d50065520 con 0x7f2d500b2910 2021-10-20T23:25:38.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d50140a80 0x7f2d500b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d50140a80 0x7f2d500b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40744/0 (socket says 172.21.15.12:40744) 2021-10-20T23:25:38.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4f7fe700 1 -- 172.21.15.12:0/2251242226 learned_addr learned my addr 172.21.15.12:0/2251242226 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:38.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4e7fc700 1 --2- 172.21.15.12:0/2251242226 >> v2:172.21.15.31:3300/0 conn(0x7f2d500b2910 0x7f2d500b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4f7fe700 1 -- 172.21.15.12:0/2251242226 >> v2:172.21.15.31:3300/0 conn(0x7f2d500b2910 msgr2=0x7f2d500b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:38.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4f7fe700 1 --2- 172.21.15.12:0/2251242226 >> v2:172.21.15.31:3300/0 conn(0x7f2d500b2910 0x7f2d500b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4f7fe700 1 -- 172.21.15.12:0/2251242226 >> v1:172.21.15.31:6789/0 conn(0x7f2d500b6380 legacy=0x7f2d50140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4f7fe700 1 -- 172.21.15.12:0/2251242226 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50147510 con 0x7f2d50140a80 2021-10-20T23:25:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4f7fe700 1 --2- 172.21.15.12:0/2251242226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d50140a80 0x7f2d500b11c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f2d480032f0 tx=0x7f2d48009290).ready entity=mon.0 client_cookie=9f38546a597d5526 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4dffb700 1 -- 172.21.15.12:0/2251242226 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d4800b870 con 0x7f2d50140a80 2021-10-20T23:25:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4dffb700 1 -- 172.21.15.12:0/2251242226 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4800b9d0 con 0x7f2d50140a80 2021-10-20T23:25:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.866+0000 7f2d4dffb700 1 -- 172.21.15.12:0/2251242226 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d4800bb40 con 0x7f2d50140a80 2021-10-20T23:25:38.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 -- 172.21.15.12:0/2251242226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d50140a80 msgr2=0x7f2d500b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 --2- 172.21.15.12:0/2251242226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d50140a80 0x7f2d500b11c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f2d480032f0 tx=0x7f2d48009290).stop 2021-10-20T23:25:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 -- 172.21.15.12:0/2251242226 shutdown_connections 2021-10-20T23:25:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 --2- 172.21.15.12:0/2251242226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d50140a80 0x7f2d500b11c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 --2- 172.21.15.12:0/2251242226 >> v2:172.21.15.31:3300/0 conn(0x7f2d500b2910 0x7f2d500b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 -- 172.21.15.12:0/2251242226 >> 172.21.15.12:0/2251242226 conn(0x7f2d50063670 msgr2=0x7f2d50063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 -- 172.21.15.12:0/2251242226 shutdown_connections 2021-10-20T23:25:38.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 -- 172.21.15.12:0/2251242226 wait complete. 2021-10-20T23:25:38.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 Processor -- start 2021-10-20T23:25:38.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.870+0000 7f2d4ffff700 1 -- start start 2021-10-20T23:25:38.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d500b2910 0x7f2d500b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d500b6380 0x7f2d50143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d50140a80 0x7f2d50155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500a3e10 con 0x7f2d500b2910 2021-10-20T23:25:38.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500a40b0 con 0x7f2d50140a80 2021-10-20T23:25:38.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500a4350 con 0x7f2d500b6380 2021-10-20T23:25:38.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d500b2910 0x7f2d500b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d500b2910 0x7f2d500b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40746/0 (socket says 172.21.15.12:40746) 2021-10-20T23:25:38.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4effd700 1 -- 172.21.15.12:0/4256660221 learned_addr learned my addr 172.21.15.12:0/4256660221 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:38.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4f7fe700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d50140a80 0x7f2d50155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4e7fc700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d500b6380 0x7f2d50143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4effd700 1 -- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d500b6380 msgr2=0x7f2d50143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4effd700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d500b6380 0x7f2d50143610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4effd700 1 -- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d50140a80 msgr2=0x7f2d50155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:38.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4effd700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d50140a80 0x7f2d50155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:38.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4effd700 1 -- 172.21.15.12:0/4256660221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48009530 con 0x7f2d500b2910 2021-10-20T23:25:38.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4effd700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d500b2910 0x7f2d500b1600 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f2d50063340 tx=0x7f2d40007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:38.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d3ffff700 1 -- 172.21.15.12:0/4256660221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d40012400 con 0x7f2d500b2910 2021-10-20T23:25:38.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d3ffff700 1 -- 172.21.15.12:0/4256660221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d40012560 con 0x7f2d500b2910 2021-10-20T23:25:38.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d500a45f0 con 0x7f2d500b2910 2021-10-20T23:25:38.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d3ffff700 1 -- 172.21.15.12:0/4256660221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d400128c0 con 0x7f2d500b2910 2021-10-20T23:25:38.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d50143b00 con 0x7f2d500b2910 2021-10-20T23:25:38.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d3ffff700 1 -- 172.21.15.12:0/4256660221 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2d40019030 con 0x7f2d500b2910 2021-10-20T23:25:38.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d50146890 con 0x7f2d500b2910 2021-10-20T23:25:38.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.874+0000 7f2d3ffff700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d2c0536a0 0x7f2d2c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:38.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.878+0000 7f2d3ffff700 1 -- 172.21.15.12:0/4256660221 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f2d4006ac70 con 0x7f2d500b2910 2021-10-20T23:25:38.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.878+0000 7f2d4e7fc700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d2c0536a0 0x7f2d2c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:38.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.878+0000 7f2d4e7fc700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d2c0536a0 0x7f2d2c055b60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f2d4400b000 tx=0x7f2d44006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:38.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:38.878+0000 7f2d3ffff700 1 -- 172.21.15.12:0/4256660221 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2d40041e20 con 0x7f2d500b2910 2021-10-20T23:25:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.010+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2d50057350 con 0x7f2d500b2910 2021-10-20T23:25:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.010+0000 7f2d3ffff700 1 -- 172.21.15.12:0/4256660221 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v74) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2d40045440 con 0x7f2d500b2910 2021-10-20T23:25:39.017 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:25:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.010+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d2c0536a0 msgr2=0x7f2d2c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.010+0000 7f2d4ffff700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d2c0536a0 0x7f2d2c055b60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f2d4400b000 tx=0x7f2d44006df0).stop 2021-10-20T23:25:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.010+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d500b2910 msgr2=0x7f2d500b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.010+0000 7f2d4ffff700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d500b2910 0x7f2d500b1600 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f2d50063340 tx=0x7f2d40007c50).stop 2021-10-20T23:25:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.014+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 shutdown_connections 2021-10-20T23:25:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.014+0000 7f2d4ffff700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d2c0536a0 0x7f2d2c055b60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.014+0000 7f2d4ffff700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d50140a80 0x7f2d50155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.014+0000 7f2d4ffff700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d500b6380 0x7f2d50143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.014+0000 7f2d4ffff700 1 --2- 172.21.15.12:0/4256660221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d500b2910 0x7f2d500b1600 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.014+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 >> 172.21.15.12:0/4256660221 conn(0x7f2d50063670 msgr2=0x7f2d5013fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.014+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 shutdown_connections 2021-10-20T23:25:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.014+0000 7f2d4ffff700 1 -- 172.21.15.12:0/4256660221 wait complete. 2021-10-20T23:25:39.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:25:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.130+0000 7f0cfffff700 1 Processor -- start 2021-10-20T23:25:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.130+0000 7f0cfffff700 1 -- start start 2021-10-20T23:25:39.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.130+0000 7f0cfffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d000aac20 0x7f0d000b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.130+0000 7f0cfffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d000b2380 con 0x7f0d000b7370 2021-10-20T23:25:39.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.130+0000 7f0cfffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d00144250 con 0x7f0d000b3060 2021-10-20T23:25:39.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.130+0000 7f0cfffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d000b3570 con 0x7f0d000aac20 2021-10-20T23:25:39.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cff7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d000aac20 0x7f0d000b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfeffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0d000b7370 0x7f0d0013e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39348/0 (socket says 172.21.15.12:39348) 2021-10-20T23:25:39.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfeffd700 1 -- 172.21.15.12:0/2782246688 learned_addr learned my addr 172.21.15.12:0/2782246688 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:39.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cff7fe700 1 -- 172.21.15.12:0/2782246688 >> v1:172.21.15.31:6789/0 conn(0x7f0d000b3060 legacy=0x7f0d00064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cff7fe700 1 -- 172.21.15.12:0/2782246688 >> v1:172.21.15.12:6789/0 conn(0x7f0d000b7370 legacy=0x7f0d0013e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cff7fe700 1 -- 172.21.15.12:0/2782246688 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d000b25b0 con 0x7f0d000aac20 2021-10-20T23:25:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cff7fe700 1 --2- 172.21.15.12:0/2782246688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 0x7f0d000b7750 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f0cf80032f0 tx=0x7f0cf80091d0).ready entity=mon.0 client_cookie=922b2be257f1f873 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfe7fc700 1 -- 172.21.15.12:0/2782246688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf8009ea0 con 0x7f0d000aac20 2021-10-20T23:25:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfe7fc700 1 -- 172.21.15.12:0/2782246688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800b8a0 con 0x7f0d000aac20 2021-10-20T23:25:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfe7fc700 1 -- 172.21.15.12:0/2782246688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf800ba10 con 0x7f0d000aac20 2021-10-20T23:25:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 -- 172.21.15.12:0/2782246688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 msgr2=0x7f0d000b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 --2- 172.21.15.12:0/2782246688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 0x7f0d000b7750 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f0cf80032f0 tx=0x7f0cf80091d0).stop 2021-10-20T23:25:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 -- 172.21.15.12:0/2782246688 shutdown_connections 2021-10-20T23:25:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 --2- 172.21.15.12:0/2782246688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 0x7f0d000b7750 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 -- 172.21.15.12:0/2782246688 >> 172.21.15.12:0/2782246688 conn(0x7f0d0005f6b0 msgr2=0x7f0d0005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 -- 172.21.15.12:0/2782246688 shutdown_connections 2021-10-20T23:25:39.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 -- 172.21.15.12:0/2782246688 wait complete. 2021-10-20T23:25:39.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 Processor -- start 2021-10-20T23:25:39.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 -- start start 2021-10-20T23:25:39.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 0x7f0d000ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d000b3060 0x7f0d000ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d000b7370 0x7f0d0013c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.134+0000 7f0cfffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000abcf0 con 0x7f0d000aac20 2021-10-20T23:25:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000ada20 con 0x7f0d000b3060 2021-10-20T23:25:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000adcc0 con 0x7f0d000b7370 2021-10-20T23:25:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 0x7f0d000ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 0x7f0d000ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40760/0 (socket says 172.21.15.12:40760) 2021-10-20T23:25:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfeffd700 1 -- 172.21.15.12:0/2223819918 learned_addr learned my addr 172.21.15.12:0/2223819918 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cff7fe700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d000b7370 0x7f0d0013c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cf7fff700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d000b3060 0x7f0d000ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfeffd700 1 -- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d000b7370 msgr2=0x7f0d0013c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfeffd700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d000b7370 0x7f0d0013c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfeffd700 1 -- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d000b3060 msgr2=0x7f0d000ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfeffd700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d000b3060 0x7f0d000ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfeffd700 1 -- 172.21.15.12:0/2223819918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8009470 con 0x7f0d000aac20 2021-10-20T23:25:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfeffd700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 0x7f0d000ac170 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f0d00064230 tx=0x7f0cf0007b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfcff9700 1 -- 172.21.15.12:0/2223819918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf00070d0 con 0x7f0d000aac20 2021-10-20T23:25:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d000adf60 con 0x7f0d000aac20 2021-10-20T23:25:39.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfcff9700 1 -- 172.21.15.12:0/2223819918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf0007230 con 0x7f0d000aac20 2021-10-20T23:25:39.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfcff9700 1 -- 172.21.15.12:0/2223819918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf00073a0 con 0x7f0d000aac20 2021-10-20T23:25:39.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d000af0d0 con 0x7f0d000aac20 2021-10-20T23:25:39.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.138+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d00057350 con 0x7f0d000aac20 2021-10-20T23:25:39.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.142+0000 7f0cfcff9700 1 -- 172.21.15.12:0/2223819918 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0cf0010070 con 0x7f0d000aac20 2021-10-20T23:25:39.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.142+0000 7f0cfcff9700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ce4053580 0x7f0ce4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.142+0000 7f0cfcff9700 1 -- 172.21.15.12:0/2223819918 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f0cf006ad70 con 0x7f0d000aac20 2021-10-20T23:25:39.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.142+0000 7f0cf7fff700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ce4053580 0x7f0ce4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.142+0000 7f0cf7fff700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ce4053580 0x7f0ce4055a40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f0ce800d000 tx=0x7f0ce8007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:39.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.150+0000 7f0cfcff9700 1 -- 172.21.15.12:0/2223819918 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0cf0041f20 con 0x7f0d000aac20 2021-10-20T23:25:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.274+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d000601a0 con 0x7f0d000aac20 2021-10-20T23:25:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.274+0000 7f0cfcff9700 1 -- 172.21.15.12:0/2223819918 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0cf0018030 con 0x7f0d000aac20 2021-10-20T23:25:39.281 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ce4053580 msgr2=0x7f0ce4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ce4053580 0x7f0ce4055a40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f0ce800d000 tx=0x7f0ce8007b90).stop 2021-10-20T23:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 msgr2=0x7f0d000ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 0x7f0d000ac170 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f0d00064230 tx=0x7f0cf0007b10).stop 2021-10-20T23:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 shutdown_connections 2021-10-20T23:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ce4053580 0x7f0ce4055a40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d000b7370 0x7f0d0013c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d000b3060 0x7f0d000ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 --2- 172.21.15.12:0/2223819918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d000aac20 0x7f0d000ac170 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 >> 172.21.15.12:0/2223819918 conn(0x7f0d0005f6b0 msgr2=0x7f0d0013db10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 shutdown_connections 2021-10-20T23:25:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.278+0000 7f0cfffff700 1 -- 172.21.15.12:0/2223819918 wait complete. 2021-10-20T23:25:39.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:25:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.394+0000 7fb12e2a7700 1 Processor -- start 2021-10-20T23:25:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.394+0000 7fb12e2a7700 1 -- start start 2021-10-20T23:25:39.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1280af2c0 0x7fb1280af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1280ad320 0x7fb128143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1280afda0 con 0x7fb128143640 2021-10-20T23:25:39.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12805c610 con 0x7fb1280ad320 2021-10-20T23:25:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb128140800 con 0x7fb1280af2c0 2021-10-20T23:25:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12caa4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1280ad320 0x7fb128143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12daa6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb128143640 0x7fb1280a8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39366/0 (socket says 172.21.15.12:39366) 2021-10-20T23:25:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12daa6700 1 -- 172.21.15.12:0/2713387703 learned_addr learned my addr 172.21.15.12:0/2713387703 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12caa4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1280ad320 0x7fb128143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40770/0 (socket says 172.21.15.12:40770) 2021-10-20T23:25:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12d2a5700 1 --2- 172.21.15.12:0/2713387703 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1280af2c0 0x7fb1280af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb117fff700 1 -- 172.21.15.12:0/2713387703 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855950334 0 0) 0x7fb1280afda0 con 0x7fb128143640 2021-10-20T23:25:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12caa4700 1 -- 172.21.15.12:0/2713387703 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1280af2c0 msgr2=0x7fb1280af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:39.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12caa4700 1 --2- 172.21.15.12:0/2713387703 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1280af2c0 0x7fb1280af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12caa4700 1 -- 172.21.15.12:0/2713387703 >> v1:172.21.15.12:6789/0 conn(0x7fb128143640 legacy=0x7fb1280a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12caa4700 1 -- 172.21.15.12:0/2713387703 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280a93c0 con 0x7fb1280ad320 2021-10-20T23:25:39.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12caa4700 1 --2- 172.21.15.12:0/2713387703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280ad320 0x7fb128143150 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fb12813fc30 tx=0x7fb118006df0).ready entity=mon.0 client_cookie=9caa54e5f2b0a8ba server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:39.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb117fff700 1 -- 172.21.15.12:0/2713387703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb118014070 con 0x7fb1280ad320 2021-10-20T23:25:39.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb117fff700 1 -- 172.21.15.12:0/2713387703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb118000e90 con 0x7fb1280ad320 2021-10-20T23:25:39.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb117fff700 1 -- 172.21.15.12:0/2713387703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11800fb60 con 0x7fb1280ad320 2021-10-20T23:25:39.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2713387703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280ad320 msgr2=0x7fb128143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 --2- 172.21.15.12:0/2713387703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280ad320 0x7fb128143150 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fb12813fc30 tx=0x7fb118006df0).stop 2021-10-20T23:25:39.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2713387703 shutdown_connections 2021-10-20T23:25:39.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 --2- 172.21.15.12:0/2713387703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280ad320 0x7fb128143150 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 --2- 172.21.15.12:0/2713387703 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1280af2c0 0x7fb1280af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2713387703 >> 172.21.15.12:0/2713387703 conn(0x7fb128061140 msgr2=0x7fb128062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:39.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2713387703 shutdown_connections 2021-10-20T23:25:39.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.398+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2713387703 wait complete. 2021-10-20T23:25:39.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 Processor -- start 2021-10-20T23:25:39.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 -- start start 2021-10-20T23:25:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1280ad320 0x7fb128152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280af2c0 0x7fb128148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb128143640 0x7fb128155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128155880 con 0x7fb1280af2c0 2021-10-20T23:25:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1281429f0 con 0x7fb1280ad320 2021-10-20T23:25:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1281481d0 con 0x7fb128143640 2021-10-20T23:25:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12caa4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280af2c0 0x7fb128148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12caa4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280af2c0 0x7fb128148c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40776/0 (socket says 172.21.15.12:40776) 2021-10-20T23:25:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12caa4700 1 -- 172.21.15.12:0/2355188666 learned_addr learned my addr 172.21.15.12:0/2355188666 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:39.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12d2a5700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1280ad320 0x7fb128152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12daa6700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb128143640 0x7fb128155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12caa4700 1 -- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb128143640 msgr2=0x7fb128155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12caa4700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb128143640 0x7fb128155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12caa4700 1 -- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1280ad320 msgr2=0x7fb128152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12caa4700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1280ad320 0x7fb128152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12caa4700 1 -- 172.21.15.12:0/2355188666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11800b180 con 0x7fb1280af2c0 2021-10-20T23:25:39.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12caa4700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280af2c0 0x7fb128148c00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fb12813fc30 tx=0x7fb118016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:39.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb1167fc700 1 -- 172.21.15.12:0/2355188666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb118010c00 con 0x7fb1280af2c0 2021-10-20T23:25:39.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb1167fc700 1 -- 172.21.15.12:0/2355188666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb118010d60 con 0x7fb1280af2c0 2021-10-20T23:25:39.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb128142c90 con 0x7fb1280af2c0 2021-10-20T23:25:39.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb1167fc700 1 -- 172.21.15.12:0/2355188666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11801c630 con 0x7fb1280af2c0 2021-10-20T23:25:39.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.402+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb128147c10 con 0x7fb1280af2c0 2021-10-20T23:25:39.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.406+0000 7fb1167fc700 1 -- 172.21.15.12:0/2355188666 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb118022020 con 0x7fb1280af2c0 2021-10-20T23:25:39.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.406+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb128057350 con 0x7fb1280af2c0 2021-10-20T23:25:39.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.406+0000 7fb1167fc700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb108053610 0x7fb108055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.406+0000 7fb1167fc700 1 -- 172.21.15.12:0/2355188666 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fb11806d260 con 0x7fb1280af2c0 2021-10-20T23:25:39.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.406+0000 7fb12d2a5700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb108053610 0x7fb108055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.406+0000 7fb12d2a5700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb108053610 0x7fb108055ad0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fb12400b000 tx=0x7fb124006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:39.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.414+0000 7fb1167fc700 1 -- 172.21.15.12:0/2355188666 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb118044650 con 0x7fb1280af2c0 2021-10-20T23:25:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb128061990 con 0x7fb1280af2c0 2021-10-20T23:25:39.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb1167fc700 1 -- 172.21.15.12:0/2355188666 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb118047c70 con 0x7fb1280af2c0 2021-10-20T23:25:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:39.544 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:25:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:25:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:25:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:25:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:25:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:25:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:25:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:25:39.546 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:25:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb108053610 msgr2=0x7fb108055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb108053610 0x7fb108055ad0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fb12400b000 tx=0x7fb124006df0).stop 2021-10-20T23:25:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280af2c0 msgr2=0x7fb128148c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280af2c0 0x7fb128148c00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fb12813fc30 tx=0x7fb118016000).stop 2021-10-20T23:25:39.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 shutdown_connections 2021-10-20T23:25:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb108053610 0x7fb108055ad0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb128143640 0x7fb128155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1280af2c0 0x7fb128148c00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 --2- 172.21.15.12:0/2355188666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1280ad320 0x7fb128152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.538+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 >> 172.21.15.12:0/2355188666 conn(0x7fb128061140 msgr2=0x7fb12813db10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.542+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 shutdown_connections 2021-10-20T23:25:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.542+0000 7fb12e2a7700 1 -- 172.21.15.12:0/2355188666 wait complete. 2021-10-20T23:25:39.557 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:25:39.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:25:39.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 Processor -- start 2021-10-20T23:25:39.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 -- start start 2021-10-20T23:25:39.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21e414ab80 0x7f21e405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f21e40ac9b0 0x7f21e414af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e4061360 con 0x7f21e40aff10 2021-10-20T23:25:39.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e414b5e0 con 0x7f21e414ab80 2021-10-20T23:25:39.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e414b880 con 0x7f21e40ac9b0 2021-10-20T23:25:39.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21e414ab80 0x7f21e405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21e414ab80 0x7f21e405f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40782/0 (socket says 172.21.15.12:40782) 2021-10-20T23:25:39.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e2ffd700 1 -- 172.21.15.12:0/3341123511 learned_addr learned my addr 172.21.15.12:0/3341123511 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:39.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e37fe700 1 --2- 172.21.15.12:0/3341123511 >> v2:172.21.15.31:3300/0 conn(0x7f21e40ac9b0 0x7f21e414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e2ffd700 1 -- 172.21.15.12:0/3341123511 >> v2:172.21.15.31:3300/0 conn(0x7f21e40ac9b0 msgr2=0x7f21e414af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:39.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/3341123511 >> v2:172.21.15.31:3300/0 conn(0x7f21e40ac9b0 0x7f21e414af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e2ffd700 1 -- 172.21.15.12:0/3341123511 >> v1:172.21.15.31:6789/0 conn(0x7f21e40aff10 legacy=0x7f21e40af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e2ffd700 1 -- 172.21.15.12:0/3341123511 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e40aed20 con 0x7f21e414ab80 2021-10-20T23:25:39.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/3341123511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e414ab80 0x7f21e405f6b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f21cc002f70 tx=0x7f21cc006eb0).ready entity=mon.0 client_cookie=61b44bd080eb483c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:39.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e1ffb700 1 -- 172.21.15.12:0/3341123511 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21cc00d5c0 con 0x7f21e414ab80 2021-10-20T23:25:39.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e1ffb700 1 -- 172.21.15.12:0/3341123511 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc000e90 con 0x7f21e414ab80 2021-10-20T23:25:39.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e1ffb700 1 -- 172.21.15.12:0/3341123511 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21cc00d950 con 0x7f21e414ab80 2021-10-20T23:25:39.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 -- 172.21.15.12:0/3341123511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e414ab80 msgr2=0x7f21e405f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 --2- 172.21.15.12:0/3341123511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e414ab80 0x7f21e405f6b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f21cc002f70 tx=0x7f21cc006eb0).stop 2021-10-20T23:25:39.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 -- 172.21.15.12:0/3341123511 shutdown_connections 2021-10-20T23:25:39.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 --2- 172.21.15.12:0/3341123511 >> v2:172.21.15.31:3300/0 conn(0x7f21e40ac9b0 0x7f21e414af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 --2- 172.21.15.12:0/3341123511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e414ab80 0x7f21e405f6b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 -- 172.21.15.12:0/3341123511 >> 172.21.15.12:0/3341123511 conn(0x7f21e40b5570 msgr2=0x7f21e40b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:39.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 -- 172.21.15.12:0/3341123511 shutdown_connections 2021-10-20T23:25:39.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.662+0000 7f21e95af700 1 -- 172.21.15.12:0/3341123511 wait complete. 2021-10-20T23:25:39.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 Processor -- start 2021-10-20T23:25:39.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 -- start start 2021-10-20T23:25:39.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21e40ac9b0 0x7f21e4147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e40aff10 0x7f21e4143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21e414ab80 0x7f21e40b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4144ae0 con 0x7f21e40aff10 2021-10-20T23:25:39.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40ad030 con 0x7f21e414ab80 2021-10-20T23:25:39.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4141e10 con 0x7f21e40ac9b0 2021-10-20T23:25:39.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e40aff10 0x7f21e4143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e40aff10 0x7f21e4143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40790/0 (socket says 172.21.15.12:40790) 2021-10-20T23:25:39.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e27fc700 1 -- 172.21.15.12:0/4247106470 learned_addr learned my addr 172.21.15.12:0/4247106470 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:39.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e37fe700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21e414ab80 0x7f21e40b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21e40ac9b0 0x7f21e4147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e27fc700 1 -- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21e40ac9b0 msgr2=0x7f21e4147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e27fc700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21e40ac9b0 0x7f21e4147da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e27fc700 1 -- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21e414ab80 msgr2=0x7f21e40b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e27fc700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21e414ab80 0x7f21e40b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e27fc700 1 -- 172.21.15.12:0/4247106470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc00b1e0 con 0x7f21e40aff10 2021-10-20T23:25:39.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e27fc700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e40aff10 0x7f21e4143360 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f21e4062060 tx=0x7f21d4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:39.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21dbfff700 1 -- 172.21.15.12:0/4247106470 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d4012400 con 0x7f21e40aff10 2021-10-20T23:25:39.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21dbfff700 1 -- 172.21.15.12:0/4247106470 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4012560 con 0x7f21e40aff10 2021-10-20T23:25:39.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e4141bb0 con 0x7f21e40aff10 2021-10-20T23:25:39.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21dbfff700 1 -- 172.21.15.12:0/4247106470 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d40128c0 con 0x7f21e40aff10 2021-10-20T23:25:39.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.666+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e40b4570 con 0x7f21e40aff10 2021-10-20T23:25:39.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.670+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e4146f50 con 0x7f21e40aff10 2021-10-20T23:25:39.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.670+0000 7f21dbfff700 1 -- 172.21.15.12:0/4247106470 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f21d4019030 con 0x7f21e40aff10 2021-10-20T23:25:39.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.670+0000 7f21dbfff700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21c8053580 0x7f21c8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:39.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.670+0000 7f21dbfff700 1 -- 172.21.15.12:0/4247106470 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f21d406ab20 con 0x7f21e40aff10 2021-10-20T23:25:39.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.670+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21c8053580 0x7f21c8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:39.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.670+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21c8053580 0x7f21c8055a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f21cc01c000 tx=0x7f21cc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:39.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.674+0000 7f21dbfff700 1 -- 172.21.15.12:0/4247106470 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f21d4041d80 con 0x7f21e40aff10 2021-10-20T23:25:39.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.802+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f21e40af8d0 con 0x7f21e40aff10 2021-10-20T23:25:39.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.918+0000 7f21dbfff700 1 -- 172.21.15.12:0/4247106470 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v75) v1 ==== 133+0+0 (secure 0 0 0) 0x7f21d40453a0 con 0x7f21e40aff10 2021-10-20T23:25:39.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21c8053580 msgr2=0x7f21c8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21c8053580 0x7f21c8055a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f21cc01c000 tx=0x7f21cc015000).stop 2021-10-20T23:25:39.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e40aff10 msgr2=0x7f21e4143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:39.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e40aff10 0x7f21e4143360 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f21e4062060 tx=0x7f21d4007c50).stop 2021-10-20T23:25:39.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 shutdown_connections 2021-10-20T23:25:39.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21c8053580 0x7f21c8055a40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21e414ab80 0x7f21e40b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e40aff10 0x7f21e4143360 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 --2- 172.21.15.12:0/4247106470 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21e40ac9b0 0x7f21e4147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 >> 172.21.15.12:0/4247106470 conn(0x7f21e40b5570 msgr2=0x7f21e413c780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.922+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 shutdown_connections 2021-10-20T23:25:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:39.926+0000 7f21e95af700 1 -- 172.21.15.12:0/4247106470 wait complete. 2021-10-20T23:25:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:25:39.946 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:25:40.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.050+0000 7f5cb1f69700 1 Processor -- start 2021-10-20T23:25:40.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.050+0000 7f5cb1f69700 1 -- start start 2021-10-20T23:25:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.050+0000 7f5cb1f69700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5cac0b4180 0x7f5cac140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:40.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.050+0000 7f5cb1f69700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4690 0x7f5cac0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:40.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.050+0000 7f5cb1f69700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac143b60 con 0x7f5cac146950 2021-10-20T23:25:40.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.050+0000 7f5cb1f69700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac147510 con 0x7f5cac0b4180 2021-10-20T23:25:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.050+0000 7f5cb1f69700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac143e00 con 0x7f5cac0b4690 2021-10-20T23:25:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cab7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5cac146950 0x7f5cac140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39390/0 (socket says 172.21.15.12:39390) 2021-10-20T23:25:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cab7fe700 1 -- 172.21.15.12:0/286152955 learned_addr learned my addr 172.21.15.12:0/286152955 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5caaffd700 1 --2- 172.21.15.12:0/286152955 >> v2:172.21.15.31:3300/0 conn(0x7f5cac0b4180 0x7f5cac140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cabfff700 1 --2- 172.21.15.12:0/286152955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4690 0x7f5cac0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5caaffd700 1 -- 172.21.15.12:0/286152955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4690 msgr2=0x7f5cac0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5caaffd700 1 --2- 172.21.15.12:0/286152955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4690 0x7f5cac0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5caaffd700 1 -- 172.21.15.12:0/286152955 >> v1:172.21.15.12:6789/0 conn(0x7f5cac146950 legacy=0x7f5cac140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5caaffd700 1 -- 172.21.15.12:0/286152955 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0b0c90 con 0x7f5cac0b4180 2021-10-20T23:25:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5caaffd700 1 --2- 172.21.15.12:0/286152955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4180 0x7f5cac140940 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5c9c002f70 tx=0x7f5c9c006df0).ready entity=mon.1 client_cookie=198cff0309409bba server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5caa7fc700 1 -- 172.21.15.12:0/286152955 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9c00d570 con 0x7f5cac0b4180 2021-10-20T23:25:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5caa7fc700 1 -- 172.21.15.12:0/286152955 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c000e90 con 0x7f5cac0b4180 2021-10-20T23:25:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5caa7fc700 1 -- 172.21.15.12:0/286152955 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9c00d8c0 con 0x7f5cac0b4180 2021-10-20T23:25:40.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cb1f69700 1 -- 172.21.15.12:0/286152955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4180 msgr2=0x7f5cac140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:40.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cb1f69700 1 --2- 172.21.15.12:0/286152955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4180 0x7f5cac140940 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5c9c002f70 tx=0x7f5c9c006df0).stop 2021-10-20T23:25:40.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cb1f69700 1 -- 172.21.15.12:0/286152955 shutdown_connections 2021-10-20T23:25:40.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cb1f69700 1 --2- 172.21.15.12:0/286152955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4690 0x7f5cac0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:40.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cb1f69700 1 --2- 172.21.15.12:0/286152955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4180 0x7f5cac140940 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:40.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cb1f69700 1 -- 172.21.15.12:0/286152955 >> 172.21.15.12:0/286152955 conn(0x7f5cac05c490 msgr2=0x7f5cac05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:40.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cb1f69700 1 -- 172.21.15.12:0/286152955 shutdown_connections 2021-10-20T23:25:40.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.054+0000 7f5cb1f69700 1 -- 172.21.15.12:0/286152955 wait complete. 2021-10-20T23:25:40.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 Processor -- start 2021-10-20T23:25:40.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 -- start start 2021-10-20T23:25:40.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4180 0x7f5cac0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:40.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4690 0x7f5cac1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:40.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cac146950 0x7f5cac152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:40.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0b5ac0 con 0x7f5cac146950 2021-10-20T23:25:40.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac155a00 con 0x7f5cac0b4690 2021-10-20T23:25:40.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac155ca0 con 0x7f5cac0b4180 2021-10-20T23:25:40.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cac146950 0x7f5cac152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:40.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cac146950 0x7f5cac152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40806/0 (socket says 172.21.15.12:40806) 2021-10-20T23:25:40.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cabfff700 1 -- 172.21.15.12:0/9084978 learned_addr learned my addr 172.21.15.12:0/9084978 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:40.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5caaffd700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4690 0x7f5cac1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:40.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cab7fe700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4180 0x7f5cac0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:40.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cabfff700 1 -- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4180 msgr2=0x7f5cac0adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:40.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cabfff700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4180 0x7f5cac0adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:40.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cabfff700 1 -- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4690 msgr2=0x7f5cac1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:40.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cabfff700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4690 0x7f5cac1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:40.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cabfff700 1 -- 172.21.15.12:0/9084978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c00b180 con 0x7f5cac146950 2021-10-20T23:25:40.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5caaffd700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4690 0x7f5cac1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:40.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cabfff700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cac146950 0x7f5cac152320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f5ca400a000 tx=0x7f5ca4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5ca8ff9700 1 -- 172.21.15.12:0/9084978 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca4013620 con 0x7f5cac146950 2021-10-20T23:25:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5ca8ff9700 1 -- 172.21.15.12:0/9084978 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca4013780 con 0x7f5cac146950 2021-10-20T23:25:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac155f40 con 0x7f5cac146950 2021-10-20T23:25:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5ca8ff9700 1 -- 172.21.15.12:0/9084978 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca4013ae0 con 0x7f5cac146950 2021-10-20T23:25:40.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.058+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac152810 con 0x7f5cac146950 2021-10-20T23:25:40.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.062+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac1560d0 con 0x7f5cac146950 2021-10-20T23:25:40.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.062+0000 7f5ca8ff9700 1 -- 172.21.15.12:0/9084978 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ca4013c40 con 0x7f5cac146950 2021-10-20T23:25:40.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.062+0000 7f5ca8ff9700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c90053610 0x7f5c90055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:40.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.062+0000 7f5ca8ff9700 1 -- 172.21.15.12:0/9084978 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f5ca406c910 con 0x7f5cac146950 2021-10-20T23:25:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.062+0000 7f5cab7fe700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c90053610 0x7f5c90055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.062+0000 7f5cab7fe700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c90053610 0x7f5c90055ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f5c9400b000 tx=0x7f5c94009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:40.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.066+0000 7f5ca8ff9700 1 -- 172.21.15.12:0/9084978 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ca4043a80 con 0x7f5cac146950 2021-10-20T23:25:40.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.190+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f5cac057350 con 0x7f5cac146950 2021-10-20T23:25:40.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.930+0000 7f5ca8ff9700 1 -- 172.21.15.12:0/9084978 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v76) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5ca40470a0 con 0x7f5cac146950 2021-10-20T23:25:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.938+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c90053610 msgr2=0x7f5c90055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.938+0000 7f5cb1f69700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c90053610 0x7f5c90055ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f5c9400b000 tx=0x7f5c94009040).stop 2021-10-20T23:25:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.938+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cac146950 msgr2=0x7f5cac152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.938+0000 7f5cb1f69700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cac146950 0x7f5cac152320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f5ca400a000 tx=0x7f5ca4008040).stop 2021-10-20T23:25:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.942+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 shutdown_connections 2021-10-20T23:25:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.942+0000 7f5cb1f69700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c90053610 0x7f5c90055ad0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.942+0000 7f5cb1f69700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cac146950 0x7f5cac152320 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.942+0000 7f5cb1f69700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cac0b4690 0x7f5cac1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.942+0000 7f5cb1f69700 1 --2- 172.21.15.12:0/9084978 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cac0b4180 0x7f5cac0adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.942+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 >> 172.21.15.12:0/9084978 conn(0x7f5cac05c490 msgr2=0x7f5cac0b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.942+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 shutdown_connections 2021-10-20T23:25:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:40.942+0000 7f5cb1f69700 1 -- 172.21.15.12:0/9084978 wait complete. 2021-10-20T23:25:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:25:40.963 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:25:41.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf44ac7700 1 Processor -- start 2021-10-20T23:25:41.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf44ac7700 1 -- start start 2021-10-20T23:25:41.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf44ac7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf400b2580 0x7faf4014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf44ac7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faf400a8ac0 0x7faf4014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf44ac7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf400a70c0 con 0x7faf400b0010 2021-10-20T23:25:41.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf44ac7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400a72f0 con 0x7faf400a8ac0 2021-10-20T23:25:41.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf44ac7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400a7590 con 0x7faf400b2580 2021-10-20T23:25:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faf400a8ac0 0x7faf4014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3effd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faf400b0010 0x7faf400a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39404/0 (socket says 172.21.15.12:39404) 2021-10-20T23:25:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3effd700 1 -- 172.21.15.12:0/4072944638 learned_addr learned my addr 172.21.15.12:0/4072944638 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3f7fe700 1 --2- 172.21.15.12:0/4072944638 >> v2:172.21.15.31:3300/0 conn(0x7faf400b2580 0x7faf4014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3ffff700 1 -- 172.21.15.12:0/4072944638 >> v2:172.21.15.31:3300/0 conn(0x7faf400b2580 msgr2=0x7faf4014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3ffff700 1 --2- 172.21.15.12:0/4072944638 >> v2:172.21.15.31:3300/0 conn(0x7faf400b2580 0x7faf4014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3ffff700 1 -- 172.21.15.12:0/4072944638 >> v1:172.21.15.12:6789/0 conn(0x7faf400b0010 legacy=0x7faf400a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3e7fc700 1 -- 172.21.15.12:0/4072944638 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698257344 0 0) 0x7faf400a70c0 con 0x7faf400b0010 2021-10-20T23:25:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3ffff700 1 -- 172.21.15.12:0/4072944638 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf400a7830 con 0x7faf400a8ac0 2021-10-20T23:25:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.070+0000 7faf3f7fe700 1 --2- 172.21.15.12:0/4072944638 >> v2:172.21.15.31:3300/0 conn(0x7faf400b2580 0x7faf4014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf3ffff700 1 --2- 172.21.15.12:0/4072944638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400a8ac0 0x7faf4014b330 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7faf38002f70 tx=0x7faf38006df0).ready entity=mon.0 client_cookie=19204de2cb3456f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf3e7fc700 1 -- 172.21.15.12:0/4072944638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3800d5c0 con 0x7faf400a8ac0 2021-10-20T23:25:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf3e7fc700 1 -- 172.21.15.12:0/4072944638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38000e90 con 0x7faf400a8ac0 2021-10-20T23:25:41.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf3e7fc700 1 -- 172.21.15.12:0/4072944638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3800d910 con 0x7faf400a8ac0 2021-10-20T23:25:41.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 -- 172.21.15.12:0/4072944638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400a8ac0 msgr2=0x7faf4014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 --2- 172.21.15.12:0/4072944638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400a8ac0 0x7faf4014b330 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7faf38002f70 tx=0x7faf38006df0).stop 2021-10-20T23:25:41.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 -- 172.21.15.12:0/4072944638 shutdown_connections 2021-10-20T23:25:41.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 --2- 172.21.15.12:0/4072944638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400a8ac0 0x7faf4014b330 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 --2- 172.21.15.12:0/4072944638 >> v2:172.21.15.31:3300/0 conn(0x7faf400b2580 0x7faf4014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 -- 172.21.15.12:0/4072944638 >> 172.21.15.12:0/4072944638 conn(0x7faf40060180 msgr2=0x7faf400b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:41.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 -- 172.21.15.12:0/4072944638 shutdown_connections 2021-10-20T23:25:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 -- 172.21.15.12:0/4072944638 wait complete. 2021-10-20T23:25:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 Processor -- start 2021-10-20T23:25:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 -- start start 2021-10-20T23:25:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf400a8ac0 0x7faf4014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400b0010 0x7faf40159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf400b2580 0x7faf4015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf400ab510 con 0x7faf400b0010 2021-10-20T23:25:41.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf400aa470 con 0x7faf400b2580 2021-10-20T23:25:41.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.074+0000 7faf44ac7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf400aa710 con 0x7faf400a8ac0 2021-10-20T23:25:41.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400b0010 0x7faf40159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400b0010 0x7faf40159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40816/0 (socket says 172.21.15.12:40816) 2021-10-20T23:25:41.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3effd700 1 -- 172.21.15.12:0/979470917 learned_addr learned my addr 172.21.15.12:0/979470917 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:41.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3ffff700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf400b2580 0x7faf4015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3f7fe700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf400a8ac0 0x7faf4014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3effd700 1 -- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf400a8ac0 msgr2=0x7faf4014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3effd700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf400a8ac0 0x7faf4014bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3effd700 1 -- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf400b2580 msgr2=0x7faf4015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3effd700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf400b2580 0x7faf4015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3effd700 1 -- 172.21.15.12:0/979470917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3800b180 con 0x7faf400b0010 2021-10-20T23:25:41.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3effd700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400b0010 0x7faf40159cb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7faf30001250 tx=0x7faf30007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3cff9700 1 -- 172.21.15.12:0/979470917 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf30005c70 con 0x7faf400b0010 2021-10-20T23:25:41.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3cff9700 1 -- 172.21.15.12:0/979470917 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30005dd0 con 0x7faf400b0010 2021-10-20T23:25:41.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4015a690 con 0x7faf400b0010 2021-10-20T23:25:41.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf3cff9700 1 -- 172.21.15.12:0/979470917 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf300072c0 con 0x7faf400b0010 2021-10-20T23:25:41.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4014c6b0 con 0x7faf400b0010 2021-10-20T23:25:41.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.078+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf40057350 con 0x7faf400b0010 2021-10-20T23:25:41.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.082+0000 7faf3cff9700 1 -- 172.21.15.12:0/979470917 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf30010070 con 0x7faf400b0010 2021-10-20T23:25:41.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.082+0000 7faf3cff9700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faf200536d0 0x7faf20055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.082+0000 7faf3cff9700 1 -- 172.21.15.12:0/979470917 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6304+0+0 (secure 0 0 0) 0x7faf3006b7a0 con 0x7faf400b0010 2021-10-20T23:25:41.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.082+0000 7faf3f7fe700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faf200536d0 0x7faf20055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.082+0000 7faf3f7fe700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faf200536d0 0x7faf20055b90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7faf3400c000 tx=0x7faf34008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.086+0000 7faf3cff9700 1 -- 172.21.15.12:0/979470917 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf30042710 con 0x7faf400b0010 2021-10-20T23:25:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.258+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7faf400aaa90 con 0x7faf400b0010 2021-10-20T23:25:41.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.266+0000 7faf3cff9700 1 -- 172.21.15.12:0/979470917 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v36) v1 ==== 189+0+0 (secure 0 0 0) 0x7faf30018070 con 0x7faf400b0010 2021-10-20T23:25:41.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faf200536d0 msgr2=0x7faf20055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faf200536d0 0x7faf20055b90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7faf3400c000 tx=0x7faf34008040).stop 2021-10-20T23:25:41.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400b0010 msgr2=0x7faf40159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400b0010 0x7faf40159cb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7faf30001250 tx=0x7faf30007de0).stop 2021-10-20T23:25:41.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 shutdown_connections 2021-10-20T23:25:41.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faf200536d0 0x7faf20055b90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf400b2580 0x7faf4015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf400b0010 0x7faf40159cb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 --2- 172.21.15.12:0/979470917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf400a8ac0 0x7faf4014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 >> 172.21.15.12:0/979470917 conn(0x7faf40060180 msgr2=0x7faf40067250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:41.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 shutdown_connections 2021-10-20T23:25:41.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.270+0000 7faf44ac7700 1 -- 172.21.15.12:0/979470917 wait complete. 2021-10-20T23:25:41.279 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 13 and data pool 14 2021-10-20T23:25:41.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:25:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d2b018700 1 Processor -- start 2021-10-20T23:25:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d2b018700 1 -- start start 2021-10-20T23:25:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d2b018700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d240b1a30 0x7f2d240669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d2b018700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d24140cb0 0x7f2d2413e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d2b018700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2405f750 con 0x7f2d240665f0 2021-10-20T23:25:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d2b018700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d240b14a0 con 0x7f2d240b1a30 2021-10-20T23:25:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d2b018700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2405f980 con 0x7f2d24140cb0 2021-10-20T23:25:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d29815700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d240b1a30 0x7f2d240669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d29815700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d240b1a30 0x7f2d240669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40828/0 (socket says 172.21.15.12:40828) 2021-10-20T23:25:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d29815700 1 -- 172.21.15.12:0/95168217 learned_addr learned my addr 172.21.15.12:0/95168217 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.382+0000 7f2d2a817700 1 --2- 172.21.15.12:0/95168217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d24140cb0 0x7f2d2413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d29815700 1 -- 172.21.15.12:0/95168217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d24140cb0 msgr2=0x7f2d2413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d29815700 1 --2- 172.21.15.12:0/95168217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d24140cb0 0x7f2d2413e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d29815700 1 -- 172.21.15.12:0/95168217 >> v1:172.21.15.31:6789/0 conn(0x7f2d240665f0 legacy=0x7f2d2405fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d29815700 1 -- 172.21.15.12:0/95168217 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240b1740 con 0x7f2d240b1a30 2021-10-20T23:25:41.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d29014700 1 -- 172.21.15.12:0/95168217 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506565552 0 0) 0x7f2d2405f750 con 0x7f2d240665f0 2021-10-20T23:25:41.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2a817700 1 --2- 172.21.15.12:0/95168217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d24140cb0 0x7f2d2413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:41.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d29815700 1 --2- 172.21.15.12:0/95168217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d240b1a30 0x7f2d240669d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f2d18002f70 tx=0x7f2d18006eb0).ready entity=mon.0 client_cookie=b227a8384a8e4dc4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d29014700 1 -- 172.21.15.12:0/95168217 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d1800d5c0 con 0x7f2d240b1a30 2021-10-20T23:25:41.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d29014700 1 -- 172.21.15.12:0/95168217 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d18000e90 con 0x7f2d240b1a30 2021-10-20T23:25:41.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d29014700 1 -- 172.21.15.12:0/95168217 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d1800d910 con 0x7f2d240b1a30 2021-10-20T23:25:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 -- 172.21.15.12:0/95168217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d240b1a30 msgr2=0x7f2d240669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 --2- 172.21.15.12:0/95168217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d240b1a30 0x7f2d240669d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f2d18002f70 tx=0x7f2d18006eb0).stop 2021-10-20T23:25:41.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 -- 172.21.15.12:0/95168217 shutdown_connections 2021-10-20T23:25:41.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 --2- 172.21.15.12:0/95168217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d24140cb0 0x7f2d2413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 --2- 172.21.15.12:0/95168217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d240b1a30 0x7f2d240669d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 -- 172.21.15.12:0/95168217 >> 172.21.15.12:0/95168217 conn(0x7f2d240636e0 msgr2=0x7f2d24063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:41.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 -- 172.21.15.12:0/95168217 shutdown_connections 2021-10-20T23:25:41.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 -- 172.21.15.12:0/95168217 wait complete. 2021-10-20T23:25:41.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 Processor -- start 2021-10-20T23:25:41.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.386+0000 7f2d2b018700 1 -- start start 2021-10-20T23:25:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2b018700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d240665f0 0x7f2d241478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2b018700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d240b1a30 0x7f2d24155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2b018700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24140cb0 0x7f2d24155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2b018700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240afea0 con 0x7f2d24140cb0 2021-10-20T23:25:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2b018700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d24155f10 con 0x7f2d240b1a30 2021-10-20T23:25:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2b018700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240662e0 con 0x7f2d240665f0 2021-10-20T23:25:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a817700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24140cb0 0x7f2d24155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a817700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24140cb0 0x7f2d24155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40836/0 (socket says 172.21.15.12:40836) 2021-10-20T23:25:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a016700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d240665f0 0x7f2d241478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a817700 1 -- 172.21.15.12:0/1133365862 learned_addr learned my addr 172.21.15.12:0/1133365862 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d29815700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d240b1a30 0x7f2d24155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a817700 1 -- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d240665f0 msgr2=0x7f2d241478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a817700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d240665f0 0x7f2d241478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a817700 1 -- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d240b1a30 msgr2=0x7f2d24155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a817700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d240b1a30 0x7f2d24155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a817700 1 -- 172.21.15.12:0/1133365862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1800b1e0 con 0x7f2d24140cb0 2021-10-20T23:25:41.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2a817700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24140cb0 0x7f2d24155a20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f2d14006940 tx=0x7f2d14008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d237fe700 1 -- 172.21.15.12:0/1133365862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d14011590 con 0x7f2d24140cb0 2021-10-20T23:25:41.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d237fe700 1 -- 172.21.15.12:0/1133365862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d140116f0 con 0x7f2d24140cb0 2021-10-20T23:25:41.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d24064c30 con 0x7f2d24140cb0 2021-10-20T23:25:41.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d237fe700 1 -- 172.21.15.12:0/1133365862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d14011a50 con 0x7f2d24140cb0 2021-10-20T23:25:41.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d240af2c0 con 0x7f2d24140cb0 2021-10-20T23:25:41.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.390+0000 7f2d237fe700 1 -- 172.21.15.12:0/1133365862 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2d14011bb0 con 0x7f2d24140cb0 2021-10-20T23:25:41.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.394+0000 7f2d237fe700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d04053640 0x7f2d04055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.394+0000 7f2d237fe700 1 -- 172.21.15.12:0/1133365862 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2d1406bd50 con 0x7f2d24140cb0 2021-10-20T23:25:41.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.394+0000 7f2d2a016700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d04053640 0x7f2d04055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.394+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d240b1120 con 0x7f2d24140cb0 2021-10-20T23:25:41.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.394+0000 7f2d2a016700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d04053640 0x7f2d04055b00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f2d1c00d000 tx=0x7f2d1c007d50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.398+0000 7f2d237fe700 1 -- 172.21.15.12:0/1133365862 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2d14042d50 con 0x7f2d24140cb0 2021-10-20T23:25:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.530+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d24057350 con 0x7f2d24140cb0 2021-10-20T23:25:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d237fe700 1 -- 172.21.15.12:0/1133365862 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f2d14046370 con 0x7f2d24140cb0 2021-10-20T23:25:41.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":78,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:25:41.263296+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:25:39.858993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-20T23:25:40.250129+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:25:41.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d04053640 msgr2=0x7f2d04055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d04053640 0x7f2d04055b00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f2d1c00d000 tx=0x7f2d1c007d50).stop 2021-10-20T23:25:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24140cb0 msgr2=0x7f2d24155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24140cb0 0x7f2d24155a20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f2d14006940 tx=0x7f2d14008040).stop 2021-10-20T23:25:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 shutdown_connections 2021-10-20T23:25:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2d04053640 0x7f2d04055b00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24140cb0 0x7f2d24155a20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d240b1a30 0x7f2d24155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 --2- 172.21.15.12:0/1133365862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2d240665f0 0x7f2d241478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 >> 172.21.15.12:0/1133365862 conn(0x7f2d240636e0 msgr2=0x7f2d240b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 shutdown_connections 2021-10-20T23:25:41.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.534+0000 7f2d2b018700 1 -- 172.21.15.12:0/1133365862 wait complete. 2021-10-20T23:25:41.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:25:41.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.646+0000 7f3fc716d700 1 Processor -- start 2021-10-20T23:25:41.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.646+0000 7f3fc716d700 1 -- start start 2021-10-20T23:25:41.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.646+0000 7f3fc716d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.646+0000 7f3fc716d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3fc00ad5c0 0x7f3fc00b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.646+0000 7f3fc716d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00aecf0 con 0x7f3fc0140440 2021-10-20T23:25:41.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.646+0000 7f3fc716d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00b6f20 con 0x7f3fc00ad5c0 2021-10-20T23:25:41.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.646+0000 7f3fc716d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00aef20 con 0x7f3fc0061320 2021-10-20T23:25:41.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc616b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc596a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3fc00ad5c0 0x7f3fc00b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc616b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46598/0 (socket says 172.21.15.12:46598) 2021-10-20T23:25:41.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc616b700 1 -- 172.21.15.12:0/3719218506 learned_addr learned my addr 172.21.15.12:0/3719218506 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:41.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc5169700 1 -- 172.21.15.12:0/3719218506 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499735374 0 0) 0x7f3fc00aecf0 con 0x7f3fc0140440 2021-10-20T23:25:41.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc5169700 1 -- 172.21.15.12:0/3719218506 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fa8003260 con 0x7f3fc0140440 2021-10-20T23:25:41.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc616b700 1 -- 172.21.15.12:0/3719218506 >> v2:172.21.15.31:3300/0 conn(0x7f3fc00ad5c0 msgr2=0x7f3fc00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:41.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc616b700 1 --2- 172.21.15.12:0/3719218506 >> v2:172.21.15.31:3300/0 conn(0x7f3fc00ad5c0 0x7f3fc00b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc616b700 1 -- 172.21.15.12:0/3719218506 >> v1:172.21.15.31:6789/0 conn(0x7f3fc0140440 legacy=0x7f3fc0146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc616b700 1 -- 172.21.15.12:0/3719218506 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00af1c0 con 0x7f3fc0061320 2021-10-20T23:25:41.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc596a700 1 --2- 172.21.15.12:0/3719218506 >> v2:172.21.15.31:3300/0 conn(0x7f3fc00ad5c0 0x7f3fc00b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc616b700 1 --2- 172.21.15.12:0/3719218506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0061700 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3fbc002f70 tx=0x7f3fbc006eb0).ready entity=mon.2 client_cookie=5872422808e2f8e2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc5169700 1 -- 172.21.15.12:0/3719218506 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fbc00d5c0 con 0x7f3fc0061320 2021-10-20T23:25:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc5169700 1 -- 172.21.15.12:0/3719218506 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc000e90 con 0x7f3fc0061320 2021-10-20T23:25:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc5169700 1 -- 172.21.15.12:0/3719218506 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fbc00d950 con 0x7f3fc0061320 2021-10-20T23:25:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc716d700 1 -- 172.21.15.12:0/3719218506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 msgr2=0x7f3fc0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc716d700 1 --2- 172.21.15.12:0/3719218506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0061700 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3fbc002f70 tx=0x7f3fbc006eb0).stop 2021-10-20T23:25:41.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc716d700 1 -- 172.21.15.12:0/3719218506 shutdown_connections 2021-10-20T23:25:41.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc716d700 1 --2- 172.21.15.12:0/3719218506 >> v2:172.21.15.31:3300/0 conn(0x7f3fc00ad5c0 0x7f3fc00b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc716d700 1 --2- 172.21.15.12:0/3719218506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0061700 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc716d700 1 -- 172.21.15.12:0/3719218506 >> 172.21.15.12:0/3719218506 conn(0x7f3fc0066de0 msgr2=0x7f3fc00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:41.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc716d700 1 -- 172.21.15.12:0/3719218506 shutdown_connections 2021-10-20T23:25:41.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc716d700 1 -- 172.21.15.12:0/3719218506 wait complete. 2021-10-20T23:25:41.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.650+0000 7f3fc716d700 1 Processor -- start 2021-10-20T23:25:41.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc716d700 1 -- start start 2021-10-20T23:25:41.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc716d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc716d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc00ad5c0 0x7f3fc0152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc716d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc0140440 0x7f3fc00ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc716d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00aff20 con 0x7f3fc0140440 2021-10-20T23:25:41.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc716d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00aafa0 con 0x7f3fc00ad5c0 2021-10-20T23:25:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc716d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc0148250 con 0x7f3fc0061320 2021-10-20T23:25:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc696c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc0140440 0x7f3fc00ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc696c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc0140440 0x7f3fc00ab3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40848/0 (socket says 172.21.15.12:40848) 2021-10-20T23:25:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc696c700 1 -- 172.21.15.12:0/441909802 learned_addr learned my addr 172.21.15.12:0/441909802 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc596a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc00ad5c0 0x7f3fc0152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc616b700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc696c700 1 -- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 msgr2=0x7f3fc0147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc696c700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc696c700 1 -- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc00ad5c0 msgr2=0x7f3fc0152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc696c700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc00ad5c0 0x7f3fc0152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc696c700 1 -- 172.21.15.12:0/441909802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb000b180 con 0x7f3fc0140440 2021-10-20T23:25:41.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc696c700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc0140440 0x7f3fc00ab3d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f3fb8001490 tx=0x7f3fb8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3faf7fe700 1 -- 172.21.15.12:0/441909802 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb8002310 con 0x7f3fc0140440 2021-10-20T23:25:41.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3faf7fe700 1 -- 172.21.15.12:0/441909802 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8002470 con 0x7f3fc0140440 2021-10-20T23:25:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc00b1e0 con 0x7f3fc0140440 2021-10-20T23:25:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3faf7fe700 1 -- 172.21.15.12:0/441909802 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb80017a0 con 0x7f3fc0140440 2021-10-20T23:25:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.654+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc00b10a0 con 0x7f3fc0140440 2021-10-20T23:25:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.658+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc00b0f10 con 0x7f3fc0140440 2021-10-20T23:25:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.658+0000 7f3faf7fe700 1 -- 172.21.15.12:0/441909802 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3fb8010030 con 0x7f3fc0140440 2021-10-20T23:25:41.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.658+0000 7f3faf7fe700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3fa00536a0 0x7f3fa0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.658+0000 7f3faf7fe700 1 -- 172.21.15.12:0/441909802 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3fb806b970 con 0x7f3fc0140440 2021-10-20T23:25:41.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.658+0000 7f3fc616b700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3fa00536a0 0x7f3fa0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.658+0000 7f3fc616b700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3fa00536a0 0x7f3fa0055b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f3fbc01c000 tx=0x7f3fbc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.666+0000 7f3faf7fe700 1 -- 172.21.15.12:0/441909802 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3fb80428d0 con 0x7f3fc0140440 2021-10-20T23:25:41.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.790+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fc0057350 con 0x7f3fc0140440 2021-10-20T23:25:41.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.794+0000 7f3faf7fe700 1 -- 172.21.15.12:0/441909802 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f3fb8045ef0 con 0x7f3fc0140440 2021-10-20T23:25:41.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:41.801 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":78,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:25:41.263296+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:25:39.858993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-20T23:25:40.250129+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:25:41.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.794+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3fa00536a0 msgr2=0x7f3fa0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.794+0000 7f3fc716d700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3fa00536a0 0x7f3fa0055b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f3fbc01c000 tx=0x7f3fbc015000).stop 2021-10-20T23:25:41.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.794+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc0140440 msgr2=0x7f3fc00ab3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.794+0000 7f3fc716d700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc0140440 0x7f3fc00ab3d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f3fb8001490 tx=0x7f3fb8007dd0).stop 2021-10-20T23:25:41.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.798+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 shutdown_connections 2021-10-20T23:25:41.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.798+0000 7f3fc716d700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3fa00536a0 0x7f3fa0055b60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.798+0000 7f3fc716d700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc0140440 0x7f3fc00ab3d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.798+0000 7f3fc716d700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc00ad5c0 0x7f3fc0152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.798+0000 7f3fc716d700 1 --2- 172.21.15.12:0/441909802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fc0061320 0x7f3fc0147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.798+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 >> 172.21.15.12:0/441909802 conn(0x7f3fc0066de0 msgr2=0x7f3fc00b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:41.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.798+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 shutdown_connections 2021-10-20T23:25:41.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.798+0000 7f3fc716d700 1 -- 172.21.15.12:0/441909802 wait complete. 2021-10-20T23:25:41.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:25:41.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.910+0000 7fb687467700 1 Processor -- start 2021-10-20T23:25:41.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.910+0000 7fb687467700 1 -- start start 2021-10-20T23:25:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb680144440 0x7fb680144970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb680065420 0x7fb680144e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb680145350 con 0x7fb680060100 2021-10-20T23:25:41.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb680065c80 con 0x7fb680144440 2021-10-20T23:25:41.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6800604e0 con 0x7fb680065420 2021-10-20T23:25:41.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb684a02700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb680144440 0x7fb680144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb685a04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb680065420 0x7fb680144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb685a04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb680065420 0x7fb680144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46616/0 (socket says 172.21.15.12:46616) 2021-10-20T23:25:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb685a04700 1 -- 172.21.15.12:0/4195914957 learned_addr learned my addr 172.21.15.12:0/4195914957 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb684a02700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb680144440 0x7fb680144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40856/0 (socket says 172.21.15.12:40856) 2021-10-20T23:25:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb685a04700 1 -- 172.21.15.12:0/4195914957 >> v2:172.21.15.12:3300/0 conn(0x7fb680144440 msgr2=0x7fb680144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb685a04700 1 --2- 172.21.15.12:0/4195914957 >> v2:172.21.15.12:3300/0 conn(0x7fb680144440 0x7fb680144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb685a04700 1 -- 172.21.15.12:0/4195914957 >> v1:172.21.15.31:6789/0 conn(0x7fb680060100 legacy=0x7fb680064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb66ffff700 1 -- 172.21.15.12:0/4195914957 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566799657 0 0) 0x7fb680145350 con 0x7fb680060100 2021-10-20T23:25:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb685a04700 1 -- 172.21.15.12:0/4195914957 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6800b23b0 con 0x7fb680065420 2021-10-20T23:25:41.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb685a04700 1 --2- 172.21.15.12:0/4195914957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb680065420 0x7fb680144e60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb6780032f0 tx=0x7fb678009290).ready entity=mon.2 client_cookie=26ebe4567608efba server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb66ffff700 1 -- 172.21.15.12:0/4195914957 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67800b8a0 con 0x7fb680065420 2021-10-20T23:25:41.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb66ffff700 1 -- 172.21.15.12:0/4195914957 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67800ba00 con 0x7fb680065420 2021-10-20T23:25:41.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb66ffff700 1 -- 172.21.15.12:0/4195914957 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67800bb70 con 0x7fb680065420 2021-10-20T23:25:41.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 -- 172.21.15.12:0/4195914957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb680065420 msgr2=0x7fb680144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 --2- 172.21.15.12:0/4195914957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb680065420 0x7fb680144e60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb6780032f0 tx=0x7fb678009290).stop 2021-10-20T23:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 -- 172.21.15.12:0/4195914957 shutdown_connections 2021-10-20T23:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 --2- 172.21.15.12:0/4195914957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb680065420 0x7fb680144e60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 --2- 172.21.15.12:0/4195914957 >> v2:172.21.15.12:3300/0 conn(0x7fb680144440 0x7fb680144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 -- 172.21.15.12:0/4195914957 >> 172.21.15.12:0/4195914957 conn(0x7fb68005cf60 msgr2=0x7fb68005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:41.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 -- 172.21.15.12:0/4195914957 shutdown_connections 2021-10-20T23:25:41.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.914+0000 7fb687467700 1 -- 172.21.15.12:0/4195914957 wait complete. 2021-10-20T23:25:41.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.918+0000 7fb687467700 1 Processor -- start 2021-10-20T23:25:41.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.918+0000 7fb687467700 1 -- start start 2021-10-20T23:25:41.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.918+0000 7fb687467700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb680060100 0x7fb68013be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.918+0000 7fb687467700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680065420 0x7fb68013d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.918+0000 7fb687467700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb68013d580 0x7fb6800af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.918+0000 7fb687467700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68013dde0 con 0x7fb680065420 2021-10-20T23:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb687467700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68013c680 con 0x7fb680060100 2021-10-20T23:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb687467700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb680140ec0 con 0x7fb68013d580 2021-10-20T23:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb684a02700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680065420 0x7fb68013d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb684a02700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680065420 0x7fb68013d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40862/0 (socket says 172.21.15.12:40862) 2021-10-20T23:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb684a02700 1 -- 172.21.15.12:0/2071296736 learned_addr learned my addr 172.21.15.12:0/2071296736 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb685a04700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb68013d580 0x7fb6800af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb685203700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb680060100 0x7fb68013be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb684a02700 1 -- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb68013d580 msgr2=0x7fb6800af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb684a02700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb68013d580 0x7fb6800af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb684a02700 1 -- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb680060100 msgr2=0x7fb68013be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb684a02700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb680060100 0x7fb68013be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb684a02700 1 -- 172.21.15.12:0/2071296736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb678009530 con 0x7fb680065420 2021-10-20T23:25:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb684a02700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680065420 0x7fb68013d090 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb68013c7c0 tx=0x7fb670006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb66e7fc700 1 -- 172.21.15.12:0/2071296736 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb670010780 con 0x7fb680065420 2021-10-20T23:25:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb66e7fc700 1 -- 172.21.15.12:0/2071296736 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6700108e0 con 0x7fb680065420 2021-10-20T23:25:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb66e7fc700 1 -- 172.21.15.12:0/2071296736 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb670010c40 con 0x7fb680065420 2021-10-20T23:25:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6800ae720 con 0x7fb680065420 2021-10-20T23:25:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb680143040 con 0x7fb680065420 2021-10-20T23:25:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb680057350 con 0x7fb680065420 2021-10-20T23:25:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb66e7fc700 1 -- 172.21.15.12:0/2071296736 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb67001c460 con 0x7fb680065420 2021-10-20T23:25:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.922+0000 7fb66e7fc700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb660053580 0x7fb660055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.926+0000 7fb66e7fc700 1 -- 172.21.15.12:0/2071296736 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb67006bef0 con 0x7fb680065420 2021-10-20T23:25:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.926+0000 7fb685203700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb660053580 0x7fb660055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.926+0000 7fb685203700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb660053580 0x7fb660055a40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fb67c00d000 tx=0x7fb67c007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:41.930+0000 7fb66e7fc700 1 -- 172.21.15.12:0/2071296736 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb670042df0 con 0x7fb680065420 2021-10-20T23:25:42.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.094+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb680143ef0 con 0x7fb680065420 2021-10-20T23:25:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.946+0000 7fb66e7fc700 1 -- 172.21.15.12:0/2071296736 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb670046410 con 0x7fb680065420 2021-10-20T23:25:42.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb660053580 msgr2=0x7fb660055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:42.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb660053580 0x7fb660055a40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fb67c00d000 tx=0x7fb67c007b70).stop 2021-10-20T23:25:42.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680065420 msgr2=0x7fb68013d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:42.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680065420 0x7fb68013d090 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb68013c7c0 tx=0x7fb670006df0).stop 2021-10-20T23:25:42.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 shutdown_connections 2021-10-20T23:25:42.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb660053580 0x7fb660055a40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:42.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb68013d580 0x7fb6800af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:42.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680065420 0x7fb68013d090 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:42.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 --2- 172.21.15.12:0/2071296736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb680060100 0x7fb68013be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:42.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 >> 172.21.15.12:0/2071296736 conn(0x7fb68005cf60 msgr2=0x7fb680140400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:42.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 shutdown_connections 2021-10-20T23:25:42.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:42.950+0000 7fb687467700 1 -- 172.21.15.12:0/2071296736 wait complete. 2021-10-20T23:25:42.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:43.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe18913700 1 Processor -- start 2021-10-20T23:25:43.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe18913700 1 -- start start 2021-10-20T23:25:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe18913700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe140afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe18913700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe140add80 con 0x7fbe140b2580 2021-10-20T23:25:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe18913700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe140ae020 con 0x7fbe140b1790 2021-10-20T23:25:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe18913700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140a9390 con 0x7fbe140b1260 2021-10-20T23:25:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe12d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbe140b2580 0x7fbe140abb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39464/0 (socket says 172.21.15.12:39464) 2021-10-20T23:25:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe12d9d700 1 -- 172.21.15.12:0/1275318418 learned_addr learned my addr 172.21.15.12:0/1275318418 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe0a59c700 1 --2- 172.21.15.12:0/1275318418 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe140afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe1259c700 1 -- 172.21.15.12:0/1275318418 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930415643 0 0) 0x7fbe140add80 con 0x7fbe140b2580 2021-10-20T23:25:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.078+0000 7fbe1259c700 1 -- 172.21.15.12:0/1275318418 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf8003260 con 0x7fbe140b2580 2021-10-20T23:25:43.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe0a59c700 1 -- 172.21.15.12:0/1275318418 >> v1:172.21.15.31:6789/0 conn(0x7fbe140b1790 legacy=0x7fbe1414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe0a59c700 1 -- 172.21.15.12:0/1275318418 >> v1:172.21.15.12:6789/0 conn(0x7fbe140b2580 legacy=0x7fbe140abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe0a59c700 1 -- 172.21.15.12:0/1275318418 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140a9830 con 0x7fbe140b1260 2021-10-20T23:25:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe0a59c700 1 --2- 172.21.15.12:0/1275318418 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe140afbd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fbe14067a30 tx=0x7fbdfc006df0).ready entity=mon.2 client_cookie=35ce24860a47db39 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe1259c700 1 -- 172.21.15.12:0/1275318418 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc00d4a0 con 0x7fbe140b1260 2021-10-20T23:25:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe1259c700 1 -- 172.21.15.12:0/1275318418 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc000e90 con 0x7fbe140b1260 2021-10-20T23:25:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe1259c700 1 -- 172.21.15.12:0/1275318418 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc00d7f0 con 0x7fbe140b1260 2021-10-20T23:25:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe18913700 1 -- 172.21.15.12:0/1275318418 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 msgr2=0x7fbe140afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe18913700 1 --2- 172.21.15.12:0/1275318418 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe140afbd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fbe14067a30 tx=0x7fbdfc006df0).stop 2021-10-20T23:25:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe18913700 1 -- 172.21.15.12:0/1275318418 shutdown_connections 2021-10-20T23:25:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe18913700 1 --2- 172.21.15.12:0/1275318418 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe140afbd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe18913700 1 -- 172.21.15.12:0/1275318418 >> 172.21.15.12:0/1275318418 conn(0x7fbe14060180 msgr2=0x7fbe140b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe18913700 1 -- 172.21.15.12:0/1275318418 shutdown_connections 2021-10-20T23:25:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.082+0000 7fbe18913700 1 -- 172.21.15.12:0/1275318418 wait complete. 2021-10-20T23:25:43.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.086+0000 7fbe18913700 1 Processor -- start 2021-10-20T23:25:43.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.086+0000 7fbe18913700 1 -- start start 2021-10-20T23:25:43.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.086+0000 7fbe18913700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe14145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.086+0000 7fbe18913700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe140b1790 0x7fbe1409e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.086+0000 7fbe18913700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe140b2580 0x7fbe140a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.086+0000 7fbe18913700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14151940 con 0x7fbe140b2580 2021-10-20T23:25:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.086+0000 7fbe18913700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14151be0 con 0x7fbe140b1790 2021-10-20T23:25:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.086+0000 7fbe18913700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14151e80 con 0x7fbe140b1260 2021-10-20T23:25:43.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe12d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe14145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe1359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe140b2580 0x7fbe140a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe12d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe14145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46632/0 (socket says 172.21.15.12:46632) 2021-10-20T23:25:43.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe12d9d700 1 -- 172.21.15.12:0/1862585803 learned_addr learned my addr 172.21.15.12:0/1862585803 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe0a59c700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe140b1790 0x7fbe1409e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe1359e700 1 -- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 msgr2=0x7fbe14145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe1359e700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe14145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe1359e700 1 -- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe140b1790 msgr2=0x7fbe1409e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe1359e700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe140b1790 0x7fbe1409e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe1359e700 1 -- 172.21.15.12:0/1862585803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc00b180 con 0x7fbe140b2580 2021-10-20T23:25:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe1359e700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe140b2580 0x7fbe140a0720 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fbe0c001490 tx=0x7fbe0c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe10d99700 1 -- 172.21.15.12:0/1862585803 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0c00f470 con 0x7fbe140b2580 2021-10-20T23:25:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe10d99700 1 -- 172.21.15.12:0/1862585803 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c00f5d0 con 0x7fbe140b2580 2021-10-20T23:25:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe14152120 con 0x7fbe140b2580 2021-10-20T23:25:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe10d99700 1 -- 172.21.15.12:0/1862585803 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0c00f930 con 0x7fbe140b2580 2021-10-20T23:25:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe141525c0 con 0x7fbe140b2580 2021-10-20T23:25:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe10d99700 1 -- 172.21.15.12:0/1862585803 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbe0c019030 con 0x7fbe140b2580 2021-10-20T23:25:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe141522b0 con 0x7fbe140b2580 2021-10-20T23:25:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe10d99700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbdec0536d0 0x7fbdec055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe10d99700 1 -- 172.21.15.12:0/1862585803 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbe0c06b2a0 con 0x7fbe140b2580 2021-10-20T23:25:43.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.090+0000 7fbe12d9d700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbdec0536d0 0x7fbdec055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.094+0000 7fbe12d9d700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbdec0536d0 0x7fbdec055b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fbe0400d000 tx=0x7fbe04009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.094+0000 7fbe10d99700 1 -- 172.21.15.12:0/1862585803 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe0c045cd0 con 0x7fbe140b2580 2021-10-20T23:25:43.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.258+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe14057350 con 0x7fbe140b2580 2021-10-20T23:25:43.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe10d99700 1 -- 172.21.15.12:0/1862585803 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fbe0c017020 con 0x7fbe140b2580 2021-10-20T23:25:43.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:43.267 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:25:41.263533+0000","modified":"2021-10-20T23:25:42.936432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3651290992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3651290992},{"type":"v1","addr":"172.21.15.31:6835","nonce":3651290992}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-20T23:25:43.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbdec0536d0 msgr2=0x7fbdec055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbdec0536d0 0x7fbdec055b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fbe0400d000 tx=0x7fbe04009040).stop 2021-10-20T23:25:43.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe140b2580 msgr2=0x7fbe140a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe140b2580 0x7fbe140a0720 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fbe0c001490 tx=0x7fbe0c007df0).stop 2021-10-20T23:25:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 shutdown_connections 2021-10-20T23:25:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbdec0536d0 0x7fbdec055b90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe140b2580 0x7fbe140a0720 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe140b1790 0x7fbe1409e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 --2- 172.21.15.12:0/1862585803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe140b1260 0x7fbe14145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 >> 172.21.15.12:0/1862585803 conn(0x7fbe14060180 msgr2=0x7fbe141441e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 shutdown_connections 2021-10-20T23:25:43.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.262+0000 7fbe18913700 1 -- 172.21.15.12:0/1862585803 wait complete. 2021-10-20T23:25:43.276 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 38 2021-10-20T23:25:43.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:25:43.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fab307700 1 Processor -- start 2021-10-20T23:25:43.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fab307700 1 -- start start 2021-10-20T23:25:43.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fab307700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa41483a0 0x7f1fa40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fab307700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1fa40a70c0 0x7f1fa4144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fab307700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa40b0350 con 0x7f1fa40b1db0 2021-10-20T23:25:43.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fab307700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa40a90c0 con 0x7f1fa40a70c0 2021-10-20T23:25:43.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fab307700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40b05f0 con 0x7f1fa41483a0 2021-10-20T23:25:43.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fa98a4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1fa40a70c0 0x7f1fa4144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fa90a3700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1fa40b1db0 0x7f1fa40b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39476/0 (socket says 172.21.15.12:39476) 2021-10-20T23:25:43.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fa90a3700 1 -- 172.21.15.12:0/3875884228 learned_addr learned my addr 172.21.15.12:0/3875884228 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:43.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fa88a2700 1 --2- 172.21.15.12:0/3875884228 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa41483a0 0x7f1fa40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fa98a4700 1 -- 172.21.15.12:0/3875884228 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa41483a0 msgr2=0x7f1fa40b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:43.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fa98a4700 1 --2- 172.21.15.12:0/3875884228 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa41483a0 0x7f1fa40b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fa98a4700 1 -- 172.21.15.12:0/3875884228 >> v1:172.21.15.12:6789/0 conn(0x7f1fa40b1db0 legacy=0x7f1fa40b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1f9bfff700 1 -- 172.21.15.12:0/3875884228 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627187876 0 0) 0x7f1fa40b0350 con 0x7f1fa40b1db0 2021-10-20T23:25:43.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fa98a4700 1 -- 172.21.15.12:0/3875884228 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa40b0890 con 0x7f1fa40a70c0 2021-10-20T23:25:43.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1fa98a4700 1 --2- 172.21.15.12:0/3875884228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 0x7f1fa4144720 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f1f9c0032f0 tx=0x7f1f9c0091d0).ready entity=mon.0 client_cookie=16bb1d3d520d453f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1f9bfff700 1 -- 172.21.15.12:0/3875884228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f9c00b6c0 con 0x7f1fa40a70c0 2021-10-20T23:25:43.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1f9bfff700 1 -- 172.21.15.12:0/3875884228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c00b820 con 0x7f1fa40a70c0 2021-10-20T23:25:43.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.378+0000 7f1f9bfff700 1 -- 172.21.15.12:0/3875884228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f9c00b990 con 0x7f1fa40a70c0 2021-10-20T23:25:43.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 -- 172.21.15.12:0/3875884228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 msgr2=0x7f1fa4144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 --2- 172.21.15.12:0/3875884228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 0x7f1fa4144720 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f1f9c0032f0 tx=0x7f1f9c0091d0).stop 2021-10-20T23:25:43.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 -- 172.21.15.12:0/3875884228 shutdown_connections 2021-10-20T23:25:43.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 --2- 172.21.15.12:0/3875884228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 0x7f1fa4144720 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 --2- 172.21.15.12:0/3875884228 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa41483a0 0x7f1fa40b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 -- 172.21.15.12:0/3875884228 >> 172.21.15.12:0/3875884228 conn(0x7f1fa405f6b0 msgr2=0x7f1fa405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:43.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 -- 172.21.15.12:0/3875884228 shutdown_connections 2021-10-20T23:25:43.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 -- 172.21.15.12:0/3875884228 wait complete. 2021-10-20T23:25:43.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 Processor -- start 2021-10-20T23:25:43.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 -- start start 2021-10-20T23:25:43.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 0x7f1fa4142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa40b1db0 0x7f1fa413d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fa41483a0 0x7f1fa413dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4145a40 con 0x7f1fa40a70c0 2021-10-20T23:25:43.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40ad020 con 0x7f1fa41483a0 2021-10-20T23:25:43.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fab307700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40ad2c0 con 0x7f1fa40b1db0 2021-10-20T23:25:43.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fa90a3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 0x7f1fa4142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fa90a3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 0x7f1fa4142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40890/0 (socket says 172.21.15.12:40890) 2021-10-20T23:25:43.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fa90a3700 1 -- 172.21.15.12:0/762261547 learned_addr learned my addr 172.21.15.12:0/762261547 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:43.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.382+0000 7f1fa88a2700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa40b1db0 0x7f1fa413d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fa98a4700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fa41483a0 0x7f1fa413dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fa90a3700 1 -- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa40b1db0 msgr2=0x7f1fa413d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fa90a3700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa40b1db0 0x7f1fa413d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fa90a3700 1 -- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fa41483a0 msgr2=0x7f1fa413dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fa90a3700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fa41483a0 0x7f1fa413dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fa90a3700 1 -- 172.21.15.12:0/762261547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c009470 con 0x7f1fa40a70c0 2021-10-20T23:25:43.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fa98a4700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fa41483a0 0x7f1fa413dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:43.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fa90a3700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 0x7f1fa4142380 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f1f94000ed0 tx=0x7f1f94007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1f9a7fc700 1 -- 172.21.15.12:0/762261547 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f940070d0 con 0x7f1fa40a70c0 2021-10-20T23:25:43.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1f9a7fc700 1 -- 172.21.15.12:0/762261547 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f94007230 con 0x7f1fa40a70c0 2021-10-20T23:25:43.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa40af4e0 con 0x7f1fa40a70c0 2021-10-20T23:25:43.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1f9a7fc700 1 -- 172.21.15.12:0/762261547 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f94005610 con 0x7f1fa40a70c0 2021-10-20T23:25:43.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa41455a0 con 0x7f1fa40a70c0 2021-10-20T23:25:43.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa40aca00 con 0x7f1fa40a70c0 2021-10-20T23:25:43.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1f9a7fc700 1 -- 172.21.15.12:0/762261547 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1f94010070 con 0x7f1fa40a70c0 2021-10-20T23:25:43.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1f9a7fc700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f8c053610 0x7f1f8c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1f9a7fc700 1 -- 172.21.15.12:0/762261547 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1f9406b260 con 0x7f1fa40a70c0 2021-10-20T23:25:43.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.386+0000 7f1fa88a2700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f8c053610 0x7f1f8c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.390+0000 7f1fa88a2700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f8c053610 0x7f1f8c055ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f1fa000b000 tx=0x7f1fa0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.390+0000 7f1f9a7fc700 1 -- 172.21.15.12:0/762261547 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fa40aca00 con 0x7f1fa40a70c0 2021-10-20T23:25:43.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.518+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fa40aca00 con 0x7f1fa40a70c0 2021-10-20T23:25:43.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.518+0000 7f1f9a7fc700 1 -- 172.21.15.12:0/762261547 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f1fa40aca00 con 0x7f1fa40a70c0 2021-10-20T23:25:43.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:43.526 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":79,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:25:42.266158+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:25:39.858993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-20T23:25:40.250129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:25:43.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f8c053610 msgr2=0x7f1f8c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f8c053610 0x7f1f8c055ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f1fa000b000 tx=0x7f1fa0006df0).stop 2021-10-20T23:25:43.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 msgr2=0x7f1fa4142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 0x7f1fa4142380 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f1f94000ed0 tx=0x7f1f94007ac0).stop 2021-10-20T23:25:43.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 shutdown_connections 2021-10-20T23:25:43.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f8c053610 0x7f1f8c055ad0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fa41483a0 0x7f1fa413dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fa40b1db0 0x7f1fa413d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 --2- 172.21.15.12:0/762261547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fa40a70c0 0x7f1fa4142380 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 >> 172.21.15.12:0/762261547 conn(0x7f1fa405f6b0 msgr2=0x7f1fa40a76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:43.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 shutdown_connections 2021-10-20T23:25:43.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.522+0000 7f1fab307700 1 -- 172.21.15.12:0/762261547 wait complete. 2021-10-20T23:25:43.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:25:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5bfff700 1 Processor -- start 2021-10-20T23:25:43.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5bfff700 1 -- start start 2021-10-20T23:25:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f5c0ad5c0 0x7f8f5c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f5c140440 0x7f8f5c1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5bfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c0aecf0 con 0x7f8f5c061320 2021-10-20T23:25:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c0b6f20 con 0x7f8f5c0ad5c0 2021-10-20T23:25:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5bfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c0aef20 con 0x7f8f5c140440 2021-10-20T23:25:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f5c0ad5c0 0x7f8f5c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f5c0ad5c0 0x7f8f5c061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40898/0 (socket says 172.21.15.12:40898) 2021-10-20T23:25:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5a7fc700 1 -- 172.21.15.12:0/980484301 learned_addr learned my addr 172.21.15.12:0/980484301 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5b7fe700 1 --2- 172.21.15.12:0/980484301 >> v2:172.21.15.31:3300/0 conn(0x7f8f5c140440 0x7f8f5c1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5b7fe700 1 -- 172.21.15.12:0/980484301 >> v2:172.21.15.12:3300/0 conn(0x7f8f5c0ad5c0 msgr2=0x7f8f5c061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5b7fe700 1 --2- 172.21.15.12:0/980484301 >> v2:172.21.15.12:3300/0 conn(0x7f8f5c0ad5c0 0x7f8f5c061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5b7fe700 1 -- 172.21.15.12:0/980484301 >> v1:172.21.15.31:6789/0 conn(0x7f8f5c061320 legacy=0x7f8f5c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5b7fe700 1 -- 172.21.15.12:0/980484301 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0af1c0 con 0x7f8f5c140440 2021-10-20T23:25:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5a7fc700 1 --2- 172.21.15.12:0/980484301 >> v2:172.21.15.12:3300/0 conn(0x7f8f5c0ad5c0 0x7f8f5c061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f5b7fe700 1 --2- 172.21.15.12:0/980484301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f5c140440 0x7f8f5c1408f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f8f54002f70 tx=0x7f8f54006df0).ready entity=mon.1 client_cookie=d26e0a05a2f31e6d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f59ffb700 1 -- 172.21.15.12:0/980484301 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f5400d570 con 0x7f8f5c140440 2021-10-20T23:25:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f59ffb700 1 -- 172.21.15.12:0/980484301 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f54000e90 con 0x7f8f5c140440 2021-10-20T23:25:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.654+0000 7f8f59ffb700 1 -- 172.21.15.12:0/980484301 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f5400d8c0 con 0x7f8f5c140440 2021-10-20T23:25:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 -- 172.21.15.12:0/980484301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f5c140440 msgr2=0x7f8f5c1408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 --2- 172.21.15.12:0/980484301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f5c140440 0x7f8f5c1408f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f8f54002f70 tx=0x7f8f54006df0).stop 2021-10-20T23:25:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 -- 172.21.15.12:0/980484301 shutdown_connections 2021-10-20T23:25:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 --2- 172.21.15.12:0/980484301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f5c140440 0x7f8f5c1408f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 --2- 172.21.15.12:0/980484301 >> v2:172.21.15.12:3300/0 conn(0x7f8f5c0ad5c0 0x7f8f5c061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 -- 172.21.15.12:0/980484301 >> 172.21.15.12:0/980484301 conn(0x7f8f5c066de0 msgr2=0x7f8f5c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 -- 172.21.15.12:0/980484301 shutdown_connections 2021-10-20T23:25:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 -- 172.21.15.12:0/980484301 wait complete. 2021-10-20T23:25:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 Processor -- start 2021-10-20T23:25:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.658+0000 7f8f5bfff700 1 -- start start 2021-10-20T23:25:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f5c061320 0x7f8f5c0aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f5c0ad5c0 0x7f8f5c1527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f5c140440 0x7f8f5c144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c152c90 con 0x7f8f5c061320 2021-10-20T23:25:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c155e80 con 0x7f8f5c140440 2021-10-20T23:25:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0aa3c0 con 0x7f8f5c0ad5c0 2021-10-20T23:25:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f5c061320 0x7f8f5c0aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f5c061320 0x7f8f5c0aac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40902/0 (socket says 172.21.15.12:40902) 2021-10-20T23:25:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5affd700 1 -- 172.21.15.12:0/1258001139 learned_addr learned my addr 172.21.15.12:0/1258001139 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5a7fc700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f5c0ad5c0 0x7f8f5c1527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5b7fe700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f5c140440 0x7f8f5c144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5affd700 1 -- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f5c0ad5c0 msgr2=0x7f8f5c1527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5affd700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f5c0ad5c0 0x7f8f5c1527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5affd700 1 -- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f5c140440 msgr2=0x7f8f5c144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5affd700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f5c140440 0x7f8f5c144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5affd700 1 -- 172.21.15.12:0/1258001139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4400b1e0 con 0x7f8f5c061320 2021-10-20T23:25:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5a7fc700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f5c0ad5c0 0x7f8f5c1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5affd700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f5c061320 0x7f8f5c0aac70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f8f5c0aa550 tx=0x7f8f4c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f53fff700 1 -- 172.21.15.12:0/1258001139 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f4c006aa0 con 0x7f8f5c061320 2021-10-20T23:25:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f53fff700 1 -- 172.21.15.12:0/1258001139 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c006c00 con 0x7f8f5c061320 2021-10-20T23:25:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5400b180 con 0x7f8f5c061320 2021-10-20T23:25:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f53fff700 1 -- 172.21.15.12:0/1258001139 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f4c007030 con 0x7f8f5c061320 2021-10-20T23:25:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c145090 con 0x7f8f5c061320 2021-10-20T23:25:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f53fff700 1 -- 172.21.15.12:0/1258001139 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8f4c019030 con 0x7f8f5c061320 2021-10-20T23:25:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c0af460 con 0x7f8f5c061320 2021-10-20T23:25:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f53fff700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f40053520 0x7f8f400559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.662+0000 7f8f53fff700 1 -- 172.21.15.12:0/1258001139 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8f4c06b220 con 0x7f8f5c061320 2021-10-20T23:25:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.666+0000 7f8f5a7fc700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f40053520 0x7f8f400559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.666+0000 7f8f5a7fc700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f40053520 0x7f8f400559e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f8f4400b000 tx=0x7f8f44008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.670+0000 7f8f53fff700 1 -- 172.21.15.12:0/1258001139 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f4c042220 con 0x7f8f5c061320 2021-10-20T23:25:43.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.838+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8f5c0b3bd0 con 0x7f8f5c061320 2021-10-20T23:25:43.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.846+0000 7f8f53fff700 1 -- 172.21.15.12:0/1258001139 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8f4c045840 con 0x7f8f5c061320 2021-10-20T23:25:43.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f40053520 msgr2=0x7f8f400559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f40053520 0x7f8f400559e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f8f4400b000 tx=0x7f8f44008040).stop 2021-10-20T23:25:43.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f5c061320 msgr2=0x7f8f5c0aac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f5c061320 0x7f8f5c0aac70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f8f5c0aa550 tx=0x7f8f4c007f90).stop 2021-10-20T23:25:43.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 shutdown_connections 2021-10-20T23:25:43.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f40053520 0x7f8f400559e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f5c140440 0x7f8f5c144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f5c0ad5c0 0x7f8f5c1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 --2- 172.21.15.12:0/1258001139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f5c061320 0x7f8f5c0aac70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 >> 172.21.15.12:0/1258001139 conn(0x7f8f5c066de0 msgr2=0x7f8f5c05cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:43.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 shutdown_connections 2021-10-20T23:25:43.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.850+0000 7f8f5bfff700 1 -- 172.21.15.12:0/1258001139 wait complete. 2021-10-20T23:25:43.862 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:25:43.872 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:25:43.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.978+0000 7f237f726700 1 Processor -- start 2021-10-20T23:25:43.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.978+0000 7f237f726700 1 -- start start 2021-10-20T23:25:43.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23780b6760 0x7f237813ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23780aa080 0x7f237813d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237813d6d0 con 0x7f237805fdb0 2021-10-20T23:25:43.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23780ac550 con 0x7f23780aa080 2021-10-20T23:25:43.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23780ac7f0 con 0x7f23780b6760 2021-10-20T23:25:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237ccc1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23780aa080 0x7f237813d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237dcc3700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f237805fdb0 0x7f23781467e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39504/0 (socket says 172.21.15.12:39504) 2021-10-20T23:25:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237dcc3700 1 -- 172.21.15.12:0/1795721133 learned_addr learned my addr 172.21.15.12:0/1795721133 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237d4c2700 1 --2- 172.21.15.12:0/1795721133 >> v2:172.21.15.31:3300/0 conn(0x7f23780b6760 0x7f237813ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:43.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f2367fff700 1 -- 172.21.15.12:0/1795721133 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972025011 0 0) 0x7f237813d6d0 con 0x7f237805fdb0 2021-10-20T23:25:43.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f2367fff700 1 -- 172.21.15.12:0/1795721133 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2360003260 con 0x7f237805fdb0 2021-10-20T23:25:43.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237ccc1700 1 -- 172.21.15.12:0/1795721133 >> v2:172.21.15.31:3300/0 conn(0x7f23780b6760 msgr2=0x7f237813ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:43.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237ccc1700 1 --2- 172.21.15.12:0/1795721133 >> v2:172.21.15.31:3300/0 conn(0x7f23780b6760 0x7f237813ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237ccc1700 1 -- 172.21.15.12:0/1795721133 >> v1:172.21.15.12:6789/0 conn(0x7f237805fdb0 legacy=0x7f23781467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237ccc1700 1 -- 172.21.15.12:0/1795721133 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23780aca90 con 0x7f23780aa080 2021-10-20T23:25:43.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237ccc1700 1 --2- 172.21.15.12:0/1795721133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780aa080 0x7f237813d1e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f2368002f70 tx=0x7f2368006df0).ready entity=mon.0 client_cookie=7a6306570ce01fee server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:43.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f2367fff700 1 -- 172.21.15.12:0/1795721133 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236800d4f0 con 0x7f23780aa080 2021-10-20T23:25:43.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f2367fff700 1 -- 172.21.15.12:0/1795721133 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2368000e90 con 0x7f23780aa080 2021-10-20T23:25:43.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f2367fff700 1 -- 172.21.15.12:0/1795721133 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236800d840 con 0x7f23780aa080 2021-10-20T23:25:43.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 -- 172.21.15.12:0/1795721133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780aa080 msgr2=0x7f237813d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:43.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 --2- 172.21.15.12:0/1795721133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780aa080 0x7f237813d1e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f2368002f70 tx=0x7f2368006df0).stop 2021-10-20T23:25:43.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 -- 172.21.15.12:0/1795721133 shutdown_connections 2021-10-20T23:25:43.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 --2- 172.21.15.12:0/1795721133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780aa080 0x7f237813d1e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 --2- 172.21.15.12:0/1795721133 >> v2:172.21.15.31:3300/0 conn(0x7f23780b6760 0x7f237813ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:43.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 -- 172.21.15.12:0/1795721133 >> 172.21.15.12:0/1795721133 conn(0x7f23780b3480 msgr2=0x7f23780b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:43.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 -- 172.21.15.12:0/1795721133 shutdown_connections 2021-10-20T23:25:43.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.982+0000 7f237f726700 1 -- 172.21.15.12:0/1795721133 wait complete. 2021-10-20T23:25:43.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237f726700 1 Processor -- start 2021-10-20T23:25:43.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237f726700 1 -- start start 2021-10-20T23:25:43.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237f726700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f237805fdb0 0x7f2378066b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237f726700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23780aa080 0x7f23780ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237f726700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780b6760 0x7f23780ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:43.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237f726700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780adc10 con 0x7f23780b6760 2021-10-20T23:25:43.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237f726700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2378155b50 con 0x7f23780aa080 2021-10-20T23:25:44.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237f726700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2378155df0 con 0x7f237805fdb0 2021-10-20T23:25:44.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237dcc3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780b6760 0x7f23780ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237dcc3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780b6760 0x7f23780ad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40918/0 (socket says 172.21.15.12:40918) 2021-10-20T23:25:44.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237dcc3700 1 -- 172.21.15.12:0/4259872815 learned_addr learned my addr 172.21.15.12:0/4259872815 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:44.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237d4c2700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f237805fdb0 0x7f2378066b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237ccc1700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23780aa080 0x7f23780ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237dcc3700 1 -- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f237805fdb0 msgr2=0x7f2378066b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:44.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237dcc3700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f237805fdb0 0x7f2378066b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237dcc3700 1 -- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23780aa080 msgr2=0x7f23780ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:44.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237dcc3700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23780aa080 0x7f23780ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237dcc3700 1 -- 172.21.15.12:0/4259872815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236800b180 con 0x7f23780b6760 2021-10-20T23:25:44.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f237dcc3700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780b6760 0x7f23780ad720 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f2370001490 tx=0x7f2370007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:44.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.986+0000 7f23667fc700 1 -- 172.21.15.12:0/4259872815 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2370005ba0 con 0x7f23780b6760 2021-10-20T23:25:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.990+0000 7f23667fc700 1 -- 172.21.15.12:0/4259872815 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370005d00 con 0x7f23780b6760 2021-10-20T23:25:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.990+0000 7f23667fc700 1 -- 172.21.15.12:0/4259872815 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23700072c0 con 0x7f23780b6760 2021-10-20T23:25:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.990+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2378156090 con 0x7f23780b6760 2021-10-20T23:25:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.990+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23780b2440 con 0x7f23780b6760 2021-10-20T23:25:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.990+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23780aacc0 con 0x7f23780b6760 2021-10-20T23:25:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.990+0000 7f23667fc700 1 -- 172.21.15.12:0/4259872815 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2370010070 con 0x7f23780b6760 2021-10-20T23:25:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.990+0000 7f23667fc700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23580536a0 0x7f2358055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:44.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.990+0000 7f23667fc700 1 -- 172.21.15.12:0/4259872815 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f237006b2f0 con 0x7f23780b6760 2021-10-20T23:25:44.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.990+0000 7f237d4c2700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23580536a0 0x7f2358055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.994+0000 7f237d4c2700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23580536a0 0x7f2358055b60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f237400b000 tx=0x7f2374006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:44.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:43.998+0000 7f23667fc700 1 -- 172.21.15.12:0/4259872815 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23700422f0 con 0x7f23780b6760 2021-10-20T23:25:44.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.162+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f23780acd30 con 0x7f23780b6760 2021-10-20T23:25:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.170+0000 7f23667fc700 1 -- 172.21.15.12:0/4259872815 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2370018070 con 0x7f23780b6760 2021-10-20T23:25:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23580536a0 msgr2=0x7f2358055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23580536a0 0x7f2358055b60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f237400b000 tx=0x7f2374006df0).stop 2021-10-20T23:25:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780b6760 msgr2=0x7f23780ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780b6760 0x7f23780ad720 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f2370001490 tx=0x7f2370007e00).stop 2021-10-20T23:25:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 shutdown_connections 2021-10-20T23:25:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23580536a0 0x7f2358055b60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23780b6760 0x7f23780ad720 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23780aa080 0x7f23780ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 --2- 172.21.15.12:0/4259872815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f237805fdb0 0x7f2378066b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 >> 172.21.15.12:0/4259872815 conn(0x7f23780b3480 msgr2=0x7f23780b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 shutdown_connections 2021-10-20T23:25:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.174+0000 7f237f726700 1 -- 172.21.15.12:0/4259872815 wait complete. 2021-10-20T23:25:44.183 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:25:44.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:44.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43593e700 1 Processor -- start 2021-10-20T23:25:44.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43593e700 1 -- start start 2021-10-20T23:25:44.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43593e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4300b2580 0x7fe43014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:44.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43593e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300b0010 0x7fe43014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:44.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43593e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4300afbd0 0x7fe4300a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:44.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43593e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4300a70c0 con 0x7fe4300afbd0 2021-10-20T23:25:44.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43593e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4300a72f0 con 0x7fe4300b2580 2021-10-20T23:25:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43593e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4300a7590 con 0x7fe4300b0010 2021-10-20T23:25:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43513d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4300afbd0 0x7fe4300a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43513d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4300afbd0 0x7fe4300a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40926/0 (socket says 172.21.15.12:40926) 2021-10-20T23:25:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.290+0000 7fe43513d700 1 -- 172.21.15.12:0/4058157151 learned_addr learned my addr 172.21.15.12:0/4058157151 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe42ffff700 1 --2- 172.21.15.12:0/4058157151 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300b0010 0x7fe43014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43493c700 1 --2- 172.21.15.12:0/4058157151 >> v2:172.21.15.31:3300/0 conn(0x7fe4300b2580 0x7fe43014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43513d700 1 -- 172.21.15.12:0/4058157151 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300b0010 msgr2=0x7fe43014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43513d700 1 --2- 172.21.15.12:0/4058157151 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300b0010 0x7fe43014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43513d700 1 -- 172.21.15.12:0/4058157151 >> v2:172.21.15.31:3300/0 conn(0x7fe4300b2580 msgr2=0x7fe43014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43513d700 1 --2- 172.21.15.12:0/4058157151 >> v2:172.21.15.31:3300/0 conn(0x7fe4300b2580 0x7fe43014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43513d700 1 -- 172.21.15.12:0/4058157151 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300a7830 con 0x7fe4300afbd0 2021-10-20T23:25:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43513d700 1 --2- 172.21.15.12:0/4058157151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300afbd0 0x7fe4300a83b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fe428002f70 tx=0x7fe428006eb0).ready entity=mon.0 client_cookie=fba12334b19c2091 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe42f7fe700 1 -- 172.21.15.12:0/4058157151 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42800d570 con 0x7fe4300afbd0 2021-10-20T23:25:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe42f7fe700 1 -- 172.21.15.12:0/4058157151 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe428000e90 con 0x7fe4300afbd0 2021-10-20T23:25:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe42f7fe700 1 -- 172.21.15.12:0/4058157151 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42800d900 con 0x7fe4300afbd0 2021-10-20T23:25:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43593e700 1 -- 172.21.15.12:0/4058157151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300afbd0 msgr2=0x7fe4300a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43593e700 1 --2- 172.21.15.12:0/4058157151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300afbd0 0x7fe4300a83b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fe428002f70 tx=0x7fe428006eb0).stop 2021-10-20T23:25:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43593e700 1 -- 172.21.15.12:0/4058157151 shutdown_connections 2021-10-20T23:25:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43593e700 1 --2- 172.21.15.12:0/4058157151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300afbd0 0x7fe4300a83b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43593e700 1 --2- 172.21.15.12:0/4058157151 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300b0010 0x7fe43014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43593e700 1 --2- 172.21.15.12:0/4058157151 >> v2:172.21.15.31:3300/0 conn(0x7fe4300b2580 0x7fe43014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43593e700 1 -- 172.21.15.12:0/4058157151 >> 172.21.15.12:0/4058157151 conn(0x7fe430060180 msgr2=0x7fe4300b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43593e700 1 -- 172.21.15.12:0/4058157151 shutdown_connections 2021-10-20T23:25:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.294+0000 7fe43593e700 1 -- 172.21.15.12:0/4058157151 wait complete. 2021-10-20T23:25:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43593e700 1 Processor -- start 2021-10-20T23:25:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43593e700 1 -- start start 2021-10-20T23:25:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43593e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300afbd0 0x7fe43014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43593e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4300b0010 0x7fe4300aab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43593e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300b2580 0x7fe4300ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43593e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4300ab550 con 0x7fe4300b2580 2021-10-20T23:25:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43593e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4300a9be0 con 0x7fe4300b0010 2021-10-20T23:25:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43593e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4300aa220 con 0x7fe4300afbd0 2021-10-20T23:25:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43513d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300b2580 0x7fe4300ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43513d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300b2580 0x7fe4300ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40932/0 (socket says 172.21.15.12:40932) 2021-10-20T23:25:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43513d700 1 -- 172.21.15.12:0/714289881 learned_addr learned my addr 172.21.15.12:0/714289881 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43493c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300afbd0 0x7fe43014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe42ffff700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4300b0010 0x7fe4300aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe42ffff700 1 -- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300afbd0 msgr2=0x7fe43014ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe42ffff700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300afbd0 0x7fe43014ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe42ffff700 1 -- 172.21.15.12:0/714289881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300b2580 msgr2=0x7fe4300ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe42ffff700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300b2580 0x7fe4300ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe42ffff700 1 -- 172.21.15.12:0/714289881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42800b1e0 con 0x7fe4300b0010 2021-10-20T23:25:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.298+0000 7fe43513d700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300b2580 0x7fe4300ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe42ffff700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4300b0010 0x7fe4300aab70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fe4300abf30 tx=0x7fe4200091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe42dffb700 1 -- 172.21.15.12:0/714289881 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42000c640 con 0x7fe4300b0010 2021-10-20T23:25:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe42dffb700 1 -- 172.21.15.12:0/714289881 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42000c7a0 con 0x7fe4300b0010 2021-10-20T23:25:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4300a9e10 con 0x7fe4300b0010 2021-10-20T23:25:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe42dffb700 1 -- 172.21.15.12:0/714289881 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42000cb00 con 0x7fe4300b0010 2021-10-20T23:25:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4300b46c0 con 0x7fe4300b0010 2021-10-20T23:25:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe430057350 con 0x7fe4300b0010 2021-10-20T23:25:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe42dffb700 1 -- 172.21.15.12:0/714289881 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe420022070 con 0x7fe4300b0010 2021-10-20T23:25:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe42dffb700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe4100536a0 0x7fe410055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe42dffb700 1 -- 172.21.15.12:0/714289881 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe42006c140 con 0x7fe4300b0010 2021-10-20T23:25:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.302+0000 7fe43493c700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe4100536a0 0x7fe410055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.306+0000 7fe43493c700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe4100536a0 0x7fe410055b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fe42400c000 tx=0x7fe424008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.314+0000 7fe42dffb700 1 -- 172.21.15.12:0/714289881 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4200430e0 con 0x7fe4300b0010 2021-10-20T23:25:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.474+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4300aa3e0 con 0x7fe4300b0010 2021-10-20T23:25:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.474+0000 7fe42dffb700 1 -- 172.21.15.12:0/714289881 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fe420016020 con 0x7fe4300b0010 2021-10-20T23:25:44.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:44.484 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:25:41.263533+0000","modified":"2021-10-20T23:25:42.936432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3651290992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3651290992},{"type":"v1","addr":"172.21.15.31:6835","nonce":3651290992}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-20T23:25:44.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe4100536a0 msgr2=0x7fe410055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:44.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe4100536a0 0x7fe410055b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fe42400c000 tx=0x7fe424008040).stop 2021-10-20T23:25:44.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4300b0010 msgr2=0x7fe4300aab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:44.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4300b0010 0x7fe4300aab70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fe4300abf30 tx=0x7fe4200091d0).stop 2021-10-20T23:25:44.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 shutdown_connections 2021-10-20T23:25:44.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe4100536a0 0x7fe410055b60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4300b2580 0x7fe4300ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4300b0010 0x7fe4300aab70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 --2- 172.21.15.12:0/714289881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4300afbd0 0x7fe43014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 >> 172.21.15.12:0/714289881 conn(0x7fe430060180 msgr2=0x7fe430149e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 shutdown_connections 2021-10-20T23:25:44.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:44.478+0000 7fe43593e700 1 -- 172.21.15.12:0/714289881 wait complete. 2021-10-20T23:25:44.488 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 38 2021-10-20T23:25:44.802 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:25:41.263533+0000', 'modified': '2021-10-20T23:25:42.936432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6231}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6231': {'gid': 6231, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3651290992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 3651290992}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3651290992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:25:44.803 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:25:44.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:25:44.919 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6231,"want_state":"up:active","state":"up:active","rank_uptime":3.6417278,"mdsmap_epoch":38,"osdmap_epoch":79,"osdmap_epoch_barrier":79,"uptime":7.8364789029999997} 2021-10-20T23:25:44.920 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6231, "mdsmap_epoch": 38, "osdmap_epoch": 79, "osdmap_epoch_barrier": 79, "rank_uptime": 3.6417278, "state": "up:active", "uptime": 7.836478903, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:25:44.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:25:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f074c85b700 1 Processor -- start 2021-10-20T23:25:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f074c85b700 1 -- start start 2021-10-20T23:25:45.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f074c85b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07480a9c10 0x7f07480607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f074c85b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0748140140 0x7f07481405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f074c85b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0748066ea0 con 0x7f07480b3040 2021-10-20T23:25:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f074c85b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07480648e0 con 0x7f07480a9c10 2021-10-20T23:25:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f074c85b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0748061dd0 con 0x7f0748140140 2021-10-20T23:25:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f07477fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f07480b3040 0x7f0748065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39530/0 (socket says 172.21.15.12:39530) 2021-10-20T23:25:45.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f07477fe700 1 -- 172.21.15.12:0/3655386948 learned_addr learned my addr 172.21.15.12:0/3655386948 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:45.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f0747fff700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0748140140 0x7f07481405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f0746ffd700 1 --2- 172.21.15.12:0/3655386948 >> v2:172.21.15.31:3300/0 conn(0x7f07480a9c10 0x7f07480607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251669484 0 0) 0x7f0748066ea0 con 0x7f07480b3040 2021-10-20T23:25:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.030+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0728003260 con 0x7f07480b3040 2021-10-20T23:25:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4240163360 0 0) 0x7f0728003260 con 0x7f07480b3040 2021-10-20T23:25:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0748140140 msgr2=0x7f07481405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0748140140 0x7f07481405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 >> v2:172.21.15.31:3300/0 conn(0x7f07480a9c10 msgr2=0x7f07480607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 --2- 172.21.15.12:0/3655386948 >> v2:172.21.15.31:3300/0 conn(0x7f07480a9c10 0x7f07480607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07480b3420 con 0x7f07480b3040 2021-10-20T23:25:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f07400019e0 con 0x7f07480b3040 2021-10-20T23:25:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 >> v1:172.21.15.12:6789/0 conn(0x7f07480b3040 legacy=0x7f0748065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0728003780 0x7f0728003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0748140140 0x7f0728004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07280049f0 0x7f0728004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728004330 con 0x7f07280049f0 2021-10-20T23:25:45.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072800b750 con 0x7f0728003780 2021-10-20T23:25:45.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072800b910 con 0x7f0748140140 2021-10-20T23:25:45.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f0747fff700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07280049f0 0x7f0728004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f0746ffd700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0748140140 0x7f0728004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07477fe700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0728003780 0x7f0728003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f0747fff700 1 -- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0748140140 msgr2=0x7f0728004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f0747fff700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0748140140 0x7f0728004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f0747fff700 1 -- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0728003780 msgr2=0x7f0728003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f0747fff700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0728003780 0x7f0728003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f0747fff700 1 -- 172.21.15.12:0/3655386948 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728003260 con 0x7f07280049f0 2021-10-20T23:25:45.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f0747fff700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07280049f0 0x7f0728004e70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f073800c000 tx=0x7f0738006df0).ready entity=mon.0 client_cookie=54db375634b0a025 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f073800e830 con 0x7f07280049f0 2021-10-20T23:25:45.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073800e990 con 0x7f07280049f0 2021-10-20T23:25:45.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f07467fc700 1 -- 172.21.15.12:0/3655386948 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f073800ecf0 con 0x7f07280049f0 2021-10-20T23:25:45.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f074c85b700 1 -- 172.21.15.12:0/3655386948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07280049f0 msgr2=0x7f0728004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f074c85b700 1 --2- 172.21.15.12:0/3655386948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07280049f0 0x7f0728004e70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f073800c000 tx=0x7f0738006df0).stop 2021-10-20T23:25:45.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f0747fff700 1 -- 172.21.15.12:0/3655386948 reap_dead start 2021-10-20T23:25:45.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f074c85b700 1 -- 172.21.15.12:0/3655386948 shutdown_connections 2021-10-20T23:25:45.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f074c85b700 1 -- 172.21.15.12:0/3655386948 >> 172.21.15.12:0/3655386948 conn(0x7f07480636e0 msgr2=0x7f0748063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:45.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f074c85b700 1 -- 172.21.15.12:0/3655386948 shutdown_connections 2021-10-20T23:25:45.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.034+0000 7f074c85b700 1 -- 172.21.15.12:0/3655386948 wait complete. 2021-10-20T23:25:45.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 Processor -- start 2021-10-20T23:25:45.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 -- start start 2021-10-20T23:25:45.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07280049f0 0x7f07480ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07480ab770 0x7f07480af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07480afad0 0x7f0748133600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0748136f30 con 0x7f07480afad0 2021-10-20T23:25:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0748136750 con 0x7f07480ab770 2021-10-20T23:25:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07481369f0 con 0x7f07280049f0 2021-10-20T23:25:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0747fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07480afad0 0x7f0748133600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0747fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07480afad0 0x7f0748133600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40952/0 (socket says 172.21.15.12:40952) 2021-10-20T23:25:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0747fff700 1 -- 172.21.15.12:0/648157630 learned_addr learned my addr 172.21.15.12:0/648157630 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f07477fe700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07280049f0 0x7f07480ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0746ffd700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07480ab770 0x7f07480af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0747fff700 1 -- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07280049f0 msgr2=0x7f07480ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0747fff700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07280049f0 0x7f07480ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0747fff700 1 -- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07480ab770 msgr2=0x7f07480af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0747fff700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07480ab770 0x7f07480af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0747fff700 1 -- 172.21.15.12:0/648157630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748136c90 con 0x7f07480afad0 2021-10-20T23:25:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0746ffd700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07480ab770 0x7f07480af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0747fff700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07480afad0 0x7f0748133600 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f0740001c40 tx=0x7f0738019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0744ff9700 1 -- 172.21.15.12:0/648157630 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0738012cd0 con 0x7f07480afad0 2021-10-20T23:25:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0744ff9700 1 -- 172.21.15.12:0/648157630 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0738022070 con 0x7f07480afad0 2021-10-20T23:25:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07481363d0 con 0x7f07480afad0 2021-10-20T23:25:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f0744ff9700 1 -- 172.21.15.12:0/648157630 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f073801b640 con 0x7f07480afad0 2021-10-20T23:25:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.038+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07480b02a0 con 0x7f07480afad0 2021-10-20T23:25:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.042+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07480b07d0 con 0x7f07480afad0 2021-10-20T23:25:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.042+0000 7f0744ff9700 1 -- 172.21.15.12:0/648157630 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f073802e070 con 0x7f07480afad0 2021-10-20T23:25:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.042+0000 7f0744ff9700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f072c0536d0 0x7f072c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.042+0000 7f0744ff9700 1 -- 172.21.15.12:0/648157630 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0738000e40 con 0x7f07480afad0 2021-10-20T23:25:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.042+0000 7f07477fe700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f072c0536d0 0x7f072c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.042+0000 7f07477fe700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f072c0536d0 0x7f072c055b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f0740005000 tx=0x7f0740002190).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.046+0000 7f0744ff9700 1 -- 172.21.15.12:0/648157630 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f07480b07d0 con 0x7f07480afad0 2021-10-20T23:25:45.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.174+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07480b02a0 con 0x7f07480afad0 2021-10-20T23:25:45.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f0744ff9700 1 -- 172.21.15.12:0/648157630 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f07480b02a0 con 0x7f07480afad0 2021-10-20T23:25:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:45.187 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":79,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:25:42.266158+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:25:39.858993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-20T23:25:40.250129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:25:45.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f072c0536d0 msgr2=0x7f072c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f072c0536d0 0x7f072c055b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f0740005000 tx=0x7f0740002190).stop 2021-10-20T23:25:45.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07480afad0 msgr2=0x7f0748133600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07480afad0 0x7f0748133600 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f0740001c40 tx=0x7f0738019000).stop 2021-10-20T23:25:45.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 shutdown_connections 2021-10-20T23:25:45.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f072c0536d0 0x7f072c055b90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07480afad0 0x7f0748133600 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07480ab770 0x7f07480af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 --2- 172.21.15.12:0/648157630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07280049f0 0x7f07480ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 >> 172.21.15.12:0/648157630 conn(0x7f07480636e0 msgr2=0x7f0748060110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:45.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 shutdown_connections 2021-10-20T23:25:45.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.178+0000 7f074c85b700 1 -- 172.21.15.12:0/648157630 wait complete. 2021-10-20T23:25:45.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:25:39.858993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:25:40.250129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:25:45.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:25:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.298+0000 7fe193cbd700 1 Processor -- start 2021-10-20T23:25:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.298+0000 7fe193cbd700 1 -- start start 2021-10-20T23:25:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe18c0acb70 0x7fe18c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 0x7fe18c0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c0ac7c0 con 0x7fe18c0b10c0 2021-10-20T23:25:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c0ac020 con 0x7fe18c0acb70 2021-10-20T23:25:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c141010 con 0x7fe18c140ba0 2021-10-20T23:25:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe191258700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe18c0acb70 0x7fe18c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe191258700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe18c0acb70 0x7fe18c0b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40956/0 (socket says 172.21.15.12:40956) 2021-10-20T23:25:45.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe191258700 1 -- 172.21.15.12:0/524319124 learned_addr learned my addr 172.21.15.12:0/524319124 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:45.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe191a59700 1 --1- 172.21.15.12:0/524319124 >> v1:172.21.15.12:6789/0 conn(0x7fe18c0b10c0 0x7fe18c13d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39550/0 (socket says 172.21.15.12:39550) 2021-10-20T23:25:45.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe19225a700 1 --2- 172.21.15.12:0/524319124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 0x7fe18c0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe191258700 1 -- 172.21.15.12:0/524319124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 msgr2=0x7fe18c0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe191258700 1 --2- 172.21.15.12:0/524319124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 0x7fe18c0b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe191258700 1 -- 172.21.15.12:0/524319124 >> v1:172.21.15.12:6789/0 conn(0x7fe18c0b10c0 legacy=0x7fe18c13d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe191258700 1 -- 172.21.15.12:0/524319124 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0ac280 con 0x7fe18c0acb70 2021-10-20T23:25:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe191258700 1 --2- 172.21.15.12:0/524319124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0acb70 0x7fe18c0b14a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe17c002f70 tx=0x7fe17c006eb0).ready entity=mon.0 client_cookie=dd6288a36a6a9d56 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe190a57700 1 -- 172.21.15.12:0/524319124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c00d570 con 0x7fe18c0acb70 2021-10-20T23:25:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe190a57700 1 -- 172.21.15.12:0/524319124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c000e90 con 0x7fe18c0acb70 2021-10-20T23:25:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe190a57700 1 -- 172.21.15.12:0/524319124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c00d900 con 0x7fe18c0acb70 2021-10-20T23:25:45.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 -- 172.21.15.12:0/524319124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0acb70 msgr2=0x7fe18c0b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 --2- 172.21.15.12:0/524319124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0acb70 0x7fe18c0b14a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe17c002f70 tx=0x7fe17c006eb0).stop 2021-10-20T23:25:45.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 -- 172.21.15.12:0/524319124 shutdown_connections 2021-10-20T23:25:45.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 --2- 172.21.15.12:0/524319124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 0x7fe18c0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 --2- 172.21.15.12:0/524319124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0acb70 0x7fe18c0b14a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 -- 172.21.15.12:0/524319124 >> 172.21.15.12:0/524319124 conn(0x7fe18c05f6b0 msgr2=0x7fe18c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:45.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 -- 172.21.15.12:0/524319124 shutdown_connections 2021-10-20T23:25:45.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.302+0000 7fe193cbd700 1 -- 172.21.15.12:0/524319124 wait complete. 2021-10-20T23:25:45.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 Processor -- start 2021-10-20T23:25:45.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 -- start start 2021-10-20T23:25:45.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0acb70 0x7fe18c13ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0b10c0 0x7fe18c150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 0x7fe18c0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c154370 con 0x7fe18c0b10c0 2021-10-20T23:25:45.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c154610 con 0x7fe18c0acb70 2021-10-20T23:25:45.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c150370 con 0x7fe18c140ba0 2021-10-20T23:25:45.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191258700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0b10c0 0x7fe18c150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191258700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0b10c0 0x7fe18c150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40962/0 (socket says 172.21.15.12:40962) 2021-10-20T23:25:45.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191258700 1 -- 172.21.15.12:0/143847816 learned_addr learned my addr 172.21.15.12:0/143847816 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:45.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191a59700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0acb70 0x7fe18c13ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe19225a700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 0x7fe18c0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191258700 1 -- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 msgr2=0x7fe18c0affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191258700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 0x7fe18c0affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191258700 1 -- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0acb70 msgr2=0x7fe18c13ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191258700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0acb70 0x7fe18c13ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191258700 1 -- 172.21.15.12:0/143847816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c00b1e0 con 0x7fe18c0b10c0 2021-10-20T23:25:45.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191a59700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0acb70 0x7fe18c13ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe191258700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0b10c0 0x7fe18c150ab0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe17c002f70 tx=0x7fe17c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe17affd700 1 -- 172.21.15.12:0/143847816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c011760 con 0x7fe18c0b10c0 2021-10-20T23:25:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe17affd700 1 -- 172.21.15.12:0/143847816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c0118c0 con 0x7fe18c0b10c0 2021-10-20T23:25:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c150610 con 0x7fe18c0b10c0 2021-10-20T23:25:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe17affd700 1 -- 172.21.15.12:0/143847816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c011c20 con 0x7fe18c0b10c0 2021-10-20T23:25:45.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.306+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c1440b0 con 0x7fe18c0b10c0 2021-10-20T23:25:45.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.310+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c144390 con 0x7fe18c0b10c0 2021-10-20T23:25:45.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.310+0000 7fe17affd700 1 -- 172.21.15.12:0/143847816 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe17c025030 con 0x7fe18c0b10c0 2021-10-20T23:25:45.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.310+0000 7fe17affd700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe16c053610 0x7fe16c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.310+0000 7fe17affd700 1 -- 172.21.15.12:0/143847816 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe17c06ca80 con 0x7fe18c0b10c0 2021-10-20T23:25:45.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.310+0000 7fe191a59700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe16c053610 0x7fe16c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.310+0000 7fe191a59700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe16c053610 0x7fe16c055ad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fe18800d000 tx=0x7fe188007b80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.314+0000 7fe17affd700 1 -- 172.21.15.12:0/143847816 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe17c043a80 con 0x7fe18c0b10c0 2021-10-20T23:25:45.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.442+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe18c1507a0 con 0x7fe18c0b10c0 2021-10-20T23:25:45.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.442+0000 7fe17affd700 1 -- 172.21.15.12:0/143847816 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe17c023020 con 0x7fe18c0b10c0 2021-10-20T23:25:45.454 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:25:45.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe16c053610 msgr2=0x7fe16c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe16c053610 0x7fe16c055ad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fe18800d000 tx=0x7fe188007b80).stop 2021-10-20T23:25:45.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0b10c0 msgr2=0x7fe18c150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0b10c0 0x7fe18c150ab0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe17c002f70 tx=0x7fe17c015000).stop 2021-10-20T23:25:45.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 shutdown_connections 2021-10-20T23:25:45.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe16c053610 0x7fe16c055ad0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c140ba0 0x7fe18c0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0b10c0 0x7fe18c150ab0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 --2- 172.21.15.12:0/143847816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0acb70 0x7fe18c13ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 >> 172.21.15.12:0/143847816 conn(0x7fe18c05f6b0 msgr2=0x7fe18c13ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:45.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 shutdown_connections 2021-10-20T23:25:45.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.446+0000 7fe193cbd700 1 -- 172.21.15.12:0/143847816 wait complete. 2021-10-20T23:25:45.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:25:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.566+0000 7f89e9c20700 1 Processor -- start 2021-10-20T23:25:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.566+0000 7f89e9c20700 1 -- start start 2021-10-20T23:25:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89e40b0710 0x7f89e4142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e4143920 con 0x7f89e40ace70 2021-10-20T23:25:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e40b0af0 con 0x7f89e40b30d0 2021-10-20T23:25:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e40ae680 con 0x7f89e40b0710 2021-10-20T23:25:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e941f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f89e40ace70 0x7f89e413f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39566/0 (socket says 172.21.15.12:39566) 2021-10-20T23:25:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e941f700 1 -- 172.21.15.12:0/15238401 learned_addr learned my addr 172.21.15.12:0/15238401 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:45.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e8c1e700 1 --2- 172.21.15.12:0/15238401 >> v2:172.21.15.12:3300/0 conn(0x7f89e40b0710 0x7f89e4142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89db7fe700 1 -- 172.21.15.12:0/15238401 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761948102 0 0) 0x7f89e4143920 con 0x7f89e40ace70 2021-10-20T23:25:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89db7fe700 1 -- 172.21.15.12:0/15238401 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d0003260 con 0x7f89e40ace70 2021-10-20T23:25:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89db7fe700 1 -- 172.21.15.12:0/15238401 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981635616 0 0) 0x7f89e40b0af0 con 0x7f89e40b30d0 2021-10-20T23:25:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e8c1e700 1 -- 172.21.15.12:0/15238401 >> v1:172.21.15.31:6789/0 conn(0x7f89e40b30d0 legacy=0x7f89e4143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e8c1e700 1 -- 172.21.15.12:0/15238401 >> v1:172.21.15.12:6789/0 conn(0x7f89e40ace70 legacy=0x7f89e413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e8c1e700 1 -- 172.21.15.12:0/15238401 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40ae920 con 0x7f89e40b0710 2021-10-20T23:25:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e8c1e700 1 --2- 172.21.15.12:0/15238401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 0x7f89e4142d20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f89e0002f70 tx=0x7f89e0006e80).ready entity=mon.0 client_cookie=719dd6551c4f305b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89db7fe700 1 -- 172.21.15.12:0/15238401 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e0014070 con 0x7f89e40b0710 2021-10-20T23:25:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89db7fe700 1 -- 172.21.15.12:0/15238401 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0000e90 con 0x7f89e40b0710 2021-10-20T23:25:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89db7fe700 1 -- 172.21.15.12:0/15238401 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e00107f0 con 0x7f89e40b0710 2021-10-20T23:25:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 -- 172.21.15.12:0/15238401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 msgr2=0x7f89e4142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 --2- 172.21.15.12:0/15238401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 0x7f89e4142d20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f89e0002f70 tx=0x7f89e0006e80).stop 2021-10-20T23:25:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 -- 172.21.15.12:0/15238401 shutdown_connections 2021-10-20T23:25:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 --2- 172.21.15.12:0/15238401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 0x7f89e4142d20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 -- 172.21.15.12:0/15238401 >> 172.21.15.12:0/15238401 conn(0x7f89e4061140 msgr2=0x7f89e4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 -- 172.21.15.12:0/15238401 shutdown_connections 2021-10-20T23:25:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.570+0000 7f89e9c20700 1 -- 172.21.15.12:0/15238401 wait complete. 2021-10-20T23:25:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e9c20700 1 Processor -- start 2021-10-20T23:25:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e9c20700 1 -- start start 2021-10-20T23:25:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e9c20700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89e40ace70 0x7f89e413dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e9c20700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 0x7f89e4140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e9c20700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89e40b30d0 0x7f89e4067760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e9c20700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e413dba0 con 0x7f89e40b0710 2021-10-20T23:25:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e9c20700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e4067c50 con 0x7f89e40b30d0 2021-10-20T23:25:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e9c20700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e413e5d0 con 0x7f89e40ace70 2021-10-20T23:25:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 0x7f89e4140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 0x7f89e4140820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40978/0 (socket says 172.21.15.12:40978) 2021-10-20T23:25:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89dbfff700 1 -- 172.21.15.12:0/159929405 learned_addr learned my addr 172.21.15.12:0/159929405 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e8c1e700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89e40ace70 0x7f89e413dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89e941f700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89e40b30d0 0x7f89e4067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89dbfff700 1 -- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89e40ace70 msgr2=0x7f89e413dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89dbfff700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89e40ace70 0x7f89e413dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89dbfff700 1 -- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89e40b30d0 msgr2=0x7f89e4067760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89dbfff700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89e40b30d0 0x7f89e4067760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89dbfff700 1 -- 172.21.15.12:0/159929405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e000c310 con 0x7f89e40b0710 2021-10-20T23:25:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.574+0000 7f89dbfff700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 0x7f89e4140820 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f89e413e4f0 tx=0x7f89d4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89d9ffb700 1 -- 172.21.15.12:0/159929405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d4012400 con 0x7f89e40b0710 2021-10-20T23:25:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89d9ffb700 1 -- 172.21.15.12:0/159929405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4012560 con 0x7f89e40b0710 2021-10-20T23:25:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e40a2d60 con 0x7f89e40b0710 2021-10-20T23:25:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89d9ffb700 1 -- 172.21.15.12:0/159929405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d40128c0 con 0x7f89e40b0710 2021-10-20T23:25:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e413e870 con 0x7f89e40b0710 2021-10-20T23:25:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e4057350 con 0x7f89e40b0710 2021-10-20T23:25:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89d9ffb700 1 -- 172.21.15.12:0/159929405 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f89d4019030 con 0x7f89e40b0710 2021-10-20T23:25:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89d9ffb700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89c4053580 0x7f89c4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89d9ffb700 1 -- 172.21.15.12:0/159929405 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f89d406ae10 con 0x7f89e40b0710 2021-10-20T23:25:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.578+0000 7f89e8c1e700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89c4053580 0x7f89c4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.582+0000 7f89e8c1e700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89c4053580 0x7f89c4055a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f89e001c000 tx=0x7f89e40ae5a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.586+0000 7f89d9ffb700 1 -- 172.21.15.12:0/159929405 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f89d4041e10 con 0x7f89e40b0710 2021-10-20T23:25:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.710+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89e40b2c70 con 0x7f89e40b0710 2021-10-20T23:25:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89d9ffb700 1 -- 172.21.15.12:0/159929405 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7f89d4045430 con 0x7f89e40b0710 2021-10-20T23:25:45.719 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89c4053580 msgr2=0x7f89c4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89c4053580 0x7f89c4055a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f89e001c000 tx=0x7f89e40ae5a0).stop 2021-10-20T23:25:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 msgr2=0x7f89e4140820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 0x7f89e4140820 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f89e413e4f0 tx=0x7f89d4007c50).stop 2021-10-20T23:25:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 shutdown_connections 2021-10-20T23:25:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89c4053580 0x7f89c4055a40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89e40b30d0 0x7f89e4067760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e40b0710 0x7f89e4140820 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 --2- 172.21.15.12:0/159929405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89e40ace70 0x7f89e413dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 >> 172.21.15.12:0/159929405 conn(0x7f89e4061140 msgr2=0x7f89e4141e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 shutdown_connections 2021-10-20T23:25:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.714+0000 7f89e9c20700 1 -- 172.21.15.12:0/159929405 wait complete. 2021-10-20T23:25:45.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:25:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034bfff700 1 Processor -- start 2021-10-20T23:25:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034bfff700 1 -- start start 2021-10-20T23:25:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f034c061680 0x7f034c0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c0b4710 0x7f034c0ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c0b6910 con 0x7f034c1439a0 2021-10-20T23:25:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034bfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c0b9680 con 0x7f034c061680 2021-10-20T23:25:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c0b6bb0 con 0x7f034c0b4710 2021-10-20T23:25:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f034c1439a0 0x7f034c13fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39580/0 (socket says 172.21.15.12:39580) 2021-10-20T23:25:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034b7fe700 1 -- 172.21.15.12:0/399597975 learned_addr learned my addr 172.21.15.12:0/399597975 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034a7fc700 1 --2- 172.21.15.12:0/399597975 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c0b4710 0x7f034c0ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.838+0000 7f034affd700 1 --2- 172.21.15.12:0/399597975 >> v2:172.21.15.31:3300/0 conn(0x7f034c061680 0x7f034c0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f0349ffb700 1 -- 172.21.15.12:0/399597975 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602124618 0 0) 0x7f034c0b6910 con 0x7f034c1439a0 2021-10-20T23:25:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f0349ffb700 1 -- 172.21.15.12:0/399597975 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f032c003260 con 0x7f034c1439a0 2021-10-20T23:25:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034affd700 1 -- 172.21.15.12:0/399597975 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c0b4710 msgr2=0x7f034c0ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034affd700 1 --2- 172.21.15.12:0/399597975 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c0b4710 0x7f034c0ba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034affd700 1 -- 172.21.15.12:0/399597975 >> v1:172.21.15.12:6789/0 conn(0x7f034c1439a0 legacy=0x7f034c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034affd700 1 -- 172.21.15.12:0/399597975 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c0b6e50 con 0x7f034c061680 2021-10-20T23:25:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034affd700 1 --2- 172.21.15.12:0/399597975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f034c061680 0x7f034c0b9d10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f0334002f70 tx=0x7f0334006df0).ready entity=mon.1 client_cookie=95c36cfacb4456b8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f0349ffb700 1 -- 172.21.15.12:0/399597975 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033400d4a0 con 0x7f034c061680 2021-10-20T23:25:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f0349ffb700 1 -- 172.21.15.12:0/399597975 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0334000e90 con 0x7f034c061680 2021-10-20T23:25:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f0349ffb700 1 -- 172.21.15.12:0/399597975 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033400d7f0 con 0x7f034c061680 2021-10-20T23:25:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 -- 172.21.15.12:0/399597975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f034c061680 msgr2=0x7f034c0b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 --2- 172.21.15.12:0/399597975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f034c061680 0x7f034c0b9d10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f0334002f70 tx=0x7f0334006df0).stop 2021-10-20T23:25:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 -- 172.21.15.12:0/399597975 shutdown_connections 2021-10-20T23:25:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 --2- 172.21.15.12:0/399597975 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c0b4710 0x7f034c0ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 --2- 172.21.15.12:0/399597975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f034c061680 0x7f034c0b9d10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 -- 172.21.15.12:0/399597975 >> 172.21.15.12:0/399597975 conn(0x7f034c06adf0 msgr2=0x7f034c05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 -- 172.21.15.12:0/399597975 shutdown_connections 2021-10-20T23:25:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 -- 172.21.15.12:0/399597975 wait complete. 2021-10-20T23:25:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 Processor -- start 2021-10-20T23:25:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.842+0000 7f034bfff700 1 -- start start 2021-10-20T23:25:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f034c061680 0x7f034c0b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034c1439a0 0x7f034c0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c1522f0 0x7f034c13f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c146460 con 0x7f034c1439a0 2021-10-20T23:25:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c146af0 con 0x7f034c061680 2021-10-20T23:25:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c146d70 con 0x7f034c1522f0 2021-10-20T23:25:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034c1439a0 0x7f034c0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034c1439a0 0x7f034c0b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40990/0 (socket says 172.21.15.12:40990) 2021-10-20T23:25:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034a7fc700 1 -- 172.21.15.12:0/294521346 learned_addr learned my addr 172.21.15.12:0/294521346 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034affd700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f034c061680 0x7f034c0b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034b7fe700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c1522f0 0x7f034c13f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034a7fc700 1 -- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c1522f0 msgr2=0x7f034c13f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034a7fc700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c1522f0 0x7f034c13f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034a7fc700 1 -- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f034c061680 msgr2=0x7f034c0b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034a7fc700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f034c061680 0x7f034c0b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034a7fc700 1 -- 172.21.15.12:0/294521346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033400b180 con 0x7f034c1439a0 2021-10-20T23:25:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034a7fc700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034c1439a0 0x7f034c0b0490 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f033c00c000 tx=0x7f033c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f0343fff700 1 -- 172.21.15.12:0/294521346 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033c010780 con 0x7f034c1439a0 2021-10-20T23:25:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f0343fff700 1 -- 172.21.15.12:0/294521346 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c0108e0 con 0x7f034c1439a0 2021-10-20T23:25:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f0343fff700 1 -- 172.21.15.12:0/294521346 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033c010c40 con 0x7f034c1439a0 2021-10-20T23:25:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c0adcd0 con 0x7f034c1439a0 2021-10-20T23:25:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c146650 con 0x7f034c1439a0 2021-10-20T23:25:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f0343fff700 1 -- 172.21.15.12:0/294521346 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f033c01c460 con 0x7f034c1439a0 2021-10-20T23:25:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c0b0b20 con 0x7f034c1439a0 2021-10-20T23:25:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.846+0000 7f0343fff700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03300536a0 0x7f0330055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.850+0000 7f0343fff700 1 -- 172.21.15.12:0/294521346 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f033c06be80 con 0x7f034c1439a0 2021-10-20T23:25:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.850+0000 7f034affd700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03300536a0 0x7f0330055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.850+0000 7f034affd700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03300536a0 0x7f0330055b60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f033401a000 tx=0x7f0334014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.850+0000 7f0343fff700 1 -- 172.21.15.12:0/294521346 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f033c042d80 con 0x7f034c1439a0 2021-10-20T23:25:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.974+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f034c057350 con 0x7f034c1439a0 2021-10-20T23:25:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f0343fff700 1 -- 172.21.15.12:0/294521346 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+10 (secure 0 0 0) 0x7f033c0463a0 con 0x7f034c1439a0 2021-10-20T23:25:45.983 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03300536a0 msgr2=0x7f0330055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03300536a0 0x7f0330055b60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f033401a000 tx=0x7f0334014000).stop 2021-10-20T23:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034c1439a0 msgr2=0x7f034c0b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034c1439a0 0x7f034c0b0490 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f033c00c000 tx=0x7f033c006df0).stop 2021-10-20T23:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 shutdown_connections 2021-10-20T23:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03300536a0 0x7f0330055b60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f034c1522f0 0x7f034c13f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034c1439a0 0x7f034c0b0490 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 --2- 172.21.15.12:0/294521346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f034c061680 0x7f034c0b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 >> 172.21.15.12:0/294521346 conn(0x7f034c06adf0 msgr2=0x7f034c1423d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 shutdown_connections 2021-10-20T23:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:45.978+0000 7f034bfff700 1 -- 172.21.15.12:0/294521346 wait complete. 2021-10-20T23:25:45.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:25:46.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 Processor -- start 2021-10-20T23:25:46.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 -- start start 2021-10-20T23:25:46.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9440b4180 0x7ff944140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9440b4690 0x7ff9440b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff944143b60 con 0x7ff944146950 2021-10-20T23:25:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff944147510 con 0x7ff9440b4690 2021-10-20T23:25:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff944143e00 con 0x7ff9440b4180 2021-10-20T23:25:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff949c96700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9440b4690 0x7ff9440b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff949c96700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9440b4690 0x7ff9440b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41000/0 (socket says 172.21.15.12:41000) 2021-10-20T23:25:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff949c96700 1 -- 172.21.15.12:0/2247241303 learned_addr learned my addr 172.21.15.12:0/2247241303 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff948c94700 1 --2- 172.21.15.12:0/2247241303 >> v2:172.21.15.31:3300/0 conn(0x7ff9440b4180 0x7ff944140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff949c96700 1 -- 172.21.15.12:0/2247241303 >> v2:172.21.15.31:3300/0 conn(0x7ff9440b4180 msgr2=0x7ff944140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff949c96700 1 --2- 172.21.15.12:0/2247241303 >> v2:172.21.15.31:3300/0 conn(0x7ff9440b4180 0x7ff944140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff949c96700 1 -- 172.21.15.12:0/2247241303 >> v1:172.21.15.31:6789/0 conn(0x7ff944146950 legacy=0x7ff944140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff949c96700 1 -- 172.21.15.12:0/2247241303 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440b0c90 con 0x7ff9440b4690 2021-10-20T23:25:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff949c96700 1 --2- 172.21.15.12:0/2247241303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4690 0x7ff9440b4ed0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7ff93c0032f0 tx=0x7ff93c009290).ready entity=mon.0 client_cookie=2afcadcab9f98b6d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff933fff700 1 -- 172.21.15.12:0/2247241303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff93c00b870 con 0x7ff9440b4690 2021-10-20T23:25:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff933fff700 1 -- 172.21.15.12:0/2247241303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00b9d0 con 0x7ff9440b4690 2021-10-20T23:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff933fff700 1 -- 172.21.15.12:0/2247241303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff93c00bb40 con 0x7ff9440b4690 2021-10-20T23:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2247241303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4690 msgr2=0x7ff9440b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 --2- 172.21.15.12:0/2247241303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4690 0x7ff9440b4ed0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7ff93c0032f0 tx=0x7ff93c009290).stop 2021-10-20T23:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2247241303 shutdown_connections 2021-10-20T23:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 --2- 172.21.15.12:0/2247241303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4690 0x7ff9440b4ed0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 --2- 172.21.15.12:0/2247241303 >> v2:172.21.15.31:3300/0 conn(0x7ff9440b4180 0x7ff944140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2247241303 >> 172.21.15.12:0/2247241303 conn(0x7ff94405c490 msgr2=0x7ff94405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2247241303 shutdown_connections 2021-10-20T23:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.106+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2247241303 wait complete. 2021-10-20T23:25:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 Processor -- start 2021-10-20T23:25:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 -- start start 2021-10-20T23:25:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4180 0x7ff944141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9440b4690 0x7ff944156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff944146950 0x7ff9441529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440b87d0 con 0x7ff9440b4180 2021-10-20T23:25:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440b8a70 con 0x7ff9440b4690 2021-10-20T23:25:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440b8d10 con 0x7ff944146950 2021-10-20T23:25:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949495700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4180 0x7ff944141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949495700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4180 0x7ff944141d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41002/0 (socket says 172.21.15.12:41002) 2021-10-20T23:25:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949495700 1 -- 172.21.15.12:0/2513695258 learned_addr learned my addr 172.21.15.12:0/2513695258 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949c96700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff944146950 0x7ff9441529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff948c94700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9440b4690 0x7ff944156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949495700 1 -- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff944146950 msgr2=0x7ff9441529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949495700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff944146950 0x7ff9441529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949495700 1 -- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9440b4690 msgr2=0x7ff944156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949495700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9440b4690 0x7ff944156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949495700 1 -- 172.21.15.12:0/2513695258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c009530 con 0x7ff9440b4180 2021-10-20T23:25:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff949495700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4180 0x7ff944141d70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7ff944060c50 tx=0x7ff940007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff9327fc700 1 -- 172.21.15.12:0/2513695258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94000ce30 con 0x7ff9440b4180 2021-10-20T23:25:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff9327fc700 1 -- 172.21.15.12:0/2513695258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff940007240 con 0x7ff9440b4180 2021-10-20T23:25:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff944156950 con 0x7ff9440b4180 2021-10-20T23:25:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff9327fc700 1 -- 172.21.15.12:0/2513695258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff940006700 con 0x7ff9440b4180 2021-10-20T23:25:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.110+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9440af1e0 con 0x7ff9440b4180 2021-10-20T23:25:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.114+0000 7ff9327fc700 1 -- 172.21.15.12:0/2513695258 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff940010030 con 0x7ff9440b4180 2021-10-20T23:25:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.114+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944057350 con 0x7ff9440b4180 2021-10-20T23:25:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.114+0000 7ff9327fc700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9240534f0 0x7ff9240559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.114+0000 7ff9327fc700 1 -- 172.21.15.12:0/2513695258 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff94006b710 con 0x7ff9440b4180 2021-10-20T23:25:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.114+0000 7ff948c94700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9240534f0 0x7ff9240559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.114+0000 7ff948c94700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9240534f0 0x7ff9240559b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ff93400b000 tx=0x7ff934008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.122+0000 7ff9327fc700 1 -- 172.21.15.12:0/2513695258 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff940042710 con 0x7ff9440b4180 2021-10-20T23:25:46.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.250+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9440b6c40 con 0x7ff9440b4180 2021-10-20T23:25:46.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.250+0000 7ff9327fc700 1 -- 172.21.15.12:0/2513695258 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff940045d30 con 0x7ff9440b4180 2021-10-20T23:25:46.258 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:46.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9240534f0 msgr2=0x7ff9240559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9240534f0 0x7ff9240559b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ff93400b000 tx=0x7ff934008040).stop 2021-10-20T23:25:46.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4180 msgr2=0x7ff944141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4180 0x7ff944141d70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7ff944060c50 tx=0x7ff940007c10).stop 2021-10-20T23:25:46.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 shutdown_connections 2021-10-20T23:25:46.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9240534f0 0x7ff9240559b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff944146950 0x7ff9441529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9440b4690 0x7ff944156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 --2- 172.21.15.12:0/2513695258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9440b4180 0x7ff944141d70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 >> 172.21.15.12:0/2513695258 conn(0x7ff94405c490 msgr2=0x7ff94413b320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:46.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 shutdown_connections 2021-10-20T23:25:46.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.254+0000 7ff94b6f9700 1 -- 172.21.15.12:0/2513695258 wait complete. 2021-10-20T23:25:46.277 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:25:46.277 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:46.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696ffff700 1 Processor -- start 2021-10-20T23:25:46.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696ffff700 1 -- start start 2021-10-20T23:25:46.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f69700b2580 0x7f697014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f697014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696ffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69700a70c0 con 0x7f69700afbd0 2021-10-20T23:25:46.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69700a72f0 con 0x7f69700b2580 2021-10-20T23:25:46.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69700a7590 con 0x7f69700b0010 2021-10-20T23:25:46.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f69700b2580 0x7f697014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f697014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f697014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46768/0 (socket says 172.21.15.12:46768) 2021-10-20T23:25:46.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.374+0000 7f696e7fc700 1 -- 172.21.15.12:0/2998967974 learned_addr learned my addr 172.21.15.12:0/2998967974 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:46.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696e7fc700 1 -- 172.21.15.12:0/2998967974 >> v2:172.21.15.12:3300/0 conn(0x7f69700b2580 msgr2=0x7f697014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:46.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696e7fc700 1 --2- 172.21.15.12:0/2998967974 >> v2:172.21.15.12:3300/0 conn(0x7f69700b2580 0x7f697014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696e7fc700 1 -- 172.21.15.12:0/2998967974 >> v1:172.21.15.31:6789/0 conn(0x7f69700afbd0 legacy=0x7f69700a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696e7fc700 1 -- 172.21.15.12:0/2998967974 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69700a7830 con 0x7f69700b0010 2021-10-20T23:25:46.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696e7fc700 1 --2- 172.21.15.12:0/2998967974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f697014b330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f69600032f0 tx=0x7f6960009290).ready entity=mon.2 client_cookie=161d6a27f1d37fe6 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:46.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696dffb700 1 -- 172.21.15.12:0/2998967974 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f696000b8a0 con 0x7f69700b0010 2021-10-20T23:25:46.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696dffb700 1 -- 172.21.15.12:0/2998967974 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696000ba00 con 0x7f69700b0010 2021-10-20T23:25:46.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696dffb700 1 -- 172.21.15.12:0/2998967974 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f696000bb70 con 0x7f69700b0010 2021-10-20T23:25:46.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 -- 172.21.15.12:0/2998967974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 msgr2=0x7f697014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 --2- 172.21.15.12:0/2998967974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f697014b330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f69600032f0 tx=0x7f6960009290).stop 2021-10-20T23:25:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 -- 172.21.15.12:0/2998967974 shutdown_connections 2021-10-20T23:25:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 --2- 172.21.15.12:0/2998967974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f697014b330 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 --2- 172.21.15.12:0/2998967974 >> v2:172.21.15.12:3300/0 conn(0x7f69700b2580 0x7f697014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 -- 172.21.15.12:0/2998967974 >> 172.21.15.12:0/2998967974 conn(0x7f6970060180 msgr2=0x7f69700b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 -- 172.21.15.12:0/2998967974 shutdown_connections 2021-10-20T23:25:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 -- 172.21.15.12:0/2998967974 wait complete. 2021-10-20T23:25:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 Processor -- start 2021-10-20T23:25:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.378+0000 7f696ffff700 1 -- start start 2021-10-20T23:25:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69700afbd0 0x7f69700aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f6970144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69700b2580 0x7f69700abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6970156f70 con 0x7f69700afbd0 2021-10-20T23:25:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69700a91c0 con 0x7f69700b2580 2021-10-20T23:25:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6970157170 con 0x7f69700b0010 2021-10-20T23:25:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69700afbd0 0x7f69700aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69700afbd0 0x7f69700aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41018/0 (socket says 172.21.15.12:41018) 2021-10-20T23:25:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696effd700 1 -- 172.21.15.12:0/4252103661 learned_addr learned my addr 172.21.15.12:0/4252103661 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696e7fc700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f6970144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696f7fe700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69700b2580 0x7f69700abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696effd700 1 -- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 msgr2=0x7f6970144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696effd700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f6970144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696effd700 1 -- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69700b2580 msgr2=0x7f69700abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696effd700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69700b2580 0x7f69700abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696effd700 1 -- 172.21.15.12:0/4252103661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6960009530 con 0x7f69700afbd0 2021-10-20T23:25:46.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696f7fe700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69700b2580 0x7f69700abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:46.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696effd700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69700afbd0 0x7f69700aeed0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f696400c000 tx=0x7f6964006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:46.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f695ffff700 1 -- 172.21.15.12:0/4252103661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6964011750 con 0x7f69700afbd0 2021-10-20T23:25:46.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f695ffff700 1 -- 172.21.15.12:0/4252103661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69640118b0 con 0x7f69700afbd0 2021-10-20T23:25:46.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69700a93f0 con 0x7f69700afbd0 2021-10-20T23:25:46.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f695ffff700 1 -- 172.21.15.12:0/4252103661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6964011c10 con 0x7f69700afbd0 2021-10-20T23:25:46.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6970145240 con 0x7f69700afbd0 2021-10-20T23:25:46.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.382+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6970057350 con 0x7f69700afbd0 2021-10-20T23:25:46.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.386+0000 7f695ffff700 1 -- 172.21.15.12:0/4252103661 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6964011d70 con 0x7f69700afbd0 2021-10-20T23:25:46.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.386+0000 7f695ffff700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f694c053610 0x7f694c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:46.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.386+0000 7f695ffff700 1 -- 172.21.15.12:0/4252103661 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f696406bfd0 con 0x7f69700afbd0 2021-10-20T23:25:46.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.386+0000 7f696e7fc700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f694c053610 0x7f694c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:46.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.386+0000 7f696e7fc700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f694c053610 0x7f694c055ad0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f696001b000 tx=0x7f6960016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:46.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.394+0000 7f695ffff700 1 -- 172.21.15.12:0/4252103661 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6964042ec0 con 0x7f69700afbd0 2021-10-20T23:25:46.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.562+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69700698e0 con 0x7f69700afbd0 2021-10-20T23:25:46.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.562+0000 7f695ffff700 1 -- 172.21.15.12:0/4252103661 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f69640464e0 con 0x7f69700afbd0 2021-10-20T23:25:46.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:46.569 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:25:41.263533+0000","modified":"2021-10-20T23:25:42.936432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3651290992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3651290992},{"type":"v1","addr":"172.21.15.31:6835","nonce":3651290992}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-20T23:25:46.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f694c053610 msgr2=0x7f694c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f694c053610 0x7f694c055ad0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f696001b000 tx=0x7f6960016000).stop 2021-10-20T23:25:46.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69700afbd0 msgr2=0x7f69700aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69700afbd0 0x7f69700aeed0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f696400c000 tx=0x7f6964006df0).stop 2021-10-20T23:25:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 shutdown_connections 2021-10-20T23:25:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f694c053610 0x7f694c055ad0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69700b2580 0x7f69700abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69700b0010 0x7f6970144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 --2- 172.21.15.12:0/4252103661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69700afbd0 0x7f69700aeed0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:46.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 >> 172.21.15.12:0/4252103661 conn(0x7f6970060180 msgr2=0x7f6970146010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:46.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 shutdown_connections 2021-10-20T23:25:46.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:46.566+0000 7f696ffff700 1 -- 172.21.15.12:0/4252103661 wait complete. 2021-10-20T23:25:46.575 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 38 2021-10-20T23:25:46.887 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:25:41.263533+0000', 'modified': '2021-10-20T23:25:42.936432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6231}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6231': {'gid': 6231, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3651290992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 3651290992}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3651290992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:25:46.888 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:25:46.889 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:25:47.010 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6231,"want_state":"up:active","state":"up:active","rank_uptime":5.7317219860000002,"mdsmap_epoch":38,"osdmap_epoch":79,"osdmap_epoch_barrier":79,"uptime":9.9264684499999998} 2021-10-20T23:25:47.010 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6231, "mdsmap_epoch": 38, "osdmap_epoch": 79, "osdmap_epoch_barrier": 79, "rank_uptime": 5.731721986, "state": "up:active", "uptime": 9.92646845, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:25:47.011 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:25:47.011 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:25:47.012 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:25:47.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:47.012 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:47.022 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:25:47.037 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:25:47.038 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:25:47.096 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:25:47.097 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:25:47.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:47.099 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:25:47.104 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:25:47.105 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:47.108 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:25:47.125 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:25:47.126 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:25:47.183 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:25:47.184 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:25:47.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:47.185 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:25:47.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:25:47.177+0000 7fcf125e8080 -1 init, newargv = 0x556942ac9e00 newargc=9ceph-fuse[ 2021-10-20T23:25:47.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:14372]: starting ceph client 2021-10-20T23:25:47.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14372]: starting fuse 2021-10-20T23:25:48.293 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:25:48.403 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:25:48.404 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:25:48.464 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:25:48.466 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:25:48.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:48.467 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:25:48.473 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:25:48.473 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:25:48.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:48.474 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:25:48.475 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:25:48.475 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:25:48.476 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:25:48.476 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:25:48.476 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:48.477 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:25:48.477 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:25:48.478 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:25:48.478 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:48.478 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:25:48.479 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:25:48.480 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:25:48.480 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:25:48.481 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:48.481 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:25:48.482 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:25:48.482 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:25:48.483 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:25:48.483 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:25:48.484 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:48.484 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:25:48.485 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:25:48.562 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14372.asok 2021-10-20T23:25:48.567 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14372.asok 2021-10-20T23:25:48.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:48.568 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14372.asok status 2021-10-20T23:25:48.660 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:25:48.661 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:25:48.661 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:25:48.661 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:25:48.661 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:25:48.662 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:25:48.662 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:25:48.662 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14372", 2021-10-20T23:25:48.662 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:25:48.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:25:48.663 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:25:48.663 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:25:48.664 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 6424, 2021-10-20T23:25:48.665 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:25:48.665 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:25:48.665 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:25:48.666 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 6424 2021-10-20T23:25:48.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:25:48.666 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:25:48.666 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:25:48.667 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:25:48.667 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1668581666 2021-10-20T23:25:48.667 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:25:48.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:25:48.667 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:25:48.668 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:25:48.668 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:25:48.668 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1668581666 2021-10-20T23:25:48.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:25:48.669 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.6424 172.21.15.119:0/1668581666", 2021-10-20T23:25:48.669 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/1668581666", 2021-10-20T23:25:48.669 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:25:48.669 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 38, 2021-10-20T23:25:48.669 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 79, 2021-10-20T23:25:48.670 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:25:48.670 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:25:48.670 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:25:48.670 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:25:48.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:48.672 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:48.673 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:48.680 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:25:48.681 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:25:48.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:48.682 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:48.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:25:48.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.850+0000 7f130359e700 1 Processor -- start 2021-10-20T23:25:48.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.850+0000 7f130359e700 1 -- start start 2021-10-20T23:25:48.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.850+0000 7f130359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13040b3060 0x7f13040b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:48.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.850+0000 7f130359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040aac20 0x7f1304064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:48.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.850+0000 7f130359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13040b2380 con 0x7f13040b7370 2021-10-20T23:25:48.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.850+0000 7f130359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1304144250 con 0x7f13040b3060 2021-10-20T23:25:48.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.850+0000 7f130359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13040b3570 con 0x7f13040aac20 2021-10-20T23:25:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f12fbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13040b3060 0x7f13040b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1302d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040aac20 0x7f1304064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f13040b7370 0x7f130413e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39620/0 (socket says 172.21.15.12:39620) 2021-10-20T23:25:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130259c700 1 -- 172.21.15.12:0/2961494523 learned_addr learned my addr 172.21.15.12:0/2961494523 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1301d9b700 1 -- 172.21.15.12:0/2961494523 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557755053 0 0) 0x7f13040b2380 con 0x7f13040b7370 2021-10-20T23:25:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1302d9d700 1 -- 172.21.15.12:0/2961494523 >> v2:172.21.15.31:3300/0 conn(0x7f13040b3060 msgr2=0x7f13040b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1302d9d700 1 --2- 172.21.15.12:0/2961494523 >> v2:172.21.15.31:3300/0 conn(0x7f13040b3060 0x7f13040b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1302d9d700 1 -- 172.21.15.12:0/2961494523 >> v1:172.21.15.12:6789/0 conn(0x7f13040b7370 legacy=0x7f130413e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1302d9d700 1 -- 172.21.15.12:0/2961494523 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13040b25b0 con 0x7f13040aac20 2021-10-20T23:25:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f12fbfff700 1 --2- 172.21.15.12:0/2961494523 >> v2:172.21.15.31:3300/0 conn(0x7f13040b3060 0x7f13040b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1302d9d700 1 --2- 172.21.15.12:0/2961494523 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040aac20 0x7f1304064ba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f12fc0032f0 tx=0x7f12fc0091d0).ready entity=mon.2 client_cookie=94e6f1afb8715128 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1301d9b700 1 -- 172.21.15.12:0/2961494523 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12fc00b6c0 con 0x7f13040aac20 2021-10-20T23:25:48.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1301d9b700 1 -- 172.21.15.12:0/2961494523 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc00b820 con 0x7f13040aac20 2021-10-20T23:25:48.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f1301d9b700 1 -- 172.21.15.12:0/2961494523 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12fc00b990 con 0x7f13040aac20 2021-10-20T23:25:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130359e700 1 -- 172.21.15.12:0/2961494523 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040aac20 msgr2=0x7f1304064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130359e700 1 --2- 172.21.15.12:0/2961494523 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040aac20 0x7f1304064ba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f12fc0032f0 tx=0x7f12fc0091d0).stop 2021-10-20T23:25:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130359e700 1 -- 172.21.15.12:0/2961494523 shutdown_connections 2021-10-20T23:25:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130359e700 1 --2- 172.21.15.12:0/2961494523 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040aac20 0x7f1304064ba0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130359e700 1 --2- 172.21.15.12:0/2961494523 >> v2:172.21.15.31:3300/0 conn(0x7f13040b3060 0x7f13040b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130359e700 1 -- 172.21.15.12:0/2961494523 >> 172.21.15.12:0/2961494523 conn(0x7f130405f6b0 msgr2=0x7f130405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:48.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130359e700 1 -- 172.21.15.12:0/2961494523 shutdown_connections 2021-10-20T23:25:48.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130359e700 1 -- 172.21.15.12:0/2961494523 wait complete. 2021-10-20T23:25:48.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.854+0000 7f130359e700 1 Processor -- start 2021-10-20T23:25:48.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130359e700 1 -- start start 2021-10-20T23:25:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13040aac20 0x7f13040b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040b3060 0x7f1304150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13040b7370 0x7f130413d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1304150d60 con 0x7f13040aac20 2021-10-20T23:25:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13040ab960 con 0x7f13040b7370 2021-10-20T23:25:48.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13040abc00 con 0x7f13040b3060 2021-10-20T23:25:48.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13040aac20 0x7f13040b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:48.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f12fbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040b3060 0x7f1304150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:48.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13040aac20 0x7f13040b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41032/0 (socket says 172.21.15.12:41032) 2021-10-20T23:25:48.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f12fbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040b3060 0x7f1304150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46788/0 (socket says 172.21.15.12:46788) 2021-10-20T23:25:48.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130259c700 1 -- 172.21.15.12:0/4071975617 learned_addr learned my addr 172.21.15.12:0/4071975617 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:48.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f1302d9d700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13040b7370 0x7f130413d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:48.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130259c700 1 -- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040b3060 msgr2=0x7f1304150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:48.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130259c700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040b3060 0x7f1304150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130259c700 1 -- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13040b7370 msgr2=0x7f130413d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130259c700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13040b7370 0x7f130413d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130259c700 1 -- 172.21.15.12:0/4071975617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f400b180 con 0x7f13040aac20 2021-10-20T23:25:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f1302d9d700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13040b7370 0x7f130413d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130259c700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13040aac20 0x7f13040b1990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f12ec001090 tx=0x7f12ec007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f12fb7fe700 1 -- 172.21.15.12:0/4071975617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12ec0072e0 con 0x7f13040aac20 2021-10-20T23:25:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f12fb7fe700 1 -- 172.21.15.12:0/4071975617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec00cbd0 con 0x7f13040aac20 2021-10-20T23:25:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc009470 con 0x7f13040aac20 2021-10-20T23:25:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f12fb7fe700 1 -- 172.21.15.12:0/4071975617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12ec0054e0 con 0x7f13040aac20 2021-10-20T23:25:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.858+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13040ac640 con 0x7f13040aac20 2021-10-20T23:25:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.862+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13040ae160 con 0x7f13040aac20 2021-10-20T23:25:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.862+0000 7f12fb7fe700 1 -- 172.21.15.12:0/4071975617 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f12ec010070 con 0x7f13040aac20 2021-10-20T23:25:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.862+0000 7f12fb7fe700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e8053610 0x7f12e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.862+0000 7f12fb7fe700 1 -- 172.21.15.12:0/4071975617 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f12ec06b170 con 0x7f13040aac20 2021-10-20T23:25:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.862+0000 7f12fbfff700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e8053610 0x7f12e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.862+0000 7f12fbfff700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e8053610 0x7f12e8055ad0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f12f400b000 tx=0x7f12f4006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.870+0000 7f12fb7fe700 1 -- 172.21.15.12:0/4071975617 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f13040ae160 con 0x7f13040aac20 2021-10-20T23:25:49.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.994+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13040ae160 con 0x7f13040aac20 2021-10-20T23:25:49.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f12fb7fe700 1 -- 172.21.15.12:0/4071975617 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f12ec025fb0 con 0x7f13040aac20 2021-10-20T23:25:49.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:49.003 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":79,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:25:42.266158+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:25:39.858993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-20T23:25:40.250129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:25:49.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e8053610 msgr2=0x7f12e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e8053610 0x7f12e8055ad0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f12f400b000 tx=0x7f12f4006df0).stop 2021-10-20T23:25:49.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13040aac20 msgr2=0x7f13040b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13040aac20 0x7f13040b1990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f12ec001090 tx=0x7f12ec007b20).stop 2021-10-20T23:25:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 shutdown_connections 2021-10-20T23:25:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e8053610 0x7f12e8055ad0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13040b7370 0x7f130413d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13040b3060 0x7f1304150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 --2- 172.21.15.12:0/4071975617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13040aac20 0x7f13040b1990 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 >> 172.21.15.12:0/4071975617 conn(0x7f130405f6b0 msgr2=0x7f130405cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 shutdown_connections 2021-10-20T23:25:49.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:48.998+0000 7f130359e700 1 -- 172.21.15.12:0/4071975617 wait complete. 2021-10-20T23:25:49.016 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:25:39.858993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:25:40.250129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:25:49.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:25:49.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.122+0000 7f85cf59e700 1 Processor -- start 2021-10-20T23:25:49.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cf59e700 1 -- start start 2021-10-20T23:25:49.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cf59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85c8042e70 0x7f85c8041e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cf59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c8041350 con 0x7f85c8048f20 2021-10-20T23:25:49.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cf59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c8044b00 con 0x7f85c80d5c30 2021-10-20T23:25:49.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cf59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c80d6050 con 0x7f85c8042e70 2021-10-20T23:25:49.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cdd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85c8042e70 0x7f85c8041e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85ce59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f85c8048f20 0x7f85c8041780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39632/0 (socket says 172.21.15.12:39632) 2021-10-20T23:25:49.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85ce59c700 1 -- 172.21.15.12:0/2834913632 learned_addr learned my addr 172.21.15.12:0/2834913632 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:49.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cdd9b700 1 -- 172.21.15.12:0/2834913632 >> v1:172.21.15.31:6789/0 conn(0x7f85c80d5c30 legacy=0x7f85c80d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cdd9b700 1 -- 172.21.15.12:0/2834913632 >> v1:172.21.15.12:6789/0 conn(0x7f85c8048f20 legacy=0x7f85c8041780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cdd9b700 1 -- 172.21.15.12:0/2834913632 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8049300 con 0x7f85c8042e70 2021-10-20T23:25:49.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.126+0000 7f85cdd9b700 1 --2- 172.21.15.12:0/2834913632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 0x7f85c8041e90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f85c4002f70 tx=0x7f85c4006df0).ready entity=mon.0 client_cookie=e8889d199fe53687 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cd59a700 1 -- 172.21.15.12:0/2834913632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c400d610 con 0x7f85c8042e70 2021-10-20T23:25:49.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cd59a700 1 -- 172.21.15.12:0/2834913632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4000e90 con 0x7f85c8042e70 2021-10-20T23:25:49.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cd59a700 1 -- 172.21.15.12:0/2834913632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c400d9a0 con 0x7f85c8042e70 2021-10-20T23:25:49.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cf59e700 1 -- 172.21.15.12:0/2834913632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 msgr2=0x7f85c8041e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cf59e700 1 --2- 172.21.15.12:0/2834913632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 0x7f85c8041e90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f85c4002f70 tx=0x7f85c4006df0).stop 2021-10-20T23:25:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cf59e700 1 -- 172.21.15.12:0/2834913632 shutdown_connections 2021-10-20T23:25:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cf59e700 1 --2- 172.21.15.12:0/2834913632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 0x7f85c8041e90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cf59e700 1 -- 172.21.15.12:0/2834913632 >> 172.21.15.12:0/2834913632 conn(0x7f85c800c0c0 msgr2=0x7f85c80484d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cf59e700 1 -- 172.21.15.12:0/2834913632 shutdown_connections 2021-10-20T23:25:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cf59e700 1 -- 172.21.15.12:0/2834913632 wait complete. 2021-10-20T23:25:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cf59e700 1 Processor -- start 2021-10-20T23:25:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.130+0000 7f85cf59e700 1 -- start start 2021-10-20T23:25:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 0x7f85c80a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85c8048f20 0x7f85c803bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85c80d5c30 0x7f85c803e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cf59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80e2290 con 0x7f85c8042e70 2021-10-20T23:25:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cf59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80e2530 con 0x7f85c80d5c30 2021-10-20T23:25:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cf59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80a4950 con 0x7f85c8048f20 2021-10-20T23:25:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ce59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 0x7f85c80a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ce59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 0x7f85c80a5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41046/0 (socket says 172.21.15.12:41046) 2021-10-20T23:25:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ce59c700 1 -- 172.21.15.12:0/2224011145 learned_addr learned my addr 172.21.15.12:0/2224011145 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cdd9b700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85c8048f20 0x7f85c803bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ced9d700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85c80d5c30 0x7f85c803e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ce59c700 1 -- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85c8048f20 msgr2=0x7f85c803bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ce59c700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85c8048f20 0x7f85c803bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ce59c700 1 -- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85c80d5c30 msgr2=0x7f85c803e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ce59c700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85c80d5c30 0x7f85c803e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ce59c700 1 -- 172.21.15.12:0/2224011145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c400b180 con 0x7f85c8042e70 2021-10-20T23:25:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85ce59c700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 0x7f85c80a5090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f85c800e6f0 tx=0x7f85c0007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85bf7fe700 1 -- 172.21.15.12:0/2224011145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c00070d0 con 0x7f85c8042e70 2021-10-20T23:25:49.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85bf7fe700 1 -- 172.21.15.12:0/2224011145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c0007230 con 0x7f85c8042e70 2021-10-20T23:25:49.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c80a4bf0 con 0x7f85c8042e70 2021-10-20T23:25:49.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85bf7fe700 1 -- 172.21.15.12:0/2224011145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c0005610 con 0x7f85c8042e70 2021-10-20T23:25:49.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c803e800 con 0x7f85c8042e70 2021-10-20T23:25:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c80a4d80 con 0x7f85c8042e70 2021-10-20T23:25:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.134+0000 7f85bf7fe700 1 -- 172.21.15.12:0/2224011145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f85c0010070 con 0x7f85c8042e70 2021-10-20T23:25:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.138+0000 7f85bf7fe700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f85ac053610 0x7f85ac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.138+0000 7f85bf7fe700 1 -- 172.21.15.12:0/2224011145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f85c006b130 con 0x7f85c8042e70 2021-10-20T23:25:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.138+0000 7f85cdd9b700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f85ac053610 0x7f85ac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.138+0000 7f85cdd9b700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f85ac053610 0x7f85ac055ad0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f85c401a000 tx=0x7f85c4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.142+0000 7f85bf7fe700 1 -- 172.21.15.12:0/2224011145 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85c0042020 con 0x7f85c8042e70 2021-10-20T23:25:49.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.266+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f85c803fd80 con 0x7f85c8042e70 2021-10-20T23:25:49.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.270+0000 7f85bf7fe700 1 -- 172.21.15.12:0/2224011145 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7f85c0045640 con 0x7f85c8042e70 2021-10-20T23:25:49.275 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:25:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.270+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f85ac053610 msgr2=0x7f85ac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.270+0000 7f85cf59e700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f85ac053610 0x7f85ac055ad0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f85c401a000 tx=0x7f85c4014000).stop 2021-10-20T23:25:49.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 msgr2=0x7f85c80a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 0x7f85c80a5090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f85c800e6f0 tx=0x7f85c0007c00).stop 2021-10-20T23:25:49.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 shutdown_connections 2021-10-20T23:25:49.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f85ac053610 0x7f85ac055ad0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85c80d5c30 0x7f85c803e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85c8048f20 0x7f85c803bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 --2- 172.21.15.12:0/2224011145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85c8042e70 0x7f85c80a5090 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 >> 172.21.15.12:0/2224011145 conn(0x7f85c800c0c0 msgr2=0x7f85c80d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 shutdown_connections 2021-10-20T23:25:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.274+0000 7f85cf59e700 1 -- 172.21.15.12:0/2224011145 wait complete. 2021-10-20T23:25:49.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:25:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.398+0000 7fa4110d6700 1 Processor -- start 2021-10-20T23:25:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.398+0000 7fa4110d6700 1 -- start start 2021-10-20T23:25:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.398+0000 7fa4110d6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa40c0af2c0 0x7fa40c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.398+0000 7fa4110d6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c0ad320 0x7fa40c143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.398+0000 7fa4110d6700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c0afda0 con 0x7fa40c143640 2021-10-20T23:25:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.398+0000 7fa4110d6700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40c05c610 con 0x7fa40c0af2c0 2021-10-20T23:25:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.398+0000 7fa4110d6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c140800 con 0x7fa40c0ad320 2021-10-20T23:25:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.398+0000 7fa40bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa40c0af2c0 0x7fa40c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa40c0af2c0 0x7fa40c0af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41052/0 (socket says 172.21.15.12:41052) 2021-10-20T23:25:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.398+0000 7fa4108d5700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa40c143640 0x7fa40c0a8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39648/0 (socket says 172.21.15.12:39648) 2021-10-20T23:25:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40bfff700 1 -- 172.21.15.12:0/478935936 learned_addr learned my addr 172.21.15.12:0/478935936 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/478935936 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c0ad320 0x7fa40c143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40bfff700 1 -- 172.21.15.12:0/478935936 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c0ad320 msgr2=0x7fa40c143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40bfff700 1 --2- 172.21.15.12:0/478935936 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c0ad320 0x7fa40c143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40bfff700 1 -- 172.21.15.12:0/478935936 >> v1:172.21.15.12:6789/0 conn(0x7fa40c143640 legacy=0x7fa40c0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40bfff700 1 -- 172.21.15.12:0/478935936 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c0a93c0 con 0x7fa40c0af2c0 2021-10-20T23:25:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40bfff700 1 --2- 172.21.15.12:0/478935936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0af2c0 0x7fa40c0af6a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fa40c13fc30 tx=0x7fa3f4006f40).ready entity=mon.0 client_cookie=33e32d413fd451f5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40affd700 1 -- 172.21.15.12:0/478935936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f400da50 con 0x7fa40c0af2c0 2021-10-20T23:25:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40affd700 1 -- 172.21.15.12:0/478935936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f4000e90 con 0x7fa40c0af2c0 2021-10-20T23:25:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa40affd700 1 -- 172.21.15.12:0/478935936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f400dde0 con 0x7fa40c0af2c0 2021-10-20T23:25:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 -- 172.21.15.12:0/478935936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0af2c0 msgr2=0x7fa40c0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 --2- 172.21.15.12:0/478935936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0af2c0 0x7fa40c0af6a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fa40c13fc30 tx=0x7fa3f4006f40).stop 2021-10-20T23:25:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 -- 172.21.15.12:0/478935936 shutdown_connections 2021-10-20T23:25:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 --2- 172.21.15.12:0/478935936 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c0ad320 0x7fa40c143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 --2- 172.21.15.12:0/478935936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0af2c0 0x7fa40c0af6a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 -- 172.21.15.12:0/478935936 >> 172.21.15.12:0/478935936 conn(0x7fa40c061140 msgr2=0x7fa40c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 -- 172.21.15.12:0/478935936 shutdown_connections 2021-10-20T23:25:49.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 -- 172.21.15.12:0/478935936 wait complete. 2021-10-20T23:25:49.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 Processor -- start 2021-10-20T23:25:49.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.402+0000 7fa4110d6700 1 -- start start 2021-10-20T23:25:49.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4110d6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0ad320 0x7fa40c13f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4110d6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40c0af2c0 0x7fa40c142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4110d6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c143640 0x7fa40c14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4110d6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1517c0 con 0x7fa40c0ad320 2021-10-20T23:25:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4110d6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1519f0 con 0x7fa40c0af2c0 2021-10-20T23:25:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4110d6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c151c90 con 0x7fa40c143640 2021-10-20T23:25:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0ad320 0x7fa40c13f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0ad320 0x7fa40c13f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41058/0 (socket says 172.21.15.12:41058) 2021-10-20T23:25:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40bfff700 1 -- 172.21.15.12:0/3695495465 learned_addr learned my addr 172.21.15.12:0/3695495465 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40c0af2c0 0x7fa40c142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4108d5700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c143640 0x7fa40c14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40bfff700 1 -- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c143640 msgr2=0x7fa40c14e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40bfff700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c143640 0x7fa40c14e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40bfff700 1 -- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40c0af2c0 msgr2=0x7fa40c142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40bfff700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40c0af2c0 0x7fa40c142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40bfff700 1 -- 172.21.15.12:0/3695495465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f400b460 con 0x7fa40c0ad320 2021-10-20T23:25:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa40bfff700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0ad320 0x7fa40c13f110 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fa40c13fc30 tx=0x7fa3f401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4097fa700 1 -- 172.21.15.12:0/3695495465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f4025630 con 0x7fa40c0ad320 2021-10-20T23:25:49.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4097fa700 1 -- 172.21.15.12:0/3695495465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f4020040 con 0x7fa40c0ad320 2021-10-20T23:25:49.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c151f30 con 0x7fa40c0ad320 2021-10-20T23:25:49.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4097fa700 1 -- 172.21.15.12:0/3695495465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f4025980 con 0x7fa40c0ad320 2021-10-20T23:25:49.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c1523d0 con 0x7fa40c0ad320 2021-10-20T23:25:49.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.406+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c057350 con 0x7fa40c0ad320 2021-10-20T23:25:49.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.410+0000 7fa4097fa700 1 -- 172.21.15.12:0/3695495465 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa3f402b020 con 0x7fa40c0ad320 2021-10-20T23:25:49.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.410+0000 7fa4097fa700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3f0053610 0x7fa3f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.410+0000 7fa4097fa700 1 -- 172.21.15.12:0/3695495465 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa3f4071190 con 0x7fa40c0ad320 2021-10-20T23:25:49.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.410+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3f0053610 0x7fa3f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.410+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3f0053610 0x7fa3f0055ad0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fa3fc00c000 tx=0x7fa3fc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.414+0000 7fa4097fa700 1 -- 172.21.15.12:0/3695495465 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3f4048080 con 0x7fa40c0ad320 2021-10-20T23:25:49.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.538+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa40c140300 con 0x7fa40c0ad320 2021-10-20T23:25:49.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.538+0000 7fa4097fa700 1 -- 172.21.15.12:0/3695495465 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa3f404b6a0 con 0x7fa40c0ad320 2021-10-20T23:25:49.545 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:49.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3f0053610 msgr2=0x7fa3f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3f0053610 0x7fa3f0055ad0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fa3fc00c000 tx=0x7fa3fc008040).stop 2021-10-20T23:25:49.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0ad320 msgr2=0x7fa40c13f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0ad320 0x7fa40c13f110 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fa40c13fc30 tx=0x7fa3f401a000).stop 2021-10-20T23:25:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 shutdown_connections 2021-10-20T23:25:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa3f0053610 0x7fa3f0055ad0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa40c143640 0x7fa40c14e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40c0af2c0 0x7fa40c142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 --2- 172.21.15.12:0/3695495465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c0ad320 0x7fa40c13f110 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 >> 172.21.15.12:0/3695495465 conn(0x7fa40c061140 msgr2=0x7fa40c137a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 shutdown_connections 2021-10-20T23:25:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.542+0000 7fa4110d6700 1 -- 172.21.15.12:0/3695495465 wait complete. 2021-10-20T23:25:49.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:25:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.658+0000 7f3cb1bb6700 1 Processor -- start 2021-10-20T23:25:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.658+0000 7f3cb1bb6700 1 -- start start 2021-10-20T23:25:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.658+0000 7f3cb1bb6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cac064b40 0x7f3cac1438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.658+0000 7f3cb1bb6700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac0b2270 con 0x7f3cac0b2cf0 2021-10-20T23:25:49.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.658+0000 7f3cb1bb6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac064f20 con 0x7f3cac0b3940 2021-10-20T23:25:49.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.658+0000 7f3cb1bb6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac062230 con 0x7f3cac064b40 2021-10-20T23:25:49.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.658+0000 7f3cabfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3cac0b2cf0 0x7f3cac0b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39662/0 (socket says 172.21.15.12:39662) 2021-10-20T23:25:49.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.658+0000 7f3cabfff700 1 -- 172.21.15.12:0/3776711214 learned_addr learned my addr 172.21.15.12:0/3776711214 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:49.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb0bb4700 1 --2- 172.21.15.12:0/3776711214 >> v2:172.21.15.31:3300/0 conn(0x7f3cac064b40 0x7f3cac1438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161651481 0 0) 0x7f3cac0b2270 con 0x7f3cac0b2cf0 2021-10-20T23:25:49.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c8c003260 con 0x7f3cac0b2cf0 2021-10-20T23:25:49.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2331747138 0 0) 0x7f3c8c003260 con 0x7f3cac0b2cf0 2021-10-20T23:25:49.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 >> v2:172.21.15.31:3300/0 conn(0x7f3cac064b40 msgr2=0x7f3cac1438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:49.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 --2- 172.21.15.12:0/3776711214 >> v2:172.21.15.31:3300/0 conn(0x7f3cac064b40 0x7f3cac1438a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 >> v1:172.21.15.31:6789/0 conn(0x7f3cac0b3940 legacy=0x7f3cac14d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac0b3d50 con 0x7f3cac0b2cf0 2021-10-20T23:25:49.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f3c94005140 con 0x7f3cac0b2cf0 2021-10-20T23:25:49.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 >> v1:172.21.15.12:6789/0 conn(0x7f3cac0b2cf0 legacy=0x7f3cac0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3c8c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c8c004500 0x7f3c8c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8c004e70 0x7f3c8c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac062230 con 0x7f3c8c003750 2021-10-20T23:25:49.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c00bd20 con 0x7f3c8c004e70 2021-10-20T23:25:49.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c00bee0 con 0x7f3c8c004500 2021-10-20T23:25:49.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb0bb4700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3c8c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb13b5700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8c004e70 0x7f3c8c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cabfff700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c8c004500 0x7f3c8c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb0bb4700 1 -- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c8c004500 msgr2=0x7f3c8c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb0bb4700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c8c004500 0x7f3c8c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb0bb4700 1 -- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8c004e70 msgr2=0x7f3c8c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb0bb4700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8c004e70 0x7f3c8c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb0bb4700 1 -- 172.21.15.12:0/3776711214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c003260 con 0x7f3c8c003750 2021-10-20T23:25:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cabfff700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c8c004500 0x7f3c8c004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb13b5700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8c004e70 0x7f3c8c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb13b5700 1 -- 172.21.15.12:0/3776711214 reap_dead start 2021-10-20T23:25:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb0bb4700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3c8c003b30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f3c9c00c000 tx=0x7f3c9c006df0).ready entity=mon.0 client_cookie=8953c9a21268873c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c00e830 con 0x7f3c8c003750 2021-10-20T23:25:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c00e990 con 0x7f3c8c003750 2021-10-20T23:25:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cab7fe700 1 -- 172.21.15.12:0/3776711214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c00ecf0 con 0x7f3c8c003750 2021-10-20T23:25:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/3776711214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 msgr2=0x7f3c8c003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb1bb6700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3c8c003b30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f3c9c00c000 tx=0x7f3c9c006df0).stop 2021-10-20T23:25:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/3776711214 shutdown_connections 2021-10-20T23:25:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb1bb6700 1 --2- 172.21.15.12:0/3776711214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3c8c003b30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/3776711214 >> 172.21.15.12:0/3776711214 conn(0x7f3cac062be0 msgr2=0x7f3cac05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/3776711214 shutdown_connections 2021-10-20T23:25:49.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.662+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/3776711214 wait complete. 2021-10-20T23:25:49.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 Processor -- start 2021-10-20T23:25:49.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 -- start start 2021-10-20T23:25:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3cac0a3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0aff00 0x7f3cac0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac0b0850 0x7f3cac1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac141c30 con 0x7f3c8c003750 2021-10-20T23:25:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac152210 con 0x7f3cac0b0850 2021-10-20T23:25:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0b51d0 con 0x7f3cac0aff00 2021-10-20T23:25:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb0bb4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3cac0a3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb0bb4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3cac0a3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41078/0 (socket says 172.21.15.12:41078) 2021-10-20T23:25:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb0bb4700 1 -- 172.21.15.12:0/913215535 learned_addr learned my addr 172.21.15.12:0/913215535 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb13b5700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac0b0850 0x7f3cac1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cabfff700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0aff00 0x7f3cac0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb0bb4700 1 -- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0aff00 msgr2=0x7f3cac0b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb0bb4700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0aff00 0x7f3cac0b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb0bb4700 1 -- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac0b0850 msgr2=0x7f3cac1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb0bb4700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac0b0850 0x7f3cac1556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb0bb4700 1 -- 172.21.15.12:0/913215535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac0b1510 con 0x7f3c8c003750 2021-10-20T23:25:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb0bb4700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3cac0a3000 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f3cac0b1430 tx=0x7f3c9c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3ca9ffb700 1 -- 172.21.15.12:0/913215535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c01ccf0 con 0x7f3c8c003750 2021-10-20T23:25:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3ca9ffb700 1 -- 172.21.15.12:0/913215535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c000e90 con 0x7f3c8c003750 2021-10-20T23:25:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac152400 con 0x7f3c8c003750 2021-10-20T23:25:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3ca9ffb700 1 -- 172.21.15.12:0/913215535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c0245e0 con 0x7f3c8c003750 2021-10-20T23:25:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.666+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac0b1040 con 0x7f3c8c003750 2021-10-20T23:25:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.670+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac057350 con 0x7f3c8c003750 2021-10-20T23:25:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.670+0000 7f3ca9ffb700 1 -- 172.21.15.12:0/913215535 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3c9c02a020 con 0x7f3c8c003750 2021-10-20T23:25:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.670+0000 7f3ca9ffb700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c90053640 0x7f3c90055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.670+0000 7f3ca9ffb700 1 -- 172.21.15.12:0/913215535 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3c9c06d090 con 0x7f3c8c003750 2021-10-20T23:25:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.670+0000 7f3cabfff700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c90053640 0x7f3c90055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.670+0000 7f3cabfff700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c90053640 0x7f3c90055b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f3c9400d000 tx=0x7f3c94009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.678+0000 7f3ca9ffb700 1 -- 172.21.15.12:0/913215535 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c9c044530 con 0x7f3c8c003750 2021-10-20T23:25:49.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.806+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cac0a3690 con 0x7f3c8c003750 2021-10-20T23:25:49.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.806+0000 7f3ca9ffb700 1 -- 172.21.15.12:0/913215535 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3c9c0475a0 con 0x7f3c8c003750 2021-10-20T23:25:49.814 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c90053640 msgr2=0x7f3c90055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c90053640 0x7f3c90055b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f3c9400d000 tx=0x7f3c94009040).stop 2021-10-20T23:25:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 msgr2=0x7f3cac0a3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3cac0a3000 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f3cac0b1430 tx=0x7f3c9c019000).stop 2021-10-20T23:25:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 shutdown_connections 2021-10-20T23:25:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c90053640 0x7f3c90055b00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac0b0850 0x7f3cac1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0aff00 0x7f3cac0b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 --2- 172.21.15.12:0/913215535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c8c003750 0x7f3cac0a3000 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 >> 172.21.15.12:0/913215535 conn(0x7f3cac062be0 msgr2=0x7f3cac061650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 shutdown_connections 2021-10-20T23:25:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.810+0000 7f3cb1bb6700 1 -- 172.21.15.12:0/913215535 wait complete. 2021-10-20T23:25:49.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:25:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f8971528700 1 Processor -- start 2021-10-20T23:25:49.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f8971528700 1 -- start start 2021-10-20T23:25:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f8971528700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f896c05d0b0 0x7f896c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f8971528700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c13f390 0x7f896c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f8971528700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c05cbb0 con 0x7f896c05c7d0 2021-10-20T23:25:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f8971528700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c0ad540 con 0x7f896c05d0b0 2021-10-20T23:25:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f8971528700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c067d70 con 0x7f896c13f390 2021-10-20T23:25:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f896c05d0b0 0x7f896c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f896c05d0b0 0x7f896c0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41088/0 (socket says 172.21.15.12:41088) 2021-10-20T23:25:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896b7fe700 1 -- 172.21.15.12:0/2499981451 learned_addr learned my addr 172.21.15.12:0/2499981451 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f8970d27700 1 --2- 172.21.15.12:0/2499981451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c13f390 0x7f896c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896b7fe700 1 -- 172.21.15.12:0/2499981451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c13f390 msgr2=0x7f896c0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896b7fe700 1 --2- 172.21.15.12:0/2499981451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c13f390 0x7f896c0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896b7fe700 1 -- 172.21.15.12:0/2499981451 >> v1:172.21.15.31:6789/0 conn(0x7f896c05c7d0 legacy=0x7f896c0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896b7fe700 1 -- 172.21.15.12:0/2499981451 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0b1790 con 0x7f896c05d0b0 2021-10-20T23:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896b7fe700 1 --2- 172.21.15.12:0/2499981451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c05d0b0 0x7f896c0b10f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f895c002f70 tx=0x7f895c006eb0).ready entity=mon.0 client_cookie=d7580f0bcf2aead9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896affd700 1 -- 172.21.15.12:0/2499981451 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f895c00d570 con 0x7f896c05d0b0 2021-10-20T23:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896affd700 1 -- 172.21.15.12:0/2499981451 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c000e90 con 0x7f896c05d0b0 2021-10-20T23:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.930+0000 7f896affd700 1 -- 172.21.15.12:0/2499981451 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f895c00d900 con 0x7f896c05d0b0 2021-10-20T23:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 -- 172.21.15.12:0/2499981451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c05d0b0 msgr2=0x7f896c0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 --2- 172.21.15.12:0/2499981451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c05d0b0 0x7f896c0b10f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f895c002f70 tx=0x7f895c006eb0).stop 2021-10-20T23:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 -- 172.21.15.12:0/2499981451 shutdown_connections 2021-10-20T23:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 --2- 172.21.15.12:0/2499981451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c13f390 0x7f896c0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 --2- 172.21.15.12:0/2499981451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c05d0b0 0x7f896c0b10f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 -- 172.21.15.12:0/2499981451 >> 172.21.15.12:0/2499981451 conn(0x7f896c060180 msgr2=0x7f896c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 -- 172.21.15.12:0/2499981451 shutdown_connections 2021-10-20T23:25:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 -- 172.21.15.12:0/2499981451 wait complete. 2021-10-20T23:25:49.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 Processor -- start 2021-10-20T23:25:49.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 -- start start 2021-10-20T23:25:49.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c05c7d0 0x7f896c13d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c05d0b0 0x7f896c145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c13f390 0x7f896c145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c1441e0 con 0x7f896c13f390 2021-10-20T23:25:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0666a0 con 0x7f896c05c7d0 2021-10-20T23:25:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8971528700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c145c20 con 0x7f896c05d0b0 2021-10-20T23:25:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8970d27700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c13f390 0x7f896c145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8970d27700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c13f390 0x7f896c145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41096/0 (socket says 172.21.15.12:41096) 2021-10-20T23:25:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8970d27700 1 -- 172.21.15.12:0/1799010293 learned_addr learned my addr 172.21.15.12:0/1799010293 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:49.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f896b7fe700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c05d0b0 0x7f896c145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f896bfff700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c05c7d0 0x7f896c13d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8970d27700 1 -- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c05d0b0 msgr2=0x7f896c145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8970d27700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c05d0b0 0x7f896c145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8970d27700 1 -- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c05c7d0 msgr2=0x7f896c13d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8970d27700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c05c7d0 0x7f896c13d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f8970d27700 1 -- 172.21.15.12:0/1799010293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c00b1e0 con 0x7f896c13f390 2021-10-20T23:25:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.934+0000 7f896bfff700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c05c7d0 0x7f896c13d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:25:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f8970d27700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c13f390 0x7f896c145730 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f8964006e00 tx=0x7f89640091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f89697fa700 1 -- 172.21.15.12:0/1799010293 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896400c670 con 0x7f896c13f390 2021-10-20T23:25:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f89697fa700 1 -- 172.21.15.12:0/1799010293 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896400c7d0 con 0x7f896c13f390 2021-10-20T23:25:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896c066070 con 0x7f896c13f390 2021-10-20T23:25:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f89697fa700 1 -- 172.21.15.12:0/1799010293 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896400cb30 con 0x7f896c13f390 2021-10-20T23:25:49.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c066fd0 con 0x7f896c13f390 2021-10-20T23:25:49.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c0b1a30 con 0x7f896c13f390 2021-10-20T23:25:49.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f89697fa700 1 -- 172.21.15.12:0/1799010293 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f896400cc90 con 0x7f896c13f390 2021-10-20T23:25:49.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f89697fa700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89500536d0 0x7f8950055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:49.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f89697fa700 1 -- 172.21.15.12:0/1799010293 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f896406bd10 con 0x7f896c13f390 2021-10-20T23:25:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.938+0000 7f896bfff700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89500536d0 0x7f8950055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.942+0000 7f896bfff700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89500536d0 0x7f8950055b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f895400b000 tx=0x7f8954009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:49.945+0000 7f89697fa700 1 -- 172.21.15.12:0/1799010293 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8964042c70 con 0x7f896c13f390 2021-10-20T23:25:50.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.073+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f896c057350 con 0x7f896c13f390 2021-10-20T23:25:50.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.073+0000 7f89697fa700 1 -- 172.21.15.12:0/1799010293 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8964046290 con 0x7f896c13f390 2021-10-20T23:25:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:25:50.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89500536d0 msgr2=0x7f8950055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:50.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89500536d0 0x7f8950055b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f895400b000 tx=0x7f8954009040).stop 2021-10-20T23:25:50.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c13f390 msgr2=0x7f896c145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:50.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c13f390 0x7f896c145730 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f8964006e00 tx=0x7f89640091d0).stop 2021-10-20T23:25:50.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 shutdown_connections 2021-10-20T23:25:50.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f89500536d0 0x7f8950055b90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c13f390 0x7f896c145730 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f896c05d0b0 0x7f896c145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 --2- 172.21.15.12:0/1799010293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c05c7d0 0x7f896c13d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 >> 172.21.15.12:0/1799010293 conn(0x7f896c060180 msgr2=0x7f896c0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:50.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 shutdown_connections 2021-10-20T23:25:50.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.077+0000 7f8971528700 1 -- 172.21.15.12:0/1799010293 wait complete. 2021-10-20T23:25:50.096 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:25:50.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.201+0000 7f7b5759e700 1 Processor -- start 2021-10-20T23:25:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.201+0000 7f7b5759e700 1 -- start start 2021-10-20T23:25:50.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.201+0000 7f7b5759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b580af2c0 0x7f7b580af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b580afda0 con 0x7f7b580ad320 2021-10-20T23:25:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5805c610 con 0x7f7b580ad850 2021-10-20T23:25:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b58140800 con 0x7f7b580af2c0 2021-10-20T23:25:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b55d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7b580ad320 0x7f7b58143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39696/0 (socket says 172.21.15.12:39696) 2021-10-20T23:25:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b55d9b700 1 -- 172.21.15.12:0/2752145187 learned_addr learned my addr 172.21.15.12:0/2752145187 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5659c700 1 --2- 172.21.15.12:0/2752145187 >> v2:172.21.15.31:3300/0 conn(0x7f7b580af2c0 0x7f7b580af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5559a700 1 -- 172.21.15.12:0/2752145187 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637664929 0 0) 0x7f7b580afda0 con 0x7f7b580ad320 2021-10-20T23:25:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5559a700 1 -- 172.21.15.12:0/2752145187 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b3c003260 con 0x7f7b580ad320 2021-10-20T23:25:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5559a700 1 -- 172.21.15.12:0/2752145187 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3152392458 0 0) 0x7f7b3c003260 con 0x7f7b580ad320 2021-10-20T23:25:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5659c700 1 -- 172.21.15.12:0/2752145187 >> v1:172.21.15.31:6789/0 conn(0x7f7b580ad850 legacy=0x7f7b580a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5659c700 1 -- 172.21.15.12:0/2752145187 >> v1:172.21.15.12:6789/0 conn(0x7f7b580ad320 legacy=0x7f7b58143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5659c700 1 -- 172.21.15.12:0/2752145187 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58143860 con 0x7f7b580af2c0 2021-10-20T23:25:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5659c700 1 --2- 172.21.15.12:0/2752145187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 0x7f7b580af6a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f7b580ad770 tx=0x7f7b48006df0).ready entity=mon.1 client_cookie=6210b11a63752c59 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5559a700 1 -- 172.21.15.12:0/2752145187 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4c001660 con 0x7f7b580af2c0 2021-10-20T23:25:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5559a700 1 -- 172.21.15.12:0/2752145187 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b48000e90 con 0x7f7b580af2c0 2021-10-20T23:25:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5559a700 1 -- 172.21.15.12:0/2752145187 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4800d4f0 con 0x7f7b580af2c0 2021-10-20T23:25:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 -- 172.21.15.12:0/2752145187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 msgr2=0x7f7b580af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 --2- 172.21.15.12:0/2752145187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 0x7f7b580af6a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f7b580ad770 tx=0x7f7b48006df0).stop 2021-10-20T23:25:50.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 -- 172.21.15.12:0/2752145187 shutdown_connections 2021-10-20T23:25:50.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 --2- 172.21.15.12:0/2752145187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 0x7f7b580af6a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 -- 172.21.15.12:0/2752145187 >> 172.21.15.12:0/2752145187 conn(0x7f7b58061140 msgr2=0x7f7b58062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:50.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 -- 172.21.15.12:0/2752145187 shutdown_connections 2021-10-20T23:25:50.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.205+0000 7f7b5759e700 1 -- 172.21.15.12:0/2752145187 wait complete. 2021-10-20T23:25:50.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 Processor -- start 2021-10-20T23:25:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 -- start start 2021-10-20T23:25:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b580ad320 0x7f7b580b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b580ad850 0x7f7b580aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 0x7f7b58153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58153930 con 0x7f7b580ad320 2021-10-20T23:25:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580a9e00 con 0x7f7b580af2c0 2021-10-20T23:25:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580aa0a0 con 0x7f7b580ad850 2021-10-20T23:25:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b580ad320 0x7f7b580b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b580ad320 0x7f7b580b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41106/0 (socket says 172.21.15.12:41106) 2021-10-20T23:25:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5659c700 1 -- 172.21.15.12:0/2136469044 learned_addr learned my addr 172.21.15.12:0/2136469044 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b55d9b700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b580ad850 0x7f7b580aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b56d9d700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 0x7f7b58153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5659c700 1 -- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b580ad850 msgr2=0x7f7b580aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5659c700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b580ad850 0x7f7b580aa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5659c700 1 -- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 msgr2=0x7f7b58153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5659c700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 0x7f7b58153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5659c700 1 -- 172.21.15.12:0/2136469044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4800b180 con 0x7f7b580ad320 2021-10-20T23:25:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b56d9d700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 0x7f7b58153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:25:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5659c700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b580ad320 0x7f7b580b5db0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f7b580ad770 tx=0x7f7b48014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b477fe700 1 -- 172.21.15.12:0/2136469044 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b48013de0 con 0x7f7b580ad320 2021-10-20T23:25:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b477fe700 1 -- 172.21.15.12:0/2136469044 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b48002f50 con 0x7f7b580ad320 2021-10-20T23:25:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b580aa340 con 0x7f7b580ad320 2021-10-20T23:25:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b477fe700 1 -- 172.21.15.12:0/2136469044 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4801e5f0 con 0x7f7b580ad320 2021-10-20T23:25:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.209+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b580aad00 con 0x7f7b580ad320 2021-10-20T23:25:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.213+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b58057350 con 0x7f7b580ad320 2021-10-20T23:25:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.213+0000 7f7b477fe700 1 -- 172.21.15.12:0/2136469044 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b4801c070 con 0x7f7b580ad320 2021-10-20T23:25:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.213+0000 7f7b477fe700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b340536d0 0x7f7b34055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.213+0000 7f7b477fe700 1 -- 172.21.15.12:0/2136469044 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7b4806c4e0 con 0x7f7b580ad320 2021-10-20T23:25:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.213+0000 7f7b55d9b700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b340536d0 0x7f7b34055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.213+0000 7f7b55d9b700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b340536d0 0x7f7b34055b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f7b4c00d000 tx=0x7f7b4c001e90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.217+0000 7f7b477fe700 1 -- 172.21.15.12:0/2136469044 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b48043440 con 0x7f7b580ad320 2021-10-20T23:25:50.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.377+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b58143640 con 0x7f7b580ad320 2021-10-20T23:25:50.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.377+0000 7f7b477fe700 1 -- 172.21.15.12:0/2136469044 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f7b48023020 con 0x7f7b580ad320 2021-10-20T23:25:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:50.386 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:25:41.263533+0000","modified":"2021-10-20T23:25:42.936432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3651290992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3651290992},{"type":"v1","addr":"172.21.15.31:6835","nonce":3651290992}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-20T23:25:50.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b340536d0 msgr2=0x7f7b34055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:50.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b340536d0 0x7f7b34055b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f7b4c00d000 tx=0x7f7b4c001e90).stop 2021-10-20T23:25:50.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b580ad320 msgr2=0x7f7b580b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:50.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b580ad320 0x7f7b580b5db0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f7b580ad770 tx=0x7f7b48014000).stop 2021-10-20T23:25:50.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 shutdown_connections 2021-10-20T23:25:50.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7b340536d0 0x7f7b34055b90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b580af2c0 0x7f7b58153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b580ad850 0x7f7b580aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 --2- 172.21.15.12:0/2136469044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b580ad320 0x7f7b580b5db0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:50.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 >> 172.21.15.12:0/2136469044 conn(0x7f7b58061140 msgr2=0x7f7b5813cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:50.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 shutdown_connections 2021-10-20T23:25:50.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:50.381+0000 7f7b5759e700 1 -- 172.21.15.12:0/2136469044 wait complete. 2021-10-20T23:25:50.391 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 38 2021-10-20T23:25:50.706 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:25:41.263533+0000', 'modified': '2021-10-20T23:25:42.936432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6231}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6231': {'gid': 6231, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3651290992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 3651290992}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3651290992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:25:50.706 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:25:50.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:25:50.823 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6231,"want_state":"up:active","state":"up:active","rank_uptime":9.5454145290000003,"mdsmap_epoch":38,"osdmap_epoch":79,"osdmap_epoch_barrier":79,"uptime":13.740181304} 2021-10-20T23:25:50.824 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6231, "mdsmap_epoch": 38, "osdmap_epoch": 79, "osdmap_epoch_barrier": 79, "rank_uptime": 9.545414529, "state": "up:active", "uptime": 13.740181304, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:25:50.824 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:25:50.824 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:25:50.825 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:25:50.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:50.826 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:25:50.834 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:25:50.851 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:25:50.852 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:25:50.908 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:25:50.910 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:25:50.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:50.911 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:25:50.918 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:25:50.918 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:25:50.921 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:25:50.936 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:25:50.936 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:25:50.991 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:25:50.993 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:25:50.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:50.995 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:25:50.996 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-10-20T23:25:50.993+0000 7ff4a2243080 -1 init, newargv = 0x5567b4b1caa0 newargc=9 2021-10-20T23:25:50.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13956]: starting ceph client 2021-10-20T23:25:51.007 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13956]: starting fuse 2021-10-20T23:25:52.104 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:25:52.122 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:25:52.123 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:25:52.180 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:25:52.182 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:25:52.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:52.184 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:25:52.190 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:25:52.191 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:25:52.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:52.192 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:25:52.192 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:25:52.193 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:25:52.193 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:25:52.194 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:25:52.194 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:25:52.194 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:25:52.195 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:25:52.195 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:25:52.196 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:25:52.196 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:25:52.197 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:25:52.197 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:25:52.198 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:25:52.198 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:25:52.199 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:25:52.200 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:25:52.200 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:25:52.201 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:25:52.201 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:25:52.201 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:25:52.202 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:25:52.202 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:25:52.247 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13956.asok 2021-10-20T23:25:52.252 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13956.asok 2021-10-20T23:25:52.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:52.253 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13956.asok status 2021-10-20T23:25:52.387 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:25:52.387 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:25:52.388 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:25:52.388 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:25:52.388 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:25:52.389 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:25:52.389 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:25:52.389 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13956", 2021-10-20T23:25:52.389 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:25:52.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:25:52.390 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:25:52.390 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:25:52.390 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 6438, 2021-10-20T23:25:52.391 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:25:52.391 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:25:52.391 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:25:52.391 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 6438 2021-10-20T23:25:52.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:25:52.392 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:25:52.392 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:25:52.392 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:25:52.393 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1842770592 2021-10-20T23:25:52.393 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:25:52.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:25:52.394 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:25:52.394 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:25:52.394 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:25:52.394 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1842770592 2021-10-20T23:25:52.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:25:52.395 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.6438 172.21.15.136:0/1842770592", 2021-10-20T23:25:52.395 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/1842770592", 2021-10-20T23:25:52.395 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:25:52.395 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 38, 2021-10-20T23:25:52.396 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 79, 2021-10-20T23:25:52.396 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:25:52.396 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:25:52.396 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:25:52.397 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:25:52.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:52.399 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:52.399 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:25:52.407 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:25:52.408 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:25:52.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:52.409 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:25:52.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:52.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f9943700 1 Processor -- start 2021-10-20T23:25:52.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f9943700 1 -- start start 2021-10-20T23:25:52.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f9943700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8f40b2580 0x7fe8f414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f9943700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8f40b0010 0x7fe8f414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f9943700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f40a70c0 con 0x7fe8f40afbd0 2021-10-20T23:25:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f9943700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f40a72f0 con 0x7fe8f40b2580 2021-10-20T23:25:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f9943700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f40a7590 con 0x7fe8f40b0010 2021-10-20T23:25:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f8941700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8f40b2580 0x7fe8f414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f8941700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8f40b2580 0x7fe8f414ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41116/0 (socket says 172.21.15.12:41116) 2021-10-20T23:25:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f8941700 1 -- 172.21.15.12:0/2791302602 learned_addr learned my addr 172.21.15.12:0/2791302602 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f3fff700 1 --2- 172.21.15.12:0/2791302602 >> v2:172.21.15.31:3300/0 conn(0x7fe8f40b0010 0x7fe8f414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f8941700 1 -- 172.21.15.12:0/2791302602 >> v2:172.21.15.31:3300/0 conn(0x7fe8f40b0010 msgr2=0x7fe8f414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f8941700 1 --2- 172.21.15.12:0/2791302602 >> v2:172.21.15.31:3300/0 conn(0x7fe8f40b0010 0x7fe8f414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f8941700 1 -- 172.21.15.12:0/2791302602 >> v1:172.21.15.31:6789/0 conn(0x7fe8f40afbd0 legacy=0x7fe8f40a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f8941700 1 -- 172.21.15.12:0/2791302602 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f40a7830 con 0x7fe8f40b2580 2021-10-20T23:25:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f3fff700 1 --2- 172.21.15.12:0/2791302602 >> v2:172.21.15.31:3300/0 conn(0x7fe8f40b0010 0x7fe8f414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:25:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f8941700 1 --2- 172.21.15.12:0/2791302602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40b2580 0x7fe8f414ae40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fe8f406b7c0 tx=0x7fe8dc006eb0).ready entity=mon.0 client_cookie=992bfd91c97b6add server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f37fe700 1 -- 172.21.15.12:0/2791302602 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8dc00d5c0 con 0x7fe8f40b2580 2021-10-20T23:25:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f37fe700 1 -- 172.21.15.12:0/2791302602 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc000e90 con 0x7fe8f40b2580 2021-10-20T23:25:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f37fe700 1 -- 172.21.15.12:0/2791302602 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8dc00d910 con 0x7fe8f40b2580 2021-10-20T23:25:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f9943700 1 -- 172.21.15.12:0/2791302602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40b2580 msgr2=0x7fe8f414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.577+0000 7fe8f9943700 1 --2- 172.21.15.12:0/2791302602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40b2580 0x7fe8f414ae40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fe8f406b7c0 tx=0x7fe8dc006eb0).stop 2021-10-20T23:25:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 -- 172.21.15.12:0/2791302602 shutdown_connections 2021-10-20T23:25:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 --2- 172.21.15.12:0/2791302602 >> v2:172.21.15.31:3300/0 conn(0x7fe8f40b0010 0x7fe8f414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 --2- 172.21.15.12:0/2791302602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40b2580 0x7fe8f414ae40 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 -- 172.21.15.12:0/2791302602 >> 172.21.15.12:0/2791302602 conn(0x7fe8f4060180 msgr2=0x7fe8f40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 -- 172.21.15.12:0/2791302602 shutdown_connections 2021-10-20T23:25:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 -- 172.21.15.12:0/2791302602 wait complete. 2021-10-20T23:25:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 Processor -- start 2021-10-20T23:25:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 -- start start 2021-10-20T23:25:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40afbd0 0x7fe8f4063ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f40b0010 0x7fe8f40643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8f40b2580 0x7fe8f4066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40648a0 con 0x7fe8f40afbd0 2021-10-20T23:25:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40aa1e0 con 0x7fe8f40b0010 2021-10-20T23:25:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9943700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40abbd0 con 0x7fe8f40b2580 2021-10-20T23:25:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f8941700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40afbd0 0x7fe8f4063ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f8941700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40afbd0 0x7fe8f4063ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41120/0 (socket says 172.21.15.12:41120) 2021-10-20T23:25:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f8941700 1 -- 172.21.15.12:0/1371828338 learned_addr learned my addr 172.21.15.12:0/1371828338 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f3fff700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f40b0010 0x7fe8f40643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f9142700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8f40b2580 0x7fe8f4066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f8941700 1 -- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8f40b2580 msgr2=0x7fe8f4066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f8941700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8f40b2580 0x7fe8f4066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f8941700 1 -- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f40b0010 msgr2=0x7fe8f40643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f8941700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f40b0010 0x7fe8f40643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.581+0000 7fe8f8941700 1 -- 172.21.15.12:0/1371828338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc00b1e0 con 0x7fe8f40afbd0 2021-10-20T23:25:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f8941700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40afbd0 0x7fe8f4063ec0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fe8f4063300 tx=0x7fe8dc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f1ffb700 1 -- 172.21.15.12:0/1371828338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8dc00d940 con 0x7fe8f40afbd0 2021-10-20T23:25:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f1ffb700 1 -- 172.21.15.12:0/1371828338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc011b00 con 0x7fe8f40afbd0 2021-10-20T23:25:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f40aa4c0 con 0x7fe8f40afbd0 2021-10-20T23:25:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f1ffb700 1 -- 172.21.15.12:0/1371828338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8dc011e60 con 0x7fe8f40afbd0 2021-10-20T23:25:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f40a9e60 con 0x7fe8f40afbd0 2021-10-20T23:25:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f40a9a20 con 0x7fe8f40afbd0 2021-10-20T23:25:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f1ffb700 1 -- 172.21.15.12:0/1371828338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe8dc025030 con 0x7fe8f40afbd0 2021-10-20T23:25:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f1ffb700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8d8053520 0x7fe8d80559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f1ffb700 1 -- 172.21.15.12:0/1371828338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe8dc06ce20 con 0x7fe8f40afbd0 2021-10-20T23:25:52.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f3fff700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8d8053520 0x7fe8d80559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.585+0000 7fe8f3fff700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8d8053520 0x7fe8d80559e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fe8ec00d000 tx=0x7fe8ec008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:52.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.593+0000 7fe8f1ffb700 1 -- 172.21.15.12:0/1371828338 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe8dc043e20 con 0x7fe8f40afbd0 2021-10-20T23:25:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.761+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8f4057350 con 0x7fe8f40afbd0 2021-10-20T23:25:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.761+0000 7fe8f1ffb700 1 -- 172.21.15.12:0/1371828338 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fe8dc023020 con 0x7fe8f40afbd0 2021-10-20T23:25:52.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:52.769 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:25:41.263533+0000","modified":"2021-10-20T23:25:42.936432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3651290992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3651290992},{"type":"v1","addr":"172.21.15.31:6835","nonce":3651290992}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-20T23:25:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8d8053520 msgr2=0x7fe8d80559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8d8053520 0x7fe8d80559e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fe8ec00d000 tx=0x7fe8ec008040).stop 2021-10-20T23:25:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40afbd0 msgr2=0x7fe8f4063ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40afbd0 0x7fe8f4063ec0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fe8f4063300 tx=0x7fe8dc015000).stop 2021-10-20T23:25:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 shutdown_connections 2021-10-20T23:25:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8d8053520 0x7fe8d80559e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8f40b2580 0x7fe8f4066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f40b0010 0x7fe8f40643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 --2- 172.21.15.12:0/1371828338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f40afbd0 0x7fe8f4063ec0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 >> 172.21.15.12:0/1371828338 conn(0x7fe8f4060180 msgr2=0x7fe8f40ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:52.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 shutdown_connections 2021-10-20T23:25:52.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.765+0000 7fe8f9943700 1 -- 172.21.15.12:0/1371828338 wait complete. 2021-10-20T23:25:52.775 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 38 2021-10-20T23:25:52.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:25:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.877+0000 7fbd0676c700 1 Processor -- start 2021-10-20T23:25:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.877+0000 7fbd0676c700 1 -- start start 2021-10-20T23:25:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbd00061320 0x7fbd00061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 0x7fbd001408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd000aecf0 con 0x7fbd000ad5c0 2021-10-20T23:25:52.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd000b6f20 con 0x7fbd00061320 2021-10-20T23:25:52.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000aef20 con 0x7fbd00140440 2021-10-20T23:25:52.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd04f69700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbd000ad5c0 0x7fbd000b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:46786/0 (socket says 172.21.15.12:46786) 2021-10-20T23:25:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd04f69700 1 -- 172.21.15.12:0/1028093267 learned_addr learned my addr 172.21.15.12:0/1028093267 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:25:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0576a700 1 --2- 172.21.15.12:0/1028093267 >> v2:172.21.15.12:3300/0 conn(0x7fbd00061320 0x7fbd00061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd05f6b700 1 --2- 172.21.15.12:0/1028093267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 0x7fbd001408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbcf7fff700 1 -- 172.21.15.12:0/1028093267 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357944422 0 0) 0x7fbd000aecf0 con 0x7fbd000ad5c0 2021-10-20T23:25:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbcf7fff700 1 -- 172.21.15.12:0/1028093267 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce4003260 con 0x7fbd000ad5c0 2021-10-20T23:25:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd05f6b700 1 -- 172.21.15.12:0/1028093267 >> v2:172.21.15.12:3300/0 conn(0x7fbd00061320 msgr2=0x7fbd00061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:25:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd05f6b700 1 --2- 172.21.15.12:0/1028093267 >> v2:172.21.15.12:3300/0 conn(0x7fbd00061320 0x7fbd00061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd05f6b700 1 -- 172.21.15.12:0/1028093267 >> v1:172.21.15.31:6789/0 conn(0x7fbd000ad5c0 legacy=0x7fbd000b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd05f6b700 1 -- 172.21.15.12:0/1028093267 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd000af1c0 con 0x7fbd00140440 2021-10-20T23:25:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd05f6b700 1 --2- 172.21.15.12:0/1028093267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 0x7fbd001408d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbd000aeba0 tx=0x7fbcf80091d0).ready entity=mon.2 client_cookie=4d0bf263627f993 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbcf7fff700 1 -- 172.21.15.12:0/1028093267 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf800b600 con 0x7fbd00140440 2021-10-20T23:25:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbcf7fff700 1 -- 172.21.15.12:0/1028093267 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf800b760 con 0x7fbd00140440 2021-10-20T23:25:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbcf7fff700 1 -- 172.21.15.12:0/1028093267 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf800b8d0 con 0x7fbd00140440 2021-10-20T23:25:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 -- 172.21.15.12:0/1028093267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 msgr2=0x7fbd001408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 --2- 172.21.15.12:0/1028093267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 0x7fbd001408d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbd000aeba0 tx=0x7fbcf80091d0).stop 2021-10-20T23:25:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 -- 172.21.15.12:0/1028093267 shutdown_connections 2021-10-20T23:25:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 --2- 172.21.15.12:0/1028093267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 0x7fbd001408d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 --2- 172.21.15.12:0/1028093267 >> v2:172.21.15.12:3300/0 conn(0x7fbd00061320 0x7fbd00061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 -- 172.21.15.12:0/1028093267 >> 172.21.15.12:0/1028093267 conn(0x7fbd00066de0 msgr2=0x7fbd000671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:52.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 -- 172.21.15.12:0/1028093267 shutdown_connections 2021-10-20T23:25:52.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.881+0000 7fbd0676c700 1 -- 172.21.15.12:0/1028093267 wait complete. 2021-10-20T23:25:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.885+0000 7fbd0676c700 1 Processor -- start 2021-10-20T23:25:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.885+0000 7fbd0676c700 1 -- start start 2021-10-20T23:25:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.885+0000 7fbd0676c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd00061320 0x7fbd00156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.885+0000 7fbd0676c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd000ad5c0 0x7fbd000b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd0676c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 0x7fbd001491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd0676c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000b00e0 con 0x7fbd000ad5c0 2021-10-20T23:25:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd0676c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd00141710 con 0x7fbd00061320 2021-10-20T23:25:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd0676c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd001419b0 con 0x7fbd00140440 2021-10-20T23:25:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd04f69700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd000ad5c0 0x7fbd000b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd04f69700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd000ad5c0 0x7fbd000b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41136/0 (socket says 172.21.15.12:41136) 2021-10-20T23:25:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd04f69700 1 -- 172.21.15.12:0/3655073227 learned_addr learned my addr 172.21.15.12:0/3655073227 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:25:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd0576a700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd00061320 0x7fbd00156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd05f6b700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 0x7fbd001491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd04f69700 1 -- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 msgr2=0x7fbd001491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd04f69700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 0x7fbd001491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd04f69700 1 -- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd00061320 msgr2=0x7fbd00156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd04f69700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd00061320 0x7fbd00156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd04f69700 1 -- 172.21.15.12:0/3655073227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf8009470 con 0x7fbd000ad5c0 2021-10-20T23:25:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd04f69700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd000ad5c0 0x7fbd000b0ed0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fbcfc001110 tx=0x7fbcfc007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbcf67fc700 1 -- 172.21.15.12:0/3655073227 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcfc0070d0 con 0x7fbd000ad5c0 2021-10-20T23:25:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbcf67fc700 1 -- 172.21.15.12:0/3655073227 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc007230 con 0x7fbd000ad5c0 2021-10-20T23:25:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd00141c50 con 0x7fbd000ad5c0 2021-10-20T23:25:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbcf67fc700 1 -- 172.21.15.12:0/3655073227 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcfc005610 con 0x7fbd000ad5c0 2021-10-20T23:25:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd001569c0 con 0x7fbd000ad5c0 2021-10-20T23:25:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd000af460 con 0x7fbd000ad5c0 2021-10-20T23:25:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.889+0000 7fbcf67fc700 1 -- 172.21.15.12:0/3655073227 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbcfc01a060 con 0x7fbd000ad5c0 2021-10-20T23:25:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.893+0000 7fbcf67fc700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbce80534f0 0x7fbce80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:25:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.893+0000 7fbcf67fc700 1 -- 172.21.15.12:0/3655073227 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbcfc06b1c0 con 0x7fbd000ad5c0 2021-10-20T23:25:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.893+0000 7fbd0576a700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbce80534f0 0x7fbce80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:25:52.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.893+0000 7fbd0576a700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbce80534f0 0x7fbce80559b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fbcf000b000 tx=0x7fbcf0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:25:52.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:52.897+0000 7fbcf67fc700 1 -- 172.21.15.12:0/3655073227 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbcfc0421c0 con 0x7fbd000ad5c0 2021-10-20T23:25:53.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.061+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd00057350 con 0x7fbd000ad5c0 2021-10-20T23:25:53.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbcf67fc700 1 -- 172.21.15.12:0/3655073227 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fbcfc018070 con 0x7fbd000ad5c0 2021-10-20T23:25:53.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:25:53.072 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:25:41.263533+0000","modified":"2021-10-20T23:25:42.936432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3651290992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3651290992},{"type":"v1","addr":"172.21.15.31:6835","nonce":3651290992}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-20T23:25:53.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbce80534f0 msgr2=0x7fbce80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:53.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbce80534f0 0x7fbce80559b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fbcf000b000 tx=0x7fbcf0006df0).stop 2021-10-20T23:25:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd000ad5c0 msgr2=0x7fbd000b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:25:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd000ad5c0 0x7fbd000b0ed0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fbcfc001110 tx=0x7fbcfc007a80).stop 2021-10-20T23:25:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 shutdown_connections 2021-10-20T23:25:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbce80534f0 0x7fbce80559b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd00140440 0x7fbd001491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd000ad5c0 0x7fbd000b0ed0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 --2- 172.21.15.12:0/3655073227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd00061320 0x7fbd00156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:25:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 >> 172.21.15.12:0/3655073227 conn(0x7fbd00066de0 msgr2=0x7fbd000b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:25:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 shutdown_connections 2021-10-20T23:25:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:25:53.065+0000 7fbd0676c700 1 -- 172.21.15.12:0/3655073227 wait complete. 2021-10-20T23:25:53.080 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 38 2021-10-20T23:25:53.086 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2021-10-20T23:25:53.203 INFO:teuthology.orchestra.run.smithi031.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2021-10-20T23:25:53.203 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-10-20T23:25:53.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:53.204 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:53.205 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:25:53.213 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:25:53.214 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:25:53.215 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-20T23:25:53.216 DEBUG:teuthology.orchestra.run.smithi119:> import time 2021-10-20T23:25:53.216 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:25:53.217 DEBUG:teuthology.orchestra.run.smithi119:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-10-20T23:25:53.217 DEBUG:teuthology.orchestra.run.smithi119:> f.write('"'"'content'"'"') 2021-10-20T23:25:53.217 DEBUG:teuthology.orchestra.run.smithi119:> f.flush() 2021-10-20T23:25:53.218 DEBUG:teuthology.orchestra.run.smithi119:> f.write('"'"'content2'"'"') 2021-10-20T23:25:53.218 DEBUG:teuthology.orchestra.run.smithi119:> while True: 2021-10-20T23:25:53.219 DEBUG:teuthology.orchestra.run.smithi119:> time.sleep(1) 2021-10-20T23:25:53.219 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:25:53.222 DEBUG:teuthology.orchestra.run.smithi119:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-10-20T23:25:53.246 INFO:teuthology.orchestra.run.smithi119.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-10-20T23:25:53.246 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-10-20T23:25:54.249 DEBUG:teuthology.orchestra.run.smithi119:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-10-20T23:25:54.267 INFO:teuthology.orchestra.run.smithi119.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-10-20T23:25:54.268 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-10-20T23:25:54.269 DEBUG:teuthology.orchestra.run.smithi136:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-10-20T23:25:54.306 INFO:teuthology.orchestra.run.smithi136.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-10-20T23:25:54.308 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-10-20T23:25:54.308 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:25:54.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:25:54.325 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:25:54.326 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:25:54.336 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:25:54.336 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:25:54.337 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-20T23:25:54.337 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:25:54.337 DEBUG:teuthology.orchestra.run.smithi136:> import time 2021-10-20T23:25:54.338 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:25:54.338 DEBUG:teuthology.orchestra.run.smithi136:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-10-20T23:25:54.339 DEBUG:teuthology.orchestra.run.smithi136:> try: 2021-10-20T23:25:54.339 DEBUG:teuthology.orchestra.run.smithi136:> while True: 2021-10-20T23:25:54.340 DEBUG:teuthology.orchestra.run.smithi136:> os.write(fd, b'"'"'content'"'"') 2021-10-20T23:25:54.340 DEBUG:teuthology.orchestra.run.smithi136:> time.sleep(1) 2021-10-20T23:25:54.340 DEBUG:teuthology.orchestra.run.smithi136:> if not False: 2021-10-20T23:25:54.341 DEBUG:teuthology.orchestra.run.smithi136:> break 2021-10-20T23:25:54.341 DEBUG:teuthology.orchestra.run.smithi136:> except IOError as e: 2021-10-20T23:25:54.341 DEBUG:teuthology.orchestra.run.smithi136:> pass 2021-10-20T23:25:54.342 DEBUG:teuthology.orchestra.run.smithi136:> os.close(fd) 2021-10-20T23:25:54.342 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:26:07.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:26:07.065 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:26:07.067 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:26:07.070 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:26:33.306 INFO:tasks.cephfs.test_misc:cap_waiter waited 38.92649602890015s 2021-10-20T23:26:33.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls --format=json 2021-10-20T23:26:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.412+0000 7f0cecdce700 1 Processor -- start 2021-10-20T23:26:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.412+0000 7f0cecdce700 1 -- start start 2021-10-20T23:26:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0cecdce700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ce8067120 0x7f0ce80b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0cecdce700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce813fff0 0x7f0ce8140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0cecdce700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce80b9bd0 con 0x7f0ce81439b0 2021-10-20T23:26:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0cecdce700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce8143080 con 0x7f0ce8067120 2021-10-20T23:26:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0cecdce700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8067500 con 0x7f0ce813fff0 2021-10-20T23:26:33.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce813fff0 0x7f0ce8140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ce8067120 0x7f0ce80b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce813fff0 0x7f0ce8140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46902/0 (socket says 172.21.15.12:46902) 2021-10-20T23:26:33.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce6d9d700 1 -- 172.21.15.12:0/4270267106 learned_addr learned my addr 172.21.15.12:0/4270267106 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce659c700 1 -- 172.21.15.12:0/4270267106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce813fff0 msgr2=0x7f0ce8140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce659c700 1 --2- 172.21.15.12:0/4270267106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce813fff0 0x7f0ce8140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce659c700 1 -- 172.21.15.12:0/4270267106 >> v1:172.21.15.31:6789/0 conn(0x7f0ce81439b0 legacy=0x7f0ce80aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce659c700 1 -- 172.21.15.12:0/4270267106 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80af4d0 con 0x7f0ce8067120 2021-10-20T23:26:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce559a700 1 -- 172.21.15.12:0/4270267106 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48997566 0 0) 0x7f0cd0001110 con 0x7f0ce81439b0 2021-10-20T23:26:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce6d9d700 1 --2- 172.21.15.12:0/4270267106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce813fff0 0x7f0ce8140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce659c700 1 --2- 172.21.15.12:0/4270267106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce8067120 0x7f0ce80b96e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f0cd8002f70 tx=0x7f0cd8006df0).ready entity=mon.1 client_cookie=a8bb49761cbd5860 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce559a700 1 -- 172.21.15.12:0/4270267106 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cd800d570 con 0x7f0ce8067120 2021-10-20T23:26:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce559a700 1 -- 172.21.15.12:0/4270267106 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd8000e90 con 0x7f0ce8067120 2021-10-20T23:26:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0ce559a700 1 -- 172.21.15.12:0/4270267106 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cd800d8c0 con 0x7f0ce8067120 2021-10-20T23:26:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0cecdce700 1 -- 172.21.15.12:0/4270267106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce8067120 msgr2=0x7f0ce80b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0cecdce700 1 --2- 172.21.15.12:0/4270267106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce8067120 0x7f0ce80b96e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f0cd8002f70 tx=0x7f0cd8006df0).stop 2021-10-20T23:26:33.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.416+0000 7f0cecdce700 1 -- 172.21.15.12:0/4270267106 shutdown_connections 2021-10-20T23:26:33.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 --2- 172.21.15.12:0/4270267106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce813fff0 0x7f0ce8140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 --2- 172.21.15.12:0/4270267106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce8067120 0x7f0ce80b96e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 -- 172.21.15.12:0/4270267106 >> 172.21.15.12:0/4270267106 conn(0x7f0ce805f9f0 msgr2=0x7f0ce80616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:33.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 -- 172.21.15.12:0/4270267106 shutdown_connections 2021-10-20T23:26:33.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 -- 172.21.15.12:0/4270267106 wait complete. 2021-10-20T23:26:33.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 Processor -- start 2021-10-20T23:26:33.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 -- start start 2021-10-20T23:26:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce8067120 0x7f0ce813f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce813fff0 0x7f0ce80b8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce81439b0 0x7f0ce80b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80b13b0 con 0x7f0ce8067120 2021-10-20T23:26:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80b73d0 con 0x7f0ce813fff0 2021-10-20T23:26:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0cecdce700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80b7670 con 0x7f0ce81439b0 2021-10-20T23:26:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0ce659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce8067120 0x7f0ce813f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0ce659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce8067120 0x7f0ce813f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41150/0 (socket says 172.21.15.12:41150) 2021-10-20T23:26:33.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0ce659c700 1 -- 172.21.15.12:0/330502617 learned_addr learned my addr 172.21.15.12:0/330502617 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:33.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0ce5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce813fff0 0x7f0ce80b8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.420+0000 7f0ce6d9d700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce81439b0 0x7f0ce80b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0ce5d9b700 1 -- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce81439b0 msgr2=0x7f0ce80b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0ce5d9b700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce81439b0 0x7f0ce80b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0ce5d9b700 1 -- 172.21.15.12:0/330502617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce8067120 msgr2=0x7f0ce813f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0ce5d9b700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce8067120 0x7f0ce813f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0ce5d9b700 1 -- 172.21.15.12:0/330502617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0009530 con 0x7f0ce813fff0 2021-10-20T23:26:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0ce659c700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce8067120 0x7f0ce813f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0ce5d9b700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce813fff0 0x7f0ce80b8680 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f0cd0000ed0 tx=0x7f0cd0007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0cdf7fe700 1 -- 172.21.15.12:0/330502617 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cd0013450 con 0x7f0ce813fff0 2021-10-20T23:26:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0cdf7fe700 1 -- 172.21.15.12:0/330502617 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00135b0 con 0x7f0ce813fff0 2021-10-20T23:26:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd800b180 con 0x7f0ce813fff0 2021-10-20T23:26:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0cdf7fe700 1 -- 172.21.15.12:0/330502617 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cd0013910 con 0x7f0ce813fff0 2021-10-20T23:26:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce8145ab0 con 0x7f0ce813fff0 2021-10-20T23:26:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce8057350 con 0x7f0ce813fff0 2021-10-20T23:26:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0cdf7fe700 1 -- 172.21.15.12:0/330502617 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0cd0010070 con 0x7f0ce813fff0 2021-10-20T23:26:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0cdf7fe700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc00536a0 0x7f0cc0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.424+0000 7f0cdf7fe700 1 -- 172.21.15.12:0/330502617 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f0cd006b0a0 con 0x7f0ce813fff0 2021-10-20T23:26:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.428+0000 7f0ce659c700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc00536a0 0x7f0cc0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.428+0000 7f0ce659c700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc00536a0 0x7f0cc0055b60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f0cd801a000 tx=0x7f0cd8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.436+0000 7f0cdf7fe700 1 -- 172.21.15.12:0/330502617 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0cd0041ef0 con 0x7f0ce813fff0 2021-10-20T23:26:33.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.580+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7f0ce80b9bd0 con 0x7f0ce813fff0 2021-10-20T23:26:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.580+0000 7f0cdf7fe700 1 -- 172.21.15.12:0/330502617 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v80) v1 ==== 98+0+81 (secure 0 0 0) 0x7f0ce80b9bd0 con 0x7f0ce813fff0 2021-10-20T23:26:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc00536a0 msgr2=0x7f0cc0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc00536a0 0x7f0cc0055b60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f0cd801a000 tx=0x7f0cd8014000).stop 2021-10-20T23:26:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce813fff0 msgr2=0x7f0ce80b8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce813fff0 0x7f0ce80b8680 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f0cd0000ed0 tx=0x7f0cd0007b90).stop 2021-10-20T23:26:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 shutdown_connections 2021-10-20T23:26:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0cc00536a0 0x7f0cc0055b60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ce81439b0 0x7f0ce80b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ce813fff0 0x7f0ce80b8680 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 --2- 172.21.15.12:0/330502617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce8067120 0x7f0ce813f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 >> 172.21.15.12:0/330502617 conn(0x7f0ce805f9f0 msgr2=0x7f0ce813b150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 shutdown_connections 2021-10-20T23:26:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.584+0000 7f0cecdce700 1 -- 172.21.15.12:0/330502617 wait complete. 2021-10-20T23:26:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:listed 1 entries 2021-10-20T23:26:33.604 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr":"172.21.15.119:0/1668581666","until":"2021-10-21T00:26:27.076701+0000"}] 2021-10-20T23:26:33.620 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-10-20T23:26:33.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:33.621 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:33.622 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:33.668 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-10-20T23:26:33.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:26:33.671 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-10-20T23:26:33.671 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:26:33.672 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:26:33.673 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:33.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:33.694 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:33.694 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:33.744 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:26:33.745 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:26:33.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:26:33.746 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:33.754 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:26:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.852+0000 7f4ece441700 1 Processor -- start 2021-10-20T23:26:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.852+0000 7f4ece441700 1 -- start start 2021-10-20T23:26:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec80b6580 0x7f4ec80b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ec80b43c0 0x7f4ec80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec81440b0 con 0x7f4ec8061d30 2021-10-20T23:26:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec80b6e50 con 0x7f4ec80b43c0 2021-10-20T23:26:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec8143b70 con 0x7f4ec80b6580 2021-10-20T23:26:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ec80b43c0 0x7f4ec80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec80b6580 0x7f4ec80b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ecc9de700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4ec8061d30 0x7f4ec81466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:46818/0 (socket says 172.21.15.12:46818) 2021-10-20T23:26:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ecc9de700 1 -- 172.21.15.12:0/1056785832 learned_addr learned my addr 172.21.15.12:0/1056785832 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec77fe700 1 -- 172.21.15.12:0/1056785832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec80b6580 msgr2=0x7f4ec80b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec77fe700 1 --2- 172.21.15.12:0/1056785832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec80b6580 0x7f4ec80b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec77fe700 1 -- 172.21.15.12:0/1056785832 >> v1:172.21.15.31:6789/0 conn(0x7f4ec8061d30 legacy=0x7f4ec81466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec77fe700 1 -- 172.21.15.12:0/1056785832 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8143e10 con 0x7f4ec80b43c0 2021-10-20T23:26:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec77fe700 1 --2- 172.21.15.12:0/1056785832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec80b43c0 0x7f4ec80b6960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f4ebc002f70 tx=0x7f4ebc006df0).ready entity=mon.1 client_cookie=6dc39fcad552ca84 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:33.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec6ffd700 1 -- 172.21.15.12:0/1056785832 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ebc00d570 con 0x7f4ec80b43c0 2021-10-20T23:26:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec6ffd700 1 -- 172.21.15.12:0/1056785832 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc000e90 con 0x7f4ec80b43c0 2021-10-20T23:26:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ec6ffd700 1 -- 172.21.15.12:0/1056785832 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ebc00d8c0 con 0x7f4ec80b43c0 2021-10-20T23:26:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 -- 172.21.15.12:0/1056785832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec80b43c0 msgr2=0x7f4ec80b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 --2- 172.21.15.12:0/1056785832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec80b43c0 0x7f4ec80b6960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f4ebc002f70 tx=0x7f4ebc006df0).stop 2021-10-20T23:26:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 -- 172.21.15.12:0/1056785832 shutdown_connections 2021-10-20T23:26:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 --2- 172.21.15.12:0/1056785832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec80b43c0 0x7f4ec80b6960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 --2- 172.21.15.12:0/1056785832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec80b6580 0x7f4ec80b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 -- 172.21.15.12:0/1056785832 >> 172.21.15.12:0/1056785832 conn(0x7f4ec805c490 msgr2=0x7f4ec805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 -- 172.21.15.12:0/1056785832 shutdown_connections 2021-10-20T23:26:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.856+0000 7f4ece441700 1 -- 172.21.15.12:0/1056785832 wait complete. 2021-10-20T23:26:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 Processor -- start 2021-10-20T23:26:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 -- start start 2021-10-20T23:26:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec8061d30 0x7f4ec8148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec80b43c0 0x7f4ec81400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec80b6580 0x7f4ec8146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec813b0a0 con 0x7f4ec80b43c0 2021-10-20T23:26:33.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec8148650 con 0x7f4ec80b6580 2021-10-20T23:26:33.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec813b2d0 con 0x7f4ec8061d30 2021-10-20T23:26:33.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec80b43c0 0x7f4ec81400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec80b43c0 0x7f4ec81400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41164/0 (socket says 172.21.15.12:41164) 2021-10-20T23:26:33.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec77fe700 1 -- 172.21.15.12:0/2746756913 learned_addr learned my addr 172.21.15.12:0/2746756913 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:33.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec7fff700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec8061d30 0x7f4ec8148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ecc9de700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec80b6580 0x7f4ec8146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec77fe700 1 -- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec8061d30 msgr2=0x7f4ec8148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec77fe700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec8061d30 0x7f4ec8148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec77fe700 1 -- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec80b6580 msgr2=0x7f4ec8146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:33.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec77fe700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec80b6580 0x7f4ec8146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:33.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec77fe700 1 -- 172.21.15.12:0/2746756913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc00b180 con 0x7f4ec80b43c0 2021-10-20T23:26:33.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec77fe700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec80b43c0 0x7f4ec81400d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f4ebc002f70 tx=0x7f4ebc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:33.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec57fa700 1 -- 172.21.15.12:0/2746756913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ebc016070 con 0x7f4ec80b43c0 2021-10-20T23:26:33.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec57fa700 1 -- 172.21.15.12:0/2746756913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc00d8f0 con 0x7f4ec80b43c0 2021-10-20T23:26:33.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ec57fa700 1 -- 172.21.15.12:0/2746756913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ebc013e90 con 0x7f4ec80b43c0 2021-10-20T23:26:33.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec8140910 con 0x7f4ec80b43c0 2021-10-20T23:26:33.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.860+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec8129780 con 0x7f4ec80b43c0 2021-10-20T23:26:33.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.864+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec8140760 con 0x7f4ec80b43c0 2021-10-20T23:26:33.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.864+0000 7f4ec57fa700 1 -- 172.21.15.12:0/2746756913 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4ebc00f030 con 0x7f4ec80b43c0 2021-10-20T23:26:33.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.864+0000 7f4ec57fa700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ea80536a0 0x7f4ea8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:33.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.864+0000 7f4ec57fa700 1 -- 172.21.15.12:0/2746756913 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f4ebc06c6a0 con 0x7f4ec80b43c0 2021-10-20T23:26:33.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.864+0000 7f4ec7fff700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ea80536a0 0x7f4ea8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:33.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.864+0000 7f4ec7fff700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ea80536a0 0x7f4ea8055b60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f4eb800b000 tx=0x7f4eb8006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:33.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:33.868+0000 7f4ec57fa700 1 -- 172.21.15.12:0/2746756913 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4ebc043680 con 0x7f4ec80b43c0 2021-10-20T23:26:34.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.000+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ec8140aa0 con 0x7f4ec80b43c0 2021-10-20T23:26:34.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.000+0000 7f4ec57fa700 1 -- 172.21.15.12:0/2746756913 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16336 (secure 0 0 0) 0x7f4ebc023020 con 0x7f4ec80b43c0 2021-10-20T23:26:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:34.013 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":80,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:26:27.905694+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:25:39.858993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-20T23:25:40.250129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.119:0/1668581666":"2021-10-21T00:26:27.076701+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:26:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ea80536a0 msgr2=0x7f4ea8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ea80536a0 0x7f4ea8055b60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f4eb800b000 tx=0x7f4eb8006df0).stop 2021-10-20T23:26:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec80b43c0 msgr2=0x7f4ec81400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec80b43c0 0x7f4ec81400d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f4ebc002f70 tx=0x7f4ebc014000).stop 2021-10-20T23:26:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 shutdown_connections 2021-10-20T23:26:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4ea80536a0 0x7f4ea8055b60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec80b6580 0x7f4ec8146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec80b43c0 0x7f4ec81400d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 --2- 172.21.15.12:0/2746756913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec8061d30 0x7f4ec8148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 >> 172.21.15.12:0/2746756913 conn(0x7f4ec805c490 msgr2=0x7f4ec8145800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 shutdown_connections 2021-10-20T23:26:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.004+0000 7f4ece441700 1 -- 172.21.15.12:0/2746756913 wait complete. 2021-10-20T23:26:34.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:25:39.858993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:25:40.250129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:26:34.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:26:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.128+0000 7faeb3fff700 1 Processor -- start 2021-10-20T23:26:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.128+0000 7faeb3fff700 1 -- start start 2021-10-20T23:26:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.128+0000 7faeb3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb40ad5c0 0x7faeb4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faeb4140440 0x7faeb41408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb40aecf0 con 0x7faeb4061320 2021-10-20T23:26:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40b6f20 con 0x7faeb4140440 2021-10-20T23:26:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40aef20 con 0x7faeb40ad5c0 2021-10-20T23:26:34.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb27fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb40ad5c0 0x7faeb4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faeb4140440 0x7faeb41408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb27fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb40ad5c0 0x7faeb4061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46930/0 (socket says 172.21.15.12:46930) 2021-10-20T23:26:34.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faeb4140440 0x7faeb41408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:56148/0 (socket says 172.21.15.12:56148) 2021-10-20T23:26:34.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb27fc700 1 -- 172.21.15.12:0/3895205407 learned_addr learned my addr 172.21.15.12:0/3895205407 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:34.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb27fc700 1 -- 172.21.15.12:0/3895205407 >> v2:172.21.15.31:3300/0 conn(0x7faeb4140440 msgr2=0x7faeb41408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:34.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb27fc700 1 --2- 172.21.15.12:0/3895205407 >> v2:172.21.15.31:3300/0 conn(0x7faeb4140440 0x7faeb41408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb27fc700 1 -- 172.21.15.12:0/3895205407 >> v1:172.21.15.31:6789/0 conn(0x7faeb4061320 legacy=0x7faeb40b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb27fc700 1 -- 172.21.15.12:0/3895205407 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40af1c0 con 0x7faeb40ad5c0 2021-10-20T23:26:34.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb27fc700 1 --2- 172.21.15.12:0/3895205407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb40ad5c0 0x7faeb4061700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7faea4002f70 tx=0x7faea4006eb0).ready entity=mon.2 client_cookie=60a23b63f34ac0a0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb1ffb700 1 -- 172.21.15.12:0/3895205407 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faea400d570 con 0x7faeb40ad5c0 2021-10-20T23:26:34.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb1ffb700 1 -- 172.21.15.12:0/3895205407 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4000e90 con 0x7faeb40ad5c0 2021-10-20T23:26:34.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb1ffb700 1 -- 172.21.15.12:0/3895205407 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faea400d900 con 0x7faeb40ad5c0 2021-10-20T23:26:34.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 -- 172.21.15.12:0/3895205407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb40ad5c0 msgr2=0x7faeb4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 --2- 172.21.15.12:0/3895205407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb40ad5c0 0x7faeb4061700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7faea4002f70 tx=0x7faea4006eb0).stop 2021-10-20T23:26:34.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 -- 172.21.15.12:0/3895205407 shutdown_connections 2021-10-20T23:26:34.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 --2- 172.21.15.12:0/3895205407 >> v2:172.21.15.31:3300/0 conn(0x7faeb4140440 0x7faeb41408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 --2- 172.21.15.12:0/3895205407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb40ad5c0 0x7faeb4061700 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 -- 172.21.15.12:0/3895205407 >> 172.21.15.12:0/3895205407 conn(0x7faeb4066de0 msgr2=0x7faeb40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:34.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 -- 172.21.15.12:0/3895205407 shutdown_connections 2021-10-20T23:26:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.132+0000 7faeb3fff700 1 -- 172.21.15.12:0/3895205407 wait complete. 2021-10-20T23:26:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb3fff700 1 Processor -- start 2021-10-20T23:26:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb3fff700 1 -- start start 2021-10-20T23:26:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb4061320 0x7faeb405bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faeb40ad5c0 0x7faeb4152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb4140440 0x7faeb41562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb4155bd0 con 0x7faeb40ad5c0 2021-10-20T23:26:34.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb3fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40b3610 con 0x7faeb4061320 2021-10-20T23:26:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb4155e00 con 0x7faeb4140440 2021-10-20T23:26:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faeb40ad5c0 0x7faeb4152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faeb40ad5c0 0x7faeb4152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41178/0 (socket says 172.21.15.12:41178) 2021-10-20T23:26:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb27fc700 1 -- 172.21.15.12:0/2754863501 learned_addr learned my addr 172.21.15.12:0/2754863501 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb37fe700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb4140440 0x7faeb41562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb2ffd700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb4061320 0x7faeb405bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb27fc700 1 -- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb4140440 msgr2=0x7faeb41562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb27fc700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb4140440 0x7faeb41562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb27fc700 1 -- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb4061320 msgr2=0x7faeb405bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb27fc700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb4061320 0x7faeb405bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb27fc700 1 -- 172.21.15.12:0/2754863501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea400b1e0 con 0x7faeb40ad5c0 2021-10-20T23:26:34.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb37fe700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb4140440 0x7faeb41562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:34.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faeb27fc700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faeb40ad5c0 0x7faeb4152560 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7faea4002f70 tx=0x7faea4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faea3fff700 1 -- 172.21.15.12:0/2754863501 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faea40068b0 con 0x7faeb40ad5c0 2021-10-20T23:26:34.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faea3fff700 1 -- 172.21.15.12:0/2754863501 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea400de30 con 0x7faeb40ad5c0 2021-10-20T23:26:34.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.136+0000 7faea3fff700 1 -- 172.21.15.12:0/2754863501 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faea4011d70 con 0x7faeb40ad5c0 2021-10-20T23:26:34.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.140+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb40b38b0 con 0x7faeb40ad5c0 2021-10-20T23:26:34.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.140+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb40b5290 con 0x7faeb40ad5c0 2021-10-20T23:26:34.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.140+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb4155fc0 con 0x7faeb40ad5c0 2021-10-20T23:26:34.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.140+0000 7faea3fff700 1 -- 172.21.15.12:0/2754863501 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faea401a040 con 0x7faeb40ad5c0 2021-10-20T23:26:34.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.140+0000 7faea3fff700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae900535b0 0x7fae90055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.140+0000 7faea3fff700 1 -- 172.21.15.12:0/2754863501 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7faea406c860 con 0x7faeb40ad5c0 2021-10-20T23:26:34.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.140+0000 7faeb2ffd700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae900535b0 0x7fae90055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.144+0000 7faeb2ffd700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae900535b0 0x7fae90055a70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7faea800d000 tx=0x7faea8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.148+0000 7faea3fff700 1 -- 172.21.15.12:0/2754863501 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faea4043880 con 0x7faeb40ad5c0 2021-10-20T23:26:34.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.272+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7faeb40b33f0 con 0x7faeb40ad5c0 2021-10-20T23:26:34.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faea3fff700 1 -- 172.21.15.12:0/2754863501 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v80) v1 ==== 110+0+10 (secure 0 0 0) 0x7faea40230b0 con 0x7faeb40ad5c0 2021-10-20T23:26:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:26:34.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae900535b0 msgr2=0x7fae90055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae900535b0 0x7fae90055a70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7faea800d000 tx=0x7faea8009040).stop 2021-10-20T23:26:34.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faeb40ad5c0 msgr2=0x7faeb4152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faeb40ad5c0 0x7faeb4152560 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7faea4002f70 tx=0x7faea4015000).stop 2021-10-20T23:26:34.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 shutdown_connections 2021-10-20T23:26:34.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae900535b0 0x7fae90055a70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faeb4140440 0x7faeb41562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faeb40ad5c0 0x7faeb4152560 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 --2- 172.21.15.12:0/2754863501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb4061320 0x7faeb405bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 >> 172.21.15.12:0/2754863501 conn(0x7faeb4066de0 msgr2=0x7faeb405cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:34.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 shutdown_connections 2021-10-20T23:26:34.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.276+0000 7faeb3fff700 1 -- 172.21.15.12:0/2754863501 wait complete. 2021-10-20T23:26:34.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:26:34.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff7b7c700 1 Processor -- start 2021-10-20T23:26:34.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff7b7c700 1 -- start start 2021-10-20T23:26:34.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff7b7c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdff0146950 0x7fdff0140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff7b7c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 0x7fdff0140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff7b7c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff0143b60 con 0x7fdff00b4690 2021-10-20T23:26:34.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff7b7c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff0147510 con 0x7fdff0146950 2021-10-20T23:26:34.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff7b7c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0143e00 con 0x7fdff00b4180 2021-10-20T23:26:34.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff5918700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdff0146950 0x7fdff0140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff5918700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdff0146950 0x7fdff0140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41184/0 (socket says 172.21.15.12:41184) 2021-10-20T23:26:34.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff5918700 1 -- 172.21.15.12:0/3474841797 learned_addr learned my addr 172.21.15.12:0/3474841797 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:34.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff5117700 1 --2- 172.21.15.12:0/3474841797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 0x7fdff0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff5918700 1 -- 172.21.15.12:0/3474841797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 msgr2=0x7fdff0140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:34.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff5918700 1 --2- 172.21.15.12:0/3474841797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 0x7fdff0140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff5918700 1 -- 172.21.15.12:0/3474841797 >> v1:172.21.15.31:6789/0 conn(0x7fdff00b4690 legacy=0x7fdff00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff5918700 1 -- 172.21.15.12:0/3474841797 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00b0c90 con 0x7fdff0146950 2021-10-20T23:26:34.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff5918700 1 --2- 172.21.15.12:0/3474841797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 0x7fdff0140230 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fdfec002f70 tx=0x7fdfec006eb0).ready entity=mon.0 client_cookie=2d7175b8b20a22be server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff4916700 1 -- 172.21.15.12:0/3474841797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec00d570 con 0x7fdff0146950 2021-10-20T23:26:34.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff4916700 1 -- 172.21.15.12:0/3474841797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec000e90 con 0x7fdff0146950 2021-10-20T23:26:34.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.400+0000 7fdff4916700 1 -- 172.21.15.12:0/3474841797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec00d900 con 0x7fdff0146950 2021-10-20T23:26:34.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 -- 172.21.15.12:0/3474841797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 msgr2=0x7fdff0140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 --2- 172.21.15.12:0/3474841797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 0x7fdff0140230 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fdfec002f70 tx=0x7fdfec006eb0).stop 2021-10-20T23:26:34.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 -- 172.21.15.12:0/3474841797 shutdown_connections 2021-10-20T23:26:34.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 --2- 172.21.15.12:0/3474841797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 0x7fdff0140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 --2- 172.21.15.12:0/3474841797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 0x7fdff0140230 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 -- 172.21.15.12:0/3474841797 >> 172.21.15.12:0/3474841797 conn(0x7fdff005c490 msgr2=0x7fdff005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:34.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 -- 172.21.15.12:0/3474841797 shutdown_connections 2021-10-20T23:26:34.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 -- 172.21.15.12:0/3474841797 wait complete. 2021-10-20T23:26:34.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 Processor -- start 2021-10-20T23:26:34.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 -- start start 2021-10-20T23:26:34.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 0x7fdff00b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdff00b4690 0x7fdff0152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 0x7fdff0152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b0410 con 0x7fdff0146950 2021-10-20T23:26:34.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0152c10 con 0x7fdff00b4690 2021-10-20T23:26:34.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff7b7c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0156320 con 0x7fdff00b4180 2021-10-20T23:26:34.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff5117700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdff00b4690 0x7fdff0152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff6119700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 0x7fdff0152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff5918700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 0x7fdff00b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff5117700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdff00b4690 0x7fdff0152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:56166/0 (socket says 172.21.15.12:56166) 2021-10-20T23:26:34.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff5117700 1 -- 172.21.15.12:0/616960684 learned_addr learned my addr 172.21.15.12:0/616960684 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff5918700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 0x7fdff00b87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46948/0 (socket says 172.21.15.12:46948) 2021-10-20T23:26:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff6119700 1 -- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 msgr2=0x7fdff00b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff6119700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 0x7fdff00b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff6119700 1 -- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdff00b4690 msgr2=0x7fdff0152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff6119700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdff00b4690 0x7fdff0152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.404+0000 7fdff6119700 1 -- 172.21.15.12:0/616960684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec00b1e0 con 0x7fdff0146950 2021-10-20T23:26:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdff6119700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 0x7fdff0152720 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fdff0060c50 tx=0x7fdfe8007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdfdeffd700 1 -- 172.21.15.12:0/616960684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe800f470 con 0x7fdff0146950 2021-10-20T23:26:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdfdeffd700 1 -- 172.21.15.12:0/616960684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe800f5d0 con 0x7fdff0146950 2021-10-20T23:26:34.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff01565c0 con 0x7fdff0146950 2021-10-20T23:26:34.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdfdeffd700 1 -- 172.21.15.12:0/616960684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe800f930 con 0x7fdff0146950 2021-10-20T23:26:34.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff01437d0 con 0x7fdff0146950 2021-10-20T23:26:34.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff0143530 con 0x7fdff0146950 2021-10-20T23:26:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdfdeffd700 1 -- 172.21.15.12:0/616960684 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdfe8010070 con 0x7fdff0146950 2021-10-20T23:26:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdfdeffd700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdfd00534f0 0x7fdfd00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdfdeffd700 1 -- 172.21.15.12:0/616960684 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fdfe806afa0 con 0x7fdff0146950 2021-10-20T23:26:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.408+0000 7fdff5918700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdfd00534f0 0x7fdfd00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.412+0000 7fdff5918700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdfd00534f0 0x7fdfd00559b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fdfec01c000 tx=0x7fdfec015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.416+0000 7fdfdeffd700 1 -- 172.21.15.12:0/616960684 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdff0143530 con 0x7fdff0146950 2021-10-20T23:26:34.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.544+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdff0143530 con 0x7fdff0146950 2021-10-20T23:26:34.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.544+0000 7fdfdeffd700 1 -- 172.21.15.12:0/616960684 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdff0143530 con 0x7fdff0146950 2021-10-20T23:26:34.554 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:34.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdfd00534f0 msgr2=0x7fdfd00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdfd00534f0 0x7fdfd00559b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fdfec01c000 tx=0x7fdfec015000).stop 2021-10-20T23:26:34.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 msgr2=0x7fdff0152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 0x7fdff0152720 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fdff0060c50 tx=0x7fdfe8007eb0).stop 2021-10-20T23:26:34.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 shutdown_connections 2021-10-20T23:26:34.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdfd00534f0 0x7fdfd00559b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdff0146950 0x7fdff0152720 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdff00b4690 0x7fdff0152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 --2- 172.21.15.12:0/616960684 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdff00b4180 0x7fdff00b87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 >> 172.21.15.12:0/616960684 conn(0x7fdff005c490 msgr2=0x7fdff00b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:34.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 shutdown_connections 2021-10-20T23:26:34.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.548+0000 7fdff7b7c700 1 -- 172.21.15.12:0/616960684 wait complete. 2021-10-20T23:26:34.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:26:34.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.668+0000 7f69e5af6700 1 Processor -- start 2021-10-20T23:26:34.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.668+0000 7f69e5af6700 1 -- start start 2021-10-20T23:26:34.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.668+0000 7f69e5af6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00ad140 0x7f69e00b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.668+0000 7f69e5af6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69e0143560 0x7f69e01439e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.668+0000 7f69e5af6700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e00b0470 con 0x7f69e00b59a0 2021-10-20T23:26:34.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.668+0000 7f69e5af6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e00b5d80 con 0x7f69e0143560 2021-10-20T23:26:34.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.668+0000 7f69e5af6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00af3f0 con 0x7f69e00ad140 2021-10-20T23:26:34.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e4af4700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f69e00b59a0 0x7f69e00af850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39792/0 (socket says 172.21.15.12:39792) 2021-10-20T23:26:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e4af4700 1 -- 172.21.15.12:0/2208323455 learned_addr learned my addr 172.21.15.12:0/2208323455 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e52f5700 1 --2- 172.21.15.12:0/2208323455 >> v2:172.21.15.31:3300/0 conn(0x7f69e0143560 0x7f69e01439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69dffff700 1 --2- 172.21.15.12:0/2208323455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00ad140 0x7f69e00b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69df7fe700 1 -- 172.21.15.12:0/2208323455 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546302733 0 0) 0x7f69e00b0470 con 0x7f69e00b59a0 2021-10-20T23:26:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69df7fe700 1 -- 172.21.15.12:0/2208323455 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69cc003260 con 0x7f69e00b59a0 2021-10-20T23:26:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e52f5700 1 -- 172.21.15.12:0/2208323455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00ad140 msgr2=0x7f69e00b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e52f5700 1 --2- 172.21.15.12:0/2208323455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00ad140 0x7f69e00b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e52f5700 1 -- 172.21.15.12:0/2208323455 >> v1:172.21.15.12:6789/0 conn(0x7f69e00b59a0 legacy=0x7f69e00af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e52f5700 1 -- 172.21.15.12:0/2208323455 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e00b0a60 con 0x7f69e0143560 2021-10-20T23:26:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e52f5700 1 --2- 172.21.15.12:0/2208323455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69e0143560 0x7f69e01439e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f69d80032f0 tx=0x7f69d80091d0).ready entity=mon.1 client_cookie=eaa949c975b53396 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69df7fe700 1 -- 172.21.15.12:0/2208323455 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d800b600 con 0x7f69e0143560 2021-10-20T23:26:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69df7fe700 1 -- 172.21.15.12:0/2208323455 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d800b760 con 0x7f69e0143560 2021-10-20T23:26:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69df7fe700 1 -- 172.21.15.12:0/2208323455 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d800b8d0 con 0x7f69e0143560 2021-10-20T23:26:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 -- 172.21.15.12:0/2208323455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69e0143560 msgr2=0x7f69e01439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 --2- 172.21.15.12:0/2208323455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69e0143560 0x7f69e01439e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f69d80032f0 tx=0x7f69d80091d0).stop 2021-10-20T23:26:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 -- 172.21.15.12:0/2208323455 shutdown_connections 2021-10-20T23:26:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 --2- 172.21.15.12:0/2208323455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69e0143560 0x7f69e01439e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 --2- 172.21.15.12:0/2208323455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00ad140 0x7f69e00b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 -- 172.21.15.12:0/2208323455 >> 172.21.15.12:0/2208323455 conn(0x7f69e005c490 msgr2=0x7f69e005c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 -- 172.21.15.12:0/2208323455 shutdown_connections 2021-10-20T23:26:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 -- 172.21.15.12:0/2208323455 wait complete. 2021-10-20T23:26:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 Processor -- start 2021-10-20T23:26:34.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.672+0000 7f69e5af6700 1 -- start start 2021-10-20T23:26:34.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e5af6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69e00ad140 0x7f69e013efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e5af6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00b59a0 0x7f69e0145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e5af6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e0143560 0x7f69e0152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e5af6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e0149060 con 0x7f69e0143560 2021-10-20T23:26:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e5af6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e01492c0 con 0x7f69e00ad140 2021-10-20T23:26:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e5af6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e0149560 con 0x7f69e00b59a0 2021-10-20T23:26:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e52f5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e0143560 0x7f69e0152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69dffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00b59a0 0x7f69e0145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e4af4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69e00ad140 0x7f69e013efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e52f5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e0143560 0x7f69e0152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41208/0 (socket says 172.21.15.12:41208) 2021-10-20T23:26:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e52f5700 1 -- 172.21.15.12:0/2512707791 learned_addr learned my addr 172.21.15.12:0/2512707791 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69dffff700 1 -- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69e00ad140 msgr2=0x7f69e013efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69dffff700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69e00ad140 0x7f69e013efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69dffff700 1 -- 172.21.15.12:0/2512707791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e0143560 msgr2=0x7f69e0152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69dffff700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e0143560 0x7f69e0152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69dffff700 1 -- 172.21.15.12:0/2512707791 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d8009470 con 0x7f69e00b59a0 2021-10-20T23:26:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e52f5700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e0143560 0x7f69e0152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69dffff700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00b59a0 0x7f69e0145d70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f69d000c000 tx=0x7f69d0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69ddffb700 1 -- 172.21.15.12:0/2512707791 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d0011750 con 0x7f69e00b59a0 2021-10-20T23:26:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69ddffb700 1 -- 172.21.15.12:0/2512707791 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d00118b0 con 0x7f69e00b59a0 2021-10-20T23:26:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e0152260 con 0x7f69e00b59a0 2021-10-20T23:26:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69ddffb700 1 -- 172.21.15.12:0/2512707791 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d0011c10 con 0x7f69e00b59a0 2021-10-20T23:26:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.676+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e0146260 con 0x7f69e00b59a0 2021-10-20T23:26:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.680+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e0145180 con 0x7f69e00b59a0 2021-10-20T23:26:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.680+0000 7f69ddffb700 1 -- 172.21.15.12:0/2512707791 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f69d0011d70 con 0x7f69e00b59a0 2021-10-20T23:26:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.680+0000 7f69ddffb700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f69c0053610 0x7f69c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.680+0000 7f69ddffb700 1 -- 172.21.15.12:0/2512707791 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f69d006bee0 con 0x7f69e00b59a0 2021-10-20T23:26:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.680+0000 7f69e4af4700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f69c0053610 0x7f69c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.680+0000 7f69e4af4700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f69c0053610 0x7f69c0055ad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f69d400d000 tx=0x7f69d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.688+0000 7f69ddffb700 1 -- 172.21.15.12:0/2512707791 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f69e0145180 con 0x7f69e00b59a0 2021-10-20T23:26:34.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.820+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69e0145180 con 0x7f69e00b59a0 2021-10-20T23:26:34.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69ddffb700 1 -- 172.21.15.12:0/2512707791 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+10 (secure 0 0 0) 0x7f69e0145180 con 0x7f69e00b59a0 2021-10-20T23:26:34.832 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:34.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f69c0053610 msgr2=0x7f69c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f69c0053610 0x7f69c0055ad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f69d400d000 tx=0x7f69d4009040).stop 2021-10-20T23:26:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00b59a0 msgr2=0x7f69e0145d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00b59a0 0x7f69e0145d70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f69d000c000 tx=0x7f69d0006df0).stop 2021-10-20T23:26:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 shutdown_connections 2021-10-20T23:26:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f69c0053610 0x7f69c0055ad0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69e0143560 0x7f69e0152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69e00b59a0 0x7f69e0145d70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 --2- 172.21.15.12:0/2512707791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69e00ad140 0x7f69e013efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 >> 172.21.15.12:0/2512707791 conn(0x7f69e005c490 msgr2=0x7f69e00b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 shutdown_connections 2021-10-20T23:26:34.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.824+0000 7f69e5af6700 1 -- 172.21.15.12:0/2512707791 wait complete. 2021-10-20T23:26:34.850 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:26:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.936+0000 7f3c264ae700 1 Processor -- start 2021-10-20T23:26:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.936+0000 7f3c264ae700 1 -- start start 2021-10-20T23:26:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c200acb70 0x7f3c200b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3c20140ba0 0x7f3c200b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c200ac7c0 con 0x7f3c200b10c0 2021-10-20T23:26:34.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c200ac020 con 0x7f3c200acb70 2021-10-20T23:26:34.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c20141010 con 0x7f3c20140ba0 2021-10-20T23:26:34.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c200acb70 0x7f3c200b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c200acb70 0x7f3c200b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41214/0 (socket says 172.21.15.12:41214) 2021-10-20T23:26:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1f7fe700 1 -- 172.21.15.12:0/1261644255 learned_addr learned my addr 172.21.15.12:0/1261644255 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c24a4b700 1 --2- 172.21.15.12:0/1261644255 >> v2:172.21.15.31:3300/0 conn(0x7f3c20140ba0 0x7f3c200b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1f7fe700 1 -- 172.21.15.12:0/1261644255 >> v2:172.21.15.31:3300/0 conn(0x7f3c20140ba0 msgr2=0x7f3c200b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1f7fe700 1 --2- 172.21.15.12:0/1261644255 >> v2:172.21.15.31:3300/0 conn(0x7f3c20140ba0 0x7f3c200b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1f7fe700 1 -- 172.21.15.12:0/1261644255 >> v1:172.21.15.31:6789/0 conn(0x7f3c200b10c0 legacy=0x7f3c2013d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1effd700 1 -- 172.21.15.12:0/1261644255 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920435231 0 0) 0x7f3c200ac7c0 con 0x7f3c200b10c0 2021-10-20T23:26:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1f7fe700 1 -- 172.21.15.12:0/1261644255 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200ac280 con 0x7f3c200acb70 2021-10-20T23:26:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1f7fe700 1 --2- 172.21.15.12:0/1261644255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200acb70 0x7f3c200b14a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f3c14002f70 tx=0x7f3c14006f40).ready entity=mon.0 client_cookie=7bd71dc7606d7971 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1effd700 1 -- 172.21.15.12:0/1261644255 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c1400da80 con 0x7f3c200acb70 2021-10-20T23:26:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1effd700 1 -- 172.21.15.12:0/1261644255 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14000e90 con 0x7f3c200acb70 2021-10-20T23:26:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c1effd700 1 -- 172.21.15.12:0/1261644255 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c1400ddd0 con 0x7f3c200acb70 2021-10-20T23:26:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 -- 172.21.15.12:0/1261644255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200acb70 msgr2=0x7f3c200b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 --2- 172.21.15.12:0/1261644255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200acb70 0x7f3c200b14a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f3c14002f70 tx=0x7f3c14006f40).stop 2021-10-20T23:26:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 -- 172.21.15.12:0/1261644255 shutdown_connections 2021-10-20T23:26:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 --2- 172.21.15.12:0/1261644255 >> v2:172.21.15.31:3300/0 conn(0x7f3c20140ba0 0x7f3c200b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 --2- 172.21.15.12:0/1261644255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200acb70 0x7f3c200b14a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 -- 172.21.15.12:0/1261644255 >> 172.21.15.12:0/1261644255 conn(0x7f3c2005f6b0 msgr2=0x7f3c2005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 -- 172.21.15.12:0/1261644255 shutdown_connections 2021-10-20T23:26:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.940+0000 7f3c264ae700 1 -- 172.21.15.12:0/1261644255 wait complete. 2021-10-20T23:26:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c264ae700 1 Processor -- start 2021-10-20T23:26:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c264ae700 1 -- start start 2021-10-20T23:26:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c264ae700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c200acb70 0x7f3c2013da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c264ae700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200b10c0 0x7f3c20066f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c264ae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c20140ba0 0x7f3c2009f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c264ae700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200a1850 con 0x7f3c200b10c0 2021-10-20T23:26:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c264ae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200a0b10 con 0x7f3c20140ba0 2021-10-20T23:26:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200b10c0 0x7f3c20066f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c264ae700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2009ecd0 con 0x7f3c200acb70 2021-10-20T23:26:34.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200b10c0 0x7f3c20066f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41220/0 (socket says 172.21.15.12:41220) 2021-10-20T23:26:34.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1f7fe700 1 -- 172.21.15.12:0/3136846177 learned_addr learned my addr 172.21.15.12:0/3136846177 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:34.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c24a4b700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c20140ba0 0x7f3c2009f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1ffff700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c200acb70 0x7f3c2013da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1f7fe700 1 -- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c200acb70 msgr2=0x7f3c2013da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1f7fe700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c200acb70 0x7f3c2013da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1f7fe700 1 -- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c20140ba0 msgr2=0x7f3c2009f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:34.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1f7fe700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c20140ba0 0x7f3c2009f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:34.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1f7fe700 1 -- 172.21.15.12:0/3136846177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1400b460 con 0x7f3c200b10c0 2021-10-20T23:26:34.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c24a4b700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c20140ba0 0x7f3c2009f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:26:34.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1f7fe700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200b10c0 0x7f3c20066f10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f3c14002f70 tx=0x7f3c20141180).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1d7fa700 1 -- 172.21.15.12:0/3136846177 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c1401d070 con 0x7f3c200b10c0 2021-10-20T23:26:34.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1d7fa700 1 -- 172.21.15.12:0/3136846177 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14018800 con 0x7f3c200b10c0 2021-10-20T23:26:34.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c1d7fa700 1 -- 172.21.15.12:0/3136846177 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c14018b60 con 0x7f3c200b10c0 2021-10-20T23:26:34.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.944+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c200a0d00 con 0x7f3c200b10c0 2021-10-20T23:26:34.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.948+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c200a0780 con 0x7f3c200b10c0 2021-10-20T23:26:34.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.948+0000 7f3c1d7fa700 1 -- 172.21.15.12:0/3136846177 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3c14018cc0 con 0x7f3c200b10c0 2021-10-20T23:26:34.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.948+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c200a0e90 con 0x7f3c200b10c0 2021-10-20T23:26:34.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.948+0000 7f3c1d7fa700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c00053580 0x7f3c00055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:34.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.948+0000 7f3c1d7fa700 1 -- 172.21.15.12:0/3136846177 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f3c1406cd30 con 0x7f3c200b10c0 2021-10-20T23:26:34.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.948+0000 7f3c1ffff700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c00053580 0x7f3c00055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:34.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.948+0000 7f3c1ffff700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c00053580 0x7f3c00055a40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f3c1800b000 tx=0x7f3c18009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:34.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:34.956+0000 7f3c1d7fa700 1 -- 172.21.15.12:0/3136846177 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c14043c90 con 0x7f3c200b10c0 2021-10-20T23:26:35.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.080+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c200ac520 con 0x7f3c200b10c0 2021-10-20T23:26:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.080+0000 7f3c1d7fa700 1 -- 172.21.15.12:0/3136846177 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3c140472b0 con 0x7f3c200b10c0 2021-10-20T23:26:35.092 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c00053580 msgr2=0x7f3c00055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c00053580 0x7f3c00055a40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f3c1800b000 tx=0x7f3c18009040).stop 2021-10-20T23:26:35.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200b10c0 msgr2=0x7f3c20066f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:35.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200b10c0 0x7f3c20066f10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f3c14002f70 tx=0x7f3c20141180).stop 2021-10-20T23:26:35.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 shutdown_connections 2021-10-20T23:26:35.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3c00053580 0x7f3c00055a40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c20140ba0 0x7f3c2009f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c200b10c0 0x7f3c20066f10 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 --2- 172.21.15.12:0/3136846177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c200acb70 0x7f3c2013da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 >> 172.21.15.12:0/3136846177 conn(0x7f3c2005f6b0 msgr2=0x7f3c200adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:35.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 shutdown_connections 2021-10-20T23:26:35.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.084+0000 7f3c264ae700 1 -- 172.21.15.12:0/3136846177 wait complete. 2021-10-20T23:26:35.105 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:26:35.105 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 Processor -- start 2021-10-20T23:26:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 -- start start 2021-10-20T23:26:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23940ad5c0 0x7f2394061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940aecf0 con 0x7f2394061320 2021-10-20T23:26:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940b6f20 con 0x7f2394140440 2021-10-20T23:26:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940aef20 con 0x7f23940ad5c0 2021-10-20T23:26:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239a3e4700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2394061320 0x7f23940b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39822/0 (socket says 172.21.15.12:39822) 2021-10-20T23:26:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239a3e4700 1 -- 172.21.15.12:0/2230500878 learned_addr learned my addr 172.21.15.12:0/2230500878 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f2399be3700 1 --2- 172.21.15.12:0/2230500878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23940ad5c0 0x7f2394061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f23993e2700 1 -- 172.21.15.12:0/2230500878 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410358306 0 0) 0x7f23940aecf0 con 0x7f2394061320 2021-10-20T23:26:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f23993e2700 1 -- 172.21.15.12:0/2230500878 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f237c003260 con 0x7f2394061320 2021-10-20T23:26:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f23993e2700 1 -- 172.21.15.12:0/2230500878 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648299836 0 0) 0x7f23940b6f20 con 0x7f2394140440 2021-10-20T23:26:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f2399be3700 1 -- 172.21.15.12:0/2230500878 >> v1:172.21.15.31:6789/0 conn(0x7f2394140440 legacy=0x7f2394146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f2399be3700 1 -- 172.21.15.12:0/2230500878 >> v1:172.21.15.12:6789/0 conn(0x7f2394061320 legacy=0x7f23940b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:35.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f2399be3700 1 -- 172.21.15.12:0/2230500878 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940af1c0 con 0x7f23940ad5c0 2021-10-20T23:26:35.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f2399be3700 1 --2- 172.21.15.12:0/2230500878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23940ad5c0 0x7f2394061700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2390001780 tx=0x7f2384006df0).ready entity=mon.2 client_cookie=1716697aa474c7e4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:35.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f23993e2700 1 -- 172.21.15.12:0/2230500878 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23900015e0 con 0x7f23940ad5c0 2021-10-20T23:26:35.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f23993e2700 1 -- 172.21.15.12:0/2230500878 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384000e90 con 0x7f23940ad5c0 2021-10-20T23:26:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f23993e2700 1 -- 172.21.15.12:0/2230500878 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238400d4a0 con 0x7f23940ad5c0 2021-10-20T23:26:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 -- 172.21.15.12:0/2230500878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23940ad5c0 msgr2=0x7f2394061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 --2- 172.21.15.12:0/2230500878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23940ad5c0 0x7f2394061700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2390001780 tx=0x7f2384006df0).stop 2021-10-20T23:26:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 -- 172.21.15.12:0/2230500878 shutdown_connections 2021-10-20T23:26:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 --2- 172.21.15.12:0/2230500878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23940ad5c0 0x7f2394061700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 -- 172.21.15.12:0/2230500878 >> 172.21.15.12:0/2230500878 conn(0x7f2394066de0 msgr2=0x7f23940671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 -- 172.21.15.12:0/2230500878 shutdown_connections 2021-10-20T23:26:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.204+0000 7f239b3e6700 1 -- 172.21.15.12:0/2230500878 wait complete. 2021-10-20T23:26:35.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 Processor -- start 2021-10-20T23:26:35.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 -- start start 2021-10-20T23:26:35.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2394061320 0x7f23941557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:35.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23940ad5c0 0x7f2394146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:35.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2394140440 0x7f23941529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940b0290 con 0x7f23940ad5c0 2021-10-20T23:26:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940b0530 con 0x7f2394140440 2021-10-20T23:26:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940b07d0 con 0x7f2394061320 2021-10-20T23:26:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f2399be3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23940ad5c0 0x7f2394146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f2399be3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23940ad5c0 0x7f2394146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41232/0 (socket says 172.21.15.12:41232) 2021-10-20T23:26:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f2399be3700 1 -- 172.21.15.12:0/570878383 learned_addr learned my addr 172.21.15.12:0/570878383 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239a3e4700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2394061320 0x7f23941557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239abe5700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2394140440 0x7f23941529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f2399be3700 1 -- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2394061320 msgr2=0x7f23941557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f2399be3700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2394061320 0x7f23941557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f2399be3700 1 -- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2394140440 msgr2=0x7f23941529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f2399be3700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2394140440 0x7f23941529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f2399be3700 1 -- 172.21.15.12:0/570878383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238400b180 con 0x7f23940ad5c0 2021-10-20T23:26:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239a3e4700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2394061320 0x7f23941557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f2399be3700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23940ad5c0 0x7f2394146c80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f2390001780 tx=0x7f23940af350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f23837fe700 1 -- 172.21.15.12:0/570878383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2384015070 con 0x7f23940ad5c0 2021-10-20T23:26:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f23837fe700 1 -- 172.21.15.12:0/570878383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384002f50 con 0x7f23940ad5c0 2021-10-20T23:26:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2394152550 con 0x7f23940ad5c0 2021-10-20T23:26:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f23837fe700 1 -- 172.21.15.12:0/570878383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238400d4a0 con 0x7f23940ad5c0 2021-10-20T23:26:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.208+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2394152280 con 0x7f23940ad5c0 2021-10-20T23:26:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.212+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23940af460 con 0x7f23940ad5c0 2021-10-20T23:26:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.212+0000 7f23837fe700 1 -- 172.21.15.12:0/570878383 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2384024030 con 0x7f23940ad5c0 2021-10-20T23:26:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.212+0000 7f23837fe700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2374053610 0x7f2374055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:35.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.212+0000 7f23837fe700 1 -- 172.21.15.12:0/570878383 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f238406c680 con 0x7f23940ad5c0 2021-10-20T23:26:35.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.212+0000 7f239a3e4700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2374053610 0x7f2374055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:35.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.212+0000 7f239a3e4700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2374053610 0x7f2374055ad0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f239000d000 tx=0x7f2390000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:35.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.216+0000 7f23837fe700 1 -- 172.21.15.12:0/570878383 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23840435e0 con 0x7f23940ad5c0 2021-10-20T23:26:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.380+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2394057350 con 0x7f23940ad5c0 2021-10-20T23:26:35.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.380+0000 7f23837fe700 1 -- 172.21.15.12:0/570878383 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f2384022020 con 0x7f23940ad5c0 2021-10-20T23:26:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:35.391 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:25:41.263533+0000","modified":"2021-10-20T23:25:42.936432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3651290992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3651290992},{"type":"v1","addr":"172.21.15.31:6835","nonce":3651290992}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-20T23:26:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2374053610 msgr2=0x7f2374055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2374053610 0x7f2374055ad0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f239000d000 tx=0x7f2390000bc0).stop 2021-10-20T23:26:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23940ad5c0 msgr2=0x7f2394146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23940ad5c0 0x7f2394146c80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f2390001780 tx=0x7f23940af350).stop 2021-10-20T23:26:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 shutdown_connections 2021-10-20T23:26:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2374053610 0x7f2374055ad0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2394140440 0x7f23941529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23940ad5c0 0x7f2394146c80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 --2- 172.21.15.12:0/570878383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2394061320 0x7f23941557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 >> 172.21.15.12:0/570878383 conn(0x7f2394066de0 msgr2=0x7f23940acac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 shutdown_connections 2021-10-20T23:26:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:35.384+0000 7f239b3e6700 1 -- 172.21.15.12:0/570878383 wait complete. 2021-10-20T23:26:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 38 2021-10-20T23:26:35.706 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:25:41.263533+0000', 'modified': '2021-10-20T23:25:42.936432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6231}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6231': {'gid': 6231, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3651290992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 3651290992}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3651290992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:26:35.707 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:26:35.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:26:35.835 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6231,"want_state":"up:active","state":"up:active","rank_uptime":54.555715604,"mdsmap_epoch":38,"osdmap_epoch":80,"osdmap_epoch_barrier":80,"uptime":58.750474988999997} 2021-10-20T23:26:35.836 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6231, "mdsmap_epoch": 38, "osdmap_epoch": 80, "osdmap_epoch_barrier": 80, "rank_uptime": 54.555715604, "state": "up:active", "uptime": 58.750474989, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:26:35.836 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:26:35.837 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:26:35.837 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:26:35.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:35.838 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:35.846 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:26:35.906 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:26:35.907 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:26:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:26:35.918 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:26:35.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:35.919 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:26:35.925 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:26:35.925 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:35.929 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:26:35.948 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:26:35.949 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:26:36.005 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14468]: starting ceph client 2021-10-20T23:26:36.005 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:26:36.000+0000 7f2a1de0c080 -1 init, newargv = 0x55a207126b90 newargc=9 2021-10-20T23:26:36.009 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:26:36.010 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:26:36.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:36.011 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:26:36.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14468]: starting fuse 2021-10-20T23:26:36.017 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:26:36.017 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:26:36.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:36.018 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:26:36.018 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:26:36.019 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:26:36.019 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:26:36.019 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:26:36.020 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:26:36.020 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:26:36.021 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:26:36.021 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:26:36.021 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:26:36.022 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:26:36.022 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:26:36.023 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:26:36.023 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:26:36.024 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:26:36.024 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:26:36.025 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:26:36.025 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:26:36.026 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:26:36.026 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:26:36.026 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:26:36.027 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:26:36.027 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:26:36.068 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14468.asok 2021-10-20T23:26:36.072 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14468.asok 2021-10-20T23:26:36.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:36.073 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14468.asok status 2021-10-20T23:26:36.204 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:26:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:26:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:26:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:26:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:26:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:26:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:26:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14468", 2021-10-20T23:26:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:26:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:26:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:26:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:26:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5918, 2021-10-20T23:26:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:26:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:26:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:26:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5918 2021-10-20T23:26:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:26:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:26:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:26:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:26:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3474022328 2021-10-20T23:26:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:26:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:26:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:26:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:26:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:26:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3474022328 2021-10-20T23:26:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:26:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5918 172.21.15.119:0/3474022328", 2021-10-20T23:26:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/3474022328", 2021-10-20T23:26:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:26:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 38, 2021-10-20T23:26:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 80, 2021-10-20T23:26:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:26:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:26:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:26:36.216 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:26:36.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:36.218 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:36.218 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:36.228 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:26:36.229 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:26:36.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:36.230 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:36.247 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:26:36.248 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:36.268 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:36.290 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:36.310 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:36.331 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:26:36.332 INFO:tasks.cephfs.mount:Terminating background process 2021-10-20T23:26:36.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:36.333 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:36.333 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:36.341 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:26:36.342 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:26:36.343 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:26:36.343 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:26:36.344 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:36.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14468]: fuse finished with error 0 and tester_r 0 2021-10-20T23:26:36.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:36.402 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:36.403 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:36.408 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:26:36.409 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:26:36.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:26:36.527 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:36.535 INFO:tasks.cephfs.mount:Terminating background process 2021-10-20T23:26:36.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:36.536 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:36.536 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:36.545 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:26:36.546 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:26:36.546 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:26:36.547 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:26:36.547 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:36.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13956]: fuse finished with error 0 and tester_r 0 2021-10-20T23:26:36.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:36.565 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:36.566 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:36.574 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:26:36.574 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:26:36.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:26:36.694 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:36.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:26:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6c3e9700 1 Processor -- start 2021-10-20T23:26:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6c3e9700 1 -- start start 2021-10-20T23:26:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6c3e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 0x7efd640b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6c3e9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd640b43c0 0x7efd640b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6c3e9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd641440b0 con 0x7efd64061d30 2021-10-20T23:26:36.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6c3e9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd640b6e50 con 0x7efd640b43c0 2021-10-20T23:26:36.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6c3e9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd64143b70 con 0x7efd640b6580 2021-10-20T23:26:36.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6a986700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efd64061d30 0x7efd641466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39838/0 (socket says 172.21.15.12:39838) 2021-10-20T23:26:36.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6a986700 1 -- 172.21.15.12:0/965367798 learned_addr learned my addr 172.21.15.12:0/965367798 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd69984700 1 --2- 172.21.15.12:0/965367798 >> v2:172.21.15.31:3300/0 conn(0x7efd640b43c0 0x7efd640b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6a185700 1 --2- 172.21.15.12:0/965367798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 0x7efd640b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd69183700 1 -- 172.21.15.12:0/965367798 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671957367 0 0) 0x7efd641440b0 con 0x7efd64061d30 2021-10-20T23:26:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd69183700 1 -- 172.21.15.12:0/965367798 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd44003260 con 0x7efd64061d30 2021-10-20T23:26:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6a185700 1 -- 172.21.15.12:0/965367798 >> v2:172.21.15.31:3300/0 conn(0x7efd640b43c0 msgr2=0x7efd640b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:36.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6a185700 1 --2- 172.21.15.12:0/965367798 >> v2:172.21.15.31:3300/0 conn(0x7efd640b43c0 0x7efd640b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:36.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6a185700 1 -- 172.21.15.12:0/965367798 >> v1:172.21.15.12:6789/0 conn(0x7efd64061d30 legacy=0x7efd641466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:36.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6a185700 1 -- 172.21.15.12:0/965367798 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64143e10 con 0x7efd640b6580 2021-10-20T23:26:36.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd6a185700 1 --2- 172.21.15.12:0/965367798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 0x7efd640b5bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7efd4c002f70 tx=0x7efd4c006df0).ready entity=mon.2 client_cookie=b786cbfc875bf5ee server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd69183700 1 -- 172.21.15.12:0/965367798 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd4c00d4a0 con 0x7efd640b6580 2021-10-20T23:26:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd69183700 1 -- 172.21.15.12:0/965367798 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c000e90 con 0x7efd640b6580 2021-10-20T23:26:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.808+0000 7efd69183700 1 -- 172.21.15.12:0/965367798 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd4c00d7f0 con 0x7efd640b6580 2021-10-20T23:26:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 -- 172.21.15.12:0/965367798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 msgr2=0x7efd640b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 --2- 172.21.15.12:0/965367798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 0x7efd640b5bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7efd4c002f70 tx=0x7efd4c006df0).stop 2021-10-20T23:26:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 -- 172.21.15.12:0/965367798 shutdown_connections 2021-10-20T23:26:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 --2- 172.21.15.12:0/965367798 >> v2:172.21.15.31:3300/0 conn(0x7efd640b43c0 0x7efd640b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 --2- 172.21.15.12:0/965367798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 0x7efd640b5bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 -- 172.21.15.12:0/965367798 >> 172.21.15.12:0/965367798 conn(0x7efd6405c490 msgr2=0x7efd6405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 -- 172.21.15.12:0/965367798 shutdown_connections 2021-10-20T23:26:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 -- 172.21.15.12:0/965367798 wait complete. 2021-10-20T23:26:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 Processor -- start 2021-10-20T23:26:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 -- start start 2021-10-20T23:26:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd64061d30 0x7efd64148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.812+0000 7efd6c3e9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd640b43c0 0x7efd64152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd6c3e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 0x7efd641457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd6c3e9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64153210 con 0x7efd640b43c0 2021-10-20T23:26:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd6c3e9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd640ba300 con 0x7efd64061d30 2021-10-20T23:26:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd6c3e9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd640ba5a0 con 0x7efd640b6580 2021-10-20T23:26:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd69984700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd640b43c0 0x7efd64152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd6a986700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 0x7efd641457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd6a185700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd64061d30 0x7efd64148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd69984700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd640b43c0 0x7efd64152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41248/0 (socket says 172.21.15.12:41248) 2021-10-20T23:26:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd69984700 1 -- 172.21.15.12:0/791106561 learned_addr learned my addr 172.21.15.12:0/791106561 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd69984700 1 -- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 msgr2=0x7efd641457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd69984700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 0x7efd641457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd69984700 1 -- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd64061d30 msgr2=0x7efd64148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd69984700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd64061d30 0x7efd64148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd69984700 1 -- 172.21.15.12:0/791106561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c00b180 con 0x7efd640b43c0 2021-10-20T23:26:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd69984700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd640b43c0 0x7efd64152d20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7efd5400c000 tx=0x7efd540091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd637fe700 1 -- 172.21.15.12:0/791106561 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd5400c670 con 0x7efd640b43c0 2021-10-20T23:26:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd637fe700 1 -- 172.21.15.12:0/791106561 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5400c7d0 con 0x7efd640b43c0 2021-10-20T23:26:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd640ad620 con 0x7efd640b43c0 2021-10-20T23:26:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd637fe700 1 -- 172.21.15.12:0/791106561 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd5400cb30 con 0x7efd640b43c0 2021-10-20T23:26:36.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd64145ca0 con 0x7efd640b43c0 2021-10-20T23:26:36.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd637fe700 1 -- 172.21.15.12:0/791106561 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd54022070 con 0x7efd640b43c0 2021-10-20T23:26:36.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd640615f0 con 0x7efd640b43c0 2021-10-20T23:26:36.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd637fe700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efd480536d0 0x7efd48055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.816+0000 7efd637fe700 1 -- 172.21.15.12:0/791106561 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7efd5406c060 con 0x7efd640b43c0 2021-10-20T23:26:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.820+0000 7efd6a185700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efd480536d0 0x7efd48055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.820+0000 7efd6a185700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efd480536d0 0x7efd48055b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7efd4c01a000 tx=0x7efd4c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.824+0000 7efd637fe700 1 -- 172.21.15.12:0/791106561 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efd54042fe0 con 0x7efd640b43c0 2021-10-20T23:26:36.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.956+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efd64057350 con 0x7efd640b43c0 2021-10-20T23:26:36.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd637fe700 1 -- 172.21.15.12:0/791106561 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v80) v1 ==== 81+0+34117 (secure 0 0 0) 0x7efd54046600 con 0x7efd640b43c0 2021-10-20T23:26:36.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:36.968 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:26:36.969 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 80, 2021-10-20T23:26:36.969 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:26:36.969 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:26:36.969 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:26:27.905694+0000", 2021-10-20T23:26:36.969 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:26:36.970 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:26:36.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:26:36.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:26:36.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:26:36.971 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:26:36.971 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:26:36.971 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:26:36.971 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:26:36.971 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:36.972 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:26:36.972 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:26:36.972 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:26:36.972 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:26:36.973 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:26:36.973 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 14, 2021-10-20T23:26:36.973 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:26:36.973 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:26:36.974 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:26:36.974 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:26:36.974 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:26:36.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:36.975 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:26:36.975 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:26:36.975 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:26:36.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:36.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:36.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:36.976 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:36.977 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:36.977 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:36.977 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:36.977 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:36.978 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:26:36.978 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:26:36.978 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:26:36.978 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:26:36.978 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:26:36.979 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:36.979 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:36.979 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:36.979 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:36.980 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:36.980 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:36.980 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:36.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:36.980 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:26:36.981 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:36.981 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:36.981 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:36.981 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:36.982 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:36.982 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:36.982 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:36.982 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:36.982 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:36.983 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:36.983 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:36.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:36.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:36.984 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:36.984 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:36.984 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:36.984 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:36.984 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:36.985 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:36.985 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:36.985 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:36.985 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:36.986 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:36.986 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:36.986 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:36.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:36.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:36.987 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:36.987 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:36.987 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:36.987 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:36.988 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:36.988 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:36.988 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:36.988 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:36.988 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:36.989 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:36.989 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:36.989 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:26:36.989 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:26:36.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:36.990 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:36.990 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:26:36.990 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:36.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:36.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:36.991 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:26:36.991 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:26:36.991 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:26:36.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:36.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:36.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:36.992 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:36.992 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:36.993 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:36.993 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:36.993 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:36.993 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:26:36.994 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:26:36.994 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:26:36.994 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:26:36.994 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:26:36.994 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:36.995 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:36.995 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:36.995 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:36.995 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:36.996 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:36.996 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:36.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:36.996 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:26:36.996 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:36.997 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:36.997 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:36.997 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:36.997 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:36.998 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:36.998 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:36.998 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:36.998 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:36.999 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:36.999 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:36.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:36.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:37.000 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:37.000 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:37.000 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:37.001 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:37.001 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:37.001 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:37.001 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:37.001 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:37.002 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:37.002 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:37.002 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:37.002 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:37.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:37.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.008 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:37.008 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:37.008 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:37.009 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:37.009 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:37.009 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:37.009 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:37.010 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:37.010 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:37.010 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:37.010 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:37.010 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:26:37.011 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:37.011 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:26:37.011 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.012 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 13, 2021-10-20T23:26:37.012 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:26:37.012 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:25:39.858993+0000", 2021-10-20T23:26:37.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:37.013 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:37.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:37.013 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:37.013 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:37.013 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:37.014 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:37.014 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:37.014 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:26:37.014 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:26:37.015 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:26:37.015 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:26:37.015 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:26:37.015 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:37.015 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:37.016 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:37.016 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:37.016 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:37.016 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:37.016 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:37.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.017 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "78", 2021-10-20T23:26:37.017 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:37.017 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:37.018 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:37.018 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:37.018 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:37.018 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:37.018 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:37.019 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:37.019 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:37.019 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:37.019 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:37.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:37.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:37.020 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:37.020 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:37.020 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:37.021 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:37.021 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:37.021 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:37.021 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:37.022 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:37.022 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:37.022 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:37.023 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:37.023 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:37.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:37.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.024 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:37.024 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:37.024 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:37.024 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:37.024 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:37.025 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:37.025 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:37.025 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:37.025 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:37.025 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:37.026 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:37.026 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:26:37.026 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:26:37.026 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:26:37.027 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:26:37.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.027 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:37.027 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:26:37.027 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:26:37.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.029 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 14, 2021-10-20T23:26:37.029 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:26:37.029 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:25:40.250129+0000", 2021-10-20T23:26:37.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:37.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:37.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:37.030 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:37.030 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:37.031 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:37.031 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:37.031 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:37.031 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:26:37.032 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:26:37.032 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:26:37.032 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:26:37.032 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:26:37.033 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:37.033 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:37.033 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:37.033 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:37.033 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:37.034 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:37.034 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:37.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.034 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "79", 2021-10-20T23:26:37.035 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:37.035 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:37.035 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:37.035 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:37.035 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:37.036 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:37.036 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:37.036 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:37.036 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:37.036 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:37.037 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:37.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:37.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:37.037 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:37.038 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:37.038 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:37.038 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:37.038 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:37.038 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:37.039 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:37.039 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:37.039 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:37.039 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:37.040 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:37.040 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:37.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:37.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.040 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:37.041 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:37.041 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:37.041 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:37.041 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:37.041 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:37.042 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:37.042 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:37.042 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:37.042 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:37.043 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:37.043 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:26:37.043 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:37.043 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:26:37.043 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:26:37.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.044 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:37.044 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:26:37.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.045 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:26:37.045 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:26:37.045 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:37.045 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:37.046 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:37.046 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:37.046 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:37.046 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:37.047 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:37.047 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:37.047 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:37.047 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:37.047 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:37.048 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.048 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:26:37.049 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:37.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.050 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:26:37.050 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:37.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.051 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:37.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.052 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:26:37.052 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:37.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.053 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:26:37.053 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:37.054 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.054 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.054 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:37.054 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.056 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:26:37.056 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:37.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.057 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:26:37.057 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:37.057 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.057 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.058 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:37.058 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.059 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:26:37.059 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:37.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.060 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:26:37.060 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:37.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.061 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.061 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:26:37.061 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:26:37.061 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:26:37.062 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:26:37.062 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:37.062 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:37.062 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:37.063 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.063 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:26:37.063 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:26:37.064 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:37.064 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:37.064 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:37.064 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:37.064 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:37.065 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:37.065 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:37.065 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:26:37.065 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:37.066 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:37.066 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:37.066 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.067 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:26:37.067 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:37.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.068 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:26:37.068 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:37.069 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.069 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.069 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:37.069 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.070 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:26:37.070 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:37.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.071 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.071 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:26:37.071 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:37.073 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.073 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.073 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:37.074 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.074 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:26:37.074 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:37.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.075 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:26:37.076 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:37.076 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.076 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.076 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:37.077 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.077 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.077 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:26:37.077 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:37.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.078 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:26:37.079 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:37.079 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.079 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.079 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:26:37.080 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:26:37.080 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:26:37.080 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:26:37.080 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:37.080 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:37.081 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:37.081 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.082 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:26:37.082 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:26:37.082 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:37.082 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:37.082 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:37.083 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:37.083 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:37.083 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:37.083 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:37.084 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:37.084 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:37.084 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:37.084 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:37.084 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.085 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:26:37.085 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:37.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.086 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:26:37.086 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:37.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.087 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.087 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:37.087 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.088 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:26:37.088 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:37.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.089 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:26:37.089 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:37.090 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.090 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.090 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:37.090 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.091 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:26:37.091 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:37.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.092 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:26:37.092 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:37.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.093 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.093 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:37.094 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.094 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:26:37.094 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:37.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.095 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:26:37.096 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:37.096 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.096 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.096 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:26:37.097 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:26:37.097 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:26:37.097 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:26:37.097 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:37.098 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:37.098 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:37.098 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.099 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:26:37.099 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:26:37.099 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:37.099 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:37.100 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:37.100 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:37.100 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:37.100 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:37.100 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:37.101 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:37.101 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:37.101 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:37.101 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:37.101 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.102 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:26:37.102 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:37.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.103 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:26:37.103 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:37.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.104 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.104 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:37.104 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.105 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:26:37.105 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:37.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.106 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:26:37.106 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:37.107 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.107 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.107 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:37.107 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.108 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.108 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:26:37.108 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:37.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.109 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:26:37.109 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:37.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.110 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.110 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:37.110 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.111 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:26:37.111 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:37.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.112 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:26:37.112 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:37.113 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.113 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.113 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:26:37.113 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:26:37.114 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:26:37.114 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:26:37.114 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:37.114 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:37.115 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:37.115 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.115 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:26:37.116 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:26:37.116 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:37.116 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:37.116 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:37.116 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:37.117 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:37.117 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:37.117 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:37.117 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 75, 2021-10-20T23:26:37.118 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:37.118 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:37.118 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:37.118 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.119 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:26:37.119 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:37.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.120 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:26:37.120 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:37.120 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.120 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.121 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:37.121 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.122 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:26:37.122 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:37.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.123 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:26:37.123 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:37.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.123 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.124 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:37.124 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.125 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:26:37.125 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:37.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.126 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.126 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:26:37.126 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:37.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.126 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.127 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:37.127 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.128 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:26:37.128 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:37.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.129 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:26:37.129 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:37.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.129 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.130 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:26:37.130 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:26:37.131 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:26:37.131 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:26:37.131 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:37.131 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:37.131 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:37.132 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.132 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:26:37.132 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:26:37.133 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:37.133 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:37.133 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:37.133 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.136 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:26:37.136 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:37.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:26:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.138 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:37.138 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.139 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:26:37.139 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:37.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.140 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:26:37.140 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:37.140 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.140 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.141 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:37.141 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.142 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:26:37.142 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:37.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.143 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:26:37.143 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:37.143 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.143 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.144 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:37.144 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:26:37.145 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:37.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.146 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:26:37.146 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:37.146 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.146 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.147 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:26:37.147 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:26:37.147 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:26:37.147 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:26:37.148 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:37.148 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:37.148 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:37.148 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.149 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:26:37.149 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:26:37.149 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:37.150 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:37.150 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:37.150 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:37.150 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:37.150 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:37.151 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:37.151 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:37.151 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:37.151 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:37.152 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:37.152 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.152 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:26:37.153 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:37.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.154 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:26:37.154 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:37.154 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.154 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.155 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:37.155 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.156 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:26:37.156 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:37.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.157 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:26:37.157 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:37.157 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.157 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.158 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:37.158 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.159 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:26:37.159 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:37.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.160 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:26:37.160 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:37.160 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.160 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.161 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:37.161 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.162 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:26:37.162 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:37.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.163 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:26:37.163 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:37.163 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.163 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.164 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:26:37.164 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:26:37.164 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:26:37.164 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:26:37.165 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:37.165 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:37.165 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:37.165 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.166 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:26:37.166 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:26:37.167 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:37.168 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:37.168 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:37.169 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:37.169 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:37.170 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:37.170 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:37.170 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 75, 2021-10-20T23:26:37.171 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:37.171 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:37.171 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:37.172 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.173 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:26:37.173 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:37.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.175 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:26:37.175 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:37.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.176 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.177 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:37.177 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.179 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:26:37.179 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:37.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.180 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:26:37.180 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:37.181 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.181 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.182 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:37.182 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.183 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:26:37.184 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:37.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.185 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:26:37.186 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:37.186 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.187 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.187 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:37.188 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:37.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:37.189 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:26:37.189 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:37.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:37.191 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:26:37.191 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:37.192 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.192 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.193 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:26:37.193 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:26:37.194 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:26:37.194 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:26:37.195 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:37.195 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:37.196 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:37.196 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:37.196 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.197 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:37.197 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:26:37.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.198 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:26:37.198 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:37.199 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:37.199 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:37.200 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:37.200 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:37.200 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:26:37.201 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:37.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.202 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:26:37.203 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:37.203 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:37.203 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:37.204 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:37.204 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:37.205 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:26:37.205 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:37.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.206 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:26:37.207 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:37.207 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:37.207 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:37.208 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:37.208 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:37.209 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:26:37.209 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:37.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.210 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:26:37.211 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:37.211 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:37.212 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:37.212 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:37.212 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:37.213 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:26:37.213 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:37.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.214 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:26:37.215 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:37.215 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:37.216 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:37.216 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:37.217 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:37.217 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:26:37.217 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:37.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:26:37.219 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:37.219 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:37.220 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:37.220 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:37.221 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:37.221 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:26:37.222 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:37.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.223 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:26:37.223 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:37.224 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:37.224 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:37.225 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:37.225 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:37.226 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:26:37.226 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:37.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:37.227 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:26:37.228 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:37.228 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:37.229 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:37.229 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:37.230 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:37.230 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:26:37.230 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:37.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.231 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:37.231 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:26:37.231 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:26:37.231 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:26:37.233 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:26:37.234 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:26:37.234 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.119:0/1668581666": "2021-10-21T00:26:27.076701+0000" 2021-10-20T23:26:37.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.234 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:26:37.235 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:26:37.235 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:26:37.235 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:26:37.235 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:26:37.235 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:26:37.236 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:26:37.236 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:26:37.236 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:26:37.236 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:26:37.237 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:26:37.237 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:26:37.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.237 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:26:37.237 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:26:37.238 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:26:37.238 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:26:37.238 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:26:37.238 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:26:37.238 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:26:37.239 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:37.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:37.239 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:26:37.239 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:26:37.239 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:26:37.240 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:26:37.240 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:26:37.240 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:26:37.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:26:37.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efd480536d0 msgr2=0x7efd48055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efd480536d0 0x7efd48055b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7efd4c01a000 tx=0x7efd4c014000).stop 2021-10-20T23:26:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd640b43c0 msgr2=0x7efd64152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd640b43c0 0x7efd64152d20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7efd5400c000 tx=0x7efd540091d0).stop 2021-10-20T23:26:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 shutdown_connections 2021-10-20T23:26:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efd480536d0 0x7efd48055b90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd640b6580 0x7efd641457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd640b43c0 0x7efd64152d20 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 --2- 172.21.15.12:0/791106561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd64061d30 0x7efd64148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 >> 172.21.15.12:0/791106561 conn(0x7efd6405c490 msgr2=0x7efd641444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 shutdown_connections 2021-10-20T23:26:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:36.960+0000 7efd6c3e9700 1 -- 172.21.15.12:0/791106561 wait complete. 2021-10-20T23:26:37.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:37.248 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:26:37.250 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:26:37.253 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:26:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fe4ae700 1 Processor -- start 2021-10-20T23:26:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fe4ae700 1 -- start start 2021-10-20T23:26:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fe4ae700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1f80b2580 0x7fd1f814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fe4ae700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80a8ac0 0x7fd1f814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fe4ae700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f80a70c0 con 0x7fd1f80b0010 2021-10-20T23:26:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fe4ae700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80a72f0 con 0x7fd1f80b2580 2021-10-20T23:26:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fe4ae700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80a7590 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fd4ac700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1f80b2580 0x7fd1f814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fccab700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd1f80b0010 0x7fd1f80a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:46912/0 (socket says 172.21.15.12:46912) 2021-10-20T23:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fccab700 1 -- 172.21.15.12:0/3943242971 learned_addr learned my addr 172.21.15.12:0/3943242971 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fdcad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80a8ac0 0x7fd1f814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fd4ac700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1f80b2580 0x7fd1f814ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41254/0 (socket says 172.21.15.12:41254) 2021-10-20T23:26:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1effff700 1 -- 172.21.15.12:0/3943242971 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401773389 0 0) 0x7fd1f80a70c0 con 0x7fd1f80b0010 2021-10-20T23:26:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1effff700 1 -- 172.21.15.12:0/3943242971 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1dc003260 con 0x7fd1f80b0010 2021-10-20T23:26:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fd4ac700 1 -- 172.21.15.12:0/3943242971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80a8ac0 msgr2=0x7fd1f814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fd4ac700 1 --2- 172.21.15.12:0/3943242971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80a8ac0 0x7fd1f814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.352+0000 7fd1fd4ac700 1 -- 172.21.15.12:0/3943242971 >> v1:172.21.15.31:6789/0 conn(0x7fd1f80b0010 legacy=0x7fd1f80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fd4ac700 1 -- 172.21.15.12:0/3943242971 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80a7830 con 0x7fd1f80b2580 2021-10-20T23:26:37.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fd4ac700 1 --2- 172.21.15.12:0/3943242971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80b2580 0x7fd1f814ae40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fd1e8002f70 tx=0x7fd1e8006df0).ready entity=mon.0 client_cookie=9299a0c1fdae1fff server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:37.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1effff700 1 -- 172.21.15.12:0/3943242971 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e800d4a0 con 0x7fd1f80b2580 2021-10-20T23:26:37.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1effff700 1 -- 172.21.15.12:0/3943242971 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8000e90 con 0x7fd1f80b2580 2021-10-20T23:26:37.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1effff700 1 -- 172.21.15.12:0/3943242971 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e800d7f0 con 0x7fd1f80b2580 2021-10-20T23:26:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3943242971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80b2580 msgr2=0x7fd1f814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fe4ae700 1 --2- 172.21.15.12:0/3943242971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80b2580 0x7fd1f814ae40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fd1e8002f70 tx=0x7fd1e8006df0).stop 2021-10-20T23:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3943242971 shutdown_connections 2021-10-20T23:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fe4ae700 1 --2- 172.21.15.12:0/3943242971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80a8ac0 0x7fd1f814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fe4ae700 1 --2- 172.21.15.12:0/3943242971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80b2580 0x7fd1f814ae40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3943242971 >> 172.21.15.12:0/3943242971 conn(0x7fd1f8060180 msgr2=0x7fd1f80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3943242971 shutdown_connections 2021-10-20T23:26:37.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3943242971 wait complete. 2021-10-20T23:26:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.356+0000 7fd1fe4ae700 1 Processor -- start 2021-10-20T23:26:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fe4ae700 1 -- start start 2021-10-20T23:26:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fe4ae700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80a8ac0 0x7fd1f81423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fe4ae700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80b0010 0x7fd1f80aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fe4ae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1f80b2580 0x7fd1f80b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fe4ae700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80b38e0 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fe4ae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80b3640 con 0x7fd1f80b2580 2021-10-20T23:26:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fe4ae700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80b3d60 con 0x7fd1f80b0010 2021-10-20T23:26:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fd4ac700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80a8ac0 0x7fd1f81423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fd4ac700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80a8ac0 0x7fd1f81423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41260/0 (socket says 172.21.15.12:41260) 2021-10-20T23:26:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fd4ac700 1 -- 172.21.15.12:0/3330559207 learned_addr learned my addr 172.21.15.12:0/3330559207 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fccab700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80b0010 0x7fd1f80aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fdcad700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1f80b2580 0x7fd1f80b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fd4ac700 1 -- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80b0010 msgr2=0x7fd1f80aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fd4ac700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80b0010 0x7fd1f80aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fd4ac700 1 -- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1f80b2580 msgr2=0x7fd1f80b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fd4ac700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1f80b2580 0x7fd1f80b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fd4ac700 1 -- 172.21.15.12:0/3330559207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e800b180 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fdcad700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1f80b2580 0x7fd1f80b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fd4ac700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80a8ac0 0x7fd1f81423b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fd1e8002f70 tx=0x7fd1e8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1ee7fc700 1 -- 172.21.15.12:0/3330559207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e8013a40 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1ee7fc700 1 -- 172.21.15.12:0/3330559207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8013ba0 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f80b4000 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1ee7fc700 1 -- 172.21.15.12:0/3330559207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e801e400 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.360+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f80a9ed0 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.364+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f8057350 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.364+0000 7fd1ee7fc700 1 -- 172.21.15.12:0/3330559207 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd1e8025030 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.364+0000 7fd1ee7fc700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1e0053580 0x7fd1e0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.364+0000 7fd1ee7fc700 1 -- 172.21.15.12:0/3330559207 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fd1e806c9c0 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.364+0000 7fd1fccab700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1e0053580 0x7fd1e0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.364+0000 7fd1fccab700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1e0053580 0x7fd1e0055a40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fd1f400d000 tx=0x7fd1f4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:37.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.372+0000 7fd1ee7fc700 1 -- 172.21.15.12:0/3330559207 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1e8043890 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.536+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1f80698e0 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.536+0000 7fd1ee7fc700 1 -- 172.21.15.12:0/3330559207 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fd1e8023090 con 0x7fd1f80a8ac0 2021-10-20T23:26:37.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:37.546 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:25:41.263533+0000","modified":"2021-10-20T23:25:42.936432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3651290992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3651290992},{"type":"v1","addr":"172.21.15.31:6835","nonce":3651290992}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-20T23:26:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.536+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1e0053580 msgr2=0x7fd1e0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1e0053580 0x7fd1e0055a40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fd1f400d000 tx=0x7fd1f4009040).stop 2021-10-20T23:26:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80a8ac0 msgr2=0x7fd1f81423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80a8ac0 0x7fd1f81423b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fd1e8002f70 tx=0x7fd1e8014000).stop 2021-10-20T23:26:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 shutdown_connections 2021-10-20T23:26:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1e0053580 0x7fd1e0055a40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1f80b2580 0x7fd1f80b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1f80b0010 0x7fd1f80aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 --2- 172.21.15.12:0/3330559207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1f80a8ac0 0x7fd1f81423b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 >> 172.21.15.12:0/3330559207 conn(0x7fd1f8060180 msgr2=0x7fd1f81486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 shutdown_connections 2021-10-20T23:26:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.540+0000 7fd1fe4ae700 1 -- 172.21.15.12:0/3330559207 wait complete. 2021-10-20T23:26:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 38 2021-10-20T23:26:37.559 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:26:37.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cef81700 1 Processor -- start 2021-10-20T23:26:37.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cef81700 1 -- start start 2021-10-20T23:26:37.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cef81700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38c80b4aa0 0x7f38c80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cef81700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064a20 0x7f38c8066500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cef81700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c80b8090 con 0x7f38c8064640 2021-10-20T23:26:37.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cef81700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c8142f40 con 0x7f38c80b4aa0 2021-10-20T23:26:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cef81700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8143130 con 0x7f38c8064a20 2021-10-20T23:26:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cd77e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38c80b4aa0 0x7f38c80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cdf7f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f38c8064640 0x7f38c8143870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39862/0 (socket says 172.21.15.12:39862) 2021-10-20T23:26:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cdf7f700 1 -- 172.21.15.12:0/3625845422 learned_addr learned my addr 172.21.15.12:0/3625845422 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38ce780700 1 --2- 172.21.15.12:0/3625845422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064a20 0x7f38c8066500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cd77e700 1 -- 172.21.15.12:0/3625845422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064a20 msgr2=0x7f38c8066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cd77e700 1 --2- 172.21.15.12:0/3625845422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064a20 0x7f38c8066500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cd77e700 1 -- 172.21.15.12:0/3625845422 >> v1:172.21.15.12:6789/0 conn(0x7f38c8064640 legacy=0x7f38c8143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38ccf7d700 1 -- 172.21.15.12:0/3625845422 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592894297 0 0) 0x7f38c80b8090 con 0x7f38c8064640 2021-10-20T23:26:37.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cd77e700 1 -- 172.21.15.12:0/3625845422 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c81433d0 con 0x7f38c80b4aa0 2021-10-20T23:26:37.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38cd77e700 1 --2- 172.21.15.12:0/3625845422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 0x7f38c80b3710 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f38c4002f70 tx=0x7f38c4006df0).ready entity=mon.0 client_cookie=921f24e4ace3f8fa server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:37.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38ccf7d700 1 -- 172.21.15.12:0/3625845422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c400d570 con 0x7f38c80b4aa0 2021-10-20T23:26:37.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38ccf7d700 1 -- 172.21.15.12:0/3625845422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4000e90 con 0x7f38c80b4aa0 2021-10-20T23:26:37.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.660+0000 7f38ccf7d700 1 -- 172.21.15.12:0/3625845422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c400d8c0 con 0x7f38c80b4aa0 2021-10-20T23:26:37.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 -- 172.21.15.12:0/3625845422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 msgr2=0x7f38c80b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 --2- 172.21.15.12:0/3625845422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 0x7f38c80b3710 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f38c4002f70 tx=0x7f38c4006df0).stop 2021-10-20T23:26:37.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 -- 172.21.15.12:0/3625845422 shutdown_connections 2021-10-20T23:26:37.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 --2- 172.21.15.12:0/3625845422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064a20 0x7f38c8066500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 --2- 172.21.15.12:0/3625845422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 0x7f38c80b3710 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 -- 172.21.15.12:0/3625845422 >> 172.21.15.12:0/3625845422 conn(0x7f38c805f6b0 msgr2=0x7f38c805fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:37.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 -- 172.21.15.12:0/3625845422 shutdown_connections 2021-10-20T23:26:37.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 -- 172.21.15.12:0/3625845422 wait complete. 2021-10-20T23:26:37.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 Processor -- start 2021-10-20T23:26:37.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.664+0000 7f38cef81700 1 -- start start 2021-10-20T23:26:37.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cef81700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064640 0x7f38c80b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cef81700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38c8064a20 0x7f38c81462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cef81700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 0x7f38c81467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cef81700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8149530 con 0x7f38c80b4aa0 2021-10-20T23:26:37.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cef81700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c81444c0 con 0x7f38c8064a20 2021-10-20T23:26:37.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cef81700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8149290 con 0x7f38c8064640 2021-10-20T23:26:37.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38ce780700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 0x7f38c81467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38ce780700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 0x7f38c81467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41278/0 (socket says 172.21.15.12:41278) 2021-10-20T23:26:37.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38ce780700 1 -- 172.21.15.12:0/2785876707 learned_addr learned my addr 172.21.15.12:0/2785876707 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:37.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cdf7f700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064640 0x7f38c80b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cd77e700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38c8064a20 0x7f38c81462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38ce780700 1 -- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064640 msgr2=0x7f38c80b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38ce780700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064640 0x7f38c80b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38ce780700 1 -- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38c8064a20 msgr2=0x7f38c81462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38ce780700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38c8064a20 0x7f38c81462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38ce780700 1 -- 172.21.15.12:0/2785876707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c400b180 con 0x7f38c80b4aa0 2021-10-20T23:26:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38ce780700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 0x7f38c81467b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f38c000a000 tx=0x7f38c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:37.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38b6ffd700 1 -- 172.21.15.12:0/2785876707 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c0013620 con 0x7f38c80b4aa0 2021-10-20T23:26:37.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38b6ffd700 1 -- 172.21.15.12:0/2785876707 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0013780 con 0x7f38c80b4aa0 2021-10-20T23:26:37.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c8144720 con 0x7f38c80b4aa0 2021-10-20T23:26:37.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38b6ffd700 1 -- 172.21.15.12:0/2785876707 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c0013ae0 con 0x7f38c80b4aa0 2021-10-20T23:26:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c8144bc0 con 0x7f38c80b4aa0 2021-10-20T23:26:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c81448b0 con 0x7f38c80b4aa0 2021-10-20T23:26:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.668+0000 7f38b6ffd700 1 -- 172.21.15.12:0/2785876707 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f38c0013c40 con 0x7f38c80b4aa0 2021-10-20T23:26:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.672+0000 7f38b6ffd700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f38a80534f0 0x7f38a80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.672+0000 7f38b6ffd700 1 -- 172.21.15.12:0/2785876707 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f38c006bae0 con 0x7f38c80b4aa0 2021-10-20T23:26:37.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.672+0000 7f38cdf7f700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f38a80534f0 0x7f38a80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:37.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.672+0000 7f38cdf7f700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f38a80534f0 0x7f38a80559b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f38b800b000 tx=0x7f38b8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:37.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.676+0000 7f38b6ffd700 1 -- 172.21.15.12:0/2785876707 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f38c0042950 con 0x7f38c80b4aa0 2021-10-20T23:26:37.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.840+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f38c80b7d40 con 0x7f38c80b4aa0 2021-10-20T23:26:37.947 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:26:37.940+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:26:37.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.952+0000 7f38b6ffd700 1 -- 172.21.15.12:0/2785876707 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f38c0045f70 con 0x7f38c80b4aa0 2021-10-20T23:26:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f38a80534f0 msgr2=0x7f38a80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f38a80534f0 0x7f38a80559b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f38b800b000 tx=0x7f38b8009040).stop 2021-10-20T23:26:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 msgr2=0x7f38c81467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 0x7f38c81467b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f38c000a000 tx=0x7f38c0008040).stop 2021-10-20T23:26:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 shutdown_connections 2021-10-20T23:26:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f38a80534f0 0x7f38a80559b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c80b4aa0 0x7f38c81467b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38c8064a20 0x7f38c81462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 --2- 172.21.15.12:0/2785876707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38c8064640 0x7f38c80b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 >> 172.21.15.12:0/2785876707 conn(0x7f38c805f6b0 msgr2=0x7f38c80b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 shutdown_connections 2021-10-20T23:26:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:37.956+0000 7f38cef81700 1 -- 172.21.15.12:0/2785876707 wait complete. 2021-10-20T23:26:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:26:37.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:37.991 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:26:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435359e700 1 Processor -- start 2021-10-20T23:26:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435359e700 1 -- start start 2021-10-20T23:26:38.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f4354142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f43540ace70 0x7f435413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4354143920 con 0x7f43540b30d0 2021-10-20T23:26:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43540b0af0 con 0x7f43540ace70 2021-10-20T23:26:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43540ae680 con 0x7f43540b0710 2021-10-20T23:26:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f4351d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f43540b30d0 0x7f4354143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39876/0 (socket says 172.21.15.12:39876) 2021-10-20T23:26:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f4351d9b700 1 -- 172.21.15.12:0/753429356 learned_addr learned my addr 172.21.15.12:0/753429356 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435259c700 1 --2- 172.21.15.12:0/753429356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f4354142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f4352d9d700 1 --2- 172.21.15.12:0/753429356 >> v2:172.21.15.31:3300/0 conn(0x7f43540ace70 0x7f435413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435159a700 1 -- 172.21.15.12:0/753429356 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322971400 0 0) 0x7f4354143920 con 0x7f43540b30d0 2021-10-20T23:26:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435159a700 1 -- 172.21.15.12:0/753429356 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4338003260 con 0x7f43540b30d0 2021-10-20T23:26:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435259c700 1 -- 172.21.15.12:0/753429356 >> v2:172.21.15.31:3300/0 conn(0x7f43540ace70 msgr2=0x7f435413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435259c700 1 --2- 172.21.15.12:0/753429356 >> v2:172.21.15.31:3300/0 conn(0x7f43540ace70 0x7f435413f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435259c700 1 -- 172.21.15.12:0/753429356 >> v1:172.21.15.12:6789/0 conn(0x7f43540b30d0 legacy=0x7f4354143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435259c700 1 -- 172.21.15.12:0/753429356 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43540ae920 con 0x7f43540b0710 2021-10-20T23:26:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435259c700 1 --2- 172.21.15.12:0/753429356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f4354142d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f43440032f0 tx=0x7f434400a370).ready entity=mon.2 client_cookie=a565cbd666be24b4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435159a700 1 -- 172.21.15.12:0/753429356 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f434400cba0 con 0x7f43540b0710 2021-10-20T23:26:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435159a700 1 -- 172.21.15.12:0/753429356 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434400cd00 con 0x7f43540b0710 2021-10-20T23:26:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.076+0000 7f435159a700 1 -- 172.21.15.12:0/753429356 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4344010600 con 0x7f43540b0710 2021-10-20T23:26:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 -- 172.21.15.12:0/753429356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 msgr2=0x7f4354142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 --2- 172.21.15.12:0/753429356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f4354142d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f43440032f0 tx=0x7f434400a370).stop 2021-10-20T23:26:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 -- 172.21.15.12:0/753429356 shutdown_connections 2021-10-20T23:26:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 --2- 172.21.15.12:0/753429356 >> v2:172.21.15.31:3300/0 conn(0x7f43540ace70 0x7f435413f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 --2- 172.21.15.12:0/753429356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f4354142d20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 -- 172.21.15.12:0/753429356 >> 172.21.15.12:0/753429356 conn(0x7f4354061140 msgr2=0x7f4354062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 -- 172.21.15.12:0/753429356 shutdown_connections 2021-10-20T23:26:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 -- 172.21.15.12:0/753429356 wait complete. 2021-10-20T23:26:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 Processor -- start 2021-10-20T23:26:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.080+0000 7f435359e700 1 -- start start 2021-10-20T23:26:38.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43540ace70 0x7f4354065df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f43540b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43540b30d0 0x7f43540ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43540656f0 con 0x7f43540b30d0 2021-10-20T23:26:38.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43540ac450 con 0x7f43540ace70 2021-10-20T23:26:38.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43540b4bb0 con 0x7f43540b0710 2021-10-20T23:26:38.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4352d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43540b30d0 0x7f43540ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43540ace70 0x7f4354065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4352d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43540b30d0 0x7f43540ab010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41292/0 (socket says 172.21.15.12:41292) 2021-10-20T23:26:38.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4351d9b700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f43540b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4352d9d700 1 -- 172.21.15.12:0/1579523983 learned_addr learned my addr 172.21.15.12:0/1579523983 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:38.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4352d9d700 1 -- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 msgr2=0x7f43540b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4352d9d700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f43540b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4352d9d700 1 -- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43540ace70 msgr2=0x7f4354065df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4352d9d700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43540ace70 0x7f4354065df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4352d9d700 1 -- 172.21.15.12:0/1579523983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434400a610 con 0x7f43540b30d0 2021-10-20T23:26:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4351d9b700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f43540b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435259c700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43540ace70 0x7f4354065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:38.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f4352d9d700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43540b30d0 0x7f43540ab010 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f434c00c000 tx=0x7f434c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:38.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f43437fe700 1 -- 172.21.15.12:0/1579523983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f434c011750 con 0x7f43540b30d0 2021-10-20T23:26:38.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f43437fe700 1 -- 172.21.15.12:0/1579523983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c0118b0 con 0x7f43540b30d0 2021-10-20T23:26:38.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43540ac1b0 con 0x7f43540b30d0 2021-10-20T23:26:38.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f43437fe700 1 -- 172.21.15.12:0/1579523983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f434c011c10 con 0x7f43540b30d0 2021-10-20T23:26:38.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.084+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43540a8f30 con 0x7f43540b30d0 2021-10-20T23:26:38.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.088+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4354064520 con 0x7f43540b30d0 2021-10-20T23:26:38.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.088+0000 7f43437fe700 1 -- 172.21.15.12:0/1579523983 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f434c011d70 con 0x7f43540b30d0 2021-10-20T23:26:38.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.088+0000 7f43437fe700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43300536a0 0x7f4330055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.088+0000 7f43437fe700 1 -- 172.21.15.12:0/1579523983 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6549+0+0 (secure 0 0 0) 0x7f434c06be30 con 0x7f43540b30d0 2021-10-20T23:26:38.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.088+0000 7f435259c700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43300536a0 0x7f4330055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.088+0000 7f435259c700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43300536a0 0x7f4330055b60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f434401b000 tx=0x7f43540a9420).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:38.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.096+0000 7f43437fe700 1 -- 172.21.15.12:0/1579523983 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4354064520 con 0x7f43540b30d0 2021-10-20T23:26:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.260+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4354064520 con 0x7f43540b30d0 2021-10-20T23:26:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f43437fe700 1 -- 172.21.15.12:0/1579523983 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f4354064520 con 0x7f43540b30d0 2021-10-20T23:26:38.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:38.272 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":39,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:25:41.263533+0000","modified":"2021-10-20T23:26:37.942724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-20T23:26:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43300536a0 msgr2=0x7f4330055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43300536a0 0x7f4330055b60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f434401b000 tx=0x7f43540a9420).stop 2021-10-20T23:26:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43540b30d0 msgr2=0x7f43540ab010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43540b30d0 0x7f43540ab010 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f434c00c000 tx=0x7f434c006df0).stop 2021-10-20T23:26:38.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 shutdown_connections 2021-10-20T23:26:38.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43300536a0 0x7f4330055b60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43540b30d0 0x7f43540ab010 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43540b0710 0x7f43540b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 --2- 172.21.15.12:0/1579523983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43540ace70 0x7f4354065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 >> 172.21.15.12:0/1579523983 conn(0x7f4354061140 msgr2=0x7f43540b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:38.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 shutdown_connections 2021-10-20T23:26:38.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.264+0000 7f435359e700 1 -- 172.21.15.12:0/1579523983 wait complete. 2021-10-20T23:26:38.278 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 39 2021-10-20T23:26:38.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:26:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.392+0000 7fa4bb59e700 1 Processor -- start 2021-10-20T23:26:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.392+0000 7fa4bb59e700 1 -- start start 2021-10-20T23:26:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.392+0000 7fa4bb59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4bc0b4060 0x7fa4bc061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.392+0000 7fa4bb59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0b5f50 con 0x7fa4bc0b6290 2021-10-20T23:26:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.392+0000 7fa4bb59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0b1f70 con 0x7fa4bc142e60 2021-10-20T23:26:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.392+0000 7fa4bb59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc0b2210 con 0x7fa4bc0b4060 2021-10-20T23:26:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.392+0000 7fa4ba59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa4bc0b6290 0x7fa4bc061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39890/0 (socket says 172.21.15.12:39890) 2021-10-20T23:26:38.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.392+0000 7fa4ba59c700 1 -- 172.21.15.12:0/3402837158 learned_addr learned my addr 172.21.15.12:0/3402837158 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:38.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.392+0000 7fa4b9d9b700 1 --2- 172.21.15.12:0/3402837158 >> v2:172.21.15.31:3300/0 conn(0x7fa4bc0b4060 0x7fa4bc061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b959a700 1 -- 172.21.15.12:0/3402837158 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033798974 0 0) 0x7fa4ac001110 con 0x7fa4bc0b6290 2021-10-20T23:26:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b959a700 1 -- 172.21.15.12:0/3402837158 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa49c003260 con 0x7fa4bc0b6290 2021-10-20T23:26:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b959a700 1 -- 172.21.15.12:0/3402837158 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057440961 0 0) 0x7fa4bc0b1f70 con 0x7fa4bc142e60 2021-10-20T23:26:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b959a700 1 -- 172.21.15.12:0/3402837158 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ac001110 con 0x7fa4bc142e60 2021-10-20T23:26:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b9d9b700 1 -- 172.21.15.12:0/3402837158 >> v1:172.21.15.31:6789/0 conn(0x7fa4bc142e60 legacy=0x7fa4bc1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b9d9b700 1 -- 172.21.15.12:0/3402837158 >> v1:172.21.15.12:6789/0 conn(0x7fa4bc0b6290 legacy=0x7fa4bc061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b9d9b700 1 -- 172.21.15.12:0/3402837158 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0b24b0 con 0x7fa4bc0b4060 2021-10-20T23:26:38.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b9d9b700 1 --2- 172.21.15.12:0/3402837158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4bc0b4060 0x7fa4bc061b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fa4a4002f70 tx=0x7fa4a4006df0).ready entity=mon.1 client_cookie=ab978ae925e61f8d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:38.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b959a700 1 -- 172.21.15.12:0/3402837158 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a400d540 con 0x7fa4bc0b4060 2021-10-20T23:26:38.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b959a700 1 -- 172.21.15.12:0/3402837158 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4000e90 con 0x7fa4bc0b4060 2021-10-20T23:26:38.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4b959a700 1 -- 172.21.15.12:0/3402837158 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a400d890 con 0x7fa4bc0b4060 2021-10-20T23:26:38.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4bb59e700 1 -- 172.21.15.12:0/3402837158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4bc0b4060 msgr2=0x7fa4bc061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4bb59e700 1 --2- 172.21.15.12:0/3402837158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4bc0b4060 0x7fa4bc061b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fa4a4002f70 tx=0x7fa4a4006df0).stop 2021-10-20T23:26:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4bb59e700 1 -- 172.21.15.12:0/3402837158 shutdown_connections 2021-10-20T23:26:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4bb59e700 1 --2- 172.21.15.12:0/3402837158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4bc0b4060 0x7fa4bc061b80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4bb59e700 1 -- 172.21.15.12:0/3402837158 >> 172.21.15.12:0/3402837158 conn(0x7fa4bc05c490 msgr2=0x7fa4bc05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4bb59e700 1 -- 172.21.15.12:0/3402837158 shutdown_connections 2021-10-20T23:26:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.396+0000 7fa4bb59e700 1 -- 172.21.15.12:0/3402837158 wait complete. 2021-10-20T23:26:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 Processor -- start 2021-10-20T23:26:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 -- start start 2021-10-20T23:26:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4bc0b4060 0x7fa4bc152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4bc0b6290 0x7fa4bc1530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4bc142e60 0x7fa4bc0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc152630 con 0x7fa4bc0b6290 2021-10-20T23:26:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc153590 con 0x7fa4bc0b4060 2021-10-20T23:26:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc146910 con 0x7fa4bc142e60 2021-10-20T23:26:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4bc0b6290 0x7fa4bc1530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4bc0b6290 0x7fa4bc1530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41304/0 (socket says 172.21.15.12:41304) 2021-10-20T23:26:38.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b9d9b700 1 -- 172.21.15.12:0/1795645606 learned_addr learned my addr 172.21.15.12:0/1795645606 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:38.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4ba59c700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4bc0b4060 0x7fa4bc152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bad9d700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4bc142e60 0x7fa4bc0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b9d9b700 1 -- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4bc142e60 msgr2=0x7fa4bc0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b9d9b700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4bc142e60 0x7fa4bc0affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b9d9b700 1 -- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4bc0b4060 msgr2=0x7fa4bc152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b9d9b700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4bc0b4060 0x7fa4bc152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b9d9b700 1 -- 172.21.15.12:0/1795645606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a400b180 con 0x7fa4bc0b6290 2021-10-20T23:26:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bad9d700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4bc142e60 0x7fa4bc0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b9d9b700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4bc0b6290 0x7fa4bc1530a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fa4a4002f70 tx=0x7fa4a4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:38.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b37fe700 1 -- 172.21.15.12:0/1795645606 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a4016070 con 0x7fa4bc0b6290 2021-10-20T23:26:38.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b37fe700 1 -- 172.21.15.12:0/1795645606 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a40138d0 con 0x7fa4bc0b6290 2021-10-20T23:26:38.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc152820 con 0x7fa4bc0b6290 2021-10-20T23:26:38.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4b37fe700 1 -- 172.21.15.12:0/1795645606 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a4013c30 con 0x7fa4bc0b6290 2021-10-20T23:26:38.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.400+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc0b5080 con 0x7fa4bc0b6290 2021-10-20T23:26:38.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.404+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc0b2750 con 0x7fa4bc0b6290 2021-10-20T23:26:38.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.404+0000 7fa4b37fe700 1 -- 172.21.15.12:0/1795645606 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa4a4025030 con 0x7fa4bc0b6290 2021-10-20T23:26:38.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.404+0000 7fa4b37fe700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa4a0053610 0x7fa4a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:38.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.404+0000 7fa4b37fe700 1 -- 172.21.15.12:0/1795645606 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6549+0+0 (secure 0 0 0) 0x7fa4a406cb10 con 0x7fa4bc0b6290 2021-10-20T23:26:38.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.404+0000 7fa4ba59c700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa4a0053610 0x7fa4a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:38.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.404+0000 7fa4ba59c700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa4a0053610 0x7fa4a0055ad0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fa4ac00d000 tx=0x7fa4ac009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:38.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.412+0000 7fa4b37fe700 1 -- 172.21.15.12:0/1795645606 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4a4043980 con 0x7fa4bc0b6290 2021-10-20T23:26:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.576+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa4bc057350 con 0x7fa4bc0b6290 2021-10-20T23:26:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.956+0000 7fa4b37fe700 1 -- 172.21.15.12:0/1795645606 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa4a4023020 con 0x7fa4bc0b6290 2021-10-20T23:26:38.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa4a0053610 msgr2=0x7fa4a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa4a0053610 0x7fa4a0055ad0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fa4ac00d000 tx=0x7fa4ac009040).stop 2021-10-20T23:26:38.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4bc0b6290 msgr2=0x7fa4bc1530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:38.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4bc0b6290 0x7fa4bc1530a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fa4a4002f70 tx=0x7fa4a4014000).stop 2021-10-20T23:26:38.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 shutdown_connections 2021-10-20T23:26:38.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa4a0053610 0x7fa4a0055ad0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4bc142e60 0x7fa4bc0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4bc0b6290 0x7fa4bc1530a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 --2- 172.21.15.12:0/1795645606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4bc0b4060 0x7fa4bc152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:38.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 >> 172.21.15.12:0/1795645606 conn(0x7fa4bc05c490 msgr2=0x7fa4bc0b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:38.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 shutdown_connections 2021-10-20T23:26:38.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:38.960+0000 7fa4bb59e700 1 -- 172.21.15.12:0/1795645606 wait complete. 2021-10-20T23:26:38.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:26:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.092+0000 7f0fa68e7700 1 Processor -- start 2021-10-20T23:26:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.092+0000 7f0fa68e7700 1 -- start start 2021-10-20T23:26:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa68e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa00b1a30 0x7f0fa00669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa68e7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0fa0140cb0 0x7f0fa013e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:39.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa68e7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa005f750 con 0x7f0fa00665f0 2021-10-20T23:26:39.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa68e7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa00b14a0 con 0x7f0fa0140cb0 2021-10-20T23:26:39.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa68e7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa005f980 con 0x7f0fa00b1a30 2021-10-20T23:26:39.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa50e4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa00b1a30 0x7f0fa00669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:39.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa50e4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa00b1a30 0x7f0fa00669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:47070/0 (socket says 172.21.15.12:47070) 2021-10-20T23:26:39.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa50e4700 1 -- 172.21.15.12:0/1493806550 learned_addr learned my addr 172.21.15.12:0/1493806550 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:39.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa58e5700 1 --1- 172.21.15.12:0/1493806550 >> v1:172.21.15.31:6789/0 conn(0x7f0fa00665f0 0x7f0fa005fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:46968/0 (socket says 172.21.15.12:46968) 2021-10-20T23:26:39.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa60e6700 1 --2- 172.21.15.12:0/1493806550 >> v2:172.21.15.31:3300/0 conn(0x7f0fa0140cb0 0x7f0fa013e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:39.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa50e4700 1 -- 172.21.15.12:0/1493806550 >> v2:172.21.15.31:3300/0 conn(0x7f0fa0140cb0 msgr2=0x7f0fa013e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:39.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa50e4700 1 --2- 172.21.15.12:0/1493806550 >> v2:172.21.15.31:3300/0 conn(0x7f0fa0140cb0 0x7f0fa013e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:39.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa50e4700 1 -- 172.21.15.12:0/1493806550 >> v1:172.21.15.31:6789/0 conn(0x7f0fa00665f0 legacy=0x7f0fa005fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:39.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa50e4700 1 -- 172.21.15.12:0/1493806550 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa00b1740 con 0x7f0fa00b1a30 2021-10-20T23:26:39.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa50e4700 1 --2- 172.21.15.12:0/1493806550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa00b1a30 0x7f0fa00669d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0f90002f70 tx=0x7f0f90006eb0).ready entity=mon.2 client_cookie=7879e602b3f1c9b1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:39.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa48e3700 1 -- 172.21.15.12:0/1493806550 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f9000d570 con 0x7f0fa00b1a30 2021-10-20T23:26:39.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa48e3700 1 -- 172.21.15.12:0/1493806550 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f90000e90 con 0x7f0fa00b1a30 2021-10-20T23:26:39.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.096+0000 7f0fa48e3700 1 -- 172.21.15.12:0/1493806550 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f9000d900 con 0x7f0fa00b1a30 2021-10-20T23:26:39.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.100+0000 7f0fa68e7700 1 -- 172.21.15.12:0/1493806550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa00b1a30 msgr2=0x7f0fa00669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:39.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.100+0000 7f0fa68e7700 1 --2- 172.21.15.12:0/1493806550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa00b1a30 0x7f0fa00669d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0f90002f70 tx=0x7f0f90006eb0).stop 2021-10-20T23:26:39.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.100+0000 7f0fa68e7700 1 -- 172.21.15.12:0/1493806550 shutdown_connections 2021-10-20T23:26:39.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.100+0000 7f0fa68e7700 1 --2- 172.21.15.12:0/1493806550 >> v2:172.21.15.31:3300/0 conn(0x7f0fa0140cb0 0x7f0fa013e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:39.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.100+0000 7f0fa68e7700 1 --2- 172.21.15.12:0/1493806550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa00b1a30 0x7f0fa00669d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:39.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.100+0000 7f0fa68e7700 1 -- 172.21.15.12:0/1493806550 >> 172.21.15.12:0/1493806550 conn(0x7f0fa00636e0 msgr2=0x7f0fa0063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:39.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.100+0000 7f0fa68e7700 1 -- 172.21.15.12:0/1493806550 shutdown_connections 2021-10-20T23:26:39.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.100+0000 7f0fa68e7700 1 -- 172.21.15.12:0/1493806550 wait complete. 2021-10-20T23:26:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.100+0000 7f0fa68e7700 1 Processor -- start 2021-10-20T23:26:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa68e7700 1 -- start start 2021-10-20T23:26:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa68e7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fa00665f0 0x7f0fa00ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa68e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fa00b1a30 0x7f0fa00abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa68e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa0140cb0 0x7f0fa013e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa68e7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa009f9b0 con 0x7f0fa00665f0 2021-10-20T23:26:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa68e7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00aede0 con 0x7f0fa00b1a30 2021-10-20T23:26:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa68e7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00ade30 con 0x7f0fa0140cb0 2021-10-20T23:26:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa58e5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fa00665f0 0x7f0fa00ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa58e5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fa00665f0 0x7f0fa00ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41316/0 (socket says 172.21.15.12:41316) 2021-10-20T23:26:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa58e5700 1 -- 172.21.15.12:0/473657074 learned_addr learned my addr 172.21.15.12:0/473657074 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa50e4700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fa00b1a30 0x7f0fa00abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa60e6700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa0140cb0 0x7f0fa013e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa58e5700 1 -- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa0140cb0 msgr2=0x7f0fa013e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa58e5700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa0140cb0 0x7f0fa013e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa58e5700 1 -- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fa00b1a30 msgr2=0x7f0fa00abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa58e5700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fa00b1a30 0x7f0fa00abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa58e5700 1 -- 172.21.15.12:0/473657074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9000b1e0 con 0x7f0fa00665f0 2021-10-20T23:26:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa58e5700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fa00665f0 0x7f0fa00ae740 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f0fa005fd00 tx=0x7f0f9c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0f8effd700 1 -- 172.21.15.12:0/473657074 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f9c0070d0 con 0x7f0fa00665f0 2021-10-20T23:26:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0f8effd700 1 -- 172.21.15.12:0/473657074 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c007230 con 0x7f0fa00665f0 2021-10-20T23:26:39.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa00aff00 con 0x7f0fa00665f0 2021-10-20T23:26:39.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0f8effd700 1 -- 172.21.15.12:0/473657074 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f9c005550 con 0x7f0fa00665f0 2021-10-20T23:26:39.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.104+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa00acda0 con 0x7f0fa00665f0 2021-10-20T23:26:39.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.108+0000 7f0f8effd700 1 -- 172.21.15.12:0/473657074 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0f9c01a070 con 0x7f0fa00665f0 2021-10-20T23:26:39.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.108+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa0141120 con 0x7f0fa00665f0 2021-10-20T23:26:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.108+0000 7f0f8effd700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0f80053640 0x7f0f80055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.108+0000 7f0f8effd700 1 -- 172.21.15.12:0/473657074 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6549+0+0 (secure 0 0 0) 0x7f0f9c06adc0 con 0x7f0fa00665f0 2021-10-20T23:26:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.108+0000 7f0fa50e4700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0f80053640 0x7f0f80055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.112+0000 7f0fa50e4700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0f80053640 0x7f0f80055b00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f0f9001c000 tx=0x7f0f90015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.116+0000 7f0f8effd700 1 -- 172.21.15.12:0/473657074 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f9c041c30 con 0x7f0fa00665f0 2021-10-20T23:26:39.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:39.248+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0fa0057350 con 0x7f0fa00665f0 2021-10-20T23:26:40.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.024+0000 7f0f8effd700 1 -- 172.21.15.12:0/473657074 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0f9c045250 con 0x7f0fa00665f0 2021-10-20T23:26:40.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0f80053640 msgr2=0x7f0f80055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:40.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0f80053640 0x7f0f80055b00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f0f9001c000 tx=0x7f0f90015000).stop 2021-10-20T23:26:40.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fa00665f0 msgr2=0x7f0fa00ae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:40.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fa00665f0 0x7f0fa00ae740 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f0fa005fd00 tx=0x7f0f9c007c40).stop 2021-10-20T23:26:40.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 shutdown_connections 2021-10-20T23:26:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0f80053640 0x7f0f80055b00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0fa0140cb0 0x7f0fa013e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fa00b1a30 0x7f0fa00abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:40.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 --2- 172.21.15.12:0/473657074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fa00665f0 0x7f0fa00ae740 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:40.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.028+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 >> 172.21.15.12:0/473657074 conn(0x7f0fa00636e0 msgr2=0x7f0fa0144040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:40.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.032+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 shutdown_connections 2021-10-20T23:26:40.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.032+0000 7f0fa68e7700 1 -- 172.21.15.12:0/473657074 wait complete. 2021-10-20T23:26:40.045 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:26:40.053 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:26:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 Processor -- start 2021-10-20T23:26:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 -- start start 2021-10-20T23:26:40.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdf040b2580 0x7fdf0414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:40.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdf040b0010 0x7fdf0414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf040a70c0 con 0x7fdf040afbd0 2021-10-20T23:26:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf040a72f0 con 0x7fdf040b2580 2021-10-20T23:26:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf040a7590 con 0x7fdf040b0010 2021-10-20T23:26:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf09f51700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdf040b2580 0x7fdf0414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf09f51700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdf040b2580 0x7fdf0414ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41324/0 (socket says 172.21.15.12:41324) 2021-10-20T23:26:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf09f51700 1 -- 172.21.15.12:0/2420509510 learned_addr learned my addr 172.21.15.12:0/2420509510 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:40.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf09750700 1 --2- 172.21.15.12:0/2420509510 >> v2:172.21.15.31:3300/0 conn(0x7fdf040b0010 0x7fdf0414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:40.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf09f51700 1 -- 172.21.15.12:0/2420509510 >> v2:172.21.15.31:3300/0 conn(0x7fdf040b0010 msgr2=0x7fdf0414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:40.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf09f51700 1 --2- 172.21.15.12:0/2420509510 >> v2:172.21.15.31:3300/0 conn(0x7fdf040b0010 0x7fdf0414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:40.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf09f51700 1 -- 172.21.15.12:0/2420509510 >> v1:172.21.15.12:6789/0 conn(0x7fdf040afbd0 legacy=0x7fdf040a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:40.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf09f51700 1 -- 172.21.15.12:0/2420509510 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf040a7830 con 0x7fdf040b2580 2021-10-20T23:26:40.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf09f51700 1 --2- 172.21.15.12:0/2420509510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b2580 0x7fdf0414ae40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fdf00002f70 tx=0x7fdf00006eb0).ready entity=mon.0 client_cookie=1277419edd0da98e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf08f4f700 1 -- 172.21.15.12:0/2420509510 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf0000d5c0 con 0x7fdf040b2580 2021-10-20T23:26:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf08f4f700 1 -- 172.21.15.12:0/2420509510 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf00000e90 con 0x7fdf040b2580 2021-10-20T23:26:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf08f4f700 1 -- 172.21.15.12:0/2420509510 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf0000d950 con 0x7fdf040b2580 2021-10-20T23:26:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 -- 172.21.15.12:0/2420509510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b2580 msgr2=0x7fdf0414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 --2- 172.21.15.12:0/2420509510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b2580 0x7fdf0414ae40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fdf00002f70 tx=0x7fdf00006eb0).stop 2021-10-20T23:26:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 -- 172.21.15.12:0/2420509510 shutdown_connections 2021-10-20T23:26:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 --2- 172.21.15.12:0/2420509510 >> v2:172.21.15.31:3300/0 conn(0x7fdf040b0010 0x7fdf0414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:40.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 --2- 172.21.15.12:0/2420509510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b2580 0x7fdf0414ae40 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:40.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 -- 172.21.15.12:0/2420509510 >> 172.21.15.12:0/2420509510 conn(0x7fdf04060180 msgr2=0x7fdf040b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:40.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 -- 172.21.15.12:0/2420509510 shutdown_connections 2021-10-20T23:26:40.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.160+0000 7fdf0af53700 1 -- 172.21.15.12:0/2420509510 wait complete. 2021-10-20T23:26:40.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 Processor -- start 2021-10-20T23:26:40.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 -- start start 2021-10-20T23:26:40.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf040afbd0 0x7fdf04149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:40.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b0010 0x7fdf040ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:40.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf040b2580 0x7fdf04159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:40.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040aae40 con 0x7fdf040b0010 2021-10-20T23:26:40.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040ab0e0 con 0x7fdf040afbd0 2021-10-20T23:26:40.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040ab380 con 0x7fdf040b2580 2021-10-20T23:26:40.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf09750700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b0010 0x7fdf040ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:40.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf09f51700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf040afbd0 0x7fdf04149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:40.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0a752700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf040b2580 0x7fdf04159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:40.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf09750700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b0010 0x7fdf040ab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41332/0 (socket says 172.21.15.12:41332) 2021-10-20T23:26:40.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf09750700 1 -- 172.21.15.12:0/3057958938 learned_addr learned my addr 172.21.15.12:0/3057958938 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:40.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0a752700 1 -- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf040afbd0 msgr2=0x7fdf04149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:40.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0a752700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf040afbd0 0x7fdf04149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:40.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0a752700 1 -- 172.21.15.12:0/3057958938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b0010 msgr2=0x7fdf040ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:40.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0a752700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b0010 0x7fdf040ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:40.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0a752700 1 -- 172.21.15.12:0/3057958938 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0000b1e0 con 0x7fdf040b2580 2021-10-20T23:26:40.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf09750700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b0010 0x7fdf040ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:40.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0a752700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf040b2580 0x7fdf04159dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdf0406b7c0 tx=0x7fdefc007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:40.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdef2ffd700 1 -- 172.21.15.12:0/3057958938 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdefc00f470 con 0x7fdf040b2580 2021-10-20T23:26:40.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdef2ffd700 1 -- 172.21.15.12:0/3057958938 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc00f5d0 con 0x7fdf040b2580 2021-10-20T23:26:40.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf04149e60 con 0x7fdf040b2580 2021-10-20T23:26:40.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdef2ffd700 1 -- 172.21.15.12:0/3057958938 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdefc00f930 con 0x7fdf040b2580 2021-10-20T23:26:40.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.164+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf041564d0 con 0x7fdf040b2580 2021-10-20T23:26:40.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.168+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf04057350 con 0x7fdf040b2580 2021-10-20T23:26:40.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.168+0000 7fdef2ffd700 1 -- 172.21.15.12:0/3057958938 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdefc010070 con 0x7fdf040b2580 2021-10-20T23:26:40.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.168+0000 7fdef2ffd700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdee4053580 0x7fdee4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:40.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.168+0000 7fdef2ffd700 1 -- 172.21.15.12:0/3057958938 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6111+0+0 (secure 0 0 0) 0x7fdefc06ae50 con 0x7fdf040b2580 2021-10-20T23:26:40.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.168+0000 7fdf09f51700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdee4053580 0x7fdee4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:40.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.168+0000 7fdf09f51700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdee4053580 0x7fdee4055a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fdf0001c000 tx=0x7fdf00015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:40.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.172+0000 7fdef2ffd700 1 -- 172.21.15.12:0/3057958938 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdefc041f10 con 0x7fdf040b2580 2021-10-20T23:26:40.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:40.304+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdf040698e0 con 0x7fdf040b2580 2021-10-20T23:26:41.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.036+0000 7fdef2ffd700 1 -- 172.21.15.12:0/3057958938 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) v1 ==== 173+0+0 (secure 0 0 0) 0x7fdefc045530 con 0x7fdf040b2580 2021-10-20T23:26:41.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdee4053580 msgr2=0x7fdee4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdee4053580 0x7fdee4055a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fdf0001c000 tx=0x7fdf00015000).stop 2021-10-20T23:26:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf040b2580 msgr2=0x7fdf04159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf040b2580 0x7fdf04159dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdf0406b7c0 tx=0x7fdefc007eb0).stop 2021-10-20T23:26:41.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 shutdown_connections 2021-10-20T23:26:41.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdee4053580 0x7fdee4055a40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf040b2580 0x7fdf04159dd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf040b0010 0x7fdf040ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 --2- 172.21.15.12:0/3057958938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf040afbd0 0x7fdf04149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 >> 172.21.15.12:0/3057958938 conn(0x7fdf04060180 msgr2=0x7fdf0414a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:41.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 shutdown_connections 2021-10-20T23:26:41.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.040+0000 7fdf0af53700 1 -- 172.21.15.12:0/3057958938 wait complete. 2021-10-20T23:26:41.056 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:26:41.063 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:26:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37dd95e700 1 Processor -- start 2021-10-20T23:26:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37dd95e700 1 -- start start 2021-10-20T23:26:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37dd95e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37d80638d0 0x7f37d8061ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37dd95e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d80b0f40 con 0x7f37d80b17b0 2021-10-20T23:26:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37dd95e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d8063cb0 con 0x7f37d813e640 2021-10-20T23:26:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37dd95e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d8060070 con 0x7f37d80638d0 2021-10-20T23:26:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d7fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f37d80b17b0 0x7f37d813df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39934/0 (socket says 172.21.15.12:39934) 2021-10-20T23:26:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d7fff700 1 -- 172.21.15.12:0/1839624935 learned_addr learned my addr 172.21.15.12:0/1839624935 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37dc95c700 1 --2- 172.21.15.12:0/1839624935 >> v2:172.21.15.31:3300/0 conn(0x7f37d80638d0 0x7f37d8061ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092427476 0 0) 0x7f37d80b0f40 con 0x7f37d80b17b0 2021-10-20T23:26:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b8003260 con 0x7f37d80b17b0 2021-10-20T23:26:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 717105718 0 0) 0x7f37b8003260 con 0x7f37d80b17b0 2021-10-20T23:26:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 >> v2:172.21.15.31:3300/0 conn(0x7f37d80638d0 msgr2=0x7f37d8061ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d77fe700 1 --2- 172.21.15.12:0/1839624935 >> v2:172.21.15.31:3300/0 conn(0x7f37d80638d0 0x7f37d8061ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 >> v1:172.21.15.31:6789/0 conn(0x7f37d813e640 legacy=0x7f37d8141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d80b1170 con 0x7f37d80b17b0 2021-10-20T23:26:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.168+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f37c0001660 con 0x7f37d80b17b0 2021-10-20T23:26:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 >> v1:172.21.15.12:6789/0 conn(0x7f37d80b17b0 legacy=0x7f37d813df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37b8003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37b8004500 0x7f37b8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37b8004e70 0x7f37b800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8060070 con 0x7f37b8003750 2021-10-20T23:26:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b800bd20 con 0x7f37b8004e70 2021-10-20T23:26:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dc95c700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37b8003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b800bee0 con 0x7f37b8004500 2021-10-20T23:26:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd15d700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37b8004e70 0x7f37b800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d7fff700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37b8004500 0x7f37b8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dc95c700 1 -- 172.21.15.12:0/1839624935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37b8004500 msgr2=0x7f37b8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dc95c700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37b8004500 0x7f37b8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dc95c700 1 -- 172.21.15.12:0/1839624935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37b8004e70 msgr2=0x7f37b800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dc95c700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37b8004e70 0x7f37b800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dc95c700 1 -- 172.21.15.12:0/1839624935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8003260 con 0x7f37b8003750 2021-10-20T23:26:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd15d700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37b8004e70 0x7f37b800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd15d700 1 -- 172.21.15.12:0/1839624935 reap_dead start 2021-10-20T23:26:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dc95c700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37b8003b90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f37c800c000 tx=0x7f37c80091d0).ready entity=mon.0 client_cookie=6eecb447b0ae6d31 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c800e7e0 con 0x7f37b8003750 2021-10-20T23:26:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c800e940 con 0x7f37b8003750 2021-10-20T23:26:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37d77fe700 1 -- 172.21.15.12:0/1839624935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c800eca0 con 0x7f37b8003750 2021-10-20T23:26:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd95e700 1 -- 172.21.15.12:0/1839624935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 msgr2=0x7f37b8003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd95e700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37b8003b90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f37c800c000 tx=0x7f37c80091d0).stop 2021-10-20T23:26:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd95e700 1 -- 172.21.15.12:0/1839624935 shutdown_connections 2021-10-20T23:26:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd95e700 1 --2- 172.21.15.12:0/1839624935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37b8003b90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd95e700 1 -- 172.21.15.12:0/1839624935 >> 172.21.15.12:0/1839624935 conn(0x7f37d805c490 msgr2=0x7f37d805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd95e700 1 -- 172.21.15.12:0/1839624935 shutdown_connections 2021-10-20T23:26:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd95e700 1 -- 172.21.15.12:0/1839624935 wait complete. 2021-10-20T23:26:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd95e700 1 Processor -- start 2021-10-20T23:26:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.172+0000 7f37dd95e700 1 -- start start 2021-10-20T23:26:41.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd95e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37d8066330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd95e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8066820 0x7f37d814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd95e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37d814dd40 0x7f37d8150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd95e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8067060 con 0x7f37b8003750 2021-10-20T23:26:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd95e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80655a0 con 0x7f37d8066820 2021-10-20T23:26:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd95e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8064b60 con 0x7f37d814dd40 2021-10-20T23:26:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dc95c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37d8066330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dc95c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37d8066330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41350/0 (socket says 172.21.15.12:41350) 2021-10-20T23:26:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dc95c700 1 -- 172.21.15.12:0/2566372082 learned_addr learned my addr 172.21.15.12:0/2566372082 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37d7fff700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8066820 0x7f37d814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd15d700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37d814dd40 0x7f37d8150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dc95c700 1 -- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37d814dd40 msgr2=0x7f37d8150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dc95c700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37d814dd40 0x7f37d8150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dc95c700 1 -- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8066820 msgr2=0x7f37d814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dc95c700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8066820 0x7f37d814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dc95c700 1 -- 172.21.15.12:0/2566372082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d8065100 con 0x7f37b8003750 2021-10-20T23:26:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd15d700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37d814dd40 0x7f37d8150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dc95c700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37d8066330 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f37c800c000 tx=0x7f37c801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37d5ffb700 1 -- 172.21.15.12:0/2566372082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c801dda0 con 0x7f37b8003750 2021-10-20T23:26:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37d5ffb700 1 -- 172.21.15.12:0/2566372082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c800eeb0 con 0x7f37b8003750 2021-10-20T23:26:41.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d814e1f0 con 0x7f37b8003750 2021-10-20T23:26:41.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37d5ffb700 1 -- 172.21.15.12:0/2566372082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c801b600 con 0x7f37b8003750 2021-10-20T23:26:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.176+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d8143cc0 con 0x7f37b8003750 2021-10-20T23:26:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.180+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d8065290 con 0x7f37b8003750 2021-10-20T23:26:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.180+0000 7f37d5ffb700 1 -- 172.21.15.12:0/2566372082 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f37c802b020 con 0x7f37b8003750 2021-10-20T23:26:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.180+0000 7f37d5ffb700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37bc053640 0x7f37bc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.180+0000 7f37d5ffb700 1 -- 172.21.15.12:0/2566372082 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f37c806d3f0 con 0x7f37b8003750 2021-10-20T23:26:41.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.180+0000 7f37d7fff700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37bc053640 0x7f37bc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.180+0000 7f37d7fff700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37bc053640 0x7f37bc055b00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f37c000d000 tx=0x7f37c0007040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:41.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.184+0000 7f37d5ffb700 1 -- 172.21.15.12:0/2566372082 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f37c8044640 con 0x7f37b8003750 2021-10-20T23:26:41.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.308+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f37d80b1410 con 0x7f37b8003750 2021-10-20T23:26:41.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.316+0000 7f37d5ffb700 1 -- 172.21.15.12:0/2566372082 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37c8047c60 con 0x7f37b8003750 2021-10-20T23:26:41.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37bc053640 msgr2=0x7f37bc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37bc053640 0x7f37bc055b00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f37c000d000 tx=0x7f37c0007040).stop 2021-10-20T23:26:41.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 msgr2=0x7f37d8066330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37d8066330 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f37c800c000 tx=0x7f37c801a000).stop 2021-10-20T23:26:41.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 shutdown_connections 2021-10-20T23:26:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37bc053640 0x7f37bc055b00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37d814dd40 0x7f37d8150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8066820 0x7f37d814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 --2- 172.21.15.12:0/2566372082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37b8003750 0x7f37d8066330 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 >> 172.21.15.12:0/2566372082 conn(0x7f37d805c490 msgr2=0x7f37d813b160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 shutdown_connections 2021-10-20T23:26:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.320+0000 7f37dd95e700 1 -- 172.21.15.12:0/2566372082 wait complete. 2021-10-20T23:26:41.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-10-20T23:26:41.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.436+0000 7f7f1f0a1700 1 Processor -- start 2021-10-20T23:26:41.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.436+0000 7f7f1f0a1700 1 -- start start 2021-10-20T23:26:41.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.436+0000 7f7f1f0a1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f18064980 0x7f7f18144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.436+0000 7f7f1f0a1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f18066500 con 0x7f7f18067110 2021-10-20T23:26:41.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.436+0000 7f7f1f0a1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f180b46c0 con 0x7f7f180b3550 2021-10-20T23:26:41.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.436+0000 7f7f1f0a1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180b3ea0 con 0x7f7f18064980 2021-10-20T23:26:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.436+0000 7f7f1e8a0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7f18067110 0x7f7f18141130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39956/0 (socket says 172.21.15.12:39956) 2021-10-20T23:26:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.436+0000 7f7f1e8a0700 1 -- 172.21.15.12:0/3890714534 learned_addr learned my addr 172.21.15.12:0/3890714534 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.436+0000 7f7f1e09f700 1 --2- 172.21.15.12:0/3890714534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f18064980 0x7f7f18144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1d09d700 1 -- 172.21.15.12:0/3890714534 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612999597 0 0) 0x7f7f18066500 con 0x7f7f18067110 2021-10-20T23:26:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1d09d700 1 -- 172.21.15.12:0/3890714534 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f00003260 con 0x7f7f18067110 2021-10-20T23:26:41.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1d09d700 1 -- 172.21.15.12:0/3890714534 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900659086 0 0) 0x7f7f180b46c0 con 0x7f7f180b3550 2021-10-20T23:26:41.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1d09d700 1 -- 172.21.15.12:0/3890714534 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f18066500 con 0x7f7f180b3550 2021-10-20T23:26:41.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1d09d700 1 -- 172.21.15.12:0/3890714534 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2897898538 0 0) 0x7f7f00003260 con 0x7f7f18067110 2021-10-20T23:26:41.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1e09f700 1 -- 172.21.15.12:0/3890714534 >> v1:172.21.15.31:6789/0 conn(0x7f7f180b3550 legacy=0x7f7f18066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1e09f700 1 -- 172.21.15.12:0/3890714534 >> v1:172.21.15.12:6789/0 conn(0x7f7f18067110 legacy=0x7f7f18141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1e09f700 1 -- 172.21.15.12:0/3890714534 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18064d60 con 0x7f7f18064980 2021-10-20T23:26:41.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1e09f700 1 --2- 172.21.15.12:0/3890714534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f18064980 0x7f7f18144ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f7f10001490 tx=0x7f7f08006df0).ready entity=mon.2 client_cookie=13af879e03236384 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:41.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1d09d700 1 -- 172.21.15.12:0/3890714534 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f10001a00 con 0x7f7f18064980 2021-10-20T23:26:41.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1d09d700 1 -- 172.21.15.12:0/3890714534 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08000e90 con 0x7f7f18064980 2021-10-20T23:26:41.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1d09d700 1 -- 172.21.15.12:0/3890714534 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f08012460 con 0x7f7f18064980 2021-10-20T23:26:41.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3890714534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f18064980 msgr2=0x7f7f18144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1f0a1700 1 --2- 172.21.15.12:0/3890714534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f18064980 0x7f7f18144ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f7f10001490 tx=0x7f7f08006df0).stop 2021-10-20T23:26:41.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3890714534 shutdown_connections 2021-10-20T23:26:41.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1f0a1700 1 --2- 172.21.15.12:0/3890714534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f18064980 0x7f7f18144ce0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3890714534 >> 172.21.15.12:0/3890714534 conn(0x7f7f1805f6b0 msgr2=0x7f7f1805fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:41.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3890714534 shutdown_connections 2021-10-20T23:26:41.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.440+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3890714534 wait complete. 2021-10-20T23:26:41.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 Processor -- start 2021-10-20T23:26:41.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 -- start start 2021-10-20T23:26:41.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f18064980 0x7f7f1813c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f18067110 0x7f7f180af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f180b3550 0x7f7f180afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18150e20 con 0x7f7f18067110 2021-10-20T23:26:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f181510c0 con 0x7f7f18064980 2021-10-20T23:26:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180ae6d0 con 0x7f7f180b3550 2021-10-20T23:26:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e09f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f18064980 0x7f7f1813c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1d89e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f18067110 0x7f7f180af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e09f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f18064980 0x7f7f1813c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:56338/0 (socket says 172.21.15.12:56338) 2021-10-20T23:26:41.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e09f700 1 -- 172.21.15.12:0/3699772701 learned_addr learned my addr 172.21.15.12:0/3699772701 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:41.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e8a0700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f180b3550 0x7f7f180afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e09f700 1 -- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f180b3550 msgr2=0x7f7f180afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e09f700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f180b3550 0x7f7f180afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e09f700 1 -- 172.21.15.12:0/3699772701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f18067110 msgr2=0x7f7f180af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e09f700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f18067110 0x7f7f180af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e09f700 1 -- 172.21.15.12:0/3699772701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0800b180 con 0x7f7f18064980 2021-10-20T23:26:41.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1e09f700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f18064980 0x7f7f1813c100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f7f10001490 tx=0x7f7f08014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:41.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f077fe700 1 -- 172.21.15.12:0/3699772701 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f08016030 con 0x7f7f18064980 2021-10-20T23:26:41.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f077fe700 1 -- 172.21.15.12:0/3699772701 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800db50 con 0x7f7f18064980 2021-10-20T23:26:41.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f077fe700 1 -- 172.21.15.12:0/3699772701 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f08012460 con 0x7f7f18064980 2021-10-20T23:26:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f180ae970 con 0x7f7f18064980 2021-10-20T23:26:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.444+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f180b0140 con 0x7f7f18064980 2021-10-20T23:26:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.448+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f180b48f0 con 0x7f7f18064980 2021-10-20T23:26:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.448+0000 7f7f077fe700 1 -- 172.21.15.12:0/3699772701 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f08024020 con 0x7f7f18064980 2021-10-20T23:26:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.448+0000 7f7f077fe700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7ef8053610 0x7f7ef8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.448+0000 7f7f077fe700 1 -- 172.21.15.12:0/3699772701 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f7f08017070 con 0x7f7f18064980 2021-10-20T23:26:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.448+0000 7f7f1d89e700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7ef8053610 0x7f7ef8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:41.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.448+0000 7f7f1d89e700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7ef8053610 0x7f7ef8055ad0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f7f1400d000 tx=0x7f7f14007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:41.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.456+0000 7f7f077fe700 1 -- 172.21.15.12:0/3699772701 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f08043990 con 0x7f7f18064980 2021-10-20T23:26:41.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:41.624+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f7f18069c00 con 0x7f7f18064980 2021-10-20T23:26:42.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.040+0000 7f7f077fe700 1 -- 172.21.15.12:0/3699772701 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v291) v1 ==== 139+0+0 (secure 0 0 0) 0x7f7f08046fb0 con 0x7f7f18064980 2021-10-20T23:26:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7ef8053610 msgr2=0x7f7ef8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7ef8053610 0x7f7ef8055ad0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f7f1400d000 tx=0x7f7f14007a20).stop 2021-10-20T23:26:42.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f18064980 msgr2=0x7f7f1813c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:42.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f18064980 0x7f7f1813c100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f7f10001490 tx=0x7f7f08014000).stop 2021-10-20T23:26:42.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 shutdown_connections 2021-10-20T23:26:42.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7ef8053610 0x7f7ef8055ad0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:42.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f180b3550 0x7f7f180afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:42.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f18067110 0x7f7f180af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:42.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 --2- 172.21.15.12:0/3699772701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f18064980 0x7f7f1813c100 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:42.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 >> 172.21.15.12:0/3699772701 conn(0x7f7f1805f6b0 msgr2=0x7f7f180b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:42.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 shutdown_connections 2021-10-20T23:26:42.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.044+0000 7f7f1f0a1700 1 -- 172.21.15.12:0/3699772701 wait complete. 2021-10-20T23:26:42.069 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-20T23:26:42.069 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-10-20T23:26:42.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-10-20T23:26:42.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.172+0000 7f604ffff700 1 Processor -- start 2021-10-20T23:26:42.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 -- start start 2021-10-20T23:26:42.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60500b30d0 0x7f6050143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:42.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60500ace70 0x7f605013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:42.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6050143920 con 0x7f60500b0710 2021-10-20T23:26:42.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60500b0af0 con 0x7f60500ace70 2021-10-20T23:26:42.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60500ae680 con 0x7f60500b30d0 2021-10-20T23:26:42.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60500ace70 0x7f605013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:42.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60500ace70 0x7f605013f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41374/0 (socket says 172.21.15.12:41374) 2021-10-20T23:26:42.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604f7fe700 1 -- 172.21.15.12:0/1908050246 learned_addr learned my addr 172.21.15.12:0/1908050246 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:42.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604e7fc700 1 --2- 172.21.15.12:0/1908050246 >> v2:172.21.15.31:3300/0 conn(0x7f60500b30d0 0x7f6050143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:42.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604dffb700 1 -- 172.21.15.12:0/1908050246 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606767650 0 0) 0x7f6050143920 con 0x7f60500b0710 2021-10-20T23:26:42.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604dffb700 1 -- 172.21.15.12:0/1908050246 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6030003260 con 0x7f60500b0710 2021-10-20T23:26:42.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604f7fe700 1 -- 172.21.15.12:0/1908050246 >> v2:172.21.15.31:3300/0 conn(0x7f60500b30d0 msgr2=0x7f6050143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:42.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604f7fe700 1 --2- 172.21.15.12:0/1908050246 >> v2:172.21.15.31:3300/0 conn(0x7f60500b30d0 0x7f6050143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:42.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604f7fe700 1 -- 172.21.15.12:0/1908050246 >> v1:172.21.15.31:6789/0 conn(0x7f60500b0710 legacy=0x7f6050142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:42.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604f7fe700 1 -- 172.21.15.12:0/1908050246 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500ae920 con 0x7f60500ace70 2021-10-20T23:26:42.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604f7fe700 1 --2- 172.21.15.12:0/1908050246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500ace70 0x7f605013f8a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f6048002f70 tx=0x7f6048006eb0).ready entity=mon.0 client_cookie=2725a6a1152738fe server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:42.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604dffb700 1 -- 172.21.15.12:0/1908050246 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f604800d610 con 0x7f60500ace70 2021-10-20T23:26:42.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604dffb700 1 -- 172.21.15.12:0/1908050246 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6048000e90 con 0x7f60500ace70 2021-10-20T23:26:42.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604dffb700 1 -- 172.21.15.12:0/1908050246 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f604800d9a0 con 0x7f60500ace70 2021-10-20T23:26:42.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 -- 172.21.15.12:0/1908050246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500ace70 msgr2=0x7f605013f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:42.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 --2- 172.21.15.12:0/1908050246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500ace70 0x7f605013f8a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f6048002f70 tx=0x7f6048006eb0).stop 2021-10-20T23:26:42.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 -- 172.21.15.12:0/1908050246 shutdown_connections 2021-10-20T23:26:42.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 --2- 172.21.15.12:0/1908050246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500ace70 0x7f605013f8a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:42.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 --2- 172.21.15.12:0/1908050246 >> v2:172.21.15.31:3300/0 conn(0x7f60500b30d0 0x7f6050143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:42.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 -- 172.21.15.12:0/1908050246 >> 172.21.15.12:0/1908050246 conn(0x7f6050061140 msgr2=0x7f6050062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:42.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 -- 172.21.15.12:0/1908050246 shutdown_connections 2021-10-20T23:26:42.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.176+0000 7f604ffff700 1 -- 172.21.15.12:0/1908050246 wait complete. 2021-10-20T23:26:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.180+0000 7f604ffff700 1 Processor -- start 2021-10-20T23:26:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.180+0000 7f604ffff700 1 -- start start 2021-10-20T23:26:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500ace70 0x7f60500b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500b0710 0x7f605013cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:42.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60500b30d0 0x7f605013d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:42.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050065390 con 0x7f60500b0710 2021-10-20T23:26:42.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60501403c0 con 0x7f60500ace70 2021-10-20T23:26:42.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60500655c0 con 0x7f60500b30d0 2021-10-20T23:26:42.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500b0710 0x7f605013cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:42.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500b0710 0x7f605013cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41380/0 (socket says 172.21.15.12:41380) 2021-10-20T23:26:42.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604e7fc700 1 -- 172.21.15.12:0/2823227816 learned_addr learned my addr 172.21.15.12:0/2823227816 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:42.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604effd700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500ace70 0x7f60500b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:42.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604f7fe700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60500b30d0 0x7f605013d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:42.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604e7fc700 1 -- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60500b30d0 msgr2=0x7f605013d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:42.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604e7fc700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60500b30d0 0x7f605013d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:42.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604e7fc700 1 -- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500ace70 msgr2=0x7f60500b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:42.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604e7fc700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500ace70 0x7f60500b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:42.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604e7fc700 1 -- 172.21.15.12:0/2823227816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604800b1e0 con 0x7f60500b0710 2021-10-20T23:26:42.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604e7fc700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500b0710 0x7f605013cbe0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f603800c000 tx=0x7f6038006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:42.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f6047fff700 1 -- 172.21.15.12:0/2823227816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6038010780 con 0x7f60500b0710 2021-10-20T23:26:42.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f6047fff700 1 -- 172.21.15.12:0/2823227816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60380108e0 con 0x7f60500b0710 2021-10-20T23:26:42.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f6047fff700 1 -- 172.21.15.12:0/2823227816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6038010c40 con 0x7f60500b0710 2021-10-20T23:26:42.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6050064b60 con 0x7f60500b0710 2021-10-20T23:26:42.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60500650a0 con 0x7f60500b0710 2021-10-20T23:26:42.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605013c9b0 con 0x7f60500b0710 2021-10-20T23:26:42.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.184+0000 7f6047fff700 1 -- 172.21.15.12:0/2823227816 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f603801c460 con 0x7f60500b0710 2021-10-20T23:26:42.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.188+0000 7f6047fff700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6034053580 0x7f6034055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:42.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.188+0000 7f6047fff700 1 -- 172.21.15.12:0/2823227816 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f603806bc30 con 0x7f60500b0710 2021-10-20T23:26:42.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.188+0000 7f604effd700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6034053580 0x7f6034055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:42.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.188+0000 7f604effd700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6034053580 0x7f6034055a40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f604000d000 tx=0x7f6040007da0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:42.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.192+0000 7f6047fff700 1 -- 172.21.15.12:0/2823227816 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6038042e80 con 0x7f60500b0710 2021-10-20T23:26:42.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:42.364+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f6050057350 con 0x7f60500b0710 2021-10-20T23:26:43.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.040+0000 7f6047fff700 1 -- 172.21.15.12:0/2823227816 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v292) v1 ==== 129+0+0 (secure 0 0 0) 0x7f60380464a0 con 0x7f60500b0710 2021-10-20T23:26:43.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6034053580 msgr2=0x7f6034055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6034053580 0x7f6034055a40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f604000d000 tx=0x7f6040007da0).stop 2021-10-20T23:26:43.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500b0710 msgr2=0x7f605013cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500b0710 0x7f605013cbe0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f603800c000 tx=0x7f6038006df0).stop 2021-10-20T23:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 shutdown_connections 2021-10-20T23:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6034053580 0x7f6034055a40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60500b30d0 0x7f605013d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60500b0710 0x7f605013cbe0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 --2- 172.21.15.12:0/2823227816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500ace70 0x7f60500b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 >> 172.21.15.12:0/2823227816 conn(0x7f6050061140 msgr2=0x7f6050142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 shutdown_connections 2021-10-20T23:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.044+0000 7f604ffff700 1 -- 172.21.15.12:0/2823227816 wait complete. 2021-10-20T23:26:43.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:26:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.168+0000 7ff0f98c3700 1 Processor -- start 2021-10-20T23:26:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.168+0000 7ff0f98c3700 1 -- start start 2021-10-20T23:26:43.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff0f41439a0 0x7ff0f41404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f40b6910 con 0x7ff0f4061680 2021-10-20T23:26:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f40b6bb0 con 0x7ff0f40b4710 2021-10-20T23:26:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40b9680 con 0x7ff0f41439a0 2021-10-20T23:26:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f88c1700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff0f4061680 0x7ff0f40b9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39980/0 (socket says 172.21.15.12:39980) 2021-10-20T23:26:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f88c1700 1 -- 172.21.15.12:0/495405097 learned_addr learned my addr 172.21.15.12:0/495405097 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f90c2700 1 --2- 172.21.15.12:0/495405097 >> v2:172.21.15.31:3300/0 conn(0x7ff0f41439a0 0x7ff0f41404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f37fe700 1 -- 172.21.15.12:0/495405097 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306545944 0 0) 0x7ff0f40b6910 con 0x7ff0f4061680 2021-10-20T23:26:43.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f37fe700 1 -- 172.21.15.12:0/495405097 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e0003260 con 0x7ff0f4061680 2021-10-20T23:26:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f90c2700 1 -- 172.21.15.12:0/495405097 >> v1:172.21.15.31:6789/0 conn(0x7ff0f40b4710 legacy=0x7ff0f413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f90c2700 1 -- 172.21.15.12:0/495405097 >> v1:172.21.15.12:6789/0 conn(0x7ff0f4061680 legacy=0x7ff0f40b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f90c2700 1 -- 172.21.15.12:0/495405097 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40b6e50 con 0x7ff0f41439a0 2021-10-20T23:26:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f90c2700 1 --2- 172.21.15.12:0/495405097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f41439a0 0x7ff0f41404b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7ff0ec0032f0 tx=0x7ff0ec0091d0).ready entity=mon.1 client_cookie=e201ee42517e5f0a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f37fe700 1 -- 172.21.15.12:0/495405097 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0ec00b6c0 con 0x7ff0f41439a0 2021-10-20T23:26:43.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f37fe700 1 -- 172.21.15.12:0/495405097 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec00b820 con 0x7ff0f41439a0 2021-10-20T23:26:43.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f37fe700 1 -- 172.21.15.12:0/495405097 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0ec00b990 con 0x7ff0f41439a0 2021-10-20T23:26:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 -- 172.21.15.12:0/495405097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f41439a0 msgr2=0x7ff0f41404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 --2- 172.21.15.12:0/495405097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f41439a0 0x7ff0f41404b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7ff0ec0032f0 tx=0x7ff0ec0091d0).stop 2021-10-20T23:26:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 -- 172.21.15.12:0/495405097 shutdown_connections 2021-10-20T23:26:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 --2- 172.21.15.12:0/495405097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f41439a0 0x7ff0f41404b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 -- 172.21.15.12:0/495405097 >> 172.21.15.12:0/495405097 conn(0x7ff0f406adf0 msgr2=0x7ff0f405f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 -- 172.21.15.12:0/495405097 shutdown_connections 2021-10-20T23:26:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.172+0000 7ff0f98c3700 1 -- 172.21.15.12:0/495405097 wait complete. 2021-10-20T23:26:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f98c3700 1 Processor -- start 2021-10-20T23:26:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f98c3700 1 -- start start 2021-10-20T23:26:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f98c3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f4061680 0x7ff0f40b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f98c3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f41439a0 0x7ff0f4152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f98c3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0f4145110 0x7ff0f41455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f98c3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4153320 con 0x7ff0f41439a0 2021-10-20T23:26:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f98c3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40ad8b0 con 0x7ff0f4061680 2021-10-20T23:26:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f98c3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40adfb0 con 0x7ff0f4145110 2021-10-20T23:26:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f88c1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f4061680 0x7ff0f40b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f88c1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f4061680 0x7ff0f40b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:56366/0 (socket says 172.21.15.12:56366) 2021-10-20T23:26:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f88c1700 1 -- 172.21.15.12:0/2962869166 learned_addr learned my addr 172.21.15.12:0/2962869166 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f41439a0 0x7ff0f4152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f90c2700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0f4145110 0x7ff0f41455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f88c1700 1 -- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0f4145110 msgr2=0x7ff0f41455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f88c1700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0f4145110 0x7ff0f41455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f88c1700 1 -- 172.21.15.12:0/2962869166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f41439a0 msgr2=0x7ff0f4152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f88c1700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f41439a0 0x7ff0f4152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.176+0000 7ff0f88c1700 1 -- 172.21.15.12:0/2962869166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec009470 con 0x7ff0f4061680 2021-10-20T23:26:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f88c1700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f4061680 0x7ff0f40b27a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7ff0e4001110 tx=0x7ff0e4007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f1ffb700 1 -- 172.21.15.12:0/2962869166 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e40070d0 con 0x7ff0f4061680 2021-10-20T23:26:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f1ffb700 1 -- 172.21.15.12:0/2962869166 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4007230 con 0x7ff0f4061680 2021-10-20T23:26:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f1ffb700 1 -- 172.21.15.12:0/2962869166 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e4005610 con 0x7ff0f4061680 2021-10-20T23:26:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f4146ea0 con 0x7ff0f4061680 2021-10-20T23:26:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f40adb10 con 0x7ff0f4061680 2021-10-20T23:26:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f40b9870 con 0x7ff0f4061680 2021-10-20T23:26:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f1ffb700 1 -- 172.21.15.12:0/2962869166 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff0e4010070 con 0x7ff0f4061680 2021-10-20T23:26:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f1ffb700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0d4053580 0x7ff0d4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f1ffb700 1 -- 172.21.15.12:0/2962869166 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5729+0+0 (secure 0 0 0) 0x7ff0e406af30 con 0x7ff0f4061680 2021-10-20T23:26:43.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.180+0000 7ff0f3fff700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0d4053580 0x7ff0d4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.184+0000 7ff0f3fff700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0d4053580 0x7ff0d4055a40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7ff0e800d000 tx=0x7ff0e8007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:43.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.188+0000 7ff0f1ffb700 1 -- 172.21.15.12:0/2962869166 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff0e40420d0 con 0x7ff0f4061680 2021-10-20T23:26:43.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.316+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff0f4057350 con 0x7ff0f4061680 2021-10-20T23:26:43.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.324+0000 7ff0f1ffb700 1 -- 172.21.15.12:0/2962869166 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff0e40456f0 con 0x7ff0f4061680 2021-10-20T23:26:43.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0d4053580 msgr2=0x7ff0d4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0d4053580 0x7ff0d4055a40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7ff0e800d000 tx=0x7ff0e8007b90).stop 2021-10-20T23:26:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f4061680 msgr2=0x7ff0f40b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f4061680 0x7ff0f40b27a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7ff0e4001110 tx=0x7ff0e4007ad0).stop 2021-10-20T23:26:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 shutdown_connections 2021-10-20T23:26:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0d4053580 0x7ff0d4055a40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0f4145110 0x7ff0f41455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f41439a0 0x7ff0f4152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 --2- 172.21.15.12:0/2962869166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0f4061680 0x7ff0f40b27a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 >> 172.21.15.12:0/2962869166 conn(0x7ff0f406adf0 msgr2=0x7ff0f41418e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:43.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 shutdown_connections 2021-10-20T23:26:43.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.328+0000 7ff0f98c3700 1 -- 172.21.15.12:0/2962869166 wait complete. 2021-10-20T23:26:43.356 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:26:43.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:43.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:43.401 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:43.423 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:43.449 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:26:43.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:43.450 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:43.450 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:43.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:26:43.474 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:26:43.474 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:26:43.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:43.477 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:43.477 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:43.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:26:43.488 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:26:43.488 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:26:43.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:26:43.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e5da6c700 1 Processor -- start 2021-10-20T23:26:43.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e5da6c700 1 -- start start 2021-10-20T23:26:43.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e5da6c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b4060 0x7f5e58061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e5da6c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e580b5f50 con 0x7f5e58142e60 2021-10-20T23:26:43.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e5da6c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e580b1f70 con 0x7f5e580b6290 2021-10-20T23:26:43.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e5da6c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580b2210 con 0x7f5e580b4060 2021-10-20T23:26:43.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e5d26b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5e58142e60 0x7f5e58143310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39998/0 (socket says 172.21.15.12:39998) 2021-10-20T23:26:43.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e5d26b700 1 -- 172.21.15.12:0/2510611823 learned_addr learned my addr 172.21.15.12:0/2510611823 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:43.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e57fff700 1 --2- 172.21.15.12:0/2510611823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b4060 0x7f5e58061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.592+0000 7f5e577fe700 1 -- 172.21.15.12:0/2510611823 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110005907 0 0) 0x7f5e48001110 con 0x7f5e58142e60 2021-10-20T23:26:43.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e577fe700 1 -- 172.21.15.12:0/2510611823 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e3c003260 con 0x7f5e58142e60 2021-10-20T23:26:43.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e57fff700 1 -- 172.21.15.12:0/2510611823 >> v1:172.21.15.31:6789/0 conn(0x7f5e580b6290 legacy=0x7f5e58061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e577fe700 1 -- 172.21.15.12:0/2510611823 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420298323 0 0) 0x7f5e580b1f70 con 0x7f5e580b6290 2021-10-20T23:26:43.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e57fff700 1 -- 172.21.15.12:0/2510611823 >> v1:172.21.15.12:6789/0 conn(0x7f5e58142e60 legacy=0x7f5e58143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e57fff700 1 -- 172.21.15.12:0/2510611823 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580b24b0 con 0x7f5e580b4060 2021-10-20T23:26:43.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e57fff700 1 --2- 172.21.15.12:0/2510611823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b4060 0x7f5e58061b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5e40002f70 tx=0x7f5e40006df0).ready entity=mon.2 client_cookie=eb9ebd0e56a4d584 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:43.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e577fe700 1 -- 172.21.15.12:0/2510611823 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e4000d570 con 0x7f5e580b4060 2021-10-20T23:26:43.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e577fe700 1 -- 172.21.15.12:0/2510611823 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40000e90 con 0x7f5e580b4060 2021-10-20T23:26:43.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e577fe700 1 -- 172.21.15.12:0/2510611823 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e4000d8c0 con 0x7f5e580b4060 2021-10-20T23:26:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e5da6c700 1 -- 172.21.15.12:0/2510611823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b4060 msgr2=0x7f5e58061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e5da6c700 1 --2- 172.21.15.12:0/2510611823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b4060 0x7f5e58061b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5e40002f70 tx=0x7f5e40006df0).stop 2021-10-20T23:26:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e5da6c700 1 -- 172.21.15.12:0/2510611823 shutdown_connections 2021-10-20T23:26:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e5da6c700 1 --2- 172.21.15.12:0/2510611823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b4060 0x7f5e58061b80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e5da6c700 1 -- 172.21.15.12:0/2510611823 >> 172.21.15.12:0/2510611823 conn(0x7f5e5805c490 msgr2=0x7f5e5805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e5da6c700 1 -- 172.21.15.12:0/2510611823 shutdown_connections 2021-10-20T23:26:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e5da6c700 1 -- 172.21.15.12:0/2510611823 wait complete. 2021-10-20T23:26:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e5da6c700 1 Processor -- start 2021-10-20T23:26:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.596+0000 7f5e5da6c700 1 -- start start 2021-10-20T23:26:43.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5da6c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e580b4060 0x7f5e580b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5da6c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b6290 0x7f5e581526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5da6c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e58142e60 0x7f5e5813ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5da6c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e581403b0 con 0x7f5e580b4060 2021-10-20T23:26:43.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5da6c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e58140650 con 0x7f5e58142e60 2021-10-20T23:26:43.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5da6c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5813e5a0 con 0x7f5e580b6290 2021-10-20T23:26:43.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5ca6a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e580b4060 0x7f5e580b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5ca6a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e580b4060 0x7f5e580b7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41406/0 (socket says 172.21.15.12:41406) 2021-10-20T23:26:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5ca6a700 1 -- 172.21.15.12:0/4060768753 learned_addr learned my addr 172.21.15.12:0/4060768753 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5d26b700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e58142e60 0x7f5e5813ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e57fff700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b6290 0x7f5e581526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5ca6a700 1 -- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b6290 msgr2=0x7f5e581526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5ca6a700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b6290 0x7f5e581526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5ca6a700 1 -- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e58142e60 msgr2=0x7f5e5813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5ca6a700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e58142e60 0x7f5e5813ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:43.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5ca6a700 1 -- 172.21.15.12:0/4060768753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4000b180 con 0x7f5e580b4060 2021-10-20T23:26:43.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5ca6a700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e580b4060 0x7f5e580b7ab0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f5e50001250 tx=0x7f5e50007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:43.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e55ffb700 1 -- 172.21.15.12:0/4060768753 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e5000e4a0 con 0x7f5e580b4060 2021-10-20T23:26:43.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e55ffb700 1 -- 172.21.15.12:0/4060768753 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5000e600 con 0x7f5e580b4060 2021-10-20T23:26:43.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5813e840 con 0x7f5e580b4060 2021-10-20T23:26:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e55ffb700 1 -- 172.21.15.12:0/4060768753 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e5000e960 con 0x7f5e580b4060 2021-10-20T23:26:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5813ffb0 con 0x7f5e580b4060 2021-10-20T23:26:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.600+0000 7f5e55ffb700 1 -- 172.21.15.12:0/4060768753 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5e50019030 con 0x7f5e580b4060 2021-10-20T23:26:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.604+0000 7f5e55ffb700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e300535b0 0x7f5e30055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.604+0000 7f5e55ffb700 1 -- 172.21.15.12:0/4060768753 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f5e5006adc0 con 0x7f5e580b4060 2021-10-20T23:26:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.604+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5813e9d0 con 0x7f5e580b4060 2021-10-20T23:26:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.604+0000 7f5e57fff700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e300535b0 0x7f5e30055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.604+0000 7f5e57fff700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e300535b0 0x7f5e30055a70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f5e4001a000 tx=0x7f5e40014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.608+0000 7f5e55ffb700 1 -- 172.21.15.12:0/4060768753 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5e50017030 con 0x7f5e580b4060 2021-10-20T23:26:43.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.736+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5e580b2750 con 0x7f5e580b4060 2021-10-20T23:26:43.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.736+0000 7f5e55ffb700 1 -- 172.21.15.12:0/4060768753 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v83) v1 ==== 81+0+29293 (secure 0 0 0) 0x7f5e50021090 con 0x7f5e580b4060 2021-10-20T23:26:43.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:43.748 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:26:43.748 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 83, 2021-10-20T23:26:43.748 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:26:43.748 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:26:43.749 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:26:41.025478+0000", 2021-10-20T23:26:43.749 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:26:43.749 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:26:43.749 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:26:43.750 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:26:43.750 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:26:43.750 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:26:43.750 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:26:43.750 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:26:43.751 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:26:43.751 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:43.751 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:26:43.751 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:26:43.752 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:26:43.752 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:26:43.752 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:26:43.753 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 14, 2021-10-20T23:26:43.753 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:26:43.754 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:26:43.754 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:26:43.754 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:26:43.754 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:26:43.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.755 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:26:43.755 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:26:43.755 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:26:43.755 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:43.756 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:43.756 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:43.757 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:43.757 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:43.757 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:43.757 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:43.757 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:43.759 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:26:43.759 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:26:43.759 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:26:43.759 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:26:43.760 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:26:43.760 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:43.760 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:43.760 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:43.760 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:43.761 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:43.761 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:43.761 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:43.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.762 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:26:43.762 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:43.762 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:43.762 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:43.762 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:43.763 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:43.763 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:43.763 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:43.763 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:43.764 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:43.764 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:43.765 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:43.765 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:43.765 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:43.766 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:43.766 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:43.766 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:43.767 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:43.767 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:43.767 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:43.767 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:43.768 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:43.768 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:43.768 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:43.769 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:43.769 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:43.769 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:43.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.769 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:43.770 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:43.770 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:43.770 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:43.770 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:43.771 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:43.771 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:43.771 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:43.771 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:43.771 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:43.772 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:43.772 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:26:43.772 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:26:43.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.772 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:43.773 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:26:43.773 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.774 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:26:43.776 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:26:43.776 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:26:43.777 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:43.777 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:43.777 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:43.777 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:43.778 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:43.778 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:43.778 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:43.779 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:43.779 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:26:43.780 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:26:43.781 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:26:43.781 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:26:43.782 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:26:43.782 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:43.783 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:43.783 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:43.784 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:43.784 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:43.785 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:43.786 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:43.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.787 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:26:43.788 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:43.788 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:43.789 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:43.789 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:43.790 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:43.790 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:43.791 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:43.791 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:43.791 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:43.792 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:43.792 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:43.793 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:43.793 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:43.794 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:43.794 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:43.794 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:43.795 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:43.795 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:43.796 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:43.796 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:43.797 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:43.797 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:43.797 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:43.798 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:43.798 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:43.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:43.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.800 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:43.801 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:43.801 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:43.801 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:43.801 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:43.802 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:43.802 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:43.802 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:43.802 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:43.802 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:43.803 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:43.803 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:26:43.803 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:43.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:26:43.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.804 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.804 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:43.804 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:26:43.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.805 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:26:43.805 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:26:43.805 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:43.805 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:43.805 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:43.806 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:43.806 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:43.806 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:43.806 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:43.806 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:43.807 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:43.807 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:43.807 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:43.807 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.808 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:26:43.808 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:43.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.809 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.809 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:26:43.810 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:43.810 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.810 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.811 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:43.811 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.812 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.812 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:26:43.812 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:43.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.813 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:26:43.813 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:43.813 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.814 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.814 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:43.814 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.815 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:26:43.815 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:43.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.816 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.816 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:26:43.816 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:43.816 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.817 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.817 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:43.817 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.818 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:26:43.818 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:43.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.819 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.819 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:26:43.819 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:43.819 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.820 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.820 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:26:43.820 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:26:43.821 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:26:43.821 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:26:43.821 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:43.821 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:43.821 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:43.822 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:26:43.823 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:26:43.823 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:43.823 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:43.823 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:43.824 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:43.824 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:43.824 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:43.824 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:43.825 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 66, 2021-10-20T23:26:43.825 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:43.825 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:43.825 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:43.826 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.826 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.826 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:26:43.827 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:43.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.827 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:26:43.828 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:43.828 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.828 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.829 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:43.829 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.829 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.829 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:26:43.830 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:43.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.831 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:26:43.831 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:43.831 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.832 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.832 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:43.832 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.833 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:26:43.833 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:43.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.834 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.834 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:26:43.834 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:43.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.835 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.835 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:43.836 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.837 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.837 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:26:43.837 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:43.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.838 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.838 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:26:43.838 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:43.839 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.839 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.839 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:26:43.839 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:26:43.840 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:26:43.840 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:26:43.840 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:43.840 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:43.841 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:43.841 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.842 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:26:43.842 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:26:43.842 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:43.842 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:43.843 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:43.843 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:43.843 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:43.843 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:43.843 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:43.844 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:43.844 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:43.844 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:43.844 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:43.844 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.845 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:26:43.845 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:43.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.846 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.846 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:26:43.846 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:43.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.847 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.847 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:43.847 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.848 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:26:43.848 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:43.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.849 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:26:43.849 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:43.849 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.850 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.850 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:43.850 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.851 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:26:43.851 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:43.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.852 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:26:43.852 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:43.853 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.853 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.854 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:43.854 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.854 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:26:43.855 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:43.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.856 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:26:43.856 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:43.856 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.856 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.857 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:26:43.858 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:26:43.858 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:26:43.858 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:26:43.858 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:43.859 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:43.859 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:43.859 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.860 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:26:43.860 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:26:43.860 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:43.860 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:43.860 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:43.861 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:43.861 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:43.861 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:43.861 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:43.862 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:43.862 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:43.862 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:43.862 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:43.863 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.863 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.863 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:26:43.864 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:43.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.864 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:26:43.865 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:43.865 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.865 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.866 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:43.866 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.867 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.867 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:26:43.867 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:43.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.868 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:26:43.868 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:43.868 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.868 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.869 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:43.869 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:26:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:26:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.872 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:43.872 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.873 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:26:43.873 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:43.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.874 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:26:43.874 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:43.874 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.875 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.875 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:26:43.875 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:26:43.876 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:26:43.876 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:26:43.876 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:43.876 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:43.876 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:43.877 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.877 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:26:43.878 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:26:43.878 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:43.878 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:43.879 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:43.879 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:43.879 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:43.879 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:43.880 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:43.880 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 75, 2021-10-20T23:26:43.880 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:43.880 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:43.880 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:43.881 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.881 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:26:43.881 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:43.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.882 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:26:43.883 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:43.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.883 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.883 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:43.884 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.884 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:26:43.884 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:43.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.885 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:26:43.886 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:43.886 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.886 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.887 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:43.888 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.889 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.889 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:26:43.889 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:43.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.891 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:26:43.891 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:43.892 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.892 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.893 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:43.893 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.894 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:26:43.895 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:43.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.896 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:26:43.897 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:43.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.898 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.898 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:26:43.899 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:26:43.899 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:26:43.899 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:26:43.900 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:43.900 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:43.900 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:43.900 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.901 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:26:43.901 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:26:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:26:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:26:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:26:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:43.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.915 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:26:43.915 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:43.915 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.916 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.916 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:43.917 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.918 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:26:43.918 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:43.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.920 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:26:43.920 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:43.921 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.921 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.922 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:43.922 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.923 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:26:43.924 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:43.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.925 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:26:43.925 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:43.926 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.926 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.927 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:26:43.927 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:26:43.928 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:26:43.928 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:26:43.928 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:43.928 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:43.929 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:43.929 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.930 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:26:43.930 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:26:43.931 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:43.931 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:43.931 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:43.931 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:43.932 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:43.932 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:43.932 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:43.932 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 76, 2021-10-20T23:26:43.933 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:43.933 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:43.933 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:43.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:26:43.934 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:43.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:26:43.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:43.936 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.936 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.937 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:43.937 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:26:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.939 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:26:43.939 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:43.939 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.939 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.940 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:43.940 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.941 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:26:43.941 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:43.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.942 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:26:43.942 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:43.942 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.942 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.943 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:43.943 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.944 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:26:43.944 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:43.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.945 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:26:43.945 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:43.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.945 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.946 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:26:43.946 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:26:43.946 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:26:43.946 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:26:43.947 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:43.947 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:43.947 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:43.947 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.948 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:26:43.948 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:26:43.948 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:43.949 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:43.949 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:43.949 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:43.949 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:43.949 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:43.950 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:43.950 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 75, 2021-10-20T23:26:43.950 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:43.950 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:43.951 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:43.951 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.951 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:26:43.952 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:43.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.952 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:26:43.953 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:43.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.953 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.953 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:43.954 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.954 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:26:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:26:43.956 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:43.956 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.956 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.956 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:43.957 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.957 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:26:43.958 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:43.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.958 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:26:43.959 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:43.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.960 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:43.960 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:43.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:43.961 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:26:43.961 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:43.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:43.962 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:26:43.962 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:43.962 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.962 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.963 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:26:43.963 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:26:43.963 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:26:43.964 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:26:43.964 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:43.964 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:43.964 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:43.965 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:43.965 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.965 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:43.965 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:26:43.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.966 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:26:43.966 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:43.966 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:43.966 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:43.967 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:43.967 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:43.967 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:26:43.967 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:43.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.974 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:26:43.974 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:43.984 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:43.984 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:43.984 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:43.984 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:43.985 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:26:43.985 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:43.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.986 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:26:43.986 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:43.987 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:43.987 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:43.987 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:43.987 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:43.988 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:26:43.988 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:43.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.988 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:26:43.989 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:43.989 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:43.989 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:43.989 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:43.990 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:43.990 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:26:43.990 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:43.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.991 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:26:43.991 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:43.991 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:43.991 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:43.991 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:43.992 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:43.992 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:26:43.992 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:43.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.993 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:26:43.993 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:43.993 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:43.993 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:43.994 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:43.994 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:43.994 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:26:43.994 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:43.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.995 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:26:43.995 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:43.995 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:43.996 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:43.996 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:43.996 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:43.996 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:26:43.996 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:43.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:43.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:43.997 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:26:43.997 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:43.998 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:43.998 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:43.998 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:43.998 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:43.998 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:26:43.999 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:26:43.999 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:43.999 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:43.999 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:26:44.000 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:26:44.000 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:26:44.000 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:26:44.000 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:26:44.000 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.31:6835/3651290992": "2021-10-21T23:26:37.845449+0000", 2021-10-20T23:26:44.001 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.31:6834/3651290992": "2021-10-21T23:26:37.845449+0000", 2021-10-20T23:26:44.001 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.119:0/1668581666": "2021-10-21T00:26:27.076701+0000" 2021-10-20T23:26:44.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:44.001 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:26:44.001 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:26:44.002 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:26:44.002 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:26:44.002 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:26:44.002 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:26:44.003 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:26:44.003 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:26:44.003 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:26:44.003 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:26:44.003 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:26:44.004 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:26:44.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:44.004 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:26:44.004 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:26:44.005 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:26:44.005 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:26:44.005 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:26:44.005 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:26:44.006 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:26:44.007 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:44.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:44.007 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:26:44.008 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:26:44.008 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:26:44.008 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:26:44.008 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:26:44.009 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:26:44.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e300535b0 msgr2=0x7f5e30055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e300535b0 0x7f5e30055a70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f5e4001a000 tx=0x7f5e40014000).stop 2021-10-20T23:26:44.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e580b4060 msgr2=0x7f5e580b7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e580b4060 0x7f5e580b7ab0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f5e50001250 tx=0x7f5e50007e40).stop 2021-10-20T23:26:44.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 shutdown_connections 2021-10-20T23:26:44.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e300535b0 0x7f5e30055a70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e58142e60 0x7f5e5813ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e580b6290 0x7f5e581526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 --2- 172.21.15.12:0/4060768753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e580b4060 0x7f5e580b7ab0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 >> 172.21.15.12:0/4060768753 conn(0x7f5e5805c490 msgr2=0x7f5e580b8980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:44.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 shutdown_connections 2021-10-20T23:26:44.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:43.740+0000 7f5e5da6c700 1 -- 172.21.15.12:0/4060768753 wait complete. 2021-10-20T23:26:44.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:44.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.120+0000 7fe91d2ab700 1 Processor -- start 2021-10-20T23:26:44.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.120+0000 7fe91d2ab700 1 -- start start 2021-10-20T23:26:44.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.120+0000 7fe91d2ab700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9180b0010 0x7fe9180a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.120+0000 7fe91d2ab700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9180afbd0 0x7fe9180a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.120+0000 7fe91d2ab700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9180a70c0 con 0x7fe9180b2580 2021-10-20T23:26:44.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.120+0000 7fe91d2ab700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9180a72f0 con 0x7fe9180afbd0 2021-10-20T23:26:44.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.120+0000 7fe91d2ab700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9180a7590 con 0x7fe9180b0010 2021-10-20T23:26:44.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.120+0000 7fe91caaa700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9180afbd0 0x7fe9180a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91caaa700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9180afbd0 0x7fe9180a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41418/0 (socket says 172.21.15.12:41418) 2021-10-20T23:26:44.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91caaa700 1 -- 172.21.15.12:0/1117641128 learned_addr learned my addr 172.21.15.12:0/1117641128 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:44.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe9177fe700 1 --2- 172.21.15.12:0/1117641128 >> v2:172.21.15.31:3300/0 conn(0x7fe9180b0010 0x7fe9180a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91caaa700 1 -- 172.21.15.12:0/1117641128 >> v2:172.21.15.31:3300/0 conn(0x7fe9180b0010 msgr2=0x7fe9180a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:44.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91caaa700 1 --2- 172.21.15.12:0/1117641128 >> v2:172.21.15.31:3300/0 conn(0x7fe9180b0010 0x7fe9180a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91caaa700 1 -- 172.21.15.12:0/1117641128 >> v1:172.21.15.31:6789/0 conn(0x7fe9180b2580 legacy=0x7fe91814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91caaa700 1 -- 172.21.15.12:0/1117641128 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9180a7830 con 0x7fe9180afbd0 2021-10-20T23:26:44.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91caaa700 1 --2- 172.21.15.12:0/1117641128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180afbd0 0x7fe9180a88a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7fe9100032f0 tx=0x7fe910009290).ready entity=mon.0 client_cookie=fb67eb48d974321e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:44.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe916ffd700 1 -- 172.21.15.12:0/1117641128 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91000b870 con 0x7fe9180afbd0 2021-10-20T23:26:44.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe916ffd700 1 -- 172.21.15.12:0/1117641128 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91000b9d0 con 0x7fe9180afbd0 2021-10-20T23:26:44.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe916ffd700 1 -- 172.21.15.12:0/1117641128 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91000bb40 con 0x7fe9180afbd0 2021-10-20T23:26:44.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1117641128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180afbd0 msgr2=0x7fe9180a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 --2- 172.21.15.12:0/1117641128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180afbd0 0x7fe9180a88a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7fe9100032f0 tx=0x7fe910009290).stop 2021-10-20T23:26:44.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1117641128 shutdown_connections 2021-10-20T23:26:44.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 --2- 172.21.15.12:0/1117641128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180afbd0 0x7fe9180a88a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 --2- 172.21.15.12:0/1117641128 >> v2:172.21.15.31:3300/0 conn(0x7fe9180b0010 0x7fe9180a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1117641128 >> 172.21.15.12:0/1117641128 conn(0x7fe918060180 msgr2=0x7fe9180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:44.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1117641128 shutdown_connections 2021-10-20T23:26:44.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1117641128 wait complete. 2021-10-20T23:26:44.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 Processor -- start 2021-10-20T23:26:44.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.124+0000 7fe91d2ab700 1 -- start start 2021-10-20T23:26:44.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91d2ab700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9180afbd0 0x7fe9180a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91d2ab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9180b0010 0x7fe9181464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91d2ab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180b2580 0x7fe918146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91d2ab700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180aabe0 con 0x7fe9180b2580 2021-10-20T23:26:44.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91d2ab700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180aae80 con 0x7fe9180b0010 2021-10-20T23:26:44.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91d2ab700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180ab120 con 0x7fe9180afbd0 2021-10-20T23:26:44.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91caaa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180b2580 0x7fe918146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91caaa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180b2580 0x7fe918146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41424/0 (socket says 172.21.15.12:41424) 2021-10-20T23:26:44.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91caaa700 1 -- 172.21.15.12:0/1713673027 learned_addr learned my addr 172.21.15.12:0/1713673027 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:44.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe917fff700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9180afbd0 0x7fe9180a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe9177fe700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9180b0010 0x7fe9181464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91caaa700 1 -- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9180afbd0 msgr2=0x7fe9180a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91caaa700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9180afbd0 0x7fe9180a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91caaa700 1 -- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9180b0010 msgr2=0x7fe9181464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91caaa700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9180b0010 0x7fe9181464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91caaa700 1 -- 172.21.15.12:0/1713673027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910009530 con 0x7fe9180b2580 2021-10-20T23:26:44.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91caaa700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180b2580 0x7fe918146990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fe9100032f0 tx=0x7fe910016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:44.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe9157fa700 1 -- 172.21.15.12:0/1713673027 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91000b870 con 0x7fe9180b2580 2021-10-20T23:26:44.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe9157fa700 1 -- 172.21.15.12:0/1713673027 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910021630 con 0x7fe9180b2580 2021-10-20T23:26:44.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9180ab3c0 con 0x7fe9180b2580 2021-10-20T23:26:44.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe9157fa700 1 -- 172.21.15.12:0/1713673027 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe910021990 con 0x7fe9180b2580 2021-10-20T23:26:44.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.128+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe918146e80 con 0x7fe9180b2580 2021-10-20T23:26:44.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.132+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9180ab550 con 0x7fe9180b2580 2021-10-20T23:26:44.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.132+0000 7fe9157fa700 1 -- 172.21.15.12:0/1713673027 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe910027020 con 0x7fe9180b2580 2021-10-20T23:26:44.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.132+0000 7fe9157fa700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8f8053610 0x7fe8f8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.132+0000 7fe9157fa700 1 -- 172.21.15.12:0/1713673027 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe91006cc20 con 0x7fe9180b2580 2021-10-20T23:26:44.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.132+0000 7fe917fff700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8f8053610 0x7fe8f8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.132+0000 7fe917fff700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8f8053610 0x7fe8f8055ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fe90c00d000 tx=0x7fe90c007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:44.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.140+0000 7fe9157fa700 1 -- 172.21.15.12:0/1713673027 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe910043e70 con 0x7fe9180b2580 2021-10-20T23:26:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.304+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe918057350 con 0x7fe9180b2580 2021-10-20T23:26:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.304+0000 7fe9157fa700 1 -- 172.21.15.12:0/1713673027 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fe910015020 con 0x7fe9180b2580 2021-10-20T23:26:44.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:44.315 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35},{"gid":6550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2598317962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2598317962},{"type":"v1","addr":"172.21.15.31:6835","nonce":2598317962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40}],"filesystems":[]} 2021-10-20T23:26:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8f8053610 msgr2=0x7fe8f8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8f8053610 0x7fe8f8055ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fe90c00d000 tx=0x7fe90c007b70).stop 2021-10-20T23:26:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180b2580 msgr2=0x7fe918146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180b2580 0x7fe918146990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fe9100032f0 tx=0x7fe910016000).stop 2021-10-20T23:26:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 shutdown_connections 2021-10-20T23:26:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe8f8053610 0x7fe8f8055ad0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180b2580 0x7fe918146990 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9180b0010 0x7fe9181464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 --2- 172.21.15.12:0/1713673027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9180afbd0 0x7fe9180a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 >> 172.21.15.12:0/1713673027 conn(0x7fe918060180 msgr2=0x7fe91814cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 shutdown_connections 2021-10-20T23:26:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.308+0000 7fe91d2ab700 1 -- 172.21.15.12:0/1713673027 wait complete. 2021-10-20T23:26:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2021-10-20T23:26:44.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:44.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1ab22700 1 Processor -- start 2021-10-20T23:26:44.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1ab22700 1 -- start start 2021-10-20T23:26:44.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1ab22700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e140b2580 0x7f4e1414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1ab22700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e140a8ac0 0x7f4e1414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1ab22700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e140a70c0 con 0x7f4e140b0010 2021-10-20T23:26:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1ab22700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140a72f0 con 0x7f4e140a8ac0 2021-10-20T23:26:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1ab22700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140a7590 con 0x7f4e140b2580 2021-10-20T23:26:44.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1a321700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e140a8ac0 0x7f4e1414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e19b20700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e140b2580 0x7f4e1414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1931f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4e140b0010 0x7f4e140a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:47086/0 (socket says 172.21.15.12:47086) 2021-10-20T23:26:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.424+0000 7f4e1931f700 1 -- 172.21.15.12:0/3927389864 learned_addr learned my addr 172.21.15.12:0/3927389864 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1a321700 1 -- 172.21.15.12:0/3927389864 >> v2:172.21.15.31:3300/0 conn(0x7f4e140b2580 msgr2=0x7f4e1414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:44.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1a321700 1 --2- 172.21.15.12:0/3927389864 >> v2:172.21.15.31:3300/0 conn(0x7f4e140b2580 0x7f4e1414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1a321700 1 -- 172.21.15.12:0/3927389864 >> v1:172.21.15.31:6789/0 conn(0x7f4e140b0010 legacy=0x7f4e140a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1a321700 1 -- 172.21.15.12:0/3927389864 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140a7830 con 0x7f4e140a8ac0 2021-10-20T23:26:44.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1a321700 1 --2- 172.21.15.12:0/3927389864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 0x7f4e1414b330 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f4e0c0032f0 tx=0x7f4e0c0091d0).ready entity=mon.0 client_cookie=be9ba5353e8af2ac server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:44.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e18b1e700 1 -- 172.21.15.12:0/3927389864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0c00b680 con 0x7f4e140a8ac0 2021-10-20T23:26:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e18b1e700 1 -- 172.21.15.12:0/3927389864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c00b7e0 con 0x7f4e140a8ac0 2021-10-20T23:26:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e18b1e700 1 -- 172.21.15.12:0/3927389864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0c00b950 con 0x7f4e140a8ac0 2021-10-20T23:26:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 -- 172.21.15.12:0/3927389864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 msgr2=0x7f4e1414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 --2- 172.21.15.12:0/3927389864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 0x7f4e1414b330 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f4e0c0032f0 tx=0x7f4e0c0091d0).stop 2021-10-20T23:26:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 -- 172.21.15.12:0/3927389864 shutdown_connections 2021-10-20T23:26:44.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 --2- 172.21.15.12:0/3927389864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 0x7f4e1414b330 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 --2- 172.21.15.12:0/3927389864 >> v2:172.21.15.31:3300/0 conn(0x7f4e140b2580 0x7f4e1414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 -- 172.21.15.12:0/3927389864 >> 172.21.15.12:0/3927389864 conn(0x7f4e14060180 msgr2=0x7f4e140b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:44.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 -- 172.21.15.12:0/3927389864 shutdown_connections 2021-10-20T23:26:44.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 -- 172.21.15.12:0/3927389864 wait complete. 2021-10-20T23:26:44.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 Processor -- start 2021-10-20T23:26:44.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.428+0000 7f4e1ab22700 1 -- start start 2021-10-20T23:26:44.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1ab22700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 0x7f4e14063a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1ab22700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e140b0010 0x7f4e140ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1ab22700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e140b2580 0x7f4e140661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1ab22700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14156fd0 con 0x7f4e140a8ac0 2021-10-20T23:26:44.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1ab22700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14063ef0 con 0x7f4e140b0010 2021-10-20T23:26:44.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1ab22700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14063000 con 0x7f4e140b2580 2021-10-20T23:26:44.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e19b20700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 0x7f4e14063a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e19b20700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 0x7f4e14063a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41434/0 (socket says 172.21.15.12:41434) 2021-10-20T23:26:44.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e19b20700 1 -- 172.21.15.12:0/4193533148 learned_addr learned my addr 172.21.15.12:0/4193533148 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:44.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1931f700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e140b0010 0x7f4e140ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1a321700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e140b2580 0x7f4e140661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e19b20700 1 -- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e140b2580 msgr2=0x7f4e140661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e19b20700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e140b2580 0x7f4e140661e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e19b20700 1 -- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e140b0010 msgr2=0x7f4e140ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e19b20700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e140b0010 0x7f4e140ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e19b20700 1 -- 172.21.15.12:0/4193533148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c009470 con 0x7f4e140a8ac0 2021-10-20T23:26:44.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1a321700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e140b2580 0x7f4e140661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:26:44.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e19b20700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 0x7f4e14063a00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f4e0400c000 tx=0x7f4e04006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:44.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e02ffd700 1 -- 172.21.15.12:0/4193533148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e04010780 con 0x7f4e140a8ac0 2021-10-20T23:26:44.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e02ffd700 1 -- 172.21.15.12:0/4193533148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e040108e0 con 0x7f4e140a8ac0 2021-10-20T23:26:44.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e14157200 con 0x7f4e140a8ac0 2021-10-20T23:26:44.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e02ffd700 1 -- 172.21.15.12:0/4193533148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e04010c40 con 0x7f4e140a8ac0 2021-10-20T23:26:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140abd50 con 0x7f4e140a8ac0 2021-10-20T23:26:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e02ffd700 1 -- 172.21.15.12:0/4193533148 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4e0401c460 con 0x7f4e140a8ac0 2021-10-20T23:26:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.432+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e14157400 con 0x7f4e140a8ac0 2021-10-20T23:26:44.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.436+0000 7f4e02ffd700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4df40536a0 0x7f4df4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.436+0000 7f4e02ffd700 1 -- 172.21.15.12:0/4193533148 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4e0406bc70 con 0x7f4e140a8ac0 2021-10-20T23:26:44.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.436+0000 7f4e1931f700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4df40536a0 0x7f4df4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.436+0000 7f4e1931f700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4df40536a0 0x7f4df4055b60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f4e1000d000 tx=0x7f4e10009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:44.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.440+0000 7f4e02ffd700 1 -- 172.21.15.12:0/4193533148 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4e04042db0 con 0x7f4e140a8ac0 2021-10-20T23:26:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.600+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e14057350 con 0x7f4e140a8ac0 2021-10-20T23:26:44.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e02ffd700 1 -- 172.21.15.12:0/4193533148 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f4e040463d0 con 0x7f4e140a8ac0 2021-10-20T23:26:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:44.612 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6222,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6834/2657379670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2657379670},{"type":"v1","addr":"172.21.15.12:6834","nonce":2657379670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3001264779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3001264779},{"type":"v1","addr":"172.21.15.12:6835","nonce":3001264779}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35},{"gid":6550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2598317962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2598317962},{"type":"v1","addr":"172.21.15.31:6835","nonce":2598317962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40}],"filesystems":[]} 2021-10-20T23:26:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4df40536a0 msgr2=0x7f4df4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4df40536a0 0x7f4df4055b60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f4e1000d000 tx=0x7f4e10009040).stop 2021-10-20T23:26:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 msgr2=0x7f4e14063a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 0x7f4e14063a00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f4e0400c000 tx=0x7f4e04006df0).stop 2021-10-20T23:26:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 shutdown_connections 2021-10-20T23:26:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4df40536a0 0x7f4df4055b60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e140b2580 0x7f4e140661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e140b0010 0x7f4e140ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 --2- 172.21.15.12:0/4193533148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e140a8ac0 0x7f4e14063a00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 >> 172.21.15.12:0/4193533148 conn(0x7f4e14060180 msgr2=0x7f4e14067410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 shutdown_connections 2021-10-20T23:26:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.604+0000 7f4e1ab22700 1 -- 172.21.15.12:0/4193533148 wait complete. 2021-10-20T23:26:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2021-10-20T23:26:44.629 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:26:44.630 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:26:44.631 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:26:44.631 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:26:44.631 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:26:44.632 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:26:44.632 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:26:44.633 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:26:44.633 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:26:44.633 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:26:44.633 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:26:44.634 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:26:44.644 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:26:44.645 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:26:44.646 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:26:44.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:26:44.648 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:26:44.648 DEBUG:teuthology.parallel:result is None 2021-10-20T23:26:44.650 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:26:44.650 DEBUG:teuthology.parallel:result is None 2021-10-20T23:26:44.651 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:26:44.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:26:44.654 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:26:44.654 DEBUG:teuthology.parallel:result is None 2021-10-20T23:26:44.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:26:44.712 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:26:44.727 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:26:44.732 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:26:44.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9ed07ad700 1 Processor -- start 2021-10-20T23:26:44.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9ed07ad700 1 -- start start 2021-10-20T23:26:44.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9ed07ad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 0x7f9ec80abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9ed07ad700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ec8141db0 0x7f9ec80ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9ed07ad700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec80ac7e0 con 0x7f9ec80affd0 2021-10-20T23:26:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9ed07ad700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec8145250 con 0x7f9ec8141db0 2021-10-20T23:26:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9ed07ad700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81454f0 con 0x7f9ec80b2200 2021-10-20T23:26:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9eced4a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ec8141db0 0x7f9ec80ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9eced4a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ec8141db0 0x7f9ec80ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41470/0 (socket says 172.21.15.12:41470) 2021-10-20T23:26:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9eced4a700 1 -- 172.21.15.12:0/3887113985 learned_addr learned my addr 172.21.15.12:0/3887113985 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9ece549700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 0x7f9ec80abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9eced4a700 1 -- 172.21.15.12:0/3887113985 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 msgr2=0x7f9ec80abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9eced4a700 1 --2- 172.21.15.12:0/3887113985 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 0x7f9ec80abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9eced4a700 1 -- 172.21.15.12:0/3887113985 >> v1:172.21.15.12:6789/0 conn(0x7f9ec80affd0 legacy=0x7f9ec81416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9eced4a700 1 -- 172.21.15.12:0/3887113985 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec8141200 con 0x7f9ec8141db0 2021-10-20T23:26:44.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.740+0000 7f9eced4a700 1 --2- 172.21.15.12:0/3887113985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec8141db0 0x7f9ec80ac2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f9eb8002f70 tx=0x7f9eb8006eb0).ready entity=mon.0 client_cookie=6ad4902b27396341 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:44.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.744+0000 7f9ecd547700 1 -- 172.21.15.12:0/3887113985 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eb800d570 con 0x7f9ec8141db0 2021-10-20T23:26:44.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.744+0000 7f9ecd547700 1 -- 172.21.15.12:0/3887113985 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8000e90 con 0x7f9ec8141db0 2021-10-20T23:26:44.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.744+0000 7f9ecd547700 1 -- 172.21.15.12:0/3887113985 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eb800d900 con 0x7f9ec8141db0 2021-10-20T23:26:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 -- 172.21.15.12:0/3887113985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec8141db0 msgr2=0x7f9ec80ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 --2- 172.21.15.12:0/3887113985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec8141db0 0x7f9ec80ac2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f9eb8002f70 tx=0x7f9eb8006eb0).stop 2021-10-20T23:26:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 -- 172.21.15.12:0/3887113985 shutdown_connections 2021-10-20T23:26:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 --2- 172.21.15.12:0/3887113985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec8141db0 0x7f9ec80ac2f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 --2- 172.21.15.12:0/3887113985 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 0x7f9ec80abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 -- 172.21.15.12:0/3887113985 >> 172.21.15.12:0/3887113985 conn(0x7f9ec805f6b0 msgr2=0x7f9ec805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 -- 172.21.15.12:0/3887113985 shutdown_connections 2021-10-20T23:26:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 -- 172.21.15.12:0/3887113985 wait complete. 2021-10-20T23:26:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 Processor -- start 2021-10-20T23:26:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.748+0000 7f9ed07ad700 1 -- start start 2021-10-20T23:26:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ed07ad700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec80affd0 0x7f9ec813de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ed07ad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 0x7f9ec80b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ed07ad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec8141db0 0x7f9ec81528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ed07ad700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8150610 con 0x7f9ec80affd0 2021-10-20T23:26:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ed07ad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec813d790 con 0x7f9ec8141db0 2021-10-20T23:26:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ed07ad700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8144dc0 con 0x7f9ec80b2200 2021-10-20T23:26:44.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ece549700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec80affd0 0x7f9ec813de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ece549700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec80affd0 0x7f9ec813de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41472/0 (socket says 172.21.15.12:41472) 2021-10-20T23:26:44.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ece549700 1 -- 172.21.15.12:0/2195422498 learned_addr learned my addr 172.21.15.12:0/2195422498 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:44.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9eced4a700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec8141db0 0x7f9ec81528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ecdd48700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 0x7f9ec80b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ece549700 1 -- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 msgr2=0x7f9ec80b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ece549700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 0x7f9ec80b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ece549700 1 -- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec8141db0 msgr2=0x7f9ec81528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ece549700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec8141db0 0x7f9ec81528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ece549700 1 -- 172.21.15.12:0/2195422498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb800b1e0 con 0x7f9ec80affd0 2021-10-20T23:26:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ece549700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec80affd0 0x7f9ec813de90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f9ec8144f50 tx=0x7f9ec00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9eb77fe700 1 -- 172.21.15.12:0/2195422498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec000ee60 con 0x7f9ec80affd0 2021-10-20T23:26:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9eb77fe700 1 -- 172.21.15.12:0/2195422498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec000c850 con 0x7f9ec80affd0 2021-10-20T23:26:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9eb77fe700 1 -- 172.21.15.12:0/2195422498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec000cbb0 con 0x7f9ec80affd0 2021-10-20T23:26:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec80b45c0 con 0x7f9ec80affd0 2021-10-20T23:26:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec813d9f0 con 0x7f9ec80affd0 2021-10-20T23:26:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec8057350 con 0x7f9ec80affd0 2021-10-20T23:26:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9eb77fe700 1 -- 172.21.15.12:0/2195422498 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ec0022070 con 0x7f9ec80affd0 2021-10-20T23:26:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.752+0000 7f9eb77fe700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9ea8053580 0x7f9ea8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.756+0000 7f9eb77fe700 1 -- 172.21.15.12:0/2195422498 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9ec006bd10 con 0x7f9ec80affd0 2021-10-20T23:26:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.756+0000 7f9ecdd48700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9ea8053580 0x7f9ea8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.756+0000 7f9ecdd48700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9ea8053580 0x7f9ea8055a40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f9ec400d000 tx=0x7f9ec4000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.760+0000 7f9eb77fe700 1 -- 172.21.15.12:0/2195422498 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ec0042fc0 con 0x7f9ec80affd0 2021-10-20T23:26:44.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:44.896+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9ec80b0560 con 0x7f9ec80affd0 2021-10-20T23:26:45.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.748+0000 7f9eb77fe700 1 -- 172.21.15.12:0/2195422498 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ec00465e0 con 0x7f9ec80affd0 2021-10-20T23:26:45.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9ea8053580 msgr2=0x7f9ea8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:45.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9ea8053580 0x7f9ea8055a40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f9ec400d000 tx=0x7f9ec4000bc0).stop 2021-10-20T23:26:45.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec80affd0 msgr2=0x7f9ec813de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:45.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec80affd0 0x7f9ec813de90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f9ec8144f50 tx=0x7f9ec00091d0).stop 2021-10-20T23:26:45.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 shutdown_connections 2021-10-20T23:26:45.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9ea8053580 0x7f9ea8055a40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:45.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec8141db0 0x7f9ec81528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:45.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ec80b2200 0x7f9ec80b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:45.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 --2- 172.21.15.12:0/2195422498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ec80affd0 0x7f9ec813de90 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:45.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 >> 172.21.15.12:0/2195422498 conn(0x7f9ec805f6b0 msgr2=0x7f9ec80ab330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:45.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 shutdown_connections 2021-10-20T23:26:45.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.752+0000 7f9ed07ad700 1 -- 172.21.15.12:0/2195422498 wait complete. 2021-10-20T23:26:45.766 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:26:45.779 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:26:45.780 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:26:45.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 Processor -- start 2021-10-20T23:26:45.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 -- start start 2021-10-20T23:26:45.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240b6900 0x7ff9240acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:45.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9240aa5d0 0x7ff92413c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:45.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9240b6ce0 con 0x7ff924060910 2021-10-20T23:26:45.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9240611e0 con 0x7ff9240aa5d0 2021-10-20T23:26:45.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff924061480 con 0x7ff9240b6900 2021-10-20T23:26:45.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9237fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9240aa5d0 0x7ff92413c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:45.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9237fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9240aa5d0 0x7ff92413c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41484/0 (socket says 172.21.15.12:41484) 2021-10-20T23:26:45.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff91bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff924060910 0x7ff9240a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40080/0 (socket says 172.21.15.12:40080) 2021-10-20T23:26:45.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9237fe700 1 -- 172.21.15.12:0/4044702166 learned_addr learned my addr 172.21.15.12:0/4044702166 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:45.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff922ffd700 1 --2- 172.21.15.12:0/4044702166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240b6900 0x7ff9240acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:45.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9237fe700 1 -- 172.21.15.12:0/4044702166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240b6900 msgr2=0x7ff9240acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:45.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9237fe700 1 --2- 172.21.15.12:0/4044702166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240b6900 0x7ff9240acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:45.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9237fe700 1 -- 172.21.15.12:0/4044702166 >> v1:172.21.15.12:6789/0 conn(0x7ff924060910 legacy=0x7ff9240a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:45.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9227fc700 1 -- 172.21.15.12:0/4044702166 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144273145 0 0) 0x7ff9240b6ce0 con 0x7ff924060910 2021-10-20T23:26:45.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9237fe700 1 -- 172.21.15.12:0/4044702166 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924061720 con 0x7ff9240aa5d0 2021-10-20T23:26:45.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9237fe700 1 --2- 172.21.15.12:0/4044702166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240aa5d0 0x7ff92413c470 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7ff91c0032f0 tx=0x7ff91c009290).ready entity=mon.0 client_cookie=125588f911d1576f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:45.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9227fc700 1 -- 172.21.15.12:0/4044702166 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff91c00b8a0 con 0x7ff9240aa5d0 2021-10-20T23:26:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9227fc700 1 -- 172.21.15.12:0/4044702166 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00ba00 con 0x7ff9240aa5d0 2021-10-20T23:26:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff9227fc700 1 -- 172.21.15.12:0/4044702166 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff91c00bb70 con 0x7ff9240aa5d0 2021-10-20T23:26:45.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 -- 172.21.15.12:0/4044702166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240aa5d0 msgr2=0x7ff92413c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:45.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 --2- 172.21.15.12:0/4044702166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240aa5d0 0x7ff92413c470 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7ff91c0032f0 tx=0x7ff91c009290).stop 2021-10-20T23:26:45.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 -- 172.21.15.12:0/4044702166 shutdown_connections 2021-10-20T23:26:45.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 --2- 172.21.15.12:0/4044702166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240aa5d0 0x7ff92413c470 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 --2- 172.21.15.12:0/4044702166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240b6900 0x7ff9240acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.884+0000 7ff929519700 1 -- 172.21.15.12:0/4044702166 >> 172.21.15.12:0/4044702166 conn(0x7ff9240b3480 msgr2=0x7ff9240b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 -- 172.21.15.12:0/4044702166 shutdown_connections 2021-10-20T23:26:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 -- 172.21.15.12:0/4044702166 wait complete. 2021-10-20T23:26:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 Processor -- start 2021-10-20T23:26:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 -- start start 2021-10-20T23:26:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff924060910 0x7ff9241312b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240aa5d0 0x7ff92412f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240b6900 0x7ff92412fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240aea00 con 0x7ff9240b6900 2021-10-20T23:26:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92405efa0 con 0x7ff924060910 2021-10-20T23:26:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff929519700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9241414d0 con 0x7ff9240aa5d0 2021-10-20T23:26:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff9237fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240b6900 0x7ff92412fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff9237fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240b6900 0x7ff92412fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41492/0 (socket says 172.21.15.12:41492) 2021-10-20T23:26:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff9237fe700 1 -- 172.21.15.12:0/646301272 learned_addr learned my addr 172.21.15.12:0/646301272 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff922ffd700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff924060910 0x7ff9241312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:45.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff91bfff700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240aa5d0 0x7ff92412f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:45.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff9237fe700 1 -- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240aa5d0 msgr2=0x7ff92412f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:45.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.888+0000 7ff9237fe700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240aa5d0 0x7ff92412f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:45.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff9237fe700 1 -- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff924060910 msgr2=0x7ff9241312b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:45.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff9237fe700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff924060910 0x7ff9241312b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:45.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff9237fe700 1 -- 172.21.15.12:0/646301272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c009530 con 0x7ff9240b6900 2021-10-20T23:26:45.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff922ffd700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff924060910 0x7ff9241312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff91bfff700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240aa5d0 0x7ff92412f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff9237fe700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240b6900 0x7ff92412fac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7ff9240af7a0 tx=0x7ff91c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff920ff9700 1 -- 172.21.15.12:0/646301272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff91c00b8a0 con 0x7ff9240b6900 2021-10-20T23:26:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff920ff9700 1 -- 172.21.15.12:0/646301272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c021630 con 0x7ff9240b6900 2021-10-20T23:26:45.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9240aebf0 con 0x7ff9240b6900 2021-10-20T23:26:45.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff920ff9700 1 -- 172.21.15.12:0/646301272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff91c021990 con 0x7ff9240b6900 2021-10-20T23:26:45.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff924131a20 con 0x7ff9240b6900 2021-10-20T23:26:45.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9240619c0 con 0x7ff9240b6900 2021-10-20T23:26:45.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff920ff9700 1 -- 172.21.15.12:0/646301272 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff91c027020 con 0x7ff9240b6900 2021-10-20T23:26:45.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff920ff9700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9080536a0 0x7ff908055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:45.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff920ff9700 1 -- 172.21.15.12:0/646301272 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ff91c06c9c0 con 0x7ff9240b6900 2021-10-20T23:26:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.892+0000 7ff922ffd700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9080536a0 0x7ff908055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.896+0000 7ff922ffd700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9080536a0 0x7ff908055b60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7ff91400b000 tx=0x7ff914006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:45.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:45.900+0000 7ff920ff9700 1 -- 172.21.15.12:0/646301272 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff91c043d40 con 0x7ff9240b6900 2021-10-20T23:26:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.072+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff924057350 con 0x7ff9240b6900 2021-10-20T23:26:46.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff920ff9700 1 -- 172.21.15.12:0/646301272 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+4255 (secure 0 0 0) 0x7ff91c015070 con 0x7ff9240b6900 2021-10-20T23:26:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:46.084 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:26:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:26:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:26:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:26:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:26:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:26:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:26:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:26:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:26:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:26:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:26:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:26:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:26:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:26:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:26:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:26:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:26:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:26:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:26:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:26:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:26:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:26:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:26:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:26:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:26:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:26:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:26:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:26:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:26:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:26:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:26:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:26:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:26:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:26:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:26:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:26:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:26:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:26:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:26:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:26:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:26:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:26:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:26:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:26:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:26:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:26:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:26:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:26:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:26:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:26:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:26:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:26:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:26:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9080536a0 msgr2=0x7ff908055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9080536a0 0x7ff908055b60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7ff91400b000 tx=0x7ff914006df0).stop 2021-10-20T23:26:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240b6900 msgr2=0x7ff92412fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240b6900 0x7ff92412fac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7ff9240af7a0 tx=0x7ff91c016000).stop 2021-10-20T23:26:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 shutdown_connections 2021-10-20T23:26:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff9080536a0 0x7ff908055b60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9240b6900 0x7ff92412fac0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9240aa5d0 0x7ff92412f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 --2- 172.21.15.12:0/646301272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff924060910 0x7ff9241312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 >> 172.21.15.12:0/646301272 conn(0x7ff9240b3480 msgr2=0x7ff92413bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 shutdown_connections 2021-10-20T23:26:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.076+0000 7ff929519700 1 -- 172.21.15.12:0/646301272 wait complete. 2021-10-20T23:26:46.132 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:26:46.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.228+0000 7fb20aa73700 1 Processor -- start 2021-10-20T23:26:46.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.228+0000 7fb20aa73700 1 -- start start 2021-10-20T23:26:46.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.228+0000 7fb20aa73700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb2040a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.228+0000 7fb20aa73700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb2040afbd0 0x7fb2040a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.228+0000 7fb20aa73700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040a70c0 con 0x7fb2040b2580 2021-10-20T23:26:46.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.228+0000 7fb20aa73700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040a72f0 con 0x7fb2040afbd0 2021-10-20T23:26:46.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.228+0000 7fb20aa73700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040a7590 con 0x7fb2040b0010 2021-10-20T23:26:46.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb209270700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb2040a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20a272700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb2040afbd0 0x7fb2040a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb209270700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb2040a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:47256/0 (socket says 172.21.15.12:47256) 2021-10-20T23:26:46.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb209270700 1 -- 172.21.15.12:0/1107435039 learned_addr learned my addr 172.21.15.12:0/1107435039 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:46.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb209a71700 1 --1- 172.21.15.12:0/1107435039 >> v1:172.21.15.31:6789/0 conn(0x7fb2040b2580 0x7fb20414ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:47158/0 (socket says 172.21.15.12:47158) 2021-10-20T23:26:46.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb209270700 1 -- 172.21.15.12:0/1107435039 >> v2:172.21.15.31:3300/0 conn(0x7fb2040afbd0 msgr2=0x7fb2040a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:46.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb209270700 1 --2- 172.21.15.12:0/1107435039 >> v2:172.21.15.31:3300/0 conn(0x7fb2040afbd0 0x7fb2040a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb209270700 1 -- 172.21.15.12:0/1107435039 >> v1:172.21.15.31:6789/0 conn(0x7fb2040b2580 legacy=0x7fb20414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb209270700 1 -- 172.21.15.12:0/1107435039 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2040a7830 con 0x7fb2040b0010 2021-10-20T23:26:46.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb209270700 1 --2- 172.21.15.12:0/1107435039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb2040a83b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb2000032f0 tx=0x7fb200009290).ready entity=mon.2 client_cookie=47a8183fbb00d0f4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:46.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb208a6f700 1 -- 172.21.15.12:0/1107435039 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb20000b8a0 con 0x7fb2040b0010 2021-10-20T23:26:46.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb208a6f700 1 -- 172.21.15.12:0/1107435039 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20000ba00 con 0x7fb2040b0010 2021-10-20T23:26:46.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb208a6f700 1 -- 172.21.15.12:0/1107435039 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb20000bb70 con 0x7fb2040b0010 2021-10-20T23:26:46.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 -- 172.21.15.12:0/1107435039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 msgr2=0x7fb2040a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 --2- 172.21.15.12:0/1107435039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb2040a83b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb2000032f0 tx=0x7fb200009290).stop 2021-10-20T23:26:46.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 -- 172.21.15.12:0/1107435039 shutdown_connections 2021-10-20T23:26:46.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 --2- 172.21.15.12:0/1107435039 >> v2:172.21.15.31:3300/0 conn(0x7fb2040afbd0 0x7fb2040a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 --2- 172.21.15.12:0/1107435039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb2040a83b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 -- 172.21.15.12:0/1107435039 >> 172.21.15.12:0/1107435039 conn(0x7fb204060180 msgr2=0x7fb2040b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:46.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 -- 172.21.15.12:0/1107435039 shutdown_connections 2021-10-20T23:26:46.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 -- 172.21.15.12:0/1107435039 wait complete. 2021-10-20T23:26:46.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 Processor -- start 2021-10-20T23:26:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.232+0000 7fb20aa73700 1 -- start start 2021-10-20T23:26:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20aa73700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2040afbd0 0x7fb2040ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20aa73700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb204064ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20aa73700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2040b2580 0x7fb2040653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20aa73700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040658c0 con 0x7fb2040afbd0 2021-10-20T23:26:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20aa73700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040ab7a0 con 0x7fb2040b2580 2021-10-20T23:26:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20aa73700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040aa850 con 0x7fb2040b0010 2021-10-20T23:26:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209a71700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2040afbd0 0x7fb2040ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209270700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb204064ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209a71700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2040afbd0 0x7fb2040ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41506/0 (socket says 172.21.15.12:41506) 2021-10-20T23:26:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209a71700 1 -- 172.21.15.12:0/1975754227 learned_addr learned my addr 172.21.15.12:0/1975754227 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20a272700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2040b2580 0x7fb2040653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209270700 1 -- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2040b2580 msgr2=0x7fb2040653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209270700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2040b2580 0x7fb2040653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209270700 1 -- 172.21.15.12:0/1975754227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2040afbd0 msgr2=0x7fb2040ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209270700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2040afbd0 0x7fb2040ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209270700 1 -- 172.21.15.12:0/1975754227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200009530 con 0x7fb2040b0010 2021-10-20T23:26:46.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20a272700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2040b2580 0x7fb2040653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:46.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb209270700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb204064ee0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb204065a00 tx=0x7fb200016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:46.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb1f2ffd700 1 -- 172.21.15.12:0/1975754227 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb20000b8a0 con 0x7fb2040b0010 2021-10-20T23:26:46.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb1f2ffd700 1 -- 172.21.15.12:0/1975754227 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb200021630 con 0x7fb2040b0010 2021-10-20T23:26:46.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb1f2ffd700 1 -- 172.21.15.12:0/1975754227 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb200021990 con 0x7fb2040b0010 2021-10-20T23:26:46.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2040aaaf0 con 0x7fb2040b0010 2021-10-20T23:26:46.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.236+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2040ac600 con 0x7fb2040b0010 2021-10-20T23:26:46.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.240+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb204057350 con 0x7fb2040b0010 2021-10-20T23:26:46.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.240+0000 7fb1f2ffd700 1 -- 172.21.15.12:0/1975754227 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb200028070 con 0x7fb2040b0010 2021-10-20T23:26:46.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.240+0000 7fb1f2ffd700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1e40536d0 0x7fb1e4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.240+0000 7fb1f2ffd700 1 -- 172.21.15.12:0/1975754227 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fb20006c7b0 con 0x7fb2040b0010 2021-10-20T23:26:46.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.240+0000 7fb209a71700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1e40536d0 0x7fb1e4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.240+0000 7fb209a71700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1e40536d0 0x7fb1e4055b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fb1f400d000 tx=0x7fb1f4000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.248+0000 7fb1f2ffd700 1 -- 172.21.15.12:0/1975754227 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb200043a20 con 0x7fb2040b0010 2021-10-20T23:26:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.384+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2040aae70 con 0x7fb2040b0010 2021-10-20T23:26:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.384+0000 7fb1f2ffd700 1 -- 172.21.15.12:0/1975754227 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+13415 (secure 0 0 0) 0x7fb200015070 con 0x7fb2040b0010 2021-10-20T23:26:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:46.401 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:26:45.745898+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:26:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1e40536d0 msgr2=0x7fb1e4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1e40536d0 0x7fb1e4055b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fb1f400d000 tx=0x7fb1f4000bc0).stop 2021-10-20T23:26:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 msgr2=0x7fb204064ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb204064ee0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb204065a00 tx=0x7fb200016000).stop 2021-10-20T23:26:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 shutdown_connections 2021-10-20T23:26:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1e40536d0 0x7fb1e4055b90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2040b2580 0x7fb2040653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2040b0010 0x7fb204064ee0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 --2- 172.21.15.12:0/1975754227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2040afbd0 0x7fb2040ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 >> 172.21.15.12:0/1975754227 conn(0x7fb204060180 msgr2=0x7fb20414b910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 shutdown_connections 2021-10-20T23:26:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.388+0000 7fb20aa73700 1 -- 172.21.15.12:0/1975754227 wait complete. 2021-10-20T23:26:46.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:26:46.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:26:46.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a1240700 1 Processor -- start 2021-10-20T23:26:46.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a1240700 1 -- start start 2021-10-20T23:26:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a1240700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f039c0a8ac0 0x7f039c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a1240700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c0a70c0 con 0x7f039c0b0010 2021-10-20T23:26:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a1240700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c0a72f0 con 0x7f039c0b2580 2021-10-20T23:26:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a1240700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c0a7590 con 0x7f039c0a8ac0 2021-10-20T23:26:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a0a3f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f039c0a8ac0 0x7f039c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f039b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f039c0b0010 0x7f039c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40106/0 (socket says 172.21.15.12:40106) 2021-10-20T23:26:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f039b7fe700 1 -- 172.21.15.12:0/173233934 learned_addr learned my addr 172.21.15.12:0/173233934 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a0a3f700 1 -- 172.21.15.12:0/173233934 >> v1:172.21.15.31:6789/0 conn(0x7f039c0b2580 legacy=0x7f039c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a0a3f700 1 -- 172.21.15.12:0/173233934 >> v1:172.21.15.12:6789/0 conn(0x7f039c0b0010 legacy=0x7f039c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a0a3f700 1 -- 172.21.15.12:0/173233934 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c0a7830 con 0x7f039c0a8ac0 2021-10-20T23:26:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f03a0a3f700 1 --2- 172.21.15.12:0/173233934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 0x7f039c152be0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f03940032f0 tx=0x7f03940091d0).ready entity=mon.0 client_cookie=2bea53201a461798 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.508+0000 7f039affd700 1 -- 172.21.15.12:0/173233934 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039400b8a0 con 0x7f039c0a8ac0 2021-10-20T23:26:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f039affd700 1 -- 172.21.15.12:0/173233934 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039400ba00 con 0x7f039c0a8ac0 2021-10-20T23:26:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f039affd700 1 -- 172.21.15.12:0/173233934 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039400bb70 con 0x7f039c0a8ac0 2021-10-20T23:26:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 -- 172.21.15.12:0/173233934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 msgr2=0x7f039c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 --2- 172.21.15.12:0/173233934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 0x7f039c152be0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f03940032f0 tx=0x7f03940091d0).stop 2021-10-20T23:26:46.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 -- 172.21.15.12:0/173233934 shutdown_connections 2021-10-20T23:26:46.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 --2- 172.21.15.12:0/173233934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 0x7f039c152be0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 -- 172.21.15.12:0/173233934 >> 172.21.15.12:0/173233934 conn(0x7f039c060180 msgr2=0x7f039c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:46.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 -- 172.21.15.12:0/173233934 shutdown_connections 2021-10-20T23:26:46.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 -- 172.21.15.12:0/173233934 wait complete. 2021-10-20T23:26:46.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 Processor -- start 2021-10-20T23:26:46.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 -- start start 2021-10-20T23:26:46.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 0x7f039c14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f039c0b0010 0x7f039c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f039c0b2580 0x7f039c15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c156580 con 0x7f039c0a8ac0 2021-10-20T23:26:46.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0abee0 con 0x7f039c0b2580 2021-10-20T23:26:46.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.512+0000 7f03a1240700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0ac650 con 0x7f039c0b0010 2021-10-20T23:26:46.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 0x7f039c14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 0x7f039c14a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41518/0 (socket says 172.21.15.12:41518) 2021-10-20T23:26:46.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039bfff700 1 -- 172.21.15.12:0/1534882202 learned_addr learned my addr 172.21.15.12:0/1534882202 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:46.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039b7fe700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f039c0b0010 0x7f039c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03a0a3f700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f039c0b2580 0x7f039c15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039bfff700 1 -- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f039c0b0010 msgr2=0x7f039c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039bfff700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f039c0b0010 0x7f039c159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039bfff700 1 -- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f039c0b2580 msgr2=0x7f039c15a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039bfff700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f039c0b2580 0x7f039c15a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039bfff700 1 -- 172.21.15.12:0/1534882202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394009470 con 0x7f039c0a8ac0 2021-10-20T23:26:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03a0a3f700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f039c0b2580 0x7f039c15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039bfff700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 0x7f039c14a8a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f039c0653f0 tx=0x7f0390007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03997fa700 1 -- 172.21.15.12:0/1534882202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0390007e70 con 0x7f039c0a8ac0 2021-10-20T23:26:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03997fa700 1 -- 172.21.15.12:0/1534882202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0390007030 con 0x7f039c0a8ac0 2021-10-20T23:26:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039c0ac110 con 0x7f039c0a8ac0 2021-10-20T23:26:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03997fa700 1 -- 172.21.15.12:0/1534882202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0390007390 con 0x7f039c0a8ac0 2021-10-20T23:26:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039c066d60 con 0x7f039c0a8ac0 2021-10-20T23:26:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03997fa700 1 -- 172.21.15.12:0/1534882202 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0390010030 con 0x7f039c0a8ac0 2021-10-20T23:26:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039c159ba0 con 0x7f039c0a8ac0 2021-10-20T23:26:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03997fa700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f037c0536a0 0x7f037c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f03997fa700 1 -- 172.21.15.12:0/1534882202 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f039006b340 con 0x7f039c0a8ac0 2021-10-20T23:26:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.516+0000 7f039b7fe700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f037c0536a0 0x7f037c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.520+0000 7f039b7fe700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f037c0536a0 0x7f037c055b60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f038c00d000 tx=0x7f038c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.524+0000 7f03997fa700 1 -- 172.21.15.12:0/1534882202 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f03900425e0 con 0x7f039c0a8ac0 2021-10-20T23:26:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.648+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f039c057350 con 0x7f039c0a8ac0 2021-10-20T23:26:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.648+0000 7f03997fa700 1 -- 172.21.15.12:0/1534882202 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v87) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0390045c00 con 0x7f039c0a8ac0 2021-10-20T23:26:46.659 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:26:46.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f037c0536a0 msgr2=0x7f037c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f037c0536a0 0x7f037c055b60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f038c00d000 tx=0x7f038c009040).stop 2021-10-20T23:26:46.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 msgr2=0x7f039c14a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 0x7f039c14a8a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f039c0653f0 tx=0x7f0390007c00).stop 2021-10-20T23:26:46.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 shutdown_connections 2021-10-20T23:26:46.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f037c0536a0 0x7f037c055b60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f039c0b2580 0x7f039c15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f039c0b0010 0x7f039c159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 --2- 172.21.15.12:0/1534882202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f039c0a8ac0 0x7f039c14a8a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 >> 172.21.15.12:0/1534882202 conn(0x7f039c060180 msgr2=0x7f039c0aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:46.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 shutdown_connections 2021-10-20T23:26:46.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.652+0000 7f03a1240700 1 -- 172.21.15.12:0/1534882202 wait complete. 2021-10-20T23:26:46.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:26:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.776+0000 7eff9ba59700 1 Processor -- start 2021-10-20T23:26:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.776+0000 7eff9ba59700 1 -- start start 2021-10-20T23:26:46.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff94146950 0x7eff94140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff940b4690 0x7eff940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff94143b60 con 0x7eff940b4180 2021-10-20T23:26:46.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff94147510 con 0x7eff940b4690 2021-10-20T23:26:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff94143e00 con 0x7eff94146950 2021-10-20T23:26:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff98ff4700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7eff940b4180 0x7eff94140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40120/0 (socket says 172.21.15.12:40120) 2021-10-20T23:26:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff98ff4700 1 -- 172.21.15.12:0/3306005098 learned_addr learned my addr 172.21.15.12:0/3306005098 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff99ff6700 1 --2- 172.21.15.12:0/3306005098 >> v2:172.21.15.31:3300/0 conn(0x7eff940b4690 0x7eff940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff997f5700 1 --2- 172.21.15.12:0/3306005098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff94146950 0x7eff94140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff8bfff700 1 -- 172.21.15.12:0/3306005098 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544180056 0 0) 0x7eff94143b60 con 0x7eff940b4180 2021-10-20T23:26:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff8bfff700 1 -- 172.21.15.12:0/3306005098 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff78003260 con 0x7eff940b4180 2021-10-20T23:26:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff99ff6700 1 -- 172.21.15.12:0/3306005098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff94146950 msgr2=0x7eff94140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff99ff6700 1 --2- 172.21.15.12:0/3306005098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff94146950 0x7eff94140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff99ff6700 1 -- 172.21.15.12:0/3306005098 >> v1:172.21.15.12:6789/0 conn(0x7eff940b4180 legacy=0x7eff94140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff99ff6700 1 -- 172.21.15.12:0/3306005098 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940b0c90 con 0x7eff940b4690 2021-10-20T23:26:46.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff99ff6700 1 --2- 172.21.15.12:0/3306005098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff940b4690 0x7eff940b4ed0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7eff8c0032f0 tx=0x7eff8c0091d0).ready entity=mon.1 client_cookie=90df478da22a778c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:46.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff8bfff700 1 -- 172.21.15.12:0/3306005098 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff8c00b600 con 0x7eff940b4690 2021-10-20T23:26:46.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff8bfff700 1 -- 172.21.15.12:0/3306005098 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00b760 con 0x7eff940b4690 2021-10-20T23:26:46.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff8bfff700 1 -- 172.21.15.12:0/3306005098 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff8c00b8d0 con 0x7eff940b4690 2021-10-20T23:26:46.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 -- 172.21.15.12:0/3306005098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff940b4690 msgr2=0x7eff940b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 --2- 172.21.15.12:0/3306005098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff940b4690 0x7eff940b4ed0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7eff8c0032f0 tx=0x7eff8c0091d0).stop 2021-10-20T23:26:46.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 -- 172.21.15.12:0/3306005098 shutdown_connections 2021-10-20T23:26:46.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 --2- 172.21.15.12:0/3306005098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff940b4690 0x7eff940b4ed0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 --2- 172.21.15.12:0/3306005098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff94146950 0x7eff94140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 -- 172.21.15.12:0/3306005098 >> 172.21.15.12:0/3306005098 conn(0x7eff9405c490 msgr2=0x7eff9405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:46.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 -- 172.21.15.12:0/3306005098 shutdown_connections 2021-10-20T23:26:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.780+0000 7eff9ba59700 1 -- 172.21.15.12:0/3306005098 wait complete. 2021-10-20T23:26:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 Processor -- start 2021-10-20T23:26:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 -- start start 2021-10-20T23:26:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff940b4180 0x7eff940b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff940b4690 0x7eff94141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff94146950 0x7eff94141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff94142bc0 con 0x7eff940b4180 2021-10-20T23:26:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9413e9b0 con 0x7eff94146950 2021-10-20T23:26:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff94141060 con 0x7eff940b4690 2021-10-20T23:26:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff997f5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff940b4180 0x7eff940b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff997f5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff940b4180 0x7eff940b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41532/0 (socket says 172.21.15.12:41532) 2021-10-20T23:26:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff997f5700 1 -- 172.21.15.12:0/2862328026 learned_addr learned my addr 172.21.15.12:0/2862328026 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff98ff4700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff940b4690 0x7eff94141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff99ff6700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff94146950 0x7eff94141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff997f5700 1 -- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff940b4690 msgr2=0x7eff94141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff997f5700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff940b4690 0x7eff94141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff997f5700 1 -- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff94146950 msgr2=0x7eff94141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff997f5700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff94146950 0x7eff94141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff997f5700 1 -- 172.21.15.12:0/2862328026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c009470 con 0x7eff940b4180 2021-10-20T23:26:46.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff997f5700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff940b4180 0x7eff940b02d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7eff8400c000 tx=0x7eff84006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:46.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff8a7fc700 1 -- 172.21.15.12:0/2862328026 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff84011750 con 0x7eff940b4180 2021-10-20T23:26:46.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff8a7fc700 1 -- 172.21.15.12:0/2862328026 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff840118b0 con 0x7eff940b4180 2021-10-20T23:26:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff94142920 con 0x7eff940b4180 2021-10-20T23:26:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff8a7fc700 1 -- 172.21.15.12:0/2862328026 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff84011c10 con 0x7eff940b4180 2021-10-20T23:26:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.784+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff94147c70 con 0x7eff940b4180 2021-10-20T23:26:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.788+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff940b7560 con 0x7eff940b4180 2021-10-20T23:26:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.788+0000 7eff8a7fc700 1 -- 172.21.15.12:0/2862328026 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff84011d70 con 0x7eff940b4180 2021-10-20T23:26:46.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.788+0000 7eff8a7fc700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7eff7c053640 0x7eff7c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:46.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.788+0000 7eff8a7fc700 1 -- 172.21.15.12:0/2862328026 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5600+0+0 (secure 0 0 0) 0x7eff8406bbf0 con 0x7eff940b4180 2021-10-20T23:26:46.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.788+0000 7eff98ff4700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7eff7c053640 0x7eff7c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:46.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.788+0000 7eff98ff4700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7eff7c053640 0x7eff7c055b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7eff9000d000 tx=0x7eff90009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:46.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.792+0000 7eff8a7fc700 1 -- 172.21.15.12:0/2862328026 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff84042e90 con 0x7eff940b4180 2021-10-20T23:26:46.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.916+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7eff94057350 con 0x7eff940b4180 2021-10-20T23:26:46.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.916+0000 7eff8a7fc700 1 -- 172.21.15.12:0/2862328026 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7eff840464b0 con 0x7eff940b4180 2021-10-20T23:26:46.927 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:46.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7eff7c053640 msgr2=0x7eff7c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7eff7c053640 0x7eff7c055b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7eff9000d000 tx=0x7eff90009040).stop 2021-10-20T23:26:46.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff940b4180 msgr2=0x7eff940b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:46.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff940b4180 0x7eff940b02d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7eff8400c000 tx=0x7eff84006df0).stop 2021-10-20T23:26:46.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 shutdown_connections 2021-10-20T23:26:46.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7eff7c053640 0x7eff7c055b00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff94146950 0x7eff94141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff940b4690 0x7eff94141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 --2- 172.21.15.12:0/2862328026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff940b4180 0x7eff940b02d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:46.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 >> 172.21.15.12:0/2862328026 conn(0x7eff9405c490 msgr2=0x7eff940b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:46.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 shutdown_connections 2021-10-20T23:26:46.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:46.920+0000 7eff9ba59700 1 -- 172.21.15.12:0/2862328026 wait complete. 2021-10-20T23:26:46.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:26:47.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.028+0000 7f58cf9b4700 1 Processor -- start 2021-10-20T23:26:47.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 -- start start 2021-10-20T23:26:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f58c80b1db0 0x7f58c80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c81483a0 0x7f58c80b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c80b0350 con 0x7f58c80a70c0 2021-10-20T23:26:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c80a90c0 con 0x7f58c80b1db0 2021-10-20T23:26:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80b05f0 con 0x7f58c81483a0 2021-10-20T23:26:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cd750700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f58c80b1db0 0x7f58c80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cd750700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f58c80b1db0 0x7f58c80b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41542/0 (socket says 172.21.15.12:41542) 2021-10-20T23:26:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cd750700 1 -- 172.21.15.12:0/2619179242 learned_addr learned my addr 172.21.15.12:0/2619179242 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58ccf4f700 1 --2- 172.21.15.12:0/2619179242 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c81483a0 0x7f58c80b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58bffff700 1 -- 172.21.15.12:0/2619179242 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156874287 0 0) 0x7f58c80b0350 con 0x7f58c80a70c0 2021-10-20T23:26:47.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cd750700 1 -- 172.21.15.12:0/2619179242 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c81483a0 msgr2=0x7f58c80b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:47.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cd750700 1 --2- 172.21.15.12:0/2619179242 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c81483a0 0x7f58c80b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cd750700 1 -- 172.21.15.12:0/2619179242 >> v1:172.21.15.31:6789/0 conn(0x7f58c80a70c0 legacy=0x7f58c8144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cd750700 1 -- 172.21.15.12:0/2619179242 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80b0890 con 0x7f58c80b1db0 2021-10-20T23:26:47.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cd750700 1 --2- 172.21.15.12:0/2619179242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c80b1db0 0x7f58c80b0fd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f58b8002f70 tx=0x7f58b8006eb0).ready entity=mon.0 client_cookie=142e3ddc7f060d97 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:47.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58bffff700 1 -- 172.21.15.12:0/2619179242 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b800d570 con 0x7f58c80b1db0 2021-10-20T23:26:47.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58bffff700 1 -- 172.21.15.12:0/2619179242 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8000e90 con 0x7f58c80b1db0 2021-10-20T23:26:47.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58bffff700 1 -- 172.21.15.12:0/2619179242 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b800d8c0 con 0x7f58c80b1db0 2021-10-20T23:26:47.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 -- 172.21.15.12:0/2619179242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c80b1db0 msgr2=0x7f58c80b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 --2- 172.21.15.12:0/2619179242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c80b1db0 0x7f58c80b0fd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f58b8002f70 tx=0x7f58b8006eb0).stop 2021-10-20T23:26:47.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 -- 172.21.15.12:0/2619179242 shutdown_connections 2021-10-20T23:26:47.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 --2- 172.21.15.12:0/2619179242 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c81483a0 0x7f58c80b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 --2- 172.21.15.12:0/2619179242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c80b1db0 0x7f58c80b0fd0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 -- 172.21.15.12:0/2619179242 >> 172.21.15.12:0/2619179242 conn(0x7f58c805f6b0 msgr2=0x7f58c805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 -- 172.21.15.12:0/2619179242 shutdown_connections 2021-10-20T23:26:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.032+0000 7f58cf9b4700 1 -- 172.21.15.12:0/2619179242 wait complete. 2021-10-20T23:26:47.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cf9b4700 1 Processor -- start 2021-10-20T23:26:47.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cf9b4700 1 -- start start 2021-10-20T23:26:47.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cf9b4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c80a70c0 0x7f58c8159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cf9b4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c80b1db0 0x7f58c8140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cf9b4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c81483a0 0x7f58c80b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cf9b4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80aa340 con 0x7f58c81483a0 2021-10-20T23:26:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cf9b4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80b4280 con 0x7f58c80a70c0 2021-10-20T23:26:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cf9b4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80b4510 con 0x7f58c80b1db0 2021-10-20T23:26:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cdf51700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c81483a0 0x7f58c80b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cd750700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c80a70c0 0x7f58c8159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58ccf4f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c80b1db0 0x7f58c8140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cdf51700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c81483a0 0x7f58c80b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41548/0 (socket says 172.21.15.12:41548) 2021-10-20T23:26:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cd750700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c80a70c0 0x7f58c8159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:56520/0 (socket says 172.21.15.12:56520) 2021-10-20T23:26:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cdf51700 1 -- 172.21.15.12:0/3278654044 learned_addr learned my addr 172.21.15.12:0/3278654044 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cd750700 1 -- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c80b1db0 msgr2=0x7f58c8140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cd750700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c80b1db0 0x7f58c8140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cd750700 1 -- 172.21.15.12:0/3278654044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c81483a0 msgr2=0x7f58c80b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cd750700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c81483a0 0x7f58c80b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cd750700 1 -- 172.21.15.12:0/3278654044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b800b1e0 con 0x7f58c80a70c0 2021-10-20T23:26:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.036+0000 7f58cdf51700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c81483a0 0x7f58c80b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58cd750700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c80a70c0 0x7f58c8159c90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f58b8002f70 tx=0x7f58b8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58be7fc700 1 -- 172.21.15.12:0/3278654044 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b8011790 con 0x7f58c80a70c0 2021-10-20T23:26:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58be7fc700 1 -- 172.21.15.12:0/3278654044 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80118f0 con 0x7f58c80a70c0 2021-10-20T23:26:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c80b47b0 con 0x7f58c80a70c0 2021-10-20T23:26:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58be7fc700 1 -- 172.21.15.12:0/3278654044 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b8011c50 con 0x7f58c80a70c0 2021-10-20T23:26:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c8156720 con 0x7f58c80a70c0 2021-10-20T23:26:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58be7fc700 1 -- 172.21.15.12:0/3278654044 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f58b801a040 con 0x7f58c80a70c0 2021-10-20T23:26:47.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c80b0b30 con 0x7f58c80a70c0 2021-10-20T23:26:47.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58be7fc700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f58b0053580 0x7f58b0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58be7fc700 1 -- 172.21.15.12:0/3278654044 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f58b806c5c0 con 0x7f58c80a70c0 2021-10-20T23:26:47.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.040+0000 7f58ccf4f700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f58b0053580 0x7f58b0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.044+0000 7f58ccf4f700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f58b0053580 0x7f58b0055a40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f58c400b000 tx=0x7f58c4006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:47.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.052+0000 7f58be7fc700 1 -- 172.21.15.12:0/3278654044 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f58b8043920 con 0x7f58c80a70c0 2021-10-20T23:26:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.180+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f58c8057350 con 0x7f58c80a70c0 2021-10-20T23:26:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58be7fc700 1 -- 172.21.15.12:0/3278654044 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v87) v1 ==== 84+0+143 (secure 0 0 0) 0x7f58b8023090 con 0x7f58c80a70c0 2021-10-20T23:26:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:47.193 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:26:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:26:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:26:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:26:47.201 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:26:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:47.203 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:26:47.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f58b0053580 msgr2=0x7f58b0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f58b0053580 0x7f58b0055a40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f58c400b000 tx=0x7f58c4006df0).stop 2021-10-20T23:26:47.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c80a70c0 msgr2=0x7f58c8159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c80a70c0 0x7f58c8159c90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f58b8002f70 tx=0x7f58b8015000).stop 2021-10-20T23:26:47.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 shutdown_connections 2021-10-20T23:26:47.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f58b0053580 0x7f58b0055a40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c81483a0 0x7f58c80b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c80b1db0 0x7f58c8140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 --2- 172.21.15.12:0/3278654044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c80a70c0 0x7f58c8159c90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 >> 172.21.15.12:0/3278654044 conn(0x7f58c805f6b0 msgr2=0x7f58c80af770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:47.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 shutdown_connections 2021-10-20T23:26:47.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.184+0000 7f58cf9b4700 1 -- 172.21.15.12:0/3278654044 wait complete. 2021-10-20T23:26:47.209 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:26:47.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:26:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 Processor -- start 2021-10-20T23:26:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 -- start start 2021-10-20T23:26:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 0x7f9b4405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b440ac9b0 0x7f9b4414af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b44061360 con 0x7f9b4414ab80 2021-10-20T23:26:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4414b5e0 con 0x7f9b440ac9b0 2021-10-20T23:26:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4414b880 con 0x7f9b440aff10 2021-10-20T23:26:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b42d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9b4414ab80 0x7f9b440af1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40146/0 (socket says 172.21.15.12:40146) 2021-10-20T23:26:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b4359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b440ac9b0 0x7f9b4414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b42d9d700 1 -- 172.21.15.12:0/512414983 learned_addr learned my addr 172.21.15.12:0/512414983 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:47.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b4259c700 1 --2- 172.21.15.12:0/512414983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 0x7f9b4405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b41d9b700 1 -- 172.21.15.12:0/512414983 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275800967 0 0) 0x7f9b44061360 con 0x7f9b4414ab80 2021-10-20T23:26:47.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b41d9b700 1 -- 172.21.15.12:0/512414983 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b28003260 con 0x7f9b4414ab80 2021-10-20T23:26:47.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b4359e700 1 -- 172.21.15.12:0/512414983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 msgr2=0x7f9b4405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:47.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b4359e700 1 --2- 172.21.15.12:0/512414983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 0x7f9b4405f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b4359e700 1 -- 172.21.15.12:0/512414983 >> v1:172.21.15.12:6789/0 conn(0x7f9b4414ab80 legacy=0x7f9b440af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b4359e700 1 -- 172.21.15.12:0/512414983 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440aed20 con 0x7f9b440ac9b0 2021-10-20T23:26:47.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b4359e700 1 --2- 172.21.15.12:0/512414983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 0x7f9b4414af60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f9b3c0032f0 tx=0x7f9b3c0091d0).ready entity=mon.0 client_cookie=bcb106c221a44a77 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:47.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b41d9b700 1 -- 172.21.15.12:0/512414983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3c00b600 con 0x7f9b440ac9b0 2021-10-20T23:26:47.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b41d9b700 1 -- 172.21.15.12:0/512414983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c00b760 con 0x7f9b440ac9b0 2021-10-20T23:26:47.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b41d9b700 1 -- 172.21.15.12:0/512414983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3c00b8d0 con 0x7f9b440ac9b0 2021-10-20T23:26:47.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 -- 172.21.15.12:0/512414983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 msgr2=0x7f9b4414af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 --2- 172.21.15.12:0/512414983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 0x7f9b4414af60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f9b3c0032f0 tx=0x7f9b3c0091d0).stop 2021-10-20T23:26:47.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 -- 172.21.15.12:0/512414983 shutdown_connections 2021-10-20T23:26:47.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 --2- 172.21.15.12:0/512414983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 0x7f9b4414af60 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 --2- 172.21.15.12:0/512414983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 0x7f9b4405f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.308+0000 7f9b491db700 1 -- 172.21.15.12:0/512414983 >> 172.21.15.12:0/512414983 conn(0x7f9b440b5570 msgr2=0x7f9b440b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:47.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 -- 172.21.15.12:0/512414983 shutdown_connections 2021-10-20T23:26:47.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 -- 172.21.15.12:0/512414983 wait complete. 2021-10-20T23:26:47.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 Processor -- start 2021-10-20T23:26:47.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 -- start start 2021-10-20T23:26:47.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 0x7f9b44156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 0x7f9b44156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4414ab80 0x7f9b44144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4413e4e0 con 0x7f9b440ac9b0 2021-10-20T23:26:47.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440b49c0 con 0x7f9b4414ab80 2021-10-20T23:26:47.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b491db700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440b42f0 con 0x7f9b440aff10 2021-10-20T23:26:47.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b42d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 0x7f9b44156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b42d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 0x7f9b44156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41558/0 (socket says 172.21.15.12:41558) 2021-10-20T23:26:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b42d9d700 1 -- 172.21.15.12:0/1795251624 learned_addr learned my addr 172.21.15.12:0/1795251624 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:47.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b4359e700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4414ab80 0x7f9b44144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b4259c700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 0x7f9b44156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b42d9d700 1 -- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 msgr2=0x7f9b44156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b42d9d700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 0x7f9b44156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b42d9d700 1 -- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4414ab80 msgr2=0x7f9b44144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.312+0000 7f9b42d9d700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4414ab80 0x7f9b44144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b42d9d700 1 -- 172.21.15.12:0/1795251624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c009470 con 0x7f9b440ac9b0 2021-10-20T23:26:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b42d9d700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 0x7f9b44156650 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f9b44157750 tx=0x7f9b34007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b33fff700 1 -- 172.21.15.12:0/1795251624 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3400ce60 con 0x7f9b440ac9b0 2021-10-20T23:26:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b33fff700 1 -- 172.21.15.12:0/1795251624 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b340070d0 con 0x7f9b440ac9b0 2021-10-20T23:26:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b33fff700 1 -- 172.21.15.12:0/1795251624 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b34007430 con 0x7f9b440ac9b0 2021-10-20T23:26:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b441571e0 con 0x7f9b440ac9b0 2021-10-20T23:26:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b440b4520 con 0x7f9b440ac9b0 2021-10-20T23:26:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b440b4720 con 0x7f9b440ac9b0 2021-10-20T23:26:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b33fff700 1 -- 172.21.15.12:0/1795251624 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b3401a070 con 0x7f9b440ac9b0 2021-10-20T23:26:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b33fff700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b20053610 0x7f9b20055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b33fff700 1 -- 172.21.15.12:0/1795251624 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f9b3406a930 con 0x7f9b440ac9b0 2021-10-20T23:26:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.316+0000 7f9b4259c700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b20053610 0x7f9b20055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:47.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.320+0000 7f9b4259c700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b20053610 0x7f9b20055ad0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f9b3800b000 tx=0x7f9b38006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:47.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.324+0000 7f9b33fff700 1 -- 172.21.15.12:0/1795251624 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b440b4720 con 0x7f9b440ac9b0 2021-10-20T23:26:47.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:47.448+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9b440b4720 con 0x7f9b440ac9b0 2021-10-20T23:26:48.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.080+0000 7f9b33fff700 1 -- 172.21.15.12:0/1795251624 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v88) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9b440b4720 con 0x7f9b440ac9b0 2021-10-20T23:26:48.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b20053610 msgr2=0x7f9b20055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:48.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b20053610 0x7f9b20055ad0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f9b3800b000 tx=0x7f9b38006df0).stop 2021-10-20T23:26:48.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 msgr2=0x7f9b44156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:48.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 0x7f9b44156650 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f9b44157750 tx=0x7f9b34007aa0).stop 2021-10-20T23:26:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 shutdown_connections 2021-10-20T23:26:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b20053610 0x7f9b20055ad0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4414ab80 0x7f9b44144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:48.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b440aff10 0x7f9b44156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:48.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 --2- 172.21.15.12:0/1795251624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b440ac9b0 0x7f9b44156650 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:48.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 >> 172.21.15.12:0/1795251624 conn(0x7f9b440b5570 msgr2=0x7f9b440b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:48.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 shutdown_connections 2021-10-20T23:26:48.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.084+0000 7f9b491db700 1 -- 172.21.15.12:0/1795251624 wait complete. 2021-10-20T23:26:48.103 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:26:48.122 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:26:48.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.232+0000 7f43f7fff700 1 Processor -- start 2021-10-20T23:26:48.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.232+0000 7f43f7fff700 1 -- start start 2021-10-20T23:26:48.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.232+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f80b25a0 0x7f43f8066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:48.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.232+0000 7f43f7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43f8066a10 0x7f43f814d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:48.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.232+0000 7f43f7fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f8065330 con 0x7f43f80b3000 2021-10-20T23:26:48.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.232+0000 7f43f7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f8062000 con 0x7f43f8066a10 2021-10-20T23:26:48.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.232+0000 7f43f7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80b33e0 con 0x7f43f80b25a0 2021-10-20T23:26:48.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.232+0000 7f43f77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43f8066a10 0x7f43f814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:48.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43f8066a10 0x7f43f814d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41570/0 (socket says 172.21.15.12:41570) 2021-10-20T23:26:48.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f77fe700 1 -- 172.21.15.12:0/3370683062 learned_addr learned my addr 172.21.15.12:0/3370683062 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:48.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f67fc700 1 --2- 172.21.15.12:0/3370683062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f80b25a0 0x7f43f8066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:48.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f77fe700 1 -- 172.21.15.12:0/3370683062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f80b25a0 msgr2=0x7f43f8066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:48.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f77fe700 1 --2- 172.21.15.12:0/3370683062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f80b25a0 0x7f43f8066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f77fe700 1 -- 172.21.15.12:0/3370683062 >> v1:172.21.15.31:6789/0 conn(0x7f43f80b3000 legacy=0x7f43f8060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f77fe700 1 -- 172.21.15.12:0/3370683062 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f805fa60 con 0x7f43f8066a10 2021-10-20T23:26:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f77fe700 1 --2- 172.21.15.12:0/3370683062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f8066a10 0x7f43f814d920 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f43f00032f0 tx=0x7f43f0009290).ready entity=mon.0 client_cookie=8f846ddec082fc92 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f5ffb700 1 -- 172.21.15.12:0/3370683062 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f000b8a0 con 0x7f43f8066a10 2021-10-20T23:26:48.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f5ffb700 1 -- 172.21.15.12:0/3370683062 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f000ba00 con 0x7f43f8066a10 2021-10-20T23:26:48.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f5ffb700 1 -- 172.21.15.12:0/3370683062 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f000bb70 con 0x7f43f8066a10 2021-10-20T23:26:48.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 -- 172.21.15.12:0/3370683062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f8066a10 msgr2=0x7f43f814d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:48.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 --2- 172.21.15.12:0/3370683062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f8066a10 0x7f43f814d920 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f43f00032f0 tx=0x7f43f0009290).stop 2021-10-20T23:26:48.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 -- 172.21.15.12:0/3370683062 shutdown_connections 2021-10-20T23:26:48.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 --2- 172.21.15.12:0/3370683062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f8066a10 0x7f43f814d920 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:48.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 --2- 172.21.15.12:0/3370683062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f80b25a0 0x7f43f8066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:48.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 -- 172.21.15.12:0/3370683062 >> 172.21.15.12:0/3370683062 conn(0x7f43f80636e0 msgr2=0x7f43f8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:48.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 -- 172.21.15.12:0/3370683062 shutdown_connections 2021-10-20T23:26:48.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 -- 172.21.15.12:0/3370683062 wait complete. 2021-10-20T23:26:48.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 Processor -- start 2021-10-20T23:26:48.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 -- start start 2021-10-20T23:26:48.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f8066a10 0x7f43f8148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:48.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43f80b25a0 0x7f43f80b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:48.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f80b3000 0x7f43f80b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:48.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80b64f0 con 0x7f43f80b3000 2021-10-20T23:26:48.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80b6790 con 0x7f43f80b25a0 2021-10-20T23:26:48.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.236+0000 7f43f7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80b5460 con 0x7f43f8066a10 2021-10-20T23:26:48.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f80b3000 0x7f43f80b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:48.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f6ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f8066a10 0x7f43f8148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:48.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f67fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43f80b25a0 0x7f43f80b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:48.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f6ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f8066a10 0x7f43f8148930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:47332/0 (socket says 172.21.15.12:47332) 2021-10-20T23:26:48.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f67fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43f80b25a0 0x7f43f80b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:56546/0 (socket says 172.21.15.12:56546) 2021-10-20T23:26:48.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f6ffd700 1 -- 172.21.15.12:0/2270813357 learned_addr learned my addr 172.21.15.12:0/2270813357 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:48.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f77fe700 1 -- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f8066a10 msgr2=0x7f43f8148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:48.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f77fe700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f8066a10 0x7f43f8148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:48.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f77fe700 1 -- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43f80b25a0 msgr2=0x7f43f80b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:48.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f77fe700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43f80b25a0 0x7f43f80b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:48.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f77fe700 1 -- 172.21.15.12:0/2270813357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0009530 con 0x7f43f80b3000 2021-10-20T23:26:48.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f67fc700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43f80b25a0 0x7f43f80b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:48.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f77fe700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f80b3000 0x7f43f80b4970 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f43f00032f0 tx=0x7f43f0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43effff700 1 -- 172.21.15.12:0/2270813357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f000b8a0 con 0x7f43f80b3000 2021-10-20T23:26:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43effff700 1 -- 172.21.15.12:0/2270813357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f0021440 con 0x7f43f80b3000 2021-10-20T23:26:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f80ad050 con 0x7f43f80b3000 2021-10-20T23:26:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f80b5c00 con 0x7f43f80b3000 2021-10-20T23:26:48.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43effff700 1 -- 172.21.15.12:0/2270813357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f00217a0 con 0x7f43f80b3000 2021-10-20T23:26:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43effff700 1 -- 172.21.15.12:0/2270813357 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f43f0027020 con 0x7f43f80b3000 2021-10-20T23:26:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.240+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f805fd00 con 0x7f43f80b3000 2021-10-20T23:26:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.244+0000 7f43effff700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43dc053610 0x7f43dc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.244+0000 7f43effff700 1 -- 172.21.15.12:0/2270813357 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f43f006cd80 con 0x7f43f80b3000 2021-10-20T23:26:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.244+0000 7f43f6ffd700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43dc053610 0x7f43dc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.244+0000 7f43f6ffd700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43dc053610 0x7f43dc055ad0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f43e800d000 tx=0x7f43e8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.248+0000 7f43effff700 1 -- 172.21.15.12:0/2270813357 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43f0043dc0 con 0x7f43f80b3000 2021-10-20T23:26:48.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:48.372+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f43f8057350 con 0x7f43f80b3000 2021-10-20T23:26:49.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.092+0000 7f43effff700 1 -- 172.21.15.12:0/2270813357 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v89) v1 ==== 125+0+0 (secure 0 0 0) 0x7f43f0015020 con 0x7f43f80b3000 2021-10-20T23:26:49.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.100+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43dc053610 msgr2=0x7f43dc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.100+0000 7f43f7fff700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43dc053610 0x7f43dc055ad0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f43e800d000 tx=0x7f43e8009040).stop 2021-10-20T23:26:49.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.100+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f80b3000 msgr2=0x7f43f80b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.100+0000 7f43f7fff700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f80b3000 0x7f43f80b4970 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f43f00032f0 tx=0x7f43f0016000).stop 2021-10-20T23:26:49.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.104+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 shutdown_connections 2021-10-20T23:26:49.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.104+0000 7f43f7fff700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f43dc053610 0x7f43dc055ad0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.104+0000 7f43f7fff700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f80b3000 0x7f43f80b4970 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.104+0000 7f43f7fff700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43f80b25a0 0x7f43f80b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.104+0000 7f43f7fff700 1 --2- 172.21.15.12:0/2270813357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43f8066a10 0x7f43f8148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.104+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 >> 172.21.15.12:0/2270813357 conn(0x7f43f80636e0 msgr2=0x7f43f81461e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:49.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.104+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 shutdown_connections 2021-10-20T23:26:49.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.104+0000 7f43f7fff700 1 -- 172.21.15.12:0/2270813357 wait complete. 2021-10-20T23:26:49.115 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:26:49.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:26:49.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f922689f700 1 Processor -- start 2021-10-20T23:26:49.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f922689f700 1 -- start start 2021-10-20T23:26:49.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f922689f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9220140cf0 0x7f92200ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f922689f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92200a8c70 0x7f92200aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f922689f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92200af090 con 0x7f92200b1280 2021-10-20T23:26:49.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f922689f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9220140310 con 0x7f92200a8c70 2021-10-20T23:26:49.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f922689f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92201405b0 con 0x7f9220140cf0 2021-10-20T23:26:49.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f9224e3c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92200a8c70 0x7f92200aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f9224e3c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92200a8c70 0x7f92200aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41582/0 (socket says 172.21.15.12:41582) 2021-10-20T23:26:49.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f9224e3c700 1 -- 172.21.15.12:0/2460466844 learned_addr learned my addr 172.21.15.12:0/2460466844 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:49.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.228+0000 7f921ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f92200b1280 0x7f92200b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40174/0 (socket says 172.21.15.12:40174) 2021-10-20T23:26:49.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f9217fff700 1 --2- 172.21.15.12:0/2460466844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9220140cf0 0x7f92200ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f9224e3c700 1 -- 172.21.15.12:0/2460466844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9220140cf0 msgr2=0x7f92200ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:49.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f9224e3c700 1 --2- 172.21.15.12:0/2460466844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9220140cf0 0x7f92200ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f921f7fe700 1 -- 172.21.15.12:0/2460466844 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072180275 0 0) 0x7f92200af090 con 0x7f92200b1280 2021-10-20T23:26:49.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f9224e3c700 1 -- 172.21.15.12:0/2460466844 >> v1:172.21.15.12:6789/0 conn(0x7f92200b1280 legacy=0x7f92200b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f9224e3c700 1 -- 172.21.15.12:0/2460466844 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220140850 con 0x7f92200a8c70 2021-10-20T23:26:49.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f9224e3c700 1 --2- 172.21.15.12:0/2460466844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92200a8c70 0x7f92200aeba0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f92180032f0 tx=0x7f9218009290).ready entity=mon.0 client_cookie=f3eacf28a9e5678a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:49.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f921f7fe700 1 -- 172.21.15.12:0/2460466844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921800b8a0 con 0x7f92200a8c70 2021-10-20T23:26:49.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f921f7fe700 1 -- 172.21.15.12:0/2460466844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921800ba00 con 0x7f92200a8c70 2021-10-20T23:26:49.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f921f7fe700 1 -- 172.21.15.12:0/2460466844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921800bb70 con 0x7f92200a8c70 2021-10-20T23:26:49.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f922689f700 1 -- 172.21.15.12:0/2460466844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92200a8c70 msgr2=0x7f92200aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f922689f700 1 --2- 172.21.15.12:0/2460466844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92200a8c70 0x7f92200aeba0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f92180032f0 tx=0x7f9218009290).stop 2021-10-20T23:26:49.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f922689f700 1 -- 172.21.15.12:0/2460466844 shutdown_connections 2021-10-20T23:26:49.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f922689f700 1 --2- 172.21.15.12:0/2460466844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92200a8c70 0x7f92200aeba0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f922689f700 1 --2- 172.21.15.12:0/2460466844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9220140cf0 0x7f92200ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f922689f700 1 -- 172.21.15.12:0/2460466844 >> 172.21.15.12:0/2460466844 conn(0x7f922005f6b0 msgr2=0x7f922005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:49.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f922689f700 1 -- 172.21.15.12:0/2460466844 shutdown_connections 2021-10-20T23:26:49.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.232+0000 7f922689f700 1 -- 172.21.15.12:0/2460466844 wait complete. 2021-10-20T23:26:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f922689f700 1 Processor -- start 2021-10-20T23:26:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f922689f700 1 -- start start 2021-10-20T23:26:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f922689f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92200a8c70 0x7f922013cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f922689f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92200b1280 0x7f9220062d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f922689f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9220140cf0 0x7f92201426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f922689f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922013d860 con 0x7f9220140cf0 2021-10-20T23:26:49.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f922689f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922013c530 con 0x7f92200b1280 2021-10-20T23:26:49.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f922689f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922013b570 con 0x7f92200a8c70 2021-10-20T23:26:49.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f9224e3c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9220140cf0 0x7f92201426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f9224e3c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9220140cf0 0x7f92201426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41590/0 (socket says 172.21.15.12:41590) 2021-10-20T23:26:49.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f9224e3c700 1 -- 172.21.15.12:0/2360423860 learned_addr learned my addr 172.21.15.12:0/2360423860 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:49.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f9217fff700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92200b1280 0x7f9220062d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f921ffff700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92200a8c70 0x7f922013cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f9224e3c700 1 -- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92200a8c70 msgr2=0x7f922013cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.236+0000 7f9224e3c700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92200a8c70 0x7f922013cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f9224e3c700 1 -- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92200b1280 msgr2=0x7f9220062d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f9224e3c700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92200b1280 0x7f9220062d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f9224e3c700 1 -- 172.21.15.12:0/2360423860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9218009530 con 0x7f9220140cf0 2021-10-20T23:26:49.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f9217fff700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92200b1280 0x7f9220062d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:49.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f9224e3c700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9220140cf0 0x7f92201426d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f92180032f0 tx=0x7f9218016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:49.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f921dffb700 1 -- 172.21.15.12:0/2360423860 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921800b8a0 con 0x7f9220140cf0 2021-10-20T23:26:49.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f921dffb700 1 -- 172.21.15.12:0/2360423860 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9218021670 con 0x7f9220140cf0 2021-10-20T23:26:49.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922013c760 con 0x7f9220140cf0 2021-10-20T23:26:49.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f921dffb700 1 -- 172.21.15.12:0/2360423860 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92180219d0 con 0x7f9220140cf0 2021-10-20T23:26:49.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922013a180 con 0x7f9220140cf0 2021-10-20T23:26:49.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.240+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922013c8f0 con 0x7f9220140cf0 2021-10-20T23:26:49.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.244+0000 7f921dffb700 1 -- 172.21.15.12:0/2360423860 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9218028070 con 0x7f9220140cf0 2021-10-20T23:26:49.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.244+0000 7f921dffb700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92040534f0 0x7f92040559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.244+0000 7f921dffb700 1 -- 172.21.15.12:0/2360423860 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f921806c890 con 0x7f9220140cf0 2021-10-20T23:26:49.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.244+0000 7f921ffff700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92040534f0 0x7f92040559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.244+0000 7f921ffff700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92040534f0 0x7f92040559b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f921000d000 tx=0x7f9210007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:49.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.248+0000 7f921dffb700 1 -- 172.21.15.12:0/2360423860 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9218043910 con 0x7f9220140cf0 2021-10-20T23:26:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.412+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f9220140000 con 0x7f9220140cf0 2021-10-20T23:26:49.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.420+0000 7f921dffb700 1 -- 172.21.15.12:0/2360423860 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v42) v1 ==== 189+0+0 (secure 0 0 0) 0x7f9218015070 con 0x7f9220140cf0 2021-10-20T23:26:49.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.428+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92040534f0 msgr2=0x7f92040559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.428+0000 7f922689f700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92040534f0 0x7f92040559b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f921000d000 tx=0x7f9210007a00).stop 2021-10-20T23:26:49.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.428+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9220140cf0 msgr2=0x7f92201426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.428+0000 7f922689f700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9220140cf0 0x7f92201426d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f92180032f0 tx=0x7f9218016000).stop 2021-10-20T23:26:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.432+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 shutdown_connections 2021-10-20T23:26:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.432+0000 7f922689f700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92040534f0 0x7f92040559b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.432+0000 7f922689f700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9220140cf0 0x7f92201426d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.432+0000 7f922689f700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92200b1280 0x7f9220062d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.432+0000 7f922689f700 1 --2- 172.21.15.12:0/2360423860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92200a8c70 0x7f922013cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.432+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 >> 172.21.15.12:0/2360423860 conn(0x7f922005f6b0 msgr2=0x7f922013f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.432+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 shutdown_connections 2021-10-20T23:26:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.432+0000 7f922689f700 1 -- 172.21.15.12:0/2360423860 wait complete. 2021-10-20T23:26:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 15 and data pool 16 2021-10-20T23:26:49.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:26:49.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.540+0000 7ff1bf59e700 1 Processor -- start 2021-10-20T23:26:49.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.540+0000 7ff1bf59e700 1 -- start start 2021-10-20T23:26:49.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b2580 0x7ff1c00abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1c00b02e0 0x7ff1c00ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c00add80 con 0x7ff1c00b1260 2021-10-20T23:26:49.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c00ae020 con 0x7ff1c00b02e0 2021-10-20T23:26:49.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00a9390 con 0x7ff1c00b2580 2021-10-20T23:26:49.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1c00b02e0 0x7ff1c00ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1be59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b2580 0x7ff1c00abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1b7fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff1c00b1260 0x7ff1c00afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:47266/0 (socket says 172.21.15.12:47266) 2021-10-20T23:26:49.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1b7fff700 1 -- 172.21.15.12:0/1938217223 learned_addr learned my addr 172.21.15.12:0/1938217223 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:49.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bed9d700 1 --2- 172.21.15.12:0/1938217223 >> v2:172.21.15.31:3300/0 conn(0x7ff1c00b02e0 0x7ff1c00ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:56578/0 (socket says 172.21.15.12:56578) 2021-10-20T23:26:49.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bed9d700 1 -- 172.21.15.12:0/1938217223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b2580 msgr2=0x7ff1c00abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:49.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bed9d700 1 --2- 172.21.15.12:0/1938217223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b2580 0x7ff1c00abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bed9d700 1 -- 172.21.15.12:0/1938217223 >> v1:172.21.15.31:6789/0 conn(0x7ff1c00b1260 legacy=0x7ff1c00afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bed9d700 1 -- 172.21.15.12:0/1938217223 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00a9830 con 0x7ff1c00b02e0 2021-10-20T23:26:49.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bed9d700 1 --2- 172.21.15.12:0/1938217223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b02e0 0x7ff1c00ac000 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7ff1b80032f0 tx=0x7ff1b80091d0).ready entity=mon.1 client_cookie=7440eda2546097f7 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:49.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bdd9b700 1 -- 172.21.15.12:0/1938217223 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b800b6c0 con 0x7ff1c00b02e0 2021-10-20T23:26:49.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bdd9b700 1 -- 172.21.15.12:0/1938217223 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b800b820 con 0x7ff1c00b02e0 2021-10-20T23:26:49.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bdd9b700 1 -- 172.21.15.12:0/1938217223 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b800b990 con 0x7ff1c00b02e0 2021-10-20T23:26:49.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1938217223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b02e0 msgr2=0x7ff1c00ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 --2- 172.21.15.12:0/1938217223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b02e0 0x7ff1c00ac000 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7ff1b80032f0 tx=0x7ff1b80091d0).stop 2021-10-20T23:26:49.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1938217223 shutdown_connections 2021-10-20T23:26:49.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 --2- 172.21.15.12:0/1938217223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b02e0 0x7ff1c00ac000 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 --2- 172.21.15.12:0/1938217223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b2580 0x7ff1c00abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1938217223 >> 172.21.15.12:0/1938217223 conn(0x7ff1c0060180 msgr2=0x7ff1c00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:49.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1938217223 shutdown_connections 2021-10-20T23:26:49.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.544+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1938217223 wait complete. 2021-10-20T23:26:49.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 Processor -- start 2021-10-20T23:26:49.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 -- start start 2021-10-20T23:26:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b02e0 0x7ff1c0139090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b1260 0x7ff1c0139580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1c00b2580 0x7ff1c0065620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0134ae0 con 0x7ff1c00b2580 2021-10-20T23:26:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0135720 con 0x7ff1c00b1260 2021-10-20T23:26:49.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c013acf0 con 0x7ff1c00b02e0 2021-10-20T23:26:49.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1c00b2580 0x7ff1c0065620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1b7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b1260 0x7ff1c0139580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1be59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b02e0 0x7ff1c0139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1c00b2580 0x7ff1c0065620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41614/0 (socket says 172.21.15.12:41614) 2021-10-20T23:26:49.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1b7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b1260 0x7ff1c0139580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:56586/0 (socket says 172.21.15.12:56586) 2021-10-20T23:26:49.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bed9d700 1 -- 172.21.15.12:0/1482629281 learned_addr learned my addr 172.21.15.12:0/1482629281 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:49.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bed9d700 1 -- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b02e0 msgr2=0x7ff1c0139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bed9d700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b02e0 0x7ff1c0139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bed9d700 1 -- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b1260 msgr2=0x7ff1c0139580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bed9d700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b1260 0x7ff1c0139580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bed9d700 1 -- 172.21.15.12:0/1482629281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b8009470 con 0x7ff1c00b2580 2021-10-20T23:26:49.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bed9d700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1c00b2580 0x7ff1c0065620 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7ff1b80032f0 tx=0x7ff1b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:49.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1b77fe700 1 -- 172.21.15.12:0/1482629281 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b800b990 con 0x7ff1c00b2580 2021-10-20T23:26:49.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1b77fe700 1 -- 172.21.15.12:0/1482629281 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b8021630 con 0x7ff1c00b2580 2021-10-20T23:26:49.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c0135480 con 0x7ff1c00b2580 2021-10-20T23:26:49.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1b77fe700 1 -- 172.21.15.12:0/1482629281 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b800b6c0 con 0x7ff1c00b2580 2021-10-20T23:26:49.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.548+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c0134440 con 0x7ff1c00b2580 2021-10-20T23:26:49.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.552+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c0057350 con 0x7ff1c00b2580 2021-10-20T23:26:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.552+0000 7ff1b77fe700 1 -- 172.21.15.12:0/1482629281 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff1b8029070 con 0x7ff1c00b2580 2021-10-20T23:26:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.552+0000 7ff1b77fe700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1a40534f0 0x7ff1a40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.552+0000 7ff1b77fe700 1 -- 172.21.15.12:0/1482629281 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff1b806cb60 con 0x7ff1c00b2580 2021-10-20T23:26:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.552+0000 7ff1be59c700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1a40534f0 0x7ff1a40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.552+0000 7ff1be59c700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1a40534f0 0x7ff1a40559b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7ff1b000b000 tx=0x7ff1b0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.560+0000 7ff1b77fe700 1 -- 172.21.15.12:0/1482629281 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff1b8043a50 con 0x7ff1c00b2580 2021-10-20T23:26:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.688+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1c013a970 con 0x7ff1c00b2580 2021-10-20T23:26:49.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1b77fe700 1 -- 172.21.15.12:0/1482629281 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16287 (secure 0 0 0) 0x7ff1b8015070 con 0x7ff1c00b2580 2021-10-20T23:26:49.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:49.703 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":90,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:26:49.417728+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:26:47.507897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-20T23:26:48.434318+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:26:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1a40534f0 msgr2=0x7ff1a40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1a40534f0 0x7ff1a40559b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7ff1b000b000 tx=0x7ff1b0006df0).stop 2021-10-20T23:26:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1c00b2580 msgr2=0x7ff1c0065620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1c00b2580 0x7ff1c0065620 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7ff1b80032f0 tx=0x7ff1b8016000).stop 2021-10-20T23:26:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 shutdown_connections 2021-10-20T23:26:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1a40534f0 0x7ff1a40559b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1c00b2580 0x7ff1c0065620 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c00b1260 0x7ff1c0139580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 --2- 172.21.15.12:0/1482629281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c00b02e0 0x7ff1c0139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 >> 172.21.15.12:0/1482629281 conn(0x7ff1c0060180 msgr2=0x7ff1c00b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 shutdown_connections 2021-10-20T23:26:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.692+0000 7ff1bf59e700 1 -- 172.21.15.12:0/1482629281 wait complete. 2021-10-20T23:26:49.715 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:26:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c5d7d3700 1 Processor -- start 2021-10-20T23:26:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c5d7d3700 1 -- start start 2021-10-20T23:26:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c5d7d3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c580b2580 0x7f8c5814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c5d7d3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c580b0010 0x7f8c5814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c5d7d3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580afbd0 0x7f8c580a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c5d7d3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c580a70c0 con 0x7f8c580b2580 2021-10-20T23:26:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c5d7d3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c580a72f0 con 0x7f8c580b0010 2021-10-20T23:26:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c5d7d3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580a7590 con 0x7f8c580afbd0 2021-10-20T23:26:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c57fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c580b2580 0x7f8c5814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c577fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c580b0010 0x7f8c5814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c57fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c580b2580 0x7f8c5814ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41622/0 (socket says 172.21.15.12:41622) 2021-10-20T23:26:49.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c5cfd2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580afbd0 0x7f8c580a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c57fff700 1 -- 172.21.15.12:0/764599285 learned_addr learned my addr 172.21.15.12:0/764599285 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c57fff700 1 -- 172.21.15.12:0/764599285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580afbd0 msgr2=0x7f8c580a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c57fff700 1 --2- 172.21.15.12:0/764599285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580afbd0 0x7f8c580a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c57fff700 1 -- 172.21.15.12:0/764599285 >> v2:172.21.15.31:3300/0 conn(0x7f8c580b0010 msgr2=0x7f8c5814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.812+0000 7f8c57fff700 1 --2- 172.21.15.12:0/764599285 >> v2:172.21.15.31:3300/0 conn(0x7f8c580b0010 0x7f8c5814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c57fff700 1 -- 172.21.15.12:0/764599285 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c580a7830 con 0x7f8c580b2580 2021-10-20T23:26:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c577fe700 1 --2- 172.21.15.12:0/764599285 >> v2:172.21.15.31:3300/0 conn(0x7f8c580b0010 0x7f8c5814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:49.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c57fff700 1 --2- 172.21.15.12:0/764599285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580b2580 0x7f8c5814ae40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f8c4c002f70 tx=0x7f8c4c006eb0).ready entity=mon.0 client_cookie=2cf845368b2f96ae server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:49.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c56ffd700 1 -- 172.21.15.12:0/764599285 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c4c00d570 con 0x7f8c580b2580 2021-10-20T23:26:49.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c56ffd700 1 -- 172.21.15.12:0/764599285 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c000e90 con 0x7f8c580b2580 2021-10-20T23:26:49.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c56ffd700 1 -- 172.21.15.12:0/764599285 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c4c00d900 con 0x7f8c580b2580 2021-10-20T23:26:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/764599285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580b2580 msgr2=0x7f8c5814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/764599285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580b2580 0x7f8c5814ae40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f8c4c002f70 tx=0x7f8c4c006eb0).stop 2021-10-20T23:26:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/764599285 shutdown_connections 2021-10-20T23:26:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/764599285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580afbd0 0x7f8c580a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/764599285 >> v2:172.21.15.31:3300/0 conn(0x7f8c580b0010 0x7f8c5814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/764599285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580b2580 0x7f8c5814ae40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/764599285 >> 172.21.15.12:0/764599285 conn(0x7f8c58060180 msgr2=0x7f8c580b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/764599285 shutdown_connections 2021-10-20T23:26:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/764599285 wait complete. 2021-10-20T23:26:49.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 Processor -- start 2021-10-20T23:26:49.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 -- start start 2021-10-20T23:26:49.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580afbd0 0x7f8c58149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c580b0010 0x7f8c580a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580b2580 0x7f8c580a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b5420 con 0x7f8c580afbd0 2021-10-20T23:26:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b4d60 con 0x7f8c580b0010 2021-10-20T23:26:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.816+0000 7f8c5d7d3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b3640 con 0x7f8c580b2580 2021-10-20T23:26:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580afbd0 0x7f8c58149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580afbd0 0x7f8c58149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41626/0 (socket says 172.21.15.12:41626) 2021-10-20T23:26:49.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c57fff700 1 -- 172.21.15.12:0/1007379131 learned_addr learned my addr 172.21.15.12:0/1007379131 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:49.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c577fe700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c580b0010 0x7f8c580a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c5cfd2700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580b2580 0x7f8c580a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c57fff700 1 -- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580b2580 msgr2=0x7f8c580a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c57fff700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580b2580 0x7f8c580a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c57fff700 1 -- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c580b0010 msgr2=0x7f8c580a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c57fff700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c580b0010 0x7f8c580a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c57fff700 1 -- 172.21.15.12:0/1007379131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4800b180 con 0x7f8c580afbd0 2021-10-20T23:26:49.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c5cfd2700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580b2580 0x7f8c580a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:49.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c577fe700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c580b0010 0x7f8c580a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:49.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c57fff700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580afbd0 0x7f8c58149990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f8c580b4ea0 tx=0x7f8c4c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:49.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c557fa700 1 -- 172.21.15.12:0/1007379131 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c4c011910 con 0x7f8c580afbd0 2021-10-20T23:26:49.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c557fa700 1 -- 172.21.15.12:0/1007379131 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c011a70 con 0x7f8c580afbd0 2021-10-20T23:26:49.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4c00b1e0 con 0x7f8c580afbd0 2021-10-20T23:26:49.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c557fa700 1 -- 172.21.15.12:0/1007379131 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c4c011dd0 con 0x7f8c580afbd0 2021-10-20T23:26:49.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c580b3870 con 0x7f8c580afbd0 2021-10-20T23:26:49.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c580b5120 con 0x7f8c580afbd0 2021-10-20T23:26:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c557fa700 1 -- 172.21.15.12:0/1007379131 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8c4c025030 con 0x7f8c580afbd0 2021-10-20T23:26:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c557fa700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8c380536a0 0x7f8c38055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.820+0000 7f8c557fa700 1 -- 172.21.15.12:0/1007379131 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8c4c06cc80 con 0x7f8c580afbd0 2021-10-20T23:26:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.824+0000 7f8c577fe700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8c380536a0 0x7f8c38055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.824+0000 7f8c577fe700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8c380536a0 0x7f8c38055b60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f8c4800b000 tx=0x7f8c48008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.828+0000 7f8c557fa700 1 -- 172.21.15.12:0/1007379131 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c4c043be0 con 0x7f8c580afbd0 2021-10-20T23:26:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.956+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c580b3ba0 con 0x7f8c580afbd0 2021-10-20T23:26:49.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c557fa700 1 -- 172.21.15.12:0/1007379131 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f8c4c023020 con 0x7f8c580afbd0 2021-10-20T23:26:49.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:49.968 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":90,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:26:49.417728+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:26:47.507897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-20T23:26:48.434318+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:26:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8c380536a0 msgr2=0x7f8c38055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8c380536a0 0x7f8c38055b60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f8c4800b000 tx=0x7f8c48008040).stop 2021-10-20T23:26:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580afbd0 msgr2=0x7f8c58149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580afbd0 0x7f8c58149990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f8c580b4ea0 tx=0x7f8c4c015000).stop 2021-10-20T23:26:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 shutdown_connections 2021-10-20T23:26:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8c380536a0 0x7f8c38055b60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c580b2580 0x7f8c580a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c580b0010 0x7f8c580a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 --2- 172.21.15.12:0/1007379131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c580afbd0 0x7f8c58149990 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 >> 172.21.15.12:0/1007379131 conn(0x7f8c58060180 msgr2=0x7f8c5814b990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 shutdown_connections 2021-10-20T23:26:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:49.960+0000 7f8c5d7d3700 1 -- 172.21.15.12:0/1007379131 wait complete. 2021-10-20T23:26:49.982 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:26:50.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb007d7a700 1 Processor -- start 2021-10-20T23:26:50.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb007d7a700 1 -- start start 2021-10-20T23:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb007d7a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0000b10c0 0x7fb0000b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb007d7a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb000140ba0 0x7fb0000b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb007d7a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0000ac7c0 con 0x7fb0000acb70 2021-10-20T23:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb007d7a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0000ac020 con 0x7fb000140ba0 2021-10-20T23:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb007d7a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb000141010 con 0x7fb0000b10c0 2021-10-20T23:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb005b16700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0000b10c0 0x7fb0000b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb005315700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb0000acb70 0x7fb00013d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:47292/0 (socket says 172.21.15.12:47292) 2021-10-20T23:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb005b16700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0000b10c0 0x7fb0000b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:47390/0 (socket says 172.21.15.12:47390) 2021-10-20T23:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb005315700 1 -- 172.21.15.12:0/1461255420 learned_addr learned my addr 172.21.15.12:0/1461255420 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb006317700 1 --2- 172.21.15.12:0/1461255420 >> v2:172.21.15.31:3300/0 conn(0x7fb000140ba0 0x7fb0000b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb004b14700 1 -- 172.21.15.12:0/1461255420 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333396855 0 0) 0x7fb0000ac7c0 con 0x7fb0000acb70 2021-10-20T23:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb004b14700 1 -- 172.21.15.12:0/1461255420 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe8003260 con 0x7fb0000acb70 2021-10-20T23:26:50.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb005b16700 1 -- 172.21.15.12:0/1461255420 >> v2:172.21.15.31:3300/0 conn(0x7fb000140ba0 msgr2=0x7fb0000b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:50.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb005b16700 1 --2- 172.21.15.12:0/1461255420 >> v2:172.21.15.31:3300/0 conn(0x7fb000140ba0 0x7fb0000b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb005b16700 1 -- 172.21.15.12:0/1461255420 >> v1:172.21.15.31:6789/0 conn(0x7fb0000acb70 legacy=0x7fb00013d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb005b16700 1 -- 172.21.15.12:0/1461255420 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000ac280 con 0x7fb0000b10c0 2021-10-20T23:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb005b16700 1 --2- 172.21.15.12:0/1461255420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0000b10c0 0x7fb0000b14a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faffc002f70 tx=0x7faffc006e80).ready entity=mon.2 client_cookie=8a0726738ec09103 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb004b14700 1 -- 172.21.15.12:0/1461255420 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faffc00b900 con 0x7fb0000b10c0 2021-10-20T23:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb004b14700 1 -- 172.21.15.12:0/1461255420 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc000e90 con 0x7fb0000b10c0 2021-10-20T23:26:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.084+0000 7fb004b14700 1 -- 172.21.15.12:0/1461255420 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faffc00bc50 con 0x7fb0000b10c0 2021-10-20T23:26:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 -- 172.21.15.12:0/1461255420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0000b10c0 msgr2=0x7fb0000b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 --2- 172.21.15.12:0/1461255420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0000b10c0 0x7fb0000b14a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faffc002f70 tx=0x7faffc006e80).stop 2021-10-20T23:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 -- 172.21.15.12:0/1461255420 shutdown_connections 2021-10-20T23:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 --2- 172.21.15.12:0/1461255420 >> v2:172.21.15.31:3300/0 conn(0x7fb000140ba0 0x7fb0000b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 --2- 172.21.15.12:0/1461255420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0000b10c0 0x7fb0000b14a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 -- 172.21.15.12:0/1461255420 >> 172.21.15.12:0/1461255420 conn(0x7fb00005f6b0 msgr2=0x7fb00005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 -- 172.21.15.12:0/1461255420 shutdown_connections 2021-10-20T23:26:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 -- 172.21.15.12:0/1461255420 wait complete. 2021-10-20T23:26:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 Processor -- start 2021-10-20T23:26:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.088+0000 7fb007d7a700 1 -- start start 2021-10-20T23:26:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb007d7a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000acb70 0x7fb000141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb007d7a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0000b10c0 0x7fb00014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb007d7a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb000140ba0 0x7fb00013f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb007d7a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb000142200 con 0x7fb0000b10c0 2021-10-20T23:26:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb007d7a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00014e400 con 0x7fb0000acb70 2021-10-20T23:26:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb007d7a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00014e6a0 con 0x7fb000140ba0 2021-10-20T23:26:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005315700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0000b10c0 0x7fb00014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005b16700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000acb70 0x7fb000141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005315700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0000b10c0 0x7fb00014ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41640/0 (socket says 172.21.15.12:41640) 2021-10-20T23:26:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005315700 1 -- 172.21.15.12:0/320192713 learned_addr learned my addr 172.21.15.12:0/320192713 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb006317700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb000140ba0 0x7fb00013f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005b16700 1 -- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb000140ba0 msgr2=0x7fb00013f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005b16700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb000140ba0 0x7fb00013f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005b16700 1 -- 172.21.15.12:0/320192713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0000b10c0 msgr2=0x7fb00014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005b16700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0000b10c0 0x7fb00014ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005b16700 1 -- 172.21.15.12:0/320192713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc00d410 con 0x7fb0000acb70 2021-10-20T23:26:50.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005315700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0000b10c0 0x7fb00014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:50.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.092+0000 7fb005b16700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000acb70 0x7fb000141bd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7faffc002f70 tx=0x7fb0000ac410).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:50.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fafeeffd700 1 -- 172.21.15.12:0/320192713 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faffc01f070 con 0x7fb0000acb70 2021-10-20T23:26:50.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fafeeffd700 1 -- 172.21.15.12:0/320192713 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc006b20 con 0x7fb0000acb70 2021-10-20T23:26:50.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00014e940 con 0x7fb0000acb70 2021-10-20T23:26:50.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fafeeffd700 1 -- 172.21.15.12:0/320192713 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faffc019660 con 0x7fb0000acb70 2021-10-20T23:26:50.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0001424e0 con 0x7fb0000acb70 2021-10-20T23:26:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fafeeffd700 1 -- 172.21.15.12:0/320192713 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faffc024460 con 0x7fb0000acb70 2021-10-20T23:26:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fafeeffd700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe00536a0 0x7fafe0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0000ac520 con 0x7fb0000acb70 2021-10-20T23:26:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fafeeffd700 1 -- 172.21.15.12:0/320192713 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6420+0+0 (secure 0 0 0) 0x7faffc06ee40 con 0x7fb0000acb70 2021-10-20T23:26:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.096+0000 7fb005315700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe00536a0 0x7fafe0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.100+0000 7fb005315700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe00536a0 0x7fafe0055b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7faff000d000 tx=0x7faff0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.104+0000 7fafeeffd700 1 -- 172.21.15.12:0/320192713 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faffc045d80 con 0x7fb0000acb70 2021-10-20T23:26:50.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.268+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb000057350 con 0x7fb0000acb70 2021-10-20T23:26:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.424+0000 7fafeeffd700 1 -- 172.21.15.12:0/320192713 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7faffc014070 con 0x7fb0000acb70 2021-10-20T23:26:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe00536a0 msgr2=0x7fafe0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe00536a0 0x7fafe0055b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7faff000d000 tx=0x7faff0009040).stop 2021-10-20T23:26:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000acb70 msgr2=0x7fb000141bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000acb70 0x7fb000141bd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7faffc002f70 tx=0x7fb0000ac410).stop 2021-10-20T23:26:50.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 shutdown_connections 2021-10-20T23:26:50.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fafe00536a0 0x7fafe0055b60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb000140ba0 0x7fb00013f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0000b10c0 0x7fb00014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 --2- 172.21.15.12:0/320192713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000acb70 0x7fb000141bd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 >> 172.21.15.12:0/320192713 conn(0x7fb00005f6b0 msgr2=0x7fb0000a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 shutdown_connections 2021-10-20T23:26:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.428+0000 7fb007d7a700 1 -- 172.21.15.12:0/320192713 wait complete. 2021-10-20T23:26:50.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 Processor -- start 2021-10-20T23:26:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 -- start start 2021-10-20T23:26:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 0x7f4708144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47080b0350 con 0x7f47081483a0 2021-10-20T23:26:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47080b05f0 con 0x7f47080b1db0 2021-10-20T23:26:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080a90c0 con 0x7f47080b0fd0 2021-10-20T23:26:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f47077fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f47081483a0 0x7f47080a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40242/0 (socket says 172.21.15.12:40242) 2021-10-20T23:26:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f47077fe700 1 -- 172.21.15.12:0/127329957 learned_addr learned my addr 172.21.15.12:0/127329957 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470c8eb700 1 --2- 172.21.15.12:0/127329957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 0x7f4708144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f4706ffd700 1 -- 172.21.15.12:0/127329957 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362782874 0 0) 0x7f47080b0350 con 0x7f47081483a0 2021-10-20T23:26:50.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f4706ffd700 1 -- 172.21.15.12:0/127329957 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46f4003260 con 0x7f47081483a0 2021-10-20T23:26:50.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f4706ffd700 1 -- 172.21.15.12:0/127329957 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339031959 0 0) 0x7f47080b05f0 con 0x7f47080b1db0 2021-10-20T23:26:50.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f4706ffd700 1 -- 172.21.15.12:0/127329957 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47080b0350 con 0x7f47080b1db0 2021-10-20T23:26:50.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470c8eb700 1 -- 172.21.15.12:0/127329957 >> v1:172.21.15.31:6789/0 conn(0x7f47080b1db0 legacy=0x7f47080b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470c8eb700 1 -- 172.21.15.12:0/127329957 >> v1:172.21.15.12:6789/0 conn(0x7f47081483a0 legacy=0x7f47080a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470c8eb700 1 -- 172.21.15.12:0/127329957 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080b0890 con 0x7f47080b0fd0 2021-10-20T23:26:50.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470c8eb700 1 --2- 172.21.15.12:0/127329957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 0x7f4708144720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4708147730 tx=0x7f4700006df0).ready entity=mon.2 client_cookie=954b11a091bcabd server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:50.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f4706ffd700 1 -- 172.21.15.12:0/127329957 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f470000d5c0 con 0x7f47080b0fd0 2021-10-20T23:26:50.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f4706ffd700 1 -- 172.21.15.12:0/127329957 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4700000e90 con 0x7f47080b0fd0 2021-10-20T23:26:50.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f4706ffd700 1 -- 172.21.15.12:0/127329957 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f470000d910 con 0x7f47080b0fd0 2021-10-20T23:26:50.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 -- 172.21.15.12:0/127329957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 msgr2=0x7f4708144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 --2- 172.21.15.12:0/127329957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 0x7f4708144720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4708147730 tx=0x7f4700006df0).stop 2021-10-20T23:26:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 -- 172.21.15.12:0/127329957 shutdown_connections 2021-10-20T23:26:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 --2- 172.21.15.12:0/127329957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 0x7f4708144720 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 -- 172.21.15.12:0/127329957 >> 172.21.15.12:0/127329957 conn(0x7f470805f6b0 msgr2=0x7f470805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 -- 172.21.15.12:0/127329957 shutdown_connections 2021-10-20T23:26:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.556+0000 7f470e34e700 1 -- 172.21.15.12:0/127329957 wait complete. 2021-10-20T23:26:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 Processor -- start 2021-10-20T23:26:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 -- start start 2021-10-20T23:26:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 0x7f47080ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47080b1db0 0x7f47080ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47081483a0 0x7f47081438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080a97c0 con 0x7f47080b1db0 2021-10-20T23:26:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470814a980 con 0x7f47081483a0 2021-10-20T23:26:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470814ab70 con 0x7f47080b0fd0 2021-10-20T23:26:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47080b1db0 0x7f47080ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47080b1db0 0x7f47080ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41652/0 (socket says 172.21.15.12:41652) 2021-10-20T23:26:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47077fe700 1 -- 172.21.15.12:0/3592426797 learned_addr learned my addr 172.21.15.12:0/3592426797 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f4707fff700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 0x7f47080ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470c8eb700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47081483a0 0x7f47081438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47077fe700 1 -- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 msgr2=0x7f47080ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47077fe700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 0x7f47080ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47077fe700 1 -- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47081483a0 msgr2=0x7f47081438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47077fe700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47081483a0 0x7f47081438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47077fe700 1 -- 172.21.15.12:0/3592426797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470000b180 con 0x7f47080b1db0 2021-10-20T23:26:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470c8eb700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47081483a0 0x7f47081438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47077fe700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47080b1db0 0x7f47080ab7b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f46fc001110 tx=0x7f46fc007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47057fa700 1 -- 172.21.15.12:0/3592426797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46fc0070d0 con 0x7f47080b1db0 2021-10-20T23:26:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470814b120 con 0x7f47080b1db0 2021-10-20T23:26:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47057fa700 1 -- 172.21.15.12:0/3592426797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc007230 con 0x7f47080b1db0 2021-10-20T23:26:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47080ab4a0 con 0x7f47080b1db0 2021-10-20T23:26:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.560+0000 7f47057fa700 1 -- 172.21.15.12:0/3592426797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46fc005610 con 0x7f47080b1db0 2021-10-20T23:26:50.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.564+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4708057350 con 0x7f47080b1db0 2021-10-20T23:26:50.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.564+0000 7f47057fa700 1 -- 172.21.15.12:0/3592426797 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f46fc010070 con 0x7f47080b1db0 2021-10-20T23:26:50.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.564+0000 7f47057fa700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f46e8053610 0x7f46e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.564+0000 7f47057fa700 1 -- 172.21.15.12:0/3592426797 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f46fc06b280 con 0x7f47080b1db0 2021-10-20T23:26:50.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.564+0000 7f4707fff700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f46e8053610 0x7f46e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.568+0000 7f4707fff700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f46e8053610 0x7f46e8055ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f46f800d000 tx=0x7f46f8007da0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:50.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.572+0000 7f47057fa700 1 -- 172.21.15.12:0/3592426797 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46fc0420f0 con 0x7f47080b1db0 2021-10-20T23:26:50.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.736+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4708044650 con 0x7f47080b1db0 2021-10-20T23:26:50.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.736+0000 7f47057fa700 1 -- 172.21.15.12:0/3592426797 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f46fc045710 con 0x7f47080b1db0 2021-10-20T23:26:50.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:50.752 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5990,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/246201101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":246201101},{"type":"v1","addr":"172.21.15.12:6833","nonce":246201101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1822115331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1822115331},{"type":"v1","addr":"172.21.15.31:6835","nonce":1822115331}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:26:49.418101+0000","modified":"2021-10-20T23:26:50.420912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1566657212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1566657212},{"type":"v1","addr":"172.21.15.12:6835","nonce":1566657212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-20T23:26:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f46e8053610 msgr2=0x7f46e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f46e8053610 0x7f46e8055ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f46f800d000 tx=0x7f46f8007da0).stop 2021-10-20T23:26:50.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47080b1db0 msgr2=0x7f47080ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47080b1db0 0x7f47080ab7b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f46fc001110 tx=0x7f46fc007af0).stop 2021-10-20T23:26:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 shutdown_connections 2021-10-20T23:26:50.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f46e8053610 0x7f46e8055ad0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47081483a0 0x7f47081438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47080b1db0 0x7f47080ab7b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 --2- 172.21.15.12:0/3592426797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47080b0fd0 0x7f47080ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 >> 172.21.15.12:0/3592426797 conn(0x7f470805f6b0 msgr2=0x7f47080b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:50.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 shutdown_connections 2021-10-20T23:26:50.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.740+0000 7f470e34e700 1 -- 172.21.15.12:0/3592426797 wait complete. 2021-10-20T23:26:50.791 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 43 2021-10-20T23:26:50.797 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:26:50.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f89622b6700 1 Processor -- start 2021-10-20T23:26:50.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f89622b6700 1 -- start start 2021-10-20T23:26:50.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f89622b6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0b2580 0x7f895c140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f89622b6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f895c0b00e0 0x7f895c140540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f89622b6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c067880 con 0x7f895c0ac6f0 2021-10-20T23:26:50.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f89622b6700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895c0ad5b0 con 0x7f895c0b00e0 2021-10-20T23:26:50.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f89622b6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c067b20 con 0x7f895c0b2580 2021-10-20T23:26:50.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f8960ab3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f895c0b00e0 0x7f895c140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f8960ab3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f895c0b00e0 0x7f895c140540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41660/0 (socket says 172.21.15.12:41660) 2021-10-20T23:26:50.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f8960ab3700 1 -- 172.21.15.12:0/2174549459 learned_addr learned my addr 172.21.15.12:0/2174549459 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:50.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f89612b4700 1 --2- 172.21.15.12:0/2174549459 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0b2580 0x7f895c140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f8960ab3700 1 -- 172.21.15.12:0/2174549459 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0b2580 msgr2=0x7f895c140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:50.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f8960ab3700 1 --2- 172.21.15.12:0/2174549459 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0b2580 0x7f895c140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f8960ab3700 1 -- 172.21.15.12:0/2174549459 >> v1:172.21.15.31:6789/0 conn(0x7f895c0ac6f0 legacy=0x7f895c142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f8960ab3700 1 -- 172.21.15.12:0/2174549459 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c146fd0 con 0x7f895c0b00e0 2021-10-20T23:26:50.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f8960ab3700 1 --2- 172.21.15.12:0/2174549459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 0x7f895c140540 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f894c002f70 tx=0x7f894c006eb0).ready entity=mon.0 client_cookie=e7e1d4e8973e44b2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:50.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f894bfff700 1 -- 172.21.15.12:0/2174549459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894c00d5c0 con 0x7f895c0b00e0 2021-10-20T23:26:50.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f894bfff700 1 -- 172.21.15.12:0/2174549459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c000e90 con 0x7f895c0b00e0 2021-10-20T23:26:50.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.900+0000 7f894bfff700 1 -- 172.21.15.12:0/2174549459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894c00d950 con 0x7f895c0b00e0 2021-10-20T23:26:50.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 -- 172.21.15.12:0/2174549459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 msgr2=0x7f895c140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 --2- 172.21.15.12:0/2174549459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 0x7f895c140540 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f894c002f70 tx=0x7f894c006eb0).stop 2021-10-20T23:26:50.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 -- 172.21.15.12:0/2174549459 shutdown_connections 2021-10-20T23:26:50.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 --2- 172.21.15.12:0/2174549459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 0x7f895c140540 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 --2- 172.21.15.12:0/2174549459 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0b2580 0x7f895c140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 -- 172.21.15.12:0/2174549459 >> 172.21.15.12:0/2174549459 conn(0x7f895c060180 msgr2=0x7f895c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:50.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 -- 172.21.15.12:0/2174549459 shutdown_connections 2021-10-20T23:26:50.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 -- 172.21.15.12:0/2174549459 wait complete. 2021-10-20T23:26:50.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 Processor -- start 2021-10-20T23:26:50.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 -- start start 2021-10-20T23:26:50.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0ac6f0 0x7f895c09f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 0x7f895c0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895c0b2580 0x7f895c0a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c142be0 con 0x7f895c0b00e0 2021-10-20T23:26:50.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c1433c0 con 0x7f895c0b2580 2021-10-20T23:26:50.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89622b6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c143660 con 0x7f895c0ac6f0 2021-10-20T23:26:50.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8960ab3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 0x7f895c0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8960ab3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 0x7f895c0b4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41668/0 (socket says 172.21.15.12:41668) 2021-10-20T23:26:50.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8960ab3700 1 -- 172.21.15.12:0/2711521023 learned_addr learned my addr 172.21.15.12:0/2711521023 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:50.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f89612b4700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0ac6f0 0x7f895c09f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8961ab5700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895c0b2580 0x7f895c0a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8960ab3700 1 -- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0ac6f0 msgr2=0x7f895c09f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8960ab3700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0ac6f0 0x7f895c09f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8960ab3700 1 -- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895c0b2580 msgr2=0x7f895c0a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:50.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8960ab3700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895c0b2580 0x7f895c0a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:50.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8960ab3700 1 -- 172.21.15.12:0/2711521023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c00b1e0 con 0x7f895c0b00e0 2021-10-20T23:26:50.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f8960ab3700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 0x7f895c0b4020 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f894c002f70 tx=0x7f894c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:50.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.904+0000 7f894a7fc700 1 -- 172.21.15.12:0/2711521023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894c00d960 con 0x7f895c0b00e0 2021-10-20T23:26:50.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.908+0000 7f894a7fc700 1 -- 172.21.15.12:0/2711521023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c011b80 con 0x7f895c0b00e0 2021-10-20T23:26:50.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.908+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c140d10 con 0x7f895c0b00e0 2021-10-20T23:26:50.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.908+0000 7f894a7fc700 1 -- 172.21.15.12:0/2711521023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894c01e460 con 0x7f895c0b00e0 2021-10-20T23:26:50.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.908+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c142720 con 0x7f895c0b00e0 2021-10-20T23:26:50.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.908+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895c143860 con 0x7f895c0b00e0 2021-10-20T23:26:50.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.908+0000 7f894a7fc700 1 -- 172.21.15.12:0/2711521023 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f894c025030 con 0x7f895c0b00e0 2021-10-20T23:26:50.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.908+0000 7f894a7fc700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f893c0535b0 0x7f893c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:50.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.908+0000 7f894a7fc700 1 -- 172.21.15.12:0/2711521023 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f894c06cbb0 con 0x7f895c0b00e0 2021-10-20T23:26:50.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.908+0000 7f89612b4700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f893c0535b0 0x7f893c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:50.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.912+0000 7f89612b4700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f893c0535b0 0x7f893c055a70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f895800c000 tx=0x7f8958008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:50.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:50.912+0000 7f894a7fc700 1 -- 172.21.15.12:0/2711521023 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f894c043ae0 con 0x7f895c0b00e0 2021-10-20T23:26:51.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.040+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f895c057350 con 0x7f895c0b00e0 2021-10-20T23:26:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f894a7fc700 1 -- 172.21.15.12:0/2711521023 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f894c0470c0 con 0x7f895c0b00e0 2021-10-20T23:26:51.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:51.053 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:26:50.421718+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:26:47.507897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-20T23:26:48.434318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:26:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f893c0535b0 msgr2=0x7f893c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f893c0535b0 0x7f893c055a70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f895800c000 tx=0x7f8958008040).stop 2021-10-20T23:26:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 msgr2=0x7f895c0b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 0x7f895c0b4020 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f894c002f70 tx=0x7f894c015000).stop 2021-10-20T23:26:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 shutdown_connections 2021-10-20T23:26:51.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f893c0535b0 0x7f893c055a70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895c0b2580 0x7f895c0a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f895c0b00e0 0x7f895c0b4020 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 --2- 172.21.15.12:0/2711521023 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f895c0ac6f0 0x7f895c09f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 >> 172.21.15.12:0/2711521023 conn(0x7f895c060180 msgr2=0x7f895c05ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 shutdown_connections 2021-10-20T23:26:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.044+0000 7f89622b6700 1 -- 172.21.15.12:0/2711521023 wait complete. 2021-10-20T23:26:51.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:26:51.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.176+0000 7fcc5e2e7700 1 Processor -- start 2021-10-20T23:26:51.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.176+0000 7fcc5e2e7700 1 -- start start 2021-10-20T23:26:51.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc580ad320 0x7fcc580af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580ad850 0x7fcc580a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc580afda0 con 0x7fcc580af2c0 2021-10-20T23:26:51.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5805c610 con 0x7fcc580ad320 2021-10-20T23:26:51.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc58140800 con 0x7fcc580ad850 2021-10-20T23:26:51.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5d2e5700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcc580af2c0 0x7fcc58143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40268/0 (socket says 172.21.15.12:40268) 2021-10-20T23:26:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5d2e5700 1 -- 172.21.15.12:0/977616251 learned_addr learned my addr 172.21.15.12:0/977616251 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5cae4700 1 --2- 172.21.15.12:0/977616251 >> v2:172.21.15.31:3300/0 conn(0x7fcc580ad320 0x7fcc580af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5dae6700 1 --2- 172.21.15.12:0/977616251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580ad850 0x7fcc580a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc47fff700 1 -- 172.21.15.12:0/977616251 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626936131 0 0) 0x7fcc580afda0 con 0x7fcc580af2c0 2021-10-20T23:26:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc47fff700 1 -- 172.21.15.12:0/977616251 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc40003260 con 0x7fcc580af2c0 2021-10-20T23:26:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5cae4700 1 -- 172.21.15.12:0/977616251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580ad850 msgr2=0x7fcc580a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5cae4700 1 --2- 172.21.15.12:0/977616251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580ad850 0x7fcc580a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5cae4700 1 -- 172.21.15.12:0/977616251 >> v1:172.21.15.12:6789/0 conn(0x7fcc580af2c0 legacy=0x7fcc58143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5cae4700 1 -- 172.21.15.12:0/977616251 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc58143860 con 0x7fcc580ad320 2021-10-20T23:26:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5dae6700 1 --2- 172.21.15.12:0/977616251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580ad850 0x7fcc580a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5cae4700 1 --2- 172.21.15.12:0/977616251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc580ad320 0x7fcc580af6a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fcc580ad770 tx=0x7fcc48006df0).ready entity=mon.1 client_cookie=ee70626feedf8b17 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc47fff700 1 -- 172.21.15.12:0/977616251 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc4800d570 con 0x7fcc580ad320 2021-10-20T23:26:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc47fff700 1 -- 172.21.15.12:0/977616251 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc48000e90 con 0x7fcc580ad320 2021-10-20T23:26:51.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc47fff700 1 -- 172.21.15.12:0/977616251 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc4800d8c0 con 0x7fcc580ad320 2021-10-20T23:26:51.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/977616251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc580ad320 msgr2=0x7fcc580af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 --2- 172.21.15.12:0/977616251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc580ad320 0x7fcc580af6a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fcc580ad770 tx=0x7fcc48006df0).stop 2021-10-20T23:26:51.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/977616251 shutdown_connections 2021-10-20T23:26:51.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 --2- 172.21.15.12:0/977616251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580ad850 0x7fcc580a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 --2- 172.21.15.12:0/977616251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc580ad320 0x7fcc580af6a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/977616251 >> 172.21.15.12:0/977616251 conn(0x7fcc58061140 msgr2=0x7fcc58062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/977616251 shutdown_connections 2021-10-20T23:26:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.180+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/977616251 wait complete. 2021-10-20T23:26:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5e2e7700 1 Processor -- start 2021-10-20T23:26:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5e2e7700 1 -- start start 2021-10-20T23:26:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5e2e7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc580ad320 0x7fcc580ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5e2e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc580ad850 0x7fcc580abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5e2e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580af2c0 0x7fcc580b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5e2e7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580a9c80 con 0x7fcc580ad320 2021-10-20T23:26:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5e2e7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580aa5a0 con 0x7fcc580ad850 2021-10-20T23:26:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5e2e7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580aaed0 con 0x7fcc580af2c0 2021-10-20T23:26:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5d2e5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc580ad320 0x7fcc580ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5d2e5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc580ad320 0x7fcc580ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41680/0 (socket says 172.21.15.12:41680) 2021-10-20T23:26:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5d2e5700 1 -- 172.21.15.12:0/3884249956 learned_addr learned my addr 172.21.15.12:0/3884249956 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5cae4700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc580ad850 0x7fcc580abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.184+0000 7fcc5dae6700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580af2c0 0x7fcc580b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5d2e5700 1 -- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580af2c0 msgr2=0x7fcc580b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5d2e5700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580af2c0 0x7fcc580b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5d2e5700 1 -- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc580ad850 msgr2=0x7fcc580abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5d2e5700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc580ad850 0x7fcc580abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5d2e5700 1 -- 172.21.15.12:0/3884249956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc50009470 con 0x7fcc580ad320 2021-10-20T23:26:51.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5dae6700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580af2c0 0x7fcc580b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:51.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5d2e5700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc580ad320 0x7fcc580ab7b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fcc580a9a40 tx=0x7fcc54007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:51.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc467fc700 1 -- 172.21.15.12:0/3884249956 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc540070d0 con 0x7fcc580ad320 2021-10-20T23:26:51.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc467fc700 1 -- 172.21.15.12:0/3884249956 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc54007230 con 0x7fcc580ad320 2021-10-20T23:26:51.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4800b180 con 0x7fcc580ad320 2021-10-20T23:26:51.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc467fc700 1 -- 172.21.15.12:0/3884249956 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc54005610 con 0x7fcc580ad320 2021-10-20T23:26:51.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc58137c00 con 0x7fcc580ad320 2021-10-20T23:26:51.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc58057350 con 0x7fcc580ad320 2021-10-20T23:26:51.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc467fc700 1 -- 172.21.15.12:0/3884249956 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc54010070 con 0x7fcc580ad320 2021-10-20T23:26:51.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc467fc700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcc380536d0 0x7fcc38055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.188+0000 7fcc467fc700 1 -- 172.21.15.12:0/3884249956 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcc5406b150 con 0x7fcc580ad320 2021-10-20T23:26:51.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.192+0000 7fcc5cae4700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcc380536d0 0x7fcc38055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.192+0000 7fcc5cae4700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcc380536d0 0x7fcc38055b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fcc4801a000 tx=0x7fcc48014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:51.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.196+0000 7fcc467fc700 1 -- 172.21.15.12:0/3884249956 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc54042040 con 0x7fcc580ad320 2021-10-20T23:26:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.364+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcc580ac840 con 0x7fcc580ad320 2021-10-20T23:26:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc467fc700 1 -- 172.21.15.12:0/3884249956 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcc54045660 con 0x7fcc580ad320 2021-10-20T23:26:51.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcc380536d0 msgr2=0x7fcc38055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcc380536d0 0x7fcc38055b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fcc4801a000 tx=0x7fcc48014000).stop 2021-10-20T23:26:51.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc580ad320 msgr2=0x7fcc580ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc580ad320 0x7fcc580ab7b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fcc580a9a40 tx=0x7fcc54007ad0).stop 2021-10-20T23:26:51.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 shutdown_connections 2021-10-20T23:26:51.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcc380536d0 0x7fcc38055b90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc580af2c0 0x7fcc580b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc580ad850 0x7fcc580abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 --2- 172.21.15.12:0/3884249956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc580ad320 0x7fcc580ab7b0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 >> 172.21.15.12:0/3884249956 conn(0x7fcc58061140 msgr2=0x7fcc5813e130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:51.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 shutdown_connections 2021-10-20T23:26:51.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.372+0000 7fcc5e2e7700 1 -- 172.21.15.12:0/3884249956 wait complete. 2021-10-20T23:26:51.390 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:26:51.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:26:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f6523fff700 1 Processor -- start 2021-10-20T23:26:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f6523fff700 1 -- start start 2021-10-20T23:26:51.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f6523fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240669d0 0x7f652413e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f6523fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652405f750 con 0x7f65240b1a30 2021-10-20T23:26:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f6523fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65240b14a0 con 0x7f65240665f0 2021-10-20T23:26:51.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f6523fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652405f980 con 0x7f65240669d0 2021-10-20T23:26:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f651bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f65240b1a30 0x7f6524140cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40284/0 (socket says 172.21.15.12:40284) 2021-10-20T23:26:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f651bfff700 1 -- 172.21.15.12:0/2692705109 learned_addr learned my addr 172.21.15.12:0/2692705109 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f65237fe700 1 --2- 172.21.15.12:0/2692705109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240669d0 0x7f652413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f65227fc700 1 -- 172.21.15.12:0/2692705109 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785014756 0 0) 0x7f652405f750 con 0x7f65240b1a30 2021-10-20T23:26:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f65227fc700 1 -- 172.21.15.12:0/2692705109 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6504003260 con 0x7f65240b1a30 2021-10-20T23:26:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f65237fe700 1 -- 172.21.15.12:0/2692705109 >> v1:172.21.15.31:6789/0 conn(0x7f65240665f0 legacy=0x7f652405fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f65237fe700 1 -- 172.21.15.12:0/2692705109 >> v1:172.21.15.12:6789/0 conn(0x7f65240b1a30 legacy=0x7f6524140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.504+0000 7f65237fe700 1 -- 172.21.15.12:0/2692705109 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65240b1740 con 0x7f65240669d0 2021-10-20T23:26:51.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f65237fe700 1 --2- 172.21.15.12:0/2692705109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240669d0 0x7f652413e120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f651c0032f0 tx=0x7f651c0091d0).ready entity=mon.2 client_cookie=c5d4d7b099e905ef server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:51.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f65227fc700 1 -- 172.21.15.12:0/2692705109 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f651c00b6c0 con 0x7f65240669d0 2021-10-20T23:26:51.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f65227fc700 1 -- 172.21.15.12:0/2692705109 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c00b820 con 0x7f65240669d0 2021-10-20T23:26:51.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f65227fc700 1 -- 172.21.15.12:0/2692705109 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f651c00b990 con 0x7f65240669d0 2021-10-20T23:26:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 -- 172.21.15.12:0/2692705109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240669d0 msgr2=0x7f652413e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 --2- 172.21.15.12:0/2692705109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240669d0 0x7f652413e120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f651c0032f0 tx=0x7f651c0091d0).stop 2021-10-20T23:26:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 -- 172.21.15.12:0/2692705109 shutdown_connections 2021-10-20T23:26:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 --2- 172.21.15.12:0/2692705109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240669d0 0x7f652413e120 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 -- 172.21.15.12:0/2692705109 >> 172.21.15.12:0/2692705109 conn(0x7f65240636e0 msgr2=0x7f6524063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:51.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 -- 172.21.15.12:0/2692705109 shutdown_connections 2021-10-20T23:26:51.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 -- 172.21.15.12:0/2692705109 wait complete. 2021-10-20T23:26:51.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 Processor -- start 2021-10-20T23:26:51.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 -- start start 2021-10-20T23:26:51.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65240665f0 0x7f652413cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65240669d0 0x7f6524144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240b1a30 0x7f6524144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652413b1b0 con 0x7f65240669d0 2021-10-20T23:26:51.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652413b880 con 0x7f65240665f0 2021-10-20T23:26:51.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6523fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6524065050 con 0x7f65240b1a30 2021-10-20T23:26:51.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f651bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65240669d0 0x7f6524144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f651bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65240669d0 0x7f6524144150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41696/0 (socket says 172.21.15.12:41696) 2021-10-20T23:26:51.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f651bfff700 1 -- 172.21.15.12:0/4141476191 learned_addr learned my addr 172.21.15.12:0/4141476191 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:51.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6522ffd700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65240665f0 0x7f652413cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f65237fe700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240b1a30 0x7f6524144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f651bfff700 1 -- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240b1a30 msgr2=0x7f6524144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f651bfff700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240b1a30 0x7f6524144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f651bfff700 1 -- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65240665f0 msgr2=0x7f652413cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f651bfff700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65240665f0 0x7f652413cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f651bfff700 1 -- 172.21.15.12:0/4141476191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c009470 con 0x7f65240669d0 2021-10-20T23:26:51.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.508+0000 7f6522ffd700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65240665f0 0x7f652413cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:51.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f651bfff700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65240669d0 0x7f6524144150 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f650c001110 tx=0x7f650c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:51.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6520ff9700 1 -- 172.21.15.12:0/4141476191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f650c00ce00 con 0x7f65240669d0 2021-10-20T23:26:51.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6520ff9700 1 -- 172.21.15.12:0/4141476191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c0070d0 con 0x7f65240669d0 2021-10-20T23:26:51.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6520ff9700 1 -- 172.21.15.12:0/4141476191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f650c007430 con 0x7f65240669d0 2021-10-20T23:26:51.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652413b3e0 con 0x7f65240669d0 2021-10-20T23:26:51.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652413aca0 con 0x7f65240669d0 2021-10-20T23:26:51.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65240b1120 con 0x7f65240669d0 2021-10-20T23:26:51.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6520ff9700 1 -- 172.21.15.12:0/4141476191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f650c010070 con 0x7f65240669d0 2021-10-20T23:26:51.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6520ff9700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6508053610 0x7f6508055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6520ff9700 1 -- 172.21.15.12:0/4141476191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f650c06b120 con 0x7f65240669d0 2021-10-20T23:26:51.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.512+0000 7f6522ffd700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6508053610 0x7f6508055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.516+0000 7f6522ffd700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6508053610 0x7f6508055ad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f651400d000 tx=0x7f6514009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:51.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.520+0000 7f6520ff9700 1 -- 172.21.15.12:0/4141476191 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f650c042010 con 0x7f65240669d0 2021-10-20T23:26:51.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.688+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6524057350 con 0x7f65240669d0 2021-10-20T23:26:51.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.696+0000 7f6520ff9700 1 -- 172.21.15.12:0/4141476191 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f650c018030 con 0x7f65240669d0 2021-10-20T23:26:51.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6508053610 msgr2=0x7f6508055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6508053610 0x7f6508055ad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f651400d000 tx=0x7f6514009040).stop 2021-10-20T23:26:51.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65240669d0 msgr2=0x7f6524144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65240669d0 0x7f6524144150 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f650c001110 tx=0x7f650c007aa0).stop 2021-10-20T23:26:51.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 shutdown_connections 2021-10-20T23:26:51.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6508053610 0x7f6508055ad0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65240b1a30 0x7f6524144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65240669d0 0x7f6524144150 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 --2- 172.21.15.12:0/4141476191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65240665f0 0x7f652413cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 >> 172.21.15.12:0/4141476191 conn(0x7f65240636e0 msgr2=0x7f65240b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:51.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 shutdown_connections 2021-10-20T23:26:51.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.700+0000 7f6523fff700 1 -- 172.21.15.12:0/4141476191 wait complete. 2021-10-20T23:26:51.715 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:26:51.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:51.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.820+0000 7fe9f61bc700 1 Processor -- start 2021-10-20T23:26:51.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.820+0000 7fe9f61bc700 1 -- start start 2021-10-20T23:26:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.820+0000 7fe9f61bc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00b04a0 0x7fe9f00add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.820+0000 7fe9f61bc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9f00aa120 0x7fe9f00ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.820+0000 7fe9f61bc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f00b2af0 con 0x7fe9f00b0880 2021-10-20T23:26:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.820+0000 7fe9f61bc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f00b2770 con 0x7fe9f00aa120 2021-10-20T23:26:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.820+0000 7fe9f61bc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00b2d20 con 0x7fe9f00b04a0 2021-10-20T23:26:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9ef7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00b04a0 0x7fe9f00add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9e7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9f00aa120 0x7fe9f00ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9ef7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00b04a0 0x7fe9f00add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:47462/0 (socket says 172.21.15.12:47462) 2021-10-20T23:26:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9ef7fe700 1 -- 172.21.15.12:0/2602080802 learned_addr learned my addr 172.21.15.12:0/2602080802 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:51.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9eeffd700 1 -- 172.21.15.12:0/2602080802 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681650414 0 0) 0x7fe9f00b2af0 con 0x7fe9f00b0880 2021-10-20T23:26:51.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9eeffd700 1 -- 172.21.15.12:0/2602080802 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d0003260 con 0x7fe9f00b0880 2021-10-20T23:26:51.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9ef7fe700 1 -- 172.21.15.12:0/2602080802 >> v2:172.21.15.31:3300/0 conn(0x7fe9f00aa120 msgr2=0x7fe9f00ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:51.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9ef7fe700 1 --2- 172.21.15.12:0/2602080802 >> v2:172.21.15.31:3300/0 conn(0x7fe9f00aa120 0x7fe9f00ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9ef7fe700 1 -- 172.21.15.12:0/2602080802 >> v1:172.21.15.31:6789/0 conn(0x7fe9f00b0880 legacy=0x7fe9f0143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9ef7fe700 1 -- 172.21.15.12:0/2602080802 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f00a9b70 con 0x7fe9f00b04a0 2021-10-20T23:26:51.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9e7fff700 1 --2- 172.21.15.12:0/2602080802 >> v2:172.21.15.31:3300/0 conn(0x7fe9f00aa120 0x7fe9f00ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:51.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9ef7fe700 1 --2- 172.21.15.12:0/2602080802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00b04a0 0x7fe9f00add30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fe9e0002f70 tx=0x7fe9e0006f40).ready entity=mon.2 client_cookie=35ab9ed255e25ab3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:51.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9eeffd700 1 -- 172.21.15.12:0/2602080802 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e000d9a0 con 0x7fe9f00b04a0 2021-10-20T23:26:51.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9eeffd700 1 -- 172.21.15.12:0/2602080802 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e0000e90 con 0x7fe9f00b04a0 2021-10-20T23:26:51.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9eeffd700 1 -- 172.21.15.12:0/2602080802 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e000dd30 con 0x7fe9f00b04a0 2021-10-20T23:26:51.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9f61bc700 1 -- 172.21.15.12:0/2602080802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00b04a0 msgr2=0x7fe9f00add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9f61bc700 1 --2- 172.21.15.12:0/2602080802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00b04a0 0x7fe9f00add30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fe9e0002f70 tx=0x7fe9e0006f40).stop 2021-10-20T23:26:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9f61bc700 1 -- 172.21.15.12:0/2602080802 shutdown_connections 2021-10-20T23:26:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9f61bc700 1 --2- 172.21.15.12:0/2602080802 >> v2:172.21.15.31:3300/0 conn(0x7fe9f00aa120 0x7fe9f00ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9f61bc700 1 --2- 172.21.15.12:0/2602080802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00b04a0 0x7fe9f00add30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9f61bc700 1 -- 172.21.15.12:0/2602080802 >> 172.21.15.12:0/2602080802 conn(0x7fe9f00607c0 msgr2=0x7fe9f0060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:51.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9f61bc700 1 -- 172.21.15.12:0/2602080802 shutdown_connections 2021-10-20T23:26:51.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.824+0000 7fe9f61bc700 1 -- 172.21.15.12:0/2602080802 wait complete. 2021-10-20T23:26:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 Processor -- start 2021-10-20T23:26:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 -- start start 2021-10-20T23:26:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00aa120 0x7fe9f014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f00b04a0 0x7fe9f00b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9f00b0880 0x7fe9f0151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f0151620 con 0x7fe9f00b0880 2021-10-20T23:26:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00642d0 con 0x7fe9f00b04a0 2021-10-20T23:26:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00638d0 con 0x7fe9f00aa120 2021-10-20T23:26:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9effff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9f00b0880 0x7fe9f0151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9e7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f00b04a0 0x7fe9f00b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9effff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9f00b0880 0x7fe9f0151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41712/0 (socket says 172.21.15.12:41712) 2021-10-20T23:26:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9ef7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00aa120 0x7fe9f014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9effff700 1 -- 172.21.15.12:0/3614290798 learned_addr learned my addr 172.21.15.12:0/3614290798 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9e7fff700 1 -- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00aa120 msgr2=0x7fe9f014e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9e7fff700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00aa120 0x7fe9f014e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9e7fff700 1 -- 172.21.15.12:0/3614290798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9f00b0880 msgr2=0x7fe9f0151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9e7fff700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9f00b0880 0x7fe9f0151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9e7fff700 1 -- 172.21.15.12:0/3614290798 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d800b180 con 0x7fe9f00b04a0 2021-10-20T23:26:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9effff700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9f00b0880 0x7fe9f0151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9e7fff700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f00b04a0 0x7fe9f00b4c50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fe9d800c000 tx=0x7fe9d8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9ed7fa700 1 -- 172.21.15.12:0/3614290798 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d8010780 con 0x7fe9f00b04a0 2021-10-20T23:26:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9ed7fa700 1 -- 172.21.15.12:0/3614290798 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d80108e0 con 0x7fe9f00b04a0 2021-10-20T23:26:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e000b460 con 0x7fe9f00b04a0 2021-10-20T23:26:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9ed7fa700 1 -- 172.21.15.12:0/3614290798 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d8010c40 con 0x7fe9f00b04a0 2021-10-20T23:26:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.828+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f0063e10 con 0x7fe9f00b04a0 2021-10-20T23:26:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.832+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f0063fd0 con 0x7fe9f00b04a0 2021-10-20T23:26:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.832+0000 7fe9ed7fa700 1 -- 172.21.15.12:0/3614290798 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9d801c460 con 0x7fe9f00b04a0 2021-10-20T23:26:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.832+0000 7fe9ed7fa700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9d40534f0 0x7fe9d40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.832+0000 7fe9ed7fa700 1 -- 172.21.15.12:0/3614290798 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe9d806bf50 con 0x7fe9f00b04a0 2021-10-20T23:26:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.832+0000 7fe9ef7fe700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9d40534f0 0x7fe9d40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.832+0000 7fe9ef7fe700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9d40534f0 0x7fe9d40559b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fe9e001e000 tx=0x7fe9e0006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:51.840+0000 7fe9ed7fa700 1 -- 172.21.15.12:0/3614290798 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9d8042ef0 con 0x7fe9f00b04a0 2021-10-20T23:26:52.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.004+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9f0057350 con 0x7fe9f00b04a0 2021-10-20T23:26:52.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9ed7fa700 1 -- 172.21.15.12:0/3614290798 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fe9d8046510 con 0x7fe9f00b04a0 2021-10-20T23:26:52.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:52.017 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5990,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/246201101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":246201101},{"type":"v1","addr":"172.21.15.12:6833","nonce":246201101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1822115331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1822115331},{"type":"v1","addr":"172.21.15.31:6835","nonce":1822115331}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:26:49.418101+0000","modified":"2021-10-20T23:26:50.420912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1566657212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1566657212},{"type":"v1","addr":"172.21.15.12:6835","nonce":1566657212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-20T23:26:52.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9d40534f0 msgr2=0x7fe9d40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9d40534f0 0x7fe9d40559b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fe9e001e000 tx=0x7fe9e0006f40).stop 2021-10-20T23:26:52.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f00b04a0 msgr2=0x7fe9f00b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f00b04a0 0x7fe9f00b4c50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fe9d800c000 tx=0x7fe9d8006df0).stop 2021-10-20T23:26:52.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 shutdown_connections 2021-10-20T23:26:52.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9d40534f0 0x7fe9d40559b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9f00b0880 0x7fe9f0151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f00b04a0 0x7fe9f00b4c50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 --2- 172.21.15.12:0/3614290798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f00aa120 0x7fe9f014e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 >> 172.21.15.12:0/3614290798 conn(0x7fe9f00607c0 msgr2=0x7fe9f00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 shutdown_connections 2021-10-20T23:26:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.008+0000 7fe9f61bc700 1 -- 172.21.15.12:0/3614290798 wait complete. 2021-10-20T23:26:52.022 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 43 2021-10-20T23:26:52.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:26:49.418101+0000', 'modified': '2021-10-20T23:26:50.420912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6600}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6600': {'gid': 6600, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1566657212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1566657212}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1566657212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:26:52.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:26:52.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:26:52.466 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6600,"want_state":"up:active","state":"up:active","rank_uptime":3.0305241289999998,"mdsmap_epoch":43,"osdmap_epoch":91,"osdmap_epoch_barrier":90,"uptime":7.7262538000000003} 2021-10-20T23:26:52.467 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6600, "mdsmap_epoch": 43, "osdmap_epoch": 91, "osdmap_epoch_barrier": 90, "rank_uptime": 3.030524129, "state": "up:active", "uptime": 7.7262538, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:26:52.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:26:52.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.564+0000 7f262226d700 1 Processor -- start 2021-10-20T23:26:52.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.564+0000 7f262226d700 1 -- start start 2021-10-20T23:26:52.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f261c0b76b0 0x7f261c065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f261c0b2ee0 0x7f261c060f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0b2a90 con 0x7f261c14aeb0 2021-10-20T23:26:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c065a80 con 0x7f261c0b76b0 2021-10-20T23:26:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0b7a90 con 0x7f261c0b2ee0 2021-10-20T23:26:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262126b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f261c0b76b0 0x7f261c065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f2621a6c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f261c14aeb0 0x7f261c14b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40314/0 (socket says 172.21.15.12:40314) 2021-10-20T23:26:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f2621a6c700 1 -- 172.21.15.12:0/1197173578 learned_addr learned my addr 172.21.15.12:0/1197173578 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f2620a6a700 1 --2- 172.21.15.12:0/1197173578 >> v2:172.21.15.31:3300/0 conn(0x7f261c0b2ee0 0x7f261c060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f2613fff700 1 -- 172.21.15.12:0/1197173578 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209536097 0 0) 0x7f261c0b2a90 con 0x7f261c14aeb0 2021-10-20T23:26:52.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f2613fff700 1 -- 172.21.15.12:0/1197173578 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2600003260 con 0x7f261c14aeb0 2021-10-20T23:26:52.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262126b700 1 -- 172.21.15.12:0/1197173578 >> v2:172.21.15.31:3300/0 conn(0x7f261c0b2ee0 msgr2=0x7f261c060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:52.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262126b700 1 --2- 172.21.15.12:0/1197173578 >> v2:172.21.15.31:3300/0 conn(0x7f261c0b2ee0 0x7f261c060f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262126b700 1 -- 172.21.15.12:0/1197173578 >> v1:172.21.15.12:6789/0 conn(0x7f261c14aeb0 legacy=0x7f261c14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262126b700 1 -- 172.21.15.12:0/1197173578 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0b27f0 con 0x7f261c0b76b0 2021-10-20T23:26:52.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262126b700 1 --2- 172.21.15.12:0/1197173578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c0b76b0 0x7f261c065590 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f2618002f70 tx=0x7f2618006df0).ready entity=mon.0 client_cookie=e41ff2074a194728 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:52.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f2613fff700 1 -- 172.21.15.12:0/1197173578 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f261800e470 con 0x7f261c0b76b0 2021-10-20T23:26:52.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f2613fff700 1 -- 172.21.15.12:0/1197173578 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618000e90 con 0x7f261c0b76b0 2021-10-20T23:26:52.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f2613fff700 1 -- 172.21.15.12:0/1197173578 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f261800e7c0 con 0x7f261c0b76b0 2021-10-20T23:26:52.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 -- 172.21.15.12:0/1197173578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c0b76b0 msgr2=0x7f261c065590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 --2- 172.21.15.12:0/1197173578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c0b76b0 0x7f261c065590 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f2618002f70 tx=0x7f2618006df0).stop 2021-10-20T23:26:52.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 -- 172.21.15.12:0/1197173578 shutdown_connections 2021-10-20T23:26:52.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 --2- 172.21.15.12:0/1197173578 >> v2:172.21.15.31:3300/0 conn(0x7f261c0b2ee0 0x7f261c060f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 --2- 172.21.15.12:0/1197173578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c0b76b0 0x7f261c065590 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 -- 172.21.15.12:0/1197173578 >> 172.21.15.12:0/1197173578 conn(0x7f261c05f6b0 msgr2=0x7f261c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 -- 172.21.15.12:0/1197173578 shutdown_connections 2021-10-20T23:26:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.568+0000 7f262226d700 1 -- 172.21.15.12:0/1197173578 wait complete. 2021-10-20T23:26:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 Processor -- start 2021-10-20T23:26:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 -- start start 2021-10-20T23:26:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f261c0b2ee0 0x7f261c0b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f261c0b76b0 0x7f261c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c14aeb0 0x7f261c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0a0570 con 0x7f261c14aeb0 2021-10-20T23:26:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0a02d0 con 0x7f261c0b2ee0 2021-10-20T23:26:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c159d50 con 0x7f261c0b76b0 2021-10-20T23:26:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2621a6c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c14aeb0 0x7f261c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2621a6c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c14aeb0 0x7f261c15a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41726/0 (socket says 172.21.15.12:41726) 2021-10-20T23:26:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2621a6c700 1 -- 172.21.15.12:0/1324696982 learned_addr learned my addr 172.21.15.12:0/1324696982 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2620a6a700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f261c0b76b0 0x7f261c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262126b700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f261c0b2ee0 0x7f261c0b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2621a6c700 1 -- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f261c0b76b0 msgr2=0x7f261c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2621a6c700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f261c0b76b0 0x7f261c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2621a6c700 1 -- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f261c0b2ee0 msgr2=0x7f261c0b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2621a6c700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f261c0b2ee0 0x7f261c0b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2621a6c700 1 -- 172.21.15.12:0/1324696982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261800b120 con 0x7f261c14aeb0 2021-10-20T23:26:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f2621a6c700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c14aeb0 0x7f261c15a6e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f2614001490 tx=0x7f2614007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f26127fc700 1 -- 172.21.15.12:0/1324696982 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2614005ba0 con 0x7f261c14aeb0 2021-10-20T23:26:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f26127fc700 1 -- 172.21.15.12:0/1324696982 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614005d00 con 0x7f261c14aeb0 2021-10-20T23:26:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c0b0c80 con 0x7f261c14aeb0 2021-10-20T23:26:52.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f26127fc700 1 -- 172.21.15.12:0/1324696982 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26140072c0 con 0x7f261c14aeb0 2021-10-20T23:26:52.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.572+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c0b0fb0 con 0x7f261c14aeb0 2021-10-20T23:26:52.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.576+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c159f10 con 0x7f261c14aeb0 2021-10-20T23:26:52.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.576+0000 7f26127fc700 1 -- 172.21.15.12:0/1324696982 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2614010070 con 0x7f261c14aeb0 2021-10-20T23:26:52.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.576+0000 7f26127fc700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26040536a0 0x7f2604055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.576+0000 7f26127fc700 1 -- 172.21.15.12:0/1324696982 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f261406ba00 con 0x7f261c14aeb0 2021-10-20T23:26:52.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.576+0000 7f262126b700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26040536a0 0x7f2604055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.576+0000 7f262126b700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26040536a0 0x7f2604055b60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f261801a000 tx=0x7f2618014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:52.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.584+0000 7f26127fc700 1 -- 172.21.15.12:0/1324696982 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f26140429a0 con 0x7f261c14aeb0 2021-10-20T23:26:52.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.712+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f261c060850 con 0x7f261c14aeb0 2021-10-20T23:26:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f26127fc700 1 -- 172.21.15.12:0/1324696982 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f2614045fc0 con 0x7f261c14aeb0 2021-10-20T23:26:52.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:52.726 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:26:50.421718+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:26:47.507897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-20T23:26:48.434318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:26:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26040536a0 msgr2=0x7f2604055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26040536a0 0x7f2604055b60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f261801a000 tx=0x7f2618014000).stop 2021-10-20T23:26:52.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c14aeb0 msgr2=0x7f261c15a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c14aeb0 0x7f261c15a6e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f2614001490 tx=0x7f2614007e00).stop 2021-10-20T23:26:52.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 shutdown_connections 2021-10-20T23:26:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26040536a0 0x7f2604055b60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f261c14aeb0 0x7f261c15a6e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f261c0b76b0 0x7f261c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 --2- 172.21.15.12:0/1324696982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f261c0b2ee0 0x7f261c0b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 >> 172.21.15.12:0/1324696982 conn(0x7f261c05f6b0 msgr2=0x7f261c0b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:52.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 shutdown_connections 2021-10-20T23:26:52.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.716+0000 7f262226d700 1 -- 172.21.15.12:0/1324696982 wait complete. 2021-10-20T23:26:52.739 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:26:47.507897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:26:48.434318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:26:52.740 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:26:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19ecc1e700 1 Processor -- start 2021-10-20T23:26:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19ecc1e700 1 -- start start 2021-10-20T23:26:52.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19ecc1e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19e8144440 0x7f19e8144970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19ecc1e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19e8065420 0x7f19e8144e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19ecc1e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e8145350 con 0x7f19e8060100 2021-10-20T23:26:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19ecc1e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e8065c80 con 0x7f19e8144440 2021-10-20T23:26:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19ecc1e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80604e0 con 0x7f19e8065420 2021-10-20T23:26:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f19e8060100 0x7f19e8064d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40324/0 (socket says 172.21.15.12:40324) 2021-10-20T23:26:52.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e659c700 1 -- 172.21.15.12:0/3602267379 learned_addr learned my addr 172.21.15.12:0/3602267379 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:52.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e5d9b700 1 --2- 172.21.15.12:0/3602267379 >> v2:172.21.15.12:3300/0 conn(0x7f19e8144440 0x7f19e8144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e6d9d700 1 --2- 172.21.15.12:0/3602267379 >> v2:172.21.15.31:3300/0 conn(0x7f19e8065420 0x7f19e8144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e5d9b700 1 -- 172.21.15.12:0/3602267379 >> v2:172.21.15.31:3300/0 conn(0x7f19e8065420 msgr2=0x7f19e8144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:52.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e5d9b700 1 --2- 172.21.15.12:0/3602267379 >> v2:172.21.15.31:3300/0 conn(0x7f19e8065420 0x7f19e8144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e5d9b700 1 -- 172.21.15.12:0/3602267379 >> v1:172.21.15.12:6789/0 conn(0x7f19e8060100 legacy=0x7f19e8064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e559a700 1 -- 172.21.15.12:0/3602267379 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792612269 0 0) 0x7f19e8145350 con 0x7f19e8060100 2021-10-20T23:26:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e5d9b700 1 -- 172.21.15.12:0/3602267379 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80b23b0 con 0x7f19e8144440 2021-10-20T23:26:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e5d9b700 1 --2- 172.21.15.12:0/3602267379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e8144440 0x7f19e8144970 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f19dc002f70 tx=0x7f19dc006df0).ready entity=mon.0 client_cookie=239b24aaae9ecf8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e559a700 1 -- 172.21.15.12:0/3602267379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19dc00d5c0 con 0x7f19e8144440 2021-10-20T23:26:52.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e559a700 1 -- 172.21.15.12:0/3602267379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc000e90 con 0x7f19e8144440 2021-10-20T23:26:52.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.844+0000 7f19e559a700 1 -- 172.21.15.12:0/3602267379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19dc00d910 con 0x7f19e8144440 2021-10-20T23:26:52.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 -- 172.21.15.12:0/3602267379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e8144440 msgr2=0x7f19e8144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 --2- 172.21.15.12:0/3602267379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e8144440 0x7f19e8144970 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f19dc002f70 tx=0x7f19dc006df0).stop 2021-10-20T23:26:52.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 -- 172.21.15.12:0/3602267379 shutdown_connections 2021-10-20T23:26:52.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 --2- 172.21.15.12:0/3602267379 >> v2:172.21.15.31:3300/0 conn(0x7f19e8065420 0x7f19e8144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 --2- 172.21.15.12:0/3602267379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e8144440 0x7f19e8144970 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 -- 172.21.15.12:0/3602267379 >> 172.21.15.12:0/3602267379 conn(0x7f19e805cf60 msgr2=0x7f19e805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:52.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 -- 172.21.15.12:0/3602267379 shutdown_connections 2021-10-20T23:26:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 -- 172.21.15.12:0/3602267379 wait complete. 2021-10-20T23:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 Processor -- start 2021-10-20T23:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 -- start start 2021-10-20T23:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8060100 0x7f19e813b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e8065420 0x7f19e80aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80b0a70 0x7f19e80607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8062460 con 0x7f19e80b0a70 2021-10-20T23:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80b10c0 con 0x7f19e8065420 2021-10-20T23:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19ecc1e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80617c0 con 0x7f19e8060100 2021-10-20T23:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19e6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80b0a70 0x7f19e80607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19e5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e8065420 0x7f19e80aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19e659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8060100 0x7f19e813b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19e5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e8065420 0x7f19e80aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:56712/0 (socket says 172.21.15.12:56712) 2021-10-20T23:26:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19e5d9b700 1 -- 172.21.15.12:0/2117203383 learned_addr learned my addr 172.21.15.12:0/2117203383 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.848+0000 7f19e6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80b0a70 0x7f19e80607f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41740/0 (socket says 172.21.15.12:41740) 2021-10-20T23:26:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19e5d9b700 1 -- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8060100 msgr2=0x7f19e813b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19e5d9b700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8060100 0x7f19e813b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19e5d9b700 1 -- 172.21.15.12:0/2117203383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80b0a70 msgr2=0x7f19e80607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19e5d9b700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80b0a70 0x7f19e80607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19e5d9b700 1 -- 172.21.15.12:0/2117203383 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc00b180 con 0x7f19e8065420 2021-10-20T23:26:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19e5d9b700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e8065420 0x7f19e80aa4a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f19e8061d00 tx=0x7f19dc014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19d77fe700 1 -- 172.21.15.12:0/2117203383 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19dc013da0 con 0x7f19e8065420 2021-10-20T23:26:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19d77fe700 1 -- 172.21.15.12:0/2117203383 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc01e400 con 0x7f19e8065420 2021-10-20T23:26:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e8062690 con 0x7f19e8065420 2021-10-20T23:26:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19d77fe700 1 -- 172.21.15.12:0/2117203383 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19dc01e760 con 0x7f19e8065420 2021-10-20T23:26:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80aa990 con 0x7f19e8065420 2021-10-20T23:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e8057350 con 0x7f19e8065420 2021-10-20T23:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19d77fe700 1 -- 172.21.15.12:0/2117203383 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f19dc025030 con 0x7f19e8065420 2021-10-20T23:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.852+0000 7f19d77fe700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19c40534f0 0x7f19c40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.856+0000 7f19d77fe700 1 -- 172.21.15.12:0/2117203383 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f19dc06c9a0 con 0x7f19e8065420 2021-10-20T23:26:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.856+0000 7f19e659c700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19c40534f0 0x7f19c40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.856+0000 7f19e659c700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19c40534f0 0x7f19c40559b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f19d800d000 tx=0x7f19d8007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.864+0000 7f19d77fe700 1 -- 172.21.15.12:0/2117203383 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f19dc043910 con 0x7f19e8065420 2021-10-20T23:26:53.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.992+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f19e80698e0 con 0x7f19e8065420 2021-10-20T23:26:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19d77fe700 1 -- 172.21.15.12:0/2117203383 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v91) v1 ==== 110+0+10 (secure 0 0 0) 0x7f19dc023020 con 0x7f19e8065420 2021-10-20T23:26:53.005 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:26:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19c40534f0 msgr2=0x7f19c40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19ecc1e700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19c40534f0 0x7f19c40559b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f19d800d000 tx=0x7f19d8007a00).stop 2021-10-20T23:26:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e8065420 msgr2=0x7f19e80aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19ecc1e700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e8065420 0x7f19e80aa4a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f19e8061d00 tx=0x7f19dc014000).stop 2021-10-20T23:26:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 shutdown_connections 2021-10-20T23:26:53.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19ecc1e700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19c40534f0 0x7f19c40559b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19ecc1e700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80b0a70 0x7f19e80607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19ecc1e700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e8065420 0x7f19e80aa4a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:52.996+0000 7f19ecc1e700 1 --2- 172.21.15.12:0/2117203383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8060100 0x7f19e813b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.000+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 >> 172.21.15.12:0/2117203383 conn(0x7f19e805cf60 msgr2=0x7f19e8143700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.000+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 shutdown_connections 2021-10-20T23:26:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.000+0000 7f19ecc1e700 1 -- 172.21.15.12:0/2117203383 wait complete. 2021-10-20T23:26:53.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:26:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63fda02700 1 Processor -- start 2021-10-20T23:26:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63fda02700 1 -- start start 2021-10-20T23:26:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63fda02700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f63f80b1ec0 0x7f63f80b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63fda02700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63f80affb0 0x7f63f80b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63fda02700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 0x7f63f8141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63fda02700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f80b0420 con 0x7f63f80affb0 2021-10-20T23:26:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63fda02700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f80b2790 con 0x7f63f80b1ec0 2021-10-20T23:26:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63fda02700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80b0650 con 0x7f63f80a70c0 2021-10-20T23:26:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f67fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63f80affb0 0x7f63f80b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f67fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63f80affb0 0x7f63f80b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41746/0 (socket says 172.21.15.12:41746) 2021-10-20T23:26:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f67fc700 1 -- 172.21.15.12:0/4294837463 learned_addr learned my addr 172.21.15.12:0/4294837463 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f6ffd700 1 --2- 172.21.15.12:0/4294837463 >> v2:172.21.15.31:3300/0 conn(0x7f63f80b1ec0 0x7f63f80b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f77fe700 1 --2- 172.21.15.12:0/4294837463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 0x7f63f8141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f67fc700 1 -- 172.21.15.12:0/4294837463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 msgr2=0x7f63f8141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:53.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f67fc700 1 --2- 172.21.15.12:0/4294837463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 0x7f63f8141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f67fc700 1 -- 172.21.15.12:0/4294837463 >> v2:172.21.15.31:3300/0 conn(0x7f63f80b1ec0 msgr2=0x7f63f80b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f67fc700 1 --2- 172.21.15.12:0/4294837463 >> v2:172.21.15.31:3300/0 conn(0x7f63f80b1ec0 0x7f63f80b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.124+0000 7f63f67fc700 1 -- 172.21.15.12:0/4294837463 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f80b08f0 con 0x7f63f80affb0 2021-10-20T23:26:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63f67fc700 1 --2- 172.21.15.12:0/4294837463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80affb0 0x7f63f80b22a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f63ec002f70 tx=0x7f63ec006eb0).ready entity=mon.0 client_cookie=b03659353f5eebe8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63f5ffb700 1 -- 172.21.15.12:0/4294837463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ec00d570 con 0x7f63f80affb0 2021-10-20T23:26:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63f5ffb700 1 -- 172.21.15.12:0/4294837463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec000e90 con 0x7f63f80affb0 2021-10-20T23:26:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63f5ffb700 1 -- 172.21.15.12:0/4294837463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ec00d900 con 0x7f63f80affb0 2021-10-20T23:26:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 -- 172.21.15.12:0/4294837463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80affb0 msgr2=0x7f63f80b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 --2- 172.21.15.12:0/4294837463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80affb0 0x7f63f80b22a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f63ec002f70 tx=0x7f63ec006eb0).stop 2021-10-20T23:26:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 -- 172.21.15.12:0/4294837463 shutdown_connections 2021-10-20T23:26:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 --2- 172.21.15.12:0/4294837463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 0x7f63f8141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 --2- 172.21.15.12:0/4294837463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80affb0 0x7f63f80b22a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 --2- 172.21.15.12:0/4294837463 >> v2:172.21.15.31:3300/0 conn(0x7f63f80b1ec0 0x7f63f80b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 -- 172.21.15.12:0/4294837463 >> 172.21.15.12:0/4294837463 conn(0x7f63f805f6b0 msgr2=0x7f63f805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 -- 172.21.15.12:0/4294837463 shutdown_connections 2021-10-20T23:26:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 -- 172.21.15.12:0/4294837463 wait complete. 2021-10-20T23:26:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 Processor -- start 2021-10-20T23:26:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.128+0000 7f63fda02700 1 -- start start 2021-10-20T23:26:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63fda02700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 0x7f63f80a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63fda02700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f80affb0 0x7f63f80ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63fda02700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80b1ec0 0x7f63f80abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63fda02700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8156de0 con 0x7f63f80b1ec0 2021-10-20T23:26:53.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63fda02700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f814c1a0 con 0x7f63f80affb0 2021-10-20T23:26:53.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63fda02700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80aace0 con 0x7f63f80a70c0 2021-10-20T23:26:53.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80b1ec0 0x7f63f80abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80b1ec0 0x7f63f80abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41754/0 (socket says 172.21.15.12:41754) 2021-10-20T23:26:53.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f77fe700 1 -- 172.21.15.12:0/1940450535 learned_addr learned my addr 172.21.15.12:0/1940450535 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:53.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f6ffd700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 0x7f63f80a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f67fc700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f80affb0 0x7f63f80ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f77fe700 1 -- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 msgr2=0x7f63f80a9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f77fe700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 0x7f63f80a9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f77fe700 1 -- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f80affb0 msgr2=0x7f63f80ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f77fe700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f80affb0 0x7f63f80ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f77fe700 1 -- 172.21.15.12:0/1940450535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec00b1e0 con 0x7f63f80b1ec0 2021-10-20T23:26:53.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f67fc700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f80affb0 0x7f63f80ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:53.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63f77fe700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80b1ec0 0x7f63f80abbb0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f63e800c000 tx=0x7f63e8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63e7fff700 1 -- 172.21.15.12:0/1940450535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e8010780 con 0x7f63f80b1ec0 2021-10-20T23:26:53.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63e7fff700 1 -- 172.21.15.12:0/1940450535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e80108e0 con 0x7f63f80b1ec0 2021-10-20T23:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f80aaf80 con 0x7f63f80b1ec0 2021-10-20T23:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63e7fff700 1 -- 172.21.15.12:0/1940450535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e8010c40 con 0x7f63f80b1ec0 2021-10-20T23:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f80a9930 con 0x7f63f80b1ec0 2021-10-20T23:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f80b0b90 con 0x7f63f80b1ec0 2021-10-20T23:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63e7fff700 1 -- 172.21.15.12:0/1940450535 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63e801c460 con 0x7f63f80b1ec0 2021-10-20T23:26:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.132+0000 7f63e7fff700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63d4053520 0x7f63d40559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.136+0000 7f63e7fff700 1 -- 172.21.15.12:0/1940450535 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f63e806be70 con 0x7f63f80b1ec0 2021-10-20T23:26:53.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.136+0000 7f63f6ffd700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63d4053520 0x7f63d40559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.136+0000 7f63f6ffd700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63d4053520 0x7f63d40559e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f63f000b000 tx=0x7f63f00091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.140+0000 7f63e7fff700 1 -- 172.21.15.12:0/1940450535 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63e8042e10 con 0x7f63f80b1ec0 2021-10-20T23:26:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f63f8057350 con 0x7f63f80b1ec0 2021-10-20T23:26:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63e7fff700 1 -- 172.21.15.12:0/1940450535 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63e8046430 con 0x7f63f80b1ec0 2021-10-20T23:26:53.274 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:53.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63d4053520 msgr2=0x7f63d40559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63d4053520 0x7f63d40559e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f63f000b000 tx=0x7f63f00091d0).stop 2021-10-20T23:26:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80b1ec0 msgr2=0x7f63f80abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80b1ec0 0x7f63f80abbb0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f63e800c000 tx=0x7f63e8006df0).stop 2021-10-20T23:26:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 shutdown_connections 2021-10-20T23:26:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f63d4053520 0x7f63d40559e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63f80b1ec0 0x7f63f80abbb0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f80affb0 0x7f63f80ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 --2- 172.21.15.12:0/1940450535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63f80a70c0 0x7f63f80a9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 >> 172.21.15.12:0/1940450535 conn(0x7f63f805f6b0 msgr2=0x7f63f80a7530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 shutdown_connections 2021-10-20T23:26:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.264+0000 7f63fda02700 1 -- 172.21.15.12:0/1940450535 wait complete. 2021-10-20T23:26:53.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:26:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 Processor -- start 2021-10-20T23:26:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 -- start start 2021-10-20T23:26:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5c400b5990 0x7f5c400b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c40143f60 con 0x7f5c400b6560 2021-10-20T23:26:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4005ffe0 con 0x7f5c4005fc00 2021-10-20T23:26:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c400ba6b0 con 0x7f5c400b5990 2021-10-20T23:26:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c4643b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5c400b5990 0x7f5c400b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c45439700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5c400b6560 0x7f5c400b4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40354/0 (socket says 172.21.15.12:40354) 2021-10-20T23:26:53.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c45439700 1 -- 172.21.15.12:0/2323839100 learned_addr learned my addr 172.21.15.12:0/2323839100 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:53.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c4643b700 1 -- 172.21.15.12:0/2323839100 >> v1:172.21.15.31:6789/0 conn(0x7f5c4005fc00 legacy=0x7f5c400b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c4643b700 1 -- 172.21.15.12:0/2323839100 >> v1:172.21.15.12:6789/0 conn(0x7f5c400b6560 legacy=0x7f5c400b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c4643b700 1 -- 172.21.15.12:0/2323839100 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40143a50 con 0x7f5c400b5990 2021-10-20T23:26:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c4643b700 1 --2- 172.21.15.12:0/2323839100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b5990 0x7f5c400b41b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f5c380032f0 tx=0x7f5c380091d0).ready entity=mon.0 client_cookie=39fb2056c4249cec server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c44c38700 1 -- 172.21.15.12:0/2323839100 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c38009ea0 con 0x7f5c400b5990 2021-10-20T23:26:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c44c38700 1 -- 172.21.15.12:0/2323839100 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800b8a0 con 0x7f5c400b5990 2021-10-20T23:26:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c44c38700 1 -- 172.21.15.12:0/2323839100 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c3800ba10 con 0x7f5c400b5990 2021-10-20T23:26:53.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2323839100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b5990 msgr2=0x7f5c400b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 --2- 172.21.15.12:0/2323839100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b5990 0x7f5c400b41b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f5c380032f0 tx=0x7f5c380091d0).stop 2021-10-20T23:26:53.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2323839100 shutdown_connections 2021-10-20T23:26:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 --2- 172.21.15.12:0/2323839100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b5990 0x7f5c400b41b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.392+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2323839100 >> 172.21.15.12:0/2323839100 conn(0x7f5c400623a0 msgr2=0x7f5c40066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2323839100 shutdown_connections 2021-10-20T23:26:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2323839100 wait complete. 2021-10-20T23:26:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 Processor -- start 2021-10-20T23:26:53.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 -- start start 2021-10-20T23:26:53.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c4005fc00 0x7f5c40132f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c400b5990 0x7f5c4012af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b6560 0x7f5c4012b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4012f4d0 con 0x7f5c400b6560 2021-10-20T23:26:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401532d0 con 0x7f5c4005fc00 2021-10-20T23:26:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c47e9e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40153570 con 0x7f5c400b5990 2021-10-20T23:26:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c4643b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b6560 0x7f5c4012b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c4643b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b6560 0x7f5c4012b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41768/0 (socket says 172.21.15.12:41768) 2021-10-20T23:26:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c4643b700 1 -- 172.21.15.12:0/2805561828 learned_addr learned my addr 172.21.15.12:0/2805561828 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c45439700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c400b5990 0x7f5c4012af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c45c3a700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c4005fc00 0x7f5c40132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c4643b700 1 -- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c400b5990 msgr2=0x7f5c4012af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c4643b700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c400b5990 0x7f5c4012af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c4643b700 1 -- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c4005fc00 msgr2=0x7f5c40132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c4643b700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c4005fc00 0x7f5c40132f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.396+0000 7f5c4643b700 1 -- 172.21.15.12:0/2805561828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009470 con 0x7f5c400b6560 2021-10-20T23:26:53.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c4643b700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b6560 0x7f5c4012b460 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f5c380032f0 tx=0x7f5c38016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c3effd700 1 -- 172.21.15.12:0/2805561828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c38009ea0 con 0x7f5c400b6560 2021-10-20T23:26:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c3effd700 1 -- 172.21.15.12:0/2805561828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3801f3f0 con 0x7f5c400b6560 2021-10-20T23:26:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c3effd700 1 -- 172.21.15.12:0/2805561828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c3801f750 con 0x7f5c400b6560 2021-10-20T23:26:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4012b950 con 0x7f5c400b6560 2021-10-20T23:26:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c40131510 con 0x7f5c400b6560 2021-10-20T23:26:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4012f640 con 0x7f5c400b6560 2021-10-20T23:26:53.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c3effd700 1 -- 172.21.15.12:0/2805561828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c38026030 con 0x7f5c400b6560 2021-10-20T23:26:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c3effd700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c20053640 0x7f5c20055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c3effd700 1 -- 172.21.15.12:0/2805561828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5c3806c790 con 0x7f5c400b6560 2021-10-20T23:26:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.400+0000 7f5c45c3a700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c20053640 0x7f5c20055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.404+0000 7f5c45c3a700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c20053640 0x7f5c20055b00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f5c3000d000 tx=0x7f5c30007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.408+0000 7f5c3effd700 1 -- 172.21.15.12:0/2805561828 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c4012f640 con 0x7f5c400b6560 2021-10-20T23:26:53.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.532+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c40153110 con 0x7f5c400b6560 2021-10-20T23:26:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.532+0000 7f5c3effd700 1 -- 172.21.15.12:0/2805561828 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5c38015020 con 0x7f5c400b6560 2021-10-20T23:26:53.543 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c20053640 msgr2=0x7f5c20055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c20053640 0x7f5c20055b00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f5c3000d000 tx=0x7f5c30007b90).stop 2021-10-20T23:26:53.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b6560 msgr2=0x7f5c4012b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b6560 0x7f5c4012b460 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f5c380032f0 tx=0x7f5c38016000).stop 2021-10-20T23:26:53.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 shutdown_connections 2021-10-20T23:26:53.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5c20053640 0x7f5c20055b00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c400b6560 0x7f5c4012b460 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c400b5990 0x7f5c4012af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 --2- 172.21.15.12:0/2805561828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c4005fc00 0x7f5c40132f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 >> 172.21.15.12:0/2805561828 conn(0x7f5c400623a0 msgr2=0x7f5c400b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 shutdown_connections 2021-10-20T23:26:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.536+0000 7f5c47e9e700 1 -- 172.21.15.12:0/2805561828 wait complete. 2021-10-20T23:26:53.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:26:53.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01ffff700 1 Processor -- start 2021-10-20T23:26:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01ffff700 1 -- start start 2021-10-20T23:26:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0200ad5c0 0x7fd020061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01ffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0200aecf0 con 0x7fd020061320 2021-10-20T23:26:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01ffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0200b6f20 con 0x7fd020140440 2021-10-20T23:26:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0200aef20 con 0x7fd0200ad5c0 2021-10-20T23:26:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0200ad5c0 0x7fd020061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01effd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd020061320 0x7fd0200b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40366/0 (socket says 172.21.15.12:40366) 2021-10-20T23:26:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01effd700 1 -- 172.21.15.12:0/1119544644 learned_addr learned my addr 172.21.15.12:0/1119544644 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01e7fc700 1 -- 172.21.15.12:0/1119544644 >> v1:172.21.15.31:6789/0 conn(0x7fd020140440 legacy=0x7fd020146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01e7fc700 1 -- 172.21.15.12:0/1119544644 >> v1:172.21.15.12:6789/0 conn(0x7fd020061320 legacy=0x7fd0200b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01e7fc700 1 -- 172.21.15.12:0/1119544644 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200af1c0 con 0x7fd0200ad5c0 2021-10-20T23:26:53.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.664+0000 7fd01e7fc700 1 --2- 172.21.15.12:0/1119544644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0200ad5c0 0x7fd020061700 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fd0200af7e0 tx=0x7fd010006df0).ready entity=mon.0 client_cookie=2d97484797b82d3b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01dffb700 1 -- 172.21.15.12:0/1119544644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd01000d5c0 con 0x7fd0200ad5c0 2021-10-20T23:26:53.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01dffb700 1 -- 172.21.15.12:0/1119544644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd010000e90 con 0x7fd0200ad5c0 2021-10-20T23:26:53.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01dffb700 1 -- 172.21.15.12:0/1119544644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd01000d910 con 0x7fd0200ad5c0 2021-10-20T23:26:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01ffff700 1 -- 172.21.15.12:0/1119544644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0200ad5c0 msgr2=0x7fd020061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01ffff700 1 --2- 172.21.15.12:0/1119544644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0200ad5c0 0x7fd020061700 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fd0200af7e0 tx=0x7fd010006df0).stop 2021-10-20T23:26:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01ffff700 1 -- 172.21.15.12:0/1119544644 shutdown_connections 2021-10-20T23:26:53.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01ffff700 1 --2- 172.21.15.12:0/1119544644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0200ad5c0 0x7fd020061700 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01ffff700 1 -- 172.21.15.12:0/1119544644 >> 172.21.15.12:0/1119544644 conn(0x7fd020066de0 msgr2=0x7fd0200671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:53.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01ffff700 1 -- 172.21.15.12:0/1119544644 shutdown_connections 2021-10-20T23:26:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01ffff700 1 -- 172.21.15.12:0/1119544644 wait complete. 2021-10-20T23:26:53.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.668+0000 7fd01ffff700 1 Processor -- start 2021-10-20T23:26:53.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01ffff700 1 -- start start 2021-10-20T23:26:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd020061320 0x7fd0200b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0200ad5c0 0x7fd020140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd020140440 0x7fd0201413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200b3f60 con 0x7fd020061320 2021-10-20T23:26:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd020143ac0 con 0x7fd0200ad5c0 2021-10-20T23:26:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200af930 con 0x7fd020140440 2021-10-20T23:26:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd020061320 0x7fd0200b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd020061320 0x7fd0200b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41778/0 (socket says 172.21.15.12:41778) 2021-10-20T23:26:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01effd700 1 -- 172.21.15.12:0/3899396732 learned_addr learned my addr 172.21.15.12:0/3899396732 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:53.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01e7fc700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0200ad5c0 0x7fd020140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01f7fe700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd020140440 0x7fd0201413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01effd700 1 -- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd020140440 msgr2=0x7fd0201413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01effd700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd020140440 0x7fd0201413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01effd700 1 -- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0200ad5c0 msgr2=0x7fd020140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01effd700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0200ad5c0 0x7fd020140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01effd700 1 -- 172.21.15.12:0/3899396732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01000b180 con 0x7fd020061320 2021-10-20T23:26:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01effd700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd020061320 0x7fd0200b3450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fd0200ae120 tx=0x7fd014007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd00ffff700 1 -- 172.21.15.12:0/3899396732 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0140070d0 con 0x7fd020061320 2021-10-20T23:26:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd00ffff700 1 -- 172.21.15.12:0/3899396732 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014007230 con 0x7fd020061320 2021-10-20T23:26:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd020143cf0 con 0x7fd020061320 2021-10-20T23:26:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd00ffff700 1 -- 172.21.15.12:0/3899396732 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd014005610 con 0x7fd020061320 2021-10-20T23:26:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.672+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd020142e60 con 0x7fd020061320 2021-10-20T23:26:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.676+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0200af460 con 0x7fd020061320 2021-10-20T23:26:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.676+0000 7fd00ffff700 1 -- 172.21.15.12:0/3899396732 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd014010070 con 0x7fd020061320 2021-10-20T23:26:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.676+0000 7fd00ffff700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcffc0534f0 0x7fcffc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.676+0000 7fd00ffff700 1 -- 172.21.15.12:0/3899396732 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd01406afa0 con 0x7fd020061320 2021-10-20T23:26:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.676+0000 7fd01e7fc700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcffc0534f0 0x7fcffc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.676+0000 7fd01e7fc700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcffc0534f0 0x7fcffc0559b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fd01001a000 tx=0x7fd010012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.680+0000 7fd00ffff700 1 -- 172.21.15.12:0/3899396732 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd014041fa0 con 0x7fd020061320 2021-10-20T23:26:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd020062100 con 0x7fd020061320 2021-10-20T23:26:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd00ffff700 1 -- 172.21.15.12:0/3899396732 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd0140455c0 con 0x7fd020061320 2021-10-20T23:26:53.817 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcffc0534f0 msgr2=0x7fcffc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcffc0534f0 0x7fcffc0559b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fd01001a000 tx=0x7fd010012000).stop 2021-10-20T23:26:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd020061320 msgr2=0x7fd0200b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd020061320 0x7fd0200b3450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fd0200ae120 tx=0x7fd014007c00).stop 2021-10-20T23:26:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 shutdown_connections 2021-10-20T23:26:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcffc0534f0 0x7fcffc0559b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd020140440 0x7fd0201413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0200ad5c0 0x7fd020140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 --2- 172.21.15.12:0/3899396732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd020061320 0x7fd0200b3450 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 >> 172.21.15.12:0/3899396732 conn(0x7fd020066de0 msgr2=0x7fd0200b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:53.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 shutdown_connections 2021-10-20T23:26:53.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.807+0000 7fd01ffff700 1 -- 172.21.15.12:0/3899396732 wait complete. 2021-10-20T23:26:53.831 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:26:53.832 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:53.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 Processor -- start 2021-10-20T23:26:53.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- start start 2021-10-20T23:26:53.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000b2580 0x7ff20014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2000b0010 0x7ff20014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2000a70c0 con 0x7ff2000afbd0 2021-10-20T23:26:53.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2000a72f0 con 0x7ff2000b0010 2021-10-20T23:26:53.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000a7590 con 0x7ff2000b2580 2021-10-20T23:26:53.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20680e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff2000afbd0 0x7ff2000a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40384/0 (socket says 172.21.15.12:40384) 2021-10-20T23:26:53.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20680e700 1 -- 172.21.15.12:0/2671479195 learned_addr learned my addr 172.21.15.12:0/2671479195 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:53.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20580c700 1 --2- 172.21.15.12:0/2671479195 >> v2:172.21.15.31:3300/0 conn(0x7ff2000b0010 0x7ff20014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20600d700 1 --2- 172.21.15.12:0/2671479195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000b2580 0x7ff20014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20500b700 1 -- 172.21.15.12:0/2671479195 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706222613 0 0) 0x7ff2000a70c0 con 0x7ff2000afbd0 2021-10-20T23:26:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20500b700 1 -- 172.21.15.12:0/2671479195 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e8003260 con 0x7ff2000afbd0 2021-10-20T23:26:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20580c700 1 -- 172.21.15.12:0/2671479195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000b2580 msgr2=0x7ff20014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20580c700 1 --2- 172.21.15.12:0/2671479195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000b2580 0x7ff20014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20580c700 1 -- 172.21.15.12:0/2671479195 >> v1:172.21.15.12:6789/0 conn(0x7ff2000afbd0 legacy=0x7ff2000a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20580c700 1 -- 172.21.15.12:0/2671479195 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2000a7830 con 0x7ff2000b0010 2021-10-20T23:26:53.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20580c700 1 --2- 172.21.15.12:0/2671479195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2000b0010 0x7ff20014b330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7ff1fc002f70 tx=0x7ff1fc006df0).ready entity=mon.1 client_cookie=62a071dd9ca6eff0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20500b700 1 -- 172.21.15.12:0/2671479195 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc00d4a0 con 0x7ff2000b0010 2021-10-20T23:26:53.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20500b700 1 -- 172.21.15.12:0/2671479195 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc000e90 con 0x7ff2000b0010 2021-10-20T23:26:53.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20500b700 1 -- 172.21.15.12:0/2671479195 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc00d7f0 con 0x7ff2000b0010 2021-10-20T23:26:53.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- 172.21.15.12:0/2671479195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2000b0010 msgr2=0x7ff20014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 --2- 172.21.15.12:0/2671479195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2000b0010 0x7ff20014b330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7ff1fc002f70 tx=0x7ff1fc006df0).stop 2021-10-20T23:26:53.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- 172.21.15.12:0/2671479195 shutdown_connections 2021-10-20T23:26:53.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 --2- 172.21.15.12:0/2671479195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2000b0010 0x7ff20014b330 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 --2- 172.21.15.12:0/2671479195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000b2580 0x7ff20014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- 172.21.15.12:0/2671479195 >> 172.21.15.12:0/2671479195 conn(0x7ff200060180 msgr2=0x7ff2000b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:53.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- 172.21.15.12:0/2671479195 shutdown_connections 2021-10-20T23:26:53.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- 172.21.15.12:0/2671479195 wait complete. 2021-10-20T23:26:53.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 Processor -- start 2021-10-20T23:26:53.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- start start 2021-10-20T23:26:53.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000afbd0 0x7ff2000a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2000b0010 0x7ff2000a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2000b2580 0x7ff200067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000b5c70 con 0x7ff2000b0010 2021-10-20T23:26:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000aa2c0 con 0x7ff2000b2580 2021-10-20T23:26:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20700f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20014b910 con 0x7ff2000afbd0 2021-10-20T23:26:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20580c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2000b0010 0x7ff2000a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20580c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2000b0010 0x7ff2000a9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41796/0 (socket says 172.21.15.12:41796) 2021-10-20T23:26:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20680e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2000b2580 0x7ff200067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20600d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000afbd0 0x7ff2000a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.931+0000 7ff20580c700 1 -- 172.21.15.12:0/1687101482 learned_addr learned my addr 172.21.15.12:0/1687101482 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:53.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff20580c700 1 -- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000afbd0 msgr2=0x7ff2000a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff20580c700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000afbd0 0x7ff2000a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff20580c700 1 -- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2000b2580 msgr2=0x7ff200067270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:53.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff20580c700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2000b2580 0x7ff200067270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:53.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff20580c700 1 -- 172.21.15.12:0/1687101482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc00b180 con 0x7ff2000b0010 2021-10-20T23:26:53.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff20580c700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2000b0010 0x7ff2000a9dd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7ff2001573b0 tx=0x7ff1fc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff1ef7fe700 1 -- 172.21.15.12:0/1687101482 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc016070 con 0x7ff2000b0010 2021-10-20T23:26:53.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff1ef7fe700 1 -- 172.21.15.12:0/1687101482 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc0137d0 con 0x7ff2000b0010 2021-10-20T23:26:53.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff200156e40 con 0x7ff2000b0010 2021-10-20T23:26:53.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff1ef7fe700 1 -- 172.21.15.12:0/1687101482 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc013b30 con 0x7ff2000b0010 2021-10-20T23:26:53.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20014d740 con 0x7ff2000b0010 2021-10-20T23:26:53.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2001571f0 con 0x7ff2000b0010 2021-10-20T23:26:53.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff1ef7fe700 1 -- 172.21.15.12:0/1687101482 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff1fc00f030 con 0x7ff2000b0010 2021-10-20T23:26:53.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff1ef7fe700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1e0053640 0x7ff1e0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:53.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.935+0000 7ff1ef7fe700 1 -- 172.21.15.12:0/1687101482 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff1fc06c6f0 con 0x7ff2000b0010 2021-10-20T23:26:53.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.939+0000 7ff20600d700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1e0053640 0x7ff1e0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:53.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.939+0000 7ff20600d700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1e0053640 0x7ff1e0055b00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7ff1f000b000 tx=0x7ff1f0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:53.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:53.943+0000 7ff1ef7fe700 1 -- 172.21.15.12:0/1687101482 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff1fc043650 con 0x7ff2000b0010 2021-10-20T23:26:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.111+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2000b3110 con 0x7ff2000b0010 2021-10-20T23:26:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.111+0000 7ff1ef7fe700 1 -- 172.21.15.12:0/1687101482 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7ff2000b3110 con 0x7ff2000b0010 2021-10-20T23:26:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:54.124 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5990,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/246201101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":246201101},{"type":"v1","addr":"172.21.15.12:6833","nonce":246201101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1822115331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1822115331},{"type":"v1","addr":"172.21.15.31:6835","nonce":1822115331}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:26:49.418101+0000","modified":"2021-10-20T23:26:50.420912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1566657212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1566657212},{"type":"v1","addr":"172.21.15.12:6835","nonce":1566657212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-20T23:26:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1e0053640 msgr2=0x7ff1e0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1e0053640 0x7ff1e0055b00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7ff1f000b000 tx=0x7ff1f0006df0).stop 2021-10-20T23:26:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2000b0010 msgr2=0x7ff2000a9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2000b0010 0x7ff2000a9dd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7ff2001573b0 tx=0x7ff1fc014000).stop 2021-10-20T23:26:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 shutdown_connections 2021-10-20T23:26:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1e0053640 0x7ff1e0055b00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2000b2580 0x7ff200067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2000b0010 0x7ff2000a9dd0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 --2- 172.21.15.12:0/1687101482 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2000afbd0 0x7ff2000a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 >> 172.21.15.12:0/1687101482 conn(0x7ff200060180 msgr2=0x7ff2001495b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 shutdown_connections 2021-10-20T23:26:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:54.115+0000 7ff20700f700 1 -- 172.21.15.12:0/1687101482 wait complete. 2021-10-20T23:26:54.129 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 43 2021-10-20T23:26:54.439 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:26:49.418101+0000', 'modified': '2021-10-20T23:26:50.420912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6600}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6600': {'gid': 6600, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1566657212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1566657212}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1566657212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:26:54.440 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:26:54.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:26:54.558 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6600,"want_state":"up:active","state":"up:active","rank_uptime":5.1228960199999998,"mdsmap_epoch":43,"osdmap_epoch":91,"osdmap_epoch_barrier":90,"uptime":9.8186199839999997} 2021-10-20T23:26:54.559 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6600, "mdsmap_epoch": 43, "osdmap_epoch": 91, "osdmap_epoch_barrier": 90, "rank_uptime": 5.12289602, "state": "up:active", "uptime": 9.818619984, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:26:54.560 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:26:54.560 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:26:54.562 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:26:54.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:54.564 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:54.572 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:26:54.590 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:26:54.590 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:26:54.648 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:26:54.649 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:26:54.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:54.651 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:26:54.656 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:26:54.657 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:54.659 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:26:54.675 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:26:54.676 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:26:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:26:54.731 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:26:54.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:54.732 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:26:54.734 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:26:54.727+0000 7fae4d617080 -1 init, newargv = 0x5605c88e6ce0 newargc=9 2021-10-20T23:26:54.734 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14549]: starting ceph client 2021-10-20T23:26:54.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14549]: starting fuse 2021-10-20T23:26:55.845 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:26:55.862 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:26:55.863 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:26:55.921 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:26:55.926 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:26:55.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:55.927 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:26:55.935 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:26:55.936 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:26:55.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:55.937 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:26:55.938 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:26:55.938 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:26:55.939 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:26:55.939 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:26:55.940 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:26:55.940 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:26:55.940 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:26:55.941 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:26:55.941 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:26:55.942 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:26:55.942 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:26:55.942 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:26:55.944 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:26:55.944 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:26:55.944 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:26:55.945 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:26:55.945 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:26:55.946 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:26:55.946 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:26:55.947 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:26:55.947 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:26:55.947 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:26:55.992 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14549.asok 2021-10-20T23:26:55.997 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14549.asok 2021-10-20T23:26:55.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:55.998 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14549.asok status 2021-10-20T23:26:56.141 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:26:56.141 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:26:56.142 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:26:56.142 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:26:56.142 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:26:56.142 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:26:56.143 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:26:56.143 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14549", 2021-10-20T23:26:56.143 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:26:56.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:26:56.144 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:26:56.144 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:26:56.144 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 6756, 2021-10-20T23:26:56.144 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:26:56.145 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:26:56.145 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:26:56.145 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 6756 2021-10-20T23:26:56.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:26:56.146 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:26:56.146 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:26:56.146 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:26:56.147 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 4121624472 2021-10-20T23:26:56.147 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:26:56.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:26:56.147 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:26:56.148 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:26:56.148 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:26:56.148 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 4121624472 2021-10-20T23:26:56.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:26:56.149 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.6756 172.21.15.119:0/4121624472", 2021-10-20T23:26:56.149 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/4121624472", 2021-10-20T23:26:56.149 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:26:56.149 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 43, 2021-10-20T23:26:56.150 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 91, 2021-10-20T23:26:56.150 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:26:56.150 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:26:56.151 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:26:56.151 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:26:56.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:56.153 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:56.154 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:56.163 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:26:56.163 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:26:56.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:56.164 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:56.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:26:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc3cf3700 1 Processor -- start 2021-10-20T23:26:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc3cf3700 1 -- start start 2021-10-20T23:26:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc3cf3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7facbc1483a0 0x7facbc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc3cf3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc0b0350 con 0x7facbc0b1db0 2021-10-20T23:26:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc3cf3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc0b05f0 con 0x7facbc0a70c0 2021-10-20T23:26:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc3cf3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc0a90c0 con 0x7facbc1483a0 2021-10-20T23:26:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc1a8f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7facbc0b1db0 0x7facbc0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40394/0 (socket says 172.21.15.12:40394) 2021-10-20T23:26:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc1a8f700 1 -- 172.21.15.12:0/1656865935 learned_addr learned my addr 172.21.15.12:0/1656865935 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc128e700 1 --2- 172.21.15.12:0/1656865935 >> v2:172.21.15.31:3300/0 conn(0x7facbc1483a0 0x7facbc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985245842 0 0) 0x7facbc0b0350 con 0x7facbc0b1db0 2021-10-20T23:26:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faca8003260 con 0x7facbc0b1db0 2021-10-20T23:26:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2505672130 0 0) 0x7faca8003260 con 0x7facbc0b1db0 2021-10-20T23:26:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 >> v2:172.21.15.31:3300/0 conn(0x7facbc1483a0 msgr2=0x7facbc0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 --2- 172.21.15.12:0/1656865935 >> v2:172.21.15.31:3300/0 conn(0x7facbc1483a0 0x7facbc0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 >> v1:172.21.15.31:6789/0 conn(0x7facbc0a70c0 legacy=0x7facbc144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0b0890 con 0x7facbc0b1db0 2021-10-20T23:26:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7facb0001660 con 0x7facbc0b1db0 2021-10-20T23:26:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 >> v1:172.21.15.12:6789/0 conn(0x7facbc0b1db0 legacy=0x7facbc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faca8003780 0x7faca8003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faca8004500 0x7faca8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8004e70 0x7faca800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca800bcf0 con 0x7faca8003780 2021-10-20T23:26:56.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca800be60 con 0x7faca8004e70 2021-10-20T23:26:56.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca800c020 con 0x7faca8004500 2021-10-20T23:26:56.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc1a8f700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faca8003780 0x7faca8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc2290700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8004e70 0x7faca800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc128e700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faca8004500 0x7faca8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc1a8f700 1 -- 172.21.15.12:0/1656865935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faca8004500 msgr2=0x7faca8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc1a8f700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faca8004500 0x7faca8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc1a8f700 1 -- 172.21.15.12:0/1656865935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8004e70 msgr2=0x7faca800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc1a8f700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8004e70 0x7faca800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc1a8f700 1 -- 172.21.15.12:0/1656865935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8003260 con 0x7faca8003780 2021-10-20T23:26:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc2290700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8004e70 0x7faca800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc2290700 1 -- 172.21.15.12:0/1656865935 reap_dead start 2021-10-20T23:26:56.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc1a8f700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faca8003780 0x7faca8003ba0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7facb0001370 tx=0x7facbc0b0a20).ready entity=mon.0 client_cookie=fc43676c696c3fc2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:56.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb00070d0 con 0x7faca8003780 2021-10-20T23:26:56.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb0007230 con 0x7faca8003780 2021-10-20T23:26:56.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.339+0000 7facc0a8d700 1 -- 172.21.15.12:0/1656865935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb000c8f0 con 0x7faca8003780 2021-10-20T23:26:56.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 -- 172.21.15.12:0/1656865935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faca8003780 msgr2=0x7faca8003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faca8003780 0x7faca8003ba0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7facb0001370 tx=0x7facbc0b0a20).stop 2021-10-20T23:26:56.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 -- 172.21.15.12:0/1656865935 shutdown_connections 2021-10-20T23:26:56.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 --2- 172.21.15.12:0/1656865935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faca8003780 0x7faca8003ba0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 -- 172.21.15.12:0/1656865935 >> 172.21.15.12:0/1656865935 conn(0x7facbc05f6b0 msgr2=0x7facbc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:56.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 -- 172.21.15.12:0/1656865935 shutdown_connections 2021-10-20T23:26:56.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 -- 172.21.15.12:0/1656865935 wait complete. 2021-10-20T23:26:56.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 Processor -- start 2021-10-20T23:26:56.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 -- start start 2021-10-20T23:26:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8003780 0x7facbc146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facbc14b1b0 0x7facbc14b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facbc1567f0 0x7facbc156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc149fd0 con 0x7facbc14b1b0 2021-10-20T23:26:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc14a270 con 0x7faca8003780 2021-10-20T23:26:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc3cf3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc14a510 con 0x7facbc1567f0 2021-10-20T23:26:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc128e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facbc14b1b0 0x7facbc14b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc128e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facbc14b1b0 0x7facbc14b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41816/0 (socket says 172.21.15.12:41816) 2021-10-20T23:26:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc2290700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facbc1567f0 0x7facbc156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc1a8f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8003780 0x7facbc146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.343+0000 7facc128e700 1 -- 172.21.15.12:0/3922981881 learned_addr learned my addr 172.21.15.12:0/3922981881 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc128e700 1 -- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facbc1567f0 msgr2=0x7facbc156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc128e700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facbc1567f0 0x7facbc156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc128e700 1 -- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8003780 msgr2=0x7facbc146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc128e700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8003780 0x7facbc146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc128e700 1 -- 172.21.15.12:0/3922981881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc157160 con 0x7facbc14b1b0 2021-10-20T23:26:56.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc1a8f700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8003780 0x7facbc146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:56.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc2290700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facbc1567f0 0x7facbc156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:56.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc128e700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facbc14b1b0 0x7facbc14b610 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7facac00b000 tx=0x7facac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:56.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facbaffd700 1 -- 172.21.15.12:0/3922981881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac015690 con 0x7facbc14b1b0 2021-10-20T23:26:56.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facbaffd700 1 -- 172.21.15.12:0/3922981881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac0157f0 con 0x7facbc14b1b0 2021-10-20T23:26:56.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc157410 con 0x7facbc14b1b0 2021-10-20T23:26:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facbaffd700 1 -- 172.21.15.12:0/3922981881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac015960 con 0x7facbc14b1b0 2021-10-20T23:26:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc148ca0 con 0x7facbc14b1b0 2021-10-20T23:26:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc0b0b30 con 0x7facbc14b1b0 2021-10-20T23:26:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.347+0000 7facbaffd700 1 -- 172.21.15.12:0/3922981881 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7facac025070 con 0x7facbc14b1b0 2021-10-20T23:26:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.351+0000 7facbaffd700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac9c0534f0 0x7fac9c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.351+0000 7facbaffd700 1 -- 172.21.15.12:0/3922981881 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7facac06c380 con 0x7facbc14b1b0 2021-10-20T23:26:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.351+0000 7facc1a8f700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac9c0534f0 0x7fac9c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.351+0000 7facc1a8f700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac9c0534f0 0x7fac9c0559b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7facb0019000 tx=0x7facb0013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.355+0000 7facbaffd700 1 -- 172.21.15.12:0/3922981881 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7facac043270 con 0x7facbc14b1b0 2021-10-20T23:26:56.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.483+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facbc057350 con 0x7facbc14b1b0 2021-10-20T23:26:56.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facbaffd700 1 -- 172.21.15.12:0/3922981881 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16274 (secure 0 0 0) 0x7facac046890 con 0x7facbc14b1b0 2021-10-20T23:26:56.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:56.494 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:26:50.421718+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:26:47.507897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-20T23:26:48.434318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:26:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac9c0534f0 msgr2=0x7fac9c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac9c0534f0 0x7fac9c0559b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7facb0019000 tx=0x7facb0013000).stop 2021-10-20T23:26:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facbc14b1b0 msgr2=0x7facbc14b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facbc14b1b0 0x7facbc14b610 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7facac00b000 tx=0x7facac008040).stop 2021-10-20T23:26:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 shutdown_connections 2021-10-20T23:26:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac9c0534f0 0x7fac9c0559b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facbc1567f0 0x7facbc156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facbc14b1b0 0x7facbc14b610 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 --2- 172.21.15.12:0/3922981881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faca8003780 0x7facbc146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 >> 172.21.15.12:0/3922981881 conn(0x7facbc05f6b0 msgr2=0x7facbc0b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 shutdown_connections 2021-10-20T23:26:56.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.487+0000 7facc3cf3700 1 -- 172.21.15.12:0/3922981881 wait complete. 2021-10-20T23:26:56.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:26:47.507897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:26:48.434318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:26:56.508 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:26:56.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 Processor -- start 2021-10-20T23:26:56.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 -- start start 2021-10-20T23:26:56.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 0x7f2ba40affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ba40b22a0 0x7f2ba4141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba40a77d0 con 0x7f2ba40b1ec0 2021-10-20T23:26:56.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba40b1740 con 0x7f2ba40b22a0 2021-10-20T23:26:56.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40b0650 con 0x7f2ba40b12d0 2021-10-20T23:26:56.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ba40b22a0 0x7f2ba4141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ba40b22a0 0x7f2ba4141250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41824/0 (socket says 172.21.15.12:41824) 2021-10-20T23:26:56.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba359e700 1 -- 172.21.15.12:0/3876161305 learned_addr learned my addr 172.21.15.12:0/3876161305 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:56.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba259c700 1 --2- 172.21.15.12:0/3876161305 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 0x7f2ba40affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba359e700 1 -- 172.21.15.12:0/3876161305 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 msgr2=0x7f2ba40affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:56.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba359e700 1 --2- 172.21.15.12:0/3876161305 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 0x7f2ba40affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba359e700 1 -- 172.21.15.12:0/3876161305 >> v1:172.21.15.31:6789/0 conn(0x7f2ba40b1ec0 legacy=0x7f2ba40a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba359e700 1 -- 172.21.15.12:0/3876161305 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba40b08f0 con 0x7f2ba40b22a0 2021-10-20T23:26:56.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba259c700 1 --2- 172.21.15.12:0/3876161305 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 0x7f2ba40affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:56.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba359e700 1 --2- 172.21.15.12:0/3876161305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 0x7f2ba4141250 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f2b9c0032f0 tx=0x7f2b9c009290).ready entity=mon.0 client_cookie=b341cd14fcf9cc22 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:56.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba1d9b700 1 -- 172.21.15.12:0/3876161305 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9c00b8a0 con 0x7f2ba40b22a0 2021-10-20T23:26:56.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba1d9b700 1 -- 172.21.15.12:0/3876161305 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c00ba00 con 0x7f2ba40b22a0 2021-10-20T23:26:56.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba1d9b700 1 -- 172.21.15.12:0/3876161305 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9c00bb70 con 0x7f2ba40b22a0 2021-10-20T23:26:56.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 -- 172.21.15.12:0/3876161305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 msgr2=0x7f2ba4141250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 --2- 172.21.15.12:0/3876161305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 0x7f2ba4141250 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f2b9c0032f0 tx=0x7f2b9c009290).stop 2021-10-20T23:26:56.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 -- 172.21.15.12:0/3876161305 shutdown_connections 2021-10-20T23:26:56.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 --2- 172.21.15.12:0/3876161305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 0x7f2ba4141250 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 --2- 172.21.15.12:0/3876161305 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 0x7f2ba40affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 -- 172.21.15.12:0/3876161305 >> 172.21.15.12:0/3876161305 conn(0x7f2ba405f6b0 msgr2=0x7f2ba405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:56.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.615+0000 7f2ba90e3700 1 -- 172.21.15.12:0/3876161305 shutdown_connections 2021-10-20T23:26:56.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.619+0000 7f2ba90e3700 1 -- 172.21.15.12:0/3876161305 wait complete. 2021-10-20T23:26:56.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.619+0000 7f2ba90e3700 1 Processor -- start 2021-10-20T23:26:56.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.619+0000 7f2ba90e3700 1 -- start start 2021-10-20T23:26:56.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.619+0000 7f2ba90e3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 0x7f2ba40b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.619+0000 7f2ba90e3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba40b1ec0 0x7f2ba4153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.619+0000 7f2ba90e3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 0x7f2ba4154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.619+0000 7f2ba90e3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40ac0e0 con 0x7f2ba40b22a0 2021-10-20T23:26:56.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.619+0000 7f2ba90e3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4154820 con 0x7f2ba40b1ec0 2021-10-20T23:26:56.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.619+0000 7f2ba90e3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4157710 con 0x7f2ba40b12d0 2021-10-20T23:26:56.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 0x7f2ba4154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 0x7f2ba4154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41830/0 (socket says 172.21.15.12:41830) 2021-10-20T23:26:56.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba359e700 1 -- 172.21.15.12:0/2657060284 learned_addr learned my addr 172.21.15.12:0/2657060284 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:56.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba2d9d700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 0x7f2ba40b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba259c700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba40b1ec0 0x7f2ba4153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba359e700 1 -- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 msgr2=0x7f2ba40b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba359e700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 0x7f2ba40b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba359e700 1 -- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba40b1ec0 msgr2=0x7f2ba4153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba359e700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba40b1ec0 0x7f2ba4153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba359e700 1 -- 172.21.15.12:0/2657060284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c009530 con 0x7f2ba40b22a0 2021-10-20T23:26:56.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba359e700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 0x7f2ba4154330 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f2ba4149040 tx=0x7f2b9c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:56.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2b9bfff700 1 -- 172.21.15.12:0/2657060284 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9c00bb70 con 0x7f2ba40b22a0 2021-10-20T23:26:56.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2b9bfff700 1 -- 172.21.15.12:0/2657060284 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c020430 con 0x7f2ba40b22a0 2021-10-20T23:26:56.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2b9bfff700 1 -- 172.21.15.12:0/2657060284 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9c00b8a0 con 0x7f2ba40b22a0 2021-10-20T23:26:56.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba41579b0 con 0x7f2ba40b22a0 2021-10-20T23:26:56.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40abc40 con 0x7f2ba40b22a0 2021-10-20T23:26:56.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba40abe00 con 0x7f2ba40b22a0 2021-10-20T23:26:56.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2b9bfff700 1 -- 172.21.15.12:0/2657060284 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2b9c028070 con 0x7f2ba40b22a0 2021-10-20T23:26:56.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2b9bfff700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b880534f0 0x7f2b880559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2b9bfff700 1 -- 172.21.15.12:0/2657060284 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2b9c06c4a0 con 0x7f2ba40b22a0 2021-10-20T23:26:56.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.623+0000 7f2ba2d9d700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b880534f0 0x7f2b880559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.627+0000 7f2ba2d9d700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b880534f0 0x7f2b880559b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f2b8c00d000 tx=0x7f2b8c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:56.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.631+0000 7f2b9bfff700 1 -- 172.21.15.12:0/2657060284 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b9c0434a0 con 0x7f2ba40b22a0 2021-10-20T23:26:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.755+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2ba4149240 con 0x7f2ba40b22a0 2021-10-20T23:26:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2b9bfff700 1 -- 172.21.15.12:0/2657060284 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v91) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2b9c0150b0 con 0x7f2ba40b22a0 2021-10-20T23:26:56.766 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:26:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b880534f0 msgr2=0x7f2b880559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b880534f0 0x7f2b880559b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f2b8c00d000 tx=0x7f2b8c009040).stop 2021-10-20T23:26:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 msgr2=0x7f2ba4154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 0x7f2ba4154330 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f2ba4149040 tx=0x7f2b9c016000).stop 2021-10-20T23:26:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 shutdown_connections 2021-10-20T23:26:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b880534f0 0x7f2b880559b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ba40b22a0 0x7f2ba4154330 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba40b1ec0 0x7f2ba4153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 --2- 172.21.15.12:0/2657060284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ba40b12d0 0x7f2ba40b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 >> 172.21.15.12:0/2657060284 conn(0x7f2ba405f6b0 msgr2=0x7f2ba413b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 shutdown_connections 2021-10-20T23:26:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.759+0000 7f2ba90e3700 1 -- 172.21.15.12:0/2657060284 wait complete. 2021-10-20T23:26:56.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:26:56.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c96238700 1 Processor -- start 2021-10-20T23:26:56.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c96238700 1 -- start start 2021-10-20T23:26:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c96238700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b1ec0 0x7f4c900b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c96238700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c900b22a0 0x7f4c90141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c96238700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c900a77d0 con 0x7f4c900affb0 2021-10-20T23:26:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c96238700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c900b03f0 con 0x7f4c900b22a0 2021-10-20T23:26:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c96238700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900b0650 con 0x7f4c900b1ec0 2021-10-20T23:26:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b1ec0 0x7f4c900b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c900b22a0 0x7f4c90141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4c900affb0 0x7f4c900a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:47494/0 (socket says 172.21.15.12:47494) 2021-10-20T23:26:56.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8effd700 1 -- 172.21.15.12:0/2818516758 learned_addr learned my addr 172.21.15.12:0/2818516758 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:56.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8ffff700 1 -- 172.21.15.12:0/2818516758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b1ec0 msgr2=0x7f4c900b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:56.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8ffff700 1 --2- 172.21.15.12:0/2818516758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b1ec0 0x7f4c900b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8ffff700 1 -- 172.21.15.12:0/2818516758 >> v1:172.21.15.31:6789/0 conn(0x7f4c900affb0 legacy=0x7f4c900a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8ffff700 1 -- 172.21.15.12:0/2818516758 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900b08f0 con 0x7f4c900b22a0 2021-10-20T23:26:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8f7fe700 1 --2- 172.21.15.12:0/2818516758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b1ec0 0x7f4c900b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8ffff700 1 --2- 172.21.15.12:0/2818516758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c900b22a0 0x7f4c90141250 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f4c880032f0 tx=0x7f4c880091d0).ready entity=mon.1 client_cookie=33c24cb2e36a7d22 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.887+0000 7f4c8e7fc700 1 -- 172.21.15.12:0/2818516758 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c8800b6c0 con 0x7f4c900b22a0 2021-10-20T23:26:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c8e7fc700 1 -- 172.21.15.12:0/2818516758 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8800b820 con 0x7f4c900b22a0 2021-10-20T23:26:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c8e7fc700 1 -- 172.21.15.12:0/2818516758 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c8800b990 con 0x7f4c900b22a0 2021-10-20T23:26:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 -- 172.21.15.12:0/2818516758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c900b22a0 msgr2=0x7f4c90141250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 --2- 172.21.15.12:0/2818516758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c900b22a0 0x7f4c90141250 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f4c880032f0 tx=0x7f4c880091d0).stop 2021-10-20T23:26:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 -- 172.21.15.12:0/2818516758 shutdown_connections 2021-10-20T23:26:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 --2- 172.21.15.12:0/2818516758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c900b22a0 0x7f4c90141250 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 --2- 172.21.15.12:0/2818516758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b1ec0 0x7f4c900b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 -- 172.21.15.12:0/2818516758 >> 172.21.15.12:0/2818516758 conn(0x7f4c9005f6b0 msgr2=0x7f4c9005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 -- 172.21.15.12:0/2818516758 shutdown_connections 2021-10-20T23:26:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 -- 172.21.15.12:0/2818516758 wait complete. 2021-10-20T23:26:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 Processor -- start 2021-10-20T23:26:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 -- start start 2021-10-20T23:26:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c900affb0 0x7f4c9014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c900b1ec0 0x7f4c900ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b22a0 0x7f4c9015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900a9f20 con 0x7f4c900b1ec0 2021-10-20T23:26:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900aa150 con 0x7f4c900affb0 2021-10-20T23:26:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.891+0000 7f4c96238700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900aa3f0 con 0x7f4c900b22a0 2021-10-20T23:26:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c900b1ec0 0x7f4c900ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c900b1ec0 0x7f4c900ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41842/0 (socket says 172.21.15.12:41842) 2021-10-20T23:26:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8effd700 1 -- 172.21.15.12:0/1661882909 learned_addr learned my addr 172.21.15.12:0/1661882909 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8f7fe700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c900affb0 0x7f4c9014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8ffff700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b22a0 0x7f4c9015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8effd700 1 -- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b22a0 msgr2=0x7f4c9015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8effd700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b22a0 0x7f4c9015a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8effd700 1 -- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c900affb0 msgr2=0x7f4c9014a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8effd700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c900affb0 0x7f4c9014a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8effd700 1 -- 172.21.15.12:0/1661882909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8000b180 con 0x7f4c900b1ec0 2021-10-20T23:26:56.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8effd700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c900b1ec0 0x7f4c900ad650 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f4c9006a0f0 tx=0x7f4c84007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:56.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8cff9700 1 -- 172.21.15.12:0/1661882909 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c840070d0 con 0x7f4c900b1ec0 2021-10-20T23:26:56.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8cff9700 1 -- 172.21.15.12:0/1661882909 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c84007230 con 0x7f4c900b1ec0 2021-10-20T23:26:56.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8cff9700 1 -- 172.21.15.12:0/1661882909 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c84005610 con 0x7f4c900b1ec0 2021-10-20T23:26:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c88009470 con 0x7f4c900b1ec0 2021-10-20T23:26:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9014a2c0 con 0x7f4c900b1ec0 2021-10-20T23:26:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9014a480 con 0x7f4c900b1ec0 2021-10-20T23:26:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.895+0000 7f4c8cff9700 1 -- 172.21.15.12:0/1661882909 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c84010070 con 0x7f4c900b1ec0 2021-10-20T23:26:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.899+0000 7f4c8cff9700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c70053520 0x7f4c700559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.899+0000 7f4c8cff9700 1 -- 172.21.15.12:0/1661882909 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4c8406b010 con 0x7f4c900b1ec0 2021-10-20T23:26:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.899+0000 7f4c8f7fe700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c70053520 0x7f4c700559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.899+0000 7f4c8f7fe700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c70053520 0x7f4c700559e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4c8000b000 tx=0x7f4c80006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:56.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:56.907+0000 7f4c8cff9700 1 -- 172.21.15.12:0/1661882909 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c84045e60 con 0x7f4c900b1ec0 2021-10-20T23:26:57.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.035+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c900b0b90 con 0x7f4c900b1ec0 2021-10-20T23:26:57.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.035+0000 7f4c8cff9700 1 -- 172.21.15.12:0/1661882909 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c84018030 con 0x7f4c900b1ec0 2021-10-20T23:26:57.044 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:57.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c70053520 msgr2=0x7f4c700559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c70053520 0x7f4c700559e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4c8000b000 tx=0x7f4c80006df0).stop 2021-10-20T23:26:57.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c900b1ec0 msgr2=0x7f4c900ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c900b1ec0 0x7f4c900ad650 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f4c9006a0f0 tx=0x7f4c84007c00).stop 2021-10-20T23:26:57.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 shutdown_connections 2021-10-20T23:26:57.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4c70053520 0x7f4c700559e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c900b22a0 0x7f4c9015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c900b1ec0 0x7f4c900ad650 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 --2- 172.21.15.12:0/1661882909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c900affb0 0x7f4c9014a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 >> 172.21.15.12:0/1661882909 conn(0x7f4c9005f6b0 msgr2=0x7f4c90145730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:57.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 shutdown_connections 2021-10-20T23:26:57.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.039+0000 7f4c96238700 1 -- 172.21.15.12:0/1661882909 wait complete. 2021-10-20T23:26:57.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:26:57.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.167+0000 7f8f3c9dd700 1 Processor -- start 2021-10-20T23:26:57.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.167+0000 7f8f3c9dd700 1 -- start start 2021-10-20T23:26:57.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f380638d0 0x7f8f38143d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f38140980 0x7f8f38128c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f38063cb0 con 0x7f8f38061920 2021-10-20T23:26:57.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3813fdb0 con 0x7f8f38140980 2021-10-20T23:26:57.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38061ff0 con 0x7f8f380638d0 2021-10-20T23:26:57.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f38140980 0x7f8f38128c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f38140980 0x7f8f38128c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41852/0 (socket says 172.21.15.12:41852) 2021-10-20T23:26:57.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3759e700 1 -- 172.21.15.12:0/3229705449 learned_addr learned my addr 172.21.15.12:0/3229705449 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:57.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f36d9d700 1 --2- 172.21.15.12:0/3229705449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f380638d0 0x7f8f38143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3759e700 1 -- 172.21.15.12:0/3229705449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f380638d0 msgr2=0x7f8f38143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:57.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3759e700 1 --2- 172.21.15.12:0/3229705449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f380638d0 0x7f8f38143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3759e700 1 -- 172.21.15.12:0/3229705449 >> v1:172.21.15.31:6789/0 conn(0x7f8f38061920 legacy=0x7f8f380b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3759e700 1 -- 172.21.15.12:0/3229705449 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3813ffa0 con 0x7f8f38140980 2021-10-20T23:26:57.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3759e700 1 --2- 172.21.15.12:0/3229705449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38140980 0x7f8f38128c80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f8f300032f0 tx=0x7f8f30009290).ready entity=mon.0 client_cookie=2784c9b75f9b9fbb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:57.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f35d9b700 1 -- 172.21.15.12:0/3229705449 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f3000b8a0 con 0x7f8f38140980 2021-10-20T23:26:57.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f35d9b700 1 -- 172.21.15.12:0/3229705449 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3000ba00 con 0x7f8f38140980 2021-10-20T23:26:57.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f35d9b700 1 -- 172.21.15.12:0/3229705449 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f3000bb70 con 0x7f8f38140980 2021-10-20T23:26:57.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/3229705449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38140980 msgr2=0x7f8f38128c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 --2- 172.21.15.12:0/3229705449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38140980 0x7f8f38128c80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f8f300032f0 tx=0x7f8f30009290).stop 2021-10-20T23:26:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/3229705449 shutdown_connections 2021-10-20T23:26:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 --2- 172.21.15.12:0/3229705449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38140980 0x7f8f38128c80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 --2- 172.21.15.12:0/3229705449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f380638d0 0x7f8f38143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/3229705449 >> 172.21.15.12:0/3229705449 conn(0x7f8f3805c490 msgr2=0x7f8f3805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/3229705449 shutdown_connections 2021-10-20T23:26:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.171+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/3229705449 wait complete. 2021-10-20T23:26:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3c9dd700 1 Processor -- start 2021-10-20T23:26:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3c9dd700 1 -- start start 2021-10-20T23:26:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3c9dd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38061920 0x7f8f38141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3c9dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f380638d0 0x7f8f38152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3c9dd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f38140980 0x7f8f38155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3c9dd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38152600 con 0x7f8f38061920 2021-10-20T23:26:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3c9dd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380b3640 con 0x7f8f380638d0 2021-10-20T23:26:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3c9dd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38153460 con 0x7f8f38140980 2021-10-20T23:26:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f36d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38061920 0x7f8f38141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f36d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38061920 0x7f8f38141e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41854/0 (socket says 172.21.15.12:41854) 2021-10-20T23:26:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f36d9d700 1 -- 172.21.15.12:0/161149141 learned_addr learned my addr 172.21.15.12:0/161149141 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3659c700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f380638d0 0x7f8f38152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f3759e700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f38140980 0x7f8f38155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f36d9d700 1 -- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f38140980 msgr2=0x7f8f38155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f36d9d700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f38140980 0x7f8f38155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f36d9d700 1 -- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f380638d0 msgr2=0x7f8f38152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f36d9d700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f380638d0 0x7f8f38152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f36d9d700 1 -- 172.21.15.12:0/161149141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30009530 con 0x7f8f38061920 2021-10-20T23:26:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.175+0000 7f8f36d9d700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38061920 0x7f8f38141e30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f8f2800c000 tx=0x7f8f28006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f27fff700 1 -- 172.21.15.12:0/161149141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f28010780 con 0x7f8f38061920 2021-10-20T23:26:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f27fff700 1 -- 172.21.15.12:0/161149141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f280108e0 con 0x7f8f38061920 2021-10-20T23:26:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f380b3f70 con 0x7f8f38061920 2021-10-20T23:26:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f27fff700 1 -- 172.21.15.12:0/161149141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f28010c40 con 0x7f8f38061920 2021-10-20T23:26:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f38152ad0 con 0x7f8f38061920 2021-10-20T23:26:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f27fff700 1 -- 172.21.15.12:0/161149141 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8f2801c460 con 0x7f8f38061920 2021-10-20T23:26:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f38057350 con 0x7f8f38061920 2021-10-20T23:26:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f27fff700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f140536a0 0x7f8f14055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f27fff700 1 -- 172.21.15.12:0/161149141 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8f2806bed0 con 0x7f8f38061920 2021-10-20T23:26:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.179+0000 7f8f3659c700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f140536a0 0x7f8f14055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.183+0000 7f8f3659c700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f140536a0 0x7f8f14055b60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f8f2c00d000 tx=0x7f8f2c007b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.187+0000 7f8f27fff700 1 -- 172.21.15.12:0/161149141 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f28042dd0 con 0x7f8f38061920 2021-10-20T23:26:57.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.315+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f3805f240 con 0x7f8f38061920 2021-10-20T23:26:57.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.315+0000 7f8f27fff700 1 -- 172.21.15.12:0/161149141 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8f280463f0 con 0x7f8f38061920 2021-10-20T23:26:57.324 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:57.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f140536a0 msgr2=0x7f8f14055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f140536a0 0x7f8f14055b60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f8f2c00d000 tx=0x7f8f2c007b50).stop 2021-10-20T23:26:57.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38061920 msgr2=0x7f8f38141e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38061920 0x7f8f38141e30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f8f2800c000 tx=0x7f8f28006df0).stop 2021-10-20T23:26:57.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 shutdown_connections 2021-10-20T23:26:57.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f140536a0 0x7f8f14055b60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f38140980 0x7f8f38155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f380638d0 0x7f8f38152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 --2- 172.21.15.12:0/161149141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38061920 0x7f8f38141e30 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 >> 172.21.15.12:0/161149141 conn(0x7f8f3805c490 msgr2=0x7f8f3805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:57.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 shutdown_connections 2021-10-20T23:26:57.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.319+0000 7f8f3c9dd700 1 -- 172.21.15.12:0/161149141 wait complete. 2021-10-20T23:26:57.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:26:57.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.439+0000 7f0e6e325700 1 Processor -- start 2021-10-20T23:26:57.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.439+0000 7f0e6e325700 1 -- start start 2021-10-20T23:26:57.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.439+0000 7f0e6e325700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 0x7f0e68064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.439+0000 7f0e6e325700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e680604e0 con 0x7f0e680b38d0 2021-10-20T23:26:57.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.439+0000 7f0e6e325700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e680b23b0 con 0x7f0e68144440 2021-10-20T23:26:57.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.439+0000 7f0e6e325700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68065c80 con 0x7f0e68060100 2021-10-20T23:26:57.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.439+0000 7f0e6c8c2700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0e680b38d0 0x7f0e6814b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40460/0 (socket says 172.21.15.12:40460) 2021-10-20T23:26:57.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.439+0000 7f0e6c8c2700 1 -- 172.21.15.12:0/3007422303 learned_addr learned my addr 172.21.15.12:0/3007422303 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:57.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.439+0000 7f0e67fff700 1 --2- 172.21.15.12:0/3007422303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 0x7f0e68064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e66ffd700 1 -- 172.21.15.12:0/3007422303 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461098084 0 0) 0x7f0e680604e0 con 0x7f0e680b38d0 2021-10-20T23:26:57.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e66ffd700 1 -- 172.21.15.12:0/3007422303 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e4c003260 con 0x7f0e680b38d0 2021-10-20T23:26:57.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e66ffd700 1 -- 172.21.15.12:0/3007422303 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563969678 0 0) 0x7f0e680b23b0 con 0x7f0e68144440 2021-10-20T23:26:57.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e66ffd700 1 -- 172.21.15.12:0/3007422303 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e680604e0 con 0x7f0e68144440 2021-10-20T23:26:57.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e66ffd700 1 -- 172.21.15.12:0/3007422303 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3197550199 0 0) 0x7f0e4c003260 con 0x7f0e680b38d0 2021-10-20T23:26:57.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e67fff700 1 -- 172.21.15.12:0/3007422303 >> v1:172.21.15.31:6789/0 conn(0x7f0e68144440 legacy=0x7f0e68144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e67fff700 1 -- 172.21.15.12:0/3007422303 >> v1:172.21.15.12:6789/0 conn(0x7f0e680b38d0 legacy=0x7f0e6814b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e67fff700 1 -- 172.21.15.12:0/3007422303 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680b2650 con 0x7f0e68060100 2021-10-20T23:26:57.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e67fff700 1 --2- 172.21.15.12:0/3007422303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 0x7f0e68064d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f0e60001490 tx=0x7f0e50006df0).ready entity=mon.2 client_cookie=f7734db3881b2058 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:57.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e66ffd700 1 -- 172.21.15.12:0/3007422303 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e600019e0 con 0x7f0e68060100 2021-10-20T23:26:57.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e66ffd700 1 -- 172.21.15.12:0/3007422303 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50000e90 con 0x7f0e68060100 2021-10-20T23:26:57.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e66ffd700 1 -- 172.21.15.12:0/3007422303 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e50012460 con 0x7f0e68060100 2021-10-20T23:26:57.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e6e325700 1 -- 172.21.15.12:0/3007422303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 msgr2=0x7f0e68064d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e6e325700 1 --2- 172.21.15.12:0/3007422303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 0x7f0e68064d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f0e60001490 tx=0x7f0e50006df0).stop 2021-10-20T23:26:57.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e6e325700 1 -- 172.21.15.12:0/3007422303 shutdown_connections 2021-10-20T23:26:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e6e325700 1 --2- 172.21.15.12:0/3007422303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 0x7f0e68064d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e6e325700 1 -- 172.21.15.12:0/3007422303 >> 172.21.15.12:0/3007422303 conn(0x7f0e6805cf60 msgr2=0x7f0e6805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e6e325700 1 -- 172.21.15.12:0/3007422303 shutdown_connections 2021-10-20T23:26:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.443+0000 7f0e6e325700 1 -- 172.21.15.12:0/3007422303 wait complete. 2021-10-20T23:26:57.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 Processor -- start 2021-10-20T23:26:57.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 -- start start 2021-10-20T23:26:57.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 0x7f0e68141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e680b38d0 0x7f0e6813c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6813cd30 0x7f0e680ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680b17d0 con 0x7f0e6813cd30 2021-10-20T23:26:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68150260 con 0x7f0e680b38d0 2021-10-20T23:26:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68141870 con 0x7f0e68060100 2021-10-20T23:26:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6c8c2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6813cd30 0x7f0e680ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e67fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 0x7f0e68141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6c8c2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6813cd30 0x7f0e680ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41872/0 (socket says 172.21.15.12:41872) 2021-10-20T23:26:57.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6c8c2700 1 -- 172.21.15.12:0/1828244194 learned_addr learned my addr 172.21.15.12:0/1828244194 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:57.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e677fe700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e680b38d0 0x7f0e6813c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6c8c2700 1 -- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 msgr2=0x7f0e68141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6c8c2700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 0x7f0e68141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6c8c2700 1 -- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e680b38d0 msgr2=0x7f0e6813c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6c8c2700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e680b38d0 0x7f0e6813c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6c8c2700 1 -- 172.21.15.12:0/1828244194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5000b180 con 0x7f0e6813cd30 2021-10-20T23:26:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e677fe700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e680b38d0 0x7f0e6813c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:26:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6c8c2700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6813cd30 0x7f0e680ae870 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f0e60001bc0 tx=0x7f0e600019c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:57.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e657fa700 1 -- 172.21.15.12:0/1828244194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e60004ab0 con 0x7f0e6813cd30 2021-10-20T23:26:57.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e680b0e90 con 0x7f0e6813cd30 2021-10-20T23:26:57.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e657fa700 1 -- 172.21.15.12:0/1828244194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e60004c10 con 0x7f0e6813cd30 2021-10-20T23:26:57.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e657fa700 1 -- 172.21.15.12:0/1828244194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e60007170 con 0x7f0e6813cd30 2021-10-20T23:26:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.447+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e680b14c0 con 0x7f0e6813cd30 2021-10-20T23:26:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.451+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e68064870 con 0x7f0e6813cd30 2021-10-20T23:26:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.451+0000 7f0e657fa700 1 -- 172.21.15.12:0/1828244194 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0e600072d0 con 0x7f0e6813cd30 2021-10-20T23:26:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.451+0000 7f0e657fa700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e40053640 0x7f0e40055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.451+0000 7f0e657fa700 1 -- 172.21.15.12:0/1828244194 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0e6006b800 con 0x7f0e6813cd30 2021-10-20T23:26:57.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.451+0000 7f0e67fff700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e40053640 0x7f0e40055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.451+0000 7f0e67fff700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e40053640 0x7f0e40055b00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f0e5001a000 tx=0x7f0e50014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:57.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.455+0000 7f0e657fa700 1 -- 172.21.15.12:0/1828244194 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e60042760 con 0x7f0e6813cd30 2021-10-20T23:26:57.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.583+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e68057350 con 0x7f0e6813cd30 2021-10-20T23:26:57.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.583+0000 7f0e657fa700 1 -- 172.21.15.12:0/1828244194 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0e60045d80 con 0x7f0e6813cd30 2021-10-20T23:26:57.597 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:26:57.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e40053640 msgr2=0x7f0e40055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e40053640 0x7f0e40055b00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f0e5001a000 tx=0x7f0e50014000).stop 2021-10-20T23:26:57.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6813cd30 msgr2=0x7f0e680ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6813cd30 0x7f0e680ae870 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f0e60001bc0 tx=0x7f0e600019c0).stop 2021-10-20T23:26:57.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 shutdown_connections 2021-10-20T23:26:57.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e40053640 0x7f0e40055b00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6813cd30 0x7f0e680ae870 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e680b38d0 0x7f0e6813c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 --2- 172.21.15.12:0/1828244194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e68060100 0x7f0e68141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 >> 172.21.15.12:0/1828244194 conn(0x7f0e6805cf60 msgr2=0x7f0e68064c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:57.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 shutdown_connections 2021-10-20T23:26:57.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.587+0000 7f0e6e325700 1 -- 172.21.15.12:0/1828244194 wait complete. 2021-10-20T23:26:57.607 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:26:57.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.703+0000 7f4211dd6700 1 Processor -- start 2021-10-20T23:26:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.703+0000 7f4211dd6700 1 -- start start 2021-10-20T23:26:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f420c0b2580 0x7f420c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f420c0a8ac0 0x7f420c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0a70c0 con 0x7f420c0b0010 2021-10-20T23:26:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0a72f0 con 0x7f420c0b2580 2021-10-20T23:26:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0a7590 con 0x7f420c0a8ac0 2021-10-20T23:26:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4210dd4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f420c0b2580 0x7f420c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4210dd4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f420c0b2580 0x7f420c14ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41878/0 (socket says 172.21.15.12:41878) 2021-10-20T23:26:57.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4210dd4700 1 -- 172.21.15.12:0/3217294078 learned_addr learned my addr 172.21.15.12:0/3217294078 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:57.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f42115d5700 1 --2- 172.21.15.12:0/3217294078 >> v2:172.21.15.31:3300/0 conn(0x7f420c0a8ac0 0x7f420c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4210dd4700 1 -- 172.21.15.12:0/3217294078 >> v2:172.21.15.31:3300/0 conn(0x7f420c0a8ac0 msgr2=0x7f420c14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4210dd4700 1 --2- 172.21.15.12:0/3217294078 >> v2:172.21.15.31:3300/0 conn(0x7f420c0a8ac0 0x7f420c14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4210dd4700 1 -- 172.21.15.12:0/3217294078 >> v1:172.21.15.31:6789/0 conn(0x7f420c0b0010 legacy=0x7f420c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4210dd4700 1 -- 172.21.15.12:0/3217294078 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0a7830 con 0x7f420c0b2580 2021-10-20T23:26:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4210dd4700 1 --2- 172.21.15.12:0/3217294078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 0x7f420c14ae40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f4200002f70 tx=0x7f4200006eb0).ready entity=mon.0 client_cookie=1263c75bdfdc091c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f420b7fe700 1 -- 172.21.15.12:0/3217294078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f420000d5c0 con 0x7f420c0b2580 2021-10-20T23:26:57.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f420b7fe700 1 -- 172.21.15.12:0/3217294078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4200000e90 con 0x7f420c0b2580 2021-10-20T23:26:57.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f420b7fe700 1 -- 172.21.15.12:0/3217294078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f420000d950 con 0x7f420c0b2580 2021-10-20T23:26:57.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 -- 172.21.15.12:0/3217294078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 msgr2=0x7f420c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 --2- 172.21.15.12:0/3217294078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 0x7f420c14ae40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f4200002f70 tx=0x7f4200006eb0).stop 2021-10-20T23:26:57.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 -- 172.21.15.12:0/3217294078 shutdown_connections 2021-10-20T23:26:57.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 --2- 172.21.15.12:0/3217294078 >> v2:172.21.15.31:3300/0 conn(0x7f420c0a8ac0 0x7f420c14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 --2- 172.21.15.12:0/3217294078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 0x7f420c14ae40 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 -- 172.21.15.12:0/3217294078 >> 172.21.15.12:0/3217294078 conn(0x7f420c060180 msgr2=0x7f420c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 -- 172.21.15.12:0/3217294078 shutdown_connections 2021-10-20T23:26:57.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.707+0000 7f4211dd6700 1 -- 172.21.15.12:0/3217294078 wait complete. 2021-10-20T23:26:57.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 Processor -- start 2021-10-20T23:26:57.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 -- start start 2021-10-20T23:26:57.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0a8ac0 0x7f420c15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0b0010 0x7f420c156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 0x7f420c0ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c145fe0 con 0x7f420c0b2580 2021-10-20T23:26:57.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c11e3a0 con 0x7f420c0b0010 2021-10-20T23:26:57.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c159ad0 con 0x7f420c0a8ac0 2021-10-20T23:26:57.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f42115d5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 0x7f420c0ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f42115d5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 0x7f420c0ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41886/0 (socket says 172.21.15.12:41886) 2021-10-20T23:26:57.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f42115d5700 1 -- 172.21.15.12:0/2392565456 learned_addr learned my addr 172.21.15.12:0/2392565456 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:57.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f420bfff700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0b0010 0x7f420c156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4210dd4700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0a8ac0 0x7f420c15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f42115d5700 1 -- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0a8ac0 msgr2=0x7f420c15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f42115d5700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0a8ac0 0x7f420c15a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f42115d5700 1 -- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0b0010 msgr2=0x7f420c156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f42115d5700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0b0010 0x7f420c156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f42115d5700 1 -- 172.21.15.12:0/2392565456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420000b1e0 con 0x7f420c0b2580 2021-10-20T23:26:57.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f420bfff700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0b0010 0x7f420c156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:26:57.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f42115d5700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 0x7f420c0ab250 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f420400c000 tx=0x7f4204006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:57.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4209ffb700 1 -- 172.21.15.12:0/2392565456 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4204010780 con 0x7f420c0b2580 2021-10-20T23:26:57.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4209ffb700 1 -- 172.21.15.12:0/2392565456 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42040108e0 con 0x7f420c0b2580 2021-10-20T23:26:57.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4209ffb700 1 -- 172.21.15.12:0/2392565456 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4204010c40 con 0x7f420c0b2580 2021-10-20T23:26:57.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c159d70 con 0x7f420c0b2580 2021-10-20T23:26:57.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.711+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c065110 con 0x7f420c0b2580 2021-10-20T23:26:57.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.715+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c057350 con 0x7f420c0b2580 2021-10-20T23:26:57.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.715+0000 7f4209ffb700 1 -- 172.21.15.12:0/2392565456 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f420401c460 con 0x7f420c0b2580 2021-10-20T23:26:57.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.715+0000 7f4209ffb700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f41ec0534f0 0x7f41ec0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:57.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.715+0000 7f4209ffb700 1 -- 172.21.15.12:0/2392565456 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f420406bff0 con 0x7f420c0b2580 2021-10-20T23:26:57.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.715+0000 7f4210dd4700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f41ec0534f0 0x7f41ec0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:57.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.715+0000 7f4210dd4700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f41ec0534f0 0x7f41ec0559b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f420001a000 tx=0x7f4200015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:57.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.723+0000 7f4209ffb700 1 -- 172.21.15.12:0/2392565456 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4204042ee0 con 0x7f420c0b2580 2021-10-20T23:26:57.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.883+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f420c0698e0 con 0x7f420c0b2580 2021-10-20T23:26:57.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4209ffb700 1 -- 172.21.15.12:0/2392565456 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f4204046500 con 0x7f420c0b2580 2021-10-20T23:26:57.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:57.894 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5990,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/246201101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":246201101},{"type":"v1","addr":"172.21.15.12:6833","nonce":246201101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1822115331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1822115331},{"type":"v1","addr":"172.21.15.31:6835","nonce":1822115331}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:26:49.418101+0000","modified":"2021-10-20T23:26:50.420912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1566657212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1566657212},{"type":"v1","addr":"172.21.15.12:6835","nonce":1566657212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-20T23:26:57.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f41ec0534f0 msgr2=0x7f41ec0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f41ec0534f0 0x7f41ec0559b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f420001a000 tx=0x7f4200015000).stop 2021-10-20T23:26:57.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 msgr2=0x7f420c0ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:57.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 0x7f420c0ab250 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f420400c000 tx=0x7f4204006df0).stop 2021-10-20T23:26:57.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 shutdown_connections 2021-10-20T23:26:57.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f41ec0534f0 0x7f41ec0559b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f420c0b2580 0x7f420c0ab250 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0b0010 0x7f420c156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 --2- 172.21.15.12:0/2392565456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0a8ac0 0x7f420c15a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:57.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 >> 172.21.15.12:0/2392565456 conn(0x7f420c060180 msgr2=0x7f420c0aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:57.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 shutdown_connections 2021-10-20T23:26:57.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:57.887+0000 7f4211dd6700 1 -- 172.21.15.12:0/2392565456 wait complete. 2021-10-20T23:26:57.899 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 43 2021-10-20T23:26:58.206 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:26:49.418101+0000', 'modified': '2021-10-20T23:26:50.420912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6600}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6600': {'gid': 6600, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1566657212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1566657212}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1566657212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:26:58.207 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:26:58.208 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:26:58.327 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6600,"want_state":"up:active","state":"up:active","rank_uptime":8.8917810290000006,"mdsmap_epoch":43,"osdmap_epoch":91,"osdmap_epoch_barrier":90,"uptime":13.587512126} 2021-10-20T23:26:58.328 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6600, "mdsmap_epoch": 43, "osdmap_epoch": 91, "osdmap_epoch_barrier": 90, "rank_uptime": 8.891781029, "state": "up:active", "uptime": 13.587512126, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:26:58.329 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:26:58.329 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:26:58.330 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:26:58.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:58.331 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:58.341 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:26:58.358 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:26:58.359 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:26:58.418 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:26:58.419 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:26:58.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:58.420 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:26:58.428 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:26:58.428 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:58.431 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:26:58.451 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:26:58.452 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:26:58.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-10-20T23:26:58.503+0000 7ff83b991080 -1 init, newargv = 0x55cdc765ac90 newargc=9 2021-10-20T23:26:58.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14064]: starting ceph client 2021-10-20T23:26:58.509 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:26:58.512 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:26:58.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:58.515 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:26:58.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14064]: starting fuse 2021-10-20T23:26:58.522 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:26:58.523 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:26:58.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:58.525 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:26:58.525 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:26:58.526 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:26:58.526 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:26:58.527 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:26:58.527 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:26:58.527 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:26:58.528 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:26:58.528 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:26:58.529 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:26:58.529 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:26:58.529 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:26:58.530 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:26:58.531 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:26:58.531 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:26:58.532 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:26:58.532 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:26:58.533 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:26:58.533 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:26:58.535 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:26:58.535 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:26:58.535 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:26:58.536 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:26:58.582 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.14064.asok 2021-10-20T23:26:58.589 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14064.asok 2021-10-20T23:26:58.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:58.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14064.asok status 2021-10-20T23:26:58.682 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:26:58.683 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:26:58.683 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:26:58.683 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:26:58.684 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:26:58.684 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:26:58.684 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:26:58.689 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "14064", 2021-10-20T23:26:58.689 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:26:58.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:26:58.689 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:26:58.690 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:26:58.690 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 6164, 2021-10-20T23:26:58.690 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:26:58.690 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:26:58.691 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:26:58.691 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 6164 2021-10-20T23:26:58.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:26:58.691 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:26:58.691 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:26:58.692 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:26:58.692 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 2453813130 2021-10-20T23:26:58.692 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:26:58.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:26:58.693 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:26:58.693 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:26:58.693 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:26:58.693 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 2453813130 2021-10-20T23:26:58.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:26:58.694 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.6164 172.21.15.136:0/2453813130", 2021-10-20T23:26:58.694 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/2453813130", 2021-10-20T23:26:58.694 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:26:58.694 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 43, 2021-10-20T23:26:58.695 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 91, 2021-10-20T23:26:58.695 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:26:58.695 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:26:58.695 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:26:58.696 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:26:58.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:58.697 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:58.698 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:58.705 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:26:58.706 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:26:58.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:58.711 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:58.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:26:58.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55e957700 1 Processor -- start 2021-10-20T23:26:58.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55e957700 1 -- start start 2021-10-20T23:26:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55e957700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff5580b1db0 0x7ff5580b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55e957700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5581483a0 0x7ff5580b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55e957700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580b0350 con 0x7ff5580a70c0 2021-10-20T23:26:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55e957700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5580a90c0 con 0x7ff5580b1db0 2021-10-20T23:26:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55e957700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580b05f0 con 0x7ff5581483a0 2021-10-20T23:26:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55cef4700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff5580a70c0 0x7ff558144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40488/0 (socket says 172.21.15.12:40488) 2021-10-20T23:26:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55cef4700 1 -- 172.21.15.12:0/3314515593 learned_addr learned my addr 172.21.15.12:0/3314515593 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:26:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff557fff700 1 --2- 172.21.15.12:0/3314515593 >> v2:172.21.15.31:3300/0 conn(0x7ff5580b1db0 0x7ff5580b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff5577fe700 1 --2- 172.21.15.12:0/3314515593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5581483a0 0x7ff5580b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff556ffd700 1 -- 172.21.15.12:0/3314515593 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821583078 0 0) 0x7ff5580b0350 con 0x7ff5580a70c0 2021-10-20T23:26:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff556ffd700 1 -- 172.21.15.12:0/3314515593 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff544003260 con 0x7ff5580a70c0 2021-10-20T23:26:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff5577fe700 1 -- 172.21.15.12:0/3314515593 >> v2:172.21.15.31:3300/0 conn(0x7ff5580b1db0 msgr2=0x7ff5580b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff5577fe700 1 --2- 172.21.15.12:0/3314515593 >> v2:172.21.15.31:3300/0 conn(0x7ff5580b1db0 0x7ff5580b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff5577fe700 1 -- 172.21.15.12:0/3314515593 >> v1:172.21.15.12:6789/0 conn(0x7ff5580a70c0 legacy=0x7ff558144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff5577fe700 1 -- 172.21.15.12:0/3314515593 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580b0890 con 0x7ff5581483a0 2021-10-20T23:26:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff5577fe700 1 --2- 172.21.15.12:0/3314515593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5581483a0 0x7ff5580b2190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff548002f70 tx=0x7ff548006df0).ready entity=mon.2 client_cookie=f95a37e1beb09f3d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff556ffd700 1 -- 172.21.15.12:0/3314515593 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54800d4a0 con 0x7ff5581483a0 2021-10-20T23:26:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff556ffd700 1 -- 172.21.15.12:0/3314515593 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548000e90 con 0x7ff5581483a0 2021-10-20T23:26:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff556ffd700 1 -- 172.21.15.12:0/3314515593 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54800d7f0 con 0x7ff5581483a0 2021-10-20T23:26:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55e957700 1 -- 172.21.15.12:0/3314515593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5581483a0 msgr2=0x7ff5580b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.835+0000 7ff55e957700 1 --2- 172.21.15.12:0/3314515593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5581483a0 0x7ff5580b2190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff548002f70 tx=0x7ff548006df0).stop 2021-10-20T23:26:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 -- 172.21.15.12:0/3314515593 shutdown_connections 2021-10-20T23:26:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 --2- 172.21.15.12:0/3314515593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5581483a0 0x7ff5580b2190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 --2- 172.21.15.12:0/3314515593 >> v2:172.21.15.31:3300/0 conn(0x7ff5580b1db0 0x7ff5580b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 -- 172.21.15.12:0/3314515593 >> 172.21.15.12:0/3314515593 conn(0x7ff55805f6b0 msgr2=0x7ff55805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 -- 172.21.15.12:0/3314515593 shutdown_connections 2021-10-20T23:26:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 -- 172.21.15.12:0/3314515593 wait complete. 2021-10-20T23:26:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 Processor -- start 2021-10-20T23:26:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 -- start start 2021-10-20T23:26:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5580a70c0 0x7ff558140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5580b1db0 0x7ff5581569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581483a0 0x7ff558156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580ae0d0 con 0x7ff5580a70c0 2021-10-20T23:26:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580ae9f0 con 0x7ff5581483a0 2021-10-20T23:26:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55e957700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580aec90 con 0x7ff5580b1db0 2021-10-20T23:26:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff557fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5580a70c0 0x7ff558140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff557fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5580a70c0 0x7ff558140070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41896/0 (socket says 172.21.15.12:41896) 2021-10-20T23:26:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff5577fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5580b1db0 0x7ff5581569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff557fff700 1 -- 172.21.15.12:0/2748756240 learned_addr learned my addr 172.21.15.12:0/2748756240 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff55cef4700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581483a0 0x7ff558156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff557fff700 1 -- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5580b1db0 msgr2=0x7ff5581569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff557fff700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5580b1db0 0x7ff5581569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff557fff700 1 -- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581483a0 msgr2=0x7ff558156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:58.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff557fff700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581483a0 0x7ff558156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:58.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff557fff700 1 -- 172.21.15.12:0/2748756240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54800b180 con 0x7ff5580a70c0 2021-10-20T23:26:58.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.839+0000 7ff557fff700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5580a70c0 0x7ff558140070 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7ff54c00c000 tx=0x7ff54c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:58.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff5557fa700 1 -- 172.21.15.12:0/2748756240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54c010780 con 0x7ff5580a70c0 2021-10-20T23:26:58.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5580aef30 con 0x7ff5580a70c0 2021-10-20T23:26:58.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff5557fa700 1 -- 172.21.15.12:0/2748756240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c0108e0 con 0x7ff5580a70c0 2021-10-20T23:26:58.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5580af9f0 con 0x7ff5580a70c0 2021-10-20T23:26:58.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff5557fa700 1 -- 172.21.15.12:0/2748756240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54c010c40 con 0x7ff5580a70c0 2021-10-20T23:26:58.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5580b0b30 con 0x7ff5580a70c0 2021-10-20T23:26:58.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff5557fa700 1 -- 172.21.15.12:0/2748756240 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff54c01c460 con 0x7ff5580a70c0 2021-10-20T23:26:58.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff5557fa700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff5380535b0 0x7ff538055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff5557fa700 1 -- 172.21.15.12:0/2748756240 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff54c06be70 con 0x7ff5580a70c0 2021-10-20T23:26:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff5577fe700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff5380535b0 0x7ff538055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.843+0000 7ff5577fe700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff5380535b0 0x7ff538055a70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7ff54801a000 tx=0x7ff548014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:58.851+0000 7ff5557fa700 1 -- 172.21.15.12:0/2748756240 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff54c042d70 con 0x7ff5580a70c0 2021-10-20T23:26:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.015+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff558057350 con 0x7ff5580a70c0 2021-10-20T23:26:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.015+0000 7ff5557fa700 1 -- 172.21.15.12:0/2748756240 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7ff54c046390 con 0x7ff5580a70c0 2021-10-20T23:26:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:59.024 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5990,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/246201101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":246201101},{"type":"v1","addr":"172.21.15.12:6833","nonce":246201101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1822115331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1822115331},{"type":"v1","addr":"172.21.15.31:6835","nonce":1822115331}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:26:49.418101+0000","modified":"2021-10-20T23:26:50.420912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1566657212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1566657212},{"type":"v1","addr":"172.21.15.12:6835","nonce":1566657212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-20T23:26:59.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff5380535b0 msgr2=0x7ff538055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:59.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff5380535b0 0x7ff538055a70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7ff54801a000 tx=0x7ff548014000).stop 2021-10-20T23:26:59.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5580a70c0 msgr2=0x7ff558140070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:59.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5580a70c0 0x7ff558140070 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7ff54c00c000 tx=0x7ff54c006df0).stop 2021-10-20T23:26:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 shutdown_connections 2021-10-20T23:26:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff5380535b0 0x7ff538055a70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581483a0 0x7ff558156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5580b1db0 0x7ff5581569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 --2- 172.21.15.12:0/2748756240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5580a70c0 0x7ff558140070 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 >> 172.21.15.12:0/2748756240 conn(0x7ff55805f6b0 msgr2=0x7ff5580b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:59.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 shutdown_connections 2021-10-20T23:26:59.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.019+0000 7ff55e957700 1 -- 172.21.15.12:0/2748756240 wait complete. 2021-10-20T23:26:59.029 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 43 2021-10-20T23:26:59.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1 2021-10-20T23:26:59.141 INFO:teuthology.orchestra.run.smithi012.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2021-10-20T23:26:56.221788+0000","btime":"2021-10-20T23:26:49.422983+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-10-20T23:26:49.422983+0000","atime":"0.000000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-10-20T23:26:56.221788+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-10-20T23:26:49.422983+0000"},"version":3,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":3,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":9,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":6164,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6756,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2021-10-20T23:26:59.143 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2021-10-20T23:26:49.422983+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 2, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "xlock_by": {} }, "backtrace_version": 3, "btime": "2021-10-20T23:26:49.422983+0000", "change_attr": 1, "client_caps": [ { "client_id": 6164, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6756, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-10-20T23:26:56.221788+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2021-10-20T23:26:49.422983+0000", "nestlock": {}, "nlink": 1, "nref": 9, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 3, "request": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2021-10-20T23:26:56.221788+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 3, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2021-10-20T23:26:59.144 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:26:59.145 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:59.164 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:59.188 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:59.210 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:26:59.233 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:26:59.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:59.234 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:59.234 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:59.243 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:26:59.244 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:26:59.244 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:26:59.246 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:26:59.246 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:59.299 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14549]: fuse finished with error 0 and tester_r 0 2021-10-20T23:26:59.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:59.301 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:59.302 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:59.308 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:26:59.309 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:26:59.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:26:59.330 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:26:59.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:59.381 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:59.381 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:59.391 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:26:59.391 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:26:59.392 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:26:59.393 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:26:59.393 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:59.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14064]: fuse finished with error 0 and tester_r 0 2021-10-20T23:26:59.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:26:59.411 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:26:59.411 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:59.461 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:26:59.462 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:26:59.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:26:59.501 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:26:59.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:26:59.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184bfff700 1 Processor -- start 2021-10-20T23:26:59.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184bfff700 1 -- start start 2021-10-20T23:26:59.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f184c061320 0x7f184c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:59.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f184c0ad5c0 0x7f184c0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c140440 0x7f184c1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c0aecf0 con 0x7f184c061320 2021-10-20T23:26:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184bfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c0b6f20 con 0x7f184c0ad5c0 2021-10-20T23:26:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0aef20 con 0x7f184c140440 2021-10-20T23:26:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f184c061320 0x7f184c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f184c061320 0x7f184c061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41904/0 (socket says 172.21.15.12:41904) 2021-10-20T23:26:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184affd700 1 -- 172.21.15.12:0/807792506 learned_addr learned my addr 172.21.15.12:0/807792506 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184b7fe700 1 --2- 172.21.15.12:0/807792506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c140440 0x7f184c1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184a7fc700 1 --2- 172.21.15.12:0/807792506 >> v2:172.21.15.31:3300/0 conn(0x7f184c0ad5c0 0x7f184c0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184affd700 1 -- 172.21.15.12:0/807792506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c140440 msgr2=0x7f184c1408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184affd700 1 --2- 172.21.15.12:0/807792506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c140440 0x7f184c1408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184affd700 1 -- 172.21.15.12:0/807792506 >> v2:172.21.15.31:3300/0 conn(0x7f184c0ad5c0 msgr2=0x7f184c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:26:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184affd700 1 --2- 172.21.15.12:0/807792506 >> v2:172.21.15.31:3300/0 conn(0x7f184c0ad5c0 0x7f184c0b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184affd700 1 -- 172.21.15.12:0/807792506 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c0af1c0 con 0x7f184c061320 2021-10-20T23:26:59.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f184affd700 1 --2- 172.21.15.12:0/807792506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c061320 0x7f184c061700 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f184c0aeba0 tx=0x7f1834006eb0).ready entity=mon.0 client_cookie=1cbb535ea9d01596 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:59.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f1849ffb700 1 -- 172.21.15.12:0/807792506 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183400e610 con 0x7f184c061320 2021-10-20T23:26:59.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f1849ffb700 1 -- 172.21.15.12:0/807792506 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1834000e90 con 0x7f184c061320 2021-10-20T23:26:59.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.615+0000 7f1849ffb700 1 -- 172.21.15.12:0/807792506 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183400e9a0 con 0x7f184c061320 2021-10-20T23:26:59.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 -- 172.21.15.12:0/807792506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c061320 msgr2=0x7f184c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:59.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 --2- 172.21.15.12:0/807792506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c061320 0x7f184c061700 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f184c0aeba0 tx=0x7f1834006eb0).stop 2021-10-20T23:26:59.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 -- 172.21.15.12:0/807792506 shutdown_connections 2021-10-20T23:26:59.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 --2- 172.21.15.12:0/807792506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c140440 0x7f184c1408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 --2- 172.21.15.12:0/807792506 >> v2:172.21.15.31:3300/0 conn(0x7f184c0ad5c0 0x7f184c0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 --2- 172.21.15.12:0/807792506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c061320 0x7f184c061700 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 -- 172.21.15.12:0/807792506 >> 172.21.15.12:0/807792506 conn(0x7f184c066de0 msgr2=0x7f184c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:26:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 -- 172.21.15.12:0/807792506 shutdown_connections 2021-10-20T23:26:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 -- 172.21.15.12:0/807792506 wait complete. 2021-10-20T23:26:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 Processor -- start 2021-10-20T23:26:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 -- start start 2021-10-20T23:26:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c061320 0x7f184c0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f184c0ad5c0 0x7f184c148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c140440 0x7f184c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c152500 con 0x7f184c140440 2021-10-20T23:26:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0b1070 con 0x7f184c0ad5c0 2021-10-20T23:26:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.619+0000 7f184bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0b1310 con 0x7f184c061320 2021-10-20T23:26:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c140440 0x7f184c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c140440 0x7f184c152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41912/0 (socket says 172.21.15.12:41912) 2021-10-20T23:26:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184b7fe700 1 -- 172.21.15.12:0/1065583009 learned_addr learned my addr 172.21.15.12:0/1065583009 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:26:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184a7fc700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f184c0ad5c0 0x7f184c148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184affd700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c061320 0x7f184c0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184b7fe700 1 -- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c061320 msgr2=0x7f184c0b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184b7fe700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c061320 0x7f184c0b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184b7fe700 1 -- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f184c0ad5c0 msgr2=0x7f184c148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:26:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184b7fe700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f184c0ad5c0 0x7f184c148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:26:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184b7fe700 1 -- 172.21.15.12:0/1065583009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183400b1e0 con 0x7f184c140440 2021-10-20T23:26:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184b7fe700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c140440 0x7f184c152b90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f1844006e00 tx=0x7f18440091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f1843fff700 1 -- 172.21.15.12:0/1065583009 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f184400c670 con 0x7f184c140440 2021-10-20T23:26:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f1843fff700 1 -- 172.21.15.12:0/1065583009 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184400c7d0 con 0x7f184c140440 2021-10-20T23:26:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c1526f0 con 0x7f184c140440 2021-10-20T23:26:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f1843fff700 1 -- 172.21.15.12:0/1065583009 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f184400cb30 con 0x7f184c140440 2021-10-20T23:26:59.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c0ab6c0 con 0x7f184c140440 2021-10-20T23:26:59.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c0af460 con 0x7f184c140440 2021-10-20T23:26:59.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.623+0000 7f1843fff700 1 -- 172.21.15.12:0/1065583009 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1844022070 con 0x7f184c140440 2021-10-20T23:26:59.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.627+0000 7f1843fff700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18300534f0 0x7f18300559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:26:59.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.627+0000 7f1843fff700 1 -- 172.21.15.12:0/1065583009 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f184406c1a0 con 0x7f184c140440 2021-10-20T23:26:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.627+0000 7f184affd700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18300534f0 0x7f18300559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:26:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.627+0000 7f184affd700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18300534f0 0x7f18300559b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f183401c000 tx=0x7f1834015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:26:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.631+0000 7f1843fff700 1 -- 172.21.15.12:0/1065583009 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1844043090 con 0x7f184c140440 2021-10-20T23:26:59.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.759+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f184c057350 con 0x7f184c140440 2021-10-20T23:26:59.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.759+0000 7f1843fff700 1 -- 172.21.15.12:0/1065583009 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v91) v1 ==== 81+0+34040 (secure 0 0 0) 0x7f18440466b0 con 0x7f184c140440 2021-10-20T23:26:59.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:26:59.768 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:26:59.769 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 91, 2021-10-20T23:26:59.769 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:26:59.769 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:26:59.769 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:26:50.421718+0000", 2021-10-20T23:26:59.770 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:26:59.770 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:26:59.770 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:26:59.770 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:26:59.771 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:26:59.771 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:26:59.771 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:26:59.772 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:26:59.772 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:26:59.772 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:59.772 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:26:59.772 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:26:59.773 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:26:59.773 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:26:59.773 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:26:59.773 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 16, 2021-10-20T23:26:59.774 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:26:59.774 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:26:59.774 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:26:59.774 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:26:59.775 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:26:59.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.775 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:26:59.775 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:26:59.775 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:26:59.776 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:59.776 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:59.776 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:59.776 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:59.776 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:59.777 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:59.777 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:59.777 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:59.777 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:26:59.778 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:26:59.778 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:26:59.778 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:26:59.778 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:26:59.778 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:59.779 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:59.779 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:59.779 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:59.779 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:59.780 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:59.781 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:59.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.781 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:26:59.781 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:59.782 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:59.782 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:59.782 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:59.782 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:59.783 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:59.783 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:59.783 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:59.783 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:59.784 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:59.784 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:59.784 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:59.784 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:59.784 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:59.785 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:59.785 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:59.785 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:59.785 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:59.786 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:59.786 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:59.786 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:59.786 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:59.786 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:59.787 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:59.787 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:59.787 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:59.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.788 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:59.788 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:59.788 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:59.788 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:59.788 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:59.789 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:59.789 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:59.789 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:59.789 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:59.790 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:59.790 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:59.790 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:26:59.791 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:26:59.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.791 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:59.792 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:26:59.792 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.793 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:26:59.793 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:26:59.793 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:26:59.793 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:59.794 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:59.794 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:59.795 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:59.796 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:59.796 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:59.796 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:59.796 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:59.797 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:26:59.797 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:26:59.797 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:26:59.797 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:26:59.798 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:26:59.798 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:59.798 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:59.798 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:59.798 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:59.799 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:59.799 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:59.799 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:59.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.800 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:26:59.800 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:59.800 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:59.800 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:59.801 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:59.801 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:59.801 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:59.801 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:59.803 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:59.803 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:59.803 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:59.803 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:59.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.807 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:59.807 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:59.807 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:59.809 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:59.809 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:59.809 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:59.810 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:59.810 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:59.810 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:59.810 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:59.811 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:59.811 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:26:59.811 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:59.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:26:59.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.812 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 15, 2021-10-20T23:26:59.813 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:26:59.813 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:26:47.507897+0000", 2021-10-20T23:26:59.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:59.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:59.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:59.814 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:59.814 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:59.814 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:59.814 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:59.815 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:59.815 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:26:59.815 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:26:59.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:26:59.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:26:59.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:26:59.816 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:59.817 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:59.817 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:59.817 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:59.817 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:59.818 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:59.818 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:59.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.818 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "90", 2021-10-20T23:26:59.818 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:59.819 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:59.819 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:59.819 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:59.820 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:59.820 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:59.820 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:59.820 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:59.820 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:59.821 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:59.821 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:59.821 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:59.821 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:59.822 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:59.822 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:59.822 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:59.822 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:59.823 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:59.823 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:59.823 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:59.823 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:59.823 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:59.824 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:59.824 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:59.824 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:59.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:59.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.825 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:59.825 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:59.825 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:59.826 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:59.826 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:59.826 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:59.826 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:59.826 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:59.827 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:59.827 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:59.827 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:59.827 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:26:59.828 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:26:59.828 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:26:59.828 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:26:59.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.829 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:59.829 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:26:59.829 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:26:59.829 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.830 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.830 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 16, 2021-10-20T23:26:59.831 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:26:59.831 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:26:48.434318+0000", 2021-10-20T23:26:59.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:26:59.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:26:59.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:26:59.832 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:26:59.832 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:26:59.832 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:26:59.832 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:26:59.833 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:26:59.833 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:26:59.833 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:26:59.833 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:26:59.834 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:26:59.834 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:26:59.834 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:26:59.834 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:26:59.835 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:26:59.835 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:26:59.835 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:26:59.835 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:26:59.835 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:26:59.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.836 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "91", 2021-10-20T23:26:59.836 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:26:59.836 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:26:59.837 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:26:59.837 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:26:59.837 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:26:59.837 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:26:59.837 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:26:59.838 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:26:59.838 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:26:59.838 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:26:59.838 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:26:59.839 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:26:59.839 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:26:59.839 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:26:59.839 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:26:59.840 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:26:59.840 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:26:59.840 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:26:59.840 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:26:59.841 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:26:59.841 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:26:59.841 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:26:59.841 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:26:59.841 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:26:59.842 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:26:59.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:26:59.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.842 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:26:59.843 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:26:59.843 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:26:59.843 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:26:59.843 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:26:59.844 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:26:59.844 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:26:59.844 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:26:59.844 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:26:59.844 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:26:59.845 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:26:59.845 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:26:59.845 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:26:59.845 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:26:59.846 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:26:59.846 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.846 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.846 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.847 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:59.847 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:26:59.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.847 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:26:59.847 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:26:59.848 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:59.848 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:59.848 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:59.848 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:59.849 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:59.849 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:59.849 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:59.849 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:26:59.850 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:59.850 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:59.850 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:59.850 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.851 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:26:59.851 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:59.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.852 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:26:59.852 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:59.853 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.853 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.854 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:59.854 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.855 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:26:59.855 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:59.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.856 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:26:59.856 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:59.856 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.856 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.857 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:59.857 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.858 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:26:59.858 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:59.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.859 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.859 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:26:59.860 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:59.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.860 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.861 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:59.861 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.862 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:26:59.862 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:59.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.864 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:26:59.864 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:26:59.864 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.864 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.865 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:26:59.865 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:26:59.865 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:26:59.866 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:26:59.866 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:59.866 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:59.866 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:59.867 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.867 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:26:59.868 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:26:59.868 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:59.868 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:59.868 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:59.869 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:59.869 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:59.869 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:59.869 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:59.869 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 88, 2021-10-20T23:26:59.870 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:59.870 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:59.870 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:59.870 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.871 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:26:59.871 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:59.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.872 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:26:59.873 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:59.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.873 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.874 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:59.874 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.875 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:26:59.875 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:59.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.876 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:26:59.876 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:59.876 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.876 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.877 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:59.877 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.878 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:26:59.878 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:59.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.879 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:26:59.879 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:59.879 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.881 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:26:59.881 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:59.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.882 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:26:59.882 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:26:59.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.883 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.883 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:26:59.884 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:26:59.884 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:26:59.884 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:26:59.884 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:59.884 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:59.885 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:59.885 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.886 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:26:59.886 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:26:59.886 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:59.886 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:59.887 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:59.887 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:59.887 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:59.887 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:59.887 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:59.888 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:26:59.888 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:59.888 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:59.888 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:59.889 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.889 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.889 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:26:59.890 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:59.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.890 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:26:59.891 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:59.891 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.891 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.892 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:59.892 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.892 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.893 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:26:59.893 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:59.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.894 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:26:59.894 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:59.894 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.894 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.895 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:59.895 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.896 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:26:59.896 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:59.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.897 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:26:59.897 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:59.898 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.898 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.898 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:59.899 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.899 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:26:59.900 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:59.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.901 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:26:59.901 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:26:59.901 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.901 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.902 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:26:59.902 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:26:59.902 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:26:59.902 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:26:59.903 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:59.903 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:59.903 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:59.903 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.904 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:26:59.904 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:26:59.904 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:59.905 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:59.905 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:59.905 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:59.905 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:59.906 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:59.906 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:59.906 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:26:59.906 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:59.907 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:59.907 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:59.907 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.908 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:26:59.908 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:59.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.909 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.909 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:26:59.909 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:59.909 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.910 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.910 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:59.910 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:26:59.911 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:59.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.912 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:26:59.913 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:59.913 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.913 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.914 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:59.914 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.915 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:26:59.915 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:59.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.916 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:26:59.916 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:59.916 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.917 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.917 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:59.917 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.918 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:26:59.918 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:59.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.919 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:26:59.919 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:26:59.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.920 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.920 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:26:59.920 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:26:59.921 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:26:59.921 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:26:59.921 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:59.921 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:59.922 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:59.922 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.923 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:26:59.923 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:26:59.923 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:59.923 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:59.923 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:59.924 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:59.924 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:59.924 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:59.924 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:59.925 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:26:59.925 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:59.925 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:59.925 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:59.926 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.926 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:26:59.926 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:59.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.927 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.927 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:26:59.928 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:59.928 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.928 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.929 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:59.929 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.930 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:26:59.930 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:59.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:26:59.931 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:59.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.931 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.932 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:59.932 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:26:59.933 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:59.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:26:59.934 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:59.934 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.935 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.935 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:59.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:26:59.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:59.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.937 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:26:59.938 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:26:59.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.938 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.939 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:26:59.939 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:26:59.939 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:26:59.939 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:26:59.939 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:59.940 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:59.940 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:59.940 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.941 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:26:59.941 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:26:59.941 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:59.942 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:59.942 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:59.942 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:59.942 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:59.942 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:59.943 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:59.943 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:26:59.943 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:59.943 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:59.944 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:59.944 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.945 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:26:59.945 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:59.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.946 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:26:59.947 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:59.947 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.947 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.948 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:59.948 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:26:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.950 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:26:59.950 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:59.950 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.950 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.951 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:59.951 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.952 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:26:59.952 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:59.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.953 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:26:59.953 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:59.954 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.954 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.954 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:59.954 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.955 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:26:59.955 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:59.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.956 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:26:59.957 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:26:59.957 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.957 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.957 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:26:59.958 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:26:59.958 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:26:59.958 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:26:59.958 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:59.959 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:59.959 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:59.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.960 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:26:59.960 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:26:59.961 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:59.961 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:59.961 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:59.961 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:59.961 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:59.962 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:59.962 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:59.962 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:26:59.963 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:59.963 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:59.963 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:59.963 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.964 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:26:59.964 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:59.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.965 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:26:59.965 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:59.966 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.966 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.966 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:59.967 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.967 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:26:59.968 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:59.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.968 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.968 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:26:59.969 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:59.969 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.969 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.970 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:59.970 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.971 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:26:59.971 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:59.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.972 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:26:59.972 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:59.972 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.972 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.973 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:59.973 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.974 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:26:59.974 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:59.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.975 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.975 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:26:59.975 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:26:59.976 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.976 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.976 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:26:59.976 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:26:59.977 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:26:59.977 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:26:59.977 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:59.977 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:59.978 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:59.978 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.979 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:26:59.979 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:26:59.979 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:26:59.979 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:26:59.980 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:26:59.980 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:26:59.980 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:26:59.980 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:26:59.981 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:26:59.981 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 75, 2021-10-20T23:26:59.981 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:26:59.981 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:26:59.982 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:26:59.982 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.983 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:26:59.983 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:59.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.984 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:26:59.984 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:59.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.984 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.985 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:26:59.985 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.986 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:26:59.986 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:59.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.987 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:26:59.987 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:59.987 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.988 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.988 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:26:59.988 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.989 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:26:59.989 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:59.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.990 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:26:59.990 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:59.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.991 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.991 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:26:59.992 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:26:59.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:26:59.992 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:26:59.992 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:59.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:26:59.993 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:26:59.994 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:26:59.994 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.994 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:26:59.995 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:26:59.995 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:26:59.995 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:26:59.995 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:26:59.995 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:26:59.996 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:26:59.996 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:26:59.996 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:26:59.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:26:59.997 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:26:59.997 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:26:59.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:26:59.997 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:26:59.998 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:26:59.998 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:26:59.998 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:26:59.999 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:26:59.999 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:26:59.999 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:26:59.999 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:00.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:00.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:00.000 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:00.000 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:00.000 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:00.001 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:00.001 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:00.001 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:00.001 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:27:00.002 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:00.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:00.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:00.002 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:00.003 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:00.003 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:00.003 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:00.003 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:00.003 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:00.004 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:27:00.004 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:00.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:00.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:00.005 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:00.005 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:00.005 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:00.005 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:00.006 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:00.006 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:00.006 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:27:00.006 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:00.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:00.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:00.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:00.007 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:00.007 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:00.008 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:00.008 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:00.008 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:00.008 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:27:00.009 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:00.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:00.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:00.009 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:00.009 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:00.010 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:00.010 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:00.010 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:00.010 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:00.011 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:27:00.011 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:00.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:00.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:00.012 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:00.012 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:00.012 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:00.013 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:00.013 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:00.013 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:00.013 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:27:00.014 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:00.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:00.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:00.014 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:00.015 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:00.015 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:00.015 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:00.015 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:00.016 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:00.016 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:27:00.016 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:00.016 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:00.016 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:00.017 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:27:00.017 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:27:00.017 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:27:00.017 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:27:00.018 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:27:00.018 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:27:00.018 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:27:00.018 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:27:00.019 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:00.019 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:27:00.019 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:27:00.019 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:00.019 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:27:00.020 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:00.020 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:00.020 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:27:00.020 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:27:00.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:00.021 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:27:00.021 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:00.021 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:00.022 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:27:00.022 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:00.022 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:00.022 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:27:00.023 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:00.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:00.023 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:27:00.023 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:27:00.023 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:27:00.024 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:27:00.024 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:27:00.024 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:00.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18300534f0 msgr2=0x7f18300559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18300534f0 0x7f18300559b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f183401c000 tx=0x7f1834015000).stop 2021-10-20T23:27:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c140440 msgr2=0x7f184c152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c140440 0x7f184c152b90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f1844006e00 tx=0x7f18440091d0).stop 2021-10-20T23:27:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 shutdown_connections 2021-10-20T23:27:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18300534f0 0x7f18300559b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f184c140440 0x7f184c152b90 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f184c0ad5c0 0x7f184c148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 --2- 172.21.15.12:0/1065583009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f184c061320 0x7f184c0b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 >> 172.21.15.12:0/1065583009 conn(0x7f184c066de0 msgr2=0x7f184c147890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 shutdown_connections 2021-10-20T23:27:00.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:26:59.763+0000 7f184bfff700 1 -- 172.21.15.12:0/1065583009 wait complete. 2021-10-20T23:27:00.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec493ba700 1 Processor -- start 2021-10-20T23:27:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec493ba700 1 -- start start 2021-10-20T23:27:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec493ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b3060 0x7fec440b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec493ba700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec440aac20 0x7fec44064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec493ba700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec440b2380 con 0x7fec440b7370 2021-10-20T23:27:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec493ba700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec44144250 con 0x7fec440aac20 2021-10-20T23:27:00.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec493ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec440b3570 con 0x7fec440b3060 2021-10-20T23:27:00.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec43fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fec440b7370 0x7fec4413e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40512/0 (socket says 172.21.15.12:40512) 2021-10-20T23:27:00.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec43fff700 1 -- 172.21.15.12:0/1326974428 learned_addr learned my addr 172.21.15.12:0/1326974428 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:00.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec48bb9700 1 --2- 172.21.15.12:0/1326974428 >> v2:172.21.15.12:3300/0 conn(0x7fec440aac20 0x7fec44064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec437fe700 1 --2- 172.21.15.12:0/1326974428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b3060 0x7fec440b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec42ffd700 1 -- 172.21.15.12:0/1326974428 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513786516 0 0) 0x7fec440b2380 con 0x7fec440b7370 2021-10-20T23:27:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec42ffd700 1 -- 172.21.15.12:0/1326974428 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec30003260 con 0x7fec440b7370 2021-10-20T23:27:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec48bb9700 1 -- 172.21.15.12:0/1326974428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b3060 msgr2=0x7fec440b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec48bb9700 1 --2- 172.21.15.12:0/1326974428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b3060 0x7fec440b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec48bb9700 1 -- 172.21.15.12:0/1326974428 >> v1:172.21.15.12:6789/0 conn(0x7fec440b7370 legacy=0x7fec4413e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.131+0000 7fec48bb9700 1 -- 172.21.15.12:0/1326974428 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec440b25b0 con 0x7fec440aac20 2021-10-20T23:27:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec48bb9700 1 --2- 172.21.15.12:0/1326974428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440aac20 0x7fec44064ba0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fec34002f70 tx=0x7fec34006df0).ready entity=mon.0 client_cookie=5fd8cfda270a4d93 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec42ffd700 1 -- 172.21.15.12:0/1326974428 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec3400d570 con 0x7fec440aac20 2021-10-20T23:27:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec42ffd700 1 -- 172.21.15.12:0/1326974428 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec34000e90 con 0x7fec440aac20 2021-10-20T23:27:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec42ffd700 1 -- 172.21.15.12:0/1326974428 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec3400d8c0 con 0x7fec440aac20 2021-10-20T23:27:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 -- 172.21.15.12:0/1326974428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440aac20 msgr2=0x7fec44064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 --2- 172.21.15.12:0/1326974428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440aac20 0x7fec44064ba0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fec34002f70 tx=0x7fec34006df0).stop 2021-10-20T23:27:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 -- 172.21.15.12:0/1326974428 shutdown_connections 2021-10-20T23:27:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 --2- 172.21.15.12:0/1326974428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440aac20 0x7fec44064ba0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 --2- 172.21.15.12:0/1326974428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b3060 0x7fec440b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 -- 172.21.15.12:0/1326974428 >> 172.21.15.12:0/1326974428 conn(0x7fec4405f6b0 msgr2=0x7fec4405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 -- 172.21.15.12:0/1326974428 shutdown_connections 2021-10-20T23:27:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 -- 172.21.15.12:0/1326974428 wait complete. 2021-10-20T23:27:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 Processor -- start 2021-10-20T23:27:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.135+0000 7fec493ba700 1 -- start start 2021-10-20T23:27:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec493ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec440aac20 0x7fec440abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec493ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440b3060 0x7fec440b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec493ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b7370 0x7fec440b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec493ba700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440ac5d0 con 0x7fec440b3060 2021-10-20T23:27:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec493ba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44150e90 con 0x7fec440aac20 2021-10-20T23:27:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec493ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec44151130 con 0x7fec440b7370 2021-10-20T23:27:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec437fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440b3060 0x7fec440b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec437fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440b3060 0x7fec440b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41926/0 (socket says 172.21.15.12:41926) 2021-10-20T23:27:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec437fe700 1 -- 172.21.15.12:0/4180493448 learned_addr learned my addr 172.21.15.12:0/4180493448 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec43fff700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec440aac20 0x7fec440abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec48bb9700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b7370 0x7fec440b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec437fe700 1 -- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b7370 msgr2=0x7fec440b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec437fe700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b7370 0x7fec440b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec437fe700 1 -- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec440aac20 msgr2=0x7fec440abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec437fe700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec440aac20 0x7fec440abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec437fe700 1 -- 172.21.15.12:0/4180493448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3400b180 con 0x7fec440b3060 2021-10-20T23:27:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec43fff700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec440aac20 0x7fec440abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec48bb9700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b7370 0x7fec440b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec437fe700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440b3060 0x7fec440b0d60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fec3800a000 tx=0x7fec38008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec417fa700 1 -- 172.21.15.12:0/4180493448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec38011780 con 0x7fec440b3060 2021-10-20T23:27:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec417fa700 1 -- 172.21.15.12:0/4180493448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec380118e0 con 0x7fec440b3060 2021-10-20T23:27:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec440ab6c0 con 0x7fec440b3060 2021-10-20T23:27:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec417fa700 1 -- 172.21.15.12:0/4180493448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec38011c40 con 0x7fec440b3060 2021-10-20T23:27:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.139+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec440acfe0 con 0x7fec440b3060 2021-10-20T23:27:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.143+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec44057350 con 0x7fec440b3060 2021-10-20T23:27:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.143+0000 7fec417fa700 1 -- 172.21.15.12:0/4180493448 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec38006030 con 0x7fec440b3060 2021-10-20T23:27:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.143+0000 7fec417fa700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec24053610 0x7fec24055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.143+0000 7fec417fa700 1 -- 172.21.15.12:0/4180493448 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fec3806b540 con 0x7fec440b3060 2021-10-20T23:27:00.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.143+0000 7fec43fff700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec24053610 0x7fec24055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.143+0000 7fec43fff700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec24053610 0x7fec24055ad0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fec3c00b000 tx=0x7fec3c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:00.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.147+0000 7fec417fa700 1 -- 172.21.15.12:0/4180493448 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec38042540 con 0x7fec440b3060 2021-10-20T23:27:00.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.311+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec440601a0 con 0x7fec440b3060 2021-10-20T23:27:00.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.311+0000 7fec417fa700 1 -- 172.21.15.12:0/4180493448 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fec38045b60 con 0x7fec440b3060 2021-10-20T23:27:00.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:00.320 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5990,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/246201101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":246201101},{"type":"v1","addr":"172.21.15.12:6833","nonce":246201101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1822115331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1822115331},{"type":"v1","addr":"172.21.15.31:6835","nonce":1822115331}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:26:49.418101+0000","modified":"2021-10-20T23:26:50.420912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1566657212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1566657212},{"type":"v1","addr":"172.21.15.12:6835","nonce":1566657212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-20T23:27:00.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec24053610 msgr2=0x7fec24055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec24053610 0x7fec24055ad0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fec3c00b000 tx=0x7fec3c009040).stop 2021-10-20T23:27:00.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440b3060 msgr2=0x7fec440b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440b3060 0x7fec440b0d60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fec3800a000 tx=0x7fec38008040).stop 2021-10-20T23:27:00.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 shutdown_connections 2021-10-20T23:27:00.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fec24053610 0x7fec24055ad0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec440b7370 0x7fec440b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec440b3060 0x7fec440b0d60 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 --2- 172.21.15.12:0/4180493448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec440aac20 0x7fec440abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 >> 172.21.15.12:0/4180493448 conn(0x7fec4405f6b0 msgr2=0x7fec4405cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:00.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 shutdown_connections 2021-10-20T23:27:00.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.315+0000 7fec493ba700 1 -- 172.21.15.12:0/4180493448 wait complete. 2021-10-20T23:27:00.325 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 43 2021-10-20T23:27:00.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:27:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb9d60700 1 Processor -- start 2021-10-20T23:27:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb9d60700 1 -- start start 2021-10-20T23:27:00.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb9d60700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 0x7fdeb4147470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb9d60700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdeb40b1d10 0x7fdeb414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb9d60700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb40b2b80 con 0x7fdeb405c490 2021-10-20T23:27:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb9d60700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb41451b0 con 0x7fdeb40b1d10 2021-10-20T23:27:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb9d60700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb414aad0 con 0x7fdeb40b27a0 2021-10-20T23:27:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeabfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdeb40b1d10 0x7fdeb414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb955f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdeb405c490 0x7fdeb40a8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40530/0 (socket says 172.21.15.12:40530) 2021-10-20T23:27:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb955f700 1 -- 172.21.15.12:0/4232868038 learned_addr learned my addr 172.21.15.12:0/4232868038 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeb8d5e700 1 --2- 172.21.15.12:0/4232868038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 0x7fdeb4147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeab7fe700 1 -- 172.21.15.12:0/4232868038 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632549183 0 0) 0x7fdeb40b2b80 con 0x7fdeb405c490 2021-10-20T23:27:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeab7fe700 1 -- 172.21.15.12:0/4232868038 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdea0003260 con 0x7fdeb405c490 2021-10-20T23:27:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeabfff700 1 -- 172.21.15.12:0/4232868038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 msgr2=0x7fdeb4147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:00.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeabfff700 1 --2- 172.21.15.12:0/4232868038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 0x7fdeb4147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeabfff700 1 -- 172.21.15.12:0/4232868038 >> v1:172.21.15.12:6789/0 conn(0x7fdeb405c490 legacy=0x7fdeb40a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeabfff700 1 -- 172.21.15.12:0/4232868038 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb40b0ec0 con 0x7fdeb40b1d10 2021-10-20T23:27:00.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeabfff700 1 --2- 172.21.15.12:0/4232868038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb40b1d10 0x7fdeb414b1d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fdea4002f70 tx=0x7fdea4006df0).ready entity=mon.0 client_cookie=ea8fb68357f3cf40 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:00.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeab7fe700 1 -- 172.21.15.12:0/4232868038 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea400d4a0 con 0x7fdeb40b1d10 2021-10-20T23:27:00.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeab7fe700 1 -- 172.21.15.12:0/4232868038 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea4000e90 con 0x7fdeb40b1d10 2021-10-20T23:27:00.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.431+0000 7fdeab7fe700 1 -- 172.21.15.12:0/4232868038 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea400d7f0 con 0x7fdeb40b1d10 2021-10-20T23:27:00.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 -- 172.21.15.12:0/4232868038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb40b1d10 msgr2=0x7fdeb414b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 --2- 172.21.15.12:0/4232868038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb40b1d10 0x7fdeb414b1d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fdea4002f70 tx=0x7fdea4006df0).stop 2021-10-20T23:27:00.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 -- 172.21.15.12:0/4232868038 shutdown_connections 2021-10-20T23:27:00.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 --2- 172.21.15.12:0/4232868038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb40b1d10 0x7fdeb414b1d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 --2- 172.21.15.12:0/4232868038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 0x7fdeb4147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 -- 172.21.15.12:0/4232868038 >> 172.21.15.12:0/4232868038 conn(0x7fdeb4061140 msgr2=0x7fdeb4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:00.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 -- 172.21.15.12:0/4232868038 shutdown_connections 2021-10-20T23:27:00.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 -- 172.21.15.12:0/4232868038 wait complete. 2021-10-20T23:27:00.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 Processor -- start 2021-10-20T23:27:00.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 -- start start 2021-10-20T23:27:00.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb405c490 0x7fdeb40ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40b1d10 0x7fdeb40aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 0x7fdeb40671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb4146c60 con 0x7fdeb405c490 2021-10-20T23:27:00.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40aacd0 con 0x7fdeb40b1d10 2021-10-20T23:27:00.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb9d60700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb41469c0 con 0x7fdeb40b27a0 2021-10-20T23:27:00.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb8d5e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb405c490 0x7fdeb40ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb8d5e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb405c490 0x7fdeb40ac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41938/0 (socket says 172.21.15.12:41938) 2021-10-20T23:27:00.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb8d5e700 1 -- 172.21.15.12:0/800605306 learned_addr learned my addr 172.21.15.12:0/800605306 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeb955f700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 0x7fdeb40671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.435+0000 7fdeabfff700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40b1d10 0x7fdeb40aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdeb8d5e700 1 -- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 msgr2=0x7fdeb40671a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdeb8d5e700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 0x7fdeb40671a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdeb8d5e700 1 -- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40b1d10 msgr2=0x7fdeb40aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdeb8d5e700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40b1d10 0x7fdeb40aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdeb8d5e700 1 -- 172.21.15.12:0/800605306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea400b180 con 0x7fdeb405c490 2021-10-20T23:27:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdeb8d5e700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb405c490 0x7fdeb40ac430 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fdeb000c000 tx=0x7fdeb0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:00.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdea9ffb700 1 -- 172.21.15.12:0/800605306 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb0010780 con 0x7fdeb405c490 2021-10-20T23:27:00.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb40aa580 con 0x7fdeb405c490 2021-10-20T23:27:00.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdea9ffb700 1 -- 172.21.15.12:0/800605306 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb00108e0 con 0x7fdeb405c490 2021-10-20T23:27:00.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdea9ffb700 1 -- 172.21.15.12:0/800605306 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb0010c40 con 0x7fdeb405c490 2021-10-20T23:27:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb4147040 con 0x7fdeb405c490 2021-10-20T23:27:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb4057350 con 0x7fdeb405c490 2021-10-20T23:27:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdea9ffb700 1 -- 172.21.15.12:0/800605306 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdeb001c460 con 0x7fdeb405c490 2021-10-20T23:27:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.439+0000 7fdea9ffb700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fde940534f0 0x7fde940559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.443+0000 7fdea9ffb700 1 -- 172.21.15.12:0/800605306 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdeb006bef0 con 0x7fdeb405c490 2021-10-20T23:27:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.443+0000 7fdeabfff700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fde940534f0 0x7fde940559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.443+0000 7fdeabfff700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fde940534f0 0x7fde940559b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fdea401a000 tx=0x7fdea4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.447+0000 7fdea9ffb700 1 -- 172.21.15.12:0/800605306 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdeb0042df0 con 0x7fdeb405c490 2021-10-20T23:27:00.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:00.607+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdeb40aa710 con 0x7fdeb405c490 2021-10-20T23:27:01.156 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:27:01.151+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:27:01.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.163+0000 7fdea9ffb700 1 -- 172.21.15.12:0/800605306 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdeb0046410 con 0x7fdeb405c490 2021-10-20T23:27:01.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fde940534f0 msgr2=0x7fde940559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fde940534f0 0x7fde940559b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fdea401a000 tx=0x7fdea4014000).stop 2021-10-20T23:27:01.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb405c490 msgr2=0x7fdeb40ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb405c490 0x7fdeb40ac430 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fdeb000c000 tx=0x7fdeb0006df0).stop 2021-10-20T23:27:01.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 shutdown_connections 2021-10-20T23:27:01.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fde940534f0 0x7fde940559b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40b27a0 0x7fdeb40671a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40b1d10 0x7fdeb40aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 --2- 172.21.15.12:0/800605306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb405c490 0x7fdeb40ac430 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 >> 172.21.15.12:0/800605306 conn(0x7fdeb4061140 msgr2=0x7fdeb414b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:01.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 shutdown_connections 2021-10-20T23:27:01.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.167+0000 7fdeb9d60700 1 -- 172.21.15.12:0/800605306 wait complete. 2021-10-20T23:27:01.177 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:27:01.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:01.198 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:27:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f191d2d1700 1 Processor -- start 2021-10-20T23:27:01.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f191d2d1700 1 -- start start 2021-10-20T23:27:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f191d2d1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19180b3000 0x7f1918060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f191d2d1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1918065330 con 0x7f19180b25a0 2021-10-20T23:27:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f191d2d1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19180b33e0 con 0x7f1918061000 2021-10-20T23:27:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f191d2d1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1918062000 con 0x7f19180b3000 2021-10-20T23:27:01.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f19177fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f19180b25a0 0x7f1918066520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40554/0 (socket says 172.21.15.12:40554) 2021-10-20T23:27:01.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f19177fe700 1 -- 172.21.15.12:0/2408581800 learned_addr learned my addr 172.21.15.12:0/2408581800 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:01.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f1917fff700 1 --2- 172.21.15.12:0/2408581800 >> v2:172.21.15.31:3300/0 conn(0x7f19180b3000 0x7f1918060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f1916ffd700 1 -- 172.21.15.12:0/2408581800 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403918048 0 0) 0x7f1918065330 con 0x7f19180b25a0 2021-10-20T23:27:01.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f1916ffd700 1 -- 172.21.15.12:0/2408581800 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1904003260 con 0x7f19180b25a0 2021-10-20T23:27:01.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f1917fff700 1 -- 172.21.15.12:0/2408581800 >> v1:172.21.15.31:6789/0 conn(0x7f1918061000 legacy=0x7f1918066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f1917fff700 1 -- 172.21.15.12:0/2408581800 >> v1:172.21.15.12:6789/0 conn(0x7f19180b25a0 legacy=0x7f1918066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.279+0000 7f1917fff700 1 -- 172.21.15.12:0/2408581800 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191805fa60 con 0x7f19180b3000 2021-10-20T23:27:01.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f1917fff700 1 --2- 172.21.15.12:0/2408581800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19180b3000 0x7f1918060b10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f1908002f70 tx=0x7f1908006df0).ready entity=mon.1 client_cookie=b86ee5c88fa6cfd4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f1916ffd700 1 -- 172.21.15.12:0/2408581800 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190800d5c0 con 0x7f19180b3000 2021-10-20T23:27:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f1916ffd700 1 -- 172.21.15.12:0/2408581800 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1908000e90 con 0x7f19180b3000 2021-10-20T23:27:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f1916ffd700 1 -- 172.21.15.12:0/2408581800 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190800d910 con 0x7f19180b3000 2021-10-20T23:27:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 -- 172.21.15.12:0/2408581800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19180b3000 msgr2=0x7f1918060b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 --2- 172.21.15.12:0/2408581800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19180b3000 0x7f1918060b10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f1908002f70 tx=0x7f1908006df0).stop 2021-10-20T23:27:01.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 -- 172.21.15.12:0/2408581800 shutdown_connections 2021-10-20T23:27:01.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 --2- 172.21.15.12:0/2408581800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19180b3000 0x7f1918060b10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 -- 172.21.15.12:0/2408581800 >> 172.21.15.12:0/2408581800 conn(0x7f19180636e0 msgr2=0x7f1918063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:01.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 -- 172.21.15.12:0/2408581800 shutdown_connections 2021-10-20T23:27:01.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 -- 172.21.15.12:0/2408581800 wait complete. 2021-10-20T23:27:01.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 Processor -- start 2021-10-20T23:27:01.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 -- start start 2021-10-20T23:27:01.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1918061000 0x7f19180ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.283+0000 7f191d2d1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19180b25a0 0x7f1918155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191d2d1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19180b3000 0x7f19180b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191d2d1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918148020 con 0x7f19180b3000 2021-10-20T23:27:01.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191d2d1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918148280 con 0x7f1918061000 2021-10-20T23:27:01.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191d2d1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1918148520 con 0x7f19180b25a0 2021-10-20T23:27:01.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191cad0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19180b3000 0x7f19180b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191cad0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19180b3000 0x7f19180b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41968/0 (socket says 172.21.15.12:41968) 2021-10-20T23:27:01.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f1917fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1918061000 0x7f19180ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191cad0700 1 -- 172.21.15.12:0/3880052578 learned_addr learned my addr 172.21.15.12:0/3880052578 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:01.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f19177fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19180b25a0 0x7f1918155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191cad0700 1 -- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19180b25a0 msgr2=0x7f1918155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191cad0700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19180b25a0 0x7f1918155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191cad0700 1 -- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1918061000 msgr2=0x7f19180ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191cad0700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1918061000 0x7f19180ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191cad0700 1 -- 172.21.15.12:0/3880052578 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190800b180 con 0x7f19180b3000 2021-10-20T23:27:01.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191cad0700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19180b3000 0x7f19180b0210 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f1918067e80 tx=0x7f1910007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:01.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f19157fa700 1 -- 172.21.15.12:0/3880052578 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191000f470 con 0x7f19180b3000 2021-10-20T23:27:01.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f19157fa700 1 -- 172.21.15.12:0/3880052578 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191000f5d0 con 0x7f19180b3000 2021-10-20T23:27:01.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1918152f90 con 0x7f19180b3000 2021-10-20T23:27:01.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f19157fa700 1 -- 172.21.15.12:0/3880052578 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191000f930 con 0x7f19180b3000 2021-10-20T23:27:01.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1918152b60 con 0x7f19180b3000 2021-10-20T23:27:01.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19181486e0 con 0x7f19180b3000 2021-10-20T23:27:01.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.287+0000 7f19157fa700 1 -- 172.21.15.12:0/3880052578 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1910019030 con 0x7f19180b3000 2021-10-20T23:27:01.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.291+0000 7f19157fa700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18f80536a0 0x7f18f8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.291+0000 7f19157fa700 1 -- 172.21.15.12:0/3880052578 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f191006b150 con 0x7f19180b3000 2021-10-20T23:27:01.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.291+0000 7f1917fff700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18f80536a0 0x7f18f8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.291+0000 7f1917fff700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18f80536a0 0x7f18f8055b60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f190801a000 tx=0x7f1908014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:01.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.295+0000 7f19157fa700 1 -- 172.21.15.12:0/3880052578 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1910041ff0 con 0x7f19180b3000 2021-10-20T23:27:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.463+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1918057350 con 0x7f19180b3000 2021-10-20T23:27:01.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.463+0000 7f19157fa700 1 -- 172.21.15.12:0/3880052578 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2129 (secure 0 0 0) 0x7f1910045610 con 0x7f19180b3000 2021-10-20T23:27:01.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:01.471 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5990,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/246201101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":246201101},{"type":"v1","addr":"172.21.15.12:6833","nonce":246201101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1822115331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1822115331},{"type":"v1","addr":"172.21.15.31:6835","nonce":1822115331}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:26:49.418101+0000","modified":"2021-10-20T23:27:01.151717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-20T23:27:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18f80536a0 msgr2=0x7f18f8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18f80536a0 0x7f18f8055b60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f190801a000 tx=0x7f1908014000).stop 2021-10-20T23:27:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19180b3000 msgr2=0x7f19180b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19180b3000 0x7f19180b0210 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f1918067e80 tx=0x7f1910007f40).stop 2021-10-20T23:27:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 shutdown_connections 2021-10-20T23:27:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f18f80536a0 0x7f18f8055b60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19180b3000 0x7f19180b0210 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19180b25a0 0x7f1918155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 --2- 172.21.15.12:0/3880052578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1918061000 0x7f19180ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 >> 172.21.15.12:0/3880052578 conn(0x7f19180636e0 msgr2=0x7f1918066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:01.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 shutdown_connections 2021-10-20T23:27:01.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.467+0000 7f191d2d1700 1 -- 172.21.15.12:0/3880052578 wait complete. 2021-10-20T23:27:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2021-10-20T23:27:01.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:27:01.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6ebd389700 1 Processor -- start 2021-10-20T23:27:01.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6ebd389700 1 -- start start 2021-10-20T23:27:01.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6ebd389700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6eb80b2720 0x7f6eb813e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6ebd389700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6eb80b0ff0 0x7f6eb813e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6ebd389700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb80aaa90 con 0x7f6eb8141080 2021-10-20T23:27:01.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6ebd389700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb8141c20 con 0x7f6eb80b0ff0 2021-10-20T23:27:01.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6ebd389700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb8140c90 con 0x7f6eb80b2720 2021-10-20T23:27:01.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6eb77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6eb80b0ff0 0x7f6eb813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6ebcb88700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6eb8141080 0x7f6eb8141510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40568/0 (socket says 172.21.15.12:40568) 2021-10-20T23:27:01.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6ebcb88700 1 -- 172.21.15.12:0/1357526079 learned_addr learned my addr 172.21.15.12:0/1357526079 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:01.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.631+0000 7f6eb7fff700 1 --2- 172.21.15.12:0/1357526079 >> v2:172.21.15.31:3300/0 conn(0x7f6eb80b2720 0x7f6eb813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb77fe700 1 -- 172.21.15.12:0/1357526079 >> v2:172.21.15.31:3300/0 conn(0x7f6eb80b2720 msgr2=0x7f6eb813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:01.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb77fe700 1 --2- 172.21.15.12:0/1357526079 >> v2:172.21.15.31:3300/0 conn(0x7f6eb80b2720 0x7f6eb813e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb77fe700 1 -- 172.21.15.12:0/1357526079 >> v1:172.21.15.12:6789/0 conn(0x7f6eb8141080 legacy=0x7f6eb8141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb6ffd700 1 -- 172.21.15.12:0/1357526079 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274595533 0 0) 0x7f6eb0001490 con 0x7f6eb8141080 2021-10-20T23:27:01.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb77fe700 1 -- 172.21.15.12:0/1357526079 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80b2b00 con 0x7f6eb80b0ff0 2021-10-20T23:27:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb77fe700 1 --2- 172.21.15.12:0/1357526079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb80b0ff0 0x7f6eb813e520 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f6ea8002f70 tx=0x7f6ea8006df0).ready entity=mon.0 client_cookie=178e9e364a2ff912 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb6ffd700 1 -- 172.21.15.12:0/1357526079 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea800d570 con 0x7f6eb80b0ff0 2021-10-20T23:27:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb6ffd700 1 -- 172.21.15.12:0/1357526079 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8000e90 con 0x7f6eb80b0ff0 2021-10-20T23:27:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb6ffd700 1 -- 172.21.15.12:0/1357526079 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea800d8c0 con 0x7f6eb80b0ff0 2021-10-20T23:27:01.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 -- 172.21.15.12:0/1357526079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb80b0ff0 msgr2=0x7f6eb813e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 --2- 172.21.15.12:0/1357526079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb80b0ff0 0x7f6eb813e520 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f6ea8002f70 tx=0x7f6ea8006df0).stop 2021-10-20T23:27:01.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 -- 172.21.15.12:0/1357526079 shutdown_connections 2021-10-20T23:27:01.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 --2- 172.21.15.12:0/1357526079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb80b0ff0 0x7f6eb813e520 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 --2- 172.21.15.12:0/1357526079 >> v2:172.21.15.31:3300/0 conn(0x7f6eb80b2720 0x7f6eb813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 -- 172.21.15.12:0/1357526079 >> 172.21.15.12:0/1357526079 conn(0x7f6eb8060180 msgr2=0x7f6eb80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:01.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 -- 172.21.15.12:0/1357526079 shutdown_connections 2021-10-20T23:27:01.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 -- 172.21.15.12:0/1357526079 wait complete. 2021-10-20T23:27:01.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 Processor -- start 2021-10-20T23:27:01.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 -- start start 2021-10-20T23:27:01.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb80b0ff0 0x7f6eb80af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6eb80b2720 0x7f6eb8155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb8141080 0x7f6eb8156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81420b0 con 0x7f6eb8141080 2021-10-20T23:27:01.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80ad010 con 0x7f6eb80b0ff0 2021-10-20T23:27:01.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebd389700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80ad240 con 0x7f6eb80b2720 2021-10-20T23:27:01.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebcb88700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb8141080 0x7f6eb8156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebcb88700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb8141080 0x7f6eb8156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41982/0 (socket says 172.21.15.12:41982) 2021-10-20T23:27:01.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6ebcb88700 1 -- 172.21.15.12:0/3864921859 learned_addr learned my addr 172.21.15.12:0/3864921859 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:01.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb77fe700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6eb80b2720 0x7f6eb8155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.635+0000 7f6eb7fff700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb80b0ff0 0x7f6eb80af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6ebcb88700 1 -- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6eb80b2720 msgr2=0x7f6eb8155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6ebcb88700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6eb80b2720 0x7f6eb8155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6ebcb88700 1 -- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb80b0ff0 msgr2=0x7f6eb80af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:01.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6ebcb88700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb80b0ff0 0x7f6eb80af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:01.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6ebcb88700 1 -- 172.21.15.12:0/3864921859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea800b180 con 0x7f6eb8141080 2021-10-20T23:27:01.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6ebcb88700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb8141080 0x7f6eb8156230 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f6eb0001250 tx=0x7f6eb0001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:01.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6eb57fa700 1 -- 172.21.15.12:0/3864921859 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb0005ba0 con 0x7f6eb8141080 2021-10-20T23:27:01.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6eb57fa700 1 -- 172.21.15.12:0/3864921859 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb0005d00 con 0x7f6eb8141080 2021-10-20T23:27:01.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb80ad4e0 con 0x7f6eb8141080 2021-10-20T23:27:01.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6eb57fa700 1 -- 172.21.15.12:0/3864921859 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb0004a90 con 0x7f6eb8141080 2021-10-20T23:27:01.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb8144e00 con 0x7f6eb8141080 2021-10-20T23:27:01.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb80ae1c0 con 0x7f6eb8141080 2021-10-20T23:27:01.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6eb57fa700 1 -- 172.21.15.12:0/3864921859 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6eb0004bf0 con 0x7f6eb8141080 2021-10-20T23:27:01.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.639+0000 7f6eb57fa700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e980535d0 0x7f6e98055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:01.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.643+0000 7f6eb57fa700 1 -- 172.21.15.12:0/3864921859 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f6eb006b700 con 0x7f6eb8141080 2021-10-20T23:27:01.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.643+0000 7f6eb7fff700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e980535d0 0x7f6e98055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:01.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.643+0000 7f6eb7fff700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e980535d0 0x7f6e98055a90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f6eac00b000 tx=0x7f6eac008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:01.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.647+0000 7f6eb57fa700 1 -- 172.21.15.12:0/3864921859 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6eb00425a0 con 0x7f6eb8141080 2021-10-20T23:27:01.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:01.811+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6eb80aaa90 con 0x7f6eb8141080 2021-10-20T23:27:02.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.167+0000 7f6eb57fa700 1 -- 172.21.15.12:0/3864921859 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6eb80aaa90 con 0x7f6eb8141080 2021-10-20T23:27:02.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e980535d0 msgr2=0x7f6e98055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:02.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e980535d0 0x7f6e98055a90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f6eac00b000 tx=0x7f6eac008040).stop 2021-10-20T23:27:02.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb8141080 msgr2=0x7f6eb8156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:02.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb8141080 0x7f6eb8156230 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f6eb0001250 tx=0x7f6eb0001360).stop 2021-10-20T23:27:02.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 shutdown_connections 2021-10-20T23:27:02.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6e980535d0 0x7f6e98055a90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:02.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb8141080 0x7f6eb8156230 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:02.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6eb80b2720 0x7f6eb8155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:02.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 --2- 172.21.15.12:0/3864921859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb80b0ff0 0x7f6eb80af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:02.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 >> 172.21.15.12:0/3864921859 conn(0x7f6eb8060180 msgr2=0x7f6eb80ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:02.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 shutdown_connections 2021-10-20T23:27:02.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.171+0000 7f6ebd389700 1 -- 172.21.15.12:0/3864921859 wait complete. 2021-10-20T23:27:02.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:27:02.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.299+0000 7f4aa162a700 1 Processor -- start 2021-10-20T23:27:02.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.299+0000 7f4aa162a700 1 -- start start 2021-10-20T23:27:02.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 0x7f4a9c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a9c060910 0x7f4a9c0a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9c0b6ce0 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c0611e0 con 0x7f4a9c060910 2021-10-20T23:27:02.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c061480 con 0x7f4a9c0b6900 2021-10-20T23:27:02.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a9a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a9c060910 0x7f4a9c0a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:02.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a9a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a9c060910 0x7f4a9c0a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41990/0 (socket says 172.21.15.12:41990) 2021-10-20T23:27:02.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a9a7fc700 1 -- 172.21.15.12:0/2438355130 learned_addr learned my addr 172.21.15.12:0/2438355130 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:02.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a9affd700 1 --2- 172.21.15.12:0/2438355130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 0x7f4a9c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:02.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a9a7fc700 1 -- 172.21.15.12:0/2438355130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 msgr2=0x7f4a9c0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a9a7fc700 1 --2- 172.21.15.12:0/2438355130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 0x7f4a9c0acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a9a7fc700 1 -- 172.21.15.12:0/2438355130 >> v1:172.21.15.31:6789/0 conn(0x7f4a9c0aa3b0 legacy=0x7f4a9c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a9a7fc700 1 -- 172.21.15.12:0/2438355130 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c061720 con 0x7f4a9c060910 2021-10-20T23:27:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a9a7fc700 1 --2- 172.21.15.12:0/2438355130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c060910 0x7f4a9c0a9ec0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f4a84002f70 tx=0x7f4a84006eb0).ready entity=mon.0 client_cookie=a025f36036852b36 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a99ffb700 1 -- 172.21.15.12:0/2438355130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a8400d570 con 0x7f4a9c060910 2021-10-20T23:27:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a99ffb700 1 -- 172.21.15.12:0/2438355130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a84000e90 con 0x7f4a9c060910 2021-10-20T23:27:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4a99ffb700 1 -- 172.21.15.12:0/2438355130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a8400d900 con 0x7f4a9c060910 2021-10-20T23:27:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 -- 172.21.15.12:0/2438355130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c060910 msgr2=0x7f4a9c0a9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 --2- 172.21.15.12:0/2438355130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c060910 0x7f4a9c0a9ec0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f4a84002f70 tx=0x7f4a84006eb0).stop 2021-10-20T23:27:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 -- 172.21.15.12:0/2438355130 shutdown_connections 2021-10-20T23:27:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 --2- 172.21.15.12:0/2438355130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c060910 0x7f4a9c0a9ec0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 --2- 172.21.15.12:0/2438355130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 0x7f4a9c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 -- 172.21.15.12:0/2438355130 >> 172.21.15.12:0/2438355130 conn(0x7f4a9c0b3480 msgr2=0x7f4a9c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 -- 172.21.15.12:0/2438355130 shutdown_connections 2021-10-20T23:27:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.303+0000 7f4aa162a700 1 -- 172.21.15.12:0/2438355130 wait complete. 2021-10-20T23:27:02.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4aa162a700 1 Processor -- start 2021-10-20T23:27:02.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4aa162a700 1 -- start start 2021-10-20T23:27:02.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4aa162a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c060910 0x7f4a9c0662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:02.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4aa162a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c0aa3b0 0x7f4a9c1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:02.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4aa162a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 0x7f4a9c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:02.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4aa162a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c1513d0 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4aa162a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c067050 con 0x7f4a9c060910 2021-10-20T23:27:02.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4aa162a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c13fe60 con 0x7f4a9c0b6900 2021-10-20T23:27:02.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c0aa3b0 0x7f4a9c1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:02.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c0aa3b0 0x7f4a9c1539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41994/0 (socket says 172.21.15.12:41994) 2021-10-20T23:27:02.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9a7fc700 1 -- 172.21.15.12:0/109709832 learned_addr learned my addr 172.21.15.12:0/109709832 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:02.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9affd700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c060910 0x7f4a9c0662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:02.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9b7fe700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 0x7f4a9c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:02.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9a7fc700 1 -- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 msgr2=0x7f4a9c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:02.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9a7fc700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 0x7f4a9c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:02.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9a7fc700 1 -- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c060910 msgr2=0x7f4a9c0662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:02.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9a7fc700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c060910 0x7f4a9c0662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:02.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9a7fc700 1 -- 172.21.15.12:0/109709832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8400b1e0 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9b7fe700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 0x7f4a9c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:02.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a9a7fc700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c0aa3b0 0x7f4a9c1539a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f4a9c065590 tx=0x7f4a84015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:02.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.307+0000 7f4a93fff700 1 -- 172.21.15.12:0/109709832 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a840117e0 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4a93fff700 1 -- 172.21.15.12:0/109709832 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a84011940 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9c140090 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4a93fff700 1 -- 172.21.15.12:0/109709832 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a84011ca0 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9c13fa30 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9c0619c0 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4a93fff700 1 -- 172.21.15.12:0/109709832 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a84025030 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4a93fff700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a80053580 0x7f4a80055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:02.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4a93fff700 1 -- 172.21.15.12:0/109709832 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f4a8406cdc0 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4a9affd700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a80053580 0x7f4a80055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:02.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.311+0000 7f4a9affd700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a80053580 0x7f4a80055a40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f4a8c009000 tx=0x7f4a8c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:02.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.315+0000 7f4a93fff700 1 -- 172.21.15.12:0/109709832 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a84043d70 con 0x7f4a9c0aa3b0 2021-10-20T23:27:02.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:02.443+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4a9c057350 con 0x7f4a9c0aa3b0 2021-10-20T23:27:03.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.171+0000 7f4a93fff700 1 -- 172.21.15.12:0/109709832 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) v1 ==== 185+0+0 (secure 0 0 0) 0x7f4a84023020 con 0x7f4a9c0aa3b0 2021-10-20T23:27:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a80053580 msgr2=0x7f4a80055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a80053580 0x7f4a80055a40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f4a8c009000 tx=0x7f4a8c009040).stop 2021-10-20T23:27:03.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c0aa3b0 msgr2=0x7f4a9c1539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:03.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c0aa3b0 0x7f4a9c1539a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f4a9c065590 tx=0x7f4a84015000).stop 2021-10-20T23:27:03.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 shutdown_connections 2021-10-20T23:27:03.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a80053580 0x7f4a80055a40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:03.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a9c0b6900 0x7f4a9c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:03.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9c0aa3b0 0x7f4a9c1539a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:03.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 --2- 172.21.15.12:0/109709832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c060910 0x7f4a9c0662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:03.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 >> 172.21.15.12:0/109709832 conn(0x7f4a9c0b3480 msgr2=0x7f4a9c13c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:03.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 shutdown_connections 2021-10-20T23:27:03.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.175+0000 7f4aa162a700 1 -- 172.21.15.12:0/109709832 wait complete. 2021-10-20T23:27:03.187 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:27:03.200 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:27:03.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.311+0000 7f6fdbd57700 1 Processor -- start 2021-10-20T23:27:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.311+0000 7f6fdbd57700 1 -- start start 2021-10-20T23:27:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fdbd57700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6fd40aa080 0x7f6fd4146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fdbd57700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd41473e0 con 0x7f6fd40b6760 2021-10-20T23:27:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fdbd57700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd40ac550 con 0x7f6fd413d400 2021-10-20T23:27:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fdbd57700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd40ac7f0 con 0x7f6fd40aa080 2021-10-20T23:27:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fda2f4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6fd40aa080 0x7f6fd4146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fd9af3700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6fd40b6760 0x7f6fd413ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40594/0 (socket says 172.21.15.12:40594) 2021-10-20T23:27:03.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fda2f4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6fd40aa080 0x7f6fd4146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42004/0 (socket says 172.21.15.12:42004) 2021-10-20T23:27:03.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fd9af3700 1 -- 172.21.15.12:0/416450140 learned_addr learned my addr 172.21.15.12:0/416450140 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:03.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fda2f4700 1 -- 172.21.15.12:0/416450140 >> v1:172.21.15.31:6789/0 conn(0x7f6fd413d400 legacy=0x7f6fd41467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fda2f4700 1 -- 172.21.15.12:0/416450140 >> v1:172.21.15.12:6789/0 conn(0x7f6fd40b6760 legacy=0x7f6fd413ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fda2f4700 1 -- 172.21.15.12:0/416450140 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40aca90 con 0x7f6fd40aa080 2021-10-20T23:27:03.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fd8af1700 1 -- 172.21.15.12:0/416450140 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270679809 0 0) 0x7f6fd41473e0 con 0x7f6fd40b6760 2021-10-20T23:27:03.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fda2f4700 1 --2- 172.21.15.12:0/416450140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40aa080 0x7f6fd4146ef0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f6fcc0032f0 tx=0x7f6fcc0091d0).ready entity=mon.0 client_cookie=d0adf12ed4b62b21 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:03.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fd8af1700 1 -- 172.21.15.12:0/416450140 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fcc009ea0 con 0x7f6fd40aa080 2021-10-20T23:27:03.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fd8af1700 1 -- 172.21.15.12:0/416450140 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc00b8a0 con 0x7f6fd40aa080 2021-10-20T23:27:03.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fd8af1700 1 -- 172.21.15.12:0/416450140 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fcc00ba10 con 0x7f6fd40aa080 2021-10-20T23:27:03.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fdbd57700 1 -- 172.21.15.12:0/416450140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40aa080 msgr2=0x7f6fd4146ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:03.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fdbd57700 1 --2- 172.21.15.12:0/416450140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40aa080 0x7f6fd4146ef0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f6fcc0032f0 tx=0x7f6fcc0091d0).stop 2021-10-20T23:27:03.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fdbd57700 1 -- 172.21.15.12:0/416450140 shutdown_connections 2021-10-20T23:27:03.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fdbd57700 1 --2- 172.21.15.12:0/416450140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40aa080 0x7f6fd4146ef0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:03.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.315+0000 7f6fdbd57700 1 -- 172.21.15.12:0/416450140 >> 172.21.15.12:0/416450140 conn(0x7f6fd40b3480 msgr2=0x7f6fd40b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:03.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.319+0000 7f6fdbd57700 1 -- 172.21.15.12:0/416450140 shutdown_connections 2021-10-20T23:27:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.319+0000 7f6fdbd57700 1 -- 172.21.15.12:0/416450140 wait complete. 2021-10-20T23:27:03.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.319+0000 7f6fdbd57700 1 Processor -- start 2021-10-20T23:27:03.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.319+0000 7f6fdbd57700 1 -- start start 2021-10-20T23:27:03.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fdbd57700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fd40aa080 0x7f6fd4146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fdbd57700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40b6760 0x7f6fd4153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fdbd57700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fd413d400 0x7f6fd4153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fdbd57700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4153a50 con 0x7f6fd40b6760 2021-10-20T23:27:03.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fdbd57700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4143d70 con 0x7f6fd413d400 2021-10-20T23:27:03.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fdbd57700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4144010 con 0x7f6fd40aa080 2021-10-20T23:27:03.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd92f2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40b6760 0x7f6fd4153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:03.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd92f2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40b6760 0x7f6fd4153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42006/0 (socket says 172.21.15.12:42006) 2021-10-20T23:27:03.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd92f2700 1 -- 172.21.15.12:0/1506794903 learned_addr learned my addr 172.21.15.12:0/1506794903 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:03.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fda2f4700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fd413d400 0x7f6fd4153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:03.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd9af3700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fd40aa080 0x7f6fd4146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd92f2700 1 -- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fd40aa080 msgr2=0x7f6fd4146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd92f2700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fd40aa080 0x7f6fd4146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd92f2700 1 -- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fd413d400 msgr2=0x7f6fd4153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd92f2700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fd413d400 0x7f6fd4153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd92f2700 1 -- 172.21.15.12:0/1506794903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc009470 con 0x7f6fd40b6760 2021-10-20T23:27:03.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fd92f2700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40b6760 0x7f6fd4153070 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f6fd40b5e00 tx=0x7f6fc8007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:03.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fc6ffd700 1 -- 172.21.15.12:0/1506794903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fc800ccd0 con 0x7f6fd40b6760 2021-10-20T23:27:03.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fc6ffd700 1 -- 172.21.15.12:0/1506794903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc800ce30 con 0x7f6fd40b6760 2021-10-20T23:27:03.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fc6ffd700 1 -- 172.21.15.12:0/1506794903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fc80125f0 con 0x7f6fd40b6760 2021-10-20T23:27:03.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd4146f30 con 0x7f6fd40b6760 2021-10-20T23:27:03.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd41560b0 con 0x7f6fd40b6760 2021-10-20T23:27:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.323+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd40acd30 con 0x7f6fd40b6760 2021-10-20T23:27:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.327+0000 7f6fc6ffd700 1 -- 172.21.15.12:0/1506794903 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6fc8019030 con 0x7f6fd40b6760 2021-10-20T23:27:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.327+0000 7f6fc6ffd700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fb40535b0 0x7f6fb4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.327+0000 7f6fc6ffd700 1 -- 172.21.15.12:0/1506794903 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f6fc806abf0 con 0x7f6fd40b6760 2021-10-20T23:27:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.327+0000 7f6fd9af3700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fb40535b0 0x7f6fb4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:03.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.327+0000 7f6fd9af3700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fb40535b0 0x7f6fb4055a70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f6fd000d000 tx=0x7f6fd00011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:03.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.331+0000 7f6fc6ffd700 1 -- 172.21.15.12:0/1506794903 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6fc8041cd0 con 0x7f6fd40b6760 2021-10-20T23:27:03.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:03.463+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6fd4057350 con 0x7f6fd40b6760 2021-10-20T23:27:04.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.183+0000 7f6fc6ffd700 1 -- 172.21.15.12:0/1506794903 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6fc80452f0 con 0x7f6fd40b6760 2021-10-20T23:27:04.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fb40535b0 msgr2=0x7f6fb4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fb40535b0 0x7f6fb4055a70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f6fd000d000 tx=0x7f6fd00011a0).stop 2021-10-20T23:27:04.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40b6760 msgr2=0x7f6fd4153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40b6760 0x7f6fd4153070 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f6fd40b5e00 tx=0x7f6fc8007c20).stop 2021-10-20T23:27:04.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 shutdown_connections 2021-10-20T23:27:04.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6fb40535b0 0x7f6fb4055a70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fd413d400 0x7f6fd4153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fd40b6760 0x7f6fd4153070 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 --2- 172.21.15.12:0/1506794903 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fd40aa080 0x7f6fd4146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 >> 172.21.15.12:0/1506794903 conn(0x7f6fd40b3480 msgr2=0x7f6fd40b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:04.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 shutdown_connections 2021-10-20T23:27:04.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.191+0000 7f6fdbd57700 1 -- 172.21.15.12:0/1506794903 wait complete. 2021-10-20T23:27:04.202 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:27:04.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:27:04.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5697645700 1 Processor -- start 2021-10-20T23:27:04.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5697645700 1 -- start start 2021-10-20T23:27:04.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5697645700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5690143640 0x7f569013d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5697645700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f56900ac180 0x7f56900ad380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5697645700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f569013d8b0 0x7f56900ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5697645700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900b6220 con 0x7f56900ac180 2021-10-20T23:27:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5697645700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900b1b20 con 0x7f569013d8b0 2021-10-20T23:27:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5697645700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900af6b0 con 0x7f5690143640 2021-10-20T23:27:04.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5694be0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f56900ac180 0x7f56900ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5694be0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f56900ac180 0x7f56900ad380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42018/0 (socket says 172.21.15.12:42018) 2021-10-20T23:27:04.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5694be0700 1 -- 172.21.15.12:0/2586785699 learned_addr learned my addr 172.21.15.12:0/2586785699 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:04.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f5695be2700 1 --2- 172.21.15.12:0/2586785699 >> v2:172.21.15.31:3300/0 conn(0x7f569013d8b0 0x7f56900ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.315+0000 7f56953e1700 1 --2- 172.21.15.12:0/2586785699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5690143640 0x7f569013d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5695be2700 1 -- 172.21.15.12:0/2586785699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5690143640 msgr2=0x7f569013d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:04.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5695be2700 1 --2- 172.21.15.12:0/2586785699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5690143640 0x7f569013d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5695be2700 1 -- 172.21.15.12:0/2586785699 >> v2:172.21.15.12:3300/0 conn(0x7f56900ac180 msgr2=0x7f56900ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5695be2700 1 --2- 172.21.15.12:0/2586785699 >> v2:172.21.15.12:3300/0 conn(0x7f56900ac180 0x7f56900ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5695be2700 1 -- 172.21.15.12:0/2586785699 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690143e90 con 0x7f569013d8b0 2021-10-20T23:27:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5694be0700 1 --2- 172.21.15.12:0/2586785699 >> v2:172.21.15.12:3300/0 conn(0x7f56900ac180 0x7f56900ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:04.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5695be2700 1 --2- 172.21.15.12:0/2586785699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f569013d8b0 0x7f56900ad870 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f56880032f0 tx=0x7f56880091d0).ready entity=mon.1 client_cookie=926c5b794623ff5c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:04.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f567bfff700 1 -- 172.21.15.12:0/2586785699 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f568800b600 con 0x7f569013d8b0 2021-10-20T23:27:04.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f567bfff700 1 -- 172.21.15.12:0/2586785699 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800b760 con 0x7f569013d8b0 2021-10-20T23:27:04.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f567bfff700 1 -- 172.21.15.12:0/2586785699 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f568800b8d0 con 0x7f569013d8b0 2021-10-20T23:27:04.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5697645700 1 -- 172.21.15.12:0/2586785699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f569013d8b0 msgr2=0x7f56900ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5697645700 1 --2- 172.21.15.12:0/2586785699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f569013d8b0 0x7f56900ad870 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f56880032f0 tx=0x7f56880091d0).stop 2021-10-20T23:27:04.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5697645700 1 -- 172.21.15.12:0/2586785699 shutdown_connections 2021-10-20T23:27:04.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5697645700 1 --2- 172.21.15.12:0/2586785699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f569013d8b0 0x7f56900ad870 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5697645700 1 --2- 172.21.15.12:0/2586785699 >> v2:172.21.15.12:3300/0 conn(0x7f56900ac180 0x7f56900ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5697645700 1 --2- 172.21.15.12:0/2586785699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5690143640 0x7f569013d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5697645700 1 -- 172.21.15.12:0/2586785699 >> 172.21.15.12:0/2586785699 conn(0x7f56900b5570 msgr2=0x7f56900b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5697645700 1 -- 172.21.15.12:0/2586785699 shutdown_connections 2021-10-20T23:27:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.319+0000 7f5697645700 1 -- 172.21.15.12:0/2586785699 wait complete. 2021-10-20T23:27:04.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5697645700 1 Processor -- start 2021-10-20T23:27:04.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5697645700 1 -- start start 2021-10-20T23:27:04.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5697645700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56900ac180 0x7f569013c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5697645700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569013d8b0 0x7f56900b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5697645700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5690143640 0x7f56901522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5697645700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56901409b0 con 0x7f5690143640 2021-10-20T23:27:04.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5697645700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900b4600 con 0x7f56900ac180 2021-10-20T23:27:04.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5697645700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900b48a0 con 0x7f569013d8b0 2021-10-20T23:27:04.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5695be2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5690143640 0x7f56901522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5695be2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5690143640 0x7f56901522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42024/0 (socket says 172.21.15.12:42024) 2021-10-20T23:27:04.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5695be2700 1 -- 172.21.15.12:0/4265645600 learned_addr learned my addr 172.21.15.12:0/4265645600 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:04.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f5694be0700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569013d8b0 0x7f56900b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.323+0000 7f56953e1700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56900ac180 0x7f569013c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5695be2700 1 -- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569013d8b0 msgr2=0x7f56900b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5695be2700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569013d8b0 0x7f56900b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5695be2700 1 -- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56900ac180 msgr2=0x7f569013c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5695be2700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56900ac180 0x7f569013c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5695be2700 1 -- 172.21.15.12:0/4265645600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568400b1e0 con 0x7f5690143640 2021-10-20T23:27:04.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5695be2700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5690143640 0x7f56901522e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f56880032f0 tx=0x7f5688016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:04.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5682ffd700 1 -- 172.21.15.12:0/4265645600 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f568800b600 con 0x7f5690143640 2021-10-20T23:27:04.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5682ffd700 1 -- 172.21.15.12:0/4265645600 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568801f5e0 con 0x7f5690143640 2021-10-20T23:27:04.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5688009470 con 0x7f5690143640 2021-10-20T23:27:04.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5682ffd700 1 -- 172.21.15.12:0/4265645600 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f568801f940 con 0x7f5690143640 2021-10-20T23:27:04.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56900b5230 con 0x7f5690143640 2021-10-20T23:27:04.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5682ffd700 1 -- 172.21.15.12:0/4265645600 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5688026030 con 0x7f5690143640 2021-10-20T23:27:04.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5690057350 con 0x7f5690143640 2021-10-20T23:27:04.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5682ffd700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f566c053610 0x7f566c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f5682ffd700 1 -- 172.21.15.12:0/4265645600 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f568806c2b0 con 0x7f5690143640 2021-10-20T23:27:04.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.327+0000 7f56953e1700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f566c053610 0x7f566c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.331+0000 7f56953e1700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f566c053610 0x7f566c055ad0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f568c00b000 tx=0x7f568c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:04.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.335+0000 7f5682ffd700 1 -- 172.21.15.12:0/4265645600 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5688043590 con 0x7f5690143640 2021-10-20T23:27:04.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.463+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f56900b4a70 con 0x7f5690143640 2021-10-20T23:27:04.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.471+0000 7f5682ffd700 1 -- 172.21.15.12:0/4265645600 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5688046bb0 con 0x7f5690143640 2021-10-20T23:27:04.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f566c053610 msgr2=0x7f566c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f566c053610 0x7f566c055ad0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f568c00b000 tx=0x7f568c006df0).stop 2021-10-20T23:27:04.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5690143640 msgr2=0x7f56901522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5690143640 0x7f56901522e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f56880032f0 tx=0x7f5688016000).stop 2021-10-20T23:27:04.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 shutdown_connections 2021-10-20T23:27:04.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f566c053610 0x7f566c055ad0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5690143640 0x7f56901522e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569013d8b0 0x7f56900b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 --2- 172.21.15.12:0/4265645600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56900ac180 0x7f569013c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 >> 172.21.15.12:0/4265645600 conn(0x7f56900b5570 msgr2=0x7f5690141430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:04.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 shutdown_connections 2021-10-20T23:27:04.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.475+0000 7f5697645700 1 -- 172.21.15.12:0/4265645600 wait complete. 2021-10-20T23:27:04.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-10-20T23:27:04.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68da9fe700 1 Processor -- start 2021-10-20T23:27:04.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68da9fe700 1 -- start start 2021-10-20T23:27:04.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68da9fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68d40b2580 0x7f68d414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68da9fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68d40b0010 0x7f68d414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68da9fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d40a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68da9fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d40a70c0 con 0x7f68d40b0010 2021-10-20T23:27:04.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68da9fe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d40a72f0 con 0x7f68d40b2580 2021-10-20T23:27:04.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68da9fe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d40a7590 con 0x7f68d40afbd0 2021-10-20T23:27:04.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d91fb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68d40b0010 0x7f68d414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d91fb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68d40b0010 0x7f68d414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42028/0 (socket says 172.21.15.12:42028) 2021-10-20T23:27:04.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d91fb700 1 -- 172.21.15.12:0/427276054 learned_addr learned my addr 172.21.15.12:0/427276054 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:04.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68da1fd700 1 --2- 172.21.15.12:0/427276054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d40a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d99fc700 1 --2- 172.21.15.12:0/427276054 >> v2:172.21.15.31:3300/0 conn(0x7f68d40b2580 0x7f68d414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d91fb700 1 -- 172.21.15.12:0/427276054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 msgr2=0x7f68d40a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:04.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d91fb700 1 --2- 172.21.15.12:0/427276054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d40a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d91fb700 1 -- 172.21.15.12:0/427276054 >> v2:172.21.15.31:3300/0 conn(0x7f68d40b2580 msgr2=0x7f68d414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:04.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d91fb700 1 --2- 172.21.15.12:0/427276054 >> v2:172.21.15.31:3300/0 conn(0x7f68d40b2580 0x7f68d414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d91fb700 1 -- 172.21.15.12:0/427276054 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d40a7830 con 0x7f68d40b0010 2021-10-20T23:27:04.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d91fb700 1 --2- 172.21.15.12:0/427276054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b0010 0x7f68d414b330 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f68d0002f70 tx=0x7f68d0006eb0).ready entity=mon.0 client_cookie=814ed7ceb93b5d5f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:04.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d89fa700 1 -- 172.21.15.12:0/427276054 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d000d570 con 0x7f68d40b0010 2021-10-20T23:27:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d89fa700 1 -- 172.21.15.12:0/427276054 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0000e90 con 0x7f68d40b0010 2021-10-20T23:27:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.603+0000 7f68d89fa700 1 -- 172.21.15.12:0/427276054 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d000d900 con 0x7f68d40b0010 2021-10-20T23:27:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 -- 172.21.15.12:0/427276054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b0010 msgr2=0x7f68d414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 --2- 172.21.15.12:0/427276054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b0010 0x7f68d414b330 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f68d0002f70 tx=0x7f68d0006eb0).stop 2021-10-20T23:27:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 -- 172.21.15.12:0/427276054 shutdown_connections 2021-10-20T23:27:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 --2- 172.21.15.12:0/427276054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d40a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 --2- 172.21.15.12:0/427276054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b0010 0x7f68d414b330 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 --2- 172.21.15.12:0/427276054 >> v2:172.21.15.31:3300/0 conn(0x7f68d40b2580 0x7f68d414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 -- 172.21.15.12:0/427276054 >> 172.21.15.12:0/427276054 conn(0x7f68d4060180 msgr2=0x7f68d40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:04.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 -- 172.21.15.12:0/427276054 shutdown_connections 2021-10-20T23:27:04.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 -- 172.21.15.12:0/427276054 wait complete. 2021-10-20T23:27:04.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 Processor -- start 2021-10-20T23:27:04.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 -- start start 2021-10-20T23:27:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b0010 0x7f68d4156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d40b2580 0x7f68d4067150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d414d840 con 0x7f68d40b0010 2021-10-20T23:27:04.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d414d300 con 0x7f68d40b2580 2021-10-20T23:27:04.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da9fe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d414d5a0 con 0x7f68d40afbd0 2021-10-20T23:27:04.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d99fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d91fb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b0010 0x7f68d4156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d99fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d414ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:47792/0 (socket says 172.21.15.12:47792) 2021-10-20T23:27:04.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d99fc700 1 -- 172.21.15.12:0/4161139924 learned_addr learned my addr 172.21.15.12:0/4161139924 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:04.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68da1fd700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d40b2580 0x7f68d4067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d99fc700 1 -- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d40b2580 msgr2=0x7f68d4067150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d99fc700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d40b2580 0x7f68d4067150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d99fc700 1 -- 172.21.15.12:0/4161139924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b0010 msgr2=0x7f68d4156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:04.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d99fc700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b0010 0x7f68d4156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:04.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d99fc700 1 -- 172.21.15.12:0/4161139924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d000b1e0 con 0x7f68d40afbd0 2021-10-20T23:27:04.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.607+0000 7f68d99fc700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d414ca80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f68c400c000 tx=0x7f68c4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.611+0000 7f68c2ffd700 1 -- 172.21.15.12:0/4161139924 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c4011750 con 0x7f68d40afbd0 2021-10-20T23:27:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.611+0000 7f68c2ffd700 1 -- 172.21.15.12:0/4161139924 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c40118b0 con 0x7f68d40afbd0 2021-10-20T23:27:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.611+0000 7f68c2ffd700 1 -- 172.21.15.12:0/4161139924 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c4011c10 con 0x7f68d40afbd0 2021-10-20T23:27:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.611+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d40abc90 con 0x7f68d40afbd0 2021-10-20T23:27:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.611+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d4067640 con 0x7f68d40afbd0 2021-10-20T23:27:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.611+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d4057350 con 0x7f68d40afbd0 2021-10-20T23:27:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.611+0000 7f68c2ffd700 1 -- 172.21.15.12:0/4161139924 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f68c4011d70 con 0x7f68d40afbd0 2021-10-20T23:27:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.611+0000 7f68c2ffd700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68b4053610 0x7f68b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.611+0000 7f68c2ffd700 1 -- 172.21.15.12:0/4161139924 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f68c406bcf0 con 0x7f68d40afbd0 2021-10-20T23:27:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.615+0000 7f68d91fb700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68b4053610 0x7f68b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.615+0000 7f68d91fb700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68b4053610 0x7f68b4055ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f68d001c000 tx=0x7f68d0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.623+0000 7f68c2ffd700 1 -- 172.21.15.12:0/4161139924 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f68c4042ec0 con 0x7f68d40afbd0 2021-10-20T23:27:04.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:04.795+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f68d40698e0 con 0x7f68d40afbd0 2021-10-20T23:27:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.187+0000 7f68c2ffd700 1 -- 172.21.15.12:0/4161139924 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v313) v1 ==== 126+0+0 (secure 0 0 0) 0x7f68c40464e0 con 0x7f68d40afbd0 2021-10-20T23:27:05.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68b4053610 msgr2=0x7f68b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:05.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68b4053610 0x7f68b4055ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f68d001c000 tx=0x7f68d0015000).stop 2021-10-20T23:27:05.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 msgr2=0x7f68d414ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:05.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d414ca80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f68c400c000 tx=0x7f68c4006df0).stop 2021-10-20T23:27:05.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 shutdown_connections 2021-10-20T23:27:05.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68b4053610 0x7f68b4055ad0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:05.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d40b2580 0x7f68d4067150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:05.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b0010 0x7f68d4156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:05.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 --2- 172.21.15.12:0/4161139924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68d40afbd0 0x7f68d414ca80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:05.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 >> 172.21.15.12:0/4161139924 conn(0x7f68d4060180 msgr2=0x7f68d4144ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:05.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 shutdown_connections 2021-10-20T23:27:05.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.191+0000 7f68da9fe700 1 -- 172.21.15.12:0/4161139924 wait complete. 2021-10-20T23:27:05.217 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-20T23:27:05.217 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-10-20T23:27:05.220 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-10-20T23:27:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.327+0000 7fef552a4700 1 Processor -- start 2021-10-20T23:27:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.327+0000 7fef552a4700 1 -- start start 2021-10-20T23:27:05.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef500b6900 0x7fef500acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:05.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef500aa5d0 0x7fef5013c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:05.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef500b6ce0 con 0x7fef50060910 2021-10-20T23:27:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500611e0 con 0x7fef500aa5d0 2021-10-20T23:27:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef50061480 con 0x7fef500b6900 2021-10-20T23:27:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef500aa5d0 0x7fef5013c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef500aa5d0 0x7fef5013c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42046/0 (socket says 172.21.15.12:42046) 2021-10-20T23:27:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4f7fe700 1 -- 172.21.15.12:0/518385891 learned_addr learned my addr 172.21.15.12:0/518385891 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4effd700 1 --2- 172.21.15.12:0/518385891 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef500b6900 0x7fef500acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4f7fe700 1 -- 172.21.15.12:0/518385891 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef500b6900 msgr2=0x7fef500acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4f7fe700 1 --2- 172.21.15.12:0/518385891 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef500b6900 0x7fef500acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4f7fe700 1 -- 172.21.15.12:0/518385891 >> v1:172.21.15.31:6789/0 conn(0x7fef50060910 legacy=0x7fef500a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4f7fe700 1 -- 172.21.15.12:0/518385891 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50061720 con 0x7fef500aa5d0 2021-10-20T23:27:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4f7fe700 1 --2- 172.21.15.12:0/518385891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 0x7fef5013c470 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fef480032f0 tx=0x7fef4800b530).ready entity=mon.0 client_cookie=9924ceb41a6c44a9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4e7fc700 1 -- 172.21.15.12:0/518385891 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef480153f0 con 0x7fef500aa5d0 2021-10-20T23:27:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4e7fc700 1 -- 172.21.15.12:0/518385891 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48015550 con 0x7fef500aa5d0 2021-10-20T23:27:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef4e7fc700 1 -- 172.21.15.12:0/518385891 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef480158b0 con 0x7fef500aa5d0 2021-10-20T23:27:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 -- 172.21.15.12:0/518385891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 msgr2=0x7fef5013c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 --2- 172.21.15.12:0/518385891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 0x7fef5013c470 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fef480032f0 tx=0x7fef4800b530).stop 2021-10-20T23:27:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 -- 172.21.15.12:0/518385891 shutdown_connections 2021-10-20T23:27:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 --2- 172.21.15.12:0/518385891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 0x7fef5013c470 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 --2- 172.21.15.12:0/518385891 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef500b6900 0x7fef500acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 -- 172.21.15.12:0/518385891 >> 172.21.15.12:0/518385891 conn(0x7fef500b3480 msgr2=0x7fef500b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 -- 172.21.15.12:0/518385891 shutdown_connections 2021-10-20T23:27:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.331+0000 7fef552a4700 1 -- 172.21.15.12:0/518385891 wait complete. 2021-10-20T23:27:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef552a4700 1 Processor -- start 2021-10-20T23:27:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef552a4700 1 -- start start 2021-10-20T23:27:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef552a4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50060910 0x7fef50140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef552a4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 0x7fef500aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef552a4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef500b6900 0x7fef500af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef552a4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500b0210 con 0x7fef500aa5d0 2021-10-20T23:27:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef552a4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50142a40 con 0x7fef500b6900 2021-10-20T23:27:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef552a4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef50142ce0 con 0x7fef50060910 2021-10-20T23:27:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef47fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 0x7fef500aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef47fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 0x7fef500aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42050/0 (socket says 172.21.15.12:42050) 2021-10-20T23:27:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef47fff700 1 -- 172.21.15.12:0/1838964432 learned_addr learned my addr 172.21.15.12:0/1838964432 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef4effd700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50060910 0x7fef50140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef4f7fe700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef500b6900 0x7fef500af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef47fff700 1 -- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50060910 msgr2=0x7fef50140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef47fff700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50060910 0x7fef50140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef47fff700 1 -- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef500b6900 msgr2=0x7fef500af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef47fff700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef500b6900 0x7fef500af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef47fff700 1 -- 172.21.15.12:0/1838964432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4800b7d0 con 0x7fef500aa5d0 2021-10-20T23:27:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.335+0000 7fef47fff700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 0x7fef500aedd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fef500b5e00 tx=0x7fef38007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef4cff9700 1 -- 172.21.15.12:0/1838964432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef38013450 con 0x7fef500aa5d0 2021-10-20T23:27:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef4cff9700 1 -- 172.21.15.12:0/1838964432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef380135b0 con 0x7fef500aa5d0 2021-10-20T23:27:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef501379f0 con 0x7fef500aa5d0 2021-10-20T23:27:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef4cff9700 1 -- 172.21.15.12:0/1838964432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef38013910 con 0x7fef500aa5d0 2021-10-20T23:27:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef50143320 con 0x7fef500aa5d0 2021-10-20T23:27:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef50142ea0 con 0x7fef500aa5d0 2021-10-20T23:27:05.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef4cff9700 1 -- 172.21.15.12:0/1838964432 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef3801a060 con 0x7fef500aa5d0 2021-10-20T23:27:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef4cff9700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef340536a0 0x7fef34055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef4cff9700 1 -- 172.21.15.12:0/1838964432 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fef3806af00 con 0x7fef500aa5d0 2021-10-20T23:27:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.339+0000 7fef4effd700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef340536a0 0x7fef34055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.343+0000 7fef4effd700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef340536a0 0x7fef34055b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fef4000b000 tx=0x7fef40006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.347+0000 7fef4cff9700 1 -- 172.21.15.12:0/1838964432 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef380421e0 con 0x7fef500aa5d0 2021-10-20T23:27:05.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:05.519+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7fef500b03e0 con 0x7fef500aa5d0 2021-10-20T23:27:06.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.191+0000 7fef4cff9700 1 -- 172.21.15.12:0/1838964432 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v314) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef38018070 con 0x7fef500aa5d0 2021-10-20T23:27:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.191+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef340536a0 msgr2=0x7fef34055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.191+0000 7fef552a4700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef340536a0 0x7fef34055b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fef4000b000 tx=0x7fef40006df0).stop 2021-10-20T23:27:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.191+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 msgr2=0x7fef500aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.191+0000 7fef552a4700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 0x7fef500aedd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fef500b5e00 tx=0x7fef38007c20).stop 2021-10-20T23:27:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.195+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 shutdown_connections 2021-10-20T23:27:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.195+0000 7fef552a4700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef340536a0 0x7fef34055b60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.195+0000 7fef552a4700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef500b6900 0x7fef500af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.195+0000 7fef552a4700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef500aa5d0 0x7fef500aedd0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.195+0000 7fef552a4700 1 --2- 172.21.15.12:0/1838964432 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50060910 0x7fef50140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.195+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 >> 172.21.15.12:0/1838964432 conn(0x7fef500b3480 msgr2=0x7fef50138db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.195+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 shutdown_connections 2021-10-20T23:27:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.195+0000 7fef552a4700 1 -- 172.21.15.12:0/1838964432 wait complete. 2021-10-20T23:27:06.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:27:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f368b1fe700 1 Processor -- start 2021-10-20T23:27:06.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f368b1fe700 1 -- start start 2021-10-20T23:27:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f368b1fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36840b3cf0 0x7f368413e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f368b1fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f368413e660 0x7f368414b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f368b1fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36840afb60 con 0x7f36840af780 2021-10-20T23:27:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f368b1fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36840b1610 con 0x7f36840b3cf0 2021-10-20T23:27:06.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f368b1fe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36840b0a90 con 0x7f368413e660 2021-10-20T23:27:06.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f3683fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36840b3cf0 0x7f368413e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f3688f9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f36840af780 0x7f36841445b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40652/0 (socket says 172.21.15.12:40652) 2021-10-20T23:27:06.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.327+0000 7f3688f9a700 1 -- 172.21.15.12:0/3563308493 learned_addr learned my addr 172.21.15.12:0/3563308493 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:06.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368979b700 1 --2- 172.21.15.12:0/3563308493 >> v2:172.21.15.31:3300/0 conn(0x7f368413e660 0x7f368414b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f3683fff700 1 -- 172.21.15.12:0/3563308493 >> v2:172.21.15.31:3300/0 conn(0x7f368413e660 msgr2=0x7f368414b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:06.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f3683fff700 1 --2- 172.21.15.12:0/3563308493 >> v2:172.21.15.31:3300/0 conn(0x7f368413e660 0x7f368414b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f3683fff700 1 -- 172.21.15.12:0/3563308493 >> v1:172.21.15.12:6789/0 conn(0x7f36840af780 legacy=0x7f36841445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f3683fff700 1 -- 172.21.15.12:0/3563308493 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36840b21a0 con 0x7f36840b3cf0 2021-10-20T23:27:06.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f3683fff700 1 --2- 172.21.15.12:0/3563308493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 0x7f368413e170 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f3670002f70 tx=0x7f3670006df0).ready entity=mon.0 client_cookie=acbeea8f2139b8b8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:06.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f36837fe700 1 -- 172.21.15.12:0/3563308493 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f367000d570 con 0x7f36840b3cf0 2021-10-20T23:27:06.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f36837fe700 1 -- 172.21.15.12:0/3563308493 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670000e90 con 0x7f36840b3cf0 2021-10-20T23:27:06.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f36837fe700 1 -- 172.21.15.12:0/3563308493 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f367000d8c0 con 0x7f36840b3cf0 2021-10-20T23:27:06.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 -- 172.21.15.12:0/3563308493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 msgr2=0x7f368413e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 --2- 172.21.15.12:0/3563308493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 0x7f368413e170 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f3670002f70 tx=0x7f3670006df0).stop 2021-10-20T23:27:06.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 -- 172.21.15.12:0/3563308493 shutdown_connections 2021-10-20T23:27:06.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 --2- 172.21.15.12:0/3563308493 >> v2:172.21.15.31:3300/0 conn(0x7f368413e660 0x7f368414b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 --2- 172.21.15.12:0/3563308493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 0x7f368413e170 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 -- 172.21.15.12:0/3563308493 >> 172.21.15.12:0/3563308493 conn(0x7f368406a110 msgr2=0x7f368405cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:06.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 -- 172.21.15.12:0/3563308493 shutdown_connections 2021-10-20T23:27:06.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 -- 172.21.15.12:0/3563308493 wait complete. 2021-10-20T23:27:06.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 Processor -- start 2021-10-20T23:27:06.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.331+0000 7f368b1fe700 1 -- start start 2021-10-20T23:27:06.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f368b1fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36840af780 0x7f36841412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f368b1fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 0x7f36840637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f368b1fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368413e660 0x7f3684063c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f368b1fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3684064180 con 0x7f36840b3cf0 2021-10-20T23:27:06.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f368b1fe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36840655f0 con 0x7f368413e660 2021-10-20T23:27:06.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f368b1fe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36840ac920 con 0x7f36840af780 2021-10-20T23:27:06.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3683fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 0x7f36840637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3683fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 0x7f36840637a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42064/0 (socket says 172.21.15.12:42064) 2021-10-20T23:27:06.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3688f9a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36840af780 0x7f36841412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3683fff700 1 -- 172.21.15.12:0/1956662573 learned_addr learned my addr 172.21.15.12:0/1956662573 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:06.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f368979b700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368413e660 0x7f3684063c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3683fff700 1 -- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36840af780 msgr2=0x7f36841412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3683fff700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36840af780 0x7f36841412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3683fff700 1 -- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368413e660 msgr2=0x7f3684063c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3683fff700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368413e660 0x7f3684063c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3683fff700 1 -- 172.21.15.12:0/1956662573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367000b180 con 0x7f36840b3cf0 2021-10-20T23:27:06.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3683fff700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 0x7f36840637a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f3670002f70 tx=0x7f3670014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:06.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3681ffb700 1 -- 172.21.15.12:0/1956662573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3670016070 con 0x7f36840b3cf0 2021-10-20T23:27:06.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3681ffb700 1 -- 172.21.15.12:0/1956662573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36700138d0 con 0x7f36840b3cf0 2021-10-20T23:27:06.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36840aec90 con 0x7f36840b3cf0 2021-10-20T23:27:06.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f3681ffb700 1 -- 172.21.15.12:0/1956662573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3670013c30 con 0x7f36840b3cf0 2021-10-20T23:27:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.335+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36840acb50 con 0x7f36840b3cf0 2021-10-20T23:27:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.339+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36840af290 con 0x7f36840b3cf0 2021-10-20T23:27:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.339+0000 7f3681ffb700 1 -- 172.21.15.12:0/1956662573 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3670025030 con 0x7f36840b3cf0 2021-10-20T23:27:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.339+0000 7f3681ffb700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3664053610 0x7f3664055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.339+0000 7f3681ffb700 1 -- 172.21.15.12:0/1956662573 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f367006c4f0 con 0x7f36840b3cf0 2021-10-20T23:27:06.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.339+0000 7f3688f9a700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3664053610 0x7f3664055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.339+0000 7f3688f9a700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3664053610 0x7f3664055ad0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f367800d000 tx=0x7f3678009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:06.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.347+0000 7f3681ffb700 1 -- 172.21.15.12:0/1956662573 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f36700437d0 con 0x7f36840b3cf0 2021-10-20T23:27:06.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.475+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3684066ca0 con 0x7f36840b3cf0 2021-10-20T23:27:06.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.483+0000 7f3681ffb700 1 -- 172.21.15.12:0/1956662573 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36700230c0 con 0x7f36840b3cf0 2021-10-20T23:27:06.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3664053610 msgr2=0x7f3664055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3664053610 0x7f3664055ad0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f367800d000 tx=0x7f3678009040).stop 2021-10-20T23:27:06.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 msgr2=0x7f36840637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 0x7f36840637a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f3670002f70 tx=0x7f3670014000).stop 2021-10-20T23:27:06.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 shutdown_connections 2021-10-20T23:27:06.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3664053610 0x7f3664055ad0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368413e660 0x7f3684063c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36840b3cf0 0x7f36840637a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 --2- 172.21.15.12:0/1956662573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36840af780 0x7f36841412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 >> 172.21.15.12:0/1956662573 conn(0x7f368406a110 msgr2=0x7f368413bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:06.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 shutdown_connections 2021-10-20T23:27:06.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.487+0000 7f368b1fe700 1 -- 172.21.15.12:0/1956662573 wait complete. 2021-10-20T23:27:06.507 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:27:06.508 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:06.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:06.551 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:06.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:06.594 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:27:06.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:06.595 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:06.596 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:06.620 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:27:06.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:27:06.623 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:27:06.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:06.624 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:06.625 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:06.632 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:27:06.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:27:06.637 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:27:06.638 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:27:06.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.743+0000 7fabc64bf700 1 Processor -- start 2021-10-20T23:27:06.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.743+0000 7fabc64bf700 1 -- start start 2021-10-20T23:27:06.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.743+0000 7fabc64bf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fabc00b03d0 0x7fabc0146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.743+0000 7fabc64bf700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc00b1140 con 0x7fabc00b0b80 2021-10-20T23:27:06.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.743+0000 7fabc64bf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc00a9570 con 0x7fabc00a9190 2021-10-20T23:27:06.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.743+0000 7fabc64bf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc00b1370 con 0x7fabc00b03d0 2021-10-20T23:27:06.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc4cbc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fabc00b0b80 0x7fabc01401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40664/0 (socket says 172.21.15.12:40664) 2021-10-20T23:27:06.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc4cbc700 1 -- 172.21.15.12:0/2166522394 learned_addr learned my addr 172.21.15.12:0/2166522394 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:06.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc5cbe700 1 --2- 172.21.15.12:0/2166522394 >> v2:172.21.15.31:3300/0 conn(0x7fabc00b03d0 0x7fabc0146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabaffff700 1 -- 172.21.15.12:0/2166522394 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760133060 0 0) 0x7fabc00b1140 con 0x7fabc00b0b80 2021-10-20T23:27:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabaffff700 1 -- 172.21.15.12:0/2166522394 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faba8003260 con 0x7fabc00b0b80 2021-10-20T23:27:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabaffff700 1 -- 172.21.15.12:0/2166522394 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27985256 0 0) 0x7fabc00a9570 con 0x7fabc00a9190 2021-10-20T23:27:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabaffff700 1 -- 172.21.15.12:0/2166522394 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc00b1140 con 0x7fabc00a9190 2021-10-20T23:27:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabaffff700 1 -- 172.21.15.12:0/2166522394 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1053156413 0 0) 0x7faba8003260 con 0x7fabc00b0b80 2021-10-20T23:27:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc5cbe700 1 -- 172.21.15.12:0/2166522394 >> v1:172.21.15.31:6789/0 conn(0x7fabc00a9190 legacy=0x7fabc0146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc5cbe700 1 -- 172.21.15.12:0/2166522394 >> v1:172.21.15.12:6789/0 conn(0x7fabc00b0b80 legacy=0x7fabc01401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc5cbe700 1 -- 172.21.15.12:0/2166522394 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc00b1610 con 0x7fabc00b03d0 2021-10-20T23:27:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc5cbe700 1 --2- 172.21.15.12:0/2166522394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b03d0 0x7fabc0146c60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fabb0001110 tx=0x7fabb80091d0).ready entity=mon.1 client_cookie=106e89fbd090295a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:06.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabaffff700 1 -- 172.21.15.12:0/2166522394 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabb0001660 con 0x7fabc00b03d0 2021-10-20T23:27:06.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabaffff700 1 -- 172.21.15.12:0/2166522394 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800f510 con 0x7fabc00b03d0 2021-10-20T23:27:06.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabaffff700 1 -- 172.21.15.12:0/2166522394 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabb800f680 con 0x7fabc00b03d0 2021-10-20T23:27:06.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc64bf700 1 -- 172.21.15.12:0/2166522394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b03d0 msgr2=0x7fabc0146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc64bf700 1 --2- 172.21.15.12:0/2166522394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b03d0 0x7fabc0146c60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fabb0001110 tx=0x7fabb80091d0).stop 2021-10-20T23:27:06.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc64bf700 1 -- 172.21.15.12:0/2166522394 shutdown_connections 2021-10-20T23:27:06.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc64bf700 1 --2- 172.21.15.12:0/2166522394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b03d0 0x7fabc0146c60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc64bf700 1 -- 172.21.15.12:0/2166522394 >> 172.21.15.12:0/2166522394 conn(0x7fabc0061140 msgr2=0x7fabc0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:06.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc64bf700 1 -- 172.21.15.12:0/2166522394 shutdown_connections 2021-10-20T23:27:06.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.747+0000 7fabc64bf700 1 -- 172.21.15.12:0/2166522394 wait complete. 2021-10-20T23:27:06.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 Processor -- start 2021-10-20T23:27:06.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 -- start start 2021-10-20T23:27:06.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabc00a9190 0x7fabc0144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc00b03d0 0x7fabc01529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b0b80 0x7fabc0152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc0152330 con 0x7fabc00a9190 2021-10-20T23:27:06.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc0145e40 con 0x7fabc00b0b80 2021-10-20T23:27:06.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc01460e0 con 0x7fabc00b03d0 2021-10-20T23:27:06.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc54bd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabc00a9190 0x7fabc0144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc54bd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabc00a9190 0x7fabc0144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42076/0 (socket says 172.21.15.12:42076) 2021-10-20T23:27:06.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc54bd700 1 -- 172.21.15.12:0/95944232 learned_addr learned my addr 172.21.15.12:0/95944232 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:06.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc4cbc700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc00b03d0 0x7fabc01529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc5cbe700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b0b80 0x7fabc0152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc54bd700 1 -- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc00b03d0 msgr2=0x7fabc01529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc54bd700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc00b03d0 0x7fabc01529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc54bd700 1 -- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b0b80 msgr2=0x7fabc0152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:06.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc54bd700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b0b80 0x7fabc0152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:06.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc54bd700 1 -- 172.21.15.12:0/95944232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb8009470 con 0x7fabc00a9190 2021-10-20T23:27:06.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc4cbc700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc00b03d0 0x7fabc01529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:06.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc5cbe700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b0b80 0x7fabc0152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:06.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc54bd700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabc00a9190 0x7fabc0144570 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fabbc001110 tx=0x7fabbc007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:06.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabae7fc700 1 -- 172.21.15.12:0/95944232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabbc00ce10 con 0x7fabc00a9190 2021-10-20T23:27:06.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabae7fc700 1 -- 172.21.15.12:0/95944232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc00f470 con 0x7fabc00a9190 2021-10-20T23:27:06.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc0152520 con 0x7fabc00a9190 2021-10-20T23:27:06.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabae7fc700 1 -- 172.21.15.12:0/95944232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabbc00f7d0 con 0x7fabc00a9190 2021-10-20T23:27:06.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc00ab930 con 0x7fabc00a9190 2021-10-20T23:27:06.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.751+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc01526b0 con 0x7fabc00a9190 2021-10-20T23:27:06.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.755+0000 7fabae7fc700 1 -- 172.21.15.12:0/95944232 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fabbc019030 con 0x7fabc00a9190 2021-10-20T23:27:06.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.755+0000 7fabae7fc700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faba0053610 0x7faba0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:06.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.755+0000 7fabae7fc700 1 -- 172.21.15.12:0/95944232 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fabbc06acc0 con 0x7fabc00a9190 2021-10-20T23:27:06.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.755+0000 7fabc4cbc700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faba0053610 0x7faba0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:06.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.755+0000 7fabc4cbc700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faba0053610 0x7faba0055ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fabb000b000 tx=0x7fabb0001020).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:06.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.759+0000 7fabae7fc700 1 -- 172.21.15.12:0/95944232 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fabbc041f00 con 0x7fabc00a9190 2021-10-20T23:27:06.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.887+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fabc0057350 con 0x7fabc00a9190 2021-10-20T23:27:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabae7fc700 1 -- 172.21.15.12:0/95944232 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v94) v1 ==== 81+0+29220 (secure 0 0 0) 0x7fabbc045520 con 0x7fabc00a9190 2021-10-20T23:27:06.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:06.899 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:06.899 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 94, 2021-10-20T23:27:06.899 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:27:06.899 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:27:06.900 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:27:04.168805+0000", 2021-10-20T23:27:06.900 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:06.900 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:06.900 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:27:06.901 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:27:06.901 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:27:06.901 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:27:06.901 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:27:06.902 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:27:06.902 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:27:06.902 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:06.902 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:27:06.902 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:27:06.903 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:27:06.903 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:27:06.903 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:27:06.903 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 16, 2021-10-20T23:27:06.904 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:27:06.904 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:27:06.904 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:27:06.904 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:27:06.904 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:27:06.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.905 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:27:06.905 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:27:06.905 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:27:06.906 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:06.906 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:06.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:06.906 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:06.907 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:06.907 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:06.907 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:06.907 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:06.907 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:27:06.908 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:27:06.908 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:27:06.908 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:27:06.908 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:27:06.909 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:06.909 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:06.909 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:06.909 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:06.909 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:06.910 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:06.910 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:06.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.910 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:27:06.911 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:06.911 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:06.911 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:06.911 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:06.911 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:06.912 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:06.912 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:06.912 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:06.912 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:06.913 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:06.913 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:06.913 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:06.913 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:06.913 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:06.914 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:06.914 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:06.914 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:06.914 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:06.915 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:06.915 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:06.915 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:06.915 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:06.915 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:06.916 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:06.916 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:06.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:06.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.917 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:06.917 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:06.917 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:06.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:06.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:06.918 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:06.918 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:06.918 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:06.918 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:06.919 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:06.919 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:06.919 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:27:06.919 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:27:06.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.920 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:06.920 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:27:06.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.921 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:27:06.921 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:27:06.921 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:27:06.921 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:06.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:06.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:06.922 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:06.922 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:06.923 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:06.923 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:06.923 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:06.923 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:27:06.924 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:27:06.924 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:27:06.924 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:27:06.924 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:27:06.925 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:06.925 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:06.925 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:06.925 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:06.925 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:06.926 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:06.926 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:06.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.926 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:27:06.927 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:06.927 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:06.927 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:06.927 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:06.927 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:06.928 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:06.928 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:06.928 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:06.928 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:06.929 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:06.929 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:06.929 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:06.929 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:06.929 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:06.930 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:06.930 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:06.930 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:06.930 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:06.931 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:06.931 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:06.931 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:06.931 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:06.931 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:06.932 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:06.932 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:06.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:06.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.933 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:06.933 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:06.933 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:06.933 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:06.934 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:06.934 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:06.934 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:06.934 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:06.935 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:06.935 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:06.935 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:06.935 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:27:06.935 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:06.936 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:27:06.936 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.936 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.936 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:06.937 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:27:06.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.937 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:06.937 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:27:06.937 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:06.938 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:06.938 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:06.938 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:06.938 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:06.939 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:06.939 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:06.939 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:27:06.939 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:06.939 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:06.940 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:06.940 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.940 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:27:06.941 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:06.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.942 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:27:06.942 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:06.942 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.942 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.943 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:06.943 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.944 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:27:06.944 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:06.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.945 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:27:06.945 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:06.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.945 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.946 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:06.946 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.947 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:27:06.947 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:06.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.948 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:27:06.948 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:06.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.949 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.949 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:06.949 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.950 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:27:06.950 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:06.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.951 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:27:06.951 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:06.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.952 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.952 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:27:06.952 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:27:06.953 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:27:06.953 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:27:06.953 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:06.953 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:06.953 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:06.954 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.954 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:06.955 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:27:06.955 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:06.955 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:06.955 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:06.956 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:06.956 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:06.956 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:06.956 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:06.956 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 88, 2021-10-20T23:27:06.957 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:06.957 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:06.957 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:06.957 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.959 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.960 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:27:06.960 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:06.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.961 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:27:06.961 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:06.962 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.962 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.962 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:06.962 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.963 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:27:06.963 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:06.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.964 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:27:06.965 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:06.965 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.965 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.965 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:06.966 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.966 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:27:06.966 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:06.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.967 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:27:06.968 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:06.968 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.968 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.968 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:06.969 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.969 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:27:06.970 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:06.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.970 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:27:06.971 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:06.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.971 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.972 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:27:06.972 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:27:06.972 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:27:06.972 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:27:06.972 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:06.973 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:06.973 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:06.973 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.974 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:06.974 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:27:06.974 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:06.975 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:06.975 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:06.975 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:06.975 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:06.976 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:06.976 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:06.976 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:27:06.976 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:06.977 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:06.977 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:06.977 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.978 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:27:06.978 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:06.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.979 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:27:06.979 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:06.979 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.979 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.980 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:06.980 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.981 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:27:06.981 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:06.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.982 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:27:06.982 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:06.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.982 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.983 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:06.983 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.984 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:27:06.984 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:06.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.985 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:27:06.985 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:06.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.986 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.986 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:06.987 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.988 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:27:06.988 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:06.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.989 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:27:06.989 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:06.990 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.990 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.990 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:27:06.991 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:27:06.991 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:27:06.991 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:27:06.991 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:06.991 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:06.992 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:06.992 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.993 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:06.993 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:27:06.993 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:06.993 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:06.994 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:06.994 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:06.994 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:06.994 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:06.994 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:06.995 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:27:06.995 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:06.995 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:06.995 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:06.996 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:06.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:06.997 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:27:06.997 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:06.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:06.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:06.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:06.998 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:27:06.999 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:06.999 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:06.999 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:06.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.000 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:07.000 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.001 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:27:07.001 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:07.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.002 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:27:07.002 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:07.002 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.002 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.003 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:07.003 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.004 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.004 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:27:07.004 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:07.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.005 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:27:07.005 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:07.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.006 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.006 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:07.006 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.007 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:27:07.007 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:07.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.008 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:27:07.008 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:07.009 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.009 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.009 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:27:07.010 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:27:07.010 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:27:07.010 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:27:07.010 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:07.011 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:07.011 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:07.011 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.012 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:07.012 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:27:07.012 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:07.012 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:07.013 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:07.013 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:07.013 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:07.013 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:07.014 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:07.014 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:27:07.014 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:07.014 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:07.014 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:07.015 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.016 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:27:07.017 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:07.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.019 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:27:07.019 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:07.019 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.020 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.020 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:07.020 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.022 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:27:07.023 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:07.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.024 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:27:07.025 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:07.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.025 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.026 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:07.026 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.027 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:27:07.027 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:07.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.028 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:27:07.028 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:07.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.028 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.029 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:07.029 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.030 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:27:07.030 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:07.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.031 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:27:07.031 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:07.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.032 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.032 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:27:07.032 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:27:07.033 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:27:07.033 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:27:07.033 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:07.033 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:07.034 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:07.034 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.035 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:07.035 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:27:07.035 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:07.035 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:07.035 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:07.036 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:07.036 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:07.036 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:07.036 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:07.037 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:27:07.037 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:07.037 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:07.037 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:07.038 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.038 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:27:07.038 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:07.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.039 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:27:07.040 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:07.040 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.040 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.041 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:07.041 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.041 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:27:07.042 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:07.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.043 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:27:07.043 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:07.043 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.043 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.044 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:07.044 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.044 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.045 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:27:07.045 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:07.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.046 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:27:07.046 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:07.046 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.047 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.047 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:07.047 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.048 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:27:07.048 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:07.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.049 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:27:07.049 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:07.050 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.050 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.050 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:27:07.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:27:07.051 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:27:07.051 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:27:07.051 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:07.052 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:07.052 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:07.052 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.053 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:07.053 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:27:07.053 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:07.053 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:07.054 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:07.054 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:07.054 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:07.054 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:07.055 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:07.055 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:27:07.055 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:07.055 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:07.055 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:07.056 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.056 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:27:07.057 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:07.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.057 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:27:07.058 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:07.058 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.058 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.059 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:07.059 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.060 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:27:07.060 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:07.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.061 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:27:07.061 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:07.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.062 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.062 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:07.063 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.063 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:27:07.064 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:07.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.064 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:27:07.065 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:07.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.065 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.066 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:07.066 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.067 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:27:07.067 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:07.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.067 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.068 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:27:07.068 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:07.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.068 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.069 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:27:07.069 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:27:07.069 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:27:07.069 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:27:07.070 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:07.070 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:07.070 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:07.070 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.071 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:07.072 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:27:07.072 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:07.072 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:07.072 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:07.072 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:07.073 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:07.073 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:07.073 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:07.073 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 75, 2021-10-20T23:27:07.074 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:07.074 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:07.074 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:07.074 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.075 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:27:07.075 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:07.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.076 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:27:07.076 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:07.077 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.077 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.077 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:07.077 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:27:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:27:07.080 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:07.080 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.080 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.081 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:07.081 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.081 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:27:07.082 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:07.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.083 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:27:07.083 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:07.083 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.084 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.084 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:07.084 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:07.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:07.085 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:27:07.085 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:07.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:07.086 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:27:07.086 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:07.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.087 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.087 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:27:07.088 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:27:07.088 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:27:07.088 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:27:07.088 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:07.088 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:07.089 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:07.089 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:07.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.089 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:07.090 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:27:07.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.090 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:07.091 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:07.091 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:07.091 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:07.091 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:07.092 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:07.092 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:27:07.092 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:07.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.093 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:07.093 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:07.093 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:07.093 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:07.094 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:07.094 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:07.094 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:27:07.094 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:07.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.095 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:07.095 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:07.095 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:07.096 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:07.096 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:07.096 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:07.096 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:27:07.097 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:07.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:07.098 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:07.098 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:07.098 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:07.098 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:07.098 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:07.099 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:27:07.099 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:07.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.100 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:07.100 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:07.100 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:07.100 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:07.101 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:07.101 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:07.101 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:27:07.101 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:07.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.102 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:07.102 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:07.102 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:07.102 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:07.103 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:07.103 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:07.103 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:27:07.103 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:07.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.104 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:07.104 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:07.105 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:07.105 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:07.105 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:07.105 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:07.105 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:27:07.106 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:07.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:07.106 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:07.107 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:07.107 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:07.107 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:07.107 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:07.108 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:07.108 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:27:07.108 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:07.108 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.108 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:07.109 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:27:07.109 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:27:07.109 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:27:07.109 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:27:07.109 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:27:07.110 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6835/1566657212": "2021-10-21T23:27:00.611904+0000", 2021-10-20T23:27:07.110 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6834/1566657212": "2021-10-21T23:27:00.611904+0000" 2021-10-20T23:27:07.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.110 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:27:07.111 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:27:07.111 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:27:07.111 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:07.111 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:27:07.111 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:27:07.112 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:07.112 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:27:07.112 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:07.112 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:07.113 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:27:07.113 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:27:07.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.113 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:27:07.113 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:07.114 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:07.114 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:27:07.114 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:07.114 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:27:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:27:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:27:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:27:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:27:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:27:07.116 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faba0053610 msgr2=0x7faba0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faba0053610 0x7faba0055ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fabb000b000 tx=0x7fabb0001020).stop 2021-10-20T23:27:07.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabc00a9190 msgr2=0x7fabc0144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabc00a9190 0x7fabc0144570 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fabbc001110 tx=0x7fabbc007ae0).stop 2021-10-20T23:27:07.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 shutdown_connections 2021-10-20T23:27:07.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faba0053610 0x7faba0055ad0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc00b0b80 0x7fabc0152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc00b03d0 0x7fabc01529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 --2- 172.21.15.12:0/95944232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabc00a9190 0x7fabc0144570 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 >> 172.21.15.12:0/95944232 conn(0x7fabc0061140 msgr2=0x7fabc01438d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 shutdown_connections 2021-10-20T23:27:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:06.891+0000 7fabc64bf700 1 -- 172.21.15.12:0/95944232 wait complete. 2021-10-20T23:27:07.123 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.227+0000 7f482cb36700 1 Processor -- start 2021-10-20T23:27:07.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.227+0000 7f482cb36700 1 -- start start 2021-10-20T23:27:07.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48280b1db0 0x7f48280b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48281483a0 0x7f48280b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48280b0350 con 0x7f48280a70c0 2021-10-20T23:27:07.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48280a90c0 con 0x7f48281483a0 2021-10-20T23:27:07.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48280b05f0 con 0x7f48280b1db0 2021-10-20T23:27:07.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f4825d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48281483a0 0x7f48280b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f4826d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f48280a70c0 0x7f4828144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40682/0 (socket says 172.21.15.12:40682) 2021-10-20T23:27:07.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f4826d9d700 1 -- 172.21.15.12:0/3225832202 learned_addr learned my addr 172.21.15.12:0/3225832202 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:07.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482659c700 1 --2- 172.21.15.12:0/3225832202 >> v2:172.21.15.31:3300/0 conn(0x7f48280b1db0 0x7f48280b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f4825d9b700 1 -- 172.21.15.12:0/3225832202 >> v2:172.21.15.31:3300/0 conn(0x7f48280b1db0 msgr2=0x7f48280b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:07.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f4825d9b700 1 --2- 172.21.15.12:0/3225832202 >> v2:172.21.15.31:3300/0 conn(0x7f48280b1db0 0x7f48280b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f4825d9b700 1 -- 172.21.15.12:0/3225832202 >> v1:172.21.15.12:6789/0 conn(0x7f48280a70c0 legacy=0x7f4828144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f4825d9b700 1 -- 172.21.15.12:0/3225832202 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48280b0890 con 0x7f48281483a0 2021-10-20T23:27:07.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f4825d9b700 1 --2- 172.21.15.12:0/3225832202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 0x7f48280b2190 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f4828147730 tx=0x7f4818006df0).ready entity=mon.0 client_cookie=e67946612e15b995 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:07.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482559a700 1 -- 172.21.15.12:0/3225832202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481800d5c0 con 0x7f48281483a0 2021-10-20T23:27:07.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482559a700 1 -- 172.21.15.12:0/3225832202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4818000e90 con 0x7f48281483a0 2021-10-20T23:27:07.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482559a700 1 -- 172.21.15.12:0/3225832202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481800d910 con 0x7f48281483a0 2021-10-20T23:27:07.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 -- 172.21.15.12:0/3225832202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 msgr2=0x7f48280b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 --2- 172.21.15.12:0/3225832202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 0x7f48280b2190 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f4828147730 tx=0x7f4818006df0).stop 2021-10-20T23:27:07.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 -- 172.21.15.12:0/3225832202 shutdown_connections 2021-10-20T23:27:07.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 --2- 172.21.15.12:0/3225832202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 0x7f48280b2190 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 --2- 172.21.15.12:0/3225832202 >> v2:172.21.15.31:3300/0 conn(0x7f48280b1db0 0x7f48280b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 -- 172.21.15.12:0/3225832202 >> 172.21.15.12:0/3225832202 conn(0x7f482805f6b0 msgr2=0x7f482805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:07.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 -- 172.21.15.12:0/3225832202 shutdown_connections 2021-10-20T23:27:07.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.231+0000 7f482cb36700 1 -- 172.21.15.12:0/3225832202 wait complete. 2021-10-20T23:27:07.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f482cb36700 1 Processor -- start 2021-10-20T23:27:07.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f482cb36700 1 -- start start 2021-10-20T23:27:07.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f482cb36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280a70c0 0x7f48280636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f482cb36700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48280b1db0 0x7f48280ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f482cb36700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 0x7f48280abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f482cb36700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4828157450 con 0x7f48281483a0 2021-10-20T23:27:07.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f482cb36700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48280aa270 con 0x7f48280a70c0 2021-10-20T23:27:07.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f482cb36700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482814b800 con 0x7f48280b1db0 2021-10-20T23:27:07.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f4826d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 0x7f48280abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f4826d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 0x7f48280abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42094/0 (socket says 172.21.15.12:42094) 2021-10-20T23:27:07.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f4826d9d700 1 -- 172.21.15.12:0/584243647 learned_addr learned my addr 172.21.15.12:0/584243647 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:07.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f482659c700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280a70c0 0x7f48280636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.235+0000 7f4825d9b700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48280b1db0 0x7f48280ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f4826d9d700 1 -- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48280b1db0 msgr2=0x7f48280ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f4826d9d700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48280b1db0 0x7f48280ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f4826d9d700 1 -- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280a70c0 msgr2=0x7f48280636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f4826d9d700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280a70c0 0x7f48280636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f4826d9d700 1 -- 172.21.15.12:0/584243647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481800b180 con 0x7f48281483a0 2021-10-20T23:27:07.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f4826d9d700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 0x7f48280abdd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f48280ace60 tx=0x7f4820007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:07.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f48177fe700 1 -- 172.21.15.12:0/584243647 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4820005ba0 con 0x7f48281483a0 2021-10-20T23:27:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f48177fe700 1 -- 172.21.15.12:0/584243647 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4820005d00 con 0x7f48281483a0 2021-10-20T23:27:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4828157670 con 0x7f48281483a0 2021-10-20T23:27:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f48177fe700 1 -- 172.21.15.12:0/584243647 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48200072c0 con 0x7f48281483a0 2021-10-20T23:27:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48280a9ef0 con 0x7f48281483a0 2021-10-20T23:27:07.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48280ac460 con 0x7f48281483a0 2021-10-20T23:27:07.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f48177fe700 1 -- 172.21.15.12:0/584243647 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f482001a060 con 0x7f48281483a0 2021-10-20T23:27:07.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f48177fe700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4804053610 0x7f4804055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f48177fe700 1 -- 172.21.15.12:0/584243647 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f482006b2d0 con 0x7f48281483a0 2021-10-20T23:27:07.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.239+0000 7f482659c700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4804053610 0x7f4804055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.243+0000 7f482659c700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4804053610 0x7f4804055ad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f481c00b000 tx=0x7f481c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:07.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.247+0000 7f48177fe700 1 -- 172.21.15.12:0/584243647 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4820042510 con 0x7f48281483a0 2021-10-20T23:27:07.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:27:07.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:27:07.307 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:27:07.311 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:27:07.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.415+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48280b0b30 con 0x7f48281483a0 2021-10-20T23:27:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.415+0000 7f48177fe700 1 -- 172.21.15.12:0/584243647 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f4820018020 con 0x7f48281483a0 2021-10-20T23:27:07.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:07.424 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5990,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/246201101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":246201101},{"type":"v1","addr":"172.21.15.12:6833","nonce":246201101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1822115331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1822115331},{"type":"v1","addr":"172.21.15.31:6835","nonce":1822115331}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6191,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2853806571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2853806571},{"type":"v1","addr":"172.21.15.12:6835","nonce":2853806571}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[]} 2021-10-20T23:27:07.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4804053610 msgr2=0x7f4804055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4804053610 0x7f4804055ad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f481c00b000 tx=0x7f481c006df0).stop 2021-10-20T23:27:07.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 msgr2=0x7f48280abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 0x7f48280abdd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f48280ace60 tx=0x7f4820007f40).stop 2021-10-20T23:27:07.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 shutdown_connections 2021-10-20T23:27:07.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4804053610 0x7f4804055ad0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48281483a0 0x7f48280abdd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48280b1db0 0x7f48280ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 --2- 172.21.15.12:0/584243647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280a70c0 0x7f48280636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 >> 172.21.15.12:0/584243647 conn(0x7f482805f6b0 msgr2=0x7f4828143de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:07.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 shutdown_connections 2021-10-20T23:27:07.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.419+0000 7f482cb36700 1 -- 172.21.15.12:0/584243647 wait complete. 2021-10-20T23:27:07.429 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 46 2021-10-20T23:27:07.437 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f163d8fd700 1 Processor -- start 2021-10-20T23:27:07.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f163d8fd700 1 -- start start 2021-10-20T23:27:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f163d8fd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16380b43c0 0x7f16380b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f163d8fd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 0x7f163812ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f163d8fd700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16381440b0 con 0x7f16380b6580 2021-10-20T23:27:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f163d8fd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1638143b70 con 0x7f16380b43c0 2021-10-20T23:27:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f163d8fd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1638143e10 con 0x7f16380b6960 2021-10-20T23:27:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f1636ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f16380b6580 0x7f1638061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40694/0 (socket says 172.21.15.12:40694) 2021-10-20T23:27:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f1636ffd700 1 -- 172.21.15.12:0/889821823 learned_addr learned my addr 172.21.15.12:0/889821823 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f16377fe700 1 --2- 172.21.15.12:0/889821823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 0x7f163812ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.535+0000 7f16367fc700 1 --2- 172.21.15.12:0/889821823 >> v2:172.21.15.31:3300/0 conn(0x7f16380b43c0 0x7f16380b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f1635ffb700 1 -- 172.21.15.12:0/889821823 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409325381 0 0) 0x7f16381440b0 con 0x7f16380b6580 2021-10-20T23:27:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f1635ffb700 1 -- 172.21.15.12:0/889821823 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f161c003260 con 0x7f16380b6580 2021-10-20T23:27:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f16377fe700 1 -- 172.21.15.12:0/889821823 >> v2:172.21.15.31:3300/0 conn(0x7f16380b43c0 msgr2=0x7f16380b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f16377fe700 1 --2- 172.21.15.12:0/889821823 >> v2:172.21.15.31:3300/0 conn(0x7f16380b43c0 0x7f16380b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f16377fe700 1 -- 172.21.15.12:0/889821823 >> v1:172.21.15.12:6789/0 conn(0x7f16380b6580 legacy=0x7f1638061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f16377fe700 1 -- 172.21.15.12:0/889821823 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380615f0 con 0x7f16380b6960 2021-10-20T23:27:07.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f16377fe700 1 --2- 172.21.15.12:0/889821823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 0x7f163812ba00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1638143120 tx=0x7f16300091d0).ready entity=mon.2 client_cookie=cdd0824eb0f739cb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:07.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f1635ffb700 1 -- 172.21.15.12:0/889821823 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163000b600 con 0x7f16380b6960 2021-10-20T23:27:07.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f1635ffb700 1 -- 172.21.15.12:0/889821823 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163000b760 con 0x7f16380b6960 2021-10-20T23:27:07.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f1635ffb700 1 -- 172.21.15.12:0/889821823 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163000b8d0 con 0x7f16380b6960 2021-10-20T23:27:07.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f163d8fd700 1 -- 172.21.15.12:0/889821823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 msgr2=0x7f163812ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f163d8fd700 1 --2- 172.21.15.12:0/889821823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 0x7f163812ba00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1638143120 tx=0x7f16300091d0).stop 2021-10-20T23:27:07.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f163d8fd700 1 -- 172.21.15.12:0/889821823 shutdown_connections 2021-10-20T23:27:07.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f163d8fd700 1 --2- 172.21.15.12:0/889821823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 0x7f163812ba00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f163d8fd700 1 --2- 172.21.15.12:0/889821823 >> v2:172.21.15.31:3300/0 conn(0x7f16380b43c0 0x7f16380b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f163d8fd700 1 -- 172.21.15.12:0/889821823 >> 172.21.15.12:0/889821823 conn(0x7f163805c490 msgr2=0x7f163805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:07.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f163d8fd700 1 -- 172.21.15.12:0/889821823 shutdown_connections 2021-10-20T23:27:07.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.539+0000 7f163d8fd700 1 -- 172.21.15.12:0/889821823 wait complete. 2021-10-20T23:27:07.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f163d8fd700 1 Processor -- start 2021-10-20T23:27:07.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f163d8fd700 1 -- start start 2021-10-20T23:27:07.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f163d8fd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16380b43c0 0x7f16381478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f163d8fd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16380b6580 0x7f1638155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f163d8fd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 0x7f16381520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f163d8fd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1638146e00 con 0x7f16380b6580 2021-10-20T23:27:07.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f163d8fd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1638146b60 con 0x7f16380b43c0 2021-10-20T23:27:07.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f163d8fd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1638155720 con 0x7f16380b6960 2021-10-20T23:27:07.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16367fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16380b6580 0x7f1638155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16367fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16380b6580 0x7f1638155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42106/0 (socket says 172.21.15.12:42106) 2021-10-20T23:27:07.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16367fc700 1 -- 172.21.15.12:0/1642683338 learned_addr learned my addr 172.21.15.12:0/1642683338 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:07.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f1636ffd700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16380b43c0 0x7f16381478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16377fe700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 0x7f16381520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16367fc700 1 -- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 msgr2=0x7f16381520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16367fc700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 0x7f16381520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16367fc700 1 -- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16380b43c0 msgr2=0x7f16381478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16367fc700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16380b43c0 0x7f16381478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16367fc700 1 -- 172.21.15.12:0/1642683338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630009470 con 0x7f16380b6580 2021-10-20T23:27:07.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.543+0000 7f16367fc700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16380b6580 0x7f1638155e60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f162c00c000 tx=0x7f162c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:07.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.547+0000 7f1627fff700 1 -- 172.21.15.12:0/1642683338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f162c011750 con 0x7f16380b6580 2021-10-20T23:27:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.547+0000 7f1627fff700 1 -- 172.21.15.12:0/1642683338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c0118b0 con 0x7f16380b6580 2021-10-20T23:27:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.547+0000 7f1627fff700 1 -- 172.21.15.12:0/1642683338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f162c011c10 con 0x7f16380b6580 2021-10-20T23:27:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.547+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16381559c0 con 0x7f16380b6580 2021-10-20T23:27:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.547+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16380b8a50 con 0x7f16380b6580 2021-10-20T23:27:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.547+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1638061890 con 0x7f16380b6580 2021-10-20T23:27:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.547+0000 7f1627fff700 1 -- 172.21.15.12:0/1642683338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f162c011d70 con 0x7f16380b6580 2021-10-20T23:27:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.547+0000 7f1627fff700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16140536d0 0x7f1614055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.547+0000 7f1627fff700 1 -- 172.21.15.12:0/1642683338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f162c06bae0 con 0x7f16380b6580 2021-10-20T23:27:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.551+0000 7f1636ffd700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16140536d0 0x7f1614055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.551+0000 7f1636ffd700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16140536d0 0x7f1614055b90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f162800d000 tx=0x7f1628009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.555+0000 7f1627fff700 1 -- 172.21.15.12:0/1642683338 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f162c042ce0 con 0x7f16380b6580 2021-10-20T23:27:07.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.723+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1638057350 con 0x7f16380b6580 2021-10-20T23:27:07.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f1627fff700 1 -- 172.21.15.12:0/1642683338 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f162c046300 con 0x7f16380b6580 2021-10-20T23:27:07.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:07.732 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5990,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/246201101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":246201101},{"type":"v1","addr":"172.21.15.12:6833","nonce":246201101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1822115331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1822115331},{"type":"v1","addr":"172.21.15.31:6835","nonce":1822115331}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6191,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2853806571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2853806571},{"type":"v1","addr":"172.21.15.12:6835","nonce":2853806571}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[]} 2021-10-20T23:27:07.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16140536d0 msgr2=0x7f1614055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16140536d0 0x7f1614055b90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f162800d000 tx=0x7f1628009040).stop 2021-10-20T23:27:07.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16380b6580 msgr2=0x7f1638155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16380b6580 0x7f1638155e60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f162c00c000 tx=0x7f162c006df0).stop 2021-10-20T23:27:07.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 shutdown_connections 2021-10-20T23:27:07.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16140536d0 0x7f1614055b90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16380b6960 0x7f16381520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16380b6580 0x7f1638155e60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 --2- 172.21.15.12:0/1642683338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16380b43c0 0x7f16381478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 >> 172.21.15.12:0/1642683338 conn(0x7f163805c490 msgr2=0x7f1638127400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:07.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 shutdown_connections 2021-10-20T23:27:07.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.727+0000 7f163d8fd700 1 -- 172.21.15.12:0/1642683338 wait complete. 2021-10-20T23:27:07.738 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 46 2021-10-20T23:27:07.746 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:27:07.750 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:27:07.751 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:27:07.751 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:27:07.752 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:27:07.752 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:27:07.752 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:27:07.754 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:27:07.755 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:27:07.755 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:27:07.756 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:27:07.756 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:27:07.769 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:27:07.770 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:27:07.771 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:27:07.772 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:27:07.773 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:27:07.774 DEBUG:teuthology.parallel:result is None 2021-10-20T23:27:07.775 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:27:07.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:27:07.776 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:27:07.777 DEBUG:teuthology.parallel:result is None 2021-10-20T23:27:07.820 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:27:07.820 DEBUG:teuthology.parallel:result is None 2021-10-20T23:27:07.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:27:07.852 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:27:07.860 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:27:07.900 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:27:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b9c82b700 1 Processor -- start 2021-10-20T23:27:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b9c82b700 1 -- start start 2021-10-20T23:27:07.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b9c82b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0b980b43c0 0x7f0b980b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b9c82b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b6960 0x7f0b9812ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b9c82b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b981440b0 con 0x7f0b980b6580 2021-10-20T23:27:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b9c82b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b98143b70 con 0x7f0b980b43c0 2021-10-20T23:27:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b9c82b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b98143e10 con 0x7f0b980b6960 2021-10-20T23:27:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b95d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0b980b43c0 0x7f0b980b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b95d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0b980b43c0 0x7f0b980b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42138/0 (socket says 172.21.15.12:42138) 2021-10-20T23:27:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b96d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b6960 0x7f0b9812ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b95d9b700 1 -- 172.21.15.12:0/2478387210 learned_addr learned my addr 172.21.15.12:0/2478387210 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:07.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b9659c700 1 --1- 172.21.15.12:0/2478387210 >> v1:172.21.15.31:6789/0 conn(0x7f0b980b6580 0x7f0b98061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:47794/0 (socket says 172.21.15.12:47794) 2021-10-20T23:27:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b95d9b700 1 -- 172.21.15.12:0/2478387210 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b6960 msgr2=0x7f0b9812ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b95d9b700 1 --2- 172.21.15.12:0/2478387210 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b6960 0x7f0b9812ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b9559a700 1 -- 172.21.15.12:0/2478387210 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639688622 0 0) 0x7f0b981440b0 con 0x7f0b980b6580 2021-10-20T23:27:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b95d9b700 1 -- 172.21.15.12:0/2478387210 >> v1:172.21.15.31:6789/0 conn(0x7f0b980b6580 legacy=0x7f0b98061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.911+0000 7f0b95d9b700 1 -- 172.21.15.12:0/2478387210 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b980615f0 con 0x7f0b980b43c0 2021-10-20T23:27:07.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b95d9b700 1 --2- 172.21.15.12:0/2478387210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b43c0 0x7f0b980b5bf0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f0b98143120 tx=0x7f0b8c006eb0).ready entity=mon.0 client_cookie=941210e40bdff155 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:07.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9559a700 1 -- 172.21.15.12:0/2478387210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8c00d5c0 con 0x7f0b980b43c0 2021-10-20T23:27:07.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9559a700 1 -- 172.21.15.12:0/2478387210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c000e90 con 0x7f0b980b43c0 2021-10-20T23:27:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9559a700 1 -- 172.21.15.12:0/2478387210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8c00d910 con 0x7f0b980b43c0 2021-10-20T23:27:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9c82b700 1 -- 172.21.15.12:0/2478387210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b43c0 msgr2=0x7f0b980b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9c82b700 1 --2- 172.21.15.12:0/2478387210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b43c0 0x7f0b980b5bf0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f0b98143120 tx=0x7f0b8c006eb0).stop 2021-10-20T23:27:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9c82b700 1 -- 172.21.15.12:0/2478387210 shutdown_connections 2021-10-20T23:27:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9c82b700 1 --2- 172.21.15.12:0/2478387210 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b6960 0x7f0b9812ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9c82b700 1 --2- 172.21.15.12:0/2478387210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b43c0 0x7f0b980b5bf0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9c82b700 1 -- 172.21.15.12:0/2478387210 >> 172.21.15.12:0/2478387210 conn(0x7f0b9805c490 msgr2=0x7f0b9805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9c82b700 1 -- 172.21.15.12:0/2478387210 shutdown_connections 2021-10-20T23:27:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.915+0000 7f0b9c82b700 1 -- 172.21.15.12:0/2478387210 wait complete. 2021-10-20T23:27:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 Processor -- start 2021-10-20T23:27:07.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 -- start start 2021-10-20T23:27:07.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b43c0 0x7f0b98146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b980b6580 0x7f0b98152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b6960 0x7f0b980ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b981472c0 con 0x7f0b980b6960 2021-10-20T23:27:07.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b98147560 con 0x7f0b980b6580 2021-10-20T23:27:07.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b98147ad0 con 0x7f0b980b43c0 2021-10-20T23:27:07.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b43c0 0x7f0b98146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b96d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b6960 0x7f0b980ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b43c0 0x7f0b98146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:47900/0 (socket says 172.21.15.12:47900) 2021-10-20T23:27:07.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b96d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b6960 0x7f0b980ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42146/0 (socket says 172.21.15.12:42146) 2021-10-20T23:27:07.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9659c700 1 -- 172.21.15.12:0/52486502 learned_addr learned my addr 172.21.15.12:0/52486502 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:07.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b95d9b700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b980b6580 0x7f0b98152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b96d9d700 1 -- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b43c0 msgr2=0x7f0b98146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b96d9d700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b43c0 0x7f0b98146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b96d9d700 1 -- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b980b6580 msgr2=0x7f0b98152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:07.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b96d9d700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b980b6580 0x7f0b98152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:07.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b96d9d700 1 -- 172.21.15.12:0/52486502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c00b1e0 con 0x7f0b980b6960 2021-10-20T23:27:07.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b96d9d700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b6960 0x7f0b980ad7c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f0b9000c000 tx=0x7f0b900091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:07.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b877fe700 1 -- 172.21.15.12:0/52486502 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b90012600 con 0x7f0b980b6960 2021-10-20T23:27:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b98147d70 con 0x7f0b980b6960 2021-10-20T23:27:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b98146d70 con 0x7f0b980b6960 2021-10-20T23:27:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b877fe700 1 -- 172.21.15.12:0/52486502 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b90012760 con 0x7f0b980b6960 2021-10-20T23:27:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.919+0000 7f0b877fe700 1 -- 172.21.15.12:0/52486502 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b90012ac0 con 0x7f0b980b6960 2021-10-20T23:27:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.923+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b70003410 con 0x7f0b980b6960 2021-10-20T23:27:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.923+0000 7f0b877fe700 1 -- 172.21.15.12:0/52486502 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0b90022070 con 0x7f0b980b6960 2021-10-20T23:27:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.923+0000 7f0b877fe700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0b74053610 0x7f0b74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.923+0000 7f0b877fe700 1 -- 172.21.15.12:0/52486502 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f0b9006be50 con 0x7f0b980b6960 2021-10-20T23:27:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.923+0000 7f0b9659c700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0b74053610 0x7f0b74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.927+0000 7f0b9659c700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0b74053610 0x7f0b74055ad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f0b8800d000 tx=0x7f0b88007ac0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:07.931+0000 7f0b877fe700 1 -- 172.21.15.12:0/52486502 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b90043030 con 0x7f0b980b6960 2021-10-20T23:27:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.075+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f0b70003c40 con 0x7f0b980b6960 2021-10-20T23:27:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.899+0000 7f0b877fe700 1 -- 172.21.15.12:0/52486502 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v96) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0b90016070 con 0x7f0b980b6960 2021-10-20T23:27:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0b74053610 msgr2=0x7f0b74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0b74053610 0x7f0b74055ad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f0b8800d000 tx=0x7f0b88007ac0).stop 2021-10-20T23:27:08.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b6960 msgr2=0x7f0b980ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:08.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b6960 0x7f0b980ad7c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f0b9000c000 tx=0x7f0b900091d0).stop 2021-10-20T23:27:08.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 shutdown_connections 2021-10-20T23:27:08.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0b74053610 0x7f0b74055ad0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b980b6960 0x7f0b980ad7c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b980b6580 0x7f0b98152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 --2- 172.21.15.12:0/52486502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b980b43c0 0x7f0b98146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 >> 172.21.15.12:0/52486502 conn(0x7f0b9805c490 msgr2=0x7f0b98141ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 shutdown_connections 2021-10-20T23:27:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:08.903+0000 7f0b9c82b700 1 -- 172.21.15.12:0/52486502 wait complete. 2021-10-20T23:27:08.913 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:27:08.925 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:27:08.926 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:27:09.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03f11e700 1 Processor -- start 2021-10-20T23:27:09.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03f11e700 1 -- start start 2021-10-20T23:27:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03f11e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0381483a0 0x7fa0380b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03f11e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0380b0350 con 0x7fa0380a70c0 2021-10-20T23:27:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03f11e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0380b05f0 con 0x7fa0380b1db0 2021-10-20T23:27:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03f11e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0380a90c0 con 0x7fa0381483a0 2021-10-20T23:27:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03d6bb700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa0380a70c0 0x7fa038144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40750/0 (socket says 172.21.15.12:40750) 2021-10-20T23:27:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03d6bb700 1 -- 172.21.15.12:0/3670981870 learned_addr learned my addr 172.21.15.12:0/3670981870 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa037fff700 1 --2- 172.21.15.12:0/3670981870 >> v2:172.21.15.31:3300/0 conn(0x7fa0381483a0 0x7fa0380b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa037fff700 1 -- 172.21.15.12:0/3670981870 >> v1:172.21.15.31:6789/0 conn(0x7fa0380b1db0 legacy=0x7fa0380b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa037fff700 1 -- 172.21.15.12:0/3670981870 >> v1:172.21.15.12:6789/0 conn(0x7fa0380a70c0 legacy=0x7fa038144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa037fff700 1 -- 172.21.15.12:0/3670981870 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0380b0890 con 0x7fa0381483a0 2021-10-20T23:27:09.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa0377fe700 1 -- 172.21.15.12:0/3670981870 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610721025 0 0) 0x7fa0380b0350 con 0x7fa0380a70c0 2021-10-20T23:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa037fff700 1 --2- 172.21.15.12:0/3670981870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0381483a0 0x7fa0380b0fd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa038147730 tx=0x7fa0300091d0).ready entity=mon.1 client_cookie=db65bd1bfb316fa1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa0377fe700 1 -- 172.21.15.12:0/3670981870 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa03000b860 con 0x7fa0381483a0 2021-10-20T23:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa0377fe700 1 -- 172.21.15.12:0/3670981870 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03000b9c0 con 0x7fa0381483a0 2021-10-20T23:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa0377fe700 1 -- 172.21.15.12:0/3670981870 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa03000bb30 con 0x7fa0381483a0 2021-10-20T23:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03f11e700 1 -- 172.21.15.12:0/3670981870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0381483a0 msgr2=0x7fa0380b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03f11e700 1 --2- 172.21.15.12:0/3670981870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0381483a0 0x7fa0380b0fd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa038147730 tx=0x7fa0300091d0).stop 2021-10-20T23:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.071+0000 7fa03f11e700 1 -- 172.21.15.12:0/3670981870 shutdown_connections 2021-10-20T23:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 --2- 172.21.15.12:0/3670981870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0381483a0 0x7fa0380b0fd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 -- 172.21.15.12:0/3670981870 >> 172.21.15.12:0/3670981870 conn(0x7fa03805f6b0 msgr2=0x7fa03805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 -- 172.21.15.12:0/3670981870 shutdown_connections 2021-10-20T23:27:09.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 -- 172.21.15.12:0/3670981870 wait complete. 2021-10-20T23:27:09.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 Processor -- start 2021-10-20T23:27:09.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 -- start start 2021-10-20T23:27:09.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0380a70c0 0x7fa0380ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0380b1db0 0x7fa038148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0381483a0 0x7fa038149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038143f40 con 0x7fa0381483a0 2021-10-20T23:27:09.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03814b450 con 0x7fa0380a70c0 2021-10-20T23:27:09.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03f11e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0380aba00 con 0x7fa0380b1db0 2021-10-20T23:27:09.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03d6bb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0381483a0 0x7fa038149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa037fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0380b1db0 0x7fa038148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03d6bb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0381483a0 0x7fa038149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42162/0 (socket says 172.21.15.12:42162) 2021-10-20T23:27:09.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa037fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0380b1db0 0x7fa038148b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:47918/0 (socket says 172.21.15.12:47918) 2021-10-20T23:27:09.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03ceba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0380a70c0 0x7fa0380ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa03d6bb700 1 -- 172.21.15.12:0/782195858 learned_addr learned my addr 172.21.15.12:0/782195858 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa037fff700 1 -- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0380a70c0 msgr2=0x7fa0380ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa037fff700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0380a70c0 0x7fa0380ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa037fff700 1 -- 172.21.15.12:0/782195858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0381483a0 msgr2=0x7fa038149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa037fff700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0381483a0 0x7fa038149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa037fff700 1 -- 172.21.15.12:0/782195858 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa030009470 con 0x7fa0380b1db0 2021-10-20T23:27:09.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.075+0000 7fa037fff700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0380b1db0 0x7fa038148b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa038149dd0 tx=0x7fa030016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa035ffb700 1 -- 172.21.15.12:0/782195858 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa030011ea0 con 0x7fa0380b1db0 2021-10-20T23:27:09.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa035ffb700 1 -- 172.21.15.12:0/782195858 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0300032f0 con 0x7fa0380b1db0 2021-10-20T23:27:09.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0380abca0 con 0x7fa0380b1db0 2021-10-20T23:27:09.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa035ffb700 1 -- 172.21.15.12:0/782195858 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa03001f5e0 con 0x7fa0380b1db0 2021-10-20T23:27:09.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0380ac460 con 0x7fa0380b1db0 2021-10-20T23:27:09.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0380b0b30 con 0x7fa0380b1db0 2021-10-20T23:27:09.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa035ffb700 1 -- 172.21.15.12:0/782195858 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa030026030 con 0x7fa0380b1db0 2021-10-20T23:27:09.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa035ffb700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0100536d0 0x7fa010055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa035ffb700 1 -- 172.21.15.12:0/782195858 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa03006c310 con 0x7fa0380b1db0 2021-10-20T23:27:09.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.079+0000 7fa03ceba700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0100536d0 0x7fa010055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.083+0000 7fa03ceba700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0100536d0 0x7fa010055b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa02000d000 tx=0x7fa020007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.091+0000 7fa035ffb700 1 -- 172.21.15.12:0/782195858 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa030043540 con 0x7fa0380b1db0 2021-10-20T23:27:09.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.259+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa038057350 con 0x7fa0380b1db0 2021-10-20T23:27:09.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.259+0000 7fa035ffb700 1 -- 172.21.15.12:0/782195858 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fa030015090 con 0x7fa0380b1db0 2021-10-20T23:27:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:09.268 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:27:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:27:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:27:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:27:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:27:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:27:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:27:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:27:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:27:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:27:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:27:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:27:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:27:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:27:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:27:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:27:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:27:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:27:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:27:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:27:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:27:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:27:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:27:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:27:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:27:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:27:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:27:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:27:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:27:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:27:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:27:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:27:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:27:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:27:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:27:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:27:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:27:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:27:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:27:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:27:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:27:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:27:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:09.301 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0100536d0 msgr2=0x7fa010055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0100536d0 0x7fa010055b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa02000d000 tx=0x7fa020007b90).stop 2021-10-20T23:27:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0380b1db0 msgr2=0x7fa038148b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0380b1db0 0x7fa038148b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa038149dd0 tx=0x7fa030016000).stop 2021-10-20T23:27:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 shutdown_connections 2021-10-20T23:27:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0100536d0 0x7fa010055b90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0381483a0 0x7fa038149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0380b1db0 0x7fa038148b90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 --2- 172.21.15.12:0/782195858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0380a70c0 0x7fa0380ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 >> 172.21.15.12:0/782195858 conn(0x7fa03805f6b0 msgr2=0x7fa0380b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 shutdown_connections 2021-10-20T23:27:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.263+0000 7fa03f11e700 1 -- 172.21.15.12:0/782195858 wait complete. 2021-10-20T23:27:09.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:09.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bd051c700 1 Processor -- start 2021-10-20T23:27:09.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bd051c700 1 -- start start 2021-10-20T23:27:09.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bd051c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc80b6900 0x7f6bc80acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bd051c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bc80aa5d0 0x7f6bc813c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bd051c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80b6ce0 con 0x7f6bc8060910 2021-10-20T23:27:09.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bd051c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80611e0 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bd051c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8061480 con 0x7f6bc80b6900 2021-10-20T23:27:09.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bceab9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bc80aa5d0 0x7f6bc813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bcdab7700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6bc8060910 0x7f6bc80a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:47826/0 (socket says 172.21.15.12:47826) 2021-10-20T23:27:09.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bce2b8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc80b6900 0x7f6bc80acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bceab9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bc80aa5d0 0x7f6bc813c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42170/0 (socket says 172.21.15.12:42170) 2021-10-20T23:27:09.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.407+0000 7f6bcdab7700 1 -- 172.21.15.12:0/4032565117 learned_addr learned my addr 172.21.15.12:0/4032565117 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:09.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bceab9700 1 -- 172.21.15.12:0/4032565117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc80b6900 msgr2=0x7f6bc80acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:09.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bceab9700 1 --2- 172.21.15.12:0/4032565117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc80b6900 0x7f6bc80acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bceab9700 1 -- 172.21.15.12:0/4032565117 >> v1:172.21.15.31:6789/0 conn(0x7f6bc8060910 legacy=0x7f6bc80a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bcd2b6700 1 -- 172.21.15.12:0/4032565117 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546866404 0 0) 0x7f6bc80b6ce0 con 0x7f6bc8060910 2021-10-20T23:27:09.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bceab9700 1 -- 172.21.15.12:0/4032565117 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8061720 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bceab9700 1 --2- 172.21.15.12:0/4032565117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 0x7f6bc813c470 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f6bc00032f0 tx=0x7f6bc00091d0).ready entity=mon.0 client_cookie=45b372c07998fb3d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bcd2b6700 1 -- 172.21.15.12:0/4032565117 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc000b6c0 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bcd2b6700 1 -- 172.21.15.12:0/4032565117 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc000b820 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bcd2b6700 1 -- 172.21.15.12:0/4032565117 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc000b990 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bd051c700 1 -- 172.21.15.12:0/4032565117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 msgr2=0x7f6bc813c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bd051c700 1 --2- 172.21.15.12:0/4032565117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 0x7f6bc813c470 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f6bc00032f0 tx=0x7f6bc00091d0).stop 2021-10-20T23:27:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bd051c700 1 -- 172.21.15.12:0/4032565117 shutdown_connections 2021-10-20T23:27:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bd051c700 1 --2- 172.21.15.12:0/4032565117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 0x7f6bc813c470 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bd051c700 1 --2- 172.21.15.12:0/4032565117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc80b6900 0x7f6bc80acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bd051c700 1 -- 172.21.15.12:0/4032565117 >> 172.21.15.12:0/4032565117 conn(0x7f6bc80b3480 msgr2=0x7f6bc80b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bd051c700 1 -- 172.21.15.12:0/4032565117 shutdown_connections 2021-10-20T23:27:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bd051c700 1 -- 172.21.15.12:0/4032565117 wait complete. 2021-10-20T23:27:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.411+0000 7f6bd051c700 1 Processor -- start 2021-10-20T23:27:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bd051c700 1 -- start start 2021-10-20T23:27:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bd051c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc8060910 0x7f6bc81374d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bd051c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 0x7f6bc8155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bd051c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bc80b6900 0x7f6bc8156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bd051c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc811fc30 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bd051c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc81559e0 con 0x7f6bc80b6900 2021-10-20T23:27:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bd051c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8121fd0 con 0x7f6bc8060910 2021-10-20T23:27:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bcdab7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 0x7f6bc8155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bce2b8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc8060910 0x7f6bc81374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bceab9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bc80b6900 0x7f6bc8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bce2b8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc8060910 0x7f6bc81374d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:47930/0 (socket says 172.21.15.12:47930) 2021-10-20T23:27:09.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bce2b8700 1 -- 172.21.15.12:0/363261965 learned_addr learned my addr 172.21.15.12:0/363261965 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bcdab7700 1 -- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc8060910 msgr2=0x7f6bc81374d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bcdab7700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc8060910 0x7f6bc81374d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bcdab7700 1 -- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bc80b6900 msgr2=0x7f6bc8156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bcdab7700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bc80b6900 0x7f6bc8156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bcdab7700 1 -- 172.21.15.12:0/363261965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009470 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bce2b8700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc8060910 0x7f6bc81374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bcdab7700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 0x7f6bc8155e80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f6bb8000ed0 tx=0x7f6bb8007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bb77fe700 1 -- 172.21.15.12:0/363261965 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bb8001d50 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bb77fe700 1 -- 172.21.15.12:0/363261965 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb80070d0 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc81222e0 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bb77fe700 1 -- 172.21.15.12:0/363261965 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bb8007430 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.415+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc80ae5d0 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.419+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc80619c0 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.419+0000 7f6bb77fe700 1 -- 172.21.15.12:0/363261965 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6bb8010070 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.419+0000 7f6bb77fe700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ba8053640 0x7f6ba8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.419+0000 7f6bb77fe700 1 -- 172.21.15.12:0/363261965 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f6bb806ace0 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.419+0000 7f6bce2b8700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ba8053640 0x7f6ba8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.419+0000 7f6bce2b8700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ba8053640 0x7f6ba8055b00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f6bc400b000 tx=0x7f6bc4006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.423+0000 7f6bb77fe700 1 -- 172.21.15.12:0/363261965 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6bb8041f10 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.547+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bc8057350 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.547+0000 7f6bb77fe700 1 -- 172.21.15.12:0/363261965 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f6bb8045530 con 0x7f6bc80aa5d0 2021-10-20T23:27:09.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:09.556 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":96,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:08.888517+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:09.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ba8053640 msgr2=0x7f6ba8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ba8053640 0x7f6ba8055b00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f6bc400b000 tx=0x7f6bc4006df0).stop 2021-10-20T23:27:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 msgr2=0x7f6bc8155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 0x7f6bc8155e80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f6bb8000ed0 tx=0x7f6bb8007c20).stop 2021-10-20T23:27:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 shutdown_connections 2021-10-20T23:27:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ba8053640 0x7f6ba8055b00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bc80b6900 0x7f6bc8156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bc80aa5d0 0x7f6bc8155e80 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 --2- 172.21.15.12:0/363261965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bc8060910 0x7f6bc81374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 >> 172.21.15.12:0/363261965 conn(0x7f6bc80b3480 msgr2=0x7f6bc80abe70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 shutdown_connections 2021-10-20T23:27:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.551+0000 7f6bd051c700 1 -- 172.21.15.12:0/363261965 wait complete. 2021-10-20T23:27:09.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:27:09.571 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:27:09.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9ecee700 1 Processor -- start 2021-10-20T23:27:09.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9ecee700 1 -- start start 2021-10-20T23:27:09.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9ecee700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee98061320 0x7fee98061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9ecee700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 0x7fee980b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9ecee700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee98140440 0x7fee981408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9ecee700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee980aecf0 con 0x7fee98061320 2021-10-20T23:27:09.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9ecee700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee980b6f20 con 0x7fee98140440 2021-10-20T23:27:09.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9ecee700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee980aef20 con 0x7fee980ad5c0 2021-10-20T23:27:09.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9dcec700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee98061320 0x7fee98061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9d4eb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 0x7fee980b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9e4ed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee98140440 0x7fee981408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9dcec700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee98061320 0x7fee98061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42182/0 (socket says 172.21.15.12:42182) 2021-10-20T23:27:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9dcec700 1 -- 172.21.15.12:0/3104050629 learned_addr learned my addr 172.21.15.12:0/3104050629 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9dcec700 1 -- 172.21.15.12:0/3104050629 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 msgr2=0x7fee980b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:09.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9dcec700 1 --2- 172.21.15.12:0/3104050629 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 0x7fee980b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9dcec700 1 -- 172.21.15.12:0/3104050629 >> v2:172.21.15.31:3300/0 conn(0x7fee98140440 msgr2=0x7fee981408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:09.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9dcec700 1 --2- 172.21.15.12:0/3104050629 >> v2:172.21.15.31:3300/0 conn(0x7fee98140440 0x7fee981408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.675+0000 7fee9dcec700 1 -- 172.21.15.12:0/3104050629 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980af1c0 con 0x7fee98061320 2021-10-20T23:27:09.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9dcec700 1 --2- 172.21.15.12:0/3104050629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 0x7fee98061700 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fee8c002f70 tx=0x7fee8c006eb0).ready entity=mon.0 client_cookie=51651841c2a4232b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ccea700 1 -- 172.21.15.12:0/3104050629 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8c00d570 con 0x7fee98061320 2021-10-20T23:27:09.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ccea700 1 -- 172.21.15.12:0/3104050629 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c000e90 con 0x7fee98061320 2021-10-20T23:27:09.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ccea700 1 -- 172.21.15.12:0/3104050629 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8c00d900 con 0x7fee98061320 2021-10-20T23:27:09.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 -- 172.21.15.12:0/3104050629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 msgr2=0x7fee98061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 --2- 172.21.15.12:0/3104050629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 0x7fee98061700 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fee8c002f70 tx=0x7fee8c006eb0).stop 2021-10-20T23:27:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 -- 172.21.15.12:0/3104050629 shutdown_connections 2021-10-20T23:27:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 --2- 172.21.15.12:0/3104050629 >> v2:172.21.15.31:3300/0 conn(0x7fee98140440 0x7fee981408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 --2- 172.21.15.12:0/3104050629 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 0x7fee980b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 --2- 172.21.15.12:0/3104050629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 0x7fee98061700 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 -- 172.21.15.12:0/3104050629 >> 172.21.15.12:0/3104050629 conn(0x7fee98066de0 msgr2=0x7fee980671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:09.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 -- 172.21.15.12:0/3104050629 shutdown_connections 2021-10-20T23:27:09.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 -- 172.21.15.12:0/3104050629 wait complete. 2021-10-20T23:27:09.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 Processor -- start 2021-10-20T23:27:09.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 -- start start 2021-10-20T23:27:09.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 0x7fee98155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 0x7fee980b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.679+0000 7fee9ecee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee98140440 0x7fee980b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9ecee700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee98144080 con 0x7fee98061320 2021-10-20T23:27:09.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9ecee700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee980b3bc0 con 0x7fee98140440 2021-10-20T23:27:09.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9ecee700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee980b0aa0 con 0x7fee980ad5c0 2021-10-20T23:27:09.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9dcec700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 0x7fee98155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9dcec700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 0x7fee98155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42186/0 (socket says 172.21.15.12:42186) 2021-10-20T23:27:09.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9e4ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee98140440 0x7fee980b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9dcec700 1 -- 172.21.15.12:0/266352198 learned_addr learned my addr 172.21.15.12:0/266352198 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9d4eb700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 0x7fee980b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9dcec700 1 -- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 msgr2=0x7fee980b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9dcec700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 0x7fee980b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9dcec700 1 -- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee98140440 msgr2=0x7fee980b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9dcec700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee98140440 0x7fee980b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9dcec700 1 -- 172.21.15.12:0/266352198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c00b1e0 con 0x7fee98061320 2021-10-20T23:27:09.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9dcec700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 0x7fee98155bc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fee8c002f70 tx=0x7fee8c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee8affd700 1 -- 172.21.15.12:0/266352198 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8c0117e0 con 0x7fee98061320 2021-10-20T23:27:09.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee980b3df0 con 0x7fee98061320 2021-10-20T23:27:09.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee8affd700 1 -- 172.21.15.12:0/266352198 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c011940 con 0x7fee98061320 2021-10-20T23:27:09.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee8affd700 1 -- 172.21.15.12:0/266352198 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8c011ca0 con 0x7fee98061320 2021-10-20T23:27:09.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee98156480 con 0x7fee98061320 2021-10-20T23:27:09.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee980af460 con 0x7fee98061320 2021-10-20T23:27:09.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.683+0000 7fee8affd700 1 -- 172.21.15.12:0/266352198 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee8c01a040 con 0x7fee98061320 2021-10-20T23:27:09.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.687+0000 7fee8affd700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee780535b0 0x7fee78055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.687+0000 7fee8affd700 1 -- 172.21.15.12:0/266352198 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fee8c06c690 con 0x7fee98061320 2021-10-20T23:27:09.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.687+0000 7fee9d4eb700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee780535b0 0x7fee78055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.687+0000 7fee9d4eb700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee780535b0 0x7fee78055a70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fee9400b000 tx=0x7fee94006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.691+0000 7fee8affd700 1 -- 172.21.15.12:0/266352198 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee8c043930 con 0x7fee98061320 2021-10-20T23:27:09.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fee980b1070 con 0x7fee98061320 2021-10-20T23:27:09.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee8affd700 1 -- 172.21.15.12:0/266352198 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v96) v1 ==== 110+0+10 (secure 0 0 0) 0x7fee8c023020 con 0x7fee98061320 2021-10-20T23:27:09.822 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:27:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee780535b0 msgr2=0x7fee78055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee780535b0 0x7fee78055a70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fee9400b000 tx=0x7fee94006df0).stop 2021-10-20T23:27:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 msgr2=0x7fee98155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 0x7fee98155bc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fee8c002f70 tx=0x7fee8c015000).stop 2021-10-20T23:27:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 shutdown_connections 2021-10-20T23:27:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee780535b0 0x7fee78055a70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee98140440 0x7fee980b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee980ad5c0 0x7fee980b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 --2- 172.21.15.12:0/266352198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee98061320 0x7fee98155bc0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 >> 172.21.15.12:0/266352198 conn(0x7fee98066de0 msgr2=0x7fee980671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 shutdown_connections 2021-10-20T23:27:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.815+0000 7fee9ecee700 1 -- 172.21.15.12:0/266352198 wait complete. 2021-10-20T23:27:09.840 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:27:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6e104700 1 Processor -- start 2021-10-20T23:27:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6e104700 1 -- start start 2021-10-20T23:27:09.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6e104700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b2580 0x7f6c6814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6e104700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c680b0010 0x7f6c6814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6e104700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c680a70c0 con 0x7f6c680afbd0 2021-10-20T23:27:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6e104700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c680a72f0 con 0x7f6c680b0010 2021-10-20T23:27:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6e104700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680a7590 con 0x7f6c680b2580 2021-10-20T23:27:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6d102700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b2580 0x7f6c6814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6d903700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6c680afbd0 0x7f6c680a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:47856/0 (socket says 172.21.15.12:47856) 2021-10-20T23:27:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6d903700 1 -- 172.21.15.12:0/2199315062 learned_addr learned my addr 172.21.15.12:0/2199315062 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6c901700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c680b0010 0x7f6c6814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c5bfff700 1 -- 172.21.15.12:0/2199315062 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459196278 0 0) 0x7f6c680a70c0 con 0x7f6c680afbd0 2021-10-20T23:27:09.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c5bfff700 1 -- 172.21.15.12:0/2199315062 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c4c003260 con 0x7f6c680afbd0 2021-10-20T23:27:09.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6d102700 1 -- 172.21.15.12:0/2199315062 >> v2:172.21.15.12:3300/0 conn(0x7f6c680b0010 msgr2=0x7f6c6814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:09.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6d102700 1 --2- 172.21.15.12:0/2199315062 >> v2:172.21.15.12:3300/0 conn(0x7f6c680b0010 0x7f6c6814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6d102700 1 -- 172.21.15.12:0/2199315062 >> v1:172.21.15.31:6789/0 conn(0x7f6c680afbd0 legacy=0x7f6c680a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.943+0000 7f6c6d102700 1 -- 172.21.15.12:0/2199315062 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c680a7830 con 0x7f6c680b2580 2021-10-20T23:27:09.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6d102700 1 --2- 172.21.15.12:0/2199315062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b2580 0x7f6c6814ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6c5c002f70 tx=0x7f6c5c006df0).ready entity=mon.2 client_cookie=afd6b78ab3ffaf17 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c5bfff700 1 -- 172.21.15.12:0/2199315062 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c5c00d4a0 con 0x7f6c680b2580 2021-10-20T23:27:09.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c5bfff700 1 -- 172.21.15.12:0/2199315062 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c000e90 con 0x7f6c680b2580 2021-10-20T23:27:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c5bfff700 1 -- 172.21.15.12:0/2199315062 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c5c00d7f0 con 0x7f6c680b2580 2021-10-20T23:27:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 -- 172.21.15.12:0/2199315062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b2580 msgr2=0x7f6c6814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 --2- 172.21.15.12:0/2199315062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b2580 0x7f6c6814ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6c5c002f70 tx=0x7f6c5c006df0).stop 2021-10-20T23:27:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 -- 172.21.15.12:0/2199315062 shutdown_connections 2021-10-20T23:27:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 --2- 172.21.15.12:0/2199315062 >> v2:172.21.15.12:3300/0 conn(0x7f6c680b0010 0x7f6c6814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 --2- 172.21.15.12:0/2199315062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b2580 0x7f6c6814ae40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 -- 172.21.15.12:0/2199315062 >> 172.21.15.12:0/2199315062 conn(0x7f6c68060180 msgr2=0x7f6c680b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:09.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 -- 172.21.15.12:0/2199315062 shutdown_connections 2021-10-20T23:27:09.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 -- 172.21.15.12:0/2199315062 wait complete. 2021-10-20T23:27:09.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 Processor -- start 2021-10-20T23:27:09.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.947+0000 7f6c6e104700 1 -- start start 2021-10-20T23:27:09.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6e104700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c680afbd0 0x7f6c68067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6e104700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b0010 0x7f6c68159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6e104700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c680b2580 0x7f6c68156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6e104700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6814d550 con 0x7f6c680b2580 2021-10-20T23:27:09.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6e104700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6814d7f0 con 0x7f6c680afbd0 2021-10-20T23:27:09.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6e104700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c681563c0 con 0x7f6c680b0010 2021-10-20T23:27:09.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d903700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c680b2580 0x7f6c68156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d903700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c680b2580 0x7f6c68156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42202/0 (socket says 172.21.15.12:42202) 2021-10-20T23:27:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d903700 1 -- 172.21.15.12:0/3740191149 learned_addr learned my addr 172.21.15.12:0/3740191149 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6c901700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b0010 0x7f6c68159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d102700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c680afbd0 0x7f6c68067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d903700 1 -- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b0010 msgr2=0x7f6c68159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d903700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b0010 0x7f6c68159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d903700 1 -- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c680afbd0 msgr2=0x7f6c68067680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d903700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c680afbd0 0x7f6c68067680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d903700 1 -- 172.21.15.12:0/3740191149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c00b180 con 0x7f6c680b2580 2021-10-20T23:27:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d102700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c680afbd0 0x7f6c68067680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6d903700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c680b2580 0x7f6c68156b00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f6c60001490 tx=0x7f6c60007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c5affd700 1 -- 172.21.15.12:0/3740191149 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c60005c70 con 0x7f6c680b2580 2021-10-20T23:27:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c5affd700 1 -- 172.21.15.12:0/3740191149 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c60005dd0 con 0x7f6c680b2580 2021-10-20T23:27:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c68156660 con 0x7f6c680b2580 2021-10-20T23:27:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c5affd700 1 -- 172.21.15.12:0/3740191149 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c600072c0 con 0x7f6c680b2580 2021-10-20T23:27:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c68156ff0 con 0x7f6c680b2580 2021-10-20T23:27:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c681567f0 con 0x7f6c680b2580 2021-10-20T23:27:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c5affd700 1 -- 172.21.15.12:0/3740191149 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c60010070 con 0x7f6c680b2580 2021-10-20T23:27:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.951+0000 7f6c5affd700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c440536f0 0x7f6c44055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.955+0000 7f6c5affd700 1 -- 172.21.15.12:0/3740191149 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f6c6006b180 con 0x7f6c680b2580 2021-10-20T23:27:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.955+0000 7f6c6d102700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c440536f0 0x7f6c44055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.955+0000 7f6c6d102700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c440536f0 0x7f6c44055bb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f6c5c018000 tx=0x7f6c5c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:09.959+0000 7f6c5affd700 1 -- 172.21.15.12:0/3740191149 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c60042460 con 0x7f6c680b2580 2021-10-20T23:27:10.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c68057350 con 0x7f6c680b2580 2021-10-20T23:27:10.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c5affd700 1 -- 172.21.15.12:0/3740191149 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c60045a80 con 0x7f6c680b2580 2021-10-20T23:27:10.094 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:10.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c440536f0 msgr2=0x7f6c44055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c440536f0 0x7f6c44055bb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f6c5c018000 tx=0x7f6c5c014000).stop 2021-10-20T23:27:10.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c680b2580 msgr2=0x7f6c68156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c680b2580 0x7f6c68156b00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f6c60001490 tx=0x7f6c60007da0).stop 2021-10-20T23:27:10.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 shutdown_connections 2021-10-20T23:27:10.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c440536f0 0x7f6c44055bb0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c680b2580 0x7f6c68156b00 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c680b0010 0x7f6c68159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 --2- 172.21.15.12:0/3740191149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c680afbd0 0x7f6c68067680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 >> 172.21.15.12:0/3740191149 conn(0x7f6c68060180 msgr2=0x7f6c68149700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:10.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.087+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 shutdown_connections 2021-10-20T23:27:10.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.091+0000 7f6c6e104700 1 -- 172.21.15.12:0/3740191149 wait complete. 2021-10-20T23:27:10.110 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:27:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f8385818700 1 Processor -- start 2021-10-20T23:27:10.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f8385818700 1 -- start start 2021-10-20T23:27:10.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f8385818700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f83800ad5c0 0x7f8380061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f8385818700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83800aecf0 con 0x7f8380061320 2021-10-20T23:27:10.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f8385818700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83800b6f20 con 0x7f8380140440 2021-10-20T23:27:10.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f8385818700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83800aef20 con 0x7f83800ad5c0 2021-10-20T23:27:10.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f8384816700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8380061320 0x7f83800b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40802/0 (socket says 172.21.15.12:40802) 2021-10-20T23:27:10.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f8384816700 1 -- 172.21.15.12:0/2818681540 learned_addr learned my addr 172.21.15.12:0/2818681540 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:10.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f837ffff700 1 --2- 172.21.15.12:0/2818681540 >> v2:172.21.15.12:3300/0 conn(0x7f83800ad5c0 0x7f8380061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f837f7fe700 1 -- 172.21.15.12:0/2818681540 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962540643 0 0) 0x7f83800aecf0 con 0x7f8380061320 2021-10-20T23:27:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.207+0000 7f837f7fe700 1 -- 172.21.15.12:0/2818681540 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8364003260 con 0x7f8380061320 2021-10-20T23:27:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f837ffff700 1 -- 172.21.15.12:0/2818681540 >> v1:172.21.15.31:6789/0 conn(0x7f8380140440 legacy=0x7f8380146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f837ffff700 1 -- 172.21.15.12:0/2818681540 >> v1:172.21.15.12:6789/0 conn(0x7f8380061320 legacy=0x7f83800b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f837ffff700 1 -- 172.21.15.12:0/2818681540 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800af1c0 con 0x7f83800ad5c0 2021-10-20T23:27:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f837ffff700 1 --2- 172.21.15.12:0/2818681540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83800ad5c0 0x7f8380061700 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f836c002f70 tx=0x7f836c006df0).ready entity=mon.0 client_cookie=c2e02a288a624197 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f837f7fe700 1 -- 172.21.15.12:0/2818681540 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836c00d610 con 0x7f83800ad5c0 2021-10-20T23:27:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f837f7fe700 1 -- 172.21.15.12:0/2818681540 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c000e90 con 0x7f83800ad5c0 2021-10-20T23:27:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f837f7fe700 1 -- 172.21.15.12:0/2818681540 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836c00d960 con 0x7f83800ad5c0 2021-10-20T23:27:10.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f8385818700 1 -- 172.21.15.12:0/2818681540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83800ad5c0 msgr2=0x7f8380061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f8385818700 1 --2- 172.21.15.12:0/2818681540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83800ad5c0 0x7f8380061700 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f836c002f70 tx=0x7f836c006df0).stop 2021-10-20T23:27:10.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f8385818700 1 -- 172.21.15.12:0/2818681540 shutdown_connections 2021-10-20T23:27:10.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f8385818700 1 --2- 172.21.15.12:0/2818681540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83800ad5c0 0x7f8380061700 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f8385818700 1 -- 172.21.15.12:0/2818681540 >> 172.21.15.12:0/2818681540 conn(0x7f8380066de0 msgr2=0x7f83800671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:10.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f8385818700 1 -- 172.21.15.12:0/2818681540 shutdown_connections 2021-10-20T23:27:10.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f8385818700 1 -- 172.21.15.12:0/2818681540 wait complete. 2021-10-20T23:27:10.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f8385818700 1 Processor -- start 2021-10-20T23:27:10.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.211+0000 7f8385818700 1 -- start start 2021-10-20T23:27:10.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385818700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380061320 0x7f83800b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385818700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83800ad5c0 0x7f83800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385818700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8380140440 0x7f83800aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385818700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380152d80 con 0x7f8380061320 2021-10-20T23:27:10.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385818700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380153020 con 0x7f83800ad5c0 2021-10-20T23:27:10.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385818700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83800afab0 con 0x7f8380140440 2021-10-20T23:27:10.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8384816700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380061320 0x7f83800b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8384816700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380061320 0x7f83800b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42214/0 (socket says 172.21.15.12:42214) 2021-10-20T23:27:10.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8384816700 1 -- 172.21.15.12:0/4000359613 learned_addr learned my addr 172.21.15.12:0/4000359613 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:10.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f837ffff700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83800ad5c0 0x7f83800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385017700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8380140440 0x7f83800aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8384816700 1 -- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8380140440 msgr2=0x7f83800aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8384816700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8380140440 0x7f83800aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8384816700 1 -- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83800ad5c0 msgr2=0x7f83800b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8384816700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83800ad5c0 0x7f83800b8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8384816700 1 -- 172.21.15.12:0/4000359613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c00b180 con 0x7f8380061320 2021-10-20T23:27:10.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8384816700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380061320 0x7f83800b0e50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f8374001110 tx=0x7f8374007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:10.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f837dffb700 1 -- 172.21.15.12:0/4000359613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83740072e0 con 0x7f8380061320 2021-10-20T23:27:10.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f837dffb700 1 -- 172.21.15.12:0/4000359613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374007440 con 0x7f8380061320 2021-10-20T23:27:10.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f837dffb700 1 -- 172.21.15.12:0/4000359613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8374005800 con 0x7f8380061320 2021-10-20T23:27:10.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83800b90f0 con 0x7f8380061320 2021-10-20T23:27:10.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83800ad080 con 0x7f8380061320 2021-10-20T23:27:10.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83801531e0 con 0x7f8380061320 2021-10-20T23:27:10.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f837dffb700 1 -- 172.21.15.12:0/4000359613 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8374010070 con 0x7f8380061320 2021-10-20T23:27:10.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.215+0000 7f837dffb700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8360053520 0x7f83600559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.219+0000 7f837dffb700 1 -- 172.21.15.12:0/4000359613 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f837406ae30 con 0x7f8380061320 2021-10-20T23:27:10.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.219+0000 7f837ffff700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8360053520 0x7f83600559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.219+0000 7f837ffff700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8360053520 0x7f83600559e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f836c018000 tx=0x7f836c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:10.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.219+0000 7f837dffb700 1 -- 172.21.15.12:0/4000359613 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8374042170 con 0x7f8380061320 2021-10-20T23:27:10.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.347+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f83800afc70 con 0x7f8380061320 2021-10-20T23:27:10.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f837dffb700 1 -- 172.21.15.12:0/4000359613 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v96) v1 ==== 84+0+143 (secure 0 0 0) 0x7f8374018070 con 0x7f8380061320 2021-10-20T23:27:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:10.357 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:27:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:27:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:27:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:27:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:27:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:27:10.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8360053520 msgr2=0x7f83600559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8360053520 0x7f83600559e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f836c018000 tx=0x7f836c014000).stop 2021-10-20T23:27:10.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380061320 msgr2=0x7f83800b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380061320 0x7f83800b0e50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f8374001110 tx=0x7f8374007ad0).stop 2021-10-20T23:27:10.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 shutdown_connections 2021-10-20T23:27:10.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8360053520 0x7f83600559e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8380140440 0x7f83800aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83800ad5c0 0x7f83800b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 --2- 172.21.15.12:0/4000359613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380061320 0x7f83800b0e50 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 >> 172.21.15.12:0/4000359613 conn(0x7f8380066de0 msgr2=0x7f8380145880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:10.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 shutdown_connections 2021-10-20T23:27:10.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.351+0000 7f8385818700 1 -- 172.21.15.12:0/4000359613 wait complete. 2021-10-20T23:27:10.369 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:27:10.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:27:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99915700 1 Processor -- start 2021-10-20T23:27:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99915700 1 -- start start 2021-10-20T23:27:10.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99915700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940aad80 0x7f0c94067300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99915700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c940ab160 0x7f0c94064800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99915700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0c94064cf0 0x7f0c940b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99915700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c94065960 con 0x7f0c94064cf0 2021-10-20T23:27:10.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99915700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c940b3ce0 con 0x7f0c940ab160 2021-10-20T23:27:10.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99915700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94066e60 con 0x7f0c940aad80 2021-10-20T23:27:10.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99114700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0c94064cf0 0x7f0c940b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99114700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0c94064cf0 0x7f0c940b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42226/0 (socket says 172.21.15.12:42226) 2021-10-20T23:27:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99114700 1 -- 172.21.15.12:0/2710739742 learned_addr learned my addr 172.21.15.12:0/2710739742 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c93fff700 1 --2- 172.21.15.12:0/2710739742 >> v2:172.21.15.31:3300/0 conn(0x7f0c940ab160 0x7f0c94064800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c98913700 1 --2- 172.21.15.12:0/2710739742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940aad80 0x7f0c94067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99114700 1 -- 172.21.15.12:0/2710739742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940aad80 msgr2=0x7f0c94067300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99114700 1 --2- 172.21.15.12:0/2710739742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940aad80 0x7f0c94067300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99114700 1 -- 172.21.15.12:0/2710739742 >> v2:172.21.15.31:3300/0 conn(0x7f0c940ab160 msgr2=0x7f0c94064800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:10.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99114700 1 --2- 172.21.15.12:0/2710739742 >> v2:172.21.15.31:3300/0 conn(0x7f0c940ab160 0x7f0c94064800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99114700 1 -- 172.21.15.12:0/2710739742 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940655e0 con 0x7f0c94064cf0 2021-10-20T23:27:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c99114700 1 --2- 172.21.15.12:0/2710739742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c94064cf0 0x7f0c940b7520 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f0c8c0032f0 tx=0x7f0c8c009290).ready entity=mon.0 client_cookie=6857fc9b2fb40914 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c937fe700 1 -- 172.21.15.12:0/2710739742 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c8c00b680 con 0x7f0c94064cf0 2021-10-20T23:27:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c937fe700 1 -- 172.21.15.12:0/2710739742 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c00b7e0 con 0x7f0c94064cf0 2021-10-20T23:27:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.471+0000 7f0c937fe700 1 -- 172.21.15.12:0/2710739742 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c8c00b950 con 0x7f0c94064cf0 2021-10-20T23:27:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 -- 172.21.15.12:0/2710739742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c94064cf0 msgr2=0x7f0c940b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 --2- 172.21.15.12:0/2710739742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c94064cf0 0x7f0c940b7520 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f0c8c0032f0 tx=0x7f0c8c009290).stop 2021-10-20T23:27:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 -- 172.21.15.12:0/2710739742 shutdown_connections 2021-10-20T23:27:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 --2- 172.21.15.12:0/2710739742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c94064cf0 0x7f0c940b7520 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 --2- 172.21.15.12:0/2710739742 >> v2:172.21.15.31:3300/0 conn(0x7f0c940ab160 0x7f0c94064800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 --2- 172.21.15.12:0/2710739742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940aad80 0x7f0c94067300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 -- 172.21.15.12:0/2710739742 >> 172.21.15.12:0/2710739742 conn(0x7f0c94062be0 msgr2=0x7f0c9405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:10.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 -- 172.21.15.12:0/2710739742 shutdown_connections 2021-10-20T23:27:10.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 -- 172.21.15.12:0/2710739742 wait complete. 2021-10-20T23:27:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 Processor -- start 2021-10-20T23:27:10.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.475+0000 7f0c99915700 1 -- start start 2021-10-20T23:27:10.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99915700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c940aad80 0x7f0c940b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99915700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940ab160 0x7f0c940b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99915700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c94138700 0x7f0c94138b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99915700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940b74d0 con 0x7f0c940aad80 2021-10-20T23:27:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99915700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940b8410 con 0x7f0c94138700 2021-10-20T23:27:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99915700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940ad080 con 0x7f0c940ab160 2021-10-20T23:27:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c98913700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c940aad80 0x7f0c940b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c98913700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c940aad80 0x7f0c940b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42228/0 (socket says 172.21.15.12:42228) 2021-10-20T23:27:10.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c98913700 1 -- 172.21.15.12:0/1876847631 learned_addr learned my addr 172.21.15.12:0/1876847631 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:10.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99114700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c94138700 0x7f0c94138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c93fff700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940ab160 0x7f0c940b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c98913700 1 -- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940ab160 msgr2=0x7f0c940b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c98913700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940ab160 0x7f0c940b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c98913700 1 -- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c94138700 msgr2=0x7f0c94138b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:10.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c98913700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c94138700 0x7f0c94138b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:10.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c98913700 1 -- 172.21.15.12:0/1876847631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c009530 con 0x7f0c940aad80 2021-10-20T23:27:10.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c93fff700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940ab160 0x7f0c940b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:10.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c98913700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c940aad80 0x7f0c940b1dd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f0c8800c000 tx=0x7f0c88006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:10.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c91ffb700 1 -- 172.21.15.12:0/1876847631 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c88010780 con 0x7f0c940aad80 2021-10-20T23:27:10.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c91ffb700 1 -- 172.21.15.12:0/1876847631 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c880108e0 con 0x7f0c940aad80 2021-10-20T23:27:10.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c940ad320 con 0x7f0c940aad80 2021-10-20T23:27:10.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c91ffb700 1 -- 172.21.15.12:0/1876847631 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c88010c40 con 0x7f0c940aad80 2021-10-20T23:27:10.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c940b0730 con 0x7f0c940aad80 2021-10-20T23:27:10.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c94139220 con 0x7f0c940aad80 2021-10-20T23:27:10.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.479+0000 7f0c91ffb700 1 -- 172.21.15.12:0/1876847631 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0c8801c460 con 0x7f0c940aad80 2021-10-20T23:27:10.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.483+0000 7f0c91ffb700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c74053610 0x7f0c74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:10.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.483+0000 7f0c91ffb700 1 -- 172.21.15.12:0/1876847631 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f0c8806bb70 con 0x7f0c940aad80 2021-10-20T23:27:10.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.483+0000 7f0c93fff700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c74053610 0x7f0c74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:10.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.483+0000 7f0c93fff700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c74053610 0x7f0c74055ad0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f0c84006000 tx=0x7f0c84008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:10.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.487+0000 7f0c91ffb700 1 -- 172.21.15.12:0/1876847631 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0c88042db0 con 0x7f0c940aad80 2021-10-20T23:27:10.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:10.611+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f0c94057350 con 0x7f0c940aad80 2021-10-20T23:27:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.223+0000 7f0c91ffb700 1 -- 172.21.15.12:0/1876847631 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v97) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0c880463d0 con 0x7f0c940aad80 2021-10-20T23:27:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c74053610 msgr2=0x7f0c74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c74053610 0x7f0c74055ad0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f0c84006000 tx=0x7f0c84008040).stop 2021-10-20T23:27:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c940aad80 msgr2=0x7f0c940b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c940aad80 0x7f0c940b1dd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f0c8800c000 tx=0x7f0c88006df0).stop 2021-10-20T23:27:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 shutdown_connections 2021-10-20T23:27:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0c74053610 0x7f0c74055ad0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c94138700 0x7f0c94138b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c940ab160 0x7f0c940b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 --2- 172.21.15.12:0/1876847631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c940aad80 0x7f0c940b1dd0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 >> 172.21.15.12:0/1876847631 conn(0x7f0c94062be0 msgr2=0x7f0c94139680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 shutdown_connections 2021-10-20T23:27:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.227+0000 7f0c99915700 1 -- 172.21.15.12:0/1876847631 wait complete. 2021-10-20T23:27:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:27:11.247 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:27:11.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6002ab3700 1 Processor -- start 2021-10-20T23:27:11.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6002ab3700 1 -- start start 2021-10-20T23:27:11.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6002ab3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ffc0b2600 0x7f5ffc05c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:11.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6002ab3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ffc13cb50 0x7f5ffc13cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6002ab3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc147020 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6002ab3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc0ad440 con 0x7f5ffc13cb50 2021-10-20T23:27:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6002ab3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc1472c0 con 0x7f5ffc0b2600 2021-10-20T23:27:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f60022b2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ffc13cb50 0x7f5ffc13cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f60022b2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ffc13cb50 0x7f5ffc13cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42240/0 (socket says 172.21.15.12:42240) 2021-10-20T23:27:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f60012b0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5ffc0b1e20 0x7f5ffc1436e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40832/0 (socket says 172.21.15.12:40832) 2021-10-20T23:27:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f60022b2700 1 -- 172.21.15.12:0/1193983916 learned_addr learned my addr 172.21.15.12:0/1193983916 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6001ab1700 1 --2- 172.21.15.12:0/1193983916 >> v2:172.21.15.31:3300/0 conn(0x7f5ffc0b2600 0x7f5ffc05c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6000aaf700 1 -- 172.21.15.12:0/1193983916 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711326315 0 0) 0x7f5ffc147020 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6000aaf700 1 -- 172.21.15.12:0/1193983916 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe4003260 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f60022b2700 1 -- 172.21.15.12:0/1193983916 >> v2:172.21.15.31:3300/0 conn(0x7f5ffc0b2600 msgr2=0x7f5ffc05c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:11.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f60022b2700 1 --2- 172.21.15.12:0/1193983916 >> v2:172.21.15.31:3300/0 conn(0x7f5ffc0b2600 0x7f5ffc05c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f60022b2700 1 -- 172.21.15.12:0/1193983916 >> v1:172.21.15.12:6789/0 conn(0x7f5ffc0b1e20 legacy=0x7f5ffc1436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:11.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f6000aaf700 1 -- 172.21.15.12:0/1193983916 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3791135915 0 0) 0x7f5fe4003260 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.351+0000 7f60022b2700 1 -- 172.21.15.12:0/1193983916 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc142fa0 con 0x7f5ffc13cb50 2021-10-20T23:27:11.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f60022b2700 1 --2- 172.21.15.12:0/1193983916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc13cb50 0x7f5ffc13cf30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f5ff8001800 tx=0x7f5ff4009290).ready entity=mon.0 client_cookie=566bdcb1ad1e40b3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:11.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6000aaf700 1 -- 172.21.15.12:0/1193983916 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff8001660 con 0x7f5ffc13cb50 2021-10-20T23:27:11.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6000aaf700 1 -- 172.21.15.12:0/1193983916 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff400b580 con 0x7f5ffc13cb50 2021-10-20T23:27:11.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6000aaf700 1 -- 172.21.15.12:0/1193983916 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff400b6f0 con 0x7f5ffc13cb50 2021-10-20T23:27:11.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 -- 172.21.15.12:0/1193983916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc13cb50 msgr2=0x7f5ffc13cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 --2- 172.21.15.12:0/1193983916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc13cb50 0x7f5ffc13cf30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f5ff8001800 tx=0x7f5ff4009290).stop 2021-10-20T23:27:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 -- 172.21.15.12:0/1193983916 shutdown_connections 2021-10-20T23:27:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 --2- 172.21.15.12:0/1193983916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc13cb50 0x7f5ffc13cf30 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 --2- 172.21.15.12:0/1193983916 >> v2:172.21.15.31:3300/0 conn(0x7f5ffc0b2600 0x7f5ffc05c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 -- 172.21.15.12:0/1193983916 >> 172.21.15.12:0/1193983916 conn(0x7f5ffc0611d0 msgr2=0x7f5ffc062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 -- 172.21.15.12:0/1193983916 shutdown_connections 2021-10-20T23:27:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 -- 172.21.15.12:0/1193983916 wait complete. 2021-10-20T23:27:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 Processor -- start 2021-10-20T23:27:11.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.355+0000 7f6002ab3700 1 -- start start 2021-10-20T23:27:11.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6002ab3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc0b1e20 0x7f5ffc13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:11.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6002ab3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ffc0b2600 0x7f5ffc0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:11.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6002ab3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc13cb50 0x7f5ffc1521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:11.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6002ab3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc153180 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6002ab3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0ab090 con 0x7f5ffc13cb50 2021-10-20T23:27:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6002ab3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0ab320 con 0x7f5ffc0b2600 2021-10-20T23:27:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6001ab1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc0b1e20 0x7f5ffc13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6001ab1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc0b1e20 0x7f5ffc13e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42242/0 (socket says 172.21.15.12:42242) 2021-10-20T23:27:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6001ab1700 1 -- 172.21.15.12:0/500812395 learned_addr learned my addr 172.21.15.12:0/500812395 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:11.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f60012b0700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ffc0b2600 0x7f5ffc0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:11.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f60022b2700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc13cb50 0x7f5ffc1521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:11.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6001ab1700 1 -- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ffc0b2600 msgr2=0x7f5ffc0aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:11.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6001ab1700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ffc0b2600 0x7f5ffc0aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6001ab1700 1 -- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc13cb50 msgr2=0x7f5ffc1521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6001ab1700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc13cb50 0x7f5ffc1521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6001ab1700 1 -- 172.21.15.12:0/500812395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff4009530 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f60022b2700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc13cb50 0x7f5ffc1521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:11.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6001ab1700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc0b1e20 0x7f5ffc13e220 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f5fec00c000 tx=0x7f5fec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:11.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f5feaffd700 1 -- 172.21.15.12:0/500812395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fec010780 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f5feaffd700 1 -- 172.21.15.12:0/500812395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec0108e0 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc155900 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f5feaffd700 1 -- 172.21.15.12:0/500812395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fec010c40 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.359+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc1526a0 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.363+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc13ee60 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.363+0000 7f5feaffd700 1 -- 172.21.15.12:0/500812395 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5fec01c460 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.363+0000 7f5feaffd700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5fdc0535b0 0x7f5fdc055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:11.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.363+0000 7f5feaffd700 1 -- 172.21.15.12:0/500812395 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f5fec06be80 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.363+0000 7f60012b0700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5fdc0535b0 0x7f5fdc055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:11.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.363+0000 7f60012b0700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5fdc0535b0 0x7f5fdc055a70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f5ff800d000 tx=0x7f5ff8001a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:11.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.367+0000 7f5feaffd700 1 -- 172.21.15.12:0/500812395 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ffc13ee60 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.503+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f5ffc13ee60 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.891+0000 7f5feaffd700 1 -- 172.21.15.12:0/500812395 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v98) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5ffc13ee60 con 0x7f5ffc0b1e20 2021-10-20T23:27:11.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5fdc0535b0 msgr2=0x7f5fdc055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:11.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5fdc0535b0 0x7f5fdc055a70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f5ff800d000 tx=0x7f5ff8001a80).stop 2021-10-20T23:27:11.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc0b1e20 msgr2=0x7f5ffc13e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:11.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc0b1e20 0x7f5ffc13e220 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f5fec00c000 tx=0x7f5fec006df0).stop 2021-10-20T23:27:11.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 shutdown_connections 2021-10-20T23:27:11.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5fdc0535b0 0x7f5fdc055a70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc13cb50 0x7f5ffc1521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ffc0b2600 0x7f5ffc0aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 --2- 172.21.15.12:0/500812395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ffc0b1e20 0x7f5ffc13e220 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:11.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 >> 172.21.15.12:0/500812395 conn(0x7f5ffc0611d0 msgr2=0x7f5ffc0b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:11.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 shutdown_connections 2021-10-20T23:27:11.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:11.895+0000 7f6002ab3700 1 -- 172.21.15.12:0/500812395 wait complete. 2021-10-20T23:27:11.907 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:27:11.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:27:12.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.011+0000 7fef2f59e700 1 Processor -- start 2021-10-20T23:27:12.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.011+0000 7fef2f59e700 1 -- start start 2021-10-20T23:27:12.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300b3040 0x7fef30065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fef300a9c10 0x7fef300607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef30143320 0x7fef301437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef300648e0 con 0x7fef30143320 2021-10-20T23:27:12.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef30061dd0 con 0x7fef300a9c10 2021-10-20T23:27:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef30066ea0 con 0x7fef300b3040 2021-10-20T23:27:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef30143320 0x7fef301437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef30143320 0x7fef301437b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42254/0 (socket says 172.21.15.12:42254) 2021-10-20T23:27:12.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2ed9d700 1 -- 172.21.15.12:0/1024002751 learned_addr learned my addr 172.21.15.12:0/1024002751 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:12.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2dd9b700 1 --2- 172.21.15.12:0/1024002751 >> v2:172.21.15.31:3300/0 conn(0x7fef300a9c10 0x7fef300607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2e59c700 1 --2- 172.21.15.12:0/1024002751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300b3040 0x7fef30065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2ed9d700 1 -- 172.21.15.12:0/1024002751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300b3040 msgr2=0x7fef30065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:12.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2ed9d700 1 --2- 172.21.15.12:0/1024002751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300b3040 0x7fef30065e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2ed9d700 1 -- 172.21.15.12:0/1024002751 >> v2:172.21.15.31:3300/0 conn(0x7fef300a9c10 msgr2=0x7fef300607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:12.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2ed9d700 1 --2- 172.21.15.12:0/1024002751 >> v2:172.21.15.31:3300/0 conn(0x7fef300a9c10 0x7fef300607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2ed9d700 1 -- 172.21.15.12:0/1024002751 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300b3420 con 0x7fef30143320 2021-10-20T23:27:12.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2dd9b700 1 --2- 172.21.15.12:0/1024002751 >> v2:172.21.15.31:3300/0 conn(0x7fef300a9c10 0x7fef300607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:12.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2e59c700 1 --2- 172.21.15.12:0/1024002751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300b3040 0x7fef30065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:27:12.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2ed9d700 1 --2- 172.21.15.12:0/1024002751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 0x7fef301437b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fef200032f0 tx=0x7fef20009290).ready entity=mon.0 client_cookie=87668d7c1e0db046 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2d59a700 1 -- 172.21.15.12:0/1024002751 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2000b870 con 0x7fef30143320 2021-10-20T23:27:12.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2d59a700 1 -- 172.21.15.12:0/1024002751 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2000b9d0 con 0x7fef30143320 2021-10-20T23:27:12.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2d59a700 1 -- 172.21.15.12:0/1024002751 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2000bb40 con 0x7fef30143320 2021-10-20T23:27:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 -- 172.21.15.12:0/1024002751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 msgr2=0x7fef301437b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 --2- 172.21.15.12:0/1024002751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 0x7fef301437b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fef200032f0 tx=0x7fef20009290).stop 2021-10-20T23:27:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 -- 172.21.15.12:0/1024002751 shutdown_connections 2021-10-20T23:27:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 --2- 172.21.15.12:0/1024002751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 0x7fef301437b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 --2- 172.21.15.12:0/1024002751 >> v2:172.21.15.31:3300/0 conn(0x7fef300a9c10 0x7fef300607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 --2- 172.21.15.12:0/1024002751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300b3040 0x7fef30065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 -- 172.21.15.12:0/1024002751 >> 172.21.15.12:0/1024002751 conn(0x7fef300636e0 msgr2=0x7fef30063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 -- 172.21.15.12:0/1024002751 shutdown_connections 2021-10-20T23:27:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.015+0000 7fef2f59e700 1 -- 172.21.15.12:0/1024002751 wait complete. 2021-10-20T23:27:12.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 Processor -- start 2021-10-20T23:27:12.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 -- start start 2021-10-20T23:27:12.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300a9c10 0x7fef300aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300b3040 0x7fef300ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 0x7fef300ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300ad4d0 con 0x7fef30143320 2021-10-20T23:27:12.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300b57d0 con 0x7fef300b3040 2021-10-20T23:27:12.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef30137330 con 0x7fef300a9c10 2021-10-20T23:27:12.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 0x7fef300ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 0x7fef300ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42258/0 (socket says 172.21.15.12:42258) 2021-10-20T23:27:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2ed9d700 1 -- 172.21.15.12:0/190901024 learned_addr learned my addr 172.21.15.12:0/190901024 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2e59c700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300a9c10 0x7fef300aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2dd9b700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300b3040 0x7fef300ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2ed9d700 1 -- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300a9c10 msgr2=0x7fef300aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2ed9d700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300a9c10 0x7fef300aa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2ed9d700 1 -- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300b3040 msgr2=0x7fef300ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2ed9d700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300b3040 0x7fef300ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2ed9d700 1 -- 172.21.15.12:0/190901024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef20009530 con 0x7fef30143320 2021-10-20T23:27:12.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2dd9b700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300b3040 0x7fef300ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:12.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2ed9d700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 0x7fef300ae570 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fef300ad610 tx=0x7fef20016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef277fe700 1 -- 172.21.15.12:0/190901024 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2000b870 con 0x7fef30143320 2021-10-20T23:27:12.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef277fe700 1 -- 172.21.15.12:0/190901024 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef20020430 con 0x7fef30143320 2021-10-20T23:27:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef300b5a00 con 0x7fef30143320 2021-10-20T23:27:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef277fe700 1 -- 172.21.15.12:0/190901024 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef20020790 con 0x7fef30143320 2021-10-20T23:27:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.019+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef300aa850 con 0x7fef30143320 2021-10-20T23:27:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.023+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef30066960 con 0x7fef30143320 2021-10-20T23:27:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.023+0000 7fef277fe700 1 -- 172.21.15.12:0/190901024 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef20028070 con 0x7fef30143320 2021-10-20T23:27:12.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.023+0000 7fef277fe700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef140534f0 0x7fef140559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.023+0000 7fef277fe700 1 -- 172.21.15.12:0/190901024 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fef20047480 con 0x7fef30143320 2021-10-20T23:27:12.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.023+0000 7fef2e59c700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef140534f0 0x7fef140559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.023+0000 7fef2e59c700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef140534f0 0x7fef140559b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fef2800d000 tx=0x7fef28008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.031+0000 7fef277fe700 1 -- 172.21.15.12:0/190901024 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef20043820 con 0x7fef30143320 2021-10-20T23:27:12.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.195+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fef30057350 con 0x7fef30143320 2021-10-20T23:27:12.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.207+0000 7fef277fe700 1 -- 172.21.15.12:0/190901024 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v48) v1 ==== 189+0+0 (secure 0 0 0) 0x7fef20046e40 con 0x7fef30143320 2021-10-20T23:27:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef140534f0 msgr2=0x7fef140559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef140534f0 0x7fef140559b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fef2800d000 tx=0x7fef28008040).stop 2021-10-20T23:27:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 msgr2=0x7fef300ae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 0x7fef300ae570 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fef300ad610 tx=0x7fef20016000).stop 2021-10-20T23:27:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 shutdown_connections 2021-10-20T23:27:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef140534f0 0x7fef140559b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef30143320 0x7fef300ae570 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300b3040 0x7fef300ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 --2- 172.21.15.12:0/190901024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef300a9c10 0x7fef300aa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 >> 172.21.15.12:0/190901024 conn(0x7fef300636e0 msgr2=0x7fef30141760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 shutdown_connections 2021-10-20T23:27:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.211+0000 7fef2f59e700 1 -- 172.21.15.12:0/190901024 wait complete. 2021-10-20T23:27:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 17 and data pool 18 2021-10-20T23:27:12.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:12.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.319+0000 7f2a9f59e700 1 Processor -- start 2021-10-20T23:27:12.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.319+0000 7f2a9f59e700 1 -- start start 2021-10-20T23:27:12.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2aa00b30d0 0x7f2aa0143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2aa00ace70 0x7f2aa013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9f59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa0143920 con 0x7f2aa00b0710 2021-10-20T23:27:12.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00b0af0 con 0x7f2aa00ace70 2021-10-20T23:27:12.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00ae680 con 0x7f2aa00b30d0 2021-10-20T23:27:12.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2aa00ace70 0x7f2aa013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2aa00ace70 0x7f2aa013f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42270/0 (socket says 172.21.15.12:42270) 2021-10-20T23:27:12.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9ed9d700 1 -- 172.21.15.12:0/1822129466 learned_addr learned my addr 172.21.15.12:0/1822129466 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:12.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a97fff700 1 --2- 172.21.15.12:0/1822129466 >> v2:172.21.15.31:3300/0 conn(0x7f2aa00b30d0 0x7f2aa0143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9ed9d700 1 -- 172.21.15.12:0/1822129466 >> v2:172.21.15.31:3300/0 conn(0x7f2aa00b30d0 msgr2=0x7f2aa0143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9ed9d700 1 --2- 172.21.15.12:0/1822129466 >> v2:172.21.15.31:3300/0 conn(0x7f2aa00b30d0 0x7f2aa0143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9ed9d700 1 -- 172.21.15.12:0/1822129466 >> v1:172.21.15.31:6789/0 conn(0x7f2aa00b0710 legacy=0x7f2aa0142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9ed9d700 1 -- 172.21.15.12:0/1822129466 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00ae920 con 0x7f2aa00ace70 2021-10-20T23:27:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9ed9d700 1 --2- 172.21.15.12:0/1822129466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 0x7f2aa013f8a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f2a980032f0 tx=0x7f2a9800b530).ready entity=mon.0 client_cookie=782b34ec5894155f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9dd9b700 1 -- 172.21.15.12:0/1822129466 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9800ddf0 con 0x7f2aa00ace70 2021-10-20T23:27:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9dd9b700 1 -- 172.21.15.12:0/1822129466 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a98010470 con 0x7f2aa00ace70 2021-10-20T23:27:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.323+0000 7f2a9dd9b700 1 -- 172.21.15.12:0/1822129466 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a980107d0 con 0x7f2aa00ace70 2021-10-20T23:27:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1822129466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 msgr2=0x7f2aa013f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 --2- 172.21.15.12:0/1822129466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 0x7f2aa013f8a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f2a980032f0 tx=0x7f2a9800b530).stop 2021-10-20T23:27:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1822129466 shutdown_connections 2021-10-20T23:27:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 --2- 172.21.15.12:0/1822129466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 0x7f2aa013f8a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 --2- 172.21.15.12:0/1822129466 >> v2:172.21.15.31:3300/0 conn(0x7f2aa00b30d0 0x7f2aa0143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1822129466 >> 172.21.15.12:0/1822129466 conn(0x7f2aa0061140 msgr2=0x7f2aa0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:12.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1822129466 shutdown_connections 2021-10-20T23:27:12.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1822129466 wait complete. 2021-10-20T23:27:12.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 Processor -- start 2021-10-20T23:27:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 -- start start 2021-10-20T23:27:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 0x7f2aa0067580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2aa00b0710 0x7f2aa00a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2aa00b30d0 0x7f2aa00a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0066d50 con 0x7f2aa00ace70 2021-10-20T23:27:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0066ff0 con 0x7f2aa00b30d0 2021-10-20T23:27:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.327+0000 7f2a9f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00659c0 con 0x7f2aa00b0710 2021-10-20T23:27:12.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 0x7f2aa0067580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 0x7f2aa0067580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42272/0 (socket says 172.21.15.12:42272) 2021-10-20T23:27:12.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9e59c700 1 -- 172.21.15.12:0/1560755039 learned_addr learned my addr 172.21.15.12:0/1560755039 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:12.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a97fff700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2aa00b0710 0x7f2aa00a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9ed9d700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2aa00b30d0 0x7f2aa00a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9e59c700 1 -- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2aa00b0710 msgr2=0x7f2aa00a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9e59c700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2aa00b0710 0x7f2aa00a85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9e59c700 1 -- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2aa00b30d0 msgr2=0x7f2aa00a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9e59c700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2aa00b30d0 0x7f2aa00a8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9e59c700 1 -- 172.21.15.12:0/1560755039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9800b7d0 con 0x7f2aa00ace70 2021-10-20T23:27:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9ed9d700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2aa00b30d0 0x7f2aa00a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9e59c700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 0x7f2aa0067580 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f2aa00b6a40 tx=0x7f2a90007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a977fe700 1 -- 172.21.15.12:0/1560755039 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a90012400 con 0x7f2aa00ace70 2021-10-20T23:27:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a977fe700 1 -- 172.21.15.12:0/1560755039 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a90012560 con 0x7f2aa00ace70 2021-10-20T23:27:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa0065c60 con 0x7f2aa00ace70 2021-10-20T23:27:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a977fe700 1 -- 172.21.15.12:0/1560755039 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a900128c0 con 0x7f2aa00ace70 2021-10-20T23:27:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa00a8fd0 con 0x7f2aa00ace70 2021-10-20T23:27:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa0065df0 con 0x7f2aa00ace70 2021-10-20T23:27:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a977fe700 1 -- 172.21.15.12:0/1560755039 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a90010070 con 0x7f2aa00ace70 2021-10-20T23:27:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a977fe700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2a84053610 0x7f2a84055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a977fe700 1 -- 172.21.15.12:0/1560755039 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2a9006ab80 con 0x7f2aa00ace70 2021-10-20T23:27:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.331+0000 7f2a97fff700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2a84053610 0x7f2a84055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.335+0000 7f2a97fff700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2a84053610 0x7f2a84055ad0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f2a8800b000 tx=0x7f2a88006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.339+0000 7f2a977fe700 1 -- 172.21.15.12:0/1560755039 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a90041ae0 con 0x7f2aa00ace70 2021-10-20T23:27:12.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.467+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2aa0057350 con 0x7f2aa00ace70 2021-10-20T23:27:12.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.467+0000 7f2a977fe700 1 -- 172.21.15.12:0/1560755039 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16290 (secure 0 0 0) 0x7f2a90045100 con 0x7f2aa00ace70 2021-10-20T23:27:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:12.476 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":100,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:12.198460+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:10.667132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:11.561636+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:12.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2a84053610 msgr2=0x7f2a84055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2a84053610 0x7f2a84055ad0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f2a8800b000 tx=0x7f2a88006df0).stop 2021-10-20T23:27:12.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 msgr2=0x7f2aa0067580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 0x7f2aa0067580 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f2aa00b6a40 tx=0x7f2a90007c50).stop 2021-10-20T23:27:12.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 shutdown_connections 2021-10-20T23:27:12.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2a84053610 0x7f2a84055ad0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2aa00b30d0 0x7f2aa00a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2aa00b0710 0x7f2aa00a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 --2- 172.21.15.12:0/1560755039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa00ace70 0x7f2aa0067580 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 >> 172.21.15.12:0/1560755039 conn(0x7f2aa0061140 msgr2=0x7f2aa0142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:12.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 shutdown_connections 2021-10-20T23:27:12.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.471+0000 7f2a9f59e700 1 -- 172.21.15.12:0/1560755039 wait complete. 2021-10-20T23:27:12.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:12.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f2170c8d700 1 Processor -- start 2021-10-20T23:27:12.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f2170c8d700 1 -- start start 2021-10-20T23:27:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f2170c8d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 0x7f216c065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f2170c8d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f216c0a9c10 0x7f216c0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f2170c8d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c066ea0 con 0x7f216c143320 2021-10-20T23:27:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f2170c8d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c0648e0 con 0x7f216c0a9c10 2021-10-20T23:27:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f2170c8d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c061dd0 con 0x7f216c0b3040 2021-10-20T23:27:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f216bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f216c143320 0x7f216c1437b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40878/0 (socket says 172.21.15.12:40878) 2021-10-20T23:27:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f216bfff700 1 -- 172.21.15.12:0/4028546022 learned_addr learned my addr 172.21.15.12:0/4028546022 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f216b7fe700 1 --2- 172.21.15.12:0/4028546022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 0x7f216c065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.587+0000 7f2162ffd700 1 --2- 172.21.15.12:0/4028546022 >> v2:172.21.15.31:3300/0 conn(0x7f216c0a9c10 0x7f216c0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f216affd700 1 -- 172.21.15.12:0/4028546022 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538413392 0 0) 0x7f216c066ea0 con 0x7f216c143320 2021-10-20T23:27:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f216affd700 1 -- 172.21.15.12:0/4028546022 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c003260 con 0x7f216c143320 2021-10-20T23:27:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2162ffd700 1 -- 172.21.15.12:0/4028546022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 msgr2=0x7f216c065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2162ffd700 1 --2- 172.21.15.12:0/4028546022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 0x7f216c065e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2162ffd700 1 -- 172.21.15.12:0/4028546022 >> v1:172.21.15.12:6789/0 conn(0x7f216c143320 legacy=0x7f216c1437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2162ffd700 1 -- 172.21.15.12:0/4028546022 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0b3420 con 0x7f216c0a9c10 2021-10-20T23:27:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2162ffd700 1 --2- 172.21.15.12:0/4028546022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f216c0a9c10 0x7f216c0607c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f2154002f70 tx=0x7f2154006df0).ready entity=mon.1 client_cookie=1aa49eae70c986ec server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f216affd700 1 -- 172.21.15.12:0/4028546022 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f215400d4a0 con 0x7f216c0a9c10 2021-10-20T23:27:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f216affd700 1 -- 172.21.15.12:0/4028546022 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2154000e90 con 0x7f216c0a9c10 2021-10-20T23:27:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f216affd700 1 -- 172.21.15.12:0/4028546022 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f215400d830 con 0x7f216c0a9c10 2021-10-20T23:27:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2170c8d700 1 -- 172.21.15.12:0/4028546022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f216c0a9c10 msgr2=0x7f216c0607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2170c8d700 1 --2- 172.21.15.12:0/4028546022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f216c0a9c10 0x7f216c0607c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f2154002f70 tx=0x7f2154006df0).stop 2021-10-20T23:27:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2170c8d700 1 -- 172.21.15.12:0/4028546022 shutdown_connections 2021-10-20T23:27:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2170c8d700 1 --2- 172.21.15.12:0/4028546022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f216c0a9c10 0x7f216c0607c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2170c8d700 1 --2- 172.21.15.12:0/4028546022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 0x7f216c065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2170c8d700 1 -- 172.21.15.12:0/4028546022 >> 172.21.15.12:0/4028546022 conn(0x7f216c0636e0 msgr2=0x7f216c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2170c8d700 1 -- 172.21.15.12:0/4028546022 shutdown_connections 2021-10-20T23:27:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.591+0000 7f2170c8d700 1 -- 172.21.15.12:0/4028546022 wait complete. 2021-10-20T23:27:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 Processor -- start 2021-10-20T23:27:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 -- start start 2021-10-20T23:27:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f216c0a9c10 0x7f216c13dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 0x7f216c1377a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c143320 0x7f216c137c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c13cba0 con 0x7f216c143320 2021-10-20T23:27:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b5710 con 0x7f216c0a9c10 2021-10-20T23:27:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b4f70 con 0x7f216c0b3040 2021-10-20T23:27:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c143320 0x7f216c137c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2162ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 0x7f216c1377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c143320 0x7f216c137c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42290/0 (socket says 172.21.15.12:42290) 2021-10-20T23:27:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216bfff700 1 -- 172.21.15.12:0/1806343551 learned_addr learned my addr 172.21.15.12:0/1806343551 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f216c0a9c10 0x7f216c13dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216bfff700 1 -- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 msgr2=0x7f216c1377a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216bfff700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 0x7f216c1377a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216bfff700 1 -- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f216c0a9c10 msgr2=0x7f216c13dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216bfff700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f216c0a9c10 0x7f216c13dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216bfff700 1 -- 172.21.15.12:0/1806343551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215400b180 con 0x7f216c143320 2021-10-20T23:27:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f216bfff700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c143320 0x7f216c137c90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f2164001490 tx=0x7f2164007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f21697fa700 1 -- 172.21.15.12:0/1806343551 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2164005ba0 con 0x7f216c143320 2021-10-20T23:27:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f21697fa700 1 -- 172.21.15.12:0/1806343551 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164005d00 con 0x7f216c143320 2021-10-20T23:27:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c13d620 con 0x7f216c143320 2021-10-20T23:27:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f21697fa700 1 -- 172.21.15.12:0/1806343551 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21640072c0 con 0x7f216c143320 2021-10-20T23:27:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.595+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c0b4cf0 con 0x7f216c143320 2021-10-20T23:27:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.599+0000 7f21697fa700 1 -- 172.21.15.12:0/1806343551 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f216401a060 con 0x7f216c143320 2021-10-20T23:27:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.599+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c066960 con 0x7f216c143320 2021-10-20T23:27:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.599+0000 7f21697fa700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21500534f0 0x7f21500559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.599+0000 7f21697fa700 1 -- 172.21.15.12:0/1806343551 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f216406b4c0 con 0x7f216c143320 2021-10-20T23:27:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.599+0000 7f216b7fe700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21500534f0 0x7f21500559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.599+0000 7f216b7fe700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21500534f0 0x7f21500559b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f215c00a000 tx=0x7f215c006e80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.603+0000 7f21697fa700 1 -- 172.21.15.12:0/1806343551 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f21640424c0 con 0x7f216c143320 2021-10-20T23:27:12.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.731+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f216c057350 con 0x7f216c143320 2021-10-20T23:27:12.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f21697fa700 1 -- 172.21.15.12:0/1806343551 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16290 (secure 0 0 0) 0x7f2164018070 con 0x7f216c143320 2021-10-20T23:27:12.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:12.741 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":100,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:12.198460+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:10.667132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:11.561636+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:12.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21500534f0 msgr2=0x7f21500559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21500534f0 0x7f21500559b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f215c00a000 tx=0x7f215c006e80).stop 2021-10-20T23:27:12.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c143320 msgr2=0x7f216c137c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c143320 0x7f216c137c90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f2164001490 tx=0x7f2164007e00).stop 2021-10-20T23:27:12.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 shutdown_connections 2021-10-20T23:27:12.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f21500534f0 0x7f21500559b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c143320 0x7f216c137c90 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f216c0b3040 0x7f216c1377a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 --2- 172.21.15.12:0/1806343551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f216c0a9c10 0x7f216c13dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 >> 172.21.15.12:0/1806343551 conn(0x7f216c0636e0 msgr2=0x7f216c0603d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:12.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 shutdown_connections 2021-10-20T23:27:12.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.735+0000 7f2170c8d700 1 -- 172.21.15.12:0/1806343551 wait complete. 2021-10-20T23:27:12.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:27:12.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.859+0000 7f00698a0700 1 Processor -- start 2021-10-20T23:27:12.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.859+0000 7f00698a0700 1 -- start start 2021-10-20T23:27:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.859+0000 7f00698a0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f00640b2580 0x7f006414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.859+0000 7f00698a0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00640a8ac0 0x7f006414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.859+0000 7f00698a0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640a70c0 con 0x7f00640b0010 2021-10-20T23:27:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640a72f0 con 0x7f00640b2580 2021-10-20T23:27:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640a7590 con 0x7f00640a8ac0 2021-10-20T23:27:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f006889e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f00640b2580 0x7f006414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f0063fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f00640b0010 0x7f00640a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40890/0 (socket says 172.21.15.12:40890) 2021-10-20T23:27:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f0063fff700 1 -- 172.21.15.12:0/2929150547 learned_addr learned my addr 172.21.15.12:0/2929150547 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:12.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f006889e700 1 --2- 172.21.15.12:0/2929150547 >> v2:172.21.15.12:3300/0 conn(0x7f00640b2580 0x7f006414ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42294/0 (socket says 172.21.15.12:42294) 2021-10-20T23:27:12.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f006909f700 1 --2- 172.21.15.12:0/2929150547 >> v2:172.21.15.31:3300/0 conn(0x7f00640a8ac0 0x7f006414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f006889e700 1 -- 172.21.15.12:0/2929150547 >> v2:172.21.15.31:3300/0 conn(0x7f00640a8ac0 msgr2=0x7f006414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:12.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f006889e700 1 --2- 172.21.15.12:0/2929150547 >> v2:172.21.15.31:3300/0 conn(0x7f00640a8ac0 0x7f006414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f006889e700 1 -- 172.21.15.12:0/2929150547 >> v1:172.21.15.12:6789/0 conn(0x7f00640b0010 legacy=0x7f00640a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f006889e700 1 -- 172.21.15.12:0/2929150547 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640a7830 con 0x7f00640b2580 2021-10-20T23:27:12.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f006889e700 1 --2- 172.21.15.12:0/2929150547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b2580 0x7f006414ae40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f004c002f70 tx=0x7f004c006df0).ready entity=mon.0 client_cookie=fb27bba46e853ecf server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00637fe700 1 -- 172.21.15.12:0/2929150547 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004c00d5c0 con 0x7f00640b2580 2021-10-20T23:27:12.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00637fe700 1 -- 172.21.15.12:0/2929150547 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c000e90 con 0x7f00640b2580 2021-10-20T23:27:12.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00637fe700 1 -- 172.21.15.12:0/2929150547 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004c00d910 con 0x7f00640b2580 2021-10-20T23:27:12.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 -- 172.21.15.12:0/2929150547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b2580 msgr2=0x7f006414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 --2- 172.21.15.12:0/2929150547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b2580 0x7f006414ae40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f004c002f70 tx=0x7f004c006df0).stop 2021-10-20T23:27:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 -- 172.21.15.12:0/2929150547 shutdown_connections 2021-10-20T23:27:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 --2- 172.21.15.12:0/2929150547 >> v2:172.21.15.31:3300/0 conn(0x7f00640a8ac0 0x7f006414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 --2- 172.21.15.12:0/2929150547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b2580 0x7f006414ae40 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 -- 172.21.15.12:0/2929150547 >> 172.21.15.12:0/2929150547 conn(0x7f0064060180 msgr2=0x7f00640b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 -- 172.21.15.12:0/2929150547 shutdown_connections 2021-10-20T23:27:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 -- 172.21.15.12:0/2929150547 wait complete. 2021-10-20T23:27:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 Processor -- start 2021-10-20T23:27:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.863+0000 7f00698a0700 1 -- start start 2021-10-20T23:27:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f00698a0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00640a8ac0 0x7f006415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f00698a0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b0010 0x7f0064156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f00698a0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00640b2580 0x7f00640ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f00698a0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0064145fe0 con 0x7f00640b0010 2021-10-20T23:27:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f00698a0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006411e3a0 con 0x7f00640a8ac0 2021-10-20T23:27:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f00698a0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0064159ad0 con 0x7f00640b2580 2021-10-20T23:27:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0063fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b0010 0x7f0064156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0063fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b0010 0x7f0064156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42302/0 (socket says 172.21.15.12:42302) 2021-10-20T23:27:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0063fff700 1 -- 172.21.15.12:0/1051435888 learned_addr learned my addr 172.21.15.12:0/1051435888 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f006889e700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00640a8ac0 0x7f006415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f006909f700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00640b2580 0x7f00640ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0063fff700 1 -- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00640b2580 msgr2=0x7f00640ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0063fff700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00640b2580 0x7f00640ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0063fff700 1 -- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00640a8ac0 msgr2=0x7f006415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0063fff700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00640a8ac0 0x7f006415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0063fff700 1 -- 172.21.15.12:0/1051435888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c00b180 con 0x7f00640b0010 2021-10-20T23:27:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f006909f700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00640b2580 0x7f00640ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f006889e700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00640a8ac0 0x7f006415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0063fff700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b0010 0x7f0064156460 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f006406b7c0 tx=0x7f0054007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0061ffb700 1 -- 172.21.15.12:0/1051435888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0054005ba0 con 0x7f00640b0010 2021-10-20T23:27:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0061ffb700 1 -- 172.21.15.12:0/1051435888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0054005d00 con 0x7f00640b0010 2021-10-20T23:27:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0064159d70 con 0x7f00640b0010 2021-10-20T23:27:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f0061ffb700 1 -- 172.21.15.12:0/1051435888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00540072c0 con 0x7f00640b0010 2021-10-20T23:27:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0064065110 con 0x7f00640b0010 2021-10-20T23:27:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.867+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0064057350 con 0x7f00640b0010 2021-10-20T23:27:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.871+0000 7f0061ffb700 1 -- 172.21.15.12:0/1051435888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0054010070 con 0x7f00640b0010 2021-10-20T23:27:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.871+0000 7f0061ffb700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f00480534f0 0x7f00480559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.871+0000 7f0061ffb700 1 -- 172.21.15.12:0/1051435888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f005406b4a0 con 0x7f00640b0010 2021-10-20T23:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.871+0000 7f006889e700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f00480534f0 0x7f00480559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.871+0000 7f006889e700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f00480534f0 0x7f00480559b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f004c018000 tx=0x7f004c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:12.875+0000 7f0061ffb700 1 -- 172.21.15.12:0/1051435888 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00540424a0 con 0x7f00640b0010 2021-10-20T23:27:13.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.043+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f00640698e0 con 0x7f00640b0010 2021-10-20T23:27:13.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.235+0000 7f0061ffb700 1 -- 172.21.15.12:0/1051435888 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0054045ac0 con 0x7f00640b0010 2021-10-20T23:27:13.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f00480534f0 msgr2=0x7f00480559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f00480534f0 0x7f00480559b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f004c018000 tx=0x7f004c014000).stop 2021-10-20T23:27:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b0010 msgr2=0x7f0064156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b0010 0x7f0064156460 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f006406b7c0 tx=0x7f0054007f60).stop 2021-10-20T23:27:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 shutdown_connections 2021-10-20T23:27:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f00480534f0 0x7f00480559b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00640b2580 0x7f00640ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00640b0010 0x7f0064156460 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 --2- 172.21.15.12:0/1051435888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00640a8ac0 0x7f006415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 >> 172.21.15.12:0/1051435888 conn(0x7f0064060180 msgr2=0x7f00640aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:13.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 shutdown_connections 2021-10-20T23:27:13.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.239+0000 7f00698a0700 1 -- 172.21.15.12:0/1051435888 wait complete. 2021-10-20T23:27:13.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:13.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.363+0000 7f1b96629700 1 Processor -- start 2021-10-20T23:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.363+0000 7f1b96629700 1 -- start start 2021-10-20T23:27:13.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.363+0000 7f1b96629700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900ad4e0 0x7f1b900b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.363+0000 7f1b96629700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b900aef90 0x7f1b900b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b900b0ab0 con 0x7f1b9005f6b0 2021-10-20T23:27:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b900b0d50 con 0x7f1b900aef90 2021-10-20T23:27:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900ae850 con 0x7f1b900ad4e0 2021-10-20T23:27:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b94e26700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b900aef90 0x7f1b900b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b94e26700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b900aef90 0x7f1b900b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42310/0 (socket says 172.21.15.12:42310) 2021-10-20T23:27:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b94e26700 1 -- 172.21.15.12:0/15495847 learned_addr learned my addr 172.21.15.12:0/15495847 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:13.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b95627700 1 --2- 172.21.15.12:0/15495847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900ad4e0 0x7f1b900b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b94e26700 1 -- 172.21.15.12:0/15495847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900ad4e0 msgr2=0x7f1b900b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:13.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b94e26700 1 --2- 172.21.15.12:0/15495847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900ad4e0 0x7f1b900b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b94e26700 1 -- 172.21.15.12:0/15495847 >> v1:172.21.15.31:6789/0 conn(0x7f1b9005f6b0 legacy=0x7f1b9005fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b94e26700 1 -- 172.21.15.12:0/15495847 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900aeaf0 con 0x7f1b900aef90 2021-10-20T23:27:13.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b94e26700 1 --2- 172.21.15.12:0/15495847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900aef90 0x7f1b900b1110 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f1b80002f70 tx=0x7f1b80006eb0).ready entity=mon.0 client_cookie=442365564f179959 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b7ffff700 1 -- 172.21.15.12:0/15495847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b8000d570 con 0x7f1b900aef90 2021-10-20T23:27:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b7ffff700 1 -- 172.21.15.12:0/15495847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b80000e90 con 0x7f1b900aef90 2021-10-20T23:27:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b7ffff700 1 -- 172.21.15.12:0/15495847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b8000d900 con 0x7f1b900aef90 2021-10-20T23:27:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 -- 172.21.15.12:0/15495847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900aef90 msgr2=0x7f1b900b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 --2- 172.21.15.12:0/15495847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900aef90 0x7f1b900b1110 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f1b80002f70 tx=0x7f1b80006eb0).stop 2021-10-20T23:27:13.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 -- 172.21.15.12:0/15495847 shutdown_connections 2021-10-20T23:27:13.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 --2- 172.21.15.12:0/15495847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900aef90 0x7f1b900b1110 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 --2- 172.21.15.12:0/15495847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900ad4e0 0x7f1b900b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 -- 172.21.15.12:0/15495847 >> 172.21.15.12:0/15495847 conn(0x7f1b900611d0 msgr2=0x7f1b90062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:13.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 -- 172.21.15.12:0/15495847 shutdown_connections 2021-10-20T23:27:13.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.367+0000 7f1b96629700 1 -- 172.21.15.12:0/15495847 wait complete. 2021-10-20T23:27:13.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 Processor -- start 2021-10-20T23:27:13.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 -- start start 2021-10-20T23:27:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9005f6b0 0x7f1b90142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900ad4e0 0x7f1b900aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900aef90 0x7f1b90152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900a9850 con 0x7f1b900ad4e0 2021-10-20T23:27:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900a9a80 con 0x7f1b9005f6b0 2021-10-20T23:27:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900a9d20 con 0x7f1b900aef90 2021-10-20T23:27:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b94e26700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900ad4e0 0x7f1b900aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b94e26700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900ad4e0 0x7f1b900aa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42316/0 (socket says 172.21.15.12:42316) 2021-10-20T23:27:13.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b94e26700 1 -- 172.21.15.12:0/2000355263 learned_addr learned my addr 172.21.15.12:0/2000355263 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:13.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b95e28700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900aef90 0x7f1b90152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b95627700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9005f6b0 0x7f1b90142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b94e26700 1 -- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900aef90 msgr2=0x7f1b90152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b94e26700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900aef90 0x7f1b90152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b94e26700 1 -- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9005f6b0 msgr2=0x7f1b90142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b94e26700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9005f6b0 0x7f1b90142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b94e26700 1 -- 172.21.15.12:0/2000355263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8000b1e0 con 0x7f1b900ad4e0 2021-10-20T23:27:13.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b95e28700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900aef90 0x7f1b90152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:13.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b94e26700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900ad4e0 0x7f1b900aa030 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f1b80002f70 tx=0x7f1b80015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:13.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b7e7fc700 1 -- 172.21.15.12:0/2000355263 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b80011950 con 0x7f1b900ad4e0 2021-10-20T23:27:13.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b7e7fc700 1 -- 172.21.15.12:0/2000355263 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b80011ab0 con 0x7f1b900ad4e0 2021-10-20T23:27:13.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b90152230 con 0x7f1b900ad4e0 2021-10-20T23:27:13.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b7e7fc700 1 -- 172.21.15.12:0/2000355263 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b80011e10 con 0x7f1b900ad4e0 2021-10-20T23:27:13.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.371+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b900aa9b0 con 0x7f1b900ad4e0 2021-10-20T23:27:13.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.375+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b900b3350 con 0x7f1b900ad4e0 2021-10-20T23:27:13.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.375+0000 7f1b7e7fc700 1 -- 172.21.15.12:0/2000355263 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1b80025030 con 0x7f1b900ad4e0 2021-10-20T23:27:13.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.375+0000 7f1b7e7fc700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b700536a0 0x7f1b70055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.375+0000 7f1b7e7fc700 1 -- 172.21.15.12:0/2000355263 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1b8006ce00 con 0x7f1b900ad4e0 2021-10-20T23:27:13.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.375+0000 7f1b95627700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b700536a0 0x7f1b70055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.375+0000 7f1b95627700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b700536a0 0x7f1b70055b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f1b8c00b000 tx=0x7f1b8c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:13.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.383+0000 7f1b7e7fc700 1 -- 172.21.15.12:0/2000355263 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1b80043e00 con 0x7f1b900ad4e0 2021-10-20T23:27:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.543+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b90152420 con 0x7f1b900ad4e0 2021-10-20T23:27:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.543+0000 7f1b7e7fc700 1 -- 172.21.15.12:0/2000355263 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f1b80023020 con 0x7f1b900ad4e0 2021-10-20T23:27:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:13.553 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1323051693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1323051693},{"type":"v1","addr":"172.21.15.12:6833","nonce":1323051693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":6921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2210278023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2210278023},{"type":"v1","addr":"172.21.15.12:6835","nonce":2210278023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:12.198777+0000","modified":"2021-10-20T23:27:13.230446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6964":{"gid":6964,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3694841345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3694841345},{"type":"v1","addr":"172.21.15.31:6835","nonce":3694841345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-20T23:27:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b700536a0 msgr2=0x7f1b70055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b700536a0 0x7f1b70055b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f1b8c00b000 tx=0x7f1b8c008040).stop 2021-10-20T23:27:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900ad4e0 msgr2=0x7f1b900aa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900ad4e0 0x7f1b900aa030 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f1b80002f70 tx=0x7f1b80015000).stop 2021-10-20T23:27:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 shutdown_connections 2021-10-20T23:27:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b700536a0 0x7f1b70055b60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b900aef90 0x7f1b90152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b900ad4e0 0x7f1b900aa030 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 --2- 172.21.15.12:0/2000355263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9005f6b0 0x7f1b90142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 >> 172.21.15.12:0/2000355263 conn(0x7f1b900611d0 msgr2=0x7f1b901404d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 shutdown_connections 2021-10-20T23:27:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.547+0000 7f1b96629700 1 -- 172.21.15.12:0/2000355263 wait complete. 2021-10-20T23:27:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2021-10-20T23:27:13.572 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:13.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcda0e07700 1 Processor -- start 2021-10-20T23:27:13.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcda0e07700 1 -- start start 2021-10-20T23:27:13.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcda0e07700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd9c0b2580 0x7fcd9c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcda0e07700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcd9c0b0010 0x7fcd9c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcda0e07700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c0a70c0 con 0x7fcd9c0afbd0 2021-10-20T23:27:13.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcda0e07700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0a72f0 con 0x7fcd9c0b0010 2021-10-20T23:27:13.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcda0e07700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0a7590 con 0x7fcd9c0b2580 2021-10-20T23:27:13.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcd9c0b0010 0x7fcd9c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcd9c0b0010 0x7fcd9c14b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42322/0 (socket says 172.21.15.12:42322) 2021-10-20T23:27:13.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9affd700 1 -- 172.21.15.12:0/3213525359 learned_addr learned my addr 172.21.15.12:0/3213525359 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:13.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9b7fe700 1 --2- 172.21.15.12:0/3213525359 >> v2:172.21.15.31:3300/0 conn(0x7fcd9c0b2580 0x7fcd9c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9affd700 1 -- 172.21.15.12:0/3213525359 >> v2:172.21.15.31:3300/0 conn(0x7fcd9c0b2580 msgr2=0x7fcd9c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:13.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9affd700 1 --2- 172.21.15.12:0/3213525359 >> v2:172.21.15.31:3300/0 conn(0x7fcd9c0b2580 0x7fcd9c14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9affd700 1 -- 172.21.15.12:0/3213525359 >> v1:172.21.15.31:6789/0 conn(0x7fcd9c0afbd0 legacy=0x7fcd9c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9affd700 1 -- 172.21.15.12:0/3213525359 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0a7830 con 0x7fcd9c0b0010 2021-10-20T23:27:13.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9affd700 1 --2- 172.21.15.12:0/3213525359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b0010 0x7fcd9c14b330 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fcd8c002f70 tx=0x7fcd8c006eb0).ready entity=mon.0 client_cookie=4df60a99f08d3515 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:13.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9a7fc700 1 -- 172.21.15.12:0/3213525359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8c00d5c0 con 0x7fcd9c0b0010 2021-10-20T23:27:13.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9a7fc700 1 -- 172.21.15.12:0/3213525359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c000e90 con 0x7fcd9c0b0010 2021-10-20T23:27:13.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.675+0000 7fcd9a7fc700 1 -- 172.21.15.12:0/3213525359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8c00d950 con 0x7fcd9c0b0010 2021-10-20T23:27:13.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 -- 172.21.15.12:0/3213525359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b0010 msgr2=0x7fcd9c14b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 --2- 172.21.15.12:0/3213525359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b0010 0x7fcd9c14b330 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fcd8c002f70 tx=0x7fcd8c006eb0).stop 2021-10-20T23:27:13.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 -- 172.21.15.12:0/3213525359 shutdown_connections 2021-10-20T23:27:13.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 --2- 172.21.15.12:0/3213525359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b0010 0x7fcd9c14b330 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 --2- 172.21.15.12:0/3213525359 >> v2:172.21.15.31:3300/0 conn(0x7fcd9c0b2580 0x7fcd9c14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 -- 172.21.15.12:0/3213525359 >> 172.21.15.12:0/3213525359 conn(0x7fcd9c060180 msgr2=0x7fcd9c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:13.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 -- 172.21.15.12:0/3213525359 shutdown_connections 2021-10-20T23:27:13.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 -- 172.21.15.12:0/3213525359 wait complete. 2021-10-20T23:27:13.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 Processor -- start 2021-10-20T23:27:13.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 -- start start 2021-10-20T23:27:13.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd9c0afbd0 0x7fcd9c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c0b0010 0x7fcd9c146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b2580 0x7fcd9c146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0ab550 con 0x7fcd9c0b2580 2021-10-20T23:27:13.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0aa620 con 0x7fcd9c0b0010 2021-10-20T23:27:13.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcda0e07700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c156460 con 0x7fcd9c0afbd0 2021-10-20T23:27:13.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b2580 0x7fcd9c146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c0b0010 0x7fcd9c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b2580 0x7fcd9c146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42332/0 (socket says 172.21.15.12:42332) 2021-10-20T23:27:13.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd9c0afbd0 0x7fcd9c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9bfff700 1 -- 172.21.15.12:0/1531266655 learned_addr learned my addr 172.21.15.12:0/1531266655 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:13.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9affd700 1 -- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd9c0afbd0 msgr2=0x7fcd9c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9affd700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd9c0afbd0 0x7fcd9c0adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9affd700 1 -- 172.21.15.12:0/1531266655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b2580 msgr2=0x7fcd9c146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9affd700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b2580 0x7fcd9c146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9affd700 1 -- 172.21.15.12:0/1531266655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c00b1e0 con 0x7fcd9c0b0010 2021-10-20T23:27:13.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9bfff700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b2580 0x7fcd9c146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:13.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.679+0000 7fcd9b7fe700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd9c0afbd0 0x7fcd9c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:13.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.683+0000 7fcd9affd700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c0b0010 0x7fcd9c146480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fcd8c002f70 tx=0x7fcd8c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:13.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.683+0000 7fcd98ff9700 1 -- 172.21.15.12:0/1531266655 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8c011760 con 0x7fcd9c0b0010 2021-10-20T23:27:13.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.683+0000 7fcd98ff9700 1 -- 172.21.15.12:0/1531266655 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0118c0 con 0x7fcd9c0b0010 2021-10-20T23:27:13.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.683+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c156700 con 0x7fcd9c0b0010 2021-10-20T23:27:13.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.683+0000 7fcd98ff9700 1 -- 172.21.15.12:0/1531266655 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8c011c20 con 0x7fcd9c0b0010 2021-10-20T23:27:13.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.683+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c146e60 con 0x7fcd9c0b0010 2021-10-20T23:27:13.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.683+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c05f240 con 0x7fcd9c0b0010 2021-10-20T23:27:13.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.683+0000 7fcd98ff9700 1 -- 172.21.15.12:0/1531266655 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcd8c03b080 con 0x7fcd9c0b0010 2021-10-20T23:27:13.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.683+0000 7fcd98ff9700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd7c0536a0 0x7fcd7c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.687+0000 7fcd98ff9700 1 -- 172.21.15.12:0/1531266655 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcd8c06ced0 con 0x7fcd9c0b0010 2021-10-20T23:27:13.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.687+0000 7fcd9b7fe700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd7c0536a0 0x7fcd7c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.687+0000 7fcd9b7fe700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd7c0536a0 0x7fcd7c055b60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fcd9000b000 tx=0x7fcd90006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:13.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.691+0000 7fcd98ff9700 1 -- 172.21.15.12:0/1531266655 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd8c043dc0 con 0x7fcd9c0b0010 2021-10-20T23:27:13.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.819+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd9c0aa760 con 0x7fcd9c0b0010 2021-10-20T23:27:13.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.819+0000 7fcd98ff9700 1 -- 172.21.15.12:0/1531266655 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16277 (secure 0 0 0) 0x7fcd8c0473e0 con 0x7fcd9c0b0010 2021-10-20T23:27:13.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:13.828 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":101,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:13.204259+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:10.667132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:11.561636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:13.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd7c0536a0 msgr2=0x7fcd7c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd7c0536a0 0x7fcd7c055b60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fcd9000b000 tx=0x7fcd90006df0).stop 2021-10-20T23:27:13.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c0b0010 msgr2=0x7fcd9c146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c0b0010 0x7fcd9c146480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fcd8c002f70 tx=0x7fcd8c015000).stop 2021-10-20T23:27:13.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 shutdown_connections 2021-10-20T23:27:13.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcd7c0536a0 0x7fcd7c055b60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd9c0b2580 0x7fcd9c146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c0b0010 0x7fcd9c146480 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 --2- 172.21.15.12:0/1531266655 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd9c0afbd0 0x7fcd9c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 >> 172.21.15.12:0/1531266655 conn(0x7fcd9c060180 msgr2=0x7fcd9c14b910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:13.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 shutdown_connections 2021-10-20T23:27:13.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.823+0000 7fcda0e07700 1 -- 172.21.15.12:0/1531266655 wait complete. 2021-10-20T23:27:13.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:27:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a12377700 1 Processor -- start 2021-10-20T23:27:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a12377700 1 -- start start 2021-10-20T23:27:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a12377700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a0c0b43c0 0x7f1a0c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a12377700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 0x7f1a0c12ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a12377700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c1440b0 con 0x7f1a0c0b6580 2021-10-20T23:27:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a12377700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c143b70 con 0x7f1a0c0b43c0 2021-10-20T23:27:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a12377700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c143e10 con 0x7f1a0c0b6960 2021-10-20T23:27:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a037fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a0c0b43c0 0x7f1a0c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a10914700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 0x7f1a0c12ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a0bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1a0c0b6580 0x7f1a0c061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:47994/0 (socket says 172.21.15.12:47994) 2021-10-20T23:27:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a0bfff700 1 -- 172.21.15.12:0/1821456775 learned_addr learned my addr 172.21.15.12:0/1821456775 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:13.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a037fe700 1 -- 172.21.15.12:0/1821456775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 msgr2=0x7f1a0c12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a037fe700 1 --2- 172.21.15.12:0/1821456775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 0x7f1a0c12ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a037fe700 1 -- 172.21.15.12:0/1821456775 >> v1:172.21.15.31:6789/0 conn(0x7f1a0c0b6580 legacy=0x7f1a0c061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a037fe700 1 -- 172.21.15.12:0/1821456775 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c0615f0 con 0x7f1a0c0b43c0 2021-10-20T23:27:13.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a0b7fe700 1 -- 172.21.15.12:0/1821456775 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689396220 0 0) 0x7f1a0c1440b0 con 0x7f1a0c0b6580 2021-10-20T23:27:13.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a10914700 1 --2- 172.21.15.12:0/1821456775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 0x7f1a0c12ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:13.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a037fe700 1 --2- 172.21.15.12:0/1821456775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a0c0b43c0 0x7f1a0c0b5bf0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f1a0c143120 tx=0x7f19f4006df0).ready entity=mon.1 client_cookie=6f1f415a9d7bede3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:13.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a0b7fe700 1 -- 172.21.15.12:0/1821456775 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19f400d570 con 0x7f1a0c0b43c0 2021-10-20T23:27:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a0b7fe700 1 -- 172.21.15.12:0/1821456775 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4000e90 con 0x7f1a0c0b43c0 2021-10-20T23:27:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.959+0000 7f1a0b7fe700 1 -- 172.21.15.12:0/1821456775 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19f400d8c0 con 0x7f1a0c0b43c0 2021-10-20T23:27:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 -- 172.21.15.12:0/1821456775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a0c0b43c0 msgr2=0x7f1a0c0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 --2- 172.21.15.12:0/1821456775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a0c0b43c0 0x7f1a0c0b5bf0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f1a0c143120 tx=0x7f19f4006df0).stop 2021-10-20T23:27:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 -- 172.21.15.12:0/1821456775 shutdown_connections 2021-10-20T23:27:13.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 --2- 172.21.15.12:0/1821456775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 0x7f1a0c12ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 --2- 172.21.15.12:0/1821456775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a0c0b43c0 0x7f1a0c0b5bf0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 -- 172.21.15.12:0/1821456775 >> 172.21.15.12:0/1821456775 conn(0x7f1a0c05c490 msgr2=0x7f1a0c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:13.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 -- 172.21.15.12:0/1821456775 shutdown_connections 2021-10-20T23:27:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 -- 172.21.15.12:0/1821456775 wait complete. 2021-10-20T23:27:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 Processor -- start 2021-10-20T23:27:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 -- start start 2021-10-20T23:27:13.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a0c0b43c0 0x7f1a0c128690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0c0b6580 0x7f1a0c125560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 0x7f1a0c1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c126980 con 0x7f1a0c0b6580 2021-10-20T23:27:13.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c126bb0 con 0x7f1a0c0b43c0 2021-10-20T23:27:13.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a12377700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c124e20 con 0x7f1a0c0b6960 2021-10-20T23:27:13.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0c0b6580 0x7f1a0c125560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0c0b6580 0x7f1a0c125560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42344/0 (socket says 172.21.15.12:42344) 2021-10-20T23:27:13.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a037fe700 1 -- 172.21.15.12:0/2156334096 learned_addr learned my addr 172.21.15.12:0/2156334096 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:13.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a0bfff700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a0c0b43c0 0x7f1a0c128690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.963+0000 7f1a10914700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 0x7f1a0c1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a037fe700 1 -- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 msgr2=0x7f1a0c1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a037fe700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 0x7f1a0c1558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a037fe700 1 -- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a0c0b43c0 msgr2=0x7f1a0c128690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:13.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a037fe700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a0c0b43c0 0x7f1a0c128690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:13.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a037fe700 1 -- 172.21.15.12:0/2156334096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04009470 con 0x7f1a0c0b6580 2021-10-20T23:27:13.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a037fe700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0c0b6580 0x7f1a0c125560 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f1a0c143120 tx=0x7f19f4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:13.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a09ffb700 1 -- 172.21.15.12:0/2156334096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19f400dea0 con 0x7f1a0c0b6580 2021-10-20T23:27:13.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a09ffb700 1 -- 172.21.15.12:0/2156334096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4013e90 con 0x7f1a0c0b6580 2021-10-20T23:27:13.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f400b180 con 0x7f1a0c0b6580 2021-10-20T23:27:13.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a09ffb700 1 -- 172.21.15.12:0/2156334096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19f401e5f0 con 0x7f1a0c0b6580 2021-10-20T23:27:13.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c12b0c0 con 0x7f1a0c0b6580 2021-10-20T23:27:13.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c061890 con 0x7f1a0c0b6580 2021-10-20T23:27:13.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.967+0000 7f1a09ffb700 1 -- 172.21.15.12:0/2156334096 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f19f4025030 con 0x7f1a0c0b6580 2021-10-20T23:27:13.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.971+0000 7f1a09ffb700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19f00536a0 0x7f19f0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:13.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.971+0000 7f1a09ffb700 1 -- 172.21.15.12:0/2156334096 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f19f406c840 con 0x7f1a0c0b6580 2021-10-20T23:27:13.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.971+0000 7f1a0bfff700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19f00536a0 0x7f19f0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:13.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.971+0000 7f1a0bfff700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19f00536a0 0x7f19f0055b60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f19fc00d000 tx=0x7f19fc007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:13.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:13.975+0000 7f1a09ffb700 1 -- 172.21.15.12:0/2156334096 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f19f4043730 con 0x7f1a0c0b6580 2021-10-20T23:27:14.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.139+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1a0c057350 con 0x7f1a0c0b6580 2021-10-20T23:27:14.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.143+0000 7f1a09ffb700 1 -- 172.21.15.12:0/2156334096 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f19f40230e0 con 0x7f1a0c0b6580 2021-10-20T23:27:14.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19f00536a0 msgr2=0x7f19f0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19f00536a0 0x7f19f0055b60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f19fc00d000 tx=0x7f19fc007a00).stop 2021-10-20T23:27:14.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0c0b6580 msgr2=0x7f1a0c125560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0c0b6580 0x7f1a0c125560 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f1a0c143120 tx=0x7f19f4014000).stop 2021-10-20T23:27:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 shutdown_connections 2021-10-20T23:27:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19f00536a0 0x7f19f0055b60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a0c0b6960 0x7f1a0c1558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0c0b6580 0x7f1a0c125560 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 --2- 172.21.15.12:0/2156334096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a0c0b43c0 0x7f1a0c128690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 >> 172.21.15.12:0/2156334096 conn(0x7f1a0c05c490 msgr2=0x7f1a0c145890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:14.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 shutdown_connections 2021-10-20T23:27:14.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.147+0000 7f1a12377700 1 -- 172.21.15.12:0/2156334096 wait complete. 2021-10-20T23:27:14.157 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:27:14.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:27:14.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e245c700 1 Processor -- start 2021-10-20T23:27:14.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e245c700 1 -- start start 2021-10-20T23:27:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e245c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc061320 0x7fa0dc061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e245c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0dc140440 0x7fa0dc1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e245c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc0aecf0 con 0x7fa0dc0ad5c0 2021-10-20T23:27:14.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e245c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc0b6f20 con 0x7fa0dc140440 2021-10-20T23:27:14.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e245c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0aef20 con 0x7fa0dc061320 2021-10-20T23:27:14.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e0c59700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa0dc0ad5c0 0x7fa0dc0b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40946/0 (socket says 172.21.15.12:40946) 2021-10-20T23:27:14.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e0c59700 1 -- 172.21.15.12:0/1384077383 learned_addr learned my addr 172.21.15.12:0/1384077383 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:14.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.279+0000 7fa0e1c5b700 1 --2- 172.21.15.12:0/1384077383 >> v2:172.21.15.12:3300/0 conn(0x7fa0dc140440 0x7fa0dc1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e145a700 1 --2- 172.21.15.12:0/1384077383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc061320 0x7fa0dc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0d3fff700 1 -- 172.21.15.12:0/1384077383 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981048112 0 0) 0x7fa0dc0aecf0 con 0x7fa0dc0ad5c0 2021-10-20T23:27:14.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0d3fff700 1 -- 172.21.15.12:0/1384077383 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c0003260 con 0x7fa0dc0ad5c0 2021-10-20T23:27:14.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e1c5b700 1 -- 172.21.15.12:0/1384077383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc061320 msgr2=0x7fa0dc061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:14.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e1c5b700 1 --2- 172.21.15.12:0/1384077383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc061320 0x7fa0dc061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e1c5b700 1 -- 172.21.15.12:0/1384077383 >> v1:172.21.15.12:6789/0 conn(0x7fa0dc0ad5c0 legacy=0x7fa0dc0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e1c5b700 1 -- 172.21.15.12:0/1384077383 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0af1c0 con 0x7fa0dc140440 2021-10-20T23:27:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e1c5b700 1 --2- 172.21.15.12:0/1384077383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 0x7fa0dc1408d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fa0d40032f0 tx=0x7fa0d40091d0).ready entity=mon.0 client_cookie=5eca351d5fa2dadb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0d3fff700 1 -- 172.21.15.12:0/1384077383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0d400b600 con 0x7fa0dc140440 2021-10-20T23:27:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0d3fff700 1 -- 172.21.15.12:0/1384077383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d400b760 con 0x7fa0dc140440 2021-10-20T23:27:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0d3fff700 1 -- 172.21.15.12:0/1384077383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0d400b8d0 con 0x7fa0dc140440 2021-10-20T23:27:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 -- 172.21.15.12:0/1384077383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 msgr2=0x7fa0dc1408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 --2- 172.21.15.12:0/1384077383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 0x7fa0dc1408d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fa0d40032f0 tx=0x7fa0d40091d0).stop 2021-10-20T23:27:14.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 -- 172.21.15.12:0/1384077383 shutdown_connections 2021-10-20T23:27:14.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 --2- 172.21.15.12:0/1384077383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 0x7fa0dc1408d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 --2- 172.21.15.12:0/1384077383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc061320 0x7fa0dc061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 -- 172.21.15.12:0/1384077383 >> 172.21.15.12:0/1384077383 conn(0x7fa0dc066de0 msgr2=0x7fa0dc0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:14.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 -- 172.21.15.12:0/1384077383 shutdown_connections 2021-10-20T23:27:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 -- 172.21.15.12:0/1384077383 wait complete. 2021-10-20T23:27:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 Processor -- start 2021-10-20T23:27:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.283+0000 7fa0e245c700 1 -- start start 2021-10-20T23:27:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e245c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0dc061320 0x7fa0dc0ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e245c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc0ad5c0 0x7fa0dc152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e245c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 0x7fa0dc152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e245c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc1413d0 con 0x7fa0dc140440 2021-10-20T23:27:14.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e245c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc141670 con 0x7fa0dc061320 2021-10-20T23:27:14.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e245c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc141910 con 0x7fa0dc0ad5c0 2021-10-20T23:27:14.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e1c5b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 0x7fa0dc152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e1c5b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 0x7fa0dc152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42360/0 (socket says 172.21.15.12:42360) 2021-10-20T23:27:14.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e1c5b700 1 -- 172.21.15.12:0/1412523352 learned_addr learned my addr 172.21.15.12:0/1412523352 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:14.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e145a700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0dc061320 0x7fa0dc0ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e0c59700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc0ad5c0 0x7fa0dc152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e1c5b700 1 -- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc0ad5c0 msgr2=0x7fa0dc152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e1c5b700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc0ad5c0 0x7fa0dc152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e1c5b700 1 -- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0dc061320 msgr2=0x7fa0dc0ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e1c5b700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0dc061320 0x7fa0dc0ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e1c5b700 1 -- 172.21.15.12:0/1412523352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4009470 con 0x7fa0dc140440 2021-10-20T23:27:14.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e145a700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0dc061320 0x7fa0dc0ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:14.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e1c5b700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 0x7fa0dc152a50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fa0d40032f0 tx=0x7fa0d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:14.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0d27fc700 1 -- 172.21.15.12:0/1412523352 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0d400b600 con 0x7fa0dc140440 2021-10-20T23:27:14.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0d27fc700 1 -- 172.21.15.12:0/1412523352 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d4011cc0 con 0x7fa0dc140440 2021-10-20T23:27:14.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc141bb0 con 0x7fa0dc140440 2021-10-20T23:27:14.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0d27fc700 1 -- 172.21.15.12:0/1412523352 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0d401f5e0 con 0x7fa0dc140440 2021-10-20T23:27:14.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc0a9ca0 con 0x7fa0dc140440 2021-10-20T23:27:14.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0d27fc700 1 -- 172.21.15.12:0/1412523352 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa0d4026030 con 0x7fa0dc140440 2021-10-20T23:27:14.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.287+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc0af460 con 0x7fa0dc140440 2021-10-20T23:27:14.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.291+0000 7fa0d27fc700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0c4053580 0x7fa0c4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.291+0000 7fa0d27fc700 1 -- 172.21.15.12:0/1412523352 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa0d406c700 con 0x7fa0dc140440 2021-10-20T23:27:14.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.291+0000 7fa0e145a700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0c4053580 0x7fa0c4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.291+0000 7fa0e145a700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0c4053580 0x7fa0c4055a40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fa0d800b000 tx=0x7fa0d8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:14.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.299+0000 7fa0d27fc700 1 -- 172.21.15.12:0/1412523352 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0d4043700 con 0x7fa0dc140440 2021-10-20T23:27:14.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.467+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa0dc062100 con 0x7fa0dc140440 2021-10-20T23:27:14.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.475+0000 7fa0d27fc700 1 -- 172.21.15.12:0/1412523352 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa0d40150e0 con 0x7fa0dc140440 2021-10-20T23:27:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0c4053580 msgr2=0x7fa0c4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0c4053580 0x7fa0c4055a40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fa0d800b000 tx=0x7fa0d8008040).stop 2021-10-20T23:27:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 msgr2=0x7fa0dc152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 0x7fa0dc152a50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fa0d40032f0 tx=0x7fa0d4016000).stop 2021-10-20T23:27:14.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 shutdown_connections 2021-10-20T23:27:14.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa0c4053580 0x7fa0c4055a40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0dc140440 0x7fa0dc152a50 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0dc0ad5c0 0x7fa0dc152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 --2- 172.21.15.12:0/1412523352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0dc061320 0x7fa0dc0ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 >> 172.21.15.12:0/1412523352 conn(0x7fa0dc066de0 msgr2=0x7fa0dc0b8720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:14.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 shutdown_connections 2021-10-20T23:27:14.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.479+0000 7fa0e245c700 1 -- 172.21.15.12:0/1412523352 wait complete. 2021-10-20T23:27:14.491 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:27:14.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:14.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.595+0000 7f1a2c18f700 1 Processor -- start 2021-10-20T23:27:14.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 -- start start 2021-10-20T23:27:14.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a240b1db0 0x7f1a240b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 0x7f1a24144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a240b0350 con 0x7f1a241483a0 2021-10-20T23:27:14.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a240a90c0 con 0x7f1a240b1db0 2021-10-20T23:27:14.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a240b05f0 con 0x7f1a240a70c0 2021-10-20T23:27:14.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2972a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1a241483a0 0x7f1a240b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40958/0 (socket says 172.21.15.12:40958) 2021-10-20T23:27:14.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2972a700 1 -- 172.21.15.12:0/3911011395 learned_addr learned my addr 172.21.15.12:0/3911011395 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:14.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2a72c700 1 --2- 172.21.15.12:0/3911011395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 0x7f1a24144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a29f2b700 1 --2- 172.21.15.12:0/3911011395 >> v2:172.21.15.31:3300/0 conn(0x7f1a240b1db0 0x7f1a240b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a28f29700 1 -- 172.21.15.12:0/3911011395 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118074906 0 0) 0x7f1a240b0350 con 0x7f1a241483a0 2021-10-20T23:27:14.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a28f29700 1 -- 172.21.15.12:0/3911011395 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a0c003260 con 0x7f1a241483a0 2021-10-20T23:27:14.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2a72c700 1 -- 172.21.15.12:0/3911011395 >> v2:172.21.15.31:3300/0 conn(0x7f1a240b1db0 msgr2=0x7f1a240b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:14.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2a72c700 1 --2- 172.21.15.12:0/3911011395 >> v2:172.21.15.31:3300/0 conn(0x7f1a240b1db0 0x7f1a240b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2a72c700 1 -- 172.21.15.12:0/3911011395 >> v1:172.21.15.12:6789/0 conn(0x7f1a241483a0 legacy=0x7f1a240b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2a72c700 1 -- 172.21.15.12:0/3911011395 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a240b0890 con 0x7f1a240a70c0 2021-10-20T23:27:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2a72c700 1 --2- 172.21.15.12:0/3911011395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 0x7f1a24144720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1a24147730 tx=0x7f1a1c0091d0).ready entity=mon.2 client_cookie=3b124b1aefb946b2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a28f29700 1 -- 172.21.15.12:0/3911011395 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1c00b600 con 0x7f1a240a70c0 2021-10-20T23:27:14.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a28f29700 1 -- 172.21.15.12:0/3911011395 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c00b760 con 0x7f1a240a70c0 2021-10-20T23:27:14.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a28f29700 1 -- 172.21.15.12:0/3911011395 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1c00b8d0 con 0x7f1a240a70c0 2021-10-20T23:27:14.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 -- 172.21.15.12:0/3911011395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 msgr2=0x7f1a24144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 --2- 172.21.15.12:0/3911011395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 0x7f1a24144720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1a24147730 tx=0x7f1a1c0091d0).stop 2021-10-20T23:27:14.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 -- 172.21.15.12:0/3911011395 shutdown_connections 2021-10-20T23:27:14.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 --2- 172.21.15.12:0/3911011395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 0x7f1a24144720 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 --2- 172.21.15.12:0/3911011395 >> v2:172.21.15.31:3300/0 conn(0x7f1a240b1db0 0x7f1a240b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 -- 172.21.15.12:0/3911011395 >> 172.21.15.12:0/3911011395 conn(0x7f1a2405f6b0 msgr2=0x7f1a2405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 -- 172.21.15.12:0/3911011395 shutdown_connections 2021-10-20T23:27:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.599+0000 7f1a2c18f700 1 -- 172.21.15.12:0/3911011395 wait complete. 2021-10-20T23:27:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.603+0000 7f1a2c18f700 1 Processor -- start 2021-10-20T23:27:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.603+0000 7f1a2c18f700 1 -- start start 2021-10-20T23:27:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2c18f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 0x7f1a24062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2c18f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a240b1db0 0x7f1a24064200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2c18f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a241483a0 0x7f1a24153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2c18f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24065370 con 0x7f1a240b1db0 2021-10-20T23:27:14.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2c18f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a241575a0 con 0x7f1a241483a0 2021-10-20T23:27:14.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2c18f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24063450 con 0x7f1a240a70c0 2021-10-20T23:27:14.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2972a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a240b1db0 0x7f1a24064200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2972a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a240b1db0 0x7f1a24064200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42372/0 (socket says 172.21.15.12:42372) 2021-10-20T23:27:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2972a700 1 -- 172.21.15.12:0/18161882 learned_addr learned my addr 172.21.15.12:0/18161882 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a29f2b700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 0x7f1a24062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2a72c700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a241483a0 0x7f1a24153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2a72c700 1 -- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 msgr2=0x7f1a24062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2a72c700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 0x7f1a24062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2a72c700 1 -- 172.21.15.12:0/18161882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a240b1db0 msgr2=0x7f1a24064200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2a72c700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a240b1db0 0x7f1a24064200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2a72c700 1 -- 172.21.15.12:0/18161882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009470 con 0x7f1a241483a0 2021-10-20T23:27:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2972a700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a240b1db0 0x7f1a24064200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2a72c700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a241483a0 0x7f1a24153bd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f1a24147730 tx=0x7f1a1c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a12ffd700 1 -- 172.21.15.12:0/18161882 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1c00b8d0 con 0x7f1a241483a0 2021-10-20T23:27:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a12ffd700 1 -- 172.21.15.12:0/18161882 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0205e0 con 0x7f1a241483a0 2021-10-20T23:27:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a240636f0 con 0x7f1a241483a0 2021-10-20T23:27:14.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a12ffd700 1 -- 172.21.15.12:0/18161882 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1c00b600 con 0x7f1a241483a0 2021-10-20T23:27:14.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a241572d0 con 0x7f1a241483a0 2021-10-20T23:27:14.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.607+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a241577a0 con 0x7f1a241483a0 2021-10-20T23:27:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.611+0000 7f1a12ffd700 1 -- 172.21.15.12:0/18161882 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a1c026020 con 0x7f1a241483a0 2021-10-20T23:27:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.611+0000 7f1a12ffd700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a04053640 0x7f1a04055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.611+0000 7f1a12ffd700 1 -- 172.21.15.12:0/18161882 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1a1c06cae0 con 0x7f1a241483a0 2021-10-20T23:27:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.611+0000 7f1a29f2b700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a04053640 0x7f1a04055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:14.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.611+0000 7f1a29f2b700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a04053640 0x7f1a04055b00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f1a2000b000 tx=0x7f1a20006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:14.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.619+0000 7f1a12ffd700 1 -- 172.21.15.12:0/18161882 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a1c043970 con 0x7f1a241483a0 2021-10-20T23:27:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.783+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a24057350 con 0x7f1a241483a0 2021-10-20T23:27:14.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.783+0000 7f1a12ffd700 1 -- 172.21.15.12:0/18161882 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f1a1c0159d0 con 0x7f1a241483a0 2021-10-20T23:27:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:14.791 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1323051693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1323051693},{"type":"v1","addr":"172.21.15.12:6833","nonce":1323051693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":6921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2210278023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2210278023},{"type":"v1","addr":"172.21.15.12:6835","nonce":2210278023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:12.198777+0000","modified":"2021-10-20T23:27:13.230446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6964":{"gid":6964,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3694841345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3694841345},{"type":"v1","addr":"172.21.15.31:6835","nonce":3694841345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-20T23:27:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a04053640 msgr2=0x7f1a04055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a04053640 0x7f1a04055b00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f1a2000b000 tx=0x7f1a20006df0).stop 2021-10-20T23:27:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a241483a0 msgr2=0x7f1a24153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a241483a0 0x7f1a24153bd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f1a24147730 tx=0x7f1a1c016000).stop 2021-10-20T23:27:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 shutdown_connections 2021-10-20T23:27:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a04053640 0x7f1a04055b00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a241483a0 0x7f1a24153bd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a240b1db0 0x7f1a24064200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 --2- 172.21.15.12:0/18161882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a240a70c0 0x7f1a24062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:14.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 >> 172.21.15.12:0/18161882 conn(0x7f1a2405f6b0 msgr2=0x7f1a24143d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:14.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 shutdown_connections 2021-10-20T23:27:14.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:14.787+0000 7f1a2c18f700 1 -- 172.21.15.12:0/18161882 wait complete. 2021-10-20T23:27:14.797 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2021-10-20T23:27:15.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:27:12.198777+0000', 'modified': '2021-10-20T23:27:13.230446+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6964}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6964': {'gid': 6964, 'name': 'b', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3694841345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 3694841345}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3694841345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:27:15.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:27:15.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:27:15.232 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6964,"want_state":"up:active","state":"up:active","rank_uptime":3.009072448,"mdsmap_epoch":49,"osdmap_epoch":101,"osdmap_epoch_barrier":101,"uptime":7.3188416619999996} 2021-10-20T23:27:15.232 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6964, "mdsmap_epoch": 49, "osdmap_epoch": 101, "osdmap_epoch_barrier": 101, "rank_uptime": 3.009072448, "state": "up:active", "uptime": 7.318841662, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:27:15.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:15.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f600e700 1 Processor -- start 2021-10-20T23:27:15.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f600e700 1 -- start start 2021-10-20T23:27:15.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f600e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00b2580 0x7ff2f014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f600e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2f00b0010 0x7ff2f014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f600e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00a70c0 con 0x7ff2f00afbd0 2021-10-20T23:27:15.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f600e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f00a72f0 con 0x7ff2f00b0010 2021-10-20T23:27:15.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f600e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00a7590 con 0x7ff2f00b2580 2021-10-20T23:27:15.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f480b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2f00b0010 0x7ff2f014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f480b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2f00b0010 0x7ff2f014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42378/0 (socket says 172.21.15.12:42378) 2021-10-20T23:27:15.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f480b700 1 -- 172.21.15.12:0/1402115586 learned_addr learned my addr 172.21.15.12:0/1402115586 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:15.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f500c700 1 --2- 172.21.15.12:0/1402115586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00b2580 0x7ff2f014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f480b700 1 -- 172.21.15.12:0/1402115586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00b2580 msgr2=0x7ff2f014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:15.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f480b700 1 --2- 172.21.15.12:0/1402115586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00b2580 0x7ff2f014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.339+0000 7ff2f480b700 1 -- 172.21.15.12:0/1402115586 >> v1:172.21.15.31:6789/0 conn(0x7ff2f00afbd0 legacy=0x7ff2f00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:15.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f480b700 1 -- 172.21.15.12:0/1402115586 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00a7830 con 0x7ff2f00b0010 2021-10-20T23:27:15.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f500c700 1 --2- 172.21.15.12:0/1402115586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00b2580 0x7ff2f014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:27:15.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f480b700 1 --2- 172.21.15.12:0/1402115586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 0x7ff2f014b330 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7ff2ec0032f0 tx=0x7ff2ec009290).ready entity=mon.0 client_cookie=a026eebfb76fb352 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:15.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2e7fff700 1 -- 172.21.15.12:0/1402115586 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec00b8a0 con 0x7ff2f00b0010 2021-10-20T23:27:15.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2e7fff700 1 -- 172.21.15.12:0/1402115586 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec00ba00 con 0x7ff2f00b0010 2021-10-20T23:27:15.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2e7fff700 1 -- 172.21.15.12:0/1402115586 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec00bb70 con 0x7ff2f00b0010 2021-10-20T23:27:15.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f600e700 1 -- 172.21.15.12:0/1402115586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 msgr2=0x7ff2f014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f600e700 1 --2- 172.21.15.12:0/1402115586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 0x7ff2f014b330 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7ff2ec0032f0 tx=0x7ff2ec009290).stop 2021-10-20T23:27:15.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f600e700 1 -- 172.21.15.12:0/1402115586 shutdown_connections 2021-10-20T23:27:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f600e700 1 --2- 172.21.15.12:0/1402115586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 0x7ff2f014b330 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f600e700 1 --2- 172.21.15.12:0/1402115586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00b2580 0x7ff2f014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f600e700 1 -- 172.21.15.12:0/1402115586 >> 172.21.15.12:0/1402115586 conn(0x7ff2f0060180 msgr2=0x7ff2f00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f600e700 1 -- 172.21.15.12:0/1402115586 shutdown_connections 2021-10-20T23:27:15.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.343+0000 7ff2f600e700 1 -- 172.21.15.12:0/1402115586 wait complete. 2021-10-20T23:27:15.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f600e700 1 Processor -- start 2021-10-20T23:27:15.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f600e700 1 -- start start 2021-10-20T23:27:15.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f600e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00afbd0 0x7ff2f00ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f600e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 0x7ff2f0149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f600e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2f00b2580 0x7ff2f0159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f600e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00af430 con 0x7ff2f00b0010 2021-10-20T23:27:15.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f600e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00af6d0 con 0x7ff2f00b2580 2021-10-20T23:27:15.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f600e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00b3510 con 0x7ff2f00afbd0 2021-10-20T23:27:15.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f500c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00afbd0 0x7ff2f00ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f500c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00afbd0 0x7ff2f00ac060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:48142/0 (socket says 172.21.15.12:48142) 2021-10-20T23:27:15.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f500c700 1 -- 172.21.15.12:0/1723461460 learned_addr learned my addr 172.21.15.12:0/1723461460 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:15.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f480b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 0x7ff2f0149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.347+0000 7ff2f580d700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2f00b2580 0x7ff2f0159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f500c700 1 -- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2f00b2580 msgr2=0x7ff2f0159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f500c700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2f00b2580 0x7ff2f0159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f500c700 1 -- 172.21.15.12:0/1723461460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 msgr2=0x7ff2f0149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f500c700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 0x7ff2f0149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f500c700 1 -- 172.21.15.12:0/1723461460 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec009530 con 0x7ff2f00afbd0 2021-10-20T23:27:15.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f480b700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 0x7ff2f0149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:15.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f500c700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00afbd0 0x7ff2f00ac060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7ff2e0007000 tx=0x7ff2e0008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:15.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2e67fc700 1 -- 172.21.15.12:0/1723461460 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e000ce80 con 0x7ff2f00afbd0 2021-10-20T23:27:15.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2e67fc700 1 -- 172.21.15.12:0/1723461460 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0010580 con 0x7ff2f00afbd0 2021-10-20T23:27:15.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f00af0f0 con 0x7ff2f00afbd0 2021-10-20T23:27:15.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2e67fc700 1 -- 172.21.15.12:0/1723461460 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e00108e0 con 0x7ff2f00afbd0 2021-10-20T23:27:15.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f01456e0 con 0x7ff2f00afbd0 2021-10-20T23:27:15.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f00b3370 con 0x7ff2f00afbd0 2021-10-20T23:27:15.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2e67fc700 1 -- 172.21.15.12:0/1723461460 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2e0010a40 con 0x7ff2f00afbd0 2021-10-20T23:27:15.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2e67fc700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2d80536a0 0x7ff2d8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2e67fc700 1 -- 172.21.15.12:0/1723461460 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff2e006b7b0 con 0x7ff2f00afbd0 2021-10-20T23:27:15.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.351+0000 7ff2f480b700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2d80536a0 0x7ff2d8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.355+0000 7ff2f480b700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2d80536a0 0x7ff2d8055b60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7ff2ec01b000 tx=0x7ff2ec016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:15.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.363+0000 7ff2e67fc700 1 -- 172.21.15.12:0/1723461460 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2f00b3370 con 0x7ff2f00afbd0 2021-10-20T23:27:15.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.495+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2f00b3370 con 0x7ff2f00afbd0 2021-10-20T23:27:15.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.495+0000 7ff2e67fc700 1 -- 172.21.15.12:0/1723461460 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16277 (secure 0 0 0) 0x7ff2f00b3370 con 0x7ff2f00afbd0 2021-10-20T23:27:15.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:15.504 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":101,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:13.204259+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:10.667132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:11.561636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:15.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2d80536a0 msgr2=0x7ff2d8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2d80536a0 0x7ff2d8055b60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7ff2ec01b000 tx=0x7ff2ec016000).stop 2021-10-20T23:27:15.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00afbd0 msgr2=0x7ff2f00ac060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00afbd0 0x7ff2f00ac060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7ff2e0007000 tx=0x7ff2e0008040).stop 2021-10-20T23:27:15.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 shutdown_connections 2021-10-20T23:27:15.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff2d80536a0 0x7ff2d8055b60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2f00b2580 0x7ff2f0159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2f00b0010 0x7ff2f0149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 --2- 172.21.15.12:0/1723461460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2f00afbd0 0x7ff2f00ac060 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 >> 172.21.15.12:0/1723461460 conn(0x7ff2f0060180 msgr2=0x7ff2f0146010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:15.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 shutdown_connections 2021-10-20T23:27:15.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.499+0000 7ff2f600e700 1 -- 172.21.15.12:0/1723461460 wait complete. 2021-10-20T23:27:15.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:27:10.667132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:27:11.561636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:27:15.518 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:27:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf68c5b700 1 Processor -- start 2021-10-20T23:27:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf68c5b700 1 -- start start 2021-10-20T23:27:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf68c5b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf640b1ec0 0x7fbf640b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf68c5b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 0x7fbf640b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf68c5b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf640b0420 con 0x7fbf640a70c0 2021-10-20T23:27:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf68c5b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf640b2790 con 0x7fbf640b1ec0 2021-10-20T23:27:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf68c5b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640b0650 con 0x7fbf640affb0 2021-10-20T23:27:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf6259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf640b1ec0 0x7fbf640b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf6259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf640b1ec0 0x7fbf640b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42392/0 (socket says 172.21.15.12:42392) 2021-10-20T23:27:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf6259c700 1 -- 172.21.15.12:0/621167093 learned_addr learned my addr 172.21.15.12:0/621167093 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:15.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf61d9b700 1 --2- 172.21.15.12:0/621167093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 0x7fbf640b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf6259c700 1 -- 172.21.15.12:0/621167093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 msgr2=0x7fbf640b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:15.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf6259c700 1 --2- 172.21.15.12:0/621167093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 0x7fbf640b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf6159a700 1 -- 172.21.15.12:0/621167093 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542002807 0 0) 0x7fbf640b0420 con 0x7fbf640a70c0 2021-10-20T23:27:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf6259c700 1 -- 172.21.15.12:0/621167093 >> v1:172.21.15.31:6789/0 conn(0x7fbf640a70c0 legacy=0x7fbf64141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.623+0000 7fbf6259c700 1 -- 172.21.15.12:0/621167093 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf640b08f0 con 0x7fbf640b1ec0 2021-10-20T23:27:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf6259c700 1 --2- 172.21.15.12:0/621167093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 0x7fbf640b12d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fbf58002f70 tx=0x7fbf58006eb0).ready entity=mon.0 client_cookie=392167b11bb88bb6 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf6159a700 1 -- 172.21.15.12:0/621167093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf5800d570 con 0x7fbf640b1ec0 2021-10-20T23:27:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf6159a700 1 -- 172.21.15.12:0/621167093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf58000e90 con 0x7fbf640b1ec0 2021-10-20T23:27:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf6159a700 1 -- 172.21.15.12:0/621167093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf5800d8c0 con 0x7fbf640b1ec0 2021-10-20T23:27:15.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 -- 172.21.15.12:0/621167093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 msgr2=0x7fbf640b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 --2- 172.21.15.12:0/621167093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 0x7fbf640b12d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fbf58002f70 tx=0x7fbf58006eb0).stop 2021-10-20T23:27:15.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 -- 172.21.15.12:0/621167093 shutdown_connections 2021-10-20T23:27:15.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 --2- 172.21.15.12:0/621167093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 0x7fbf640b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 --2- 172.21.15.12:0/621167093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 0x7fbf640b12d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 -- 172.21.15.12:0/621167093 >> 172.21.15.12:0/621167093 conn(0x7fbf6405f6b0 msgr2=0x7fbf6405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 -- 172.21.15.12:0/621167093 shutdown_connections 2021-10-20T23:27:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 -- 172.21.15.12:0/621167093 wait complete. 2021-10-20T23:27:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 Processor -- start 2021-10-20T23:27:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.627+0000 7fbf68c5b700 1 -- start start 2021-10-20T23:27:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf68c5b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640a70c0 0x7fbf64146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf68c5b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 0x7fbf640abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf68c5b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 0x7fbf6415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf68c5b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6414ba10 con 0x7fbf640b1ec0 2021-10-20T23:27:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf68c5b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf64156900 con 0x7fbf640a70c0 2021-10-20T23:27:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf68c5b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6414b6f0 con 0x7fbf640affb0 2021-10-20T23:27:15.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf62d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 0x7fbf6415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf62d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 0x7fbf6415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42402/0 (socket says 172.21.15.12:42402) 2021-10-20T23:27:15.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf62d9d700 1 -- 172.21.15.12:0/4004504371 learned_addr learned my addr 172.21.15.12:0/4004504371 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:15.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf61d9b700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 0x7fbf640abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf6259c700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640a70c0 0x7fbf64146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf62d9d700 1 -- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 msgr2=0x7fbf640abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf62d9d700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 0x7fbf640abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf62d9d700 1 -- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640a70c0 msgr2=0x7fbf64146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf62d9d700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640a70c0 0x7fbf64146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf62d9d700 1 -- 172.21.15.12:0/4004504371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5800b1e0 con 0x7fbf640b1ec0 2021-10-20T23:27:15.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf62d9d700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 0x7fbf6415a1a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7fbf5c000bc0 tx=0x7fbf5c0079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:15.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf537fe700 1 -- 172.21.15.12:0/4004504371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf5c012400 con 0x7fbf640b1ec0 2021-10-20T23:27:15.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf537fe700 1 -- 172.21.15.12:0/4004504371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c012560 con 0x7fbf640b1ec0 2021-10-20T23:27:15.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6414af10 con 0x7fbf640b1ec0 2021-10-20T23:27:15.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf537fe700 1 -- 172.21.15.12:0/4004504371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf5c0128c0 con 0x7fbf640b1ec0 2021-10-20T23:27:15.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6414ac00 con 0x7fbf640b1ec0 2021-10-20T23:27:15.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6414b560 con 0x7fbf640b1ec0 2021-10-20T23:27:15.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.631+0000 7fbf537fe700 1 -- 172.21.15.12:0/4004504371 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf5c019030 con 0x7fbf640b1ec0 2021-10-20T23:27:15.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.635+0000 7fbf537fe700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf400536a0 0x7fbf40055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.635+0000 7fbf537fe700 1 -- 172.21.15.12:0/4004504371 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbf5c06af20 con 0x7fbf640b1ec0 2021-10-20T23:27:15.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.635+0000 7fbf6259c700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf400536a0 0x7fbf40055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.635+0000 7fbf6259c700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf400536a0 0x7fbf40055b60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fbf5801a000 tx=0x7fbf58015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:15.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.639+0000 7fbf537fe700 1 -- 172.21.15.12:0/4004504371 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf5c041f20 con 0x7fbf640b1ec0 2021-10-20T23:27:15.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbf640b0b90 con 0x7fbf640b1ec0 2021-10-20T23:27:15.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf537fe700 1 -- 172.21.15.12:0/4004504371 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v101) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbf5c045540 con 0x7fbf640b1ec0 2021-10-20T23:27:15.773 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:27:15.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf400536a0 msgr2=0x7fbf40055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf400536a0 0x7fbf40055b60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fbf5801a000 tx=0x7fbf58015000).stop 2021-10-20T23:27:15.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 msgr2=0x7fbf6415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 0x7fbf6415a1a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7fbf5c000bc0 tx=0x7fbf5c0079e0).stop 2021-10-20T23:27:15.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 shutdown_connections 2021-10-20T23:27:15.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf400536a0 0x7fbf40055b60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf640b1ec0 0x7fbf6415a1a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf640affb0 0x7fbf640abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 --2- 172.21.15.12:0/4004504371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640a70c0 0x7fbf64146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 >> 172.21.15.12:0/4004504371 conn(0x7fbf6405f6b0 msgr2=0x7fbf640af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:15.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 shutdown_connections 2021-10-20T23:27:15.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.763+0000 7fbf68c5b700 1 -- 172.21.15.12:0/4004504371 wait complete. 2021-10-20T23:27:15.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:27:15.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997f28b700 1 Processor -- start 2021-10-20T23:27:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997f28b700 1 -- start start 2021-10-20T23:27:15.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997f28b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99780af2c0 0x7f99780af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997f28b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99780ad320 0x7f9978143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997f28b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99780afda0 con 0x7f9978143640 2021-10-20T23:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997f28b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997805c610 con 0x7f99780ad320 2021-10-20T23:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997f28b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9978140800 con 0x7f99780af2c0 2021-10-20T23:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997e289700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99780af2c0 0x7f99780af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997da88700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99780ad320 0x7f9978143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997da88700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99780ad320 0x7f9978143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:57380/0 (socket says 172.21.15.12:57380) 2021-10-20T23:27:15.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997da88700 1 -- 172.21.15.12:0/685465686 learned_addr learned my addr 172.21.15.12:0/685465686 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:15.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997e289700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99780af2c0 0x7f99780af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:48166/0 (socket says 172.21.15.12:48166) 2021-10-20T23:27:15.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997da88700 1 -- 172.21.15.12:0/685465686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99780af2c0 msgr2=0x7f99780af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:15.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997da88700 1 --2- 172.21.15.12:0/685465686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99780af2c0 0x7f99780af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997da88700 1 -- 172.21.15.12:0/685465686 >> v1:172.21.15.31:6789/0 conn(0x7f9978143640 legacy=0x7f99780a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997da88700 1 -- 172.21.15.12:0/685465686 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99780a93c0 con 0x7f99780ad320 2021-10-20T23:27:15.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997da88700 1 --2- 172.21.15.12:0/685465686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780ad320 0x7f9978143150 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f997813fc30 tx=0x7f9974009290).ready entity=mon.1 client_cookie=7417639b06bcdb21 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:15.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997d287700 1 -- 172.21.15.12:0/685465686 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f997400b860 con 0x7f99780ad320 2021-10-20T23:27:15.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997d287700 1 -- 172.21.15.12:0/685465686 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997400b9c0 con 0x7f99780ad320 2021-10-20T23:27:15.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.883+0000 7f997d287700 1 -- 172.21.15.12:0/685465686 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f997400bb30 con 0x7f99780ad320 2021-10-20T23:27:15.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- 172.21.15.12:0/685465686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780ad320 msgr2=0x7f9978143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 --2- 172.21.15.12:0/685465686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780ad320 0x7f9978143150 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f997813fc30 tx=0x7f9974009290).stop 2021-10-20T23:27:15.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- 172.21.15.12:0/685465686 shutdown_connections 2021-10-20T23:27:15.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 --2- 172.21.15.12:0/685465686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780ad320 0x7f9978143150 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 --2- 172.21.15.12:0/685465686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99780af2c0 0x7f99780af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- 172.21.15.12:0/685465686 >> 172.21.15.12:0/685465686 conn(0x7f9978061140 msgr2=0x7f9978062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:15.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- 172.21.15.12:0/685465686 shutdown_connections 2021-10-20T23:27:15.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- 172.21.15.12:0/685465686 wait complete. 2021-10-20T23:27:15.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 Processor -- start 2021-10-20T23:27:15.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- start start 2021-10-20T23:27:15.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780ad320 0x7f99780b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99780af2c0 0x7f997813bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9978143640 0x7f9978152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9978156470 con 0x7f99780af2c0 2021-10-20T23:27:15.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9978156710 con 0x7f99780ad320 2021-10-20T23:27:15.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99780b3860 con 0x7f9978143640 2021-10-20T23:27:15.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997da88700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99780af2c0 0x7f997813bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997da88700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99780af2c0 0x7f997813bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42412/0 (socket says 172.21.15.12:42412) 2021-10-20T23:27:15.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997da88700 1 -- 172.21.15.12:0/1166910553 learned_addr learned my addr 172.21.15.12:0/1166910553 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:15.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997e289700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780ad320 0x7f99780b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997ea8a700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9978143640 0x7f9978152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997da88700 1 -- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9978143640 msgr2=0x7f9978152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997da88700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9978143640 0x7f9978152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997da88700 1 -- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780ad320 msgr2=0x7f99780b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:15.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997da88700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780ad320 0x7f99780b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:15.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997da88700 1 -- 172.21.15.12:0/1166910553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974009530 con 0x7f99780af2c0 2021-10-20T23:27:15.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997ea8a700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9978143640 0x7f9978152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:27:15.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997da88700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99780af2c0 0x7f997813bf60 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f997813fc30 tx=0x7f9974016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:15.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f996b7fe700 1 -- 172.21.15.12:0/1166910553 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9974021630 con 0x7f99780af2c0 2021-10-20T23:27:15.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f996b7fe700 1 -- 172.21.15.12:0/1166910553 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974021790 con 0x7f99780af2c0 2021-10-20T23:27:15.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.887+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99780b3b00 con 0x7f99780af2c0 2021-10-20T23:27:15.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.891+0000 7f996b7fe700 1 -- 172.21.15.12:0/1166910553 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9974021af0 con 0x7f99780af2c0 2021-10-20T23:27:15.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.891+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9978143360 con 0x7f99780af2c0 2021-10-20T23:27:15.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.891+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99780b3c90 con 0x7f99780af2c0 2021-10-20T23:27:15.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.891+0000 7f996b7fe700 1 -- 172.21.15.12:0/1166910553 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f997400f070 con 0x7f99780af2c0 2021-10-20T23:27:15.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.891+0000 7f996b7fe700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f99580534f0 0x7f99580559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:15.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.891+0000 7f996b7fe700 1 -- 172.21.15.12:0/1166910553 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f997406c230 con 0x7f99780af2c0 2021-10-20T23:27:15.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.891+0000 7f997e289700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f99580534f0 0x7f99580559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:15.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.891+0000 7f997e289700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f99580534f0 0x7f99580559b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f996c008000 tx=0x7f996c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:15.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:15.899+0000 7f996b7fe700 1 -- 172.21.15.12:0/1166910553 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9974043270 con 0x7f99780af2c0 2021-10-20T23:27:16.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.027+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9978057350 con 0x7f99780af2c0 2021-10-20T23:27:16.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.027+0000 7f996b7fe700 1 -- 172.21.15.12:0/1166910553 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v101) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9974015070 con 0x7f99780af2c0 2021-10-20T23:27:16.035 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:16.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f99580534f0 msgr2=0x7f99580559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f99580534f0 0x7f99580559b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f996c008000 tx=0x7f996c008040).stop 2021-10-20T23:27:16.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99780af2c0 msgr2=0x7f997813bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99780af2c0 0x7f997813bf60 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f997813fc30 tx=0x7f9974016000).stop 2021-10-20T23:27:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 shutdown_connections 2021-10-20T23:27:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f99580534f0 0x7f99580559b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9978143640 0x7f9978152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99780af2c0 0x7f997813bf60 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 --2- 172.21.15.12:0/1166910553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780ad320 0x7f99780b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 >> 172.21.15.12:0/1166910553 conn(0x7f9978061140 msgr2=0x7f997813dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 shutdown_connections 2021-10-20T23:27:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.031+0000 7f997f28b700 1 -- 172.21.15.12:0/1166910553 wait complete. 2021-10-20T23:27:16.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:27:16.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.155+0000 7f91b3fff700 1 Processor -- start 2021-10-20T23:27:16.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.155+0000 7f91b3fff700 1 -- start start 2021-10-20T23:27:16.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.155+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b40b4710 0x7f91b413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.155+0000 7f91b3fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40b6910 con 0x7f91b4061680 2021-10-20T23:27:16.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.155+0000 7f91b3fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40b6bb0 con 0x7f91b41439a0 2021-10-20T23:27:16.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.155+0000 7f91b3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40b9680 con 0x7f91b40b4710 2021-10-20T23:27:16.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.155+0000 7f91b2ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f91b4061680 0x7f91b40b9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41014/0 (socket says 172.21.15.12:41014) 2021-10-20T23:27:16.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.155+0000 7f91b2ffd700 1 -- 172.21.15.12:0/1387126506 learned_addr learned my addr 172.21.15.12:0/1387126506 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.155+0000 7f91b27fc700 1 --2- 172.21.15.12:0/1387126506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b40b4710 0x7f91b413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b1ffb700 1 -- 172.21.15.12:0/1387126506 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187700061 0 0) 0x7f91b40b6910 con 0x7f91b4061680 2021-10-20T23:27:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b1ffb700 1 -- 172.21.15.12:0/1387126506 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9198003260 con 0x7f91b4061680 2021-10-20T23:27:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b27fc700 1 -- 172.21.15.12:0/1387126506 >> v1:172.21.15.31:6789/0 conn(0x7f91b41439a0 legacy=0x7f91b4140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b27fc700 1 -- 172.21.15.12:0/1387126506 >> v1:172.21.15.12:6789/0 conn(0x7f91b4061680 legacy=0x7f91b40b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b27fc700 1 -- 172.21.15.12:0/1387126506 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40b6e50 con 0x7f91b40b4710 2021-10-20T23:27:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b27fc700 1 --2- 172.21.15.12:0/1387126506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b40b4710 0x7f91b413fda0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f91a4002f70 tx=0x7f91a4006df0).ready entity=mon.2 client_cookie=1af248d8c5507705 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b1ffb700 1 -- 172.21.15.12:0/1387126506 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a400d570 con 0x7f91b40b4710 2021-10-20T23:27:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b1ffb700 1 -- 172.21.15.12:0/1387126506 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4000e90 con 0x7f91b40b4710 2021-10-20T23:27:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b1ffb700 1 -- 172.21.15.12:0/1387126506 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a400d8c0 con 0x7f91b40b4710 2021-10-20T23:27:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b3fff700 1 -- 172.21.15.12:0/1387126506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b40b4710 msgr2=0x7f91b413fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b3fff700 1 --2- 172.21.15.12:0/1387126506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b40b4710 0x7f91b413fda0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f91a4002f70 tx=0x7f91a4006df0).stop 2021-10-20T23:27:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b3fff700 1 -- 172.21.15.12:0/1387126506 shutdown_connections 2021-10-20T23:27:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b3fff700 1 --2- 172.21.15.12:0/1387126506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b40b4710 0x7f91b413fda0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b3fff700 1 -- 172.21.15.12:0/1387126506 >> 172.21.15.12:0/1387126506 conn(0x7f91b406adf0 msgr2=0x7f91b405f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b3fff700 1 -- 172.21.15.12:0/1387126506 shutdown_connections 2021-10-20T23:27:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b3fff700 1 -- 172.21.15.12:0/1387126506 wait complete. 2021-10-20T23:27:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b3fff700 1 Processor -- start 2021-10-20T23:27:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.159+0000 7f91b3fff700 1 -- start start 2021-10-20T23:27:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b4061680 0x7f91b40b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b41439a0 0x7f91b413c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40ad6a0 0x7f91b413c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4156bf0 con 0x7f91b41439a0 2021-10-20T23:27:16.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b3fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4155d40 con 0x7f91b40ad6a0 2021-10-20T23:27:16.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4113600 con 0x7f91b4061680 2021-10-20T23:27:16.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b41439a0 0x7f91b413c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b41439a0 0x7f91b413c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42428/0 (socket says 172.21.15.12:42428) 2021-10-20T23:27:16.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b27fc700 1 -- 172.21.15.12:0/4252425758 learned_addr learned my addr 172.21.15.12:0/4252425758 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:16.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b37fe700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40ad6a0 0x7f91b413c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b2ffd700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b4061680 0x7f91b40b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b27fc700 1 -- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b4061680 msgr2=0x7f91b40b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b27fc700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b4061680 0x7f91b40b8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b27fc700 1 -- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40ad6a0 msgr2=0x7f91b413c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b27fc700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40ad6a0 0x7f91b413c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b27fc700 1 -- 172.21.15.12:0/4252425758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a400b180 con 0x7f91b41439a0 2021-10-20T23:27:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b2ffd700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b4061680 0x7f91b40b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b27fc700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b41439a0 0x7f91b413c050 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f91b4156d30 tx=0x7f91a4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91a3fff700 1 -- 172.21.15.12:0/4252425758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a400dea0 con 0x7f91b41439a0 2021-10-20T23:27:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91a3fff700 1 -- 172.21.15.12:0/4252425758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4013e50 con 0x7f91b41439a0 2021-10-20T23:27:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91a3fff700 1 -- 172.21.15.12:0/4252425758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a401e5f0 con 0x7f91b41439a0 2021-10-20T23:27:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b4155f70 con 0x7f91b41439a0 2021-10-20T23:27:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b41564b0 con 0x7f91b41439a0 2021-10-20T23:27:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.163+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b40b6350 con 0x7f91b41439a0 2021-10-20T23:27:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.167+0000 7f91a3fff700 1 -- 172.21.15.12:0/4252425758 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f91a401c070 con 0x7f91b41439a0 2021-10-20T23:27:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.167+0000 7f91a3fff700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91900535b0 0x7f9190055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.167+0000 7f91a3fff700 1 -- 172.21.15.12:0/4252425758 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f91a406c630 con 0x7f91b41439a0 2021-10-20T23:27:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.167+0000 7f91b2ffd700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91900535b0 0x7f9190055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.167+0000 7f91b2ffd700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91900535b0 0x7f9190055a70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f91a800b000 tx=0x7f91a8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.175+0000 7f91a3fff700 1 -- 172.21.15.12:0/4252425758 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f91a4043520 con 0x7f91b41439a0 2021-10-20T23:27:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.303+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91b41568f0 con 0x7f91b41439a0 2021-10-20T23:27:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.303+0000 7f91a3fff700 1 -- 172.21.15.12:0/4252425758 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) v1 ==== 104+0+10 (secure 0 0 0) 0x7f91a4046b40 con 0x7f91b41439a0 2021-10-20T23:27:16.311 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91900535b0 msgr2=0x7f9190055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91900535b0 0x7f9190055a70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f91a800b000 tx=0x7f91a8009040).stop 2021-10-20T23:27:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b41439a0 msgr2=0x7f91b413c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b41439a0 0x7f91b413c050 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f91b4156d30 tx=0x7f91a4014000).stop 2021-10-20T23:27:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 shutdown_connections 2021-10-20T23:27:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f91900535b0 0x7f9190055a70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40ad6a0 0x7f91b413c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b41439a0 0x7f91b413c050 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 --2- 172.21.15.12:0/4252425758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91b4061680 0x7f91b40b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 >> 172.21.15.12:0/4252425758 conn(0x7f91b406adf0 msgr2=0x7f91b405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 shutdown_connections 2021-10-20T23:27:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.307+0000 7f91b3fff700 1 -- 172.21.15.12:0/4252425758 wait complete. 2021-10-20T23:27:16.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:27:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.431+0000 7f3f5e475700 1 Processor -- start 2021-10-20T23:27:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.431+0000 7f3f5e475700 1 -- start start 2021-10-20T23:27:16.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b2580 0x7f3f580abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3f580b1260 0x7f3f580ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f580add80 con 0x7f3f580b1790 2021-10-20T23:27:16.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f580ae020 con 0x7f3f580b1260 2021-10-20T23:27:16.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580a9390 con 0x7f3f580b2580 2021-10-20T23:27:16.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5cc72700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3f580b1260 0x7f3f580ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5cc72700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3f580b1260 0x7f3f580ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42438/0 (socket says 172.21.15.12:42438) 2021-10-20T23:27:16.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5dc74700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3f580b1790 0x7f3f580afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:48094/0 (socket says 172.21.15.12:48094) 2021-10-20T23:27:16.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5cc72700 1 -- 172.21.15.12:0/1514853109 learned_addr learned my addr 172.21.15.12:0/1514853109 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:16.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5d473700 1 --2- 172.21.15.12:0/1514853109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b2580 0x7f3f580abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5cc72700 1 -- 172.21.15.12:0/1514853109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b2580 msgr2=0x7f3f580abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:16.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5cc72700 1 --2- 172.21.15.12:0/1514853109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b2580 0x7f3f580abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5cc72700 1 -- 172.21.15.12:0/1514853109 >> v1:172.21.15.31:6789/0 conn(0x7f3f580b1790 legacy=0x7f3f580afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f47fff700 1 -- 172.21.15.12:0/1514853109 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291778382 0 0) 0x7f3f580add80 con 0x7f3f580b1790 2021-10-20T23:27:16.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5cc72700 1 -- 172.21.15.12:0/1514853109 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580a9830 con 0x7f3f580b1260 2021-10-20T23:27:16.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5cc72700 1 --2- 172.21.15.12:0/1514853109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b1260 0x7f3f580ac000 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f3f58067a30 tx=0x7f3f48006f40).ready entity=mon.0 client_cookie=681fb6e7d3c50877 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:16.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f47fff700 1 -- 172.21.15.12:0/1514853109 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f4800da40 con 0x7f3f580b1260 2021-10-20T23:27:16.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f47fff700 1 -- 172.21.15.12:0/1514853109 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f48000e90 con 0x7f3f580b1260 2021-10-20T23:27:16.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f47fff700 1 -- 172.21.15.12:0/1514853109 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f4800dd90 con 0x7f3f580b1260 2021-10-20T23:27:16.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 -- 172.21.15.12:0/1514853109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b1260 msgr2=0x7f3f580ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 --2- 172.21.15.12:0/1514853109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b1260 0x7f3f580ac000 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f3f58067a30 tx=0x7f3f48006f40).stop 2021-10-20T23:27:16.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 -- 172.21.15.12:0/1514853109 shutdown_connections 2021-10-20T23:27:16.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 --2- 172.21.15.12:0/1514853109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b1260 0x7f3f580ac000 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 --2- 172.21.15.12:0/1514853109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b2580 0x7f3f580abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 -- 172.21.15.12:0/1514853109 >> 172.21.15.12:0/1514853109 conn(0x7f3f58060180 msgr2=0x7f3f580b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 -- 172.21.15.12:0/1514853109 shutdown_connections 2021-10-20T23:27:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.435+0000 7f3f5e475700 1 -- 172.21.15.12:0/1514853109 wait complete. 2021-10-20T23:27:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5e475700 1 Processor -- start 2021-10-20T23:27:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5e475700 1 -- start start 2021-10-20T23:27:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5e475700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f580b1260 0x7f3f58151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5e475700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b1790 0x7f3f58144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5e475700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b2580 0x7f3f580aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5e475700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f58152180 con 0x7f3f580b2580 2021-10-20T23:27:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5e475700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f58141790 con 0x7f3f580b1260 2021-10-20T23:27:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5e475700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f58140fb0 con 0x7f3f580b1790 2021-10-20T23:27:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5dc74700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b2580 0x7f3f580aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5dc74700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b2580 0x7f3f580aac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42444/0 (socket says 172.21.15.12:42444) 2021-10-20T23:27:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.439+0000 7f3f5d473700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f580b1260 0x7f3f58151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5dc74700 1 -- 172.21.15.12:0/2084048823 learned_addr learned my addr 172.21.15.12:0/2084048823 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5cc72700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b1790 0x7f3f58144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5dc74700 1 -- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b1790 msgr2=0x7f3f58144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5dc74700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b1790 0x7f3f58144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5dc74700 1 -- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f580b1260 msgr2=0x7f3f58151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5dc74700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f580b1260 0x7f3f58151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5dc74700 1 -- 172.21.15.12:0/2084048823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4800b460 con 0x7f3f580b2580 2021-10-20T23:27:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5d473700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f580b1260 0x7f3f58151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5dc74700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b2580 0x7f3f580aac00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f3f581522c0 tx=0x7f3f50001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:16.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f467fc700 1 -- 172.21.15.12:0/2084048823 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f50005ae0 con 0x7f3f580b2580 2021-10-20T23:27:16.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f467fc700 1 -- 172.21.15.12:0/2084048823 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50005c40 con 0x7f3f580b2580 2021-10-20T23:27:16.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f467fc700 1 -- 172.21.15.12:0/2084048823 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f500070d0 con 0x7f3f580b2580 2021-10-20T23:27:16.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f58141250 con 0x7f3f580b2580 2021-10-20T23:27:16.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f58144fa0 con 0x7f3f580b2580 2021-10-20T23:27:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f467fc700 1 -- 172.21.15.12:0/2084048823 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3f50010070 con 0x7f3f580b2580 2021-10-20T23:27:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f58057350 con 0x7f3f580b2580 2021-10-20T23:27:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.443+0000 7f3f467fc700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3f380536a0 0x7f3f38055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.447+0000 7f3f467fc700 1 -- 172.21.15.12:0/2084048823 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3f5006b3b0 con 0x7f3f580b2580 2021-10-20T23:27:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.447+0000 7f3f5d473700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3f380536a0 0x7f3f38055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.447+0000 7f3f5d473700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3f380536a0 0x7f3f38055b60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f3f5400b000 tx=0x7f3f54006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.451+0000 7f3f467fc700 1 -- 172.21.15.12:0/2084048823 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3f500423b0 con 0x7f3f580b2580 2021-10-20T23:27:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.579+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f5814dd30 con 0x7f3f580b2580 2021-10-20T23:27:16.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.579+0000 7f3f467fc700 1 -- 172.21.15.12:0/2084048823 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3f500459d0 con 0x7f3f580b2580 2021-10-20T23:27:16.588 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3f380536a0 msgr2=0x7f3f38055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3f380536a0 0x7f3f38055b60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f3f5400b000 tx=0x7f3f54006df0).stop 2021-10-20T23:27:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b2580 msgr2=0x7f3f580aac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b2580 0x7f3f580aac00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f3f581522c0 tx=0x7f3f50001360).stop 2021-10-20T23:27:16.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 shutdown_connections 2021-10-20T23:27:16.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3f380536a0 0x7f3f38055b60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f580b2580 0x7f3f580aac00 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f580b1790 0x7f3f58144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 --2- 172.21.15.12:0/2084048823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f580b1260 0x7f3f58151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 >> 172.21.15.12:0/2084048823 conn(0x7f3f58060180 msgr2=0x7f3f580b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 shutdown_connections 2021-10-20T23:27:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.583+0000 7f3f5e475700 1 -- 172.21.15.12:0/2084048823 wait complete. 2021-10-20T23:27:16.601 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:27:16.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:16.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 Processor -- start 2021-10-20T23:27:16.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 -- start start 2021-10-20T23:27:16.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03440b0b80 0x7f0344146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b03d0 0x7f03441401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03440b1140 con 0x7f03440a9190 2021-10-20T23:27:16.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03440a9570 con 0x7f03440b0b80 2021-10-20T23:27:16.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b1370 con 0x7f03440b03d0 2021-10-20T23:27:16.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349805700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03440b0b80 0x7f0344146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349805700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03440b0b80 0x7f0344146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:57422/0 (socket says 172.21.15.12:57422) 2021-10-20T23:27:16.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349805700 1 -- 172.21.15.12:0/1262285572 learned_addr learned my addr 172.21.15.12:0/1262285572 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:16.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034a006700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f03440a9190 0x7f0344146550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41044/0 (socket says 172.21.15.12:41044) 2021-10-20T23:27:16.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034a807700 1 --2- 172.21.15.12:0/1262285572 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b03d0 0x7f03441401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349805700 1 -- 172.21.15.12:0/1262285572 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b03d0 msgr2=0x7f03441401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:16.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349805700 1 --2- 172.21.15.12:0/1262285572 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b03d0 0x7f03441401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349805700 1 -- 172.21.15.12:0/1262285572 >> v1:172.21.15.12:6789/0 conn(0x7f03440a9190 legacy=0x7f0344146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349004700 1 -- 172.21.15.12:0/1262285572 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075903364 0 0) 0x7f03440b1140 con 0x7f03440a9190 2021-10-20T23:27:16.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349805700 1 -- 172.21.15.12:0/1262285572 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03440b1610 con 0x7f03440b0b80 2021-10-20T23:27:16.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349805700 1 --2- 172.21.15.12:0/1262285572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440b0b80 0x7f0344146c60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f0334002f70 tx=0x7f0334006eb0).ready entity=mon.1 client_cookie=b4bb5ffda04b3e5a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:16.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349004700 1 -- 172.21.15.12:0/1262285572 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033400d570 con 0x7f03440b0b80 2021-10-20T23:27:16.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349004700 1 -- 172.21.15.12:0/1262285572 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0334000e90 con 0x7f03440b0b80 2021-10-20T23:27:16.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f0349004700 1 -- 172.21.15.12:0/1262285572 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033400d8c0 con 0x7f03440b0b80 2021-10-20T23:27:16.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 -- 172.21.15.12:0/1262285572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440b0b80 msgr2=0x7f0344146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 --2- 172.21.15.12:0/1262285572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440b0b80 0x7f0344146c60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f0334002f70 tx=0x7f0334006eb0).stop 2021-10-20T23:27:16.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 -- 172.21.15.12:0/1262285572 shutdown_connections 2021-10-20T23:27:16.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 --2- 172.21.15.12:0/1262285572 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b03d0 0x7f03441401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 --2- 172.21.15.12:0/1262285572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440b0b80 0x7f0344146c60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 -- 172.21.15.12:0/1262285572 >> 172.21.15.12:0/1262285572 conn(0x7f0344061140 msgr2=0x7f0344062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:16.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 -- 172.21.15.12:0/1262285572 shutdown_connections 2021-10-20T23:27:16.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.703+0000 7f034b008700 1 -- 172.21.15.12:0/1262285572 wait complete. 2021-10-20T23:27:16.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034b008700 1 Processor -- start 2021-10-20T23:27:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034b008700 1 -- start start 2021-10-20T23:27:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034b008700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9190 0x7f03441436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034b008700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b03d0 0x7f03440b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034b008700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b0b80 0x7f03440b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034b008700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344140ea0 con 0x7f03440b03d0 2021-10-20T23:27:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034b008700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b4de0 con 0x7f03440a9190 2021-10-20T23:27:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034b008700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b60f0 con 0x7f03440b0b80 2021-10-20T23:27:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f0349805700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b03d0 0x7f03440b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f0349805700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b03d0 0x7f03440b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42456/0 (socket says 172.21.15.12:42456) 2021-10-20T23:27:16.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f0349805700 1 -- 172.21.15.12:0/3768248194 learned_addr learned my addr 172.21.15.12:0/3768248194 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:16.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034a006700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9190 0x7f03441436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034a807700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b0b80 0x7f03440b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f0349805700 1 -- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b0b80 msgr2=0x7f03440b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f0349805700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b0b80 0x7f03440b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f0349805700 1 -- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9190 msgr2=0x7f03441436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f0349805700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9190 0x7f03441436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f0349805700 1 -- 172.21.15.12:0/3768248194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033400b1e0 con 0x7f03440b03d0 2021-10-20T23:27:16.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f034a807700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b0b80 0x7f03440b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:16.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.707+0000 7f0349805700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b03d0 0x7f03440b5710 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f0334002f70 tx=0x7f0334015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:16.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f03337fe700 1 -- 172.21.15.12:0/3768248194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0334011860 con 0x7f03440b03d0 2021-10-20T23:27:16.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f03337fe700 1 -- 172.21.15.12:0/3768248194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03340119c0 con 0x7f03440b03d0 2021-10-20T23:27:16.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03440b4900 con 0x7f03440b03d0 2021-10-20T23:27:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f03337fe700 1 -- 172.21.15.12:0/3768248194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0334011d20 con 0x7f03440b03d0 2021-10-20T23:27:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03440b5240 con 0x7f03440b03d0 2021-10-20T23:27:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f03337fe700 1 -- 172.21.15.12:0/3768248194 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0334025030 con 0x7f03440b03d0 2021-10-20T23:27:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0344057350 con 0x7f03440b03d0 2021-10-20T23:27:16.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f03337fe700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240536d0 0x7f0324055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:16.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f03337fe700 1 -- 172.21.15.12:0/3768248194 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f033406cc10 con 0x7f03440b03d0 2021-10-20T23:27:16.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f034a006700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240536d0 0x7f0324055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:16.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.711+0000 7f034a006700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240536d0 0x7f0324055b90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f034000d000 tx=0x7f0340007bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:16.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.719+0000 7f03337fe700 1 -- 172.21.15.12:0/3768248194 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0334043c10 con 0x7f03440b03d0 2021-10-20T23:27:16.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03440b4520 con 0x7f03440b03d0 2021-10-20T23:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f03337fe700 1 -- 172.21.15.12:0/3768248194 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f0334023070 con 0x7f03440b03d0 2021-10-20T23:27:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:16.891 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1323051693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1323051693},{"type":"v1","addr":"172.21.15.12:6833","nonce":1323051693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":6921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2210278023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2210278023},{"type":"v1","addr":"172.21.15.12:6835","nonce":2210278023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:12.198777+0000","modified":"2021-10-20T23:27:13.230446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6964":{"gid":6964,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3694841345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3694841345},{"type":"v1","addr":"172.21.15.31:6835","nonce":3694841345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-20T23:27:16.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240536d0 msgr2=0x7f0324055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240536d0 0x7f0324055b90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f034000d000 tx=0x7f0340007bc0).stop 2021-10-20T23:27:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b03d0 msgr2=0x7f03440b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b03d0 0x7f03440b5710 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f0334002f70 tx=0x7f0334015000).stop 2021-10-20T23:27:16.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 shutdown_connections 2021-10-20T23:27:16.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240536d0 0x7f0324055b90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03440b0b80 0x7f03440b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b03d0 0x7f03440b5710 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 --2- 172.21.15.12:0/3768248194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9190 0x7f03441436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:16.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.883+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 >> 172.21.15.12:0/3768248194 conn(0x7f0344061140 msgr2=0x7f034413df00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:16.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.887+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 shutdown_connections 2021-10-20T23:27:16.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:16.887+0000 7f034b008700 1 -- 172.21.15.12:0/3768248194 wait complete. 2021-10-20T23:27:16.896 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2021-10-20T23:27:17.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:27:12.198777+0000', 'modified': '2021-10-20T23:27:13.230446+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6964}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6964': {'gid': 6964, 'name': 'b', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3694841345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 3694841345}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3694841345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:27:17.210 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:27:17.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:27:17.329 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6964,"want_state":"up:active","state":"up:active","rank_uptime":5.1083528229999997,"mdsmap_epoch":49,"osdmap_epoch":101,"osdmap_epoch_barrier":101,"uptime":9.4181149669999993} 2021-10-20T23:27:17.329 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6964, "mdsmap_epoch": 49, "osdmap_epoch": 101, "osdmap_epoch_barrier": 101, "rank_uptime": 5.108352823, "state": "up:active", "uptime": 9.418114967, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:27:17.331 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:27:17.331 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:27:17.332 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:27:17.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:17.333 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:17.342 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:27:17.402 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:27:17.403 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:27:17.413 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:27:17.414 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:27:17.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:17.415 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:27:17.420 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:27:17.421 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:17.424 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:27:17.439 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:27:17.440 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:27:17.499 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:27:17.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14635]: starting ceph client 2021-10-20T23:27:17.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:27:17.491+0000 7f28b9bdc080 -1 init, newargv = 0x55d356694c90 newargc=9 2021-10-20T23:27:17.509 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:27:17.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:17.511 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:27:17.512 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14635]: starting fuse 2021-10-20T23:27:17.518 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:27:17.519 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:27:17.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:17.521 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:27:17.522 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:27:17.522 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:27:17.523 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:27:17.523 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:27:17.523 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:27:17.524 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:27:17.524 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:27:17.525 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:27:17.525 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:27:17.525 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:27:17.526 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:27:17.526 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:27:17.527 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:27:17.527 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:27:17.528 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:27:17.529 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:27:17.529 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:27:17.530 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:27:17.531 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:27:17.531 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:27:17.532 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:27:17.532 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:27:17.601 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14635.asok 2021-10-20T23:27:17.605 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14635.asok 2021-10-20T23:27:17.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:17.606 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14635.asok status 2021-10-20T23:27:17.695 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:27:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:27:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:27:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:27:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:27:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:27:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:27:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14635", 2021-10-20T23:27:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:27:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:27:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:27:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:27:17.699 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 7114, 2021-10-20T23:27:17.699 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:27:17.699 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:27:17.699 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:27:17.700 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 7114 2021-10-20T23:27:17.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:27:17.700 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:27:17.700 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:27:17.701 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:27:17.701 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1285332223 2021-10-20T23:27:17.701 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:27:17.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:27:17.701 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:27:17.702 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:27:17.702 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:27:17.702 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1285332223 2021-10-20T23:27:17.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:27:17.703 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.7114 172.21.15.119:0/1285332223", 2021-10-20T23:27:17.703 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/1285332223", 2021-10-20T23:27:17.703 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:27:17.703 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 49, 2021-10-20T23:27:17.704 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 101, 2021-10-20T23:27:17.704 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:27:17.704 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:27:17.704 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:27:17.704 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:27:17.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:17.706 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:17.707 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:17.715 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:27:17.716 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:27:17.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:17.717 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:17.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 Processor -- start 2021-10-20T23:27:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 -- start start 2021-10-20T23:27:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5bdc0b0fd0 0x7f5bdc144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc0b0350 con 0x7f5bdc0b1db0 2021-10-20T23:27:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc0b05f0 con 0x7f5bdc1483a0 2021-10-20T23:27:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc0a90c0 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bdb7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5bdc0b1db0 0x7f5bdc0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41056/0 (socket says 172.21.15.12:41056) 2021-10-20T23:27:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bdb7fe700 1 -- 172.21.15.12:0/1521428737 learned_addr learned my addr 172.21.15.12:0/1521428737 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bdbfff700 1 --2- 172.21.15.12:0/1521428737 >> v2:172.21.15.31:3300/0 conn(0x7f5bdc0b0fd0 0x7f5bdc144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bda7fc700 1 -- 172.21.15.12:0/1521428737 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844804072 0 0) 0x7f5bdc0b0350 con 0x7f5bdc0b1db0 2021-10-20T23:27:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bda7fc700 1 -- 172.21.15.12:0/1521428737 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bbc003260 con 0x7f5bdc0b1db0 2021-10-20T23:27:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bda7fc700 1 -- 172.21.15.12:0/1521428737 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1955228476 0 0) 0x7f5bbc003260 con 0x7f5bdc0b1db0 2021-10-20T23:27:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bdbfff700 1 -- 172.21.15.12:0/1521428737 >> v1:172.21.15.31:6789/0 conn(0x7f5bdc1483a0 legacy=0x7f5bdc0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bdbfff700 1 -- 172.21.15.12:0/1521428737 >> v1:172.21.15.12:6789/0 conn(0x7f5bdc0b1db0 legacy=0x7f5bdc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bdbfff700 1 -- 172.21.15.12:0/1521428737 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc0b0890 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bdbfff700 1 --2- 172.21.15.12:0/1521428737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bdc0b0fd0 0x7f5bdc144720 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f5bc4001800 tx=0x7f5bd4006df0).ready entity=mon.1 client_cookie=28d06fbe756fb77 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bda7fc700 1 -- 172.21.15.12:0/1521428737 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bc4001660 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bda7fc700 1 -- 172.21.15.12:0/1521428737 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd4000e90 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5bda7fc700 1 -- 172.21.15.12:0/1521428737 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd400d4f0 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 -- 172.21.15.12:0/1521428737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bdc0b0fd0 msgr2=0x7f5bdc144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 --2- 172.21.15.12:0/1521428737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bdc0b0fd0 0x7f5bdc144720 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f5bc4001800 tx=0x7f5bd4006df0).stop 2021-10-20T23:27:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 -- 172.21.15.12:0/1521428737 shutdown_connections 2021-10-20T23:27:17.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 --2- 172.21.15.12:0/1521428737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bdc0b0fd0 0x7f5bdc144720 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:17.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.883+0000 7f5be1f3a700 1 -- 172.21.15.12:0/1521428737 >> 172.21.15.12:0/1521428737 conn(0x7f5bdc05f6b0 msgr2=0x7f5bdc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:17.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 -- 172.21.15.12:0/1521428737 shutdown_connections 2021-10-20T23:27:17.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 -- 172.21.15.12:0/1521428737 wait complete. 2021-10-20T23:27:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 Processor -- start 2021-10-20T23:27:17.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 -- start start 2021-10-20T23:27:17.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc0b0fd0 0x7f5bdc143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:17.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bdc0b1db0 0x7f5bdc143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:17.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bdc1483a0 0x7f5bdc159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:17.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0ae090 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0a94e0 con 0x7f5bdc1483a0 2021-10-20T23:27:17.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5be1f3a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0ad820 con 0x7f5bdc0b1db0 2021-10-20T23:27:17.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc0b0fd0 0x7f5bdc143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:17.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc0b0fd0 0x7f5bdc143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42468/0 (socket says 172.21.15.12:42468) 2021-10-20T23:27:17.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdb7fe700 1 -- 172.21.15.12:0/3090643348 learned_addr learned my addr 172.21.15.12:0/3090643348 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:17.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdbfff700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bdc1483a0 0x7f5bdc159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:17.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdaffd700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bdc0b1db0 0x7f5bdc143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:17.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdb7fe700 1 -- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bdc0b1db0 msgr2=0x7f5bdc143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:17.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdb7fe700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bdc0b1db0 0x7f5bdc143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:17.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdb7fe700 1 -- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bdc1483a0 msgr2=0x7f5bdc159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:17.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdb7fe700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bdc1483a0 0x7f5bdc159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:17.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdb7fe700 1 -- 172.21.15.12:0/3090643348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd400b180 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bdb7fe700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc0b0fd0 0x7f5bdc143840 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f5bc40018c0 tx=0x7f5bc4001230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:17.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bd8ff9700 1 -- 172.21.15.12:0/3090643348 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bc4007170 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.887+0000 7f5bd8ff9700 1 -- 172.21.15.12:0/3090643348 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc40072d0 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.891+0000 7f5bd8ff9700 1 -- 172.21.15.12:0/3090643348 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bc4004710 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.891+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc0ae5e0 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.891+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc144220 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.891+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc0b0b30 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.891+0000 7f5bd8ff9700 1 -- 172.21.15.12:0/3090643348 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5bc401b070 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.891+0000 7f5bd8ff9700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bc0053640 0x7f5bc0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:17.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.891+0000 7f5bd8ff9700 1 -- 172.21.15.12:0/3090643348 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5bc406b000 con 0x7f5bdc0b0fd0 2021-10-20T23:27:17.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.891+0000 7f5bdaffd700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bc0053640 0x7f5bc0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:17.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.891+0000 7f5bdaffd700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bc0053640 0x7f5bc0055b00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f5bcc00d000 tx=0x7f5bcc007f10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:17.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:17.899+0000 7f5bd8ff9700 1 -- 172.21.15.12:0/3090643348 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5bc4042000 con 0x7f5bdc0b0fd0 2021-10-20T23:27:18.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.027+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bdc057350 con 0x7f5bdc0b0fd0 2021-10-20T23:27:18.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.027+0000 7f5bd8ff9700 1 -- 172.21.15.12:0/3090643348 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16277 (secure 0 0 0) 0x7f5bc4045620 con 0x7f5bdc0b0fd0 2021-10-20T23:27:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:18.036 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":101,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:13.204259+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:10.667132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:11.561636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:18.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.027+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bc0053640 msgr2=0x7f5bc0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.027+0000 7f5be1f3a700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bc0053640 0x7f5bc0055b00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f5bcc00d000 tx=0x7f5bcc007f10).stop 2021-10-20T23:27:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.027+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc0b0fd0 msgr2=0x7f5bdc143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.027+0000 7f5be1f3a700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc0b0fd0 0x7f5bdc143840 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f5bc40018c0 tx=0x7f5bc4001230).stop 2021-10-20T23:27:18.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.031+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 shutdown_connections 2021-10-20T23:27:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.031+0000 7f5be1f3a700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bc0053640 0x7f5bc0055b00 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.031+0000 7f5be1f3a700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bdc1483a0 0x7f5bdc159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.031+0000 7f5be1f3a700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bdc0b1db0 0x7f5bdc143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.031+0000 7f5be1f3a700 1 --2- 172.21.15.12:0/3090643348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc0b0fd0 0x7f5bdc143840 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.031+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 >> 172.21.15.12:0/3090643348 conn(0x7f5bdc05f6b0 msgr2=0x7f5bdc0b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:18.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.031+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 shutdown_connections 2021-10-20T23:27:18.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.031+0000 7f5be1f3a700 1 -- 172.21.15.12:0/3090643348 wait complete. 2021-10-20T23:27:18.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:27:10.667132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:27:11.561636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:27:18.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:27:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 Processor -- start 2021-10-20T23:27:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 -- start start 2021-10-20T23:27:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff09405c7d0 0x7ff0940b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405d0b0 0x7ff09413f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09413f880 con 0x7ff0940ace30 2021-10-20T23:27:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff094067d70 con 0x7ff09405c7d0 2021-10-20T23:27:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940b2af0 con 0x7ff09405d0b0 2021-10-20T23:27:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09ad23700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff0940ace30 0x7ff0940b23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41072/0 (socket says 172.21.15.12:41072) 2021-10-20T23:27:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09ad23700 1 -- 172.21.15.12:0/106076705 learned_addr learned my addr 172.21.15.12:0/106076705 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09a522700 1 --2- 172.21.15.12:0/106076705 >> v2:172.21.15.31:3300/0 conn(0x7ff09405c7d0 0x7ff0940b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff099d21700 1 --2- 172.21.15.12:0/106076705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405d0b0 0x7ff09413f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff099520700 1 -- 172.21.15.12:0/106076705 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994967189 0 0) 0x7ff08c001490 con 0x7ff0940ace30 2021-10-20T23:27:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff099520700 1 -- 172.21.15.12:0/106076705 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff07c003260 con 0x7ff0940ace30 2021-10-20T23:27:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09a522700 1 -- 172.21.15.12:0/106076705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405d0b0 msgr2=0x7ff09413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09a522700 1 --2- 172.21.15.12:0/106076705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405d0b0 0x7ff09413f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09a522700 1 -- 172.21.15.12:0/106076705 >> v1:172.21.15.12:6789/0 conn(0x7ff0940ace30 legacy=0x7ff0940b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff099520700 1 -- 172.21.15.12:0/106076705 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2693186396 0 0) 0x7ff07c003260 con 0x7ff0940ace30 2021-10-20T23:27:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09a522700 1 -- 172.21.15.12:0/106076705 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09405cbb0 con 0x7ff09405c7d0 2021-10-20T23:27:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09a522700 1 --2- 172.21.15.12:0/106076705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09405c7d0 0x7ff0940b10f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7ff090002f70 tx=0x7ff090006df0).ready entity=mon.1 client_cookie=8430e4c8bb370e98 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff099520700 1 -- 172.21.15.12:0/106076705 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff09000d4a0 con 0x7ff09405c7d0 2021-10-20T23:27:18.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff099520700 1 -- 172.21.15.12:0/106076705 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff090000e90 con 0x7ff09405c7d0 2021-10-20T23:27:18.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff099520700 1 -- 172.21.15.12:0/106076705 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff09000d7f0 con 0x7ff09405c7d0 2021-10-20T23:27:18.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 -- 172.21.15.12:0/106076705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09405c7d0 msgr2=0x7ff0940b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 --2- 172.21.15.12:0/106076705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09405c7d0 0x7ff0940b10f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7ff090002f70 tx=0x7ff090006df0).stop 2021-10-20T23:27:18.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 -- 172.21.15.12:0/106076705 shutdown_connections 2021-10-20T23:27:18.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 --2- 172.21.15.12:0/106076705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405d0b0 0x7ff09413f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 --2- 172.21.15.12:0/106076705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09405c7d0 0x7ff0940b10f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 -- 172.21.15.12:0/106076705 >> 172.21.15.12:0/106076705 conn(0x7ff094060180 msgr2=0x7ff0940b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 -- 172.21.15.12:0/106076705 shutdown_connections 2021-10-20T23:27:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.159+0000 7ff09b524700 1 -- 172.21.15.12:0/106076705 wait complete. 2021-10-20T23:27:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 Processor -- start 2021-10-20T23:27:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 -- start start 2021-10-20T23:27:18.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405c7d0 0x7ff094134d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09405d0b0 0x7ff0940b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0940ace30 0x7ff094153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940abbb0 con 0x7ff0940ace30 2021-10-20T23:27:18.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940abe50 con 0x7ff09405d0b0 2021-10-20T23:27:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940ac0f0 con 0x7ff09405c7d0 2021-10-20T23:27:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09ad23700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0940ace30 0x7ff094153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09ad23700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0940ace30 0x7ff094153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42484/0 (socket says 172.21.15.12:42484) 2021-10-20T23:27:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09ad23700 1 -- 172.21.15.12:0/602235984 learned_addr learned my addr 172.21.15.12:0/602235984 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09a522700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405c7d0 0x7ff094134d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff099d21700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09405d0b0 0x7ff0940b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09ad23700 1 -- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405c7d0 msgr2=0x7ff094134d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09ad23700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405c7d0 0x7ff094134d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09ad23700 1 -- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09405d0b0 msgr2=0x7ff0940b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09ad23700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09405d0b0 0x7ff0940b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09ad23700 1 -- 172.21.15.12:0/602235984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09000b180 con 0x7ff0940ace30 2021-10-20T23:27:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09ad23700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0940ace30 0x7ff094153810 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7ff08c001250 tx=0x7ff08c007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff0837fe700 1 -- 172.21.15.12:0/602235984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff08c004ab0 con 0x7ff0940ace30 2021-10-20T23:27:18.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff0837fe700 1 -- 172.21.15.12:0/602235984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c004c10 con 0x7ff0940ace30 2021-10-20T23:27:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0940ac390 con 0x7ff0940ace30 2021-10-20T23:27:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff0837fe700 1 -- 172.21.15.12:0/602235984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff08c007170 con 0x7ff0940ace30 2021-10-20T23:27:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.163+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0940b5120 con 0x7ff0940ace30 2021-10-20T23:27:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.167+0000 7ff0837fe700 1 -- 172.21.15.12:0/602235984 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff08c0072d0 con 0x7ff0940ace30 2021-10-20T23:27:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.167+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0940ac520 con 0x7ff0940ace30 2021-10-20T23:27:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.167+0000 7ff0837fe700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0740536a0 0x7ff074055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.167+0000 7ff0837fe700 1 -- 172.21.15.12:0/602235984 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff08c06b5f0 con 0x7ff0940ace30 2021-10-20T23:27:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.167+0000 7ff09a522700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0740536a0 0x7ff074055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.167+0000 7ff09a522700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0740536a0 0x7ff074055b60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7ff090018000 tx=0x7ff090014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.171+0000 7ff0837fe700 1 -- 172.21.15.12:0/602235984 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff08c0424f0 con 0x7ff0940ace30 2021-10-20T23:27:18.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff09413f880 con 0x7ff0940ace30 2021-10-20T23:27:18.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff0837fe700 1 -- 172.21.15.12:0/602235984 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v101) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff09413f880 con 0x7ff0940ace30 2021-10-20T23:27:18.311 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:27:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0740536a0 msgr2=0x7ff074055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0740536a0 0x7ff074055b60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7ff090018000 tx=0x7ff090014000).stop 2021-10-20T23:27:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0940ace30 msgr2=0x7ff094153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0940ace30 0x7ff094153810 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7ff08c001250 tx=0x7ff08c007be0).stop 2021-10-20T23:27:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 shutdown_connections 2021-10-20T23:27:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0740536a0 0x7ff074055b60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0940ace30 0x7ff094153810 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09405d0b0 0x7ff0940b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 --2- 172.21.15.12:0/602235984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff09405c7d0 0x7ff094134d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 >> 172.21.15.12:0/602235984 conn(0x7ff094060180 msgr2=0x7ff0940b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:18.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 shutdown_connections 2021-10-20T23:27:18.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.303+0000 7ff09b524700 1 -- 172.21.15.12:0/602235984 wait complete. 2021-10-20T23:27:18.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:27:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f6600942700 1 Processor -- start 2021-10-20T23:27:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f6600942700 1 -- start start 2021-10-20T23:27:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f6600942700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f65fc144440 0x7f65fc144970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f6600942700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc0604e0 con 0x7f65fc065420 2021-10-20T23:27:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f6600942700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc0b23b0 con 0x7f65fc060100 2021-10-20T23:27:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f6600942700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc065c80 con 0x7f65fc144440 2021-10-20T23:27:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65fad9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f65fc065420 0x7f65fc14b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41086/0 (socket says 172.21.15.12:41086) 2021-10-20T23:27:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65fad9d700 1 -- 172.21.15.12:0/3286516920 learned_addr learned my addr 172.21.15.12:0/3286516920 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f9d9b700 1 --2- 172.21.15.12:0/3286516920 >> v2:172.21.15.31:3300/0 conn(0x7f65fc144440 0x7f65fc144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216065925 0 0) 0x7f65fc0604e0 con 0x7f65fc065420 2021-10-20T23:27:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e0003260 con 0x7f65fc065420 2021-10-20T23:27:18.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1175730540 0 0) 0x7f65e0003260 con 0x7f65fc065420 2021-10-20T23:27:18.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 >> v2:172.21.15.31:3300/0 conn(0x7f65fc144440 msgr2=0x7f65fc144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:18.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 --2- 172.21.15.12:0/3286516920 >> v2:172.21.15.31:3300/0 conn(0x7f65fc144440 0x7f65fc144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 >> v1:172.21.15.31:6789/0 conn(0x7f65fc060100 legacy=0x7f65fc064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc0b2650 con 0x7f65fc065420 2021-10-20T23:27:18.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f65f4001a00 con 0x7f65fc065420 2021-10-20T23:27:18.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 >> v1:172.21.15.12:6789/0 conn(0x7f65fc065420 legacy=0x7f65fc14b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65e0003750 0x7f65e0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65e0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e0004e70 0x7f65e000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc065c80 con 0x7f65e0004500 2021-10-20T23:27:18.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e000bd20 con 0x7f65e0004e70 2021-10-20T23:27:18.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e000bee0 con 0x7f65e0003750 2021-10-20T23:27:18.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f9d9b700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65e0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65fad9d700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e0004e70 0x7f65e000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65fa59c700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65e0003750 0x7f65e0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f9d9b700 1 -- 172.21.15.12:0/3286516920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65e0003750 msgr2=0x7f65e0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.427+0000 7f65f9d9b700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65e0003750 0x7f65e0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f65f9d9b700 1 -- 172.21.15.12:0/3286516920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e0004e70 msgr2=0x7f65e000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f65f9d9b700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e0004e70 0x7f65e000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f65f9d9b700 1 -- 172.21.15.12:0/3286516920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0003260 con 0x7f65e0004500 2021-10-20T23:27:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f65fad9d700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e0004e70 0x7f65e000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f65fad9d700 1 -- 172.21.15.12:0/3286516920 reap_dead start 2021-10-20T23:27:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f65f9d9b700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65e0004980 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f65ec00c000 tx=0x7f65ec006df0).ready entity=mon.0 client_cookie=a9c727f27d055ef0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ec00e830 con 0x7f65e0004500 2021-10-20T23:27:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec00e990 con 0x7f65e0004500 2021-10-20T23:27:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f65f959a700 1 -- 172.21.15.12:0/3286516920 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ec00ecf0 con 0x7f65e0004500 2021-10-20T23:27:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f6600942700 1 -- 172.21.15.12:0/3286516920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 msgr2=0x7f65e0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f6600942700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65e0004980 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f65ec00c000 tx=0x7f65ec006df0).stop 2021-10-20T23:27:18.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f6600942700 1 -- 172.21.15.12:0/3286516920 shutdown_connections 2021-10-20T23:27:18.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f6600942700 1 --2- 172.21.15.12:0/3286516920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65e0004980 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f6600942700 1 -- 172.21.15.12:0/3286516920 >> 172.21.15.12:0/3286516920 conn(0x7f65fc05cf60 msgr2=0x7f65fc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:18.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f6600942700 1 -- 172.21.15.12:0/3286516920 shutdown_connections 2021-10-20T23:27:18.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.431+0000 7f6600942700 1 -- 172.21.15.12:0/3286516920 wait complete. 2021-10-20T23:27:18.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 Processor -- start 2021-10-20T23:27:18.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 -- start start 2021-10-20T23:27:18.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65fc1402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65fc0b6c60 0x7f65fc151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65fc151d20 0x7f65fc137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc1521d0 con 0x7f65e0004500 2021-10-20T23:27:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0b7170 con 0x7f65fc0b6c60 2021-10-20T23:27:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0b7b30 con 0x7f65fc151d20 2021-10-20T23:27:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65fc1402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65fc1402f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42502/0 (socket says 172.21.15.12:42502) 2021-10-20T23:27:18.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fa59c700 1 -- 172.21.15.12:0/1985068814 learned_addr learned my addr 172.21.15.12:0/1985068814 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:18.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65f9d9b700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65fc0b6c60 0x7f65fc151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fad9d700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65fc151d20 0x7f65fc137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fa59c700 1 -- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65fc151d20 msgr2=0x7f65fc137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fa59c700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65fc151d20 0x7f65fc137710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fa59c700 1 -- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65fc0b6c60 msgr2=0x7f65fc151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fa59c700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65fc0b6c60 0x7f65fc151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fa59c700 1 -- 172.21.15.12:0/1985068814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc0b7dd0 con 0x7f65e0004500 2021-10-20T23:27:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65fa59c700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65fc1402f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f65f000d000 tx=0x7f65f0007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65eb7fe700 1 -- 172.21.15.12:0/1985068814 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f0002e10 con 0x7f65e0004500 2021-10-20T23:27:18.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65eb7fe700 1 -- 172.21.15.12:0/1985068814 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f00114c0 con 0x7f65e0004500 2021-10-20T23:27:18.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65fc0b1490 con 0x7f65e0004500 2021-10-20T23:27:18.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f65eb7fe700 1 -- 172.21.15.12:0/1985068814 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f0011820 con 0x7f65e0004500 2021-10-20T23:27:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.435+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc140a30 con 0x7f65e0004500 2021-10-20T23:27:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.439+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65fc064870 con 0x7f65e0004500 2021-10-20T23:27:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.439+0000 7f65eb7fe700 1 -- 172.21.15.12:0/1985068814 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f65f001a030 con 0x7f65e0004500 2021-10-20T23:27:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.439+0000 7f65eb7fe700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f65d8053570 0x7f65d8055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.439+0000 7f65eb7fe700 1 -- 172.21.15.12:0/1985068814 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f65f006b440 con 0x7f65e0004500 2021-10-20T23:27:18.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.439+0000 7f65f9d9b700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f65d8053570 0x7f65d8055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.443+0000 7f65f9d9b700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f65d8053570 0x7f65d8055a30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f65ec01b000 tx=0x7f65ec019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.447+0000 7f65eb7fe700 1 -- 172.21.15.12:0/1985068814 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f65f0042380 con 0x7f65e0004500 2021-10-20T23:27:18.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65fc057350 con 0x7f65e0004500 2021-10-20T23:27:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f65eb7fe700 1 -- 172.21.15.12:0/1985068814 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v101) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65f00459a0 con 0x7f65e0004500 2021-10-20T23:27:18.586 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f65d8053570 msgr2=0x7f65d8055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f65d8053570 0x7f65d8055a30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f65ec01b000 tx=0x7f65ec019000).stop 2021-10-20T23:27:18.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 msgr2=0x7f65fc1402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65fc1402f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f65f000d000 tx=0x7f65f0007a00).stop 2021-10-20T23:27:18.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 shutdown_connections 2021-10-20T23:27:18.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f65d8053570 0x7f65d8055a30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65fc151d20 0x7f65fc137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65fc0b6c60 0x7f65fc151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 --2- 172.21.15.12:0/1985068814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e0004500 0x7f65fc1402f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 >> 172.21.15.12:0/1985068814 conn(0x7f65fc05cf60 msgr2=0x7f65fc0adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:18.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 shutdown_connections 2021-10-20T23:27:18.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.579+0000 7f6600942700 1 -- 172.21.15.12:0/1985068814 wait complete. 2021-10-20T23:27:18.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:27:18.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df8bd0700 1 Processor -- start 2021-10-20T23:27:18.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df8bd0700 1 -- start start 2021-10-20T23:27:18.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df8bd0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5df40b5990 0x7f5df40b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df8bd0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df4143f60 con 0x7f5df405fc00 2021-10-20T23:27:18.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df8bd0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df405ffe0 con 0x7f5df40b6560 2021-10-20T23:27:18.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df8bd0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df40ba6b0 con 0x7f5df40b5990 2021-10-20T23:27:18.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5df405fc00 0x7f5df40b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41104/0 (socket says 172.21.15.12:41104) 2021-10-20T23:27:18.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df259c700 1 -- 172.21.15.12:0/415117641 learned_addr learned my addr 172.21.15.12:0/415117641 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:18.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df2d9d700 1 --2- 172.21.15.12:0/415117641 >> v2:172.21.15.31:3300/0 conn(0x7f5df40b5990 0x7f5df40b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df159a700 1 -- 172.21.15.12:0/415117641 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988611903 0 0) 0x7f5df4143f60 con 0x7f5df405fc00 2021-10-20T23:27:18.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df159a700 1 -- 172.21.15.12:0/415117641 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd4003260 con 0x7f5df405fc00 2021-10-20T23:27:18.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df2d9d700 1 -- 172.21.15.12:0/415117641 >> v1:172.21.15.31:6789/0 conn(0x7f5df40b6560 legacy=0x7f5df40b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df2d9d700 1 -- 172.21.15.12:0/415117641 >> v1:172.21.15.12:6789/0 conn(0x7f5df405fc00 legacy=0x7f5df40b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df2d9d700 1 -- 172.21.15.12:0/415117641 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4143a50 con 0x7f5df40b5990 2021-10-20T23:27:18.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df2d9d700 1 --2- 172.21.15.12:0/415117641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b5990 0x7f5df40b41b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f5dec0032f0 tx=0x7f5dec0091d0).ready entity=mon.1 client_cookie=8f45e2f6ad5a1d42 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df159a700 1 -- 172.21.15.12:0/415117641 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dec00b6c0 con 0x7f5df40b5990 2021-10-20T23:27:18.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df159a700 1 -- 172.21.15.12:0/415117641 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00b820 con 0x7f5df40b5990 2021-10-20T23:27:18.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.703+0000 7f5df159a700 1 -- 172.21.15.12:0/415117641 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dec00b990 con 0x7f5df40b5990 2021-10-20T23:27:18.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 -- 172.21.15.12:0/415117641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b5990 msgr2=0x7f5df40b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 --2- 172.21.15.12:0/415117641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b5990 0x7f5df40b41b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f5dec0032f0 tx=0x7f5dec0091d0).stop 2021-10-20T23:27:18.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 -- 172.21.15.12:0/415117641 shutdown_connections 2021-10-20T23:27:18.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 --2- 172.21.15.12:0/415117641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b5990 0x7f5df40b41b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 -- 172.21.15.12:0/415117641 >> 172.21.15.12:0/415117641 conn(0x7f5df40623a0 msgr2=0x7f5df4066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:18.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 -- 172.21.15.12:0/415117641 shutdown_connections 2021-10-20T23:27:18.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 -- 172.21.15.12:0/415117641 wait complete. 2021-10-20T23:27:18.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 Processor -- start 2021-10-20T23:27:18.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 -- start start 2021-10-20T23:27:18.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df405fc00 0x7f5df4142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b5990 0x7f5df40af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5df40b6560 0x7f5df40afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df413fbc0 con 0x7f5df405fc00 2021-10-20T23:27:18.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df413f920 con 0x7f5df40b5990 2021-10-20T23:27:18.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df8bd0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df41400c0 con 0x7f5df40b6560 2021-10-20T23:27:18.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df405fc00 0x7f5df4142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df405fc00 0x7f5df4142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42516/0 (socket says 172.21.15.12:42516) 2021-10-20T23:27:18.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df259c700 1 -- 172.21.15.12:0/2932252542 learned_addr learned my addr 172.21.15.12:0/2932252542 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:18.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df1d9b700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b5990 0x7f5df40af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df2d9d700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5df40b6560 0x7f5df40afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df259c700 1 -- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5df40b6560 msgr2=0x7f5df40afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df259c700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5df40b6560 0x7f5df40afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df259c700 1 -- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b5990 msgr2=0x7f5df40af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df259c700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b5990 0x7f5df40af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df259c700 1 -- 172.21.15.12:0/2932252542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec009470 con 0x7f5df405fc00 2021-10-20T23:27:18.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.707+0000 7f5df259c700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df405fc00 0x7f5df4142180 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f5de4001110 tx=0x7f5de4007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5deb7fe700 1 -- 172.21.15.12:0/2932252542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de40070d0 con 0x7f5df405fc00 2021-10-20T23:27:18.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5deb7fe700 1 -- 172.21.15.12:0/2932252542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de4007230 con 0x7f5df405fc00 2021-10-20T23:27:18.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df4140360 con 0x7f5df405fc00 2021-10-20T23:27:18.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5deb7fe700 1 -- 172.21.15.12:0/2932252542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de4005610 con 0x7f5df405fc00 2021-10-20T23:27:18.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df40b0180 con 0x7f5df405fc00 2021-10-20T23:27:18.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df41404f0 con 0x7f5df405fc00 2021-10-20T23:27:18.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5deb7fe700 1 -- 172.21.15.12:0/2932252542 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5de4010070 con 0x7f5df405fc00 2021-10-20T23:27:18.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5deb7fe700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dd8053640 0x7f5dd8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5deb7fe700 1 -- 172.21.15.12:0/2932252542 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5de406b160 con 0x7f5df405fc00 2021-10-20T23:27:18.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5df1d9b700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dd8053640 0x7f5dd8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.711+0000 7f5df1d9b700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dd8053640 0x7f5dd8055b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f5ddc00d000 tx=0x7f5ddc007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.719+0000 7f5deb7fe700 1 -- 172.21.15.12:0/2932252542 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5de4042050 con 0x7f5df405fc00 2021-10-20T23:27:18.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.843+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5df4143cc0 con 0x7f5df405fc00 2021-10-20T23:27:18.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.843+0000 7f5deb7fe700 1 -- 172.21.15.12:0/2932252542 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5de4045670 con 0x7f5df405fc00 2021-10-20T23:27:18.851 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:18.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dd8053640 msgr2=0x7f5dd8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dd8053640 0x7f5dd8055b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f5ddc00d000 tx=0x7f5ddc007b90).stop 2021-10-20T23:27:18.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df405fc00 msgr2=0x7f5df4142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df405fc00 0x7f5df4142180 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f5de4001110 tx=0x7f5de4007ad0).stop 2021-10-20T23:27:18.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 shutdown_connections 2021-10-20T23:27:18.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dd8053640 0x7f5dd8055b00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5df40b6560 0x7f5df40afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b5990 0x7f5df40af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 --2- 172.21.15.12:0/2932252542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df405fc00 0x7f5df4142180 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 >> 172.21.15.12:0/2932252542 conn(0x7f5df40623a0 msgr2=0x7f5df412c100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:18.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 shutdown_connections 2021-10-20T23:27:18.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.847+0000 7f5df8bd0700 1 -- 172.21.15.12:0/2932252542 wait complete. 2021-10-20T23:27:18.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:27:18.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7779520700 1 Processor -- start 2021-10-20T23:27:18.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7779520700 1 -- start start 2021-10-20T23:27:18.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7779520700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740b13f0 0x7f77740b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7779520700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f77740af480 0x7f77740af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7779520700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77740b17d0 con 0x7f77740adf20 2021-10-20T23:27:18.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7779520700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777414bd80 con 0x7f77740af480 2021-10-20T23:27:18.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7779520700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77740b32f0 con 0x7f77740b13f0 2021-10-20T23:27:18.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f77737fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f77740af480 0x7f77740af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f77727fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f77740adf20 0x7f777414b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41122/0 (socket says 172.21.15.12:41122) 2021-10-20T23:27:18.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f77737fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f77740af480 0x7f77740af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42526/0 (socket says 172.21.15.12:42526) 2021-10-20T23:27:18.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f77727fc700 1 -- 172.21.15.12:0/1967077912 learned_addr learned my addr 172.21.15.12:0/1967077912 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:18.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7772ffd700 1 --2- 172.21.15.12:0/1967077912 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740b13f0 0x7f77740b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f77737fe700 1 -- 172.21.15.12:0/1967077912 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740b13f0 msgr2=0x7f77740b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:18.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f77737fe700 1 --2- 172.21.15.12:0/1967077912 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740b13f0 0x7f77740b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f77737fe700 1 -- 172.21.15.12:0/1967077912 >> v1:172.21.15.12:6789/0 conn(0x7f77740adf20 legacy=0x7f777414b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7771ffb700 1 -- 172.21.15.12:0/1967077912 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020373539 0 0) 0x7f77740b17d0 con 0x7f77740adf20 2021-10-20T23:27:18.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f77737fe700 1 -- 172.21.15.12:0/1967077912 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740b3590 con 0x7f77740af480 2021-10-20T23:27:18.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f77737fe700 1 --2- 172.21.15.12:0/1967077912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740af480 0x7f77740af910 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f77740b0b50 tx=0x7f776c006df0).ready entity=mon.0 client_cookie=2cbde3f79a8c3d3c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7771ffb700 1 -- 172.21.15.12:0/1967077912 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f776c00d570 con 0x7f77740af480 2021-10-20T23:27:18.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7771ffb700 1 -- 172.21.15.12:0/1967077912 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c000e90 con 0x7f77740af480 2021-10-20T23:27:18.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.967+0000 7f7771ffb700 1 -- 172.21.15.12:0/1967077912 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f776c00d8c0 con 0x7f77740af480 2021-10-20T23:27:18.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 -- 172.21.15.12:0/1967077912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740af480 msgr2=0x7f77740af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 --2- 172.21.15.12:0/1967077912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740af480 0x7f77740af910 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f77740b0b50 tx=0x7f776c006df0).stop 2021-10-20T23:27:18.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 -- 172.21.15.12:0/1967077912 shutdown_connections 2021-10-20T23:27:18.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 --2- 172.21.15.12:0/1967077912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740af480 0x7f77740af910 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 --2- 172.21.15.12:0/1967077912 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740b13f0 0x7f77740b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 -- 172.21.15.12:0/1967077912 >> 172.21.15.12:0/1967077912 conn(0x7f77740607c0 msgr2=0x7f7774060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:18.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 -- 172.21.15.12:0/1967077912 shutdown_connections 2021-10-20T23:27:18.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 -- 172.21.15.12:0/1967077912 wait complete. 2021-10-20T23:27:18.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 Processor -- start 2021-10-20T23:27:18.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 -- start start 2021-10-20T23:27:18.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77740adf20 0x7f777409ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740af480 0x7f7774156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740b13f0 0x7f7774156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777409fd20 con 0x7f77740b13f0 2021-10-20T23:27:18.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774067110 con 0x7f77740adf20 2021-10-20T23:27:18.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7779520700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7774067340 con 0x7f77740af480 2021-10-20T23:27:18.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f77737fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740b13f0 0x7f7774156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f77737fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740b13f0 0x7f7774156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42532/0 (socket says 172.21.15.12:42532) 2021-10-20T23:27:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f77737fe700 1 -- 172.21.15.12:0/2031221647 learned_addr learned my addr 172.21.15.12:0/2031221647 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f7772ffd700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77740adf20 0x7f777409ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.971+0000 7f77727fc700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740af480 0x7f7774156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f77737fe700 1 -- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740af480 msgr2=0x7f7774156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f77737fe700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740af480 0x7f7774156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f77737fe700 1 -- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77740adf20 msgr2=0x7f777409ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f77737fe700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77740adf20 0x7f777409ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f77737fe700 1 -- 172.21.15.12:0/2031221647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c00b180 con 0x7f77740b13f0 2021-10-20T23:27:18.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f7772ffd700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77740adf20 0x7f777409ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:18.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f77737fe700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740b13f0 0x7f7774156c10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f77740b0b50 tx=0x7f776c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f776bfff700 1 -- 172.21.15.12:0/2031221647 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f776c013de0 con 0x7f77740b13f0 2021-10-20T23:27:18.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f776bfff700 1 -- 172.21.15.12:0/2031221647 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c002f70 con 0x7f77740b13f0 2021-10-20T23:27:18.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77740a11e0 con 0x7f77740b13f0 2021-10-20T23:27:18.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f776bfff700 1 -- 172.21.15.12:0/2031221647 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f776c01e5f0 con 0x7f77740b13f0 2021-10-20T23:27:18.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7774065ae0 con 0x7f77740b13f0 2021-10-20T23:27:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7774067540 con 0x7f77740b13f0 2021-10-20T23:27:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f776bfff700 1 -- 172.21.15.12:0/2031221647 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f776c025030 con 0x7f77740b13f0 2021-10-20T23:27:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f776bfff700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f77580536a0 0x7f7758055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f776bfff700 1 -- 172.21.15.12:0/2031221647 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f776c06c5a0 con 0x7f77740b13f0 2021-10-20T23:27:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.975+0000 7f7772ffd700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f77580536a0 0x7f7758055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.979+0000 7f7772ffd700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f77580536a0 0x7f7758055b60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f776400b000 tx=0x7f77640091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:18.979+0000 7f776bfff700 1 -- 172.21.15.12:0/2031221647 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f776c0435e0 con 0x7f77740b13f0 2021-10-20T23:27:19.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.107+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77740b3830 con 0x7f77740b13f0 2021-10-20T23:27:19.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f776bfff700 1 -- 172.21.15.12:0/2031221647 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) v1 ==== 100+0+10 (secure 0 0 0) 0x7f776c023020 con 0x7f77740b13f0 2021-10-20T23:27:19.117 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f77580536a0 msgr2=0x7f7758055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f77580536a0 0x7f7758055b60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f776400b000 tx=0x7f77640091d0).stop 2021-10-20T23:27:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740b13f0 msgr2=0x7f7774156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740b13f0 0x7f7774156c10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f77740b0b50 tx=0x7f776c014000).stop 2021-10-20T23:27:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 shutdown_connections 2021-10-20T23:27:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f77580536a0 0x7f7758055b60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77740b13f0 0x7f7774156c10 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77740af480 0x7f7774156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 --2- 172.21.15.12:0/2031221647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77740adf20 0x7f777409ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 >> 172.21.15.12:0/2031221647 conn(0x7f77740607c0 msgr2=0x7f77740b66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 shutdown_connections 2021-10-20T23:27:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.111+0000 7f7779520700 1 -- 172.21.15.12:0/2031221647 wait complete. 2021-10-20T23:27:19.132 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:27:19.132 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:19.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.223+0000 7f2e0759e700 1 Processor -- start 2021-10-20T23:27:19.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.223+0000 7f2e0759e700 1 -- start start 2021-10-20T23:27:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 0x7f2e0813e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0805f750 con 0x7f2e080b1a30 2021-10-20T23:27:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e080b14a0 con 0x7f2e080665f0 2021-10-20T23:27:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0805f980 con 0x7f2e080669d0 2021-10-20T23:27:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2dfffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2e080b1a30 0x7f2e08140cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41134/0 (socket says 172.21.15.12:41134) 2021-10-20T23:27:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2dfffff700 1 -- 172.21.15.12:0/442153729 learned_addr learned my addr 172.21.15.12:0/442153729 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e06d9d700 1 --2- 172.21.15.12:0/442153729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 0x7f2e0813e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e05d9b700 1 -- 172.21.15.12:0/442153729 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067500968 0 0) 0x7f2e0805f750 con 0x7f2e080b1a30 2021-10-20T23:27:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e05d9b700 1 -- 172.21.15.12:0/442153729 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2de8003260 con 0x7f2e080b1a30 2021-10-20T23:27:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e05d9b700 1 -- 172.21.15.12:0/442153729 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400565215 0 0) 0x7f2e080b14a0 con 0x7f2e080665f0 2021-10-20T23:27:19.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e05d9b700 1 -- 172.21.15.12:0/442153729 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e0805f750 con 0x7f2e080665f0 2021-10-20T23:27:19.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e06d9d700 1 -- 172.21.15.12:0/442153729 >> v1:172.21.15.31:6789/0 conn(0x7f2e080665f0 legacy=0x7f2e0805fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:19.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e06d9d700 1 -- 172.21.15.12:0/442153729 >> v1:172.21.15.12:6789/0 conn(0x7f2e080b1a30 legacy=0x7f2e08140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:19.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e06d9d700 1 -- 172.21.15.12:0/442153729 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080b1740 con 0x7f2e080669d0 2021-10-20T23:27:19.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e06d9d700 1 --2- 172.21.15.12:0/442153729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 0x7f2e0813e120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f2e000032f0 tx=0x7f2e000091d0).ready entity=mon.2 client_cookie=d5e844dc30642925 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:19.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e05d9b700 1 -- 172.21.15.12:0/442153729 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0000b640 con 0x7f2e080669d0 2021-10-20T23:27:19.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e05d9b700 1 -- 172.21.15.12:0/442153729 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0000b7a0 con 0x7f2e080669d0 2021-10-20T23:27:19.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e05d9b700 1 -- 172.21.15.12:0/442153729 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0000b910 con 0x7f2e080669d0 2021-10-20T23:27:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 -- 172.21.15.12:0/442153729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 msgr2=0x7f2e0813e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 --2- 172.21.15.12:0/442153729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 0x7f2e0813e120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f2e000032f0 tx=0x7f2e000091d0).stop 2021-10-20T23:27:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 -- 172.21.15.12:0/442153729 shutdown_connections 2021-10-20T23:27:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 --2- 172.21.15.12:0/442153729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 0x7f2e0813e120 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 -- 172.21.15.12:0/442153729 >> 172.21.15.12:0/442153729 conn(0x7f2e080636e0 msgr2=0x7f2e08063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 -- 172.21.15.12:0/442153729 shutdown_connections 2021-10-20T23:27:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.227+0000 7f2e0759e700 1 -- 172.21.15.12:0/442153729 wait complete. 2021-10-20T23:27:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0759e700 1 Processor -- start 2021-10-20T23:27:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0759e700 1 -- start start 2021-10-20T23:27:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e080665f0 0x7f2e08141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 0x7f2e08064730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e080b1a30 0x7f2e08064c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e08145110 con 0x7f2e080b1a30 2021-10-20T23:27:19.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e081523b0 con 0x7f2e080665f0 2021-10-20T23:27:19.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e08152650 con 0x7f2e080669d0 2021-10-20T23:27:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e06d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e080b1a30 0x7f2e08064c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e06d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e080b1a30 0x7f2e08064c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42546/0 (socket says 172.21.15.12:42546) 2021-10-20T23:27:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e06d9d700 1 -- 172.21.15.12:0/2898178997 learned_addr learned my addr 172.21.15.12:0/2898178997 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2dfffff700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 0x7f2e08064730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0659c700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e080665f0 0x7f2e08141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e06d9d700 1 -- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 msgr2=0x7f2e08064730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e06d9d700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 0x7f2e08064730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e06d9d700 1 -- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e080665f0 msgr2=0x7f2e08141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e06d9d700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e080665f0 0x7f2e08141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e06d9d700 1 -- 172.21.15.12:0/2898178997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00009470 con 0x7f2e080b1a30 2021-10-20T23:27:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e06d9d700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e080b1a30 0x7f2e08064c20 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f2e000032f0 tx=0x7f2e00016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2dff7fe700 1 -- 172.21.15.12:0/2898178997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0000b910 con 0x7f2e080b1a30 2021-10-20T23:27:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2dff7fe700 1 -- 172.21.15.12:0/2898178997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00011e60 con 0x7f2e080b1a30 2021-10-20T23:27:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e081528f0 con 0x7f2e080b1a30 2021-10-20T23:27:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.231+0000 7f2dff7fe700 1 -- 172.21.15.12:0/2898178997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0000b640 con 0x7f2e080b1a30 2021-10-20T23:27:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.235+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e080b5770 con 0x7f2e080b1a30 2021-10-20T23:27:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.235+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e08152a80 con 0x7f2e080b1a30 2021-10-20T23:27:19.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.235+0000 7f2dff7fe700 1 -- 172.21.15.12:0/2898178997 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2e0000f070 con 0x7f2e080b1a30 2021-10-20T23:27:19.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.235+0000 7f2dff7fe700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2dec053580 0x7f2dec055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:19.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.235+0000 7f2dff7fe700 1 -- 172.21.15.12:0/2898178997 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2e0006c600 con 0x7f2e080b1a30 2021-10-20T23:27:19.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.235+0000 7f2e0659c700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2dec053580 0x7f2dec055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:19.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.239+0000 7f2e0659c700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2dec053580 0x7f2dec055a40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f2df800d000 tx=0x7f2df8007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:19.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.243+0000 7f2dff7fe700 1 -- 172.21.15.12:0/2898178997 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e000434f0 con 0x7f2e080b1a30 2021-10-20T23:27:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e080b1120 con 0x7f2e080b1a30 2021-10-20T23:27:19.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2dff7fe700 1 -- 172.21.15.12:0/2898178997 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f2e00015020 con 0x7f2e080b1a30 2021-10-20T23:27:19.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:19.418 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1323051693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1323051693},{"type":"v1","addr":"172.21.15.12:6833","nonce":1323051693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":6921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2210278023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2210278023},{"type":"v1","addr":"172.21.15.12:6835","nonce":2210278023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:12.198777+0000","modified":"2021-10-20T23:27:13.230446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6964":{"gid":6964,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3694841345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3694841345},{"type":"v1","addr":"172.21.15.31:6835","nonce":3694841345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-20T23:27:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2dec053580 msgr2=0x7f2dec055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2dec053580 0x7f2dec055a40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f2df800d000 tx=0x7f2df8007a20).stop 2021-10-20T23:27:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e080b1a30 msgr2=0x7f2e08064c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e080b1a30 0x7f2e08064c20 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f2e000032f0 tx=0x7f2e00016000).stop 2021-10-20T23:27:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 shutdown_connections 2021-10-20T23:27:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2dec053580 0x7f2dec055a40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e080b1a30 0x7f2e08064c20 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e080669d0 0x7f2e08064730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 --2- 172.21.15.12:0/2898178997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e080665f0 0x7f2e08141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 >> 172.21.15.12:0/2898178997 conn(0x7f2e080636e0 msgr2=0x7f2e08145300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 shutdown_connections 2021-10-20T23:27:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:19.411+0000 7f2e0759e700 1 -- 172.21.15.12:0/2898178997 wait complete. 2021-10-20T23:27:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2021-10-20T23:27:19.736 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:27:12.198777+0000', 'modified': '2021-10-20T23:27:13.230446+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6964}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6964': {'gid': 6964, 'name': 'b', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3694841345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 3694841345}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3694841345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:27:19.737 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:27:19.738 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:27:19.855 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":6964,"want_state":"up:active","state":"up:active","rank_uptime":7.6348560980000002,"mdsmap_epoch":49,"osdmap_epoch":101,"osdmap_epoch_barrier":101,"uptime":11.944618610999999} 2021-10-20T23:27:19.856 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 6964, "mdsmap_epoch": 49, "osdmap_epoch": 101, "osdmap_epoch_barrier": 101, "rank_uptime": 7.634856098, "state": "up:active", "uptime": 11.944618611, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:27:19.856 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:27:19.857 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:27:19.857 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:27:19.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:19.858 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:19.868 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:27:19.882 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:27:19.883 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:27:19.896 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:27:19.897 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:27:19.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:19.898 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:27:19.952 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:27:19.953 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:19.956 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:27:19.975 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:27:19.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:27:20.033 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-10-20T23:27:20.030+0000 7f0a4aff7080 -1 init, newargv = 0x55da222913c0 newargc=9 2021-10-20T23:27:20.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14146]: starting ceph client 2021-10-20T23:27:20.039 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:27:20.042 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:27:20.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:20.043 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:27:20.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14146]: starting fuse 2021-10-20T23:27:20.050 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:27:20.050 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:27:20.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:20.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:27:20.052 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:27:20.052 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:27:20.055 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:27:20.055 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:27:20.055 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:27:20.056 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:27:20.056 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:27:20.057 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:27:20.057 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:27:20.057 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:27:20.058 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:27:20.058 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:27:20.059 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:27:20.059 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:27:20.059 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:27:20.060 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:27:20.060 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:27:20.061 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:27:20.061 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:27:20.061 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:27:20.062 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:27:20.062 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:27:20.137 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.14146.asok 2021-10-20T23:27:20.142 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14146.asok 2021-10-20T23:27:20.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:20.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14146.asok status 2021-10-20T23:27:20.236 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:27:20.237 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:27:20.237 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:27:20.238 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:27:20.238 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:27:20.238 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:27:20.239 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:27:20.239 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "14146", 2021-10-20T23:27:20.239 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:27:20.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:27:20.240 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:27:20.240 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:27:20.240 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 6404, 2021-10-20T23:27:20.240 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:27:20.241 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:27:20.241 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:27:20.241 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 6404 2021-10-20T23:27:20.241 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:27:20.241 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:27:20.242 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:27:20.242 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:27:20.242 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3024850902 2021-10-20T23:27:20.242 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:27:20.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:27:20.243 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:27:20.243 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:27:20.243 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:27:20.243 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3024850902 2021-10-20T23:27:20.244 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:27:20.244 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.6404 172.21.15.136:0/3024850902", 2021-10-20T23:27:20.244 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/3024850902", 2021-10-20T23:27:20.244 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:27:20.244 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 49, 2021-10-20T23:27:20.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 101, 2021-10-20T23:27:20.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:27:20.245 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:27:20.245 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:27:20.245 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:27:20.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:20.248 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:20.249 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:20.257 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:27:20.258 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:27:20.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:20.260 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:20.322 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-20T23:27:20.322 DEBUG:teuthology.orchestra.run.smithi119:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-10-20T23:27:20.352 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-20T23:27:20.353 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:27:20.353 DEBUG:teuthology.orchestra.run.smithi119:> import stat 2021-10-20T23:27:20.355 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:27:20.356 DEBUG:teuthology.orchestra.run.smithi119:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-10-20T23:27:20.357 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:27:20.474 INFO:teuthology.orchestra.run.smithi119.stdout:1099511627776 2021-10-20T23:27:20.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:20.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031ffff700 1 Processor -- start 2021-10-20T23:27:20.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031ffff700 1 -- start start 2021-10-20T23:27:20.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0320061320 0x7f0320061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:20.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03200ad5c0 0x7f03200b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:20.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031ffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03200aecf0 con 0x7f0320140440 2021-10-20T23:27:20.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03200b6f20 con 0x7f0320061320 2021-10-20T23:27:20.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03200aef20 con 0x7f03200ad5c0 2021-10-20T23:27:20.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0320061320 0x7f0320061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:20.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0320061320 0x7f0320061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42552/0 (socket says 172.21.15.12:42552) 2021-10-20T23:27:20.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031effd700 1 -- 172.21.15.12:0/2951618230 learned_addr learned my addr 172.21.15.12:0/2951618230 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:20.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f0317fff700 1 --2- 172.21.15.12:0/2951618230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03200ad5c0 0x7f03200b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:20.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031effd700 1 -- 172.21.15.12:0/2951618230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03200ad5c0 msgr2=0x7f03200b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:20.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031effd700 1 --2- 172.21.15.12:0/2951618230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03200ad5c0 0x7f03200b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:20.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031effd700 1 -- 172.21.15.12:0/2951618230 >> v1:172.21.15.12:6789/0 conn(0x7f0320140440 legacy=0x7f0320146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:20.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031effd700 1 -- 172.21.15.12:0/2951618230 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200af1c0 con 0x7f0320061320 2021-10-20T23:27:20.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f0317fff700 1 --2- 172.21.15.12:0/2951618230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03200ad5c0 0x7f03200b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:20.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031effd700 1 --2- 172.21.15.12:0/2951618230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0320061320 0x7f0320061700 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f0310002f70 tx=0x7f0310006eb0).ready entity=mon.0 client_cookie=81d4f3ed8062d8a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:20.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031e7fc700 1 -- 172.21.15.12:0/2951618230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f031000d5c0 con 0x7f0320061320 2021-10-20T23:27:20.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031e7fc700 1 -- 172.21.15.12:0/2951618230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0310000e90 con 0x7f0320061320 2021-10-20T23:27:20.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031e7fc700 1 -- 172.21.15.12:0/2951618230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f031000d950 con 0x7f0320061320 2021-10-20T23:27:20.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031ffff700 1 -- 172.21.15.12:0/2951618230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0320061320 msgr2=0x7f0320061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:20.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.771+0000 7f031ffff700 1 --2- 172.21.15.12:0/2951618230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0320061320 0x7f0320061700 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f0310002f70 tx=0x7f0310006eb0).stop 2021-10-20T23:27:20.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 -- 172.21.15.12:0/2951618230 shutdown_connections 2021-10-20T23:27:20.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 --2- 172.21.15.12:0/2951618230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03200ad5c0 0x7f03200b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 --2- 172.21.15.12:0/2951618230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0320061320 0x7f0320061700 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 -- 172.21.15.12:0/2951618230 >> 172.21.15.12:0/2951618230 conn(0x7f0320066de0 msgr2=0x7f03200671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 -- 172.21.15.12:0/2951618230 shutdown_connections 2021-10-20T23:27:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 -- 172.21.15.12:0/2951618230 wait complete. 2021-10-20T23:27:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 Processor -- start 2021-10-20T23:27:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 -- start start 2021-10-20T23:27:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0320061320 0x7f03200b8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03200ad5c0 0x7f0320145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:20.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.775+0000 7f031ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0320140440 0x7f0320152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:20.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032009e8b0 con 0x7f03200ad5c0 2021-10-20T23:27:20.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0320156800 con 0x7f0320061320 2021-10-20T23:27:20.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032009eae0 con 0x7f0320140440 2021-10-20T23:27:20.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f0317fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03200ad5c0 0x7f0320145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:20.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f0317fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03200ad5c0 0x7f0320145e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42560/0 (socket says 172.21.15.12:42560) 2021-10-20T23:27:20.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f0317fff700 1 -- 172.21.15.12:0/353632684 learned_addr learned my addr 172.21.15.12:0/353632684 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:20.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031f7fe700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0320140440 0x7f0320152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:20.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031effd700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0320061320 0x7f03200b8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:20.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f0317fff700 1 -- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0320140440 msgr2=0x7f0320152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:20.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f0317fff700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0320140440 0x7f0320152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:20.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f0317fff700 1 -- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0320061320 msgr2=0x7f03200b8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:20.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f0317fff700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0320061320 0x7f03200b8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:20.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f0317fff700 1 -- 172.21.15.12:0/353632684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031000b1e0 con 0x7f03200ad5c0 2021-10-20T23:27:20.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f0317fff700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03200ad5c0 0x7f0320145e80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f0308006940 tx=0x7f0308008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:20.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031cff9700 1 -- 172.21.15.12:0/353632684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0308011780 con 0x7f03200ad5c0 2021-10-20T23:27:20.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031cff9700 1 -- 172.21.15.12:0/353632684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03080118e0 con 0x7f03200ad5c0 2021-10-20T23:27:20.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03201562c0 con 0x7f03200ad5c0 2021-10-20T23:27:20.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031cff9700 1 -- 172.21.15.12:0/353632684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0308011c40 con 0x7f03200ad5c0 2021-10-20T23:27:20.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032009ee30 con 0x7f03200ad5c0 2021-10-20T23:27:20.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.779+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03200af460 con 0x7f03200ad5c0 2021-10-20T23:27:20.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.783+0000 7f031cff9700 1 -- 172.21.15.12:0/353632684 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f030801c460 con 0x7f03200ad5c0 2021-10-20T23:27:20.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.783+0000 7f031cff9700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0304053640 0x7f0304055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.783+0000 7f031cff9700 1 -- 172.21.15.12:0/353632684 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f030806bc10 con 0x7f03200ad5c0 2021-10-20T23:27:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.783+0000 7f031effd700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0304053640 0x7f0304055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.783+0000 7f031effd700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0304053640 0x7f0304055b00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f031001c000 tx=0x7f0310015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.787+0000 7f031cff9700 1 -- 172.21.15.12:0/353632684 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0308042b10 con 0x7f03200ad5c0 2021-10-20T23:27:20.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.955+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0320062100 con 0x7f03200ad5c0 2021-10-20T23:27:20.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.955+0000 7f031cff9700 1 -- 172.21.15.12:0/353632684 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f0308046130 con 0x7f03200ad5c0 2021-10-20T23:27:20.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1323051693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1323051693},{"type":"v1","addr":"172.21.15.12:6833","nonce":1323051693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":6921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2210278023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2210278023},{"type":"v1","addr":"172.21.15.12:6835","nonce":2210278023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:12.198777+0000","modified":"2021-10-20T23:27:13.230446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6964":{"gid":6964,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3694841345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3694841345},{"type":"v1","addr":"172.21.15.31:6835","nonce":3694841345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-20T23:27:20.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0304053640 msgr2=0x7f0304055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:20.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0304053640 0x7f0304055b00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f031001c000 tx=0x7f0310015000).stop 2021-10-20T23:27:20.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03200ad5c0 msgr2=0x7f0320145e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:20.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03200ad5c0 0x7f0320145e80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f0308006940 tx=0x7f0308008040).stop 2021-10-20T23:27:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 shutdown_connections 2021-10-20T23:27:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0304053640 0x7f0304055b00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0320140440 0x7f0320152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03200ad5c0 0x7f0320145e80 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 --2- 172.21.15.12:0/353632684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0320061320 0x7f03200b8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 >> 172.21.15.12:0/353632684 conn(0x7f0320066de0 msgr2=0x7f0320141170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 shutdown_connections 2021-10-20T23:27:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:20.959+0000 7f031ffff700 1 -- 172.21.15.12:0/353632684 wait complete. 2021-10-20T23:27:20.971 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2021-10-20T23:27:20.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 0x10000000000 2021-10-20T23:27:21.099 INFO:teuthology.orchestra.run.smithi031.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2021-10-20T23:27:20.342059+0000","btime":"2021-10-20T23:27:20.342059+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-10-20T23:27:20.342059+0000","atime":"2021-10-20T23:27:20.342059+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":7114,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":7114,"want_loner":7114,"mds_caps_wanted":[]} 2021-10-20T23:27:21.100 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2021-10-20T23:27:20.342059+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2021-10-20T23:27:20.342059+0000", "change_attr": 0, "client_caps": [ { "client_id": 7114, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-10-20T23:27:20.342059+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 7114, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2021-10-20T23:27:20.342059+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 7114, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2021-10-20T23:27:21.101 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:27:21.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:21.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:21.154 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:21.184 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:21.246 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:27:21.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:21.249 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:21.250 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:21.286 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:27:21.286 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:27:21.287 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:27:21.288 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:27:21.289 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:21.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14635]: fuse finished with error 0 and tester_r 0 2021-10-20T23:27:21.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:21.340 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:21.341 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:21.414 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:27:21.423 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:27:21.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:27:21.502 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:21.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:21.552 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:21.553 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:21.592 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:27:21.593 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:27:21.595 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:27:21.596 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:27:21.597 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:21.628 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14146]: fuse finished with error 0 and tester_r 0 2021-10-20T23:27:21.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:21.639 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:21.639 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:21.684 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:27:21.685 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:27:21.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:27:21.805 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:21.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:27:21.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b44b1e700 1 Processor -- start 2021-10-20T23:27:21.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b44b1e700 1 -- start start 2021-10-20T23:27:21.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b44b1e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2b400ad5c0 0x7f2b40061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:21.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b44b1e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b400aecf0 con 0x7f2b40061320 2021-10-20T23:27:21.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b44b1e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b400b6f20 con 0x7f2b40140440 2021-10-20T23:27:21.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b44b1e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b400aef20 con 0x7f2b400ad5c0 2021-10-20T23:27:21.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2b40061320 0x7f2b400b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41160/0 (socket says 172.21.15.12:41160) 2021-10-20T23:27:21.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3f7fe700 1 -- 172.21.15.12:0/3297238873 learned_addr learned my addr 172.21.15.12:0/3297238873 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:21.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3effd700 1 --2- 172.21.15.12:0/3297238873 >> v2:172.21.15.31:3300/0 conn(0x7f2b400ad5c0 0x7f2b40061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:21.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797407932 0 0) 0x7f2b400aecf0 con 0x7f2b40061320 2021-10-20T23:27:21.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b24003260 con 0x7f2b40061320 2021-10-20T23:27:21.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1434753684 0 0) 0x7f2b24003260 con 0x7f2b40061320 2021-10-20T23:27:21.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 >> v2:172.21.15.31:3300/0 conn(0x7f2b400ad5c0 msgr2=0x7f2b40061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:21.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 --2- 172.21.15.12:0/3297238873 >> v2:172.21.15.31:3300/0 conn(0x7f2b400ad5c0 0x7f2b40061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:21.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 >> v1:172.21.15.31:6789/0 conn(0x7f2b40140440 legacy=0x7f2b40146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:21.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400af1c0 con 0x7f2b40061320 2021-10-20T23:27:21.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f2b300019e0 con 0x7f2b40061320 2021-10-20T23:27:21.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 >> v1:172.21.15.12:6789/0 conn(0x7f2b40061320 legacy=0x7f2b400b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:21.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24003750 0x7f2b24003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:21.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b24004500 0x7f2b24004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:21.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b2400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:21.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b400aef20 con 0x7f2b24004e70 2021-10-20T23:27:21.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2400bd20 con 0x7f2b24003750 2021-10-20T23:27:21.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2400bee0 con 0x7f2b24004500 2021-10-20T23:27:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3ffff700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b2400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3effd700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b24004500 0x7f2b24004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3f7fe700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24003750 0x7f2b24003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3ffff700 1 -- 172.21.15.12:0/3297238873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b24004500 msgr2=0x7f2b24004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3ffff700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b24004500 0x7f2b24004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3ffff700 1 -- 172.21.15.12:0/3297238873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24003750 msgr2=0x7f2b24003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3ffff700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24003750 0x7f2b24003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.967+0000 7f2b3ffff700 1 -- 172.21.15.12:0/3297238873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24003260 con 0x7f2b24004e70 2021-10-20T23:27:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b3ffff700 1 -- 172.21.15.12:0/3297238873 reap_dead start 2021-10-20T23:27:21.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b3ffff700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b2400b750 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f2b400af7e0 tx=0x7f2b38007a00).ready entity=mon.0 client_cookie=b4ab1ccec9370759 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:21.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b38007d10 con 0x7f2b24004e70 2021-10-20T23:27:21.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b38007030 con 0x7f2b24004e70 2021-10-20T23:27:21.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/3297238873 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b38007390 con 0x7f2b24004e70 2021-10-20T23:27:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3297238873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 msgr2=0x7f2b2400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b2400b750 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f2b400af7e0 tx=0x7f2b38007a00).stop 2021-10-20T23:27:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3297238873 shutdown_connections 2021-10-20T23:27:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 --2- 172.21.15.12:0/3297238873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b2400b750 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3297238873 >> 172.21.15.12:0/3297238873 conn(0x7f2b40066de0 msgr2=0x7f2b400671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:21.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3297238873 shutdown_connections 2021-10-20T23:27:21.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3297238873 wait complete. 2021-10-20T23:27:21.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 Processor -- start 2021-10-20T23:27:21.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 -- start start 2021-10-20T23:27:21.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b400b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:21.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b40144160 0x7f2b400b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:21.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b400b0c10 0x7f2b400b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:21.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b40140f40 con 0x7f2b24004e70 2021-10-20T23:27:21.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b40143230 con 0x7f2b400b0c10 2021-10-20T23:27:21.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b44b1e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b401423a0 con 0x7f2b40144160 2021-10-20T23:27:21.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b3f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b400b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:21.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b3f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b400b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42578/0 (socket says 172.21.15.12:42578) 2021-10-20T23:27:21.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b3f7fe700 1 -- 172.21.15.12:0/3694396186 learned_addr learned my addr 172.21.15.12:0/3694396186 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:21.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.971+0000 7f2b3effd700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b40144160 0x7f2b400b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:21.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3ffff700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b400b0c10 0x7f2b400b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:21.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3f7fe700 1 -- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b40144160 msgr2=0x7f2b400b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:21.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3f7fe700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b40144160 0x7f2b400b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:21.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3f7fe700 1 -- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b400b0c10 msgr2=0x7f2b400b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:21.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3f7fe700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b400b0c10 0x7f2b400b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:21.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3f7fe700 1 -- 172.21.15.12:0/3694396186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b401413b0 con 0x7f2b24004e70 2021-10-20T23:27:21.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3f7fe700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b400b0720 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f2b40142530 tx=0x7f2b400af350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:21.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3cff9700 1 -- 172.21.15.12:0/3694396186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3000f8f0 con 0x7f2b24004e70 2021-10-20T23:27:21.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3cff9700 1 -- 172.21.15.12:0/3694396186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3000fa50 con 0x7f2b24004e70 2021-10-20T23:27:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b40142100 con 0x7f2b24004e70 2021-10-20T23:27:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3cff9700 1 -- 172.21.15.12:0/3694396186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3000fdb0 con 0x7f2b24004e70 2021-10-20T23:27:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b400b3d10 con 0x7f2b24004e70 2021-10-20T23:27:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b400af460 con 0x7f2b24004e70 2021-10-20T23:27:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3cff9700 1 -- 172.21.15.12:0/3694396186 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2b3001b030 con 0x7f2b24004e70 2021-10-20T23:27:21.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.975+0000 7f2b3cff9700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b180535b0 0x7f2b18055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:21.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.979+0000 7f2b3cff9700 1 -- 172.21.15.12:0/3694396186 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2b3006b740 con 0x7f2b24004e70 2021-10-20T23:27:21.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.979+0000 7f2b3effd700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b180535b0 0x7f2b18055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:21.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.979+0000 7f2b3effd700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b180535b0 0x7f2b18055a70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f2b2800b000 tx=0x7f2b28006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:21.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:21.983+0000 7f2b3cff9700 1 -- 172.21.15.12:0/3694396186 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b300426c0 con 0x7f2b24004e70 2021-10-20T23:27:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.111+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2b40057350 con 0x7f2b24004e70 2021-10-20T23:27:22.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.111+0000 7f2b3cff9700 1 -- 172.21.15.12:0/3694396186 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v101) v1 ==== 81+0+34043 (secure 0 0 0) 0x7f2b30019030 con 0x7f2b24004e70 2021-10-20T23:27:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:22.122 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 101, 2021-10-20T23:27:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:27:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:27:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:27:13.204259+0000", 2021-10-20T23:27:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:27:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:27:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:27:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:27:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:27:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:27:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:27:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:27:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:27:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:27:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:27:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:27:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 18, 2021-10-20T23:27:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:27:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:27:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:27:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:27:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:27:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:27:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:27:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:27:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:27:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:27:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:27:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:27:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:27:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:27:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:27:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:27:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:27:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:27:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:27:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:27:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:27:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:27:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:27:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:27:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:27:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:27:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:27:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:27:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 17, 2021-10-20T23:27:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:27:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:27:10.667132+0000", 2021-10-20T23:27:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:27:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:27:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:27:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:27:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:27:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "100", 2021-10-20T23:27:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:27:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:27:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:27:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:27:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:27:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:27:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 18, 2021-10-20T23:27:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:27:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:27:11.561636+0000", 2021-10-20T23:27:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:27:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:27:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:27:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:27:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:27:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "101", 2021-10-20T23:27:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:27:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:27:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:27:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:27:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:27:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 98, 2021-10-20T23:27:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:27:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:27:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:27:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:27:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:27:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:27:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:27:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:27:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:27:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:27:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:27:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:27:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:27:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 98, 2021-10-20T23:27:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:27:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:27:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:27:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:27:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:27:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:27:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:27:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:27:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:27:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:27:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:27:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:27:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:27:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 99, 2021-10-20T23:27:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:27:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:27:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:27:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:27:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:27:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:27:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:27:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:27:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:27:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:27:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:27:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:27:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:27:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 99, 2021-10-20T23:27:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:27:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:27:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:27:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:27:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:27:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:27:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:27:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:27:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:27:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:27:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:27:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:27:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:27:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 97, 2021-10-20T23:27:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:27:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:27:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:27:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:27:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:27:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:27:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:27:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:27:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:27:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:27:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:27:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:27:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:27:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:27:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:27:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:27:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:27:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:27:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:27:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:27:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:27:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:27:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:27:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:27:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:27:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:27:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:27:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 97, 2021-10-20T23:27:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:27:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:27:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:27:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:27:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:27:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:27:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:27:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:27:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:27:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:27:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:27:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:27:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:27:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 98, 2021-10-20T23:27:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:27:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:27:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:27:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:27:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:27:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:27:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:27:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:27:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:27:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:27:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:27:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:27:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:27:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:27:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:27:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:27:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:27:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:27:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:27:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:27:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:27:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:27:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:27:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:27:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:27:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:27:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:27:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:27:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:27:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:27:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:27:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:27:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:27:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:27:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:27:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:27:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:27:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:27:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:27:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:27:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:27:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:27:22.361 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b180535b0 msgr2=0x7f2b18055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b180535b0 0x7f2b18055a70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f2b2800b000 tx=0x7f2b28006df0).stop 2021-10-20T23:27:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 msgr2=0x7f2b400b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b400b0720 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f2b40142530 tx=0x7f2b400af350).stop 2021-10-20T23:27:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 shutdown_connections 2021-10-20T23:27:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b180535b0 0x7f2b18055a70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b400b0c10 0x7f2b400b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b40144160 0x7f2b400b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 --2- 172.21.15.12:0/3694396186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b24004e70 0x7f2b400b0720 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 >> 172.21.15.12:0/3694396186 conn(0x7f2b40066de0 msgr2=0x7f2b40144650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 shutdown_connections 2021-10-20T23:27:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.115+0000 7f2b44b1e700 1 -- 172.21.15.12:0/3694396186 wait complete. 2021-10-20T23:27:22.367 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f3261b700 1 Processor -- start 2021-10-20T23:27:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f3261b700 1 -- start start 2021-10-20T23:27:22.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f3261b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b2580 0x7f6f2c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f3261b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f2c0b0010 0x7f6f2c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f3261b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c0a70c0 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f3261b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2c0a72f0 con 0x7f6f2c0b0010 2021-10-20T23:27:22.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f3261b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c0a7590 con 0x7f6f2c0b2580 2021-10-20T23:27:22.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f30e18700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f2c0b0010 0x7f6f2c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f30e18700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f2c0b0010 0x7f6f2c14b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42586/0 (socket says 172.21.15.12:42586) 2021-10-20T23:27:22.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f30e18700 1 -- 172.21.15.12:0/730829007 learned_addr learned my addr 172.21.15.12:0/730829007 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:22.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f31619700 1 --2- 172.21.15.12:0/730829007 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b2580 0x7f6f2c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f1ffff700 1 -- 172.21.15.12:0/730829007 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639364673 0 0) 0x7f6f2c0a70c0 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f1ffff700 1 -- 172.21.15.12:0/730829007 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f10003260 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f30e18700 1 -- 172.21.15.12:0/730829007 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b2580 msgr2=0x7f6f2c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:22.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f30e18700 1 --2- 172.21.15.12:0/730829007 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b2580 0x7f6f2c14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f30e18700 1 -- 172.21.15.12:0/730829007 >> v1:172.21.15.31:6789/0 conn(0x7f6f2c0afbd0 legacy=0x7f6f2c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f30e18700 1 -- 172.21.15.12:0/730829007 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0a7830 con 0x7f6f2c0b0010 2021-10-20T23:27:22.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f31619700 1 --2- 172.21.15.12:0/730829007 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b2580 0x7f6f2c14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:22.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.475+0000 7f6f30e18700 1 --2- 172.21.15.12:0/730829007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0b0010 0x7f6f2c14b330 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f6f20002f70 tx=0x7f6f20006eb0).ready entity=mon.0 client_cookie=f1e87956e34e626c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:22.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f1ffff700 1 -- 172.21.15.12:0/730829007 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2000d5c0 con 0x7f6f2c0b0010 2021-10-20T23:27:22.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f1ffff700 1 -- 172.21.15.12:0/730829007 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20000e90 con 0x7f6f2c0b0010 2021-10-20T23:27:22.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f1ffff700 1 -- 172.21.15.12:0/730829007 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2000d950 con 0x7f6f2c0b0010 2021-10-20T23:27:22.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 -- 172.21.15.12:0/730829007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0b0010 msgr2=0x7f6f2c14b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 --2- 172.21.15.12:0/730829007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0b0010 0x7f6f2c14b330 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f6f20002f70 tx=0x7f6f20006eb0).stop 2021-10-20T23:27:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 -- 172.21.15.12:0/730829007 shutdown_connections 2021-10-20T23:27:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 --2- 172.21.15.12:0/730829007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0b0010 0x7f6f2c14b330 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 --2- 172.21.15.12:0/730829007 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b2580 0x7f6f2c14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 -- 172.21.15.12:0/730829007 >> 172.21.15.12:0/730829007 conn(0x7f6f2c060180 msgr2=0x7f6f2c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:22.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 -- 172.21.15.12:0/730829007 shutdown_connections 2021-10-20T23:27:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 -- 172.21.15.12:0/730829007 wait complete. 2021-10-20T23:27:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 Processor -- start 2021-10-20T23:27:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.479+0000 7f6f3261b700 1 -- start start 2021-10-20T23:27:22.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f3261b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0afbd0 0x7f6f2c0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f3261b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b0010 0x7f6f2c143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f3261b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c0b2580 0x7f6f2c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f3261b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c156500 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f3261b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c1567a0 con 0x7f6f2c0b2580 2021-10-20T23:27:22.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f3261b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c156a40 con 0x7f6f2c0b0010 2021-10-20T23:27:22.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31619700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0afbd0 0x7f6f2c0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31619700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0afbd0 0x7f6f2c0b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42592/0 (socket says 172.21.15.12:42592) 2021-10-20T23:27:22.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31619700 1 -- 172.21.15.12:0/3228233343 learned_addr learned my addr 172.21.15.12:0/3228233343 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:22.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f30e18700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b0010 0x7f6f2c143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31e1a700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c0b2580 0x7f6f2c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31619700 1 -- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b0010 msgr2=0x7f6f2c143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31619700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b0010 0x7f6f2c143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31619700 1 -- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c0b2580 msgr2=0x7f6f2c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31619700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c0b2580 0x7f6f2c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31619700 1 -- 172.21.15.12:0/3228233343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2800b180 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31e1a700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c0b2580 0x7f6f2c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f31619700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0afbd0 0x7f6f2c0b2dd0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f6f2800c000 tx=0x7f6f28006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f1e7fc700 1 -- 172.21.15.12:0/3228233343 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f28010780 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f1e7fc700 1 -- 172.21.15.12:0/3228233343 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f280108e0 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2000b1e0 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f1e7fc700 1 -- 172.21.15.12:0/3228233343 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f28010c40 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c157180 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c057350 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.483+0000 7f6f1e7fc700 1 -- 172.21.15.12:0/3228233343 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f2801c460 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.487+0000 7f6f1e7fc700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f140536d0 0x7f6f14055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.487+0000 7f6f1e7fc700 1 -- 172.21.15.12:0/3228233343 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6f2806c080 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.487+0000 7f6f30e18700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f140536d0 0x7f6f14055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.487+0000 7f6f30e18700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f140536d0 0x7f6f14055b90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f6f2001c000 tx=0x7f6f20015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:22.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.491+0000 7f6f1e7fc700 1 -- 172.21.15.12:0/3228233343 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f28042f80 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.659+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f2c0698e0 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.659+0000 7f6f1e7fc700 1 -- 172.21.15.12:0/3228233343 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f6f280465a0 con 0x7f6f2c0afbd0 2021-10-20T23:27:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:22.669 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1323051693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1323051693},{"type":"v1","addr":"172.21.15.12:6833","nonce":1323051693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":6921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2210278023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2210278023},{"type":"v1","addr":"172.21.15.12:6835","nonce":2210278023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:12.198777+0000","modified":"2021-10-20T23:27:13.230446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6964":{"gid":6964,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3694841345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3694841345},{"type":"v1","addr":"172.21.15.31:6835","nonce":3694841345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-20T23:27:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f140536d0 msgr2=0x7f6f14055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f140536d0 0x7f6f14055b90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f6f2001c000 tx=0x7f6f20015000).stop 2021-10-20T23:27:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0afbd0 msgr2=0x7f6f2c0b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0afbd0 0x7f6f2c0b2dd0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f6f2800c000 tx=0x7f6f28006df0).stop 2021-10-20T23:27:22.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 shutdown_connections 2021-10-20T23:27:22.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f140536d0 0x7f6f14055b90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c0b2580 0x7f6f2c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c0b0010 0x7f6f2c143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 --2- 172.21.15.12:0/3228233343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2c0afbd0 0x7f6f2c0b2dd0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 >> 172.21.15.12:0/3228233343 conn(0x7f6f2c060180 msgr2=0x7f6f2c144ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 shutdown_connections 2021-10-20T23:27:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.663+0000 7f6f3261b700 1 -- 172.21.15.12:0/3228233343 wait complete. 2021-10-20T23:27:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2021-10-20T23:27:22.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:27:22.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7febfff700 1 Processor -- start 2021-10-20T23:27:22.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7febfff700 1 -- start start 2021-10-20T23:27:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7febfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec061320 0x7f7fec061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7febfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7fec0ad5c0 0x7f7fec0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7febfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7fec140440 0x7f7fec1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7febfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fec0aecf0 con 0x7f7fec140440 2021-10-20T23:27:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7febfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fec0b6f20 con 0x7f7fec0ad5c0 2021-10-20T23:27:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7febfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec0aef20 con 0x7f7fec061320 2021-10-20T23:27:22.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feb7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7fec140440 0x7f7fec1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feb7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7fec140440 0x7f7fec1408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42600/0 (socket says 172.21.15.12:42600) 2021-10-20T23:27:22.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feb7fe700 1 -- 172.21.15.12:0/3523099974 learned_addr learned my addr 172.21.15.12:0/3523099974 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feaffd700 1 --2- 172.21.15.12:0/3523099974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec061320 0x7f7fec061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7fea7fc700 1 --2- 172.21.15.12:0/3523099974 >> v2:172.21.15.31:3300/0 conn(0x7f7fec0ad5c0 0x7f7fec0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feb7fe700 1 -- 172.21.15.12:0/3523099974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec061320 msgr2=0x7f7fec061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feb7fe700 1 --2- 172.21.15.12:0/3523099974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec061320 0x7f7fec061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feb7fe700 1 -- 172.21.15.12:0/3523099974 >> v2:172.21.15.31:3300/0 conn(0x7f7fec0ad5c0 msgr2=0x7f7fec0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:22.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feb7fe700 1 --2- 172.21.15.12:0/3523099974 >> v2:172.21.15.31:3300/0 conn(0x7f7fec0ad5c0 0x7f7fec0b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feb7fe700 1 -- 172.21.15.12:0/3523099974 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec0af1c0 con 0x7f7fec140440 2021-10-20T23:27:22.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7feb7fe700 1 --2- 172.21.15.12:0/3523099974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec140440 0x7f7fec1408f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f7fe4002f70 tx=0x7f7fe4006eb0).ready entity=mon.0 client_cookie=69f9d163785e2636 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:22.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7fe9ffb700 1 -- 172.21.15.12:0/3523099974 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fe400d570 con 0x7f7fec140440 2021-10-20T23:27:22.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7fe9ffb700 1 -- 172.21.15.12:0/3523099974 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe4000e90 con 0x7f7fec140440 2021-10-20T23:27:22.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.783+0000 7f7fe9ffb700 1 -- 172.21.15.12:0/3523099974 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fe400d900 con 0x7f7fec140440 2021-10-20T23:27:22.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- 172.21.15.12:0/3523099974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec140440 msgr2=0x7f7fec1408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 --2- 172.21.15.12:0/3523099974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec140440 0x7f7fec1408f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f7fe4002f70 tx=0x7f7fe4006eb0).stop 2021-10-20T23:27:22.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- 172.21.15.12:0/3523099974 shutdown_connections 2021-10-20T23:27:22.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 --2- 172.21.15.12:0/3523099974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec140440 0x7f7fec1408f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 --2- 172.21.15.12:0/3523099974 >> v2:172.21.15.31:3300/0 conn(0x7f7fec0ad5c0 0x7f7fec0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 --2- 172.21.15.12:0/3523099974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec061320 0x7f7fec061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- 172.21.15.12:0/3523099974 >> 172.21.15.12:0/3523099974 conn(0x7f7fec066de0 msgr2=0x7f7fec0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:22.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- 172.21.15.12:0/3523099974 shutdown_connections 2021-10-20T23:27:22.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- 172.21.15.12:0/3523099974 wait complete. 2021-10-20T23:27:22.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 Processor -- start 2021-10-20T23:27:22.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- start start 2021-10-20T23:27:22.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec061320 0x7f7fec142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec0ad5c0 0x7f7fec13f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec140440 0x7f7fec13fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec0aae10 con 0x7f7fec061320 2021-10-20T23:27:22.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec156380 con 0x7f7fec140440 2021-10-20T23:27:22.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec156620 con 0x7f7fec0ad5c0 2021-10-20T23:27:22.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec061320 0x7f7fec142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec061320 0x7f7fec142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42604/0 (socket says 172.21.15.12:42604) 2021-10-20T23:27:22.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feaffd700 1 -- 172.21.15.12:0/4040830567 learned_addr learned my addr 172.21.15.12:0/4040830567 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:22.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7fea7fc700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec0ad5c0 0x7f7fec13f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feb7fe700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec140440 0x7f7fec13fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feaffd700 1 -- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec0ad5c0 msgr2=0x7f7fec13f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feaffd700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec0ad5c0 0x7f7fec13f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feaffd700 1 -- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec140440 msgr2=0x7f7fec13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:22.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feaffd700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec140440 0x7f7fec13fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:22.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feaffd700 1 -- 172.21.15.12:0/4040830567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe400b1e0 con 0x7f7fec061320 2021-10-20T23:27:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7feaffd700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec061320 0x7f7fec142140 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f7fdc006e00 tx=0x7f7fdc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7fe3fff700 1 -- 172.21.15.12:0/4040830567 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fdc00c850 con 0x7f7fec061320 2021-10-20T23:27:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7fe3fff700 1 -- 172.21.15.12:0/4040830567 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc00c9b0 con 0x7f7fec061320 2021-10-20T23:27:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fec140170 con 0x7f7fec061320 2021-10-20T23:27:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.787+0000 7f7fe3fff700 1 -- 172.21.15.12:0/4040830567 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fdc00cd10 con 0x7f7fec061320 2021-10-20T23:27:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.791+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec0aa0c0 con 0x7f7fec061320 2021-10-20T23:27:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.791+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec1561b0 con 0x7f7fec061320 2021-10-20T23:27:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.791+0000 7f7fe3fff700 1 -- 172.21.15.12:0/4040830567 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7fdc022070 con 0x7f7fec061320 2021-10-20T23:27:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.791+0000 7f7fe3fff700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7fc40534f0 0x7f7fc40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.791+0000 7f7fe3fff700 1 -- 172.21.15.12:0/4040830567 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7fdc06c300 con 0x7f7fec061320 2021-10-20T23:27:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.791+0000 7f7fea7fc700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7fc40534f0 0x7f7fc40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.791+0000 7f7fea7fc700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7fc40534f0 0x7f7fc40559b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f7fd400b000 tx=0x7f7fd4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.795+0000 7f7fe3fff700 1 -- 172.21.15.12:0/4040830567 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7fdc043300 con 0x7f7fec061320 2021-10-20T23:27:22.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:22.963+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7fec152270 con 0x7f7fec061320 2021-10-20T23:27:23.943 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:27:23.935+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:27:23.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.947+0000 7f7fe3fff700 1 -- 172.21.15.12:0/4040830567 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7fdc016020 con 0x7f7fec061320 2021-10-20T23:27:23.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7fc40534f0 msgr2=0x7f7fc40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:23.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7fc40534f0 0x7f7fc40559b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f7fd400b000 tx=0x7f7fd4008040).stop 2021-10-20T23:27:23.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec061320 msgr2=0x7f7fec142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec061320 0x7f7fec142140 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f7fdc006e00 tx=0x7f7fdc0091d0).stop 2021-10-20T23:27:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 shutdown_connections 2021-10-20T23:27:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7fc40534f0 0x7f7fc40559b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec140440 0x7f7fec13fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fec0ad5c0 0x7f7fec13f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 --2- 172.21.15.12:0/4040830567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fec061320 0x7f7fec142140 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 >> 172.21.15.12:0/4040830567 conn(0x7f7fec066de0 msgr2=0x7f7fec0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 shutdown_connections 2021-10-20T23:27:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:23.951+0000 7f7febfff700 1 -- 172.21.15.12:0/4040830567 wait complete. 2021-10-20T23:27:23.962 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:27:23.974 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:23.980 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:27:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbe5109700 1 Processor -- start 2021-10-20T23:27:24.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbe5109700 1 -- start start 2021-10-20T23:27:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbe5109700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbbe00b2580 0x7fbbe0140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbe5109700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe0067880 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbe5109700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe0067b20 con 0x7fbbe00b00e0 2021-10-20T23:27:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbe5109700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe00ad5b0 con 0x7fbbe00b2580 2021-10-20T23:27:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbdffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbbe00b2580 0x7fbbe0140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbe4908700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbbe00ac6f0 0x7fbbe0143580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41210/0 (socket says 172.21.15.12:41210) 2021-10-20T23:27:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbe4908700 1 -- 172.21.15.12:0/1687080052 learned_addr learned my addr 172.21.15.12:0/1687080052 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbdffff700 1 -- 172.21.15.12:0/1687080052 >> v1:172.21.15.31:6789/0 conn(0x7fbbe00b00e0 legacy=0x7fbbe0142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbdeffd700 1 -- 172.21.15.12:0/1687080052 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351535633 0 0) 0x7fbbe0067b20 con 0x7fbbe00b00e0 2021-10-20T23:27:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbdffff700 1 -- 172.21.15.12:0/1687080052 >> v1:172.21.15.12:6789/0 conn(0x7fbbe00ac6f0 legacy=0x7fbbe0143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.083+0000 7fbbdffff700 1 -- 172.21.15.12:0/1687080052 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe0146fd0 con 0x7fbbe00b2580 2021-10-20T23:27:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbdffff700 1 --2- 172.21.15.12:0/1687080052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00b2580 0x7fbbe0140050 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fbbd8001490 tx=0x7fbbd0006df0).ready entity=mon.0 client_cookie=9a9cac11dd595d57 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbdeffd700 1 -- 172.21.15.12:0/1687080052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbd000d5c0 con 0x7fbbe00b2580 2021-10-20T23:27:24.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbdeffd700 1 -- 172.21.15.12:0/1687080052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd0000e90 con 0x7fbbe00b2580 2021-10-20T23:27:24.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbdeffd700 1 -- 172.21.15.12:0/1687080052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbd000d910 con 0x7fbbe00b2580 2021-10-20T23:27:24.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbe5109700 1 -- 172.21.15.12:0/1687080052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00b2580 msgr2=0x7fbbe0140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbe5109700 1 --2- 172.21.15.12:0/1687080052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00b2580 0x7fbbe0140050 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fbbd8001490 tx=0x7fbbd0006df0).stop 2021-10-20T23:27:24.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbe5109700 1 -- 172.21.15.12:0/1687080052 shutdown_connections 2021-10-20T23:27:24.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbe5109700 1 --2- 172.21.15.12:0/1687080052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00b2580 0x7fbbe0140050 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbe5109700 1 -- 172.21.15.12:0/1687080052 >> 172.21.15.12:0/1687080052 conn(0x7fbbe0060180 msgr2=0x7fbbe00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:24.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbe5109700 1 -- 172.21.15.12:0/1687080052 shutdown_connections 2021-10-20T23:27:24.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbe5109700 1 -- 172.21.15.12:0/1687080052 wait complete. 2021-10-20T23:27:24.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbe5109700 1 Processor -- start 2021-10-20T23:27:24.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.087+0000 7fbbe5109700 1 -- start start 2021-10-20T23:27:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe5109700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00ac6f0 0x7fbbe0145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe5109700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbe00b00e0 0x7fbbe00ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe5109700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe00b2580 0x7fbbe009e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe5109700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00a13c0 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe5109700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00a09e0 con 0x7fbbe00b2580 2021-10-20T23:27:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe5109700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00a0c80 con 0x7fbbe00b00e0 2021-10-20T23:27:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00ac6f0 0x7fbbe0145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00ac6f0 0x7fbbe0145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42618/0 (socket says 172.21.15.12:42618) 2021-10-20T23:27:24.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdffff700 1 -- 172.21.15.12:0/4136469226 learned_addr learned my addr 172.21.15.12:0/4136469226 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:24.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdf7fe700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbe00b00e0 0x7fbbe00ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe4908700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe00b2580 0x7fbbe009e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdffff700 1 -- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbe00b00e0 msgr2=0x7fbbe00ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdffff700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbe00b00e0 0x7fbbe00ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdffff700 1 -- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe00b2580 msgr2=0x7fbbe009e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdffff700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe00b2580 0x7fbbe009e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdffff700 1 -- 172.21.15.12:0/4136469226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd000b180 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdffff700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00ac6f0 0x7fbbe0145a50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fbbd8001490 tx=0x7fbbd0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdd7fa700 1 -- 172.21.15.12:0/4136469226 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbd0013de0 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdd7fa700 1 -- 172.21.15.12:0/4136469226 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd0002f70 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe00a0f20 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbdd7fa700 1 -- 172.21.15.12:0/4136469226 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbd001e5f0 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe00ab180 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.091+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe00a10e0 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.095+0000 7fbbdd7fa700 1 -- 172.21.15.12:0/4136469226 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbbd0025030 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.095+0000 7fbbdd7fa700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc00536d0 0x7fbbc0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.095+0000 7fbbdd7fa700 1 -- 172.21.15.12:0/4136469226 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fbbd006c950 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.095+0000 7fbbdf7fe700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc00536d0 0x7fbbc0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.095+0000 7fbbdf7fe700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc00536d0 0x7fbbc0055b90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fbbd400d000 tx=0x7fbbd4007a60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.099+0000 7fbbdd7fa700 1 -- 172.21.15.12:0/4136469226 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbbd00437f0 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.263+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbe0057350 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.263+0000 7fbbdd7fa700 1 -- 172.21.15.12:0/4136469226 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2133 (secure 0 0 0) 0x7fbbd0023020 con 0x7fbbe00ac6f0 2021-10-20T23:27:24.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:24.272 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":50,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1323051693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1323051693},{"type":"v1","addr":"172.21.15.12:6833","nonce":1323051693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":6921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2210278023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2210278023},{"type":"v1","addr":"172.21.15.12:6835","nonce":2210278023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:12.198777+0000","modified":"2021-10-20T23:27:23.938109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-20T23:27:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc00536d0 msgr2=0x7fbbc0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc00536d0 0x7fbbc0055b90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fbbd400d000 tx=0x7fbbd4007a60).stop 2021-10-20T23:27:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00ac6f0 msgr2=0x7fbbe0145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00ac6f0 0x7fbbe0145a50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fbbd8001490 tx=0x7fbbd0014000).stop 2021-10-20T23:27:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 shutdown_connections 2021-10-20T23:27:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbbc00536d0 0x7fbbc0055b90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe00b2580 0x7fbbe009e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbbe00b00e0 0x7fbbe00ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 --2- 172.21.15.12:0/4136469226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe00ac6f0 0x7fbbe0145a50 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 >> 172.21.15.12:0/4136469226 conn(0x7fbbe0060180 msgr2=0x7fbbe00b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 shutdown_connections 2021-10-20T23:27:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.267+0000 7fbbe5109700 1 -- 172.21.15.12:0/4136469226 wait complete. 2021-10-20T23:27:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 50 2021-10-20T23:27:24.285 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:27:24.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a9b248700 1 Processor -- start 2021-10-20T23:27:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a9b248700 1 -- start start 2021-10-20T23:27:24.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a9b248700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a940b10f0 0x7f4a9413f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a9b248700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9413f880 con 0x7f4a9405c7d0 2021-10-20T23:27:24.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a9b248700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9405cbb0 con 0x7f4a9405d0b0 2021-10-20T23:27:24.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a9b248700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a940ad540 con 0x7f4a940b10f0 2021-10-20T23:27:24.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a9a246700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a9405c7d0 0x7f4a940ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41220/0 (socket says 172.21.15.12:41220) 2021-10-20T23:27:24.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a9a246700 1 -- 172.21.15.12:0/2209878496 learned_addr learned my addr 172.21.15.12:0/2209878496 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:24.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a9aa47700 1 --2- 172.21.15.12:0/2209878496 >> v2:172.21.15.12:3300/0 conn(0x7f4a940b10f0 0x7f4a9413f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a99244700 1 -- 172.21.15.12:0/2209878496 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321050896 0 0) 0x7f4a88001110 con 0x7f4a9405c7d0 2021-10-20T23:27:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a99244700 1 -- 172.21.15.12:0/2209878496 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a7c004370 con 0x7f4a9405c7d0 2021-10-20T23:27:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.383+0000 7f4a99244700 1 -- 172.21.15.12:0/2209878496 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694934140 0 0) 0x7f4a9405cbb0 con 0x7f4a9405d0b0 2021-10-20T23:27:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a99244700 1 -- 172.21.15.12:0/2209878496 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a88001110 con 0x7f4a9405d0b0 2021-10-20T23:27:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a99244700 1 -- 172.21.15.12:0/2209878496 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3798189319 0 0) 0x7f4a7c004370 con 0x7f4a9405c7d0 2021-10-20T23:27:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9aa47700 1 -- 172.21.15.12:0/2209878496 >> v1:172.21.15.31:6789/0 conn(0x7f4a9405d0b0 legacy=0x7f4a940aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9aa47700 1 -- 172.21.15.12:0/2209878496 >> v1:172.21.15.12:6789/0 conn(0x7f4a9405c7d0 legacy=0x7f4a940ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9aa47700 1 -- 172.21.15.12:0/2209878496 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a940b1520 con 0x7f4a940b10f0 2021-10-20T23:27:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9aa47700 1 --2- 172.21.15.12:0/2209878496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a940b10f0 0x7f4a9413f390 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f4a880012a0 tx=0x7f4a8c0091d0).ready entity=mon.0 client_cookie=12b9fc8515fb624e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a99244700 1 -- 172.21.15.12:0/2209878496 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a880017f0 con 0x7f4a940b10f0 2021-10-20T23:27:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a99244700 1 -- 172.21.15.12:0/2209878496 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c00f510 con 0x7f4a940b10f0 2021-10-20T23:27:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a99244700 1 -- 172.21.15.12:0/2209878496 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a8c00f680 con 0x7f4a940b10f0 2021-10-20T23:27:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9b248700 1 -- 172.21.15.12:0/2209878496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a940b10f0 msgr2=0x7f4a9413f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9b248700 1 --2- 172.21.15.12:0/2209878496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a940b10f0 0x7f4a9413f390 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f4a880012a0 tx=0x7f4a8c0091d0).stop 2021-10-20T23:27:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9b248700 1 -- 172.21.15.12:0/2209878496 shutdown_connections 2021-10-20T23:27:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9b248700 1 --2- 172.21.15.12:0/2209878496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a940b10f0 0x7f4a9413f390 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9b248700 1 -- 172.21.15.12:0/2209878496 >> 172.21.15.12:0/2209878496 conn(0x7f4a94060180 msgr2=0x7f4a940b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9b248700 1 -- 172.21.15.12:0/2209878496 shutdown_connections 2021-10-20T23:27:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9b248700 1 -- 172.21.15.12:0/2209878496 wait complete. 2021-10-20T23:27:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9b248700 1 Processor -- start 2021-10-20T23:27:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.387+0000 7f4a9b248700 1 -- start start 2021-10-20T23:27:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9b248700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9405c7d0 0x7f4a940b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9b248700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9405d0b0 0x7f4a94141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9b248700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a940b10f0 0x7f4a941509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9b248700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a940670c0 con 0x7f4a9405d0b0 2021-10-20T23:27:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9b248700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a941502e0 con 0x7f4a9405c7d0 2021-10-20T23:27:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9b248700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a941539f0 con 0x7f4a940b10f0 2021-10-20T23:27:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a99a45700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9405d0b0 0x7f4a94141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a99a45700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9405d0b0 0x7f4a94141740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42634/0 (socket says 172.21.15.12:42634) 2021-10-20T23:27:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a99a45700 1 -- 172.21.15.12:0/1439451651 learned_addr learned my addr 172.21.15.12:0/1439451651 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9a246700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9405c7d0 0x7f4a940b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9aa47700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a940b10f0 0x7f4a941509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a99a45700 1 -- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a940b10f0 msgr2=0x7f4a941509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a99a45700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a940b10f0 0x7f4a941509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a99a45700 1 -- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9405c7d0 msgr2=0x7f4a940b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a99a45700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9405c7d0 0x7f4a940b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a99a45700 1 -- 172.21.15.12:0/1439451651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c009470 con 0x7f4a9405d0b0 2021-10-20T23:27:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a99a45700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9405d0b0 0x7f4a94141740 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f4a94153b80 tx=0x7f4a90007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a877fe700 1 -- 172.21.15.12:0/1439451651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a90012400 con 0x7f4a9405d0b0 2021-10-20T23:27:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a877fe700 1 -- 172.21.15.12:0/1439451651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a90012560 con 0x7f4a9405d0b0 2021-10-20T23:27:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a94153750 con 0x7f4a9405d0b0 2021-10-20T23:27:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a877fe700 1 -- 172.21.15.12:0/1439451651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a900128c0 con 0x7f4a9405d0b0 2021-10-20T23:27:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.391+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a94140cc0 con 0x7f4a9405d0b0 2021-10-20T23:27:24.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.395+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a940b1790 con 0x7f4a9405d0b0 2021-10-20T23:27:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.395+0000 7f4a877fe700 1 -- 172.21.15.12:0/1439451651 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a90019030 con 0x7f4a9405d0b0 2021-10-20T23:27:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.395+0000 7f4a877fe700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a740536d0 0x7f4a74055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.395+0000 7f4a877fe700 1 -- 172.21.15.12:0/1439451651 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f4a9006ae60 con 0x7f4a9405d0b0 2021-10-20T23:27:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.395+0000 7f4a9a246700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a740536d0 0x7f4a74055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.395+0000 7f4a9a246700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a740536d0 0x7f4a74055b90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f4a8800d000 tx=0x7f4a88000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.403+0000 7f4a877fe700 1 -- 172.21.15.12:0/1439451651 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a90041e10 con 0x7f4a9405d0b0 2021-10-20T23:27:24.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.563+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a94057350 con 0x7f4a9405d0b0 2021-10-20T23:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.951+0000 7f4a877fe700 1 -- 172.21.15.12:0/1439451651 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a90045430 con 0x7f4a9405d0b0 2021-10-20T23:27:24.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a740536d0 msgr2=0x7f4a74055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a740536d0 0x7f4a74055b90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f4a8800d000 tx=0x7f4a88000bc0).stop 2021-10-20T23:27:24.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9405d0b0 msgr2=0x7f4a94141740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:24.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9405d0b0 0x7f4a94141740 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f4a94153b80 tx=0x7f4a90007ae0).stop 2021-10-20T23:27:24.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 shutdown_connections 2021-10-20T23:27:24.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a740536d0 0x7f4a74055b90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a940b10f0 0x7f4a941509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a9405d0b0 0x7f4a94141740 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 --2- 172.21.15.12:0/1439451651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9405c7d0 0x7f4a940b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:24.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 >> 172.21.15.12:0/1439451651 conn(0x7f4a94060180 msgr2=0x7f4a940b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:24.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 shutdown_connections 2021-10-20T23:27:24.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:24.955+0000 7f4a9b248700 1 -- 172.21.15.12:0/1439451651 wait complete. 2021-10-20T23:27:24.979 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:27:25.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.091+0000 7fe3cb148700 1 Processor -- start 2021-10-20T23:27:25.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.091+0000 7fe3cb148700 1 -- start start 2021-10-20T23:27:25.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe3c4139cc0 0x7fe3c40acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:25.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40b21c0 0x7fe3c41434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:25.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3c413a0a0 0x7fe3c40b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:25.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40b2730 con 0x7fe3c4139cc0 2021-10-20T23:27:25.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40ad070 con 0x7fe3c413a0a0 2021-10-20T23:27:25.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4060d40 con 0x7fe3c40b21c0 2021-10-20T23:27:25.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c8ee4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe3c4139cc0 0x7fe3c40acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:25.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c8ee4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe3c4139cc0 0x7fe3c40acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42640/0 (socket says 172.21.15.12:42640) 2021-10-20T23:27:25.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c8ee4700 1 -- 172.21.15.12:0/2710339004 learned_addr learned my addr 172.21.15.12:0/2710339004 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:25.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c96e5700 1 --2- 172.21.15.12:0/2710339004 >> v2:172.21.15.31:3300/0 conn(0x7fe3c413a0a0 0x7fe3c40b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:25.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3bbfff700 1 --2- 172.21.15.12:0/2710339004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40b21c0 0x7fe3c41434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:25.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c8ee4700 1 -- 172.21.15.12:0/2710339004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40b21c0 msgr2=0x7fe3c41434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:25.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c8ee4700 1 --2- 172.21.15.12:0/2710339004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40b21c0 0x7fe3c41434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:25.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c8ee4700 1 -- 172.21.15.12:0/2710339004 >> v2:172.21.15.31:3300/0 conn(0x7fe3c413a0a0 msgr2=0x7fe3c40b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:25.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c8ee4700 1 --2- 172.21.15.12:0/2710339004 >> v2:172.21.15.31:3300/0 conn(0x7fe3c413a0a0 0x7fe3c40b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:25.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c8ee4700 1 -- 172.21.15.12:0/2710339004 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c4060fa0 con 0x7fe3c4139cc0 2021-10-20T23:27:25.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3bbfff700 1 --2- 172.21.15.12:0/2710339004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40b21c0 0x7fe3c41434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:25.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3c8ee4700 1 --2- 172.21.15.12:0/2710339004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4139cc0 0x7fe3c40acb80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fe3c0002f70 tx=0x7fe3c0006f40).ready entity=mon.0 client_cookie=933cde1cb5436df5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:25.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3bb7fe700 1 -- 172.21.15.12:0/2710339004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c000da80 con 0x7fe3c4139cc0 2021-10-20T23:27:25.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3bb7fe700 1 -- 172.21.15.12:0/2710339004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0000e90 con 0x7fe3c4139cc0 2021-10-20T23:27:25.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3bb7fe700 1 -- 172.21.15.12:0/2710339004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c000de10 con 0x7fe3c4139cc0 2021-10-20T23:27:25.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 -- 172.21.15.12:0/2710339004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4139cc0 msgr2=0x7fe3c40acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:25.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 --2- 172.21.15.12:0/2710339004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4139cc0 0x7fe3c40acb80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fe3c0002f70 tx=0x7fe3c0006f40).stop 2021-10-20T23:27:25.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 -- 172.21.15.12:0/2710339004 shutdown_connections 2021-10-20T23:27:25.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 --2- 172.21.15.12:0/2710339004 >> v2:172.21.15.31:3300/0 conn(0x7fe3c413a0a0 0x7fe3c40b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:25.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 --2- 172.21.15.12:0/2710339004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c40b21c0 0x7fe3c41434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:25.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 --2- 172.21.15.12:0/2710339004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c4139cc0 0x7fe3c40acb80 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:25.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 -- 172.21.15.12:0/2710339004 >> 172.21.15.12:0/2710339004 conn(0x7fe3c40b3480 msgr2=0x7fe3c40b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:25.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 -- 172.21.15.12:0/2710339004 shutdown_connections 2021-10-20T23:27:25.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.095+0000 7fe3cb148700 1 -- 172.21.15.12:0/2710339004 wait complete. 2021-10-20T23:27:25.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 Processor -- start 2021-10-20T23:27:25.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 -- start start 2021-10-20T23:27:25.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c40b21c0 0x7fe3c413b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3c4139cc0 0x7fe3c413ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c413a0a0 0x7fe3c413d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4152590 con 0x7fe3c40b21c0 2021-10-20T23:27:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c413e560 con 0x7fe3c4139cc0 2021-10-20T23:27:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c413e2c0 con 0x7fe3c413a0a0 2021-10-20T23:27:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c8ee4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c40b21c0 0x7fe3c413b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c8ee4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c40b21c0 0x7fe3c413b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42646/0 (socket says 172.21.15.12:42646) 2021-10-20T23:27:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c8ee4700 1 -- 172.21.15.12:0/88273647 learned_addr learned my addr 172.21.15.12:0/88273647 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c96e5700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c413a0a0 0x7fe3c413d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:25.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3bbfff700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3c4139cc0 0x7fe3c413ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:25.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c8ee4700 1 -- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c413a0a0 msgr2=0x7fe3c413d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:25.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c8ee4700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c413a0a0 0x7fe3c413d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:25.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c8ee4700 1 -- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3c4139cc0 msgr2=0x7fe3c413ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:25.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c8ee4700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3c4139cc0 0x7fe3c413ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:25.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c8ee4700 1 -- 172.21.15.12:0/88273647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c000b460 con 0x7fe3c40b21c0 2021-10-20T23:27:25.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3c8ee4700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c40b21c0 0x7fe3c413b480 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fe3c0002f70 tx=0x7fe3c413da80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:25.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3b9ffb700 1 -- 172.21.15.12:0/88273647 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c000de40 con 0x7fe3c40b21c0 2021-10-20T23:27:25.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3b9ffb700 1 -- 172.21.15.12:0/88273647 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0006c00 con 0x7fe3c40b21c0 2021-10-20T23:27:25.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3b9ffb700 1 -- 172.21.15.12:0/88273647 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c00245f0 con 0x7fe3c40b21c0 2021-10-20T23:27:25.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c413e890 con 0x7fe3c40b21c0 2021-10-20T23:27:25.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.099+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c41520f0 con 0x7fe3c40b21c0 2021-10-20T23:27:25.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.103+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c4061240 con 0x7fe3c40b21c0 2021-10-20T23:27:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.103+0000 7fe3b9ffb700 1 -- 172.21.15.12:0/88273647 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe3c0021020 con 0x7fe3c40b21c0 2021-10-20T23:27:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.103+0000 7fe3b9ffb700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053610 0x7fe3a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.103+0000 7fe3b9ffb700 1 -- 172.21.15.12:0/88273647 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fe3c006f720 con 0x7fe3c40b21c0 2021-10-20T23:27:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.103+0000 7fe3bbfff700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053610 0x7fe3a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.103+0000 7fe3bbfff700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053610 0x7fe3a4055ad0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fe3b400c000 tx=0x7fe3b4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:25.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.107+0000 7fe3b9ffb700 1 -- 172.21.15.12:0/88273647 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3c00464e0 con 0x7fe3c40b21c0 2021-10-20T23:27:25.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:25.239+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe3c4057350 con 0x7fe3c40b21c0 2021-10-20T23:27:26.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.019+0000 7fe3b9ffb700 1 -- 172.21.15.12:0/88273647 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) v1 ==== 185+0+0 (secure 0 0 0) 0x7fe3c0029070 con 0x7fe3c40b21c0 2021-10-20T23:27:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053610 msgr2=0x7fe3a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053610 0x7fe3a4055ad0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fe3b400c000 tx=0x7fe3b4008040).stop 2021-10-20T23:27:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c40b21c0 msgr2=0x7fe3c413b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c40b21c0 0x7fe3c413b480 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fe3c0002f70 tx=0x7fe3c413da80).stop 2021-10-20T23:27:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 shutdown_connections 2021-10-20T23:27:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe3a4053610 0x7fe3a4055ad0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3c413a0a0 0x7fe3c413d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3c4139cc0 0x7fe3c413ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 --2- 172.21.15.12:0/88273647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3c40b21c0 0x7fe3c413b480 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 >> 172.21.15.12:0/88273647 conn(0x7fe3c40b3480 msgr2=0x7fe3c40b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 shutdown_connections 2021-10-20T23:27:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.023+0000 7fe3cb148700 1 -- 172.21.15.12:0/88273647 wait complete. 2021-10-20T23:27:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:27:26.046 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:27:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.155+0000 7f05d8b8c700 1 Processor -- start 2021-10-20T23:27:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.155+0000 7f05d8b8c700 1 -- start start 2021-10-20T23:27:26.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d8b8c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05d40b5bf0 0x7f05d40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:26.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d8b8c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d41440b0 con 0x7f05d40b43c0 2021-10-20T23:27:26.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d8b8c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d40b6e50 con 0x7f05d40b6580 2021-10-20T23:27:26.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d8b8c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d4143b70 con 0x7f05d40b5bf0 2021-10-20T23:27:26.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d1d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f05d40b43c0 0x7f05d412ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41248/0 (socket says 172.21.15.12:41248) 2021-10-20T23:27:26.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d1d9b700 1 -- 172.21.15.12:0/3540349552 learned_addr learned my addr 172.21.15.12:0/3540349552 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:26.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d2d9d700 1 --2- 172.21.15.12:0/3540349552 >> v2:172.21.15.31:3300/0 conn(0x7f05d40b5bf0 0x7f05d40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:26.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173562271 0 0) 0x7f05d41440b0 con 0x7f05d40b43c0 2021-10-20T23:27:26.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b4003260 con 0x7f05d40b43c0 2021-10-20T23:27:26.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436753511 0 0) 0x7f05d40b6e50 con 0x7f05d40b6580 2021-10-20T23:27:26.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d41440b0 con 0x7f05d40b6580 2021-10-20T23:27:26.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406877012 0 0) 0x7f05b4003260 con 0x7f05d40b43c0 2021-10-20T23:27:26.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 >> v2:172.21.15.31:3300/0 conn(0x7f05d40b5bf0 msgr2=0x7f05d40b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:26.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 --2- 172.21.15.12:0/3540349552 >> v2:172.21.15.31:3300/0 conn(0x7f05d40b5bf0 0x7f05d40b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 >> v1:172.21.15.31:6789/0 conn(0x7f05d40b6580 legacy=0x7f05d4061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:26.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d4143e10 con 0x7f05d40b43c0 2021-10-20T23:27:26.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f05c4001660 con 0x7f05d40b43c0 2021-10-20T23:27:26.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 >> v1:172.21.15.12:6789/0 conn(0x7f05d40b43c0 legacy=0x7f05d412ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:26.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b40038e0 0x7f05b4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:26.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05b4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:26.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b4004e70 0x7f05b400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:26.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d4143b70 con 0x7f05b4004500 2021-10-20T23:27:26.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b400bcf0 con 0x7f05b4004e70 2021-10-20T23:27:26.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b400beb0 con 0x7f05b40038e0 2021-10-20T23:27:26.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d2d9d700 1 --2- 172.21.15.12:0/3540349552 >> v2:172.21.15.31:3300/0 conn(0x7f05d40b5bf0 0x7f05d40b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:26.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d1d9b700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05b4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:26.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d259c700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b40038e0 0x7f05b4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:26.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d2d9d700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b4004e70 0x7f05b400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:26.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d1d9b700 1 -- 172.21.15.12:0/3540349552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b40038e0 msgr2=0x7f05b4003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:26.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d1d9b700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05b40038e0 0x7f05b4003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d1d9b700 1 -- 172.21.15.12:0/3540349552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b4004e70 msgr2=0x7f05b400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:26.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d1d9b700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b4004e70 0x7f05b400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d1d9b700 1 -- 172.21.15.12:0/3540349552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b4003260 con 0x7f05b4004500 2021-10-20T23:27:26.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d2d9d700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05b4004e70 0x7f05b400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:27:26.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d2d9d700 1 -- 172.21.15.12:0/3540349552 reap_dead start 2021-10-20T23:27:26.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d1d9b700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05b4004980 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f05c4001430 tx=0x7f05d4143fa0).ready entity=mon.0 client_cookie=f1cfc5b8b8405b01 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:26.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c40070d0 con 0x7f05b4004500 2021-10-20T23:27:26.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4007230 con 0x7f05b4004500 2021-10-20T23:27:26.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d159a700 1 -- 172.21.15.12:0/3540349552 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c400c8c0 con 0x7f05b4004500 2021-10-20T23:27:26.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d8b8c700 1 -- 172.21.15.12:0/3540349552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 msgr2=0x7f05b4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:26.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.159+0000 7f05d8b8c700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05b4004980 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f05c4001430 tx=0x7f05d4143fa0).stop 2021-10-20T23:27:26.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 -- 172.21.15.12:0/3540349552 shutdown_connections 2021-10-20T23:27:26.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 --2- 172.21.15.12:0/3540349552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05b4004980 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 -- 172.21.15.12:0/3540349552 >> 172.21.15.12:0/3540349552 conn(0x7f05d405c490 msgr2=0x7f05d405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:26.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 -- 172.21.15.12:0/3540349552 shutdown_connections 2021-10-20T23:27:26.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 -- 172.21.15.12:0/3540349552 wait complete. 2021-10-20T23:27:26.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 Processor -- start 2021-10-20T23:27:26.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 -- start start 2021-10-20T23:27:26.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05d4147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:26.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4125560 0x7f05d4155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:26.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d4156150 0x7f05d41565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:26.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41259c0 con 0x7f05b4004500 2021-10-20T23:27:26.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41477d0 con 0x7f05d4125560 2021-10-20T23:27:26.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d8b8c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d4146bc0 con 0x7f05d4156150 2021-10-20T23:27:26.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05d4147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:26.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05d4147d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42664/0 (socket says 172.21.15.12:42664) 2021-10-20T23:27:26.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d259c700 1 -- 172.21.15.12:0/737718693 learned_addr learned my addr 172.21.15.12:0/737718693 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:26.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d1d9b700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4125560 0x7f05d4155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.163+0000 7f05d2d9d700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d4156150 0x7f05d41565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05d259c700 1 -- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d4156150 msgr2=0x7f05d41565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05d259c700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d4156150 0x7f05d41565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05d259c700 1 -- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4125560 msgr2=0x7f05d4155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:26.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05d259c700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4125560 0x7f05d4155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:26.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05d259c700 1 -- 172.21.15.12:0/737718693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d4126130 con 0x7f05b4004500 2021-10-20T23:27:26.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05d259c700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05d4147d70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f05d4147450 tx=0x7f05bc0079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:26.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05cb7fe700 1 -- 172.21.15.12:0/737718693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05bc011780 con 0x7f05b4004500 2021-10-20T23:27:26.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05cb7fe700 1 -- 172.21.15.12:0/737718693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc0118e0 con 0x7f05b4004500 2021-10-20T23:27:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05cb7fe700 1 -- 172.21.15.12:0/737718693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05bc011c40 con 0x7f05b4004500 2021-10-20T23:27:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d4156ac0 con 0x7f05b4004500 2021-10-20T23:27:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d4147530 con 0x7f05b4004500 2021-10-20T23:27:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d40615f0 con 0x7f05b4004500 2021-10-20T23:27:26.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.167+0000 7f05cb7fe700 1 -- 172.21.15.12:0/737718693 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f05bc01b030 con 0x7f05b4004500 2021-10-20T23:27:26.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.171+0000 7f05cb7fe700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05b8053610 0x7f05b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:26.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.171+0000 7f05cb7fe700 1 -- 172.21.15.12:0/737718693 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f05bc06b990 con 0x7f05b4004500 2021-10-20T23:27:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.171+0000 7f05d1d9b700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05b8053610 0x7f05b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.171+0000 7f05d1d9b700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05b8053610 0x7f05b8055ad0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f05c4019000 tx=0x7f05c4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.175+0000 7f05cb7fe700 1 -- 172.21.15.12:0/737718693 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05bc042af0 con 0x7f05b4004500 2021-10-20T23:27:26.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:26.306+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f05d4057350 con 0x7f05b4004500 2021-10-20T23:27:27.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.030+0000 7f05cb7fe700 1 -- 172.21.15.12:0/737718693 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) v1 ==== 173+0+0 (secure 0 0 0) 0x7f05bc019020 con 0x7f05b4004500 2021-10-20T23:27:27.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05b8053610 msgr2=0x7f05b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05b8053610 0x7f05b8055ad0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f05c4019000 tx=0x7f05c4015000).stop 2021-10-20T23:27:27.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 msgr2=0x7f05d4147d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05d4147d70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f05d4147450 tx=0x7f05bc0079e0).stop 2021-10-20T23:27:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 shutdown_connections 2021-10-20T23:27:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05b8053610 0x7f05b8055ad0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d4156150 0x7f05d41565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4125560 0x7f05d4155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 --2- 172.21.15.12:0/737718693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b4004500 0x7f05d4147d70 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 >> 172.21.15.12:0/737718693 conn(0x7f05d405c490 msgr2=0x7f05d4143160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 shutdown_connections 2021-10-20T23:27:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.034+0000 7f05d8b8c700 1 -- 172.21.15.12:0/737718693 wait complete. 2021-10-20T23:27:27.045 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:27:27.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:27:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.154+0000 7fcdc7a4f700 1 Processor -- start 2021-10-20T23:27:27.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.154+0000 7fcdc7a4f700 1 -- start start 2021-10-20T23:27:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00affa0 0x7fcdc01471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcdc00b5210 0x7fcdc00b0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc00ad770 con 0x7fcdc00b2b60 2021-10-20T23:27:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc01476a0 con 0x7fcdc00b5210 2021-10-20T23:27:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00b2f40 con 0x7fcdc00affa0 2021-10-20T23:27:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc5fec700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcdc00b5210 0x7fcdc00b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc4fea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00affa0 0x7fcdc01471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc5fec700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcdc00b5210 0x7fcdc00b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:57650/0 (socket says 172.21.15.12:57650) 2021-10-20T23:27:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc5fec700 1 -- 172.21.15.12:0/284894945 learned_addr learned my addr 172.21.15.12:0/284894945 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc57eb700 1 --1- 172.21.15.12:0/284894945 >> v1:172.21.15.31:6789/0 conn(0x7fcdc00b2b60 0x7fcdc00af890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:48330/0 (socket says 172.21.15.12:48330) 2021-10-20T23:27:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc5fec700 1 -- 172.21.15.12:0/284894945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00affa0 msgr2=0x7fcdc01471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc5fec700 1 --2- 172.21.15.12:0/284894945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00affa0 0x7fcdc01471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc5fec700 1 -- 172.21.15.12:0/284894945 >> v1:172.21.15.31:6789/0 conn(0x7fcdc00b2b60 legacy=0x7fcdc00af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc5fec700 1 -- 172.21.15.12:0/284894945 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc005ca70 con 0x7fcdc00b5210 2021-10-20T23:27:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc5fec700 1 --2- 172.21.15.12:0/284894945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdc00b5210 0x7fcdc00b0820 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fcdb80032f0 tx=0x7fcdb8009290).ready entity=mon.1 client_cookie=f6cf6ad7fba539bd server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdaffff700 1 -- 172.21.15.12:0/284894945 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb800b8a0 con 0x7fcdc00b5210 2021-10-20T23:27:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdaffff700 1 -- 172.21.15.12:0/284894945 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb800ba00 con 0x7fcdc00b5210 2021-10-20T23:27:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdaffff700 1 -- 172.21.15.12:0/284894945 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb800bb70 con 0x7fcdc00b5210 2021-10-20T23:27:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/284894945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdc00b5210 msgr2=0x7fcdc00b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 --2- 172.21.15.12:0/284894945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdc00b5210 0x7fcdc00b0820 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fcdb80032f0 tx=0x7fcdb8009290).stop 2021-10-20T23:27:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/284894945 shutdown_connections 2021-10-20T23:27:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 --2- 172.21.15.12:0/284894945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdc00b5210 0x7fcdc00b0820 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 --2- 172.21.15.12:0/284894945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00affa0 0x7fcdc01471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/284894945 >> 172.21.15.12:0/284894945 conn(0x7fcdc006a110 msgr2=0x7fcdc005cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:27.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/284894945 shutdown_connections 2021-10-20T23:27:27.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.158+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/284894945 wait complete. 2021-10-20T23:27:27.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc7a4f700 1 Processor -- start 2021-10-20T23:27:27.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc7a4f700 1 -- start start 2021-10-20T23:27:27.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc7a4f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdc00affa0 0x7fcdc013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc7a4f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00b2b60 0x7fcdc00654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc7a4f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcdc00b5210 0x7fcdc00659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc7a4f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0156090 con 0x7fcdc00b5210 2021-10-20T23:27:27.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc7a4f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0143050 con 0x7fcdc00affa0 2021-10-20T23:27:27.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc7a4f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0141d10 con 0x7fcdc00b2b60 2021-10-20T23:27:27.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc5fec700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcdc00b5210 0x7fcdc00659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc4fea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00b2b60 0x7fcdc00654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc5fec700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcdc00b5210 0x7fcdc00659a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42682/0 (socket says 172.21.15.12:42682) 2021-10-20T23:27:27.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc57eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdc00affa0 0x7fcdc013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc5fec700 1 -- 172.21.15.12:0/4193726218 learned_addr learned my addr 172.21.15.12:0/4193726218 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:27.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc5fec700 1 -- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00b2b60 msgr2=0x7fcdc00654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc5fec700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00b2b60 0x7fcdc00654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc5fec700 1 -- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdc00affa0 msgr2=0x7fcdc013f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc5fec700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdc00affa0 0x7fcdc013f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc5fec700 1 -- 172.21.15.12:0/4193726218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8009530 con 0x7fcdc00b5210 2021-10-20T23:27:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.162+0000 7fcdc5fec700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcdc00b5210 0x7fcdc00659a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fcdb80032f0 tx=0x7fcdb8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdae7fc700 1 -- 172.21.15.12:0/4193726218 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb800b8a0 con 0x7fcdc00b5210 2021-10-20T23:27:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdae7fc700 1 -- 172.21.15.12:0/4193726218 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb8021480 con 0x7fcdc00b5210 2021-10-20T23:27:27.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdae7fc700 1 -- 172.21.15.12:0/4193726218 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb80217e0 con 0x7fcdc00b5210 2021-10-20T23:27:27.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc0141fb0 con 0x7fcdc00b5210 2021-10-20T23:27:27.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc01424a0 con 0x7fcdc00b5210 2021-10-20T23:27:27.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdae7fc700 1 -- 172.21.15.12:0/4193726218 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcdb8028070 con 0x7fcdc00b5210 2021-10-20T23:27:27.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc0143250 con 0x7fcdc00b5210 2021-10-20T23:27:27.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdae7fc700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcda0053610 0x7fcda0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdae7fc700 1 -- 172.21.15.12:0/4193726218 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fcdb806ca40 con 0x7fcdc00b5210 2021-10-20T23:27:27.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdc57eb700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcda0053610 0x7fcda0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.166+0000 7fcdc57eb700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcda0053610 0x7fcda0055ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fcdbc00d000 tx=0x7fcdbc007b80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:27.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.174+0000 7fcdae7fc700 1 -- 172.21.15.12:0/4193726218 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcdb8043b90 con 0x7fcdc00b5210 2021-10-20T23:27:27.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.298+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcdc0142140 con 0x7fcdc00b5210 2021-10-20T23:27:27.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdae7fc700 1 -- 172.21.15.12:0/4193726218 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcdb8015070 con 0x7fcdc00b5210 2021-10-20T23:27:27.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcda0053610 msgr2=0x7fcda0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcda0053610 0x7fcda0055ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fcdbc00d000 tx=0x7fcdbc007b80).stop 2021-10-20T23:27:27.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcdc00b5210 msgr2=0x7fcdc00659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcdc00b5210 0x7fcdc00659a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fcdb80032f0 tx=0x7fcdb8016000).stop 2021-10-20T23:27:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 shutdown_connections 2021-10-20T23:27:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcda0053610 0x7fcda0055ad0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcdc00b5210 0x7fcdc00659a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcdc00b2b60 0x7fcdc00654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 --2- 172.21.15.12:0/4193726218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdc00affa0 0x7fcdc013f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.310+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 >> 172.21.15.12:0/4193726218 conn(0x7fcdc006a110 msgr2=0x7fcdc013bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:27.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.314+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 shutdown_connections 2021-10-20T23:27:27.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.314+0000 7fcdc7a4f700 1 -- 172.21.15.12:0/4193726218 wait complete. 2021-10-20T23:27:27.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-10-20T23:27:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.426+0000 7fbe8ee31700 1 Processor -- start 2021-10-20T23:27:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.426+0000 7fbe8ee31700 1 -- start start 2021-10-20T23:27:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.426+0000 7fbe8ee31700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880ad030 0x7fbe88143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.426+0000 7fbe8ee31700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe880673d0 con 0x7fbe88066ff0 2021-10-20T23:27:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.426+0000 7fbe8ee31700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe880affd0 con 0x7fbe880b06e0 2021-10-20T23:27:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.426+0000 7fbe8ee31700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880b0270 con 0x7fbe880ad030 2021-10-20T23:27:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.426+0000 7fbe8cbcd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbe88066ff0 0x7fbe881438d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41282/0 (socket says 172.21.15.12:41282) 2021-10-20T23:27:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.426+0000 7fbe8cbcd700 1 -- 172.21.15.12:0/3668823044 learned_addr learned my addr 172.21.15.12:0/3668823044 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.426+0000 7fbe87fff700 1 --2- 172.21.15.12:0/3668823044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880ad030 0x7fbe88143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe877fe700 1 -- 172.21.15.12:0/3668823044 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042794048 0 0) 0x7fbe880affd0 con 0x7fbe880b06e0 2021-10-20T23:27:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe877fe700 1 -- 172.21.15.12:0/3668823044 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c003260 con 0x7fbe880b06e0 2021-10-20T23:27:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe877fe700 1 -- 172.21.15.12:0/3668823044 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441167655 0 0) 0x7fbe880673d0 con 0x7fbe88066ff0 2021-10-20T23:27:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe877fe700 1 -- 172.21.15.12:0/3668823044 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe880affd0 con 0x7fbe88066ff0 2021-10-20T23:27:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe87fff700 1 -- 172.21.15.12:0/3668823044 >> v1:172.21.15.31:6789/0 conn(0x7fbe880b06e0 legacy=0x7fbe880b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe87fff700 1 -- 172.21.15.12:0/3668823044 >> v1:172.21.15.12:6789/0 conn(0x7fbe88066ff0 legacy=0x7fbe881438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe87fff700 1 -- 172.21.15.12:0/3668823044 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880af3a0 con 0x7fbe880ad030 2021-10-20T23:27:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe87fff700 1 --2- 172.21.15.12:0/3668823044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880ad030 0x7fbe88143fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fbe74002f70 tx=0x7fbe74006df0).ready entity=mon.2 client_cookie=2fd1566af1bc7047 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe877fe700 1 -- 172.21.15.12:0/3668823044 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7400d5c0 con 0x7fbe880ad030 2021-10-20T23:27:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe877fe700 1 -- 172.21.15.12:0/3668823044 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74000e90 con 0x7fbe880ad030 2021-10-20T23:27:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe877fe700 1 -- 172.21.15.12:0/3668823044 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7400d910 con 0x7fbe880ad030 2021-10-20T23:27:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe8ee31700 1 -- 172.21.15.12:0/3668823044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880ad030 msgr2=0x7fbe88143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe8ee31700 1 --2- 172.21.15.12:0/3668823044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880ad030 0x7fbe88143fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fbe74002f70 tx=0x7fbe74006df0).stop 2021-10-20T23:27:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe8ee31700 1 -- 172.21.15.12:0/3668823044 shutdown_connections 2021-10-20T23:27:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe8ee31700 1 --2- 172.21.15.12:0/3668823044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880ad030 0x7fbe88143fe0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe8ee31700 1 -- 172.21.15.12:0/3668823044 >> 172.21.15.12:0/3668823044 conn(0x7fbe8805f6b0 msgr2=0x7fbe8805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe8ee31700 1 -- 172.21.15.12:0/3668823044 shutdown_connections 2021-10-20T23:27:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe8ee31700 1 -- 172.21.15.12:0/3668823044 wait complete. 2021-10-20T23:27:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe8ee31700 1 Processor -- start 2021-10-20T23:27:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.430+0000 7fbe8ee31700 1 -- start start 2021-10-20T23:27:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8ee31700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe88066ff0 0x7fbe88156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8ee31700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe880b06e0 0x7fbe8814a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8ee31700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880a0500 0x7fbe88141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8ee31700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880a00a0 con 0x7fbe880b06e0 2021-10-20T23:27:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8ee31700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8809fb60 con 0x7fbe88066ff0 2021-10-20T23:27:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8ee31700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8809fe00 con 0x7fbe880a0500 2021-10-20T23:27:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe880b06e0 0x7fbe8814a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe880b06e0 0x7fbe8814a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42694/0 (socket says 172.21.15.12:42694) 2021-10-20T23:27:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe87fff700 1 -- 172.21.15.12:0/1989695189 learned_addr learned my addr 172.21.15.12:0/1989695189 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8cbcd700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe88066ff0 0x7fbe88156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8d3ce700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880a0500 0x7fbe88141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe87fff700 1 -- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880a0500 msgr2=0x7fbe88141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe87fff700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880a0500 0x7fbe88141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe87fff700 1 -- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe88066ff0 msgr2=0x7fbe88156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe87fff700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe88066ff0 0x7fbe88156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe87fff700 1 -- 172.21.15.12:0/1989695189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7400b180 con 0x7fbe880b06e0 2021-10-20T23:27:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe87fff700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe880b06e0 0x7fbe8814a910 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fbe74002f70 tx=0x7fbe74014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe85ffb700 1 -- 172.21.15.12:0/1989695189 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe74013de0 con 0x7fbe880b06e0 2021-10-20T23:27:27.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe85ffb700 1 -- 172.21.15.12:0/1989695189 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74006780 con 0x7fbe880b06e0 2021-10-20T23:27:27.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe880a0b00 con 0x7fbe880b06e0 2021-10-20T23:27:27.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe85ffb700 1 -- 172.21.15.12:0/1989695189 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7401e5f0 con 0x7fbe880b06e0 2021-10-20T23:27:27.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe88141fb0 con 0x7fbe880b06e0 2021-10-20T23:27:27.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe88057350 con 0x7fbe880b06e0 2021-10-20T23:27:27.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.434+0000 7fbe85ffb700 1 -- 172.21.15.12:0/1989695189 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbe74025030 con 0x7fbe880b06e0 2021-10-20T23:27:27.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.438+0000 7fbe85ffb700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe680536d0 0x7fbe68055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:27.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.438+0000 7fbe85ffb700 1 -- 172.21.15.12:0/1989695189 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fbe7406c220 con 0x7fbe880b06e0 2021-10-20T23:27:27.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.438+0000 7fbe8cbcd700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe680536d0 0x7fbe68055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:27.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.438+0000 7fbe8cbcd700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe680536d0 0x7fbe68055b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fbe7c00d000 tx=0x7fbe7c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:27.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.442+0000 7fbe85ffb700 1 -- 172.21.15.12:0/1989695189 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe74043500 con 0x7fbe880b06e0 2021-10-20T23:27:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:27.610+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7fbe88067810 con 0x7fbe880b06e0 2021-10-20T23:27:28.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.030+0000 7fbe85ffb700 1 -- 172.21.15.12:0/1989695189 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v335) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbe74023020 con 0x7fbe880b06e0 2021-10-20T23:27:28.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe680536d0 msgr2=0x7fbe68055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:28.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe680536d0 0x7fbe68055b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fbe7c00d000 tx=0x7fbe7c009040).stop 2021-10-20T23:27:28.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe880b06e0 msgr2=0x7fbe8814a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:28.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe880b06e0 0x7fbe8814a910 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fbe74002f70 tx=0x7fbe74014000).stop 2021-10-20T23:27:28.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 shutdown_connections 2021-10-20T23:27:28.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbe680536d0 0x7fbe68055b90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe880a0500 0x7fbe88141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe880b06e0 0x7fbe8814a910 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 --2- 172.21.15.12:0/1989695189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe88066ff0 0x7fbe88156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 >> 172.21.15.12:0/1989695189 conn(0x7fbe8805f6b0 msgr2=0x7fbe880b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:28.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 shutdown_connections 2021-10-20T23:27:28.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.034+0000 7fbe8ee31700 1 -- 172.21.15.12:0/1989695189 wait complete. 2021-10-20T23:27:28.059 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-20T23:27:28.060 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-10-20T23:27:28.060 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-10-20T23:27:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdeffd48700 1 Processor -- start 2021-10-20T23:27:28.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdeffd48700 1 -- start start 2021-10-20T23:27:28.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdeffd48700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdef80ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:28.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdeffd48700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdef80b0880 0x7fdef81405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:28.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdeffd48700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef80b2af0 con 0x7fdef80b04a0 2021-10-20T23:27:28.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdeffd48700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef80b2770 con 0x7fdef80b0880 2021-10-20T23:27:28.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdeffd48700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80b2d20 con 0x7fdef80aa120 2021-10-20T23:27:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefdae4700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdef80b04a0 0x7fdef80add30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41294/0 (socket says 172.21.15.12:41294) 2021-10-20T23:27:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefdae4700 1 -- 172.21.15.12:0/4154905752 learned_addr learned my addr 172.21.15.12:0/4154905752 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefe2e5700 1 --2- 172.21.15.12:0/4154905752 >> v2:172.21.15.12:3300/0 conn(0x7fdef80b0880 0x7fdef81405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefd2e3700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdef80ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082408818 0 0) 0x7fdef80b2af0 con 0x7fdef80b04a0 2021-10-20T23:27:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee0003260 con 0x7fdef80b04a0 2021-10-20T23:27:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2463179218 0 0) 0x7fdee0003260 con 0x7fdef80b04a0 2021-10-20T23:27:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 msgr2=0x7fdef80ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:28.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdef80ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 >> v2:172.21.15.12:3300/0 conn(0x7fdef80b0880 msgr2=0x7fdef81405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:28.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 --2- 172.21.15.12:0/4154905752 >> v2:172.21.15.12:3300/0 conn(0x7fdef80b0880 0x7fdef81405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80a9b70 con 0x7fdef80b04a0 2021-10-20T23:27:28.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fdef4001660 con 0x7fdef80b04a0 2021-10-20T23:27:28.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 >> v1:172.21.15.12:6789/0 conn(0x7fdef80b04a0 legacy=0x7fdef80add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:28.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdee0003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:28.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee0003c80 0x7fdee0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:28.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdee00049f0 0x7fdee0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:28.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80b2770 con 0x7fdee00049f0 2021-10-20T23:27:28.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80b2d20 con 0x7fdee0003c80 2021-10-20T23:27:28.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.158+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee000d990 con 0x7fdef80aa120 2021-10-20T23:27:28.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefdae4700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdee0003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:28.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefd2e3700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee0003c80 0x7fdee0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:28.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefe2e5700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdee00049f0 0x7fdee0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:28.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefdae4700 1 -- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee0003c80 msgr2=0x7fdee0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:28.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefdae4700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee0003c80 0x7fdee0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefdae4700 1 -- 172.21.15.12:0/4154905752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdee00049f0 msgr2=0x7fdee0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:28.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefdae4700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdee00049f0 0x7fdee0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefdae4700 1 -- 172.21.15.12:0/4154905752 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee0003260 con 0x7fdef80aa120 2021-10-20T23:27:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefdae4700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdee0003750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fdef4001370 tx=0x7fdef4001e50).ready entity=mon.2 client_cookie=720516bb101c0041 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdef40070d0 con 0x7fdef80aa120 2021-10-20T23:27:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4007230 con 0x7fdef80aa120 2021-10-20T23:27:28.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefcae2700 1 -- 172.21.15.12:0/4154905752 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdef400c960 con 0x7fdef80aa120 2021-10-20T23:27:28.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdeffd48700 1 -- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 msgr2=0x7fdee0003750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:28.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdeffd48700 1 --2- 172.21.15.12:0/4154905752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdee0003750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fdef4001370 tx=0x7fdef4001e50).stop 2021-10-20T23:27:28.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdefe2e5700 1 -- 172.21.15.12:0/4154905752 reap_dead start 2021-10-20T23:27:28.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdeffd48700 1 -- 172.21.15.12:0/4154905752 shutdown_connections 2021-10-20T23:27:28.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdeffd48700 1 -- 172.21.15.12:0/4154905752 >> 172.21.15.12:0/4154905752 conn(0x7fdef80607c0 msgr2=0x7fdef8060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:28.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdeffd48700 1 -- 172.21.15.12:0/4154905752 shutdown_connections 2021-10-20T23:27:28.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.162+0000 7fdeffd48700 1 -- 172.21.15.12:0/4154905752 wait complete. 2021-10-20T23:27:28.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdeffd48700 1 Processor -- start 2021-10-20T23:27:28.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdeffd48700 1 -- start start 2021-10-20T23:27:28.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdeffd48700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdef81418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:28.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdeffd48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef81521a0 0x7fdef814e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:28.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdeffd48700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813aa50 0x7fdef80ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:28.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdeffd48700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef8152620 con 0x7fdef81521a0 2021-10-20T23:27:28.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdeffd48700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef81517c0 con 0x7fdef813aa50 2021-10-20T23:27:28.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdeffd48700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef8151a60 con 0x7fdef80aa120 2021-10-20T23:27:28.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefd2e3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef81521a0 0x7fdef814e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:28.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefd2e3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef81521a0 0x7fdef814e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42712/0 (socket says 172.21.15.12:42712) 2021-10-20T23:27:28.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefd2e3700 1 -- 172.21.15.12:0/778877191 learned_addr learned my addr 172.21.15.12:0/778877191 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:28.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefdae4700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdef81418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:28.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefe2e5700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813aa50 0x7fdef80ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:28.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefd2e3700 1 -- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 msgr2=0x7fdef81418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:28.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefd2e3700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdef81418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefd2e3700 1 -- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813aa50 msgr2=0x7fdef80ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:28.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefd2e3700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813aa50 0x7fdef80ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:28.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefd2e3700 1 -- 172.21.15.12:0/778877191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8151d00 con 0x7fdef81521a0 2021-10-20T23:27:28.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.166+0000 7fdefd2e3700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef81521a0 0x7fdef814e170 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fdee800c000 tx=0x7fdee8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:28.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdee6ffd700 1 -- 172.21.15.12:0/778877191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdee8012800 con 0x7fdef81521a0 2021-10-20T23:27:28.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdee6ffd700 1 -- 172.21.15.12:0/778877191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee8012960 con 0x7fdef81521a0 2021-10-20T23:27:28.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef813b440 con 0x7fdef81521a0 2021-10-20T23:27:28.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdee6ffd700 1 -- 172.21.15.12:0/778877191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdee8012cc0 con 0x7fdef81521a0 2021-10-20T23:27:28.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef814e660 con 0x7fdef81521a0 2021-10-20T23:27:28.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef813b210 con 0x7fdef81521a0 2021-10-20T23:27:28.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdee6ffd700 1 -- 172.21.15.12:0/778877191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdee8014470 con 0x7fdef81521a0 2021-10-20T23:27:28.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdee6ffd700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fded80536a0 0x7fded8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:28.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdee6ffd700 1 -- 172.21.15.12:0/778877191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fdee806c020 con 0x7fdef81521a0 2021-10-20T23:27:28.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdefdae4700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fded80536a0 0x7fded8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:28.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.170+0000 7fdefdae4700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fded80536a0 0x7fded8055b60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fdef401a000 tx=0x7fdef4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:28.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.174+0000 7fdee6ffd700 1 -- 172.21.15.12:0/778877191 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdee80432a0 con 0x7fdef81521a0 2021-10-20T23:27:28.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:28.346+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7fdef8151e90 con 0x7fdef81521a0 2021-10-20T23:27:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.038+0000 7fdee6ffd700 1 -- 172.21.15.12:0/778877191 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v336) v1 ==== 130+0+0 (secure 0 0 0) 0x7fdee80468c0 con 0x7fdef81521a0 2021-10-20T23:27:29.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fded80536a0 msgr2=0x7fded8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fded80536a0 0x7fded8055b60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fdef401a000 tx=0x7fdef4015000).stop 2021-10-20T23:27:29.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef81521a0 msgr2=0x7fdef814e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef81521a0 0x7fdef814e170 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fdee800c000 tx=0x7fdee8008040).stop 2021-10-20T23:27:29.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 shutdown_connections 2021-10-20T23:27:29.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fded80536a0 0x7fded8055b60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813aa50 0x7fdef80ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef81521a0 0x7fdef814e170 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 --2- 172.21.15.12:0/778877191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdef80aa120 0x7fdef81418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 >> 172.21.15.12:0/778877191 conn(0x7fdef80607c0 msgr2=0x7fdef80b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:29.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 shutdown_connections 2021-10-20T23:27:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.042+0000 7fdeffd48700 1 -- 172.21.15.12:0/778877191 wait complete. 2021-10-20T23:27:29.066 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:27:29.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.178+0000 7f70fcf38700 1 Processor -- start 2021-10-20T23:27:29.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.178+0000 7f70fcf38700 1 -- start start 2021-10-20T23:27:29.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.178+0000 7f70fcf38700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70f80aca30 0x7f70f80b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.178+0000 7f70fcf38700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80b1430 0x7f70f8067000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f80ace10 con 0x7f70f80ad870 2021-10-20T23:27:29.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f80b5160 con 0x7f70f80aca30 2021-10-20T23:27:29.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80adee0 con 0x7f70f80b1430 2021-10-20T23:27:29.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f6ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f70f80ad870 0x7f70f81434c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41312/0 (socket says 172.21.15.12:41312) 2021-10-20T23:27:29.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70f80aca30 0x7f70f80b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f6ffd700 1 -- 172.21.15.12:0/3374073341 learned_addr learned my addr 172.21.15.12:0/3374073341 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:29.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f7fff700 1 --2- 172.21.15.12:0/3374073341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80b1430 0x7f70f8067000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f67fc700 1 -- 172.21.15.12:0/3374073341 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567187557 0 0) 0x7f70f80ace10 con 0x7f70f80ad870 2021-10-20T23:27:29.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f67fc700 1 -- 172.21.15.12:0/3374073341 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d8003260 con 0x7f70f80ad870 2021-10-20T23:27:29.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f7fff700 1 -- 172.21.15.12:0/3374073341 >> v2:172.21.15.12:3300/0 conn(0x7f70f80aca30 msgr2=0x7f70f80b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:29.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f7fff700 1 --2- 172.21.15.12:0/3374073341 >> v2:172.21.15.12:3300/0 conn(0x7f70f80aca30 0x7f70f80b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f7fff700 1 -- 172.21.15.12:0/3374073341 >> v1:172.21.15.12:6789/0 conn(0x7f70f80ad870 legacy=0x7f70f81434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f7fff700 1 -- 172.21.15.12:0/3374073341 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80ae180 con 0x7f70f80b1430 2021-10-20T23:27:29.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f77fe700 1 --2- 172.21.15.12:0/3374073341 >> v2:172.21.15.12:3300/0 conn(0x7f70f80aca30 0x7f70f80b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:29.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f7fff700 1 --2- 172.21.15.12:0/3374073341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80b1430 0x7f70f8067000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f70f00032f0 tx=0x7f70f00091d0).ready entity=mon.2 client_cookie=8d0b814aa87edb41 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:29.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f67fc700 1 -- 172.21.15.12:0/3374073341 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f000b600 con 0x7f70f80b1430 2021-10-20T23:27:29.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f67fc700 1 -- 172.21.15.12:0/3374073341 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000b760 con 0x7f70f80b1430 2021-10-20T23:27:29.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70f67fc700 1 -- 172.21.15.12:0/3374073341 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f000b8d0 con 0x7f70f80b1430 2021-10-20T23:27:29.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 -- 172.21.15.12:0/3374073341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80b1430 msgr2=0x7f70f8067000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 --2- 172.21.15.12:0/3374073341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80b1430 0x7f70f8067000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f70f00032f0 tx=0x7f70f00091d0).stop 2021-10-20T23:27:29.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 -- 172.21.15.12:0/3374073341 shutdown_connections 2021-10-20T23:27:29.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 --2- 172.21.15.12:0/3374073341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80b1430 0x7f70f8067000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 --2- 172.21.15.12:0/3374073341 >> v2:172.21.15.12:3300/0 conn(0x7f70f80aca30 0x7f70f80b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 -- 172.21.15.12:0/3374073341 >> 172.21.15.12:0/3374073341 conn(0x7f70f8062560 msgr2=0x7f70f8062940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:29.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 -- 172.21.15.12:0/3374073341 shutdown_connections 2021-10-20T23:27:29.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.182+0000 7f70fcf38700 1 -- 172.21.15.12:0/3374073341 wait complete. 2021-10-20T23:27:29.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70fcf38700 1 Processor -- start 2021-10-20T23:27:29.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70fcf38700 1 -- start start 2021-10-20T23:27:29.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70fcf38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f80aca30 0x7f70f8066d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70fcf38700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80ad870 0x7f70f8065570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70fcf38700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f80b1430 0x7f70f8065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70fcf38700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8063df0 con 0x7f70f80b1430 2021-10-20T23:27:29.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70fcf38700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8065f50 con 0x7f70f80aca30 2021-10-20T23:27:29.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70fcf38700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8063fe0 con 0x7f70f80ad870 2021-10-20T23:27:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f80b1430 0x7f70f8065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f80b1430 0x7f70f8065a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42726/0 (socket says 172.21.15.12:42726) 2021-10-20T23:27:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f7fff700 1 -- 172.21.15.12:0/4013031368 learned_addr learned my addr 172.21.15.12:0/4013031368 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:29.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f6ffd700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80ad870 0x7f70f8065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f77fe700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f80aca30 0x7f70f8066d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f7fff700 1 -- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80ad870 msgr2=0x7f70f8065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f7fff700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80ad870 0x7f70f8065570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f7fff700 1 -- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f80aca30 msgr2=0x7f70f8066d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f7fff700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f80aca30 0x7f70f8066d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.186+0000 7f70f7fff700 1 -- 172.21.15.12:0/4013031368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e800b180 con 0x7f70f80b1430 2021-10-20T23:27:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70f7fff700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f80b1430 0x7f70f8065a60 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f70f00032f0 tx=0x7f70f0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70f4ff9700 1 -- 172.21.15.12:0/4013031368 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f000b8d0 con 0x7f70f80b1430 2021-10-20T23:27:29.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70f4ff9700 1 -- 172.21.15.12:0/4013031368 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0021630 con 0x7f70f80b1430 2021-10-20T23:27:29.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f0009470 con 0x7f70f80b1430 2021-10-20T23:27:29.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70f4ff9700 1 -- 172.21.15.12:0/4013031368 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f000b600 con 0x7f70f80b1430 2021-10-20T23:27:29.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f8064520 con 0x7f70f80b1430 2021-10-20T23:27:29.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f80ae420 con 0x7f70f80b1430 2021-10-20T23:27:29.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70f4ff9700 1 -- 172.21.15.12:0/4013031368 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f70f0027020 con 0x7f70f80b1430 2021-10-20T23:27:29.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70f4ff9700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70dc053520 0x7f70dc0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.190+0000 7f70f4ff9700 1 -- 172.21.15.12:0/4013031368 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f70f006cda0 con 0x7f70f80b1430 2021-10-20T23:27:29.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.194+0000 7f70f77fe700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70dc053520 0x7f70dc0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.194+0000 7f70f77fe700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70dc053520 0x7f70dc0559e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f70e800b000 tx=0x7f70e8006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:29.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.198+0000 7f70f4ff9700 1 -- 172.21.15.12:0/4013031368 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f70f0047e60 con 0x7f70f80b1430 2021-10-20T23:27:29.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.322+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f70f8057350 con 0x7f70f80b1430 2021-10-20T23:27:29.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.330+0000 7f70f4ff9700 1 -- 172.21.15.12:0/4013031368 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f70f0015070 con 0x7f70f80b1430 2021-10-20T23:27:29.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70dc053520 msgr2=0x7f70dc0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70dc053520 0x7f70dc0559e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f70e800b000 tx=0x7f70e8006df0).stop 2021-10-20T23:27:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f80b1430 msgr2=0x7f70f8065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f80b1430 0x7f70f8065a60 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f70f00032f0 tx=0x7f70f0016000).stop 2021-10-20T23:27:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 shutdown_connections 2021-10-20T23:27:29.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f70dc053520 0x7f70dc0559e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f80b1430 0x7f70f8065a60 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70f80ad870 0x7f70f8065570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 --2- 172.21.15.12:0/4013031368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f80aca30 0x7f70f8066d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 >> 172.21.15.12:0/4013031368 conn(0x7f70f8062560 msgr2=0x7f70f80b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:29.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 shutdown_connections 2021-10-20T23:27:29.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.334+0000 7f70fcf38700 1 -- 172.21.15.12:0/4013031368 wait complete. 2021-10-20T23:27:29.354 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:27:29.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:29.368 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:29.395 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:29.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:29.439 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:27:29.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:29.440 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:29.440 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:29.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:27:29.453 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:27:29.454 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:27:29.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:29.455 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:29.455 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:29.493 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:27:29.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:27:29.495 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:27:29.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa96740c700 1 Processor -- start 2021-10-20T23:27:29.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa96740c700 1 -- start start 2021-10-20T23:27:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa96740c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa9600b3040 0x7fa960065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa96740c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 0x7fa9601405f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa96740c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa960066ea0 con 0x7fa9600a9c10 2021-10-20T23:27:29.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa96740c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9600648e0 con 0x7fa9600b3040 2021-10-20T23:27:29.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa96740c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa960061dd0 con 0x7fa960140140 2021-10-20T23:27:29.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa965c09700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa9600a9c10 0x7fa9600607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41326/0 (socket says 172.21.15.12:41326) 2021-10-20T23:27:29.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa965c09700 1 -- 172.21.15.12:0/3602543756 learned_addr learned my addr 172.21.15.12:0/3602543756 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:29.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa96640a700 1 --2- 172.21.15.12:0/3602543756 >> v2:172.21.15.12:3300/0 conn(0x7fa9600b3040 0x7fa960065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.602+0000 7fa966c0b700 1 --2- 172.21.15.12:0/3602543756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 0x7fa9601405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa965408700 1 -- 172.21.15.12:0/3602543756 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627055243 0 0) 0x7fa960066ea0 con 0x7fa9600a9c10 2021-10-20T23:27:29.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa965408700 1 -- 172.21.15.12:0/3602543756 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa948003260 con 0x7fa9600a9c10 2021-10-20T23:27:29.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96640a700 1 -- 172.21.15.12:0/3602543756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 msgr2=0x7fa9601405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:29.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96640a700 1 --2- 172.21.15.12:0/3602543756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 0x7fa9601405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96640a700 1 -- 172.21.15.12:0/3602543756 >> v1:172.21.15.12:6789/0 conn(0x7fa9600a9c10 legacy=0x7fa9600607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96640a700 1 -- 172.21.15.12:0/3602543756 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600b3420 con 0x7fa9600b3040 2021-10-20T23:27:29.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96640a700 1 --2- 172.21.15.12:0/3602543756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600b3040 0x7fa960065e90 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fa95c002f70 tx=0x7fa95c006df0).ready entity=mon.0 client_cookie=8898394b615489fb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:29.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa965408700 1 -- 172.21.15.12:0/3602543756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa95c00d4a0 con 0x7fa9600b3040 2021-10-20T23:27:29.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa965408700 1 -- 172.21.15.12:0/3602543756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c000e90 con 0x7fa9600b3040 2021-10-20T23:27:29.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa965408700 1 -- 172.21.15.12:0/3602543756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa95c00d7f0 con 0x7fa9600b3040 2021-10-20T23:27:29.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96740c700 1 -- 172.21.15.12:0/3602543756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600b3040 msgr2=0x7fa960065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96740c700 1 --2- 172.21.15.12:0/3602543756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600b3040 0x7fa960065e90 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fa95c002f70 tx=0x7fa95c006df0).stop 2021-10-20T23:27:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96740c700 1 -- 172.21.15.12:0/3602543756 shutdown_connections 2021-10-20T23:27:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96740c700 1 --2- 172.21.15.12:0/3602543756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 0x7fa9601405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96740c700 1 --2- 172.21.15.12:0/3602543756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600b3040 0x7fa960065e90 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96740c700 1 -- 172.21.15.12:0/3602543756 >> 172.21.15.12:0/3602543756 conn(0x7fa9600636e0 msgr2=0x7fa960063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96740c700 1 -- 172.21.15.12:0/3602543756 shutdown_connections 2021-10-20T23:27:29.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.606+0000 7fa96740c700 1 -- 172.21.15.12:0/3602543756 wait complete. 2021-10-20T23:27:29.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 Processor -- start 2021-10-20T23:27:29.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 -- start start 2021-10-20T23:27:29.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600a9c10 0x7fa96014fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9600b3040 0x7fa960153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 0x7fa9600b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96013a780 con 0x7fa9600a9c10 2021-10-20T23:27:29.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96013ce40 con 0x7fa9600b3040 2021-10-20T23:27:29.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa960153450 con 0x7fa960140140 2021-10-20T23:27:29.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96640a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600a9c10 0x7fa96014fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96640a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600a9c10 0x7fa96014fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42736/0 (socket says 172.21.15.12:42736) 2021-10-20T23:27:29.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96640a700 1 -- 172.21.15.12:0/4215240954 learned_addr learned my addr 172.21.15.12:0/4215240954 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:29.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa966c0b700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 0x7fa9600b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa965c09700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9600b3040 0x7fa960153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96640a700 1 -- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 msgr2=0x7fa9600b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96640a700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 0x7fa9600b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96640a700 1 -- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9600b3040 msgr2=0x7fa960153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96640a700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9600b3040 0x7fa960153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96640a700 1 -- 172.21.15.12:0/4215240954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c00b180 con 0x7fa9600a9c10 2021-10-20T23:27:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa966c0b700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 0x7fa9600b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:29.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa965c09700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9600b3040 0x7fa960153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:29.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96640a700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600a9c10 0x7fa96014fe20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fa96013ca00 tx=0x7fa95c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:29.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa94f7fe700 1 -- 172.21.15.12:0/4215240954 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa95c013a40 con 0x7fa9600a9c10 2021-10-20T23:27:29.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa94f7fe700 1 -- 172.21.15.12:0/4215240954 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c013ba0 con 0x7fa9600a9c10 2021-10-20T23:27:29.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa94f7fe700 1 -- 172.21.15.12:0/4215240954 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa95c01e400 con 0x7fa9600a9c10 2021-10-20T23:27:29.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9601536b0 con 0x7fa9600a9c10 2021-10-20T23:27:29.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.610+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9600ac7c0 con 0x7fa9600a9c10 2021-10-20T23:27:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.614+0000 7fa94f7fe700 1 -- 172.21.15.12:0/4215240954 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa95c025030 con 0x7fa9600a9c10 2021-10-20T23:27:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.614+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa960153870 con 0x7fa9600a9c10 2021-10-20T23:27:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.614+0000 7fa94f7fe700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa940053580 0x7fa940055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:29.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.614+0000 7fa94f7fe700 1 -- 172.21.15.12:0/4215240954 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fa95c06c720 con 0x7fa9600a9c10 2021-10-20T23:27:29.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.614+0000 7fa965c09700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa940053580 0x7fa940055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:29.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.614+0000 7fa965c09700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa940053580 0x7fa940055a40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fa95000b000 tx=0x7fa950009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:29.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.618+0000 7fa94f7fe700 1 -- 172.21.15.12:0/4215240954 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa95c0438b0 con 0x7fa9600a9c10 2021-10-20T23:27:29.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.746+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa960066960 con 0x7fa9600a9c10 2021-10-20T23:27:29.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.750+0000 7fa94f7fe700 1 -- 172.21.15.12:0/4215240954 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) v1 ==== 81+0+29221 (secure 0 0 0) 0x7fa95c023020 con 0x7fa9600a9c10 2021-10-20T23:27:29.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:29.759 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:29.760 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 104, 2021-10-20T23:27:29.760 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:27:29.760 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:27:29.760 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:27:27.014151+0000", 2021-10-20T23:27:29.761 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:29.761 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:29.761 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:27:29.761 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:27:29.762 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:27:29.762 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:27:29.762 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:27:29.763 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:27:29.763 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:27:29.763 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:29.763 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:27:29.763 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:27:29.764 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:27:29.764 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:27:29.764 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:27:29.764 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 18, 2021-10-20T23:27:29.765 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:27:29.765 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:27:29.765 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:27:29.765 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:27:29.765 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:27:29.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.766 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:27:29.766 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:27:29.766 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:27:29.767 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:29.767 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:29.767 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:29.767 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:29.768 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:29.769 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:29.769 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:29.769 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:29.769 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:27:29.770 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:27:29.770 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:27:29.770 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:27:29.771 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:27:29.771 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:29.771 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:29.771 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:29.772 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:29.772 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:29.772 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:29.772 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:29.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.773 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:27:29.773 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:29.773 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:29.773 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:29.774 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:29.774 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:29.774 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:29.774 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:29.775 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:29.775 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:29.775 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:29.775 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:29.776 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:29.776 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:29.776 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:29.776 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:29.777 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:29.777 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:29.777 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:29.777 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:29.777 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:29.778 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:29.778 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:29.779 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:29.779 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:29.779 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:29.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:29.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.780 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:29.780 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:29.781 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:29.781 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:29.781 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:29.781 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:29.781 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:29.782 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:29.782 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:29.782 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:29.782 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:29.783 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:27:29.783 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:27:29.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.784 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:29.784 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:27:29.784 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.785 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:27:29.786 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:27:29.787 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:27:29.787 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:29.787 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:29.787 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:29.788 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:29.788 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:29.788 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:29.788 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:29.790 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:29.790 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:27:29.790 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:27:29.790 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:27:29.791 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:27:29.791 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:27:29.791 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:29.791 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:29.792 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:29.792 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:29.792 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:29.792 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:29.793 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:29.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.793 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:27:29.793 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:29.793 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:29.794 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:29.794 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:29.794 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:29.794 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:29.795 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:29.795 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:29.795 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:29.795 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:29.796 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:29.796 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:29.796 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:29.796 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:29.796 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:29.797 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:29.797 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:29.797 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:29.797 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:29.798 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:29.798 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:29.798 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:29.798 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:29.799 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:29.799 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:29.799 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:29.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.799 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:29.800 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:29.800 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:29.800 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:29.800 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:29.801 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:29.801 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:29.801 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:29.801 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:29.802 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:29.802 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:29.802 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:27:29.802 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:29.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:27:29.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.803 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:29.803 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:27:29.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.804 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:29.804 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:27:29.804 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:29.805 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:29.805 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:29.805 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:29.805 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:29.805 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:29.806 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:29.806 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 98, 2021-10-20T23:27:29.806 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:29.806 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:29.807 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:29.807 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.808 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:27:29.808 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:29.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.809 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:27:29.809 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:29.809 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.809 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.810 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:29.810 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.811 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.811 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:27:29.811 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:29.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.812 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.812 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:27:29.812 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:29.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.813 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.813 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:29.813 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.814 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.814 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:27:29.815 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:29.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.816 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:27:29.816 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:29.816 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.816 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.817 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:29.817 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.818 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:27:29.818 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:29.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.819 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.819 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:27:29.819 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:29.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.822 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.822 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:27:29.822 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:27:29.823 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:27:29.823 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:27:29.823 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:29.823 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:29.823 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:29.824 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.824 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:29.824 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:27:29.825 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:29.825 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:29.826 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:29.826 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:29.826 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:29.826 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:29.826 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:29.827 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 98, 2021-10-20T23:27:29.828 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:29.828 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:29.829 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:29.830 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.830 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.830 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:27:29.830 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:29.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.831 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:27:29.832 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:29.833 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.833 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.833 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:29.833 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.834 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.834 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:27:29.835 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:29.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.835 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:27:29.836 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:29.836 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.837 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.837 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:29.837 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.838 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.838 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:27:29.838 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:29.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.839 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:27:29.839 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:29.840 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.841 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.841 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:29.842 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.842 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:27:29.843 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:29.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.844 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.844 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:27:29.845 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:29.845 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.845 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.846 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:27:29.846 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:27:29.846 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:27:29.846 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:27:29.846 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:29.847 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:29.847 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:29.847 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.848 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:29.848 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:27:29.848 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:29.848 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:29.849 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:29.849 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:29.849 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:29.849 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:29.849 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:29.850 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 99, 2021-10-20T23:27:29.850 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:29.850 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:29.850 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:29.851 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.851 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:27:29.851 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:29.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.852 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:27:29.853 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:29.853 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.853 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.854 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:29.854 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.856 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:27:29.856 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:29.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.857 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:27:29.857 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:29.857 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.857 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.858 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:29.858 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.859 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:27:29.859 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:29.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.860 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:27:29.860 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:29.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.860 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.861 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:29.861 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.862 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:27:29.862 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:29.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.863 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.863 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:27:29.863 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:29.863 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.863 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.864 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:27:29.864 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:27:29.864 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:27:29.864 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:27:29.865 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:29.865 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:29.865 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:29.865 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.867 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:29.867 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:27:29.867 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:29.867 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:29.867 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:29.868 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:29.868 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:29.868 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:29.869 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:29.869 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 99, 2021-10-20T23:27:29.869 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:29.869 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:29.870 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:29.870 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.870 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.870 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:27:29.871 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:29.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.872 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:27:29.873 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:29.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.873 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.874 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:29.874 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.874 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:27:29.875 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:29.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.876 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:27:29.876 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:29.876 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.878 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.878 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:29.878 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.881 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:27:29.882 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:29.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.883 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:27:29.883 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:29.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.883 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.884 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:29.884 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.885 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:27:29.885 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:29.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.888 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:27:29.888 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:29.889 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.889 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.889 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:27:29.890 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:27:29.890 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:27:29.891 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:27:29.891 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:29.891 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:29.892 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:29.892 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.893 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:29.893 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:27:29.893 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:29.894 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:29.894 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:29.894 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:29.894 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:29.895 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:29.895 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:29.896 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 97, 2021-10-20T23:27:29.896 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:29.897 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:29.897 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:29.899 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.900 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:27:29.901 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:29.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.902 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:27:29.902 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:29.902 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.902 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.903 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:29.903 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.904 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:27:29.904 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:29.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.905 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:27:29.905 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:29.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.906 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.906 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:29.907 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.907 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:27:29.908 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:29.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.909 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:27:29.909 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:29.909 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.909 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:27:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:27:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.913 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.913 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:27:29.914 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:27:29.915 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:27:29.915 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:27:29.915 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:29.915 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:29.915 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:29.916 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.916 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:29.917 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:27:29.917 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:29.918 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:29.918 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:29.918 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:29.918 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:29.919 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:29.919 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:29.919 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 89, 2021-10-20T23:27:29.919 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:29.920 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:29.920 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:29.920 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.921 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:27:29.921 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:29.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.922 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:27:29.923 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:29.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.923 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.924 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:29.924 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.925 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:27:29.925 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:29.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.926 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:27:29.926 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:29.926 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.927 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.927 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:29.927 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.928 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:27:29.928 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:29.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.929 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:27:29.930 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:29.930 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.930 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.931 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:29.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.932 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:27:29.932 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:29.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:27:29.934 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:29.934 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.934 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.935 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:27:29.935 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:27:29.935 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:27:29.935 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:27:29.936 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:29.936 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:29.936 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:29.936 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.937 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:29.938 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:27:29.938 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:29.938 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:29.938 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:29.939 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:29.939 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:29.939 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:29.939 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:29.940 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 97, 2021-10-20T23:27:29.940 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:29.940 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:29.940 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:29.940 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.941 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:27:29.941 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:29.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.942 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:27:29.943 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:29.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.943 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.943 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:29.944 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.944 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:27:29.945 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:29.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.946 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:27:29.946 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:29.946 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.946 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.947 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:29.947 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.948 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:27:29.948 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:29.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.949 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:27:29.949 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:29.949 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.949 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.950 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:29.950 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.951 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:27:29.951 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:29.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.952 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:27:29.952 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:29.952 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.953 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.953 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:27:29.953 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:27:29.954 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:27:29.954 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:27:29.954 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:29.954 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:29.954 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:29.955 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.955 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:29.956 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:27:29.956 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:29.956 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:29.956 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:29.956 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:29.957 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:29.957 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:29.957 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:29.957 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 98, 2021-10-20T23:27:29.958 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:29.958 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:29.958 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:29.958 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.959 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.959 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:27:29.959 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:29.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.960 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:27:29.960 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:29.961 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.961 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.961 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:29.961 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.962 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:27:29.962 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:29.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.963 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:27:29.964 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:29.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.964 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.965 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:29.965 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.965 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:27:29.966 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:29.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.967 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:27:29.967 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:29.967 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.968 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.968 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:29.968 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:29.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:29.969 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:27:29.969 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:29.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:29.970 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:27:29.970 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:29.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.971 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.971 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:27:29.972 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:27:29.972 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:27:29.972 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:27:29.972 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:29.973 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:29.973 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:29.973 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:29.973 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.973 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:29.974 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:27:29.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.974 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:29.975 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:29.975 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:29.975 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:29.975 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:29.976 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:29.976 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:27:29.976 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:29.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.977 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:29.977 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:29.977 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:29.977 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:29.978 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:29.978 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:29.978 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:27:29.978 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:29.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.979 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:29.979 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:29.979 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:29.980 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:29.980 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:29.980 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:29.980 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:27:29.981 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:29.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.981 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:27:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:27:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:27:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:27:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:27:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:27:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:27:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:27:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:27:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:27:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.31:6835/3694841345": "2021-10-21T23:27:22.967214+0000", 2021-10-20T23:27:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.31:6834/3694841345": "2021-10-21T23:27:22.967214+0000" 2021-10-20T23:27:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:27:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:27:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:27:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:27:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:27:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:27:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:27:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:27:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:27:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:27:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:27:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:27:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:27:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:27:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:27:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:27:30.006 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:30.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa940053580 msgr2=0x7fa940055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa940053580 0x7fa940055a40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fa95000b000 tx=0x7fa950009040).stop 2021-10-20T23:27:30.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600a9c10 msgr2=0x7fa96014fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600a9c10 0x7fa96014fe20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fa96013ca00 tx=0x7fa95c014000).stop 2021-10-20T23:27:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 shutdown_connections 2021-10-20T23:27:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa940053580 0x7fa940055a40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa960140140 0x7fa9600b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9600b3040 0x7fa960153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 --2- 172.21.15.12:0/4215240954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9600a9c10 0x7fa96014fe20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 >> 172.21.15.12:0/4215240954 conn(0x7fa9600636e0 msgr2=0x7fa960141530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:30.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 shutdown_connections 2021-10-20T23:27:30.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:29.754+0000 7fa96740c700 1 -- 172.21.15.12:0/4215240954 wait complete. 2021-10-20T23:27:30.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:30.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc405f6f700 1 Processor -- start 2021-10-20T23:27:30.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc405f6f700 1 -- start start 2021-10-20T23:27:30.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc405f6f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4001483a0 0x7fc4000b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc405f6f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc4000a70c0 0x7fc400144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc405f6f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4000b0350 con 0x7fc4000b1db0 2021-10-20T23:27:30.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc405f6f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4000a90c0 con 0x7fc4000a70c0 2021-10-20T23:27:30.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc405f6f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000b05f0 con 0x7fc4001483a0 2021-10-20T23:27:30.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc4000a70c0 0x7fc400144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc4000a70c0 0x7fc400144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42748/0 (socket says 172.21.15.12:42748) 2021-10-20T23:27:30.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fffff700 1 -- 172.21.15.12:0/547378297 learned_addr learned my addr 172.21.15.12:0/547378297 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:30.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3feffd700 1 --2- 172.21.15.12:0/547378297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4001483a0 0x7fc4000b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fe7fc700 1 -- 172.21.15.12:0/547378297 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059782724 0 0) 0x7fc4000b0350 con 0x7fc4000b1db0 2021-10-20T23:27:30.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fffff700 1 -- 172.21.15.12:0/547378297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4001483a0 msgr2=0x7fc4000b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:30.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fffff700 1 --2- 172.21.15.12:0/547378297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4001483a0 0x7fc4000b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fffff700 1 -- 172.21.15.12:0/547378297 >> v1:172.21.15.31:6789/0 conn(0x7fc4000b1db0 legacy=0x7fc4000b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fffff700 1 -- 172.21.15.12:0/547378297 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4000b0890 con 0x7fc4000a70c0 2021-10-20T23:27:30.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3feffd700 1 --2- 172.21.15.12:0/547378297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4001483a0 0x7fc4000b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:30.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fffff700 1 --2- 172.21.15.12:0/547378297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4000a70c0 0x7fc400144720 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fc3f80032f0 tx=0x7fc3f8009290).ready entity=mon.0 client_cookie=6bd2e5bc16875330 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:30.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fe7fc700 1 -- 172.21.15.12:0/547378297 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f800b8a0 con 0x7fc4000a70c0 2021-10-20T23:27:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fe7fc700 1 -- 172.21.15.12:0/547378297 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f800ba00 con 0x7fc4000a70c0 2021-10-20T23:27:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.118+0000 7fc3fe7fc700 1 -- 172.21.15.12:0/547378297 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f800bb70 con 0x7fc4000a70c0 2021-10-20T23:27:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 -- 172.21.15.12:0/547378297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4000a70c0 msgr2=0x7fc400144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 --2- 172.21.15.12:0/547378297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4000a70c0 0x7fc400144720 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fc3f80032f0 tx=0x7fc3f8009290).stop 2021-10-20T23:27:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 -- 172.21.15.12:0/547378297 shutdown_connections 2021-10-20T23:27:30.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 --2- 172.21.15.12:0/547378297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4000a70c0 0x7fc400144720 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 --2- 172.21.15.12:0/547378297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4001483a0 0x7fc4000b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 -- 172.21.15.12:0/547378297 >> 172.21.15.12:0/547378297 conn(0x7fc40005f6b0 msgr2=0x7fc40005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:30.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 -- 172.21.15.12:0/547378297 shutdown_connections 2021-10-20T23:27:30.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 -- 172.21.15.12:0/547378297 wait complete. 2021-10-20T23:27:30.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 Processor -- start 2021-10-20T23:27:30.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.122+0000 7fc405f6f700 1 -- start start 2021-10-20T23:27:30.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc405f6f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4000a70c0 0x7fc400142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc405f6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000b1db0 0x7fc40013d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc405f6f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4001483a0 0x7fc40013dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc405f6f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc400145a40 con 0x7fc4001483a0 2021-10-20T23:27:30.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc405f6f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000ad020 con 0x7fc4000b1db0 2021-10-20T23:27:30.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc405f6f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000ad2c0 con 0x7fc4000a70c0 2021-10-20T23:27:30.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4001483a0 0x7fc40013dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4001483a0 0x7fc40013dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42752/0 (socket says 172.21.15.12:42752) 2021-10-20T23:27:30.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3fffff700 1 -- 172.21.15.12:0/4056122197 learned_addr learned my addr 172.21.15.12:0/4056122197 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:30.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3ff7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4000a70c0 0x7fc400142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3feffd700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000b1db0 0x7fc40013d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3ff7fe700 1 -- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000b1db0 msgr2=0x7fc40013d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3ff7fe700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000b1db0 0x7fc40013d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3ff7fe700 1 -- 172.21.15.12:0/4056122197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4001483a0 msgr2=0x7fc40013dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3ff7fe700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4001483a0 0x7fc40013dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3ff7fe700 1 -- 172.21.15.12:0/4056122197 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f400b180 con 0x7fc4000a70c0 2021-10-20T23:27:30.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3fffff700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4001483a0 0x7fc40013dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:30.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3ff7fe700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4000a70c0 0x7fc400142380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fc3f0000ed0 tx=0x7fc3f0007a00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:30.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3fcff9700 1 -- 172.21.15.12:0/4056122197 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f0012400 con 0x7fc4000a70c0 2021-10-20T23:27:30.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3fcff9700 1 -- 172.21.15.12:0/4056122197 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f0012560 con 0x7fc4000a70c0 2021-10-20T23:27:30.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc3fcff9700 1 -- 172.21.15.12:0/4056122197 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f00128c0 con 0x7fc4000a70c0 2021-10-20T23:27:30.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f8009530 con 0x7fc4000a70c0 2021-10-20T23:27:30.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40013e1c0 con 0x7fc4000a70c0 2021-10-20T23:27:30.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.126+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc400145c40 con 0x7fc4000a70c0 2021-10-20T23:27:30.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.130+0000 7fc3fcff9700 1 -- 172.21.15.12:0/4056122197 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc3f0019030 con 0x7fc4000a70c0 2021-10-20T23:27:30.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.130+0000 7fc3fcff9700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3e0053610 0x7fc3e0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.130+0000 7fc3fcff9700 1 -- 172.21.15.12:0/4056122197 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc3f006ab00 con 0x7fc4000a70c0 2021-10-20T23:27:30.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.130+0000 7fc3feffd700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3e0053610 0x7fc3e0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.130+0000 7fc3feffd700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3e0053610 0x7fc3e0055ad0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fc3f400b000 tx=0x7fc3f4006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:30.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.138+0000 7fc3fcff9700 1 -- 172.21.15.12:0/4056122197 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3f006ce60 con 0x7fc4000a70c0 2021-10-20T23:27:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.302+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc400057350 con 0x7fc4000a70c0 2021-10-20T23:27:30.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.306+0000 7fc3fcff9700 1 -- 172.21.15.12:0/4056122197 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fc3f0041ca0 con 0x7fc4000a70c0 2021-10-20T23:27:30.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:30.314 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1323051693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1323051693},{"type":"v1","addr":"172.21.15.12:6833","nonce":1323051693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":6921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2210278023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2210278023},{"type":"v1","addr":"172.21.15.12:6835","nonce":2210278023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48},{"gid":7192,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1081601998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1081601998},{"type":"v1","addr":"172.21.15.31:6835","nonce":1081601998}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[]} 2021-10-20T23:27:30.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.306+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3e0053610 msgr2=0x7fc3e0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.306+0000 7fc405f6f700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3e0053610 0x7fc3e0055ad0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fc3f400b000 tx=0x7fc3f4006df0).stop 2021-10-20T23:27:30.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.306+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4000a70c0 msgr2=0x7fc400142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.306+0000 7fc405f6f700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4000a70c0 0x7fc400142380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fc3f0000ed0 tx=0x7fc3f0007a00).stop 2021-10-20T23:27:30.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.310+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 shutdown_connections 2021-10-20T23:27:30.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.310+0000 7fc405f6f700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3e0053610 0x7fc3e0055ad0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.310+0000 7fc405f6f700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4001483a0 0x7fc40013dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.310+0000 7fc405f6f700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000b1db0 0x7fc40013d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.310+0000 7fc405f6f700 1 --2- 172.21.15.12:0/4056122197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4000a70c0 0x7fc400142380 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.310+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 >> 172.21.15.12:0/4056122197 conn(0x7fc40005f6b0 msgr2=0x7fc4000a76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:30.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.310+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 shutdown_connections 2021-10-20T23:27:30.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.310+0000 7fc405f6f700 1 -- 172.21.15.12:0/4056122197 wait complete. 2021-10-20T23:27:30.322 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 51 2021-10-20T23:27:30.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:30.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5ebd5a4700 1 Processor -- start 2021-10-20T23:27:30.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5ebd5a4700 1 -- start start 2021-10-20T23:27:30.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5ebd5a4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8061320 0x7f5eb8061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5ebd5a4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5eb80ad5c0 0x7f5eb80b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5ebd5a4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb80aecf0 con 0x7f5eb8140440 2021-10-20T23:27:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5ebd5a4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb80b6f20 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5ebd5a4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80aef20 con 0x7f5eb8061320 2021-10-20T23:27:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eaffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5eb80ad5c0 0x7f5eb80b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eaffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5eb80ad5c0 0x7f5eb80b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42760/0 (socket says 172.21.15.12:42760) 2021-10-20T23:27:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5ebcda3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5eb8140440 0x7f5eb8146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:48418/0 (socket says 172.21.15.12:48418) 2021-10-20T23:27:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eb7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8061320 0x7f5eb8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eaffff700 1 -- 172.21.15.12:0/1155779001 learned_addr learned my addr 172.21.15.12:0/1155779001 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eaffff700 1 -- 172.21.15.12:0/1155779001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8061320 msgr2=0x7f5eb8061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eaffff700 1 --2- 172.21.15.12:0/1155779001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8061320 0x7f5eb8061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eb77fe700 1 -- 172.21.15.12:0/1155779001 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026100860 0 0) 0x7f5eb80aecf0 con 0x7f5eb8140440 2021-10-20T23:27:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eaffff700 1 -- 172.21.15.12:0/1155779001 >> v1:172.21.15.31:6789/0 conn(0x7f5eb8140440 legacy=0x7f5eb8146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eaffff700 1 -- 172.21.15.12:0/1155779001 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80af1c0 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eaffff700 1 --2- 172.21.15.12:0/1155779001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 0x7f5eb80b9e60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f5ea0002f70 tx=0x7f5ea0006eb0).ready entity=mon.0 client_cookie=e4961a37e2d1b726 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eb77fe700 1 -- 172.21.15.12:0/1155779001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ea000d570 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eb77fe700 1 -- 172.21.15.12:0/1155779001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea0000e90 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.430+0000 7f5eb77fe700 1 -- 172.21.15.12:0/1155779001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ea000d8c0 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/1155779001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 msgr2=0x7f5eb80b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 --2- 172.21.15.12:0/1155779001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 0x7f5eb80b9e60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f5ea0002f70 tx=0x7f5ea0006eb0).stop 2021-10-20T23:27:30.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/1155779001 shutdown_connections 2021-10-20T23:27:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 --2- 172.21.15.12:0/1155779001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 0x7f5eb80b9e60 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 --2- 172.21.15.12:0/1155779001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8061320 0x7f5eb8061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/1155779001 >> 172.21.15.12:0/1155779001 conn(0x7f5eb8066de0 msgr2=0x7f5eb80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/1155779001 shutdown_connections 2021-10-20T23:27:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/1155779001 wait complete. 2021-10-20T23:27:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 Processor -- start 2021-10-20T23:27:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.434+0000 7f5ebd5a4700 1 -- start start 2021-10-20T23:27:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5ebd5a4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5eb8061320 0x7f5eb8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5ebd5a4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 0x7f5eb80b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5ebd5a4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8140440 0x7f5eb80b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5ebd5a4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80b26d0 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5ebd5a4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb814a2a0 con 0x7f5eb8061320 2021-10-20T23:27:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5ebd5a4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80b0290 con 0x7f5eb8140440 2021-10-20T23:27:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 0x7f5eb80b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 0x7f5eb80b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42766/0 (socket says 172.21.15.12:42766) 2021-10-20T23:27:30.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eaffff700 1 -- 172.21.15.12:0/4038998874 learned_addr learned my addr 172.21.15.12:0/4038998874 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:30.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eb7fff700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5eb8061320 0x7f5eb8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5ebcda3700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8140440 0x7f5eb80b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eaffff700 1 -- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8140440 msgr2=0x7f5eb80b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eaffff700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8140440 0x7f5eb80b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eaffff700 1 -- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5eb8061320 msgr2=0x7f5eb8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eaffff700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5eb8061320 0x7f5eb8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eaffff700 1 -- 172.21.15.12:0/4038998874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea000b1e0 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eaffff700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 0x7f5eb80b0900 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f5ea0002f70 tx=0x7f5ea0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:30.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/4038998874 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ea0011860 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/4038998874 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea00119c0 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb80b23c0 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/4038998874 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ea0011d20 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.438+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb80afde0 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.442+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb80b3ae0 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.442+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/4038998874 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ea0025030 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.442+0000 7f5eb5ffb700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e9c053640 0x7f5e9c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.442+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/4038998874 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f5ea006c9c0 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.442+0000 7f5eb7fff700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e9c053640 0x7f5e9c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.442+0000 7f5eb7fff700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e9c053640 0x7f5e9c055b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f5ea800b000 tx=0x7f5ea8006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.450+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/4038998874 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ea0043b90 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5eb80af460 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/4038998874 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f5ea0023070 con 0x7f5eb80ad5c0 2021-10-20T23:27:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:30.626 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1323051693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1323051693},{"type":"v1","addr":"172.21.15.12:6833","nonce":1323051693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":6921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/2210278023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2210278023},{"type":"v1","addr":"172.21.15.12:6835","nonce":2210278023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48},{"gid":7192,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1081601998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1081601998},{"type":"v1","addr":"172.21.15.31:6835","nonce":1081601998}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[]} 2021-10-20T23:27:30.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e9c053640 msgr2=0x7f5e9c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e9c053640 0x7f5e9c055b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f5ea800b000 tx=0x7f5ea8006df0).stop 2021-10-20T23:27:30.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 msgr2=0x7f5eb80b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 0x7f5eb80b0900 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f5ea0002f70 tx=0x7f5ea0015000).stop 2021-10-20T23:27:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 shutdown_connections 2021-10-20T23:27:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e9c053640 0x7f5e9c055b00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb8140440 0x7f5eb80b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5eb80ad5c0 0x7f5eb80b0900 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 --2- 172.21.15.12:0/4038998874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5eb8061320 0x7f5eb8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 >> 172.21.15.12:0/4038998874 conn(0x7f5eb8066de0 msgr2=0x7f5eb8146780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 shutdown_connections 2021-10-20T23:27:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.618+0000 7f5ebd5a4700 1 -- 172.21.15.12:0/4038998874 wait complete. 2021-10-20T23:27:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 51 2021-10-20T23:27:30.642 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:27:30.643 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:27:30.643 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:27:30.643 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:27:30.644 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:27:30.644 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:27:30.644 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:27:30.645 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:27:30.645 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:27:30.645 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:27:30.646 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:27:30.646 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:27:30.655 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:27:30.655 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:27:30.658 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:27:30.658 DEBUG:teuthology.parallel:result is None 2021-10-20T23:27:30.659 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:27:30.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:27:30.661 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:27:30.662 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:27:30.667 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:27:30.668 DEBUG:teuthology.parallel:result is None 2021-10-20T23:27:30.708 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:27:30.708 DEBUG:teuthology.parallel:result is None 2021-10-20T23:27:30.709 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:27:30.719 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:27:30.731 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:27:30.788 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:27:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.806+0000 7f6c9f358700 1 Processor -- start 2021-10-20T23:27:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.806+0000 7f6c9f358700 1 -- start start 2021-10-20T23:27:30.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.806+0000 7f6c9f358700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98060100 0x7f6c98061650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.806+0000 7f6c9f358700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c980604e0 con 0x7f6c98066ce0 2021-10-20T23:27:30.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.806+0000 7f6c9f358700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c98060c70 con 0x7f6c98065970 2021-10-20T23:27:30.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.806+0000 7f6c9f358700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98067120 con 0x7f6c98060100 2021-10-20T23:27:30.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.806+0000 7f6c9d8f5700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6c98066ce0 0x7f6c9814d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41394/0 (socket says 172.21.15.12:41394) 2021-10-20T23:27:30.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.806+0000 7f6c9d8f5700 1 -- 172.21.15.12:0/4188494510 learned_addr learned my addr 172.21.15.12:0/4188494510 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:30.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.806+0000 7f6c9d0f4700 1 --2- 172.21.15.12:0/4188494510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98060100 0x7f6c98061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c8ffff700 1 -- 172.21.15.12:0/4188494510 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023697472 0 0) 0x7f6c980604e0 con 0x7f6c98066ce0 2021-10-20T23:27:30.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c8ffff700 1 -- 172.21.15.12:0/4188494510 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c7c003260 con 0x7f6c98066ce0 2021-10-20T23:27:30.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c8ffff700 1 -- 172.21.15.12:0/4188494510 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547032108 0 0) 0x7f6c98060c70 con 0x7f6c98065970 2021-10-20T23:27:30.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c8ffff700 1 -- 172.21.15.12:0/4188494510 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c980604e0 con 0x7f6c98065970 2021-10-20T23:27:30.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9d0f4700 1 -- 172.21.15.12:0/4188494510 >> v1:172.21.15.31:6789/0 conn(0x7f6c98065970 legacy=0x7f6c980665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9d0f4700 1 -- 172.21.15.12:0/4188494510 >> v1:172.21.15.12:6789/0 conn(0x7f6c98066ce0 legacy=0x7f6c9814d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9d0f4700 1 -- 172.21.15.12:0/4188494510 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98060f10 con 0x7f6c98060100 2021-10-20T23:27:30.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9d0f4700 1 --2- 172.21.15.12:0/4188494510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98060100 0x7f6c98061650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f6c900032f0 tx=0x7f6c900091d0).ready entity=mon.2 client_cookie=47cd7f85e9a9befc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:30.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c8ffff700 1 -- 172.21.15.12:0/4188494510 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c9000b640 con 0x7f6c98060100 2021-10-20T23:27:30.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c8ffff700 1 -- 172.21.15.12:0/4188494510 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9000b7a0 con 0x7f6c98060100 2021-10-20T23:27:30.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c8ffff700 1 -- 172.21.15.12:0/4188494510 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c9000b910 con 0x7f6c98060100 2021-10-20T23:27:30.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/4188494510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98060100 msgr2=0x7f6c98061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9f358700 1 --2- 172.21.15.12:0/4188494510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98060100 0x7f6c98061650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f6c900032f0 tx=0x7f6c900091d0).stop 2021-10-20T23:27:30.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/4188494510 shutdown_connections 2021-10-20T23:27:30.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9f358700 1 --2- 172.21.15.12:0/4188494510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98060100 0x7f6c98061650 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/4188494510 >> 172.21.15.12:0/4188494510 conn(0x7f6c9805cf30 msgr2=0x7f6c9805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:30.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/4188494510 shutdown_connections 2021-10-20T23:27:30.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/4188494510 wait complete. 2021-10-20T23:27:30.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9f358700 1 Processor -- start 2021-10-20T23:27:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.810+0000 7f6c9f358700 1 -- start start 2021-10-20T23:27:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9f358700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c98060100 0x7f6c980b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9f358700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c98065970 0x7f6c980a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9f358700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98066ce0 0x7f6c980a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9f358700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c981527f0 con 0x7f6c98065970 2021-10-20T23:27:30.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9f358700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980a8680 con 0x7f6c98060100 2021-10-20T23:27:30.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9f358700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980a4c60 con 0x7f6c98066ce0 2021-10-20T23:27:30.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9c8f3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c98065970 0x7f6c980a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9c8f3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c98065970 0x7f6c980a5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42804/0 (socket says 172.21.15.12:42804) 2021-10-20T23:27:30.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9c8f3700 1 -- 172.21.15.12:0/969461236 learned_addr learned my addr 172.21.15.12:0/969461236 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:30.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9d0f4700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c98060100 0x7f6c980b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9d8f5700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98066ce0 0x7f6c980a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9c8f3700 1 -- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98066ce0 msgr2=0x7f6c980a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9c8f3700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98066ce0 0x7f6c980a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9c8f3700 1 -- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c98060100 msgr2=0x7f6c980b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:30.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9c8f3700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c98060100 0x7f6c980b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:30.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9c8f3700 1 -- 172.21.15.12:0/969461236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009470 con 0x7f6c98065970 2021-10-20T23:27:30.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9c8f3700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c98065970 0x7f6c980a5690 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f6c88001110 tx=0x7f6c88007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:30.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c8e7fc700 1 -- 172.21.15.12:0/969461236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c88012400 con 0x7f6c98065970 2021-10-20T23:27:30.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c8e7fc700 1 -- 172.21.15.12:0/969461236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c88012560 con 0x7f6c98065970 2021-10-20T23:27:30.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c8e7fc700 1 -- 172.21.15.12:0/969461236 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c880128c0 con 0x7f6c98065970 2021-10-20T23:27:30.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c98152a20 con 0x7f6c98065970 2021-10-20T23:27:30.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c980a4950 con 0x7f6c98065970 2021-10-20T23:27:30.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.814+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c98152bb0 con 0x7f6c98065970 2021-10-20T23:27:30.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.818+0000 7f6c8e7fc700 1 -- 172.21.15.12:0/969461236 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c88019030 con 0x7f6c98065970 2021-10-20T23:27:30.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.818+0000 7f6c8e7fc700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c80053610 0x7f6c80055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:30.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.818+0000 7f6c8e7fc700 1 -- 172.21.15.12:0/969461236 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f6c8806ab10 con 0x7f6c98065970 2021-10-20T23:27:30.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.818+0000 7f6c9d0f4700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c80053610 0x7f6c80055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:30.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.818+0000 7f6c9d0f4700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c80053610 0x7f6c80055ad0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f6c9001b000 tx=0x7f6c90016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:30.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.822+0000 7f6c8e7fc700 1 -- 172.21.15.12:0/969461236 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c88041df0 con 0x7f6c98065970 2021-10-20T23:27:30.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:30.958+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f6c980611b0 con 0x7f6c98065970 2021-10-20T23:27:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.806+0000 7f6c8e7fc700 1 -- 172.21.15.12:0/969461236 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6c88045410 con 0x7f6c98065970 2021-10-20T23:27:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c80053610 msgr2=0x7f6c80055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c80053610 0x7f6c80055ad0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f6c9001b000 tx=0x7f6c90016000).stop 2021-10-20T23:27:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c98065970 msgr2=0x7f6c980a5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c98065970 0x7f6c980a5690 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f6c88001110 tx=0x7f6c88007a90).stop 2021-10-20T23:27:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 shutdown_connections 2021-10-20T23:27:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c80053610 0x7f6c80055ad0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c98066ce0 0x7f6c980a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c98065970 0x7f6c980a5690 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 --2- 172.21.15.12:0/969461236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c98060100 0x7f6c980b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 >> 172.21.15.12:0/969461236 conn(0x7f6c9805cf30 msgr2=0x7f6c980615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 shutdown_connections 2021-10-20T23:27:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.810+0000 7f6c9f358700 1 -- 172.21.15.12:0/969461236 wait complete. 2021-10-20T23:27:31.822 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:27:31.840 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:27:31.841 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:27:32.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.986+0000 7f6878810700 1 Processor -- start 2021-10-20T23:27:32.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.986+0000 7f6878810700 1 -- start start 2021-10-20T23:27:32.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b43c0 0x7f68740b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68740b6960 0x7f687412ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68741440b0 con 0x7f68740b6580 2021-10-20T23:27:32.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6874143b70 con 0x7f68740b6960 2021-10-20T23:27:32.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6874143e10 con 0x7f68740b43c0 2021-10-20T23:27:32.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6872d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68740b6960 0x7f687412ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6869d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b43c0 0x7f68740b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6872d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68740b6960 0x7f687412ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:57792/0 (socket says 172.21.15.12:57792) 2021-10-20T23:27:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6869d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b43c0 0x7f68740b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:48572/0 (socket says 172.21.15.12:48572) 2021-10-20T23:27:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6872d9d700 1 -- 172.21.15.12:0/2473487126 learned_addr learned my addr 172.21.15.12:0/2473487126 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:32.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f687259c700 1 --1- 172.21.15.12:0/2473487126 >> v1:172.21.15.31:6789/0 conn(0x7f68740b6580 0x7f6874061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:48472/0 (socket says 172.21.15.12:48472) 2021-10-20T23:27:32.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6869d9b700 1 -- 172.21.15.12:0/2473487126 >> v2:172.21.15.31:3300/0 conn(0x7f68740b6960 msgr2=0x7f687412ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:32.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6869d9b700 1 --2- 172.21.15.12:0/2473487126 >> v2:172.21.15.31:3300/0 conn(0x7f68740b6960 0x7f687412ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6869d9b700 1 -- 172.21.15.12:0/2473487126 >> v1:172.21.15.31:6789/0 conn(0x7f68740b6580 legacy=0x7f6874061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6869d9b700 1 -- 172.21.15.12:0/2473487126 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740615f0 con 0x7f68740b43c0 2021-10-20T23:27:32.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6869d9b700 1 --2- 172.21.15.12:0/2473487126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b43c0 0x7f68740b5bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f685c002f70 tx=0x7f685c006df0).ready entity=mon.2 client_cookie=cc55d0977a8f3461 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6871d9b700 1 -- 172.21.15.12:0/2473487126 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f685c00d570 con 0x7f68740b43c0 2021-10-20T23:27:32.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6871d9b700 1 -- 172.21.15.12:0/2473487126 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c000e90 con 0x7f68740b43c0 2021-10-20T23:27:32.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6871d9b700 1 -- 172.21.15.12:0/2473487126 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f685c00d8c0 con 0x7f68740b43c0 2021-10-20T23:27:32.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 -- 172.21.15.12:0/2473487126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b43c0 msgr2=0x7f68740b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 --2- 172.21.15.12:0/2473487126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b43c0 0x7f68740b5bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f685c002f70 tx=0x7f685c006df0).stop 2021-10-20T23:27:32.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 -- 172.21.15.12:0/2473487126 shutdown_connections 2021-10-20T23:27:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 --2- 172.21.15.12:0/2473487126 >> v2:172.21.15.31:3300/0 conn(0x7f68740b6960 0x7f687412ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.990+0000 7f6878810700 1 --2- 172.21.15.12:0/2473487126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b43c0 0x7f68740b5bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 -- 172.21.15.12:0/2473487126 >> 172.21.15.12:0/2473487126 conn(0x7f687405c490 msgr2=0x7f687405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 -- 172.21.15.12:0/2473487126 shutdown_connections 2021-10-20T23:27:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 -- 172.21.15.12:0/2473487126 wait complete. 2021-10-20T23:27:32.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 Processor -- start 2021-10-20T23:27:32.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 -- start start 2021-10-20T23:27:32.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68740b43c0 0x7f68740b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68740b6580 0x7f6874140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b6960 0x7f6874141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6874153250 con 0x7f68740b6580 2021-10-20T23:27:32.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6874152330 con 0x7f68740b43c0 2021-10-20T23:27:32.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6878810700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68741525d0 con 0x7f68740b6960 2021-10-20T23:27:32.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6869d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68740b6580 0x7f6874140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6869d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68740b6580 0x7f6874140f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42822/0 (socket says 172.21.15.12:42822) 2021-10-20T23:27:32.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6869d9b700 1 -- 172.21.15.12:0/1640839565 learned_addr learned my addr 172.21.15.12:0/1640839565 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:32.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f687259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68740b43c0 0x7f68740b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.994+0000 7f6872d9d700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b6960 0x7f6874141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f6869d9b700 1 -- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b6960 msgr2=0x7f6874141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f6869d9b700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b6960 0x7f6874141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f6869d9b700 1 -- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68740b43c0 msgr2=0x7f68740b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f6869d9b700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68740b43c0 0x7f68740b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f6869d9b700 1 -- 172.21.15.12:0/1640839565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c00b180 con 0x7f68740b6580 2021-10-20T23:27:32.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f6869d9b700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68740b6580 0x7f6874140f90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f685c002f70 tx=0x7f685c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f686bfff700 1 -- 172.21.15.12:0/1640839565 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f685c00dea0 con 0x7f68740b6580 2021-10-20T23:27:32.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f686bfff700 1 -- 172.21.15.12:0/1640839565 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c013de0 con 0x7f68740b6580 2021-10-20T23:27:32.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6874152870 con 0x7f68740b6580 2021-10-20T23:27:32.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f686bfff700 1 -- 172.21.15.12:0/1640839565 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f685c01e5f0 con 0x7f68740b6580 2021-10-20T23:27:32.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68740b7aa0 con 0x7f68740b6580 2021-10-20T23:27:32.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6874061890 con 0x7f68740b6580 2021-10-20T23:27:32.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:31.998+0000 7f686bfff700 1 -- 172.21.15.12:0/1640839565 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f685c025030 con 0x7f68740b6580 2021-10-20T23:27:32.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.002+0000 7f686bfff700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6858053580 0x7f6858055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.002+0000 7f686bfff700 1 -- 172.21.15.12:0/1640839565 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f685c06c330 con 0x7f68740b6580 2021-10-20T23:27:32.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.002+0000 7f687259c700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6858053580 0x7f6858055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.002+0000 7f687259c700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6858053580 0x7f6858055a40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f686400d000 tx=0x7f6864007b80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.010+0000 7f686bfff700 1 -- 172.21.15.12:0/1640839565 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f685c043670 con 0x7f68740b6580 2021-10-20T23:27:32.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6874057350 con 0x7f68740b6580 2021-10-20T23:27:32.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f686bfff700 1 -- 172.21.15.12:0/1640839565 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f685c023090 con 0x7f68740b6580 2021-10-20T23:27:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:32.191 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:27:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:27:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:27:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:27:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:27:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:27:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:27:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:27:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:27:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:27:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:27:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:27:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:27:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:27:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:27:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:27:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:27:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:27:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:27:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:27:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:27:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:27:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:27:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:27:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:27:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:27:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:27:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:27:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:27:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:27:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:27:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:27:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:27:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:27:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:27:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:27:32.230 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.230 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:27:32.230 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:27:32.230 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:32.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:32.231 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:27:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:27:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:27:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:27:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:32.233 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:32.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6858053580 msgr2=0x7f6858055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6858053580 0x7f6858055a40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f686400d000 tx=0x7f6864007b80).stop 2021-10-20T23:27:32.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68740b6580 msgr2=0x7f6874140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68740b6580 0x7f6874140f90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f685c002f70 tx=0x7f685c014000).stop 2021-10-20T23:27:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 shutdown_connections 2021-10-20T23:27:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6858053580 0x7f6858055a40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68740b6960 0x7f6874141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68740b6580 0x7f6874140f90 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 --2- 172.21.15.12:0/1640839565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68740b43c0 0x7f68740b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.182+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 >> 172.21.15.12:0/1640839565 conn(0x7f687405c490 msgr2=0x7f6874145040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.186+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 shutdown_connections 2021-10-20T23:27:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.186+0000 7f6878810700 1 -- 172.21.15.12:0/1640839565 wait complete. 2021-10-20T23:27:32.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:32.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.342+0000 7fd96961d700 1 Processor -- start 2021-10-20T23:27:32.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.342+0000 7fd96961d700 1 -- start start 2021-10-20T23:27:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd9640b4060 0x7fd964061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd964142e60 0x7fd9641432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640b5f50 con 0x7fd9640b6290 2021-10-20T23:27:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640b1f70 con 0x7fd9640b4060 2021-10-20T23:27:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640b2210 con 0x7fd964142e60 2021-10-20T23:27:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd9637fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd9640b4060 0x7fd964061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd9637fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd9640b4060 0x7fd964061b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42828/0 (socket says 172.21.15.12:42828) 2021-10-20T23:27:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd9637fe700 1 -- 172.21.15.12:0/2938509643 learned_addr learned my addr 172.21.15.12:0/2938509643 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd968e1c700 1 --2- 172.21.15.12:0/2938509643 >> v2:172.21.15.31:3300/0 conn(0x7fd964142e60 0x7fd9641432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd9637fe700 1 -- 172.21.15.12:0/2938509643 >> v2:172.21.15.31:3300/0 conn(0x7fd964142e60 msgr2=0x7fd9641432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd9637fe700 1 --2- 172.21.15.12:0/2938509643 >> v2:172.21.15.31:3300/0 conn(0x7fd964142e60 0x7fd9641432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd9637fe700 1 -- 172.21.15.12:0/2938509643 >> v1:172.21.15.31:6789/0 conn(0x7fd9640b6290 legacy=0x7fd964061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd9637fe700 1 -- 172.21.15.12:0/2938509643 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640b24b0 con 0x7fd9640b4060 2021-10-20T23:27:32.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd9637fe700 1 --2- 172.21.15.12:0/2938509643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 0x7fd964061b80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fd94c0032f0 tx=0x7fd94c009290).ready entity=mon.0 client_cookie=e4844742beb75d42 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd962ffd700 1 -- 172.21.15.12:0/2938509643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94c00b870 con 0x7fd9640b4060 2021-10-20T23:27:32.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd962ffd700 1 -- 172.21.15.12:0/2938509643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c00b9d0 con 0x7fd9640b4060 2021-10-20T23:27:32.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd962ffd700 1 -- 172.21.15.12:0/2938509643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94c00bb40 con 0x7fd9640b4060 2021-10-20T23:27:32.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 -- 172.21.15.12:0/2938509643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 msgr2=0x7fd964061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 --2- 172.21.15.12:0/2938509643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 0x7fd964061b80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fd94c0032f0 tx=0x7fd94c009290).stop 2021-10-20T23:27:32.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 -- 172.21.15.12:0/2938509643 shutdown_connections 2021-10-20T23:27:32.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 --2- 172.21.15.12:0/2938509643 >> v2:172.21.15.31:3300/0 conn(0x7fd964142e60 0x7fd9641432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 --2- 172.21.15.12:0/2938509643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 0x7fd964061b80 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 -- 172.21.15.12:0/2938509643 >> 172.21.15.12:0/2938509643 conn(0x7fd96405c490 msgr2=0x7fd96405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:32.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 -- 172.21.15.12:0/2938509643 shutdown_connections 2021-10-20T23:27:32.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.346+0000 7fd96961d700 1 -- 172.21.15.12:0/2938509643 wait complete. 2021-10-20T23:27:32.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd96961d700 1 Processor -- start 2021-10-20T23:27:32.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd96961d700 1 -- start start 2021-10-20T23:27:32.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd96961d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 0x7fd9640b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd96961d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640b6290 0x7fd964140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd96961d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964142e60 0x7fd96413d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd96961d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96413fef0 con 0x7fd9640b4060 2021-10-20T23:27:32.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd96961d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964146060 con 0x7fd964142e60 2021-10-20T23:27:32.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd96961d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd964146300 con 0x7fd9640b6290 2021-10-20T23:27:32.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd963fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 0x7fd9640b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd963fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 0x7fd9640b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42834/0 (socket says 172.21.15.12:42834) 2021-10-20T23:27:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd963fff700 1 -- 172.21.15.12:0/2182216725 learned_addr learned my addr 172.21.15.12:0/2182216725 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd968e1c700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964142e60 0x7fd96413d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.350+0000 7fd9637fe700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640b6290 0x7fd964140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd963fff700 1 -- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640b6290 msgr2=0x7fd964140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd963fff700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640b6290 0x7fd964140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd963fff700 1 -- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964142e60 msgr2=0x7fd96413d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd963fff700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964142e60 0x7fd96413d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd963fff700 1 -- 172.21.15.12:0/2182216725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c009530 con 0x7fd9640b4060 2021-10-20T23:27:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd9637fe700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640b6290 0x7fd964140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd963fff700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 0x7fd9640b4c90 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fd9640b2ad0 tx=0x7fd954007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd9617fa700 1 -- 172.21.15.12:0/2182216725 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd954007030 con 0x7fd9640b4060 2021-10-20T23:27:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd9617fa700 1 -- 172.21.15.12:0/2182216725 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954007190 con 0x7fd9640b4060 2021-10-20T23:27:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9641465a0 con 0x7fd9640b4060 2021-10-20T23:27:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd9617fa700 1 -- 172.21.15.12:0/2182216725 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd954006510 con 0x7fd9640b4060 2021-10-20T23:27:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd964150100 con 0x7fd9640b4060 2021-10-20T23:27:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96413dee0 con 0x7fd9640b4060 2021-10-20T23:27:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.354+0000 7fd9617fa700 1 -- 172.21.15.12:0/2182216725 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd95401b070 con 0x7fd9640b4060 2021-10-20T23:27:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.358+0000 7fd9617fa700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd93c053640 0x7fd93c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.358+0000 7fd9617fa700 1 -- 172.21.15.12:0/2182216725 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fd95406ab80 con 0x7fd9640b4060 2021-10-20T23:27:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.358+0000 7fd9637fe700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd93c053640 0x7fd93c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.358+0000 7fd9637fe700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd93c053640 0x7fd93c055b00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fd94c019000 tx=0x7fd94c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.362+0000 7fd9617fa700 1 -- 172.21.15.12:0/2182216725 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd954041ec0 con 0x7fd9640b4060 2021-10-20T23:27:32.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.490+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9640b5f50 con 0x7fd9640b4060 2021-10-20T23:27:32.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.490+0000 7fd9617fa700 1 -- 172.21.15.12:0/2182216725 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+13416 (secure 0 0 0) 0x7fd9640b5f50 con 0x7fd9640b4060 2021-10-20T23:27:32.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:32.500 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":108,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:31.800655+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:32.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd93c053640 msgr2=0x7fd93c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd93c053640 0x7fd93c055b00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fd94c019000 tx=0x7fd94c016000).stop 2021-10-20T23:27:32.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 msgr2=0x7fd9640b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 0x7fd9640b4c90 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fd9640b2ad0 tx=0x7fd954007c00).stop 2021-10-20T23:27:32.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 shutdown_connections 2021-10-20T23:27:32.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd93c053640 0x7fd93c055b00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964142e60 0x7fd96413d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640b6290 0x7fd964140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 --2- 172.21.15.12:0/2182216725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9640b4060 0x7fd9640b4c90 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 >> 172.21.15.12:0/2182216725 conn(0x7fd96405c490 msgr2=0x7fd9640b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:32.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 shutdown_connections 2021-10-20T23:27:32.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.494+0000 7fd96961d700 1 -- 172.21.15.12:0/2182216725 wait complete. 2021-10-20T23:27:32.515 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:27:32.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:27:32.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.618+0000 7fced6fec700 1 Processor -- start 2021-10-20T23:27:32.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.618+0000 7fced6fec700 1 -- start start 2021-10-20T23:27:32.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00b1ec0 0x7fced00b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fced00affb0 0x7fced00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced00b2790 con 0x7fced00a70c0 2021-10-20T23:27:32.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced00b03f0 con 0x7fced00affb0 2021-10-20T23:27:32.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00b0650 con 0x7fced00b1ec0 2021-10-20T23:27:32.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced5589700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fced00a70c0 0x7fced0141250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41440/0 (socket says 172.21.15.12:41440) 2021-10-20T23:27:32.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced5589700 1 -- 172.21.15.12:0/364634595 learned_addr learned my addr 172.21.15.12:0/364634595 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:32.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecffff700 1 --2- 172.21.15.12:0/364634595 >> v2:172.21.15.31:3300/0 conn(0x7fced00affb0 0x7fced00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced4d88700 1 --2- 172.21.15.12:0/364634595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00b1ec0 0x7fced00b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecf7fe700 1 -- 172.21.15.12:0/364634595 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974906328 0 0) 0x7fced00b2790 con 0x7fced00a70c0 2021-10-20T23:27:32.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecf7fe700 1 -- 172.21.15.12:0/364634595 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb0003260 con 0x7fced00a70c0 2021-10-20T23:27:32.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecffff700 1 -- 172.21.15.12:0/364634595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00b1ec0 msgr2=0x7fced00b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecffff700 1 --2- 172.21.15.12:0/364634595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00b1ec0 0x7fced00b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecffff700 1 -- 172.21.15.12:0/364634595 >> v1:172.21.15.12:6789/0 conn(0x7fced00a70c0 legacy=0x7fced0141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecf7fe700 1 -- 172.21.15.12:0/364634595 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1163553253 0 0) 0x7fceb0003260 con 0x7fced00a70c0 2021-10-20T23:27:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecffff700 1 -- 172.21.15.12:0/364634595 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00b08f0 con 0x7fced00affb0 2021-10-20T23:27:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecffff700 1 --2- 172.21.15.12:0/364634595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fced00affb0 0x7fced00b22a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fcec0002f70 tx=0x7fcec0006df0).ready entity=mon.1 client_cookie=daeaa168d86ed465 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecf7fe700 1 -- 172.21.15.12:0/364634595 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec000d4a0 con 0x7fced00affb0 2021-10-20T23:27:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecf7fe700 1 -- 172.21.15.12:0/364634595 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0000e90 con 0x7fced00affb0 2021-10-20T23:27:32.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fcecf7fe700 1 -- 172.21.15.12:0/364634595 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec000d7f0 con 0x7fced00affb0 2021-10-20T23:27:32.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 -- 172.21.15.12:0/364634595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fced00affb0 msgr2=0x7fced00b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 --2- 172.21.15.12:0/364634595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fced00affb0 0x7fced00b22a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fcec0002f70 tx=0x7fcec0006df0).stop 2021-10-20T23:27:32.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 -- 172.21.15.12:0/364634595 shutdown_connections 2021-10-20T23:27:32.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 --2- 172.21.15.12:0/364634595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fced00affb0 0x7fced00b22a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 --2- 172.21.15.12:0/364634595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00b1ec0 0x7fced00b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 -- 172.21.15.12:0/364634595 >> 172.21.15.12:0/364634595 conn(0x7fced005f6b0 msgr2=0x7fced005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 -- 172.21.15.12:0/364634595 shutdown_connections 2021-10-20T23:27:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.622+0000 7fced6fec700 1 -- 172.21.15.12:0/364634595 wait complete. 2021-10-20T23:27:32.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 Processor -- start 2021-10-20T23:27:32.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 -- start start 2021-10-20T23:27:32.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fced00a70c0 0x7fced00a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00affb0 0x7fced014a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fced00b1ec0 0x7fced014ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced014a030 con 0x7fced00a70c0 2021-10-20T23:27:32.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced0145ba0 con 0x7fced00b1ec0 2021-10-20T23:27:32.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00aaf80 con 0x7fced00affb0 2021-10-20T23:27:32.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced4d88700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fced00a70c0 0x7fced00a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced4d88700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fced00a70c0 0x7fced00a8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42848/0 (socket says 172.21.15.12:42848) 2021-10-20T23:27:32.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced4d88700 1 -- 172.21.15.12:0/176903767 learned_addr learned my addr 172.21.15.12:0/176903767 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:32.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fcecffff700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00affb0 0x7fced014a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced5589700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fced00b1ec0 0x7fced014ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced4d88700 1 -- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00affb0 msgr2=0x7fced014a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced4d88700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00affb0 0x7fced014a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced4d88700 1 -- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fced00b1ec0 msgr2=0x7fced014ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced4d88700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fced00b1ec0 0x7fced014ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced4d88700 1 -- 172.21.15.12:0/176903767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec000b180 con 0x7fced00a70c0 2021-10-20T23:27:32.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced4d88700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fced00a70c0 0x7fced00a8040 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fceb800c000 tx=0x7fceb8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fcecdffb700 1 -- 172.21.15.12:0/176903767 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb8011750 con 0x7fced00a70c0 2021-10-20T23:27:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fcecdffb700 1 -- 172.21.15.12:0/176903767 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb80118b0 con 0x7fced00a70c0 2021-10-20T23:27:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced014b6c0 con 0x7fced00a70c0 2021-10-20T23:27:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fcecdffb700 1 -- 172.21.15.12:0/176903767 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb8011c10 con 0x7fced00a70c0 2021-10-20T23:27:32.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.626+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced00a9910 con 0x7fced00a70c0 2021-10-20T23:27:32.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.630+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced00b0b90 con 0x7fced00a70c0 2021-10-20T23:27:32.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.630+0000 7fcecdffb700 1 -- 172.21.15.12:0/176903767 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fceb8011d70 con 0x7fced00a70c0 2021-10-20T23:27:32.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.630+0000 7fcecdffb700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fceb40534f0 0x7fceb40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.630+0000 7fcecdffb700 1 -- 172.21.15.12:0/176903767 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fceb806bd10 con 0x7fced00a70c0 2021-10-20T23:27:32.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.630+0000 7fcecffff700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fceb40534f0 0x7fceb40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.630+0000 7fcecffff700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fceb40534f0 0x7fceb40559b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fcec0018000 tx=0x7fcec0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.638+0000 7fcecdffb700 1 -- 172.21.15.12:0/176903767 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fceb8071020 con 0x7fced00a70c0 2021-10-20T23:27:32.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.758+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fced0057350 con 0x7fced00a70c0 2021-10-20T23:27:32.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.758+0000 7fcecdffb700 1 -- 172.21.15.12:0/176903767 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7fceb8042ec0 con 0x7fced00a70c0 2021-10-20T23:27:32.768 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:27:32.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fceb40534f0 msgr2=0x7fceb40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fceb40534f0 0x7fceb40559b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fcec0018000 tx=0x7fcec0014000).stop 2021-10-20T23:27:32.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fced00a70c0 msgr2=0x7fced00a8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fced00a70c0 0x7fced00a8040 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fceb800c000 tx=0x7fceb8006df0).stop 2021-10-20T23:27:32.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 shutdown_connections 2021-10-20T23:27:32.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fceb40534f0 0x7fceb40559b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fced00b1ec0 0x7fced014ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fced00affb0 0x7fced014a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 --2- 172.21.15.12:0/176903767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fced00a70c0 0x7fced00a8040 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 >> 172.21.15.12:0/176903767 conn(0x7fced005f6b0 msgr2=0x7fced0141020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:32.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 shutdown_connections 2021-10-20T23:27:32.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.762+0000 7fced6fec700 1 -- 172.21.15.12:0/176903767 wait complete. 2021-10-20T23:27:32.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:27:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.890+0000 7f23e5967700 1 Processor -- start 2021-10-20T23:27:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.890+0000 7f23e5967700 1 -- start start 2021-10-20T23:27:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23e00b30d0 0x7f23e0143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 0x7f23e013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e0143920 con 0x7f23e00b0710 2021-10-20T23:27:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e00b0af0 con 0x7f23e00b30d0 2021-10-20T23:27:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00ae680 con 0x7f23e00ace70 2021-10-20T23:27:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e4965700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f23e00b0710 0x7f23e0142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41450/0 (socket says 172.21.15.12:41450) 2021-10-20T23:27:32.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e4965700 1 -- 172.21.15.12:0/712642691 learned_addr learned my addr 172.21.15.12:0/712642691 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:32.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23dffff700 1 --2- 172.21.15.12:0/712642691 >> v2:172.21.15.31:3300/0 conn(0x7f23e00b30d0 0x7f23e0143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5166700 1 --2- 172.21.15.12:0/712642691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 0x7f23e013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23df7fe700 1 -- 172.21.15.12:0/712642691 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627662694 0 0) 0x7f23e0143920 con 0x7f23e00b0710 2021-10-20T23:27:32.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23df7fe700 1 -- 172.21.15.12:0/712642691 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c4003260 con 0x7f23e00b0710 2021-10-20T23:27:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23dffff700 1 -- 172.21.15.12:0/712642691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 msgr2=0x7f23e013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23dffff700 1 --2- 172.21.15.12:0/712642691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 0x7f23e013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23dffff700 1 -- 172.21.15.12:0/712642691 >> v1:172.21.15.12:6789/0 conn(0x7f23e00b0710 legacy=0x7f23e0142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23dffff700 1 -- 172.21.15.12:0/712642691 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e00ae920 con 0x7f23e00b30d0 2021-10-20T23:27:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23dffff700 1 --2- 172.21.15.12:0/712642691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b30d0 0x7f23e0143430 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f23cc002f70 tx=0x7f23cc006df0).ready entity=mon.1 client_cookie=3338d2666217fcf8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23df7fe700 1 -- 172.21.15.12:0/712642691 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc00d4a0 con 0x7f23e00b30d0 2021-10-20T23:27:32.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23df7fe700 1 -- 172.21.15.12:0/712642691 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc000e90 con 0x7f23e00b30d0 2021-10-20T23:27:32.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23df7fe700 1 -- 172.21.15.12:0/712642691 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc00d7f0 con 0x7f23e00b30d0 2021-10-20T23:27:32.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 -- 172.21.15.12:0/712642691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b30d0 msgr2=0x7f23e0143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 --2- 172.21.15.12:0/712642691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b30d0 0x7f23e0143430 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f23cc002f70 tx=0x7f23cc006df0).stop 2021-10-20T23:27:32.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 -- 172.21.15.12:0/712642691 shutdown_connections 2021-10-20T23:27:32.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 --2- 172.21.15.12:0/712642691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 0x7f23e013f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 --2- 172.21.15.12:0/712642691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b30d0 0x7f23e0143430 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 -- 172.21.15.12:0/712642691 >> 172.21.15.12:0/712642691 conn(0x7f23e0061140 msgr2=0x7f23e0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:32.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 -- 172.21.15.12:0/712642691 shutdown_connections 2021-10-20T23:27:32.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.894+0000 7f23e5967700 1 -- 172.21.15.12:0/712642691 wait complete. 2021-10-20T23:27:32.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 Processor -- start 2021-10-20T23:27:32.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 -- start start 2021-10-20T23:27:32.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 0x7f23e0066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23e00b0710 0x7f23e0066f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b30d0 0x7f23e0155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00ac910 con 0x7f23e00b0710 2021-10-20T23:27:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e013f5b0 con 0x7f23e00b30d0 2021-10-20T23:27:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e013f0b0 con 0x7f23e00ace70 2021-10-20T23:27:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23dffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23e00b0710 0x7f23e0066f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23dffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23e00b0710 0x7f23e0066f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42866/0 (socket says 172.21.15.12:42866) 2021-10-20T23:27:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23dffff700 1 -- 172.21.15.12:0/4029054146 learned_addr learned my addr 172.21.15.12:0/4029054146 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e4965700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 0x7f23e0066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5166700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b30d0 0x7f23e0155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23dffff700 1 -- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 msgr2=0x7f23e0066aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23dffff700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 0x7f23e0066aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23dffff700 1 -- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b30d0 msgr2=0x7f23e0155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23dffff700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b30d0 0x7f23e0155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23dffff700 1 -- 172.21.15.12:0/4029054146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc00b180 con 0x7f23e00b0710 2021-10-20T23:27:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23dffff700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23e00b0710 0x7f23e0066f90 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f23e01414a0 tx=0x7f23cc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23ddffb700 1 -- 172.21.15.12:0/4029054146 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc016070 con 0x7f23e00b0710 2021-10-20T23:27:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23ddffb700 1 -- 172.21.15.12:0/4029054146 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc0137d0 con 0x7f23e00b0710 2021-10-20T23:27:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e013f310 con 0x7f23e00b0710 2021-10-20T23:27:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23ddffb700 1 -- 172.21.15.12:0/4029054146 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc013b30 con 0x7f23e00b0710 2021-10-20T23:27:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.898+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e013fa20 con 0x7f23e00b0710 2021-10-20T23:27:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.902+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e0067620 con 0x7f23e00b0710 2021-10-20T23:27:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.902+0000 7f23ddffb700 1 -- 172.21.15.12:0/4029054146 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f23cc025030 con 0x7f23e00b0710 2021-10-20T23:27:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.902+0000 7f23ddffb700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23c0053580 0x7f23c0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.902+0000 7f23ddffb700 1 -- 172.21.15.12:0/4029054146 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f23cc06c700 con 0x7f23e00b0710 2021-10-20T23:27:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.902+0000 7f23e4965700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23c0053580 0x7f23c0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.902+0000 7f23e4965700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23c0053580 0x7f23c0055a40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f23d400d000 tx=0x7f23d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:32.910+0000 7f23ddffb700 1 -- 172.21.15.12:0/4029054146 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23cc043930 con 0x7f23e00b0710 2021-10-20T23:27:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.034+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23e0140a50 con 0x7f23e00b0710 2021-10-20T23:27:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23ddffb700 1 -- 172.21.15.12:0/4029054146 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23cc0230a0 con 0x7f23e00b0710 2021-10-20T23:27:33.049 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:33.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23c0053580 msgr2=0x7f23c0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23c0053580 0x7f23c0055a40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f23d400d000 tx=0x7f23d4009040).stop 2021-10-20T23:27:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23e00b0710 msgr2=0x7f23e0066f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23e00b0710 0x7f23e0066f90 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f23e01414a0 tx=0x7f23cc014000).stop 2021-10-20T23:27:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 shutdown_connections 2021-10-20T23:27:33.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f23c0053580 0x7f23c0055a40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b30d0 0x7f23e0155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23e00b0710 0x7f23e0066f90 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 --2- 172.21.15.12:0/4029054146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23e00ace70 0x7f23e0066aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 >> 172.21.15.12:0/4029054146 conn(0x7f23e0061140 msgr2=0x7f23e0139230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:33.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 shutdown_connections 2021-10-20T23:27:33.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.038+0000 7f23e5967700 1 -- 172.21.15.12:0/4029054146 wait complete. 2021-10-20T23:27:33.058 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:27:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.154+0000 7f8af3fff700 1 Processor -- start 2021-10-20T23:27:33.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.154+0000 7f8af3fff700 1 -- start start 2021-10-20T23:27:33.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.154+0000 7f8af3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8af40b2580 0x7f8af414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.154+0000 7f8af3fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af40a70c0 con 0x7f8af40a8ac0 2021-10-20T23:27:33.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.154+0000 7f8af3fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af40a72f0 con 0x7f8af40b0010 2021-10-20T23:27:33.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.154+0000 7f8af3fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af40a7590 con 0x7f8af40b2580 2021-10-20T23:27:33.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.154+0000 7f8af37fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8af40a8ac0 0x7f8af4151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41468/0 (socket says 172.21.15.12:41468) 2021-10-20T23:27:33.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.154+0000 7f8af37fe700 1 -- 172.21.15.12:0/3444618338 learned_addr learned my addr 172.21.15.12:0/3444618338 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:33.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.154+0000 7f8af2ffd700 1 --2- 172.21.15.12:0/3444618338 >> v2:172.21.15.12:3300/0 conn(0x7f8af40b2580 0x7f8af414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af2ffd700 1 -- 172.21.15.12:0/3444618338 >> v1:172.21.15.31:6789/0 conn(0x7f8af40b0010 legacy=0x7f8af40a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af2ffd700 1 -- 172.21.15.12:0/3444618338 >> v1:172.21.15.12:6789/0 conn(0x7f8af40a8ac0 legacy=0x7f8af4151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af1ffb700 1 -- 172.21.15.12:0/3444618338 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482365132 0 0) 0x7f8af40a70c0 con 0x7f8af40a8ac0 2021-10-20T23:27:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af2ffd700 1 -- 172.21.15.12:0/3444618338 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40a7830 con 0x7f8af40b2580 2021-10-20T23:27:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af2ffd700 1 --2- 172.21.15.12:0/3444618338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b2580 0x7f8af414ae40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f8ae8002f70 tx=0x7f8ae8006df0).ready entity=mon.0 client_cookie=86035671f235a7f6 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af1ffb700 1 -- 172.21.15.12:0/3444618338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae800d610 con 0x7f8af40b2580 2021-10-20T23:27:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af1ffb700 1 -- 172.21.15.12:0/3444618338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae8000e90 con 0x7f8af40b2580 2021-10-20T23:27:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af1ffb700 1 -- 172.21.15.12:0/3444618338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae800d960 con 0x7f8af40b2580 2021-10-20T23:27:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af3fff700 1 -- 172.21.15.12:0/3444618338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b2580 msgr2=0x7f8af414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af3fff700 1 --2- 172.21.15.12:0/3444618338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b2580 0x7f8af414ae40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f8ae8002f70 tx=0x7f8ae8006df0).stop 2021-10-20T23:27:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af3fff700 1 -- 172.21.15.12:0/3444618338 shutdown_connections 2021-10-20T23:27:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af3fff700 1 --2- 172.21.15.12:0/3444618338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b2580 0x7f8af414ae40 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af3fff700 1 -- 172.21.15.12:0/3444618338 >> 172.21.15.12:0/3444618338 conn(0x7f8af4060180 msgr2=0x7f8af40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:33.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af3fff700 1 -- 172.21.15.12:0/3444618338 shutdown_connections 2021-10-20T23:27:33.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af3fff700 1 -- 172.21.15.12:0/3444618338 wait complete. 2021-10-20T23:27:33.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af3fff700 1 Processor -- start 2021-10-20T23:27:33.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.158+0000 7f8af3fff700 1 -- start start 2021-10-20T23:27:33.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af40a8ac0 0x7f8af40ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b0010 0x7f8af4156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8af40b2580 0x7f8af4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4064770 con 0x7f8af40b0010 2021-10-20T23:27:33.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af3fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40aab30 con 0x7f8af40a8ac0 2021-10-20T23:27:33.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40a9df0 con 0x7f8af40b2580 2021-10-20T23:27:33.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b0010 0x7f8af4156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b0010 0x7f8af4156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42876/0 (socket says 172.21.15.12:42876) 2021-10-20T23:27:33.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af27fc700 1 -- 172.21.15.12:0/1839521399 learned_addr learned my addr 172.21.15.12:0/1839521399 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:33.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af2ffd700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af40a8ac0 0x7f8af40ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af37fe700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8af40b2580 0x7f8af4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af27fc700 1 -- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8af40b2580 msgr2=0x7f8af4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af27fc700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8af40b2580 0x7f8af4156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af27fc700 1 -- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af40a8ac0 msgr2=0x7f8af40ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af27fc700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af40a8ac0 0x7f8af40ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af27fc700 1 -- 172.21.15.12:0/1839521399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae800b180 con 0x7f8af40b0010 2021-10-20T23:27:33.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af37fe700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8af40b2580 0x7f8af4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:33.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af2ffd700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af40a8ac0 0x7f8af40ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:33.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af27fc700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b0010 0x7f8af4156670 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f8af4061a80 tx=0x7f8ae4007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:33.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8ae3fff700 1 -- 172.21.15.12:0/1839521399 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae400e4a0 con 0x7f8af40b0010 2021-10-20T23:27:33.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8ae3fff700 1 -- 172.21.15.12:0/1839521399 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae400e600 con 0x7f8af40b0010 2021-10-20T23:27:33.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af40aa090 con 0x7f8af40b0010 2021-10-20T23:27:33.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8ae3fff700 1 -- 172.21.15.12:0/1839521399 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae400e960 con 0x7f8af40b0010 2021-10-20T23:27:33.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af40a92d0 con 0x7f8af40b0010 2021-10-20T23:27:33.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.162+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af40ab150 con 0x7f8af40b0010 2021-10-20T23:27:33.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.166+0000 7f8ae3fff700 1 -- 172.21.15.12:0/1839521399 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8ae4019030 con 0x7f8af40b0010 2021-10-20T23:27:33.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.166+0000 7f8ae3fff700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ad00536a0 0x7f8ad0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.166+0000 7f8ae3fff700 1 -- 172.21.15.12:0/1839521399 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f8ae406b0b0 con 0x7f8af40b0010 2021-10-20T23:27:33.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.166+0000 7f8af2ffd700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ad00536a0 0x7f8ad0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.166+0000 7f8af2ffd700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ad00536a0 0x7f8ad0055b60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f8ae801a000 tx=0x7f8ae8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:33.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.170+0000 7f8ae3fff700 1 -- 172.21.15.12:0/1839521399 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8ae4042260 con 0x7f8af40b0010 2021-10-20T23:27:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.298+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8af4057350 con 0x7f8af40b0010 2021-10-20T23:27:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.298+0000 7f8ae3fff700 1 -- 172.21.15.12:0/1839521399 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v108) v1 ==== 84+0+143 (secure 0 0 0) 0x7f8ae4045880 con 0x7f8af40b0010 2021-10-20T23:27:33.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:33.309 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:27:33.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:33.310 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:27:33.310 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:27:33.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:33.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:33.311 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:27:33.311 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:27:33.311 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:33.312 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:27:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ad00536a0 msgr2=0x7f8ad0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ad00536a0 0x7f8ad0055b60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f8ae801a000 tx=0x7f8ae8015000).stop 2021-10-20T23:27:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b0010 msgr2=0x7f8af4156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b0010 0x7f8af4156670 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f8af4061a80 tx=0x7f8ae4007f70).stop 2021-10-20T23:27:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 shutdown_connections 2021-10-20T23:27:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8ad00536a0 0x7f8ad0055b60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8af40b2580 0x7f8af4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8af40b0010 0x7f8af4156670 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 --2- 172.21.15.12:0/1839521399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af40a8ac0 0x7f8af40ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 >> 172.21.15.12:0/1839521399 conn(0x7f8af4060180 msgr2=0x7f8af40b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:33.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 shutdown_connections 2021-10-20T23:27:33.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.302+0000 7f8af3fff700 1 -- 172.21.15.12:0/1839521399 wait complete. 2021-10-20T23:27:33.326 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:27:33.327 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:27:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04d49f2700 1 Processor -- start 2021-10-20T23:27:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04d49f2700 1 -- start start 2021-10-20T23:27:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04d49f2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04d005fc00 0x7f04d00b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04d49f2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04d00b6560 0x7f04d00b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04d49f2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d0143f60 con 0x7f04d00b5990 2021-10-20T23:27:33.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04d49f2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d005ffe0 con 0x7f04d00b6560 2021-10-20T23:27:33.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04d49f2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d0143a50 con 0x7f04d005fc00 2021-10-20T23:27:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cdd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04d00b6560 0x7f04d00b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cdd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04d00b6560 0x7f04d00b9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42886/0 (socket says 172.21.15.12:42886) 2021-10-20T23:27:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cdd9b700 1 -- 172.21.15.12:0/3328150872 learned_addr learned my addr 172.21.15.12:0/3328150872 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04ce59c700 1 --2- 172.21.15.12:0/3328150872 >> v2:172.21.15.31:3300/0 conn(0x7f04d005fc00 0x7f04d00b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04ced9d700 1 --1- 172.21.15.12:0/3328150872 >> v1:172.21.15.12:6789/0 conn(0x7f04d00b5990 0x7f04d00b4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41482/0 (socket says 172.21.15.12:41482) 2021-10-20T23:27:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cdd9b700 1 -- 172.21.15.12:0/3328150872 >> v2:172.21.15.31:3300/0 conn(0x7f04d005fc00 msgr2=0x7f04d00b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cdd9b700 1 --2- 172.21.15.12:0/3328150872 >> v2:172.21.15.31:3300/0 conn(0x7f04d005fc00 0x7f04d00b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cdd9b700 1 -- 172.21.15.12:0/3328150872 >> v1:172.21.15.12:6789/0 conn(0x7f04d00b5990 legacy=0x7f04d00b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cd59a700 1 -- 172.21.15.12:0/3328150872 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660872581 0 0) 0x7f04d0143f60 con 0x7f04d00b5990 2021-10-20T23:27:33.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cdd9b700 1 -- 172.21.15.12:0/3328150872 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d0143cc0 con 0x7f04d00b6560 2021-10-20T23:27:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cdd9b700 1 --2- 172.21.15.12:0/3328150872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d00b6560 0x7f04d00b9fa0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f04c4002f70 tx=0x7f04c4006eb0).ready entity=mon.0 client_cookie=f912e17528d81e17 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cd59a700 1 -- 172.21.15.12:0/3328150872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c400d5c0 con 0x7f04d00b6560 2021-10-20T23:27:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cd59a700 1 -- 172.21.15.12:0/3328150872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c4000e90 con 0x7f04d00b6560 2021-10-20T23:27:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.426+0000 7f04cd59a700 1 -- 172.21.15.12:0/3328150872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c400d910 con 0x7f04d00b6560 2021-10-20T23:27:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 -- 172.21.15.12:0/3328150872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d00b6560 msgr2=0x7f04d00b9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 --2- 172.21.15.12:0/3328150872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d00b6560 0x7f04d00b9fa0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f04c4002f70 tx=0x7f04c4006eb0).stop 2021-10-20T23:27:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 -- 172.21.15.12:0/3328150872 shutdown_connections 2021-10-20T23:27:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 --2- 172.21.15.12:0/3328150872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d00b6560 0x7f04d00b9fa0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 --2- 172.21.15.12:0/3328150872 >> v2:172.21.15.31:3300/0 conn(0x7f04d005fc00 0x7f04d00b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 -- 172.21.15.12:0/3328150872 >> 172.21.15.12:0/3328150872 conn(0x7f04d00623a0 msgr2=0x7f04d0066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:33.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 -- 172.21.15.12:0/3328150872 shutdown_connections 2021-10-20T23:27:33.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 -- 172.21.15.12:0/3328150872 wait complete. 2021-10-20T23:27:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 Processor -- start 2021-10-20T23:27:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 -- start start 2021-10-20T23:27:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d005fc00 0x7f04d014f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b5990 0x7f04d014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d00b6560 0x7f04d012d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00adaf0 con 0x7f04d00b6560 2021-10-20T23:27:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00ad620 con 0x7f04d00b5990 2021-10-20T23:27:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.430+0000 7f04d49f2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d01530e0 con 0x7f04d005fc00 2021-10-20T23:27:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04ced9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d00b6560 0x7f04d012d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04ce59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d005fc00 0x7f04d014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04cdd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b5990 0x7f04d014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04cdd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b5990 0x7f04d014fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:57866/0 (socket says 172.21.15.12:57866) 2021-10-20T23:27:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04cdd9b700 1 -- 172.21.15.12:0/3811425824 learned_addr learned my addr 172.21.15.12:0/3811425824 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04cdd9b700 1 -- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d005fc00 msgr2=0x7f04d014f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04cdd9b700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d005fc00 0x7f04d014f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04cdd9b700 1 -- 172.21.15.12:0/3811425824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d00b6560 msgr2=0x7f04d012d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04cdd9b700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d00b6560 0x7f04d012d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04cdd9b700 1 -- 172.21.15.12:0/3811425824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c400b1e0 con 0x7f04d00b5990 2021-10-20T23:27:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04cdd9b700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b5990 0x7f04d014fb50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f04d00ae3d0 tx=0x7f04c4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04bf7fe700 1 -- 172.21.15.12:0/3811425824 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c4006b40 con 0x7f04d00b5990 2021-10-20T23:27:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04bf7fe700 1 -- 172.21.15.12:0/3811425824 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400de40 con 0x7f04d00b5990 2021-10-20T23:27:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d0152e70 con 0x7f04d00b5990 2021-10-20T23:27:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04bf7fe700 1 -- 172.21.15.12:0/3811425824 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c4011da0 con 0x7f04d00b5990 2021-10-20T23:27:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d01463f0 con 0x7f04d00b5990 2021-10-20T23:27:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d00b9860 con 0x7f04d00b5990 2021-10-20T23:27:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.434+0000 7f04bf7fe700 1 -- 172.21.15.12:0/3811425824 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f04c4025030 con 0x7f04d00b5990 2021-10-20T23:27:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.438+0000 7f04bf7fe700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04ac053580 0x7f04ac055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.438+0000 7f04bf7fe700 1 -- 172.21.15.12:0/3811425824 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f04c406c800 con 0x7f04d00b5990 2021-10-20T23:27:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.438+0000 7f04ce59c700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04ac053580 0x7f04ac055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.438+0000 7f04ce59c700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04ac053580 0x7f04ac055a40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f04c000b000 tx=0x7f04c0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.446+0000 7f04bf7fe700 1 -- 172.21.15.12:0/3811425824 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04c4043b40 con 0x7f04d00b5990 2021-10-20T23:27:33.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:33.574+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f04d0057350 con 0x7f04d00b5990 2021-10-20T23:27:34.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.082+0000 7f04bf7fe700 1 -- 172.21.15.12:0/3811425824 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v109) v1 ==== 133+0+0 (secure 0 0 0) 0x7f04c4023070 con 0x7f04d00b5990 2021-10-20T23:27:34.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04ac053580 msgr2=0x7f04ac055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:34.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04ac053580 0x7f04ac055a40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f04c000b000 tx=0x7f04c0006df0).stop 2021-10-20T23:27:34.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b5990 msgr2=0x7f04d014fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:34.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b5990 0x7f04d014fb50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f04d00ae3d0 tx=0x7f04c4015000).stop 2021-10-20T23:27:34.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 shutdown_connections 2021-10-20T23:27:34.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f04ac053580 0x7f04ac055a40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04d00b6560 0x7f04d012d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b5990 0x7f04d014fb50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 --2- 172.21.15.12:0/3811425824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04d005fc00 0x7f04d014f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 >> 172.21.15.12:0/3811425824 conn(0x7f04d00623a0 msgr2=0x7f04d00b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 shutdown_connections 2021-10-20T23:27:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.086+0000 7f04d49f2700 1 -- 172.21.15.12:0/3811425824 wait complete. 2021-10-20T23:27:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:27:34.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:27:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.226+0000 7f6cc6f4b700 1 Processor -- start 2021-10-20T23:27:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.226+0000 7f6cc6f4b700 1 -- start start 2021-10-20T23:27:34.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.226+0000 7f6cc6f4b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6cc005ff60 0x7f6cc0140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:34.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc6f4b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc0064910 con 0x7f6cc00611d0 2021-10-20T23:27:34.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc6f4b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc0064bb0 con 0x7f6cc00b2710 2021-10-20T23:27:34.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc6f4b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc0064e50 con 0x7f6cc005ff60 2021-10-20T23:27:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc54e8700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6cc00611d0 0x7f6cc0143820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41496/0 (socket says 172.21.15.12:41496) 2021-10-20T23:27:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc54e8700 1 -- 172.21.15.12:0/2323363136 learned_addr learned my addr 172.21.15.12:0/2323363136 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc4ce7700 1 --2- 172.21.15.12:0/2323363136 >> v2:172.21.15.31:3300/0 conn(0x7f6cc005ff60 0x7f6cc0140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010500692 0 0) 0x7f6cc0064910 con 0x7f6cc00611d0 2021-10-20T23:27:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca0003260 con 0x7f6cc00611d0 2021-10-20T23:27:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163493992 0 0) 0x7f6cc0064bb0 con 0x7f6cc00b2710 2021-10-20T23:27:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cc0064910 con 0x7f6cc00b2710 2021-10-20T23:27:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3958461091 0 0) 0x7f6ca0003260 con 0x7f6cc00611d0 2021-10-20T23:27:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 >> v2:172.21.15.31:3300/0 conn(0x7f6cc005ff60 msgr2=0x7f6cc0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:34.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 --2- 172.21.15.12:0/2323363136 >> v2:172.21.15.31:3300/0 conn(0x7f6cc005ff60 0x7f6cc0140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 >> v1:172.21.15.31:6789/0 conn(0x7f6cc00b2710 legacy=0x7f6cc0143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:34.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc00650f0 con 0x7f6cc00611d0 2021-10-20T23:27:34.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f6cb80019e0 con 0x7f6cc00611d0 2021-10-20T23:27:34.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 >> v1:172.21.15.12:6789/0 conn(0x7f6cc00611d0 legacy=0x7f6cc0143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:34.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00038e0 0x7f6ca0003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:34.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ca0004500 0x7f6ca0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:34.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ca0004e70 0x7f6ca000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:34.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc0064e50 con 0x7f6ca00038e0 2021-10-20T23:27:34.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca000bcf0 con 0x7f6ca0004500 2021-10-20T23:27:34.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca000beb0 con 0x7f6ca0004e70 2021-10-20T23:27:34.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc4ce7700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00038e0 0x7f6ca0003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:34.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbffff700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ca0004500 0x7f6ca0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:34.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc54e8700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ca0004e70 0x7f6ca000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc4ce7700 1 -- 172.21.15.12:0/2323363136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ca0004e70 msgr2=0x7f6ca000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc4ce7700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ca0004e70 0x7f6ca000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc4ce7700 1 -- 172.21.15.12:0/2323363136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ca0004500 msgr2=0x7f6ca0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc4ce7700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ca0004500 0x7f6ca0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc54e8700 1 -- 172.21.15.12:0/2323363136 reap_dead start 2021-10-20T23:27:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc4ce7700 1 -- 172.21.15.12:0/2323363136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0003260 con 0x7f6ca00038e0 2021-10-20T23:27:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbffff700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ca0004500 0x7f6ca0004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cc4ce7700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00038e0 0x7f6ca0003ce0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f6ca800c000 tx=0x7f6ca8006df0).ready entity=mon.0 client_cookie=be000ce4f29fb947 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca800e800 con 0x7f6ca00038e0 2021-10-20T23:27:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800e960 con 0x7f6ca00038e0 2021-10-20T23:27:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.230+0000 7f6cbf7fe700 1 -- 172.21.15.12:0/2323363136 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca800ecc0 con 0x7f6ca00038e0 2021-10-20T23:27:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.234+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/2323363136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00038e0 msgr2=0x7f6ca0003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.234+0000 7f6cc6f4b700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00038e0 0x7f6ca0003ce0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f6ca800c000 tx=0x7f6ca8006df0).stop 2021-10-20T23:27:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.234+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/2323363136 shutdown_connections 2021-10-20T23:27:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.234+0000 7f6cc6f4b700 1 --2- 172.21.15.12:0/2323363136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca00038e0 0x7f6ca0003ce0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.234+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/2323363136 >> 172.21.15.12:0/2323363136 conn(0x7f6cc005cf60 msgr2=0x7f6cc005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.234+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/2323363136 shutdown_connections 2021-10-20T23:27:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.234+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/2323363136 wait complete. 2021-10-20T23:27:34.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.234+0000 7f6cc6f4b700 1 Processor -- start 2021-10-20T23:27:34.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.234+0000 7f6cc6f4b700 1 -- start start 2021-10-20T23:27:34.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc6f4b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ca00038e0 0x7f6cc00adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:34.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc6f4b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc00b5300 0x7f6cc013eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:34.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc6f4b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc013efe0 0x7f6cc00b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:34.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc6f4b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00ab530 con 0x7f6cc00b5300 2021-10-20T23:27:34.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc6f4b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00ab7d0 con 0x7f6cc013efe0 2021-10-20T23:27:34.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc6f4b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc0142830 con 0x7f6ca00038e0 2021-10-20T23:27:34.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cbffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc00b5300 0x7f6cc013eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:34.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cbffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc00b5300 0x7f6cc013eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42912/0 (socket says 172.21.15.12:42912) 2021-10-20T23:27:34.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc54e8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc013efe0 0x7f6cc00b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:34.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cbffff700 1 -- 172.21.15.12:0/3096955229 learned_addr learned my addr 172.21.15.12:0/3096955229 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:34.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc4ce7700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ca00038e0 0x7f6cc00adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:34.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc54e8700 1 -- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ca00038e0 msgr2=0x7f6cc00adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:34.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc54e8700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ca00038e0 0x7f6cc00adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc54e8700 1 -- 172.21.15.12:0/3096955229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc00b5300 msgr2=0x7f6cc013eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:34.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc54e8700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc00b5300 0x7f6cc013eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:34.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc54e8700 1 -- 172.21.15.12:0/3096955229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc00ad870 con 0x7f6cc013efe0 2021-10-20T23:27:34.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cbffff700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc00b5300 0x7f6cc013eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:34.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc54e8700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc013efe0 0x7f6cc00b62c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f6cb8000b60 tx=0x7f6cb8002130).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:34.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cbdffb700 1 -- 172.21.15.12:0/3096955229 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cb800f820 con 0x7f6cc013efe0 2021-10-20T23:27:34.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cbdffb700 1 -- 172.21.15.12:0/3096955229 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb800f980 con 0x7f6cc013efe0 2021-10-20T23:27:34.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc00b5780 con 0x7f6cc013efe0 2021-10-20T23:27:34.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cbdffb700 1 -- 172.21.15.12:0/3096955229 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cb800fce0 con 0x7f6cc013efe0 2021-10-20T23:27:34.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.238+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc0142e70 con 0x7f6cc013efe0 2021-10-20T23:27:34.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.242+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc01429f0 con 0x7f6cc013efe0 2021-10-20T23:27:34.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.242+0000 7f6cbdffb700 1 -- 172.21.15.12:0/3096955229 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6cb801c360 con 0x7f6cc013efe0 2021-10-20T23:27:34.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.242+0000 7f6cbdffb700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ca4053580 0x7f6ca4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:34.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.242+0000 7f6cbdffb700 1 -- 172.21.15.12:0/3096955229 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f6cb806b580 con 0x7f6cc013efe0 2021-10-20T23:27:34.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.242+0000 7f6cc4ce7700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ca4053580 0x7f6ca4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:34.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.242+0000 7f6cc4ce7700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ca4053580 0x7f6ca4055a40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f6ca800c000 tx=0x7f6ca8019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:34.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.250+0000 7f6cbdffb700 1 -- 172.21.15.12:0/3096955229 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6cb8042560 con 0x7f6cc013efe0 2021-10-20T23:27:34.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:34.382+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6cc0060340 con 0x7f6cc013efe0 2021-10-20T23:27:35.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.094+0000 7f6cbdffb700 1 -- 172.21.15.12:0/3096955229 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v110) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6cb8019020 con 0x7f6cc013efe0 2021-10-20T23:27:35.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ca4053580 msgr2=0x7f6ca4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ca4053580 0x7f6ca4055a40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f6ca800c000 tx=0x7f6ca8019000).stop 2021-10-20T23:27:35.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc013efe0 msgr2=0x7f6cc00b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc013efe0 0x7f6cc00b62c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f6cb8000b60 tx=0x7f6cb8002130).stop 2021-10-20T23:27:35.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 shutdown_connections 2021-10-20T23:27:35.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6ca4053580 0x7f6ca4055a40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc013efe0 0x7f6cc00b62c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc00b5300 0x7f6cc013eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 --2- 172.21.15.12:0/3096955229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ca00038e0 0x7f6cc00adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 >> 172.21.15.12:0/3096955229 conn(0x7f6cc005cf60 msgr2=0x7f6cc0143630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:35.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 shutdown_connections 2021-10-20T23:27:35.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.102+0000 7f6cc6f4b700 1 -- 172.21.15.12:0/3096955229 wait complete. 2021-10-20T23:27:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:27:35.125 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:27:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.230+0000 7fae27fff700 1 Processor -- start 2021-10-20T23:27:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.230+0000 7fae27fff700 1 -- start start 2021-10-20T23:27:35.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae280ad5c0 0x7fae28061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 0x7fae281408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae280aecf0 con 0x7fae28061320 2021-10-20T23:27:35.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae280b6f20 con 0x7fae280ad5c0 2021-10-20T23:27:35.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae280aef20 con 0x7fae28140440 2021-10-20T23:27:35.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae26ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae28061320 0x7fae280b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41512/0 (socket says 172.21.15.12:41512) 2021-10-20T23:27:35.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae26ffd700 1 -- 172.21.15.12:0/1705946460 learned_addr learned my addr 172.21.15.12:0/1705946460 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:35.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae267fc700 1 --2- 172.21.15.12:0/1705946460 >> v2:172.21.15.31:3300/0 conn(0x7fae280ad5c0 0x7fae28061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae277fe700 1 --2- 172.21.15.12:0/1705946460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 0x7fae281408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae25ffb700 1 -- 172.21.15.12:0/1705946460 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939048450 0 0) 0x7fae280aecf0 con 0x7fae28061320 2021-10-20T23:27:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae25ffb700 1 -- 172.21.15.12:0/1705946460 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae08003260 con 0x7fae28061320 2021-10-20T23:27:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae277fe700 1 -- 172.21.15.12:0/1705946460 >> v2:172.21.15.31:3300/0 conn(0x7fae280ad5c0 msgr2=0x7fae28061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae277fe700 1 --2- 172.21.15.12:0/1705946460 >> v2:172.21.15.31:3300/0 conn(0x7fae280ad5c0 0x7fae28061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae277fe700 1 -- 172.21.15.12:0/1705946460 >> v1:172.21.15.12:6789/0 conn(0x7fae28061320 legacy=0x7fae280b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae277fe700 1 -- 172.21.15.12:0/1705946460 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae280af1c0 con 0x7fae28140440 2021-10-20T23:27:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae277fe700 1 --2- 172.21.15.12:0/1705946460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 0x7fae281408f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fae200032f0 tx=0x7fae200091d0).ready entity=mon.2 client_cookie=2cdf605346df0f9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae25ffb700 1 -- 172.21.15.12:0/1705946460 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2000b600 con 0x7fae28140440 2021-10-20T23:27:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae25ffb700 1 -- 172.21.15.12:0/1705946460 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2000b760 con 0x7fae28140440 2021-10-20T23:27:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae25ffb700 1 -- 172.21.15.12:0/1705946460 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2000b8d0 con 0x7fae28140440 2021-10-20T23:27:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 -- 172.21.15.12:0/1705946460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 msgr2=0x7fae281408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 --2- 172.21.15.12:0/1705946460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 0x7fae281408f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fae200032f0 tx=0x7fae200091d0).stop 2021-10-20T23:27:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 -- 172.21.15.12:0/1705946460 shutdown_connections 2021-10-20T23:27:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 --2- 172.21.15.12:0/1705946460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 0x7fae281408f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 --2- 172.21.15.12:0/1705946460 >> v2:172.21.15.31:3300/0 conn(0x7fae280ad5c0 0x7fae28061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 -- 172.21.15.12:0/1705946460 >> 172.21.15.12:0/1705946460 conn(0x7fae28066de0 msgr2=0x7fae280671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 -- 172.21.15.12:0/1705946460 shutdown_connections 2021-10-20T23:27:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.234+0000 7fae27fff700 1 -- 172.21.15.12:0/1705946460 wait complete. 2021-10-20T23:27:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae27fff700 1 Processor -- start 2021-10-20T23:27:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae27fff700 1 -- start start 2021-10-20T23:27:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae27fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae28061320 0x7fae28142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae27fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae280ad5c0 0x7fae2813f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae27fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 0x7fae2813fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae27fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae281402d0 con 0x7fae280ad5c0 2021-10-20T23:27:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae27fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae280b1500 con 0x7fae28061320 2021-10-20T23:27:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae27fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae28145f80 con 0x7fae28140440 2021-10-20T23:27:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae267fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae280ad5c0 0x7fae2813f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae26ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae28061320 0x7fae28142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae26ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae28061320 0x7fae28142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:57898/0 (socket says 172.21.15.12:57898) 2021-10-20T23:27:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae26ffd700 1 -- 172.21.15.12:0/2671722675 learned_addr learned my addr 172.21.15.12:0/2671722675 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae267fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae280ad5c0 0x7fae2813f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42928/0 (socket says 172.21.15.12:42928) 2021-10-20T23:27:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae277fe700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 0x7fae2813fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae26ffd700 1 -- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 msgr2=0x7fae2813fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae26ffd700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 0x7fae2813fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae26ffd700 1 -- 172.21.15.12:0/2671722675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae280ad5c0 msgr2=0x7fae2813f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae26ffd700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae280ad5c0 0x7fae2813f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.238+0000 7fae26ffd700 1 -- 172.21.15.12:0/2671722675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae20009470 con 0x7fae28061320 2021-10-20T23:27:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae26ffd700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae28061320 0x7fae28142140 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fae10001110 tx=0x7fae10007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae1ffff700 1 -- 172.21.15.12:0/2671722675 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae100070d0 con 0x7fae28061320 2021-10-20T23:27:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae1ffff700 1 -- 172.21.15.12:0/2671722675 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae10007230 con 0x7fae28061320 2021-10-20T23:27:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae280aa770 con 0x7fae28061320 2021-10-20T23:27:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae1ffff700 1 -- 172.21.15.12:0/2671722675 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae10005610 con 0x7fae28061320 2021-10-20T23:27:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae28142b80 con 0x7fae28061320 2021-10-20T23:27:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae280aadb0 con 0x7fae28061320 2021-10-20T23:27:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae1ffff700 1 -- 172.21.15.12:0/2671722675 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fae10010070 con 0x7fae28061320 2021-10-20T23:27:35.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae1ffff700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae0c053580 0x7fae0c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae1ffff700 1 -- 172.21.15.12:0/2671722675 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fae1006b750 con 0x7fae28061320 2021-10-20T23:27:35.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.242+0000 7fae267fc700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae0c053580 0x7fae0c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.246+0000 7fae267fc700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae0c053580 0x7fae0c055a40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fae1800b000 tx=0x7fae18006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:35.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.250+0000 7fae1ffff700 1 -- 172.21.15.12:0/2671722675 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae10042770 con 0x7fae28061320 2021-10-20T23:27:35.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.414+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fae280a9e10 con 0x7fae28061320 2021-10-20T23:27:35.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.426+0000 7fae1ffff700 1 -- 172.21.15.12:0/2671722675 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v53) v1 ==== 189+0+0 (secure 0 0 0) 0x7fae10018070 con 0x7fae28061320 2021-10-20T23:27:35.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae0c053580 msgr2=0x7fae0c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae0c053580 0x7fae0c055a40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fae1800b000 tx=0x7fae18006df0).stop 2021-10-20T23:27:35.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae28061320 msgr2=0x7fae28142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae28061320 0x7fae28142140 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fae10001110 tx=0x7fae10007aa0).stop 2021-10-20T23:27:35.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 shutdown_connections 2021-10-20T23:27:35.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae0c053580 0x7fae0c055a40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae28140440 0x7fae2813fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae280ad5c0 0x7fae2813f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 --2- 172.21.15.12:0/2671722675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae28061320 0x7fae28142140 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 >> 172.21.15.12:0/2671722675 conn(0x7fae28066de0 msgr2=0x7fae280671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:35.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 shutdown_connections 2021-10-20T23:27:35.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.434+0000 7fae27fff700 1 -- 172.21.15.12:0/2671722675 wait complete. 2021-10-20T23:27:35.450 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 19 and data pool 20 2021-10-20T23:27:35.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:35.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 Processor -- start 2021-10-20T23:27:35.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 -- start start 2021-10-20T23:27:35.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5b0061320 0x7fb5b0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00aecf0 con 0x7fb5b00ad5c0 2021-10-20T23:27:35.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00b6f20 con 0x7fb5b0140440 2021-10-20T23:27:35.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b00aef20 con 0x7fb5b0061320 2021-10-20T23:27:35.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5affff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5b0061320 0x7fb5b0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5af7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb5b00ad5c0 0x7fb5b00b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41540/0 (socket says 172.21.15.12:41540) 2021-10-20T23:27:35.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5af7fe700 1 -- 172.21.15.12:0/2845245683 learned_addr learned my addr 172.21.15.12:0/2845245683 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:35.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5aeffd700 1 -- 172.21.15.12:0/2845245683 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372131501 0 0) 0x7fb5b00aecf0 con 0x7fb5b00ad5c0 2021-10-20T23:27:35.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5aeffd700 1 -- 172.21.15.12:0/2845245683 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb590003260 con 0x7fb5b00ad5c0 2021-10-20T23:27:35.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5aeffd700 1 -- 172.21.15.12:0/2845245683 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270737555 0 0) 0x7fb5b00b6f20 con 0x7fb5b0140440 2021-10-20T23:27:35.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5aeffd700 1 -- 172.21.15.12:0/2845245683 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b00aecf0 con 0x7fb5b0140440 2021-10-20T23:27:35.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5aeffd700 1 -- 172.21.15.12:0/2845245683 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232384701 0 0) 0x7fb590003260 con 0x7fb5b00ad5c0 2021-10-20T23:27:35.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5affff700 1 -- 172.21.15.12:0/2845245683 >> v1:172.21.15.31:6789/0 conn(0x7fb5b0140440 legacy=0x7fb5b0146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5affff700 1 -- 172.21.15.12:0/2845245683 >> v1:172.21.15.12:6789/0 conn(0x7fb5b00ad5c0 legacy=0x7fb5b00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5affff700 1 -- 172.21.15.12:0/2845245683 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00af1c0 con 0x7fb5b0061320 2021-10-20T23:27:35.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5affff700 1 --2- 172.21.15.12:0/2845245683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0061320 0x7fb5b0061700 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fb5b00aeba0 tx=0x7fb5a0006df0).ready entity=mon.0 client_cookie=18e56ff71a9e1d96 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:35.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5aeffd700 1 -- 172.21.15.12:0/2845245683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb598001660 con 0x7fb5b0061320 2021-10-20T23:27:35.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5aeffd700 1 -- 172.21.15.12:0/2845245683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0000e90 con 0x7fb5b0061320 2021-10-20T23:27:35.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5aeffd700 1 -- 172.21.15.12:0/2845245683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5a0012460 con 0x7fb5b0061320 2021-10-20T23:27:35.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 -- 172.21.15.12:0/2845245683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0061320 msgr2=0x7fb5b0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 --2- 172.21.15.12:0/2845245683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0061320 0x7fb5b0061700 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fb5b00aeba0 tx=0x7fb5a0006df0).stop 2021-10-20T23:27:35.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 -- 172.21.15.12:0/2845245683 shutdown_connections 2021-10-20T23:27:35.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 --2- 172.21.15.12:0/2845245683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0061320 0x7fb5b0061700 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.546+0000 7fb5b574b700 1 -- 172.21.15.12:0/2845245683 >> 172.21.15.12:0/2845245683 conn(0x7fb5b0066de0 msgr2=0x7fb5b00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:35.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.550+0000 7fb5b574b700 1 -- 172.21.15.12:0/2845245683 shutdown_connections 2021-10-20T23:27:35.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.550+0000 7fb5b574b700 1 -- 172.21.15.12:0/2845245683 wait complete. 2021-10-20T23:27:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.550+0000 7fb5b574b700 1 Processor -- start 2021-10-20T23:27:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.550+0000 7fb5b574b700 1 -- start start 2021-10-20T23:27:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b574b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5b0061320 0x7fb5b0141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b574b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b00ad5c0 0x7fb5b0152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b574b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0140440 0x7fb5b00b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b574b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b01568d0 con 0x7fb5b0140440 2021-10-20T23:27:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b574b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b01559f0 con 0x7fb5b00ad5c0 2021-10-20T23:27:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b574b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b0152490 con 0x7fb5b0061320 2021-10-20T23:27:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b4f4a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0140440 0x7fb5b00b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b4f4a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0140440 0x7fb5b00b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42954/0 (socket says 172.21.15.12:42954) 2021-10-20T23:27:35.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b4f4a700 1 -- 172.21.15.12:0/2013388806 learned_addr learned my addr 172.21.15.12:0/2013388806 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:35.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5af7fe700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b00ad5c0 0x7fb5b0152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5affff700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5b0061320 0x7fb5b0141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b4f4a700 1 -- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5b0061320 msgr2=0x7fb5b0141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b4f4a700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5b0061320 0x7fb5b0141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b4f4a700 1 -- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b00ad5c0 msgr2=0x7fb5b0152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b4f4a700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b00ad5c0 0x7fb5b0152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b4f4a700 1 -- 172.21.15.12:0/2013388806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a000b180 con 0x7fb5b0140440 2021-10-20T23:27:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b4f4a700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0140440 0x7fb5b00b1100 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fb5a8001490 tx=0x7fb5a8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5ad7fa700 1 -- 172.21.15.12:0/2013388806 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5a8002310 con 0x7fb5b0140440 2021-10-20T23:27:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b00af930 con 0x7fb5b0140440 2021-10-20T23:27:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5ad7fa700 1 -- 172.21.15.12:0/2013388806 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a8002470 con 0x7fb5b0140440 2021-10-20T23:27:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5ad7fa700 1 -- 172.21.15.12:0/2013388806 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5a80017a0 con 0x7fb5b0140440 2021-10-20T23:27:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b0141270 con 0x7fb5b0140440 2021-10-20T23:27:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.554+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b0141a10 con 0x7fb5b0140440 2021-10-20T23:27:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.558+0000 7fb5ad7fa700 1 -- 172.21.15.12:0/2013388806 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb5a8010030 con 0x7fb5b0140440 2021-10-20T23:27:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.558+0000 7fb5ad7fa700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb594053580 0x7fb594055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.558+0000 7fb5ad7fa700 1 -- 172.21.15.12:0/2013388806 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb5a806b840 con 0x7fb5b0140440 2021-10-20T23:27:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.558+0000 7fb5affff700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb594053580 0x7fb594055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.558+0000 7fb5affff700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb594053580 0x7fb594055a40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fb5a001a000 tx=0x7fb5a0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.566+0000 7fb5ad7fa700 1 -- 172.21.15.12:0/2013388806 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb5a80427a0 con 0x7fb5b0140440 2021-10-20T23:27:35.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.690+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5b00af460 con 0x7fb5b0140440 2021-10-20T23:27:35.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.690+0000 7fb5ad7fa700 1 -- 172.21.15.12:0/2013388806 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fb5a8045dc0 con 0x7fb5b0140440 2021-10-20T23:27:35.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:35.699 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":111,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:35.417679+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:33.634838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:34.436087+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:35.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb594053580 msgr2=0x7fb594055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb594053580 0x7fb594055a40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fb5a001a000 tx=0x7fb5a0014000).stop 2021-10-20T23:27:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0140440 msgr2=0x7fb5b00b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0140440 0x7fb5b00b1100 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fb5a8001490 tx=0x7fb5a8007dd0).stop 2021-10-20T23:27:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 shutdown_connections 2021-10-20T23:27:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb594053580 0x7fb594055a40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5b0140440 0x7fb5b00b1100 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b00ad5c0 0x7fb5b0152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 --2- 172.21.15.12:0/2013388806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5b0061320 0x7fb5b0141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 >> 172.21.15.12:0/2013388806 conn(0x7fb5b0066de0 msgr2=0x7fb5b013f850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:35.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 shutdown_connections 2021-10-20T23:27:35.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.694+0000 7fb5b574b700 1 -- 172.21.15.12:0/2013388806 wait complete. 2021-10-20T23:27:35.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:35.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.810+0000 7efcdd87c700 1 Processor -- start 2021-10-20T23:27:35.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.810+0000 7efcdd87c700 1 -- start start 2021-10-20T23:27:35.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efcd80b1db0 0x7efcd80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd81483a0 0x7efcd80b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80b0350 con 0x7efcd80a70c0 2021-10-20T23:27:35.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd80a90c0 con 0x7efcd80b1db0 2021-10-20T23:27:35.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b05f0 con 0x7efcd81483a0 2021-10-20T23:27:35.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd77fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efcd80a70c0 0x7efcd8144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41554/0 (socket says 172.21.15.12:41554) 2021-10-20T23:27:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd77fe700 1 -- 172.21.15.12:0/4200183648 learned_addr learned my addr 172.21.15.12:0/4200183648 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efcd80b1db0 0x7efcd80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd67fc700 1 --2- 172.21.15.12:0/4200183648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd81483a0 0x7efcd80b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd5ffb700 1 -- 172.21.15.12:0/4200183648 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722582069 0 0) 0x7efcd80b0350 con 0x7efcd80a70c0 2021-10-20T23:27:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd5ffb700 1 -- 172.21.15.12:0/4200183648 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcb8003260 con 0x7efcd80a70c0 2021-10-20T23:27:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd6ffd700 1 -- 172.21.15.12:0/4200183648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd81483a0 msgr2=0x7efcd80b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd6ffd700 1 --2- 172.21.15.12:0/4200183648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd81483a0 0x7efcd80b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd6ffd700 1 -- 172.21.15.12:0/4200183648 >> v1:172.21.15.12:6789/0 conn(0x7efcd80a70c0 legacy=0x7efcd8144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd5ffb700 1 -- 172.21.15.12:0/4200183648 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3438603335 0 0) 0x7efcb8003260 con 0x7efcd80a70c0 2021-10-20T23:27:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd6ffd700 1 -- 172.21.15.12:0/4200183648 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80b0890 con 0x7efcd80b1db0 2021-10-20T23:27:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd6ffd700 1 --2- 172.21.15.12:0/4200183648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 0x7efcd80b0fd0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7efcd0001800 tx=0x7efcc0006df0).ready entity=mon.0 client_cookie=137ecc170517194c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd5ffb700 1 -- 172.21.15.12:0/4200183648 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcd0001660 con 0x7efcd80b1db0 2021-10-20T23:27:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd5ffb700 1 -- 172.21.15.12:0/4200183648 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0000e90 con 0x7efcd80b1db0 2021-10-20T23:27:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcd5ffb700 1 -- 172.21.15.12:0/4200183648 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcc0012460 con 0x7efcd80b1db0 2021-10-20T23:27:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 -- 172.21.15.12:0/4200183648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 msgr2=0x7efcd80b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 --2- 172.21.15.12:0/4200183648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 0x7efcd80b0fd0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7efcd0001800 tx=0x7efcc0006df0).stop 2021-10-20T23:27:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 -- 172.21.15.12:0/4200183648 shutdown_connections 2021-10-20T23:27:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 --2- 172.21.15.12:0/4200183648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd81483a0 0x7efcd80b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 --2- 172.21.15.12:0/4200183648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 0x7efcd80b0fd0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 -- 172.21.15.12:0/4200183648 >> 172.21.15.12:0/4200183648 conn(0x7efcd805f6b0 msgr2=0x7efcd805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 -- 172.21.15.12:0/4200183648 shutdown_connections 2021-10-20T23:27:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.814+0000 7efcdd87c700 1 -- 172.21.15.12:0/4200183648 wait complete. 2021-10-20T23:27:35.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 Processor -- start 2021-10-20T23:27:35.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 -- start start 2021-10-20T23:27:35.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd80a70c0 0x7efcd81423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 0x7efcd813ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd81483a0 0x7efcd813fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd813f880 con 0x7efcd80b1db0 2021-10-20T23:27:35.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd813f5e0 con 0x7efcd81483a0 2021-10-20T23:27:35.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80aae40 con 0x7efcd80a70c0 2021-10-20T23:27:35.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 0x7efcd813ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 0x7efcd813ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42964/0 (socket says 172.21.15.12:42964) 2021-10-20T23:27:35.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd67fc700 1 -- 172.21.15.12:0/1294779622 learned_addr learned my addr 172.21.15.12:0/1294779622 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:35.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd77fe700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd81483a0 0x7efcd813fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd6ffd700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd80a70c0 0x7efcd81423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd67fc700 1 -- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd80a70c0 msgr2=0x7efcd81423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd67fc700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd80a70c0 0x7efcd81423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd67fc700 1 -- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd81483a0 msgr2=0x7efcd813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd67fc700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd81483a0 0x7efcd813fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd67fc700 1 -- 172.21.15.12:0/1294779622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc000b180 con 0x7efcd80b1db0 2021-10-20T23:27:35.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcd67fc700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 0x7efcd813ee40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7efcc800c000 tx=0x7efcc80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efccffff700 1 -- 172.21.15.12:0/1294779622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcc800eea0 con 0x7efcd80b1db0 2021-10-20T23:27:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efccffff700 1 -- 172.21.15.12:0/1294779622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc800c850 con 0x7efcd80b1db0 2021-10-20T23:27:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd80ab0e0 con 0x7efcd80b1db0 2021-10-20T23:27:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efccffff700 1 -- 172.21.15.12:0/1294779622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcc800cbb0 con 0x7efcd80b1db0 2021-10-20T23:27:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.818+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd80ab580 con 0x7efcd80b1db0 2021-10-20T23:27:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.822+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd80ab270 con 0x7efcd80b1db0 2021-10-20T23:27:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.822+0000 7efccffff700 1 -- 172.21.15.12:0/1294779622 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efcc8022070 con 0x7efcd80b1db0 2021-10-20T23:27:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.822+0000 7efccffff700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcbc053610 0x7efcbc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.822+0000 7efccffff700 1 -- 172.21.15.12:0/1294779622 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efcc806c140 con 0x7efcd80b1db0 2021-10-20T23:27:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.822+0000 7efcd6ffd700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcbc053610 0x7efcbc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.822+0000 7efcd6ffd700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcbc053610 0x7efcbc055ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7efcc0018000 tx=0x7efcc0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.826+0000 7efccffff700 1 -- 172.21.15.12:0/1294779622 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efcc8043140 con 0x7efcd80b1db0 2021-10-20T23:27:35.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.954+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcd80b0b30 con 0x7efcd80b1db0 2021-10-20T23:27:35.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.958+0000 7efccffff700 1 -- 172.21.15.12:0/1294779622 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16298 (secure 0 0 0) 0x7efcc8046760 con 0x7efcd80b1db0 2021-10-20T23:27:35.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:35.975 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":111,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:35.417679+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:33.634838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:34.436087+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.958+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcbc053610 msgr2=0x7efcbc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.958+0000 7efcdd87c700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcbc053610 0x7efcbc055ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7efcc0018000 tx=0x7efcc0014000).stop 2021-10-20T23:27:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.958+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 msgr2=0x7efcd813ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.958+0000 7efcdd87c700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 0x7efcd813ee40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7efcc800c000 tx=0x7efcc80091d0).stop 2021-10-20T23:27:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.962+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 shutdown_connections 2021-10-20T23:27:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.962+0000 7efcdd87c700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efcbc053610 0x7efcbc055ad0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.962+0000 7efcdd87c700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd81483a0 0x7efcd813fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.962+0000 7efcdd87c700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80b1db0 0x7efcd813ee40 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.962+0000 7efcdd87c700 1 --2- 172.21.15.12:0/1294779622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efcd80a70c0 0x7efcd81423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.962+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 >> 172.21.15.12:0/1294779622 conn(0x7efcd805f6b0 msgr2=0x7efcd80af740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.962+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 shutdown_connections 2021-10-20T23:27:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:35.962+0000 7efcdd87c700 1 -- 172.21.15.12:0/1294779622 wait complete. 2021-10-20T23:27:35.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:27:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.090+0000 7f07fa8cd700 1 Processor -- start 2021-10-20T23:27:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.090+0000 7f07fa8cd700 1 -- start start 2021-10-20T23:27:36.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.090+0000 7f07fa8cd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07f4061320 0x7f07f4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.090+0000 7f07fa8cd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07f40ad5c0 0x7f07f40b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.090+0000 7f07fa8cd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f40aecf0 con 0x7f07f4140440 2021-10-20T23:27:36.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.090+0000 7f07fa8cd700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40b6f20 con 0x7f07f40ad5c0 2021-10-20T23:27:36.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.090+0000 7f07fa8cd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40aef20 con 0x7f07f4061320 2021-10-20T23:27:36.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f90ca700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07f40ad5c0 0x7f07f40b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f90ca700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07f40ad5c0 0x7f07f40b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42972/0 (socket says 172.21.15.12:42972) 2021-10-20T23:27:36.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f98cb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07f4061320 0x7f07f4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f90ca700 1 -- 172.21.15.12:0/1778359470 learned_addr learned my addr 172.21.15.12:0/1778359470 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:36.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f90ca700 1 -- 172.21.15.12:0/1778359470 >> v2:172.21.15.31:3300/0 conn(0x7f07f4061320 msgr2=0x7f07f4061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:36.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f90ca700 1 --2- 172.21.15.12:0/1778359470 >> v2:172.21.15.31:3300/0 conn(0x7f07f4061320 0x7f07f4061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f90ca700 1 -- 172.21.15.12:0/1778359470 >> v1:172.21.15.31:6789/0 conn(0x7f07f4140440 legacy=0x7f07f4146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f90ca700 1 -- 172.21.15.12:0/1778359470 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40af1c0 con 0x7f07f40ad5c0 2021-10-20T23:27:36.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f90ca700 1 --2- 172.21.15.12:0/1778359470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f40ad5c0 0x7f07f40b9e60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f07f40aeba0 tx=0x7f07e4006eb0).ready entity=mon.0 client_cookie=d0ed6d00636c2a71 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:36.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f88c9700 1 -- 172.21.15.12:0/1778359470 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07e400d610 con 0x7f07f40ad5c0 2021-10-20T23:27:36.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f88c9700 1 -- 172.21.15.12:0/1778359470 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e4000e90 con 0x7f07f40ad5c0 2021-10-20T23:27:36.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07f88c9700 1 -- 172.21.15.12:0/1778359470 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07e400d9a0 con 0x7f07f40ad5c0 2021-10-20T23:27:36.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1778359470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f40ad5c0 msgr2=0x7f07f40b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.094+0000 7f07fa8cd700 1 --2- 172.21.15.12:0/1778359470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f40ad5c0 0x7f07f40b9e60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f07f40aeba0 tx=0x7f07e4006eb0).stop 2021-10-20T23:27:36.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.098+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1778359470 shutdown_connections 2021-10-20T23:27:36.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.098+0000 7f07fa8cd700 1 --2- 172.21.15.12:0/1778359470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f40ad5c0 0x7f07f40b9e60 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.098+0000 7f07fa8cd700 1 --2- 172.21.15.12:0/1778359470 >> v2:172.21.15.31:3300/0 conn(0x7f07f4061320 0x7f07f4061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.098+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1778359470 >> 172.21.15.12:0/1778359470 conn(0x7f07f4066de0 msgr2=0x7f07f40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.098+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1778359470 shutdown_connections 2021-10-20T23:27:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.098+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1778359470 wait complete. 2021-10-20T23:27:36.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.098+0000 7f07fa8cd700 1 Processor -- start 2021-10-20T23:27:36.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.098+0000 7f07fa8cd700 1 -- start start 2021-10-20T23:27:36.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa8cd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f4061320 0x7f07f40b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa8cd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f40ad5c0 0x7f07f409e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa8cd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f4140440 0x7f07f4144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa8cd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f409f140 con 0x7f07f4061320 2021-10-20T23:27:36.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa8cd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40b2c40 con 0x7f07f4140440 2021-10-20T23:27:36.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa8cd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f409eea0 con 0x7f07f40ad5c0 2021-10-20T23:27:36.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f98cb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f4061320 0x7f07f40b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f90ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f40ad5c0 0x7f07f409e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f98cb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f4061320 0x7f07f40b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42978/0 (socket says 172.21.15.12:42978) 2021-10-20T23:27:36.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f98cb700 1 -- 172.21.15.12:0/1710960112 learned_addr learned my addr 172.21.15.12:0/1710960112 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:36.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa0cc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f4140440 0x7f07f4144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f98cb700 1 -- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f40ad5c0 msgr2=0x7f07f409e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f98cb700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f40ad5c0 0x7f07f409e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f98cb700 1 -- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f4140440 msgr2=0x7f07f4144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f98cb700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f4140440 0x7f07f4144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f98cb700 1 -- 172.21.15.12:0/1710960112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e400b1e0 con 0x7f07f4061320 2021-10-20T23:27:36.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07f98cb700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f4061320 0x7f07f40b3340 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f07f000c000 tx=0x7f07f0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:36.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07e2ffd700 1 -- 172.21.15.12:0/1710960112 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f0010780 con 0x7f07f4061320 2021-10-20T23:27:36.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07e2ffd700 1 -- 172.21.15.12:0/1710960112 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f00108e0 con 0x7f07f4061320 2021-10-20T23:27:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07e2ffd700 1 -- 172.21.15.12:0/1710960112 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f0010c40 con 0x7f07f4061320 2021-10-20T23:27:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f40b2ea0 con 0x7f07f4061320 2021-10-20T23:27:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f40ac710 con 0x7f07f4061320 2021-10-20T23:27:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.102+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f40b3030 con 0x7f07f4061320 2021-10-20T23:27:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.106+0000 7f07e2ffd700 1 -- 172.21.15.12:0/1710960112 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f07f001c460 con 0x7f07f4061320 2021-10-20T23:27:36.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.106+0000 7f07e2ffd700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07d4053580 0x7f07d4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.106+0000 7f07e2ffd700 1 -- 172.21.15.12:0/1710960112 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f07f006bf20 con 0x7f07f4061320 2021-10-20T23:27:36.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.106+0000 7f07f90ca700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07d4053580 0x7f07d4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.106+0000 7f07f90ca700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07d4053580 0x7f07d4055a40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f07e401c000 tx=0x7f07e4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:36.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.110+0000 7f07e2ffd700 1 -- 172.21.15.12:0/1710960112 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f07f0042e20 con 0x7f07f4061320 2021-10-20T23:27:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.274+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f07f40af460 con 0x7f07f4061320 2021-10-20T23:27:36.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.434+0000 7f07e2ffd700 1 -- 172.21.15.12:0/1710960112 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7f07f0046440 con 0x7f07f4061320 2021-10-20T23:27:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07d4053580 msgr2=0x7f07d4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07d4053580 0x7f07d4055a40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f07e401c000 tx=0x7f07e4015000).stop 2021-10-20T23:27:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f4061320 msgr2=0x7f07f40b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f4061320 0x7f07f40b3340 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f07f000c000 tx=0x7f07f0006df0).stop 2021-10-20T23:27:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 shutdown_connections 2021-10-20T23:27:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07d4053580 0x7f07d4055a40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f4140440 0x7f07f4144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f40ad5c0 0x7f07f409e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 --2- 172.21.15.12:0/1710960112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07f4061320 0x7f07f40b3340 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 >> 172.21.15.12:0/1710960112 conn(0x7f07f4066de0 msgr2=0x7f07f40acac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 shutdown_connections 2021-10-20T23:27:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.438+0000 7f07fa8cd700 1 -- 172.21.15.12:0/1710960112 wait complete. 2021-10-20T23:27:36.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2c71700 1 Processor -- start 2021-10-20T23:27:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2c71700 1 -- start start 2021-10-20T23:27:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2c71700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec0ad5c0 0x7f78ec061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2c71700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78ec140440 0x7f78ec1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2c71700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec0aecf0 con 0x7f78ec061320 2021-10-20T23:27:36.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2c71700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec0b6f20 con 0x7f78ec140440 2021-10-20T23:27:36.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2c71700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0aef20 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2470700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78ec140440 0x7f78ec1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2470700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78ec140440 0x7f78ec1408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42988/0 (socket says 172.21.15.12:42988) 2021-10-20T23:27:36.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2470700 1 -- 172.21.15.12:0/2349065753 learned_addr learned my addr 172.21.15.12:0/2349065753 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:36.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f146e700 1 --2- 172.21.15.12:0/2349065753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec0ad5c0 0x7f78ec061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f0c6d700 1 -- 172.21.15.12:0/2349065753 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918647584 0 0) 0x7f78ec0aecf0 con 0x7f78ec061320 2021-10-20T23:27:36.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2470700 1 -- 172.21.15.12:0/2349065753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec0ad5c0 msgr2=0x7f78ec061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2470700 1 --2- 172.21.15.12:0/2349065753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec0ad5c0 0x7f78ec061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.570+0000 7f78f2470700 1 -- 172.21.15.12:0/2349065753 >> v1:172.21.15.31:6789/0 conn(0x7f78ec061320 legacy=0x7f78ec0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2470700 1 -- 172.21.15.12:0/2349065753 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0af1c0 con 0x7f78ec140440 2021-10-20T23:27:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2470700 1 --2- 172.21.15.12:0/2349065753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec140440 0x7f78ec1408f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f78e4002f70 tx=0x7f78e4006eb0).ready entity=mon.0 client_cookie=16c4223372329664 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f0c6d700 1 -- 172.21.15.12:0/2349065753 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e400d570 con 0x7f78ec140440 2021-10-20T23:27:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f0c6d700 1 -- 172.21.15.12:0/2349065753 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4000e90 con 0x7f78ec140440 2021-10-20T23:27:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f0c6d700 1 -- 172.21.15.12:0/2349065753 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e400d8c0 con 0x7f78ec140440 2021-10-20T23:27:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 -- 172.21.15.12:0/2349065753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec140440 msgr2=0x7f78ec1408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 --2- 172.21.15.12:0/2349065753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec140440 0x7f78ec1408f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f78e4002f70 tx=0x7f78e4006eb0).stop 2021-10-20T23:27:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 -- 172.21.15.12:0/2349065753 shutdown_connections 2021-10-20T23:27:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 --2- 172.21.15.12:0/2349065753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec140440 0x7f78ec1408f0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 --2- 172.21.15.12:0/2349065753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec0ad5c0 0x7f78ec061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 -- 172.21.15.12:0/2349065753 >> 172.21.15.12:0/2349065753 conn(0x7f78ec066de0 msgr2=0x7f78ec0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 -- 172.21.15.12:0/2349065753 shutdown_connections 2021-10-20T23:27:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 -- 172.21.15.12:0/2349065753 wait complete. 2021-10-20T23:27:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 Processor -- start 2021-10-20T23:27:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.574+0000 7f78f2c71700 1 -- start start 2021-10-20T23:27:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f2c71700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec061320 0x7f78ec145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f2c71700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0ad5c0 0x7f78ec13f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f2c71700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec140440 0x7f78ec13fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f2c71700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec05efa0 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f2c71700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec155680 con 0x7f78ec140440 2021-10-20T23:27:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f2c71700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0b1eb0 con 0x7f78ec061320 2021-10-20T23:27:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f146e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0ad5c0 0x7f78ec13f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f146e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0ad5c0 0x7f78ec13f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42994/0 (socket says 172.21.15.12:42994) 2021-10-20T23:27:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f146e700 1 -- 172.21.15.12:0/1758367150 learned_addr learned my addr 172.21.15.12:0/1758367150 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f2470700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec140440 0x7f78ec13fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f1c6f700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec061320 0x7f78ec145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f146e700 1 -- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec061320 msgr2=0x7f78ec145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f146e700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec061320 0x7f78ec145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f146e700 1 -- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec140440 msgr2=0x7f78ec13fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f146e700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec140440 0x7f78ec13fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f146e700 1 -- 172.21.15.12:0/1758367150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e400b1e0 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f1c6f700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec061320 0x7f78ec145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f146e700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0ad5c0 0x7f78ec13f820 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f78e000c000 tx=0x7f78e0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78df7fe700 1 -- 172.21.15.12:0/1758367150 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e0010780 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78df7fe700 1 -- 172.21.15.12:0/1758367150 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e00108e0 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec0b3770 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78df7fe700 1 -- 172.21.15.12:0/1758367150 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e0010c40 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.578+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec152f10 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.582+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec0af460 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.582+0000 7f78df7fe700 1 -- 172.21.15.12:0/1758367150 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f78e001c460 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.582+0000 7f78df7fe700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f78c80534f0 0x7f78c80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.582+0000 7f78df7fe700 1 -- 172.21.15.12:0/1758367150 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f78e006bdc0 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.582+0000 7f78f1c6f700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f78c80534f0 0x7f78c80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.582+0000 7f78f1c6f700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f78c80534f0 0x7f78c80559b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f78e800d000 tx=0x7f78e8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.586+0000 7f78df7fe700 1 -- 172.21.15.12:0/1758367150 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78e0042d60 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.754+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78ec057350 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.754+0000 7f78df7fe700 1 -- 172.21.15.12:0/1758367150 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f78e0046380 con 0x7f78ec0ad5c0 2021-10-20T23:27:36.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:36.763 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1540805449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1540805449},{"type":"v1","addr":"172.21.15.31:6835","nonce":1540805449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2826685098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2826685098},{"type":"v1","addr":"172.21.15.12:6833","nonce":2826685098}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:35.417915+0000","modified":"2021-10-20T23:27:36.421728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3124306556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3124306556},{"type":"v1","addr":"172.21.15.12:6835","nonce":3124306556}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-20T23:27:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.754+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f78c80534f0 msgr2=0x7f78c80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.754+0000 7f78f2c71700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f78c80534f0 0x7f78c80559b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f78e800d000 tx=0x7f78e8009040).stop 2021-10-20T23:27:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.754+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0ad5c0 msgr2=0x7f78ec13f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.754+0000 7f78f2c71700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0ad5c0 0x7f78ec13f820 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f78e000c000 tx=0x7f78e0006df0).stop 2021-10-20T23:27:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.758+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 shutdown_connections 2021-10-20T23:27:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.758+0000 7f78f2c71700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f78c80534f0 0x7f78c80559b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.758+0000 7f78f2c71700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec140440 0x7f78ec13fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.758+0000 7f78f2c71700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0ad5c0 0x7f78ec13f820 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.758+0000 7f78f2c71700 1 --2- 172.21.15.12:0/1758367150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec061320 0x7f78ec145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.758+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 >> 172.21.15.12:0/1758367150 conn(0x7f78ec066de0 msgr2=0x7f78ec148080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:36.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.758+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 shutdown_connections 2021-10-20T23:27:36.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.758+0000 7f78f2c71700 1 -- 172.21.15.12:0/1758367150 wait complete. 2021-10-20T23:27:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 54 2021-10-20T23:27:36.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:36.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a7fff700 1 Processor -- start 2021-10-20T23:27:36.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a7fff700 1 -- start start 2021-10-20T23:27:36.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6a80b6430 0x7fc6a8061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6a8147bf0 0x7fc6a8144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a80b1f70 con 0x7fc6a80b4060 2021-10-20T23:27:36.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80b14a0 con 0x7fc6a80b6430 2021-10-20T23:27:36.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a7fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80b6810 con 0x7fc6a8147bf0 2021-10-20T23:27:36.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6a80b6430 0x7fc6a8061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a67fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc6a80b4060 0x7fc6a81444a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41594/0 (socket says 172.21.15.12:41594) 2021-10-20T23:27:36.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a67fc700 1 -- 172.21.15.12:0/1174038393 learned_addr learned my addr 172.21.15.12:0/1174038393 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:36.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.870+0000 7fc6a77fe700 1 --2- 172.21.15.12:0/1174038393 >> v2:172.21.15.31:3300/0 conn(0x7fc6a8147bf0 0x7fc6a8144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a6ffd700 1 -- 172.21.15.12:0/1174038393 >> v2:172.21.15.31:3300/0 conn(0x7fc6a8147bf0 msgr2=0x7fc6a8144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:36.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a6ffd700 1 --2- 172.21.15.12:0/1174038393 >> v2:172.21.15.31:3300/0 conn(0x7fc6a8147bf0 0x7fc6a8144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a6ffd700 1 -- 172.21.15.12:0/1174038393 >> v1:172.21.15.12:6789/0 conn(0x7fc6a80b4060 legacy=0x7fc6a81444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a5ffb700 1 -- 172.21.15.12:0/1174038393 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604420767 0 0) 0x7fc6a80b1f70 con 0x7fc6a80b4060 2021-10-20T23:27:36.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a6ffd700 1 -- 172.21.15.12:0/1174038393 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8148110 con 0x7fc6a80b6430 2021-10-20T23:27:36.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a6ffd700 1 --2- 172.21.15.12:0/1174038393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 0x7fc6a8061470 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fc698002f70 tx=0x7fc698006df0).ready entity=mon.0 client_cookie=fe6d373a6ed8bd86 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:36.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a5ffb700 1 -- 172.21.15.12:0/1174038393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69800d5c0 con 0x7fc6a80b6430 2021-10-20T23:27:36.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a5ffb700 1 -- 172.21.15.12:0/1174038393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698000e90 con 0x7fc6a80b6430 2021-10-20T23:27:36.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a5ffb700 1 -- 172.21.15.12:0/1174038393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69800d910 con 0x7fc6a80b6430 2021-10-20T23:27:36.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1174038393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 msgr2=0x7fc6a8061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1174038393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 0x7fc6a8061470 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fc698002f70 tx=0x7fc698006df0).stop 2021-10-20T23:27:36.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1174038393 shutdown_connections 2021-10-20T23:27:36.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1174038393 >> v2:172.21.15.31:3300/0 conn(0x7fc6a8147bf0 0x7fc6a8144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1174038393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 0x7fc6a8061470 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1174038393 >> 172.21.15.12:0/1174038393 conn(0x7fc6a805c490 msgr2=0x7fc6a805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:36.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1174038393 shutdown_connections 2021-10-20T23:27:36.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1174038393 wait complete. 2021-10-20T23:27:36.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 Processor -- start 2021-10-20T23:27:36.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 -- start start 2021-10-20T23:27:36.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a80b4060 0x7fc6a814aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.874+0000 7fc6a7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 0x7fc6a8062b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a8147bf0 0x7fc6a81426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8063050 con 0x7fc6a80b6430 2021-10-20T23:27:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8063270 con 0x7fc6a8147bf0 2021-10-20T23:27:36.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8064780 con 0x7fc6a80b4060 2021-10-20T23:27:36.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 0x7fc6a8062b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 0x7fc6a8062b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43008/0 (socket says 172.21.15.12:43008) 2021-10-20T23:27:36.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a67fc700 1 -- 172.21.15.12:0/1981841349 learned_addr learned my addr 172.21.15.12:0/1981841349 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:36.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a6ffd700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a80b4060 0x7fc6a814aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a77fe700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a8147bf0 0x7fc6a81426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a67fc700 1 -- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a80b4060 msgr2=0x7fc6a814aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a67fc700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a80b4060 0x7fc6a814aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a67fc700 1 -- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a8147bf0 msgr2=0x7fc6a81426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:36.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a67fc700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a8147bf0 0x7fc6a81426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:36.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a67fc700 1 -- 172.21.15.12:0/1981841349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69800b180 con 0x7fc6a80b6430 2021-10-20T23:27:36.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a67fc700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 0x7fc6a8062b60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fc690001250 tx=0x7fc690007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:36.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc69ffff700 1 -- 172.21.15.12:0/1981841349 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc690005ba0 con 0x7fc6a80b6430 2021-10-20T23:27:36.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc69ffff700 1 -- 172.21.15.12:0/1981841349 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc690005d00 con 0x7fc6a80b6430 2021-10-20T23:27:36.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a8064a20 con 0x7fc6a80b6430 2021-10-20T23:27:36.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc69ffff700 1 -- 172.21.15.12:0/1981841349 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6900072c0 con 0x7fc6a80b6430 2021-10-20T23:27:36.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a8065160 con 0x7fc6a80b6430 2021-10-20T23:27:36.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.878+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a8066ad0 con 0x7fc6a80b6430 2021-10-20T23:27:36.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.882+0000 7fc69ffff700 1 -- 172.21.15.12:0/1981841349 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc690010070 con 0x7fc6a80b6430 2021-10-20T23:27:36.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.882+0000 7fc69ffff700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc68c0536a0 0x7fc68c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:36.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.882+0000 7fc69ffff700 1 -- 172.21.15.12:0/1981841349 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc69006b430 con 0x7fc6a80b6430 2021-10-20T23:27:36.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.882+0000 7fc6a6ffd700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc68c0536a0 0x7fc68c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:36.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.882+0000 7fc6a6ffd700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc68c0536a0 0x7fc68c055b60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fc69801a000 tx=0x7fc698014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:36.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:36.886+0000 7fc69ffff700 1 -- 172.21.15.12:0/1981841349 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc6a8066ad0 con 0x7fc6a80b6430 2021-10-20T23:27:37.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.014+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6a8066ad0 con 0x7fc6a80b6430 2021-10-20T23:27:37.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.014+0000 7fc69ffff700 1 -- 172.21.15.12:0/1981841349 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fc6a8066ad0 con 0x7fc6a80b6430 2021-10-20T23:27:37.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:37.026 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":112,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:36.420656+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:33.634838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:34.436087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:37.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc68c0536a0 msgr2=0x7fc68c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc68c0536a0 0x7fc68c055b60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fc69801a000 tx=0x7fc698014000).stop 2021-10-20T23:27:37.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 msgr2=0x7fc6a8062b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 0x7fc6a8062b60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fc690001250 tx=0x7fc690007e40).stop 2021-10-20T23:27:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 shutdown_connections 2021-10-20T23:27:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc68c0536a0 0x7fc68c055b60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a8147bf0 0x7fc6a81426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80b6430 0x7fc6a8062b60 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1981841349 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a80b4060 0x7fc6a814aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 >> 172.21.15.12:0/1981841349 conn(0x7fc6a805c490 msgr2=0x7fc6a8143b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:37.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 shutdown_connections 2021-10-20T23:27:37.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.018+0000 7fc6a7fff700 1 -- 172.21.15.12:0/1981841349 wait complete. 2021-10-20T23:27:37.045 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:27:37.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.154+0000 7fd5c5207700 1 Processor -- start 2021-10-20T23:27:37.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.154+0000 7fd5c5207700 1 -- start start 2021-10-20T23:27:37.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.154+0000 7fd5c5207700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 0x7fd5c00add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.154+0000 7fd5c5207700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00b2af0 con 0x7fd5c00aa120 2021-10-20T23:27:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.154+0000 7fd5c5207700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00b2770 con 0x7fd5c00b0880 2021-10-20T23:27:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.154+0000 7fd5c5207700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00b2d20 con 0x7fd5c00b04a0 2021-10-20T23:27:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.154+0000 7fd5be59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd5c00aa120 0x7fd5c00ae220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41612/0 (socket says 172.21.15.12:41612) 2021-10-20T23:27:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.154+0000 7fd5be59c700 1 -- 172.21.15.12:0/1768336043 learned_addr learned my addr 172.21.15.12:0/1768336043 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:37.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.154+0000 7fd5bed9d700 1 --2- 172.21.15.12:0/1768336043 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 0x7fd5c00add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bdd9b700 1 -- 172.21.15.12:0/1768336043 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507827626 0 0) 0x7fd5c00b2af0 con 0x7fd5c00aa120 2021-10-20T23:27:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bdd9b700 1 -- 172.21.15.12:0/1768336043 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a0003260 con 0x7fd5c00aa120 2021-10-20T23:27:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bdd9b700 1 -- 172.21.15.12:0/1768336043 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621842566 0 0) 0x7fd5c00b2770 con 0x7fd5c00b0880 2021-10-20T23:27:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bdd9b700 1 -- 172.21.15.12:0/1768336043 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c00b2af0 con 0x7fd5c00b0880 2021-10-20T23:27:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bdd9b700 1 -- 172.21.15.12:0/1768336043 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3826492157 0 0) 0x7fd5a0003260 con 0x7fd5c00aa120 2021-10-20T23:27:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bed9d700 1 -- 172.21.15.12:0/1768336043 >> v1:172.21.15.31:6789/0 conn(0x7fd5c00b0880 legacy=0x7fd5c01405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bed9d700 1 -- 172.21.15.12:0/1768336043 >> v1:172.21.15.12:6789/0 conn(0x7fd5c00aa120 legacy=0x7fd5c00ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bed9d700 1 -- 172.21.15.12:0/1768336043 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00a9b70 con 0x7fd5c00b04a0 2021-10-20T23:27:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bed9d700 1 --2- 172.21.15.12:0/1768336043 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 0x7fd5c00add30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd5b0001110 tx=0x7fd5a8006df0).ready entity=mon.2 client_cookie=6ba3ca586de57dbd server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bdd9b700 1 -- 172.21.15.12:0/1768336043 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5b0001660 con 0x7fd5c00b04a0 2021-10-20T23:27:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bdd9b700 1 -- 172.21.15.12:0/1768336043 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a8000e90 con 0x7fd5c00b04a0 2021-10-20T23:27:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5bdd9b700 1 -- 172.21.15.12:0/1768336043 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a8012460 con 0x7fd5c00b04a0 2021-10-20T23:27:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5c5207700 1 -- 172.21.15.12:0/1768336043 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 msgr2=0x7fd5c00add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5c5207700 1 --2- 172.21.15.12:0/1768336043 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 0x7fd5c00add30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd5b0001110 tx=0x7fd5a8006df0).stop 2021-10-20T23:27:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5c5207700 1 -- 172.21.15.12:0/1768336043 shutdown_connections 2021-10-20T23:27:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5c5207700 1 --2- 172.21.15.12:0/1768336043 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 0x7fd5c00add30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5c5207700 1 -- 172.21.15.12:0/1768336043 >> 172.21.15.12:0/1768336043 conn(0x7fd5c00607c0 msgr2=0x7fd5c0060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5c5207700 1 -- 172.21.15.12:0/1768336043 shutdown_connections 2021-10-20T23:27:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.158+0000 7fd5c5207700 1 -- 172.21.15.12:0/1768336043 wait complete. 2021-10-20T23:27:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 Processor -- start 2021-10-20T23:27:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 -- start start 2021-10-20T23:27:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00aa120 0x7fd5c00b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 0x7fd5c0066ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c00b0880 0x7fd5c00674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0066e50 con 0x7fd5c00b0880 2021-10-20T23:27:37.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c013c340 con 0x7fd5c00aa120 2021-10-20T23:27:37.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0066470 con 0x7fd5c00b04a0 2021-10-20T23:27:37.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c00b0880 0x7fd5c00674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00aa120 0x7fd5c00b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c00b0880 0x7fd5c00674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43024/0 (socket says 172.21.15.12:43024) 2021-10-20T23:27:37.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5be59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 0x7fd5c0066ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bf59e700 1 -- 172.21.15.12:0/2643268642 learned_addr learned my addr 172.21.15.12:0/2643268642 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bf59e700 1 -- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 msgr2=0x7fd5c0066ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bf59e700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 0x7fd5c0066ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bf59e700 1 -- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00aa120 msgr2=0x7fd5c00b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bf59e700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00aa120 0x7fd5c00b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bf59e700 1 -- 172.21.15.12:0/2643268642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a800b180 con 0x7fd5c00b0880 2021-10-20T23:27:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5bf59e700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c00b0880 0x7fd5c00674e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fd5b8001490 tx=0x7fd5b8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5b7fff700 1 -- 172.21.15.12:0/2643268642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5b8002310 con 0x7fd5c00b0880 2021-10-20T23:27:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5b7fff700 1 -- 172.21.15.12:0/2643268642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b8002470 con 0x7fd5c00b0880 2021-10-20T23:27:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c0066710 con 0x7fd5c00b0880 2021-10-20T23:27:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5b7fff700 1 -- 172.21.15.12:0/2643268642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5b80017a0 con 0x7fd5c00b0880 2021-10-20T23:27:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.162+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c0139ac0 con 0x7fd5c00b0880 2021-10-20T23:27:37.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.166+0000 7fd5b7fff700 1 -- 172.21.15.12:0/2643268642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd5b8010030 con 0x7fd5c00b0880 2021-10-20T23:27:37.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.166+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c0057350 con 0x7fd5c00b0880 2021-10-20T23:27:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.166+0000 7fd5b7fff700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a40536a0 0x7fd5a4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.166+0000 7fd5b7fff700 1 -- 172.21.15.12:0/2643268642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd5b806b840 con 0x7fd5c00b0880 2021-10-20T23:27:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.166+0000 7fd5bed9d700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a40536a0 0x7fd5a4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.166+0000 7fd5bed9d700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a40536a0 0x7fd5a4055b60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fd5a801c000 tx=0x7fd5a8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.170+0000 7fd5b7fff700 1 -- 172.21.15.12:0/2643268642 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5b8042730 con 0x7fd5c00b0880 2021-10-20T23:27:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.338+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd5c0044650 con 0x7fd5c00b0880 2021-10-20T23:27:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.346+0000 7fd5b7fff700 1 -- 172.21.15.12:0/2643268642 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd5b8045d50 con 0x7fd5c00b0880 2021-10-20T23:27:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a40536a0 msgr2=0x7fd5a4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a40536a0 0x7fd5a4055b60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fd5a801c000 tx=0x7fd5a8014000).stop 2021-10-20T23:27:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c00b0880 msgr2=0x7fd5c00674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c00b0880 0x7fd5c00674e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fd5b8001490 tx=0x7fd5b8007dd0).stop 2021-10-20T23:27:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 shutdown_connections 2021-10-20T23:27:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5a40536a0 0x7fd5a4055b60 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c00b0880 0x7fd5c00674e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5c00b04a0 0x7fd5c0066ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 --2- 172.21.15.12:0/2643268642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00aa120 0x7fd5c00b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 >> 172.21.15.12:0/2643268642 conn(0x7fd5c00607c0 msgr2=0x7fd5c00adb70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 shutdown_connections 2021-10-20T23:27:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.350+0000 7fd5c5207700 1 -- 172.21.15.12:0/2643268642 wait complete. 2021-10-20T23:27:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:27:37.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:27:37.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:27:37.384 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:27:37.387 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:27:37.390 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:27:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f0244f05700 1 Processor -- start 2021-10-20T23:27:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f0244f05700 1 -- start start 2021-10-20T23:27:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f0244f05700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0240060100 0x7f02400b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f0244f05700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0240067300 0x7f02401438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f0244f05700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02400aabb0 con 0x7f02400b4c40 2021-10-20T23:27:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f0244f05700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02400604e0 con 0x7f0240067300 2021-10-20T23:27:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f0244f05700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0240066ea0 con 0x7f0240060100 2021-10-20T23:27:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f023e59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0240060100 0x7f02400b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f023dd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0240067300 0x7f02401438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f023e59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0240060100 0x7f02400b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:48786/0 (socket says 172.21.15.12:48786) 2021-10-20T23:27:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f023e59c700 1 -- 172.21.15.12:0/1602434010 learned_addr learned my addr 172.21.15.12:0/1602434010 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.478+0000 7f023ed9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f02400b4c40 0x7f0240144510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:48688/0 (socket says 172.21.15.12:48688) 2021-10-20T23:27:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023d59a700 1 -- 172.21.15.12:0/1602434010 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984015608 0 0) 0x7f02400aabb0 con 0x7f02400b4c40 2021-10-20T23:27:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023d59a700 1 -- 172.21.15.12:0/1602434010 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0224003260 con 0x7f02400b4c40 2021-10-20T23:27:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023dd9b700 1 -- 172.21.15.12:0/1602434010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0240060100 msgr2=0x7f02400b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023dd9b700 1 --2- 172.21.15.12:0/1602434010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0240060100 0x7f02400b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023dd9b700 1 -- 172.21.15.12:0/1602434010 >> v1:172.21.15.31:6789/0 conn(0x7f02400b4c40 legacy=0x7f0240144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023dd9b700 1 -- 172.21.15.12:0/1602434010 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02400b33b0 con 0x7f0240067300 2021-10-20T23:27:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023e59c700 1 --2- 172.21.15.12:0/1602434010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0240060100 0x7f02400b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023dd9b700 1 --2- 172.21.15.12:0/1602434010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240067300 0x7f02401438f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f0234002f70 tx=0x7f0234006df0).ready entity=mon.1 client_cookie=9becc8523cf68ad5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023d59a700 1 -- 172.21.15.12:0/1602434010 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f023400d4a0 con 0x7f0240067300 2021-10-20T23:27:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023d59a700 1 -- 172.21.15.12:0/1602434010 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234000e90 con 0x7f0240067300 2021-10-20T23:27:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f023d59a700 1 -- 172.21.15.12:0/1602434010 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f023400d7f0 con 0x7f0240067300 2021-10-20T23:27:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f0244f05700 1 -- 172.21.15.12:0/1602434010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240067300 msgr2=0x7f02401438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f0244f05700 1 --2- 172.21.15.12:0/1602434010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240067300 0x7f02401438f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f0234002f70 tx=0x7f0234006df0).stop 2021-10-20T23:27:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f0244f05700 1 -- 172.21.15.12:0/1602434010 shutdown_connections 2021-10-20T23:27:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f0244f05700 1 --2- 172.21.15.12:0/1602434010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240067300 0x7f02401438f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f0244f05700 1 --2- 172.21.15.12:0/1602434010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0240060100 0x7f02400b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f0244f05700 1 -- 172.21.15.12:0/1602434010 >> 172.21.15.12:0/1602434010 conn(0x7f024005cf30 msgr2=0x7f024005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f0244f05700 1 -- 172.21.15.12:0/1602434010 shutdown_connections 2021-10-20T23:27:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.482+0000 7f0244f05700 1 -- 172.21.15.12:0/1602434010 wait complete. 2021-10-20T23:27:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 Processor -- start 2021-10-20T23:27:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 -- start start 2021-10-20T23:27:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240060100 0x7f02400b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240067300 0x7f02400abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02400b4c40 0x7f02400abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400ad500 con 0x7f0240067300 2021-10-20T23:27:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400b5e50 con 0x7f0240060100 2021-10-20T23:27:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0240062720 con 0x7f02400b4c40 2021-10-20T23:27:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240067300 0x7f02400abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240060100 0x7f02400b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240060100 0x7f02400b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:58008/0 (socket says 172.21.15.12:58008) 2021-10-20T23:27:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023e59c700 1 -- 172.21.15.12:0/1821279191 learned_addr learned my addr 172.21.15.12:0/1821279191 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023ed9d700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02400b4c40 0x7f02400abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023dd9b700 1 -- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02400b4c40 msgr2=0x7f02400abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023dd9b700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02400b4c40 0x7f02400abff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023dd9b700 1 -- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240060100 msgr2=0x7f02400b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023dd9b700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240060100 0x7f02400b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023dd9b700 1 -- 172.21.15.12:0/1821279191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023000b1e0 con 0x7f0240067300 2021-10-20T23:27:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f023dd9b700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240067300 0x7f02400abb00 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f02400b0720 tx=0x7f0234014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f022f7fe700 1 -- 172.21.15.12:0/1821279191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0234016070 con 0x7f0240067300 2021-10-20T23:27:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f022f7fe700 1 -- 172.21.15.12:0/1821279191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02340137d0 con 0x7f0240067300 2021-10-20T23:27:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023400b180 con 0x7f0240067300 2021-10-20T23:27:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f022f7fe700 1 -- 172.21.15.12:0/1821279191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0234013b30 con 0x7f0240067300 2021-10-20T23:27:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.486+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0240061c30 con 0x7f0240067300 2021-10-20T23:27:37.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.490+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02400ab8a0 con 0x7f0240067300 2021-10-20T23:27:37.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.490+0000 7f022f7fe700 1 -- 172.21.15.12:0/1821279191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f023400f030 con 0x7f0240067300 2021-10-20T23:27:37.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.490+0000 7f022f7fe700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f021c053640 0x7f021c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.490+0000 7f022f7fe700 1 -- 172.21.15.12:0/1821279191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f023406c720 con 0x7f0240067300 2021-10-20T23:27:37.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.490+0000 7f023e59c700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f021c053640 0x7f021c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.490+0000 7f023e59c700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f021c053640 0x7f021c055b00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f023000b000 tx=0x7f0230006eb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:37.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.498+0000 7f022f7fe700 1 -- 172.21.15.12:0/1821279191 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f02340435d0 con 0x7f0240067300 2021-10-20T23:27:37.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.670+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0240057350 con 0x7f0240067300 2021-10-20T23:27:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f022f7fe700 1 -- 172.21.15.12:0/1821279191 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f02340230e0 con 0x7f0240067300 2021-10-20T23:27:37.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f021c053640 msgr2=0x7f021c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f021c053640 0x7f021c055b00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f023000b000 tx=0x7f0230006eb0).stop 2021-10-20T23:27:37.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240067300 msgr2=0x7f02400abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240067300 0x7f02400abb00 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f02400b0720 tx=0x7f0234014000).stop 2021-10-20T23:27:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 shutdown_connections 2021-10-20T23:27:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f021c053640 0x7f021c055b00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02400b4c40 0x7f02400abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240067300 0x7f02400abb00 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 --2- 172.21.15.12:0/1821279191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0240060100 0x7f02400b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 >> 172.21.15.12:0/1821279191 conn(0x7f024005cf30 msgr2=0x7f024005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 shutdown_connections 2021-10-20T23:27:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.678+0000 7f0244f05700 1 -- 172.21.15.12:0/1821279191 wait complete. 2021-10-20T23:27:37.691 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:27:37.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d759e700 1 Processor -- start 2021-10-20T23:27:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d759e700 1 -- start start 2021-10-20T23:27:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71d8061320 0x7f71d8061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d80ad5c0 0x7f71d80b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f71d8140440 0x7f71d81408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d80aecf0 con 0x7f71d8140440 2021-10-20T23:27:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d80b6f20 con 0x7f71d8061320 2021-10-20T23:27:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80aef20 con 0x7f71d80ad5c0 2021-10-20T23:27:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f71d8140440 0x7f71d81408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f71d8140440 0x7f71d81408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43046/0 (socket says 172.21.15.12:43046) 2021-10-20T23:27:37.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d6d9d700 1 -- 172.21.15.12:0/1817557989 learned_addr learned my addr 172.21.15.12:0/1817557989 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:37.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d659c700 1 --2- 172.21.15.12:0/1817557989 >> v2:172.21.15.31:3300/0 conn(0x7f71d8061320 0x7f71d8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d5d9b700 1 --2- 172.21.15.12:0/1817557989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d80ad5c0 0x7f71d80b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d6d9d700 1 -- 172.21.15.12:0/1817557989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d80ad5c0 msgr2=0x7f71d80b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:37.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d6d9d700 1 --2- 172.21.15.12:0/1817557989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d80ad5c0 0x7f71d80b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d6d9d700 1 -- 172.21.15.12:0/1817557989 >> v2:172.21.15.31:3300/0 conn(0x7f71d8061320 msgr2=0x7f71d8061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:37.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d6d9d700 1 --2- 172.21.15.12:0/1817557989 >> v2:172.21.15.31:3300/0 conn(0x7f71d8061320 0x7f71d8061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d6d9d700 1 -- 172.21.15.12:0/1817557989 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80af1c0 con 0x7f71d8140440 2021-10-20T23:27:37.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d659c700 1 --2- 172.21.15.12:0/1817557989 >> v2:172.21.15.31:3300/0 conn(0x7f71d8061320 0x7f71d8061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:37.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.798+0000 7f71d6d9d700 1 --2- 172.21.15.12:0/1817557989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 0x7f71d81408d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f71d0002f70 tx=0x7f71d0006eb0).ready entity=mon.0 client_cookie=b6a7d4db2e72a280 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:37.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d559a700 1 -- 172.21.15.12:0/1817557989 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d000d570 con 0x7f71d8140440 2021-10-20T23:27:37.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d559a700 1 -- 172.21.15.12:0/1817557989 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d0000e90 con 0x7f71d8140440 2021-10-20T23:27:37.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d559a700 1 -- 172.21.15.12:0/1817557989 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d000d900 con 0x7f71d8140440 2021-10-20T23:27:37.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 -- 172.21.15.12:0/1817557989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 msgr2=0x7f71d81408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 --2- 172.21.15.12:0/1817557989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 0x7f71d81408d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f71d0002f70 tx=0x7f71d0006eb0).stop 2021-10-20T23:27:37.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 -- 172.21.15.12:0/1817557989 shutdown_connections 2021-10-20T23:27:37.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 --2- 172.21.15.12:0/1817557989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 0x7f71d81408d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 --2- 172.21.15.12:0/1817557989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d80ad5c0 0x7f71d80b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 --2- 172.21.15.12:0/1817557989 >> v2:172.21.15.31:3300/0 conn(0x7f71d8061320 0x7f71d8061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 -- 172.21.15.12:0/1817557989 >> 172.21.15.12:0/1817557989 conn(0x7f71d8066de0 msgr2=0x7f71d80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:37.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 -- 172.21.15.12:0/1817557989 shutdown_connections 2021-10-20T23:27:37.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 -- 172.21.15.12:0/1817557989 wait complete. 2021-10-20T23:27:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 Processor -- start 2021-10-20T23:27:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 -- start start 2021-10-20T23:27:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d8061320 0x7f71d8156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.802+0000 7f71d759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71d80ad5c0 0x7f71d81522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 0x7f71d80b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8156660 con 0x7f71d8140440 2021-10-20T23:27:37.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80ab900 con 0x7f71d80ad5c0 2021-10-20T23:27:37.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80abb80 con 0x7f71d8061320 2021-10-20T23:27:37.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 0x7f71d80b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d8061320 0x7f71d8156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71d80ad5c0 0x7f71d81522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 0x7f71d80b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43052/0 (socket says 172.21.15.12:43052) 2021-10-20T23:27:37.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d6d9d700 1 -- 172.21.15.12:0/757781974 learned_addr learned my addr 172.21.15.12:0/757781974 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:37.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d6d9d700 1 -- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d8061320 msgr2=0x7f71d8156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d6d9d700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d8061320 0x7f71d8156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d6d9d700 1 -- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71d80ad5c0 msgr2=0x7f71d81522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d6d9d700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71d80ad5c0 0x7f71d81522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d6d9d700 1 -- 172.21.15.12:0/757781974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8009470 con 0x7f71d8140440 2021-10-20T23:27:37.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d6d9d700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 0x7f71d80b0ca0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f71d0002f70 tx=0x7f71d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:37.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71cf7fe700 1 -- 172.21.15.12:0/757781974 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d0011760 con 0x7f71d8140440 2021-10-20T23:27:37.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71cf7fe700 1 -- 172.21.15.12:0/757781974 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d00118c0 con 0x7f71d8140440 2021-10-20T23:27:37.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d000b1e0 con 0x7f71d8140440 2021-10-20T23:27:37.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71cf7fe700 1 -- 172.21.15.12:0/757781974 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d0011c20 con 0x7f71d8140440 2021-10-20T23:27:37.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d8149880 con 0x7f71d8140440 2021-10-20T23:27:37.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.806+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d80af460 con 0x7f71d8140440 2021-10-20T23:27:37.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.810+0000 7f71cf7fe700 1 -- 172.21.15.12:0/757781974 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71d0025030 con 0x7f71d8140440 2021-10-20T23:27:37.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.810+0000 7f71cf7fe700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f71bc0534f0 0x7f71bc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:37.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.810+0000 7f71cf7fe700 1 -- 172.21.15.12:0/757781974 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f71d006ce10 con 0x7f71d8140440 2021-10-20T23:27:37.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.810+0000 7f71d659c700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f71bc0534f0 0x7f71bc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:37.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.810+0000 7f71d659c700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f71bc0534f0 0x7f71bc0559b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f71c800b000 tx=0x7f71c80091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:37.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.814+0000 7f71cf7fe700 1 -- 172.21.15.12:0/757781974 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71d0043d00 con 0x7f71d8140440 2021-10-20T23:27:37.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71d8057350 con 0x7f71d8140440 2021-10-20T23:27:37.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71cf7fe700 1 -- 172.21.15.12:0/757781974 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f71d0023070 con 0x7f71d8140440 2021-10-20T23:27:37.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:37.983 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1540805449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1540805449},{"type":"v1","addr":"172.21.15.31:6835","nonce":1540805449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2826685098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2826685098},{"type":"v1","addr":"172.21.15.12:6833","nonce":2826685098}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:35.417915+0000","modified":"2021-10-20T23:27:36.421728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3124306556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3124306556},{"type":"v1","addr":"172.21.15.12:6835","nonce":3124306556}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-20T23:27:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f71bc0534f0 msgr2=0x7f71bc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f71bc0534f0 0x7f71bc0559b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f71c800b000 tx=0x7f71c80091d0).stop 2021-10-20T23:27:37.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 msgr2=0x7f71d80b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:37.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 0x7f71d80b0ca0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f71d0002f70 tx=0x7f71d0015000).stop 2021-10-20T23:27:37.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 shutdown_connections 2021-10-20T23:27:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f71bc0534f0 0x7f71bc0559b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71d8140440 0x7f71d80b0ca0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71d80ad5c0 0x7f71d81522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 --2- 172.21.15.12:0/757781974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71d8061320 0x7f71d8156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.974+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 >> 172.21.15.12:0/757781974 conn(0x7f71d8066de0 msgr2=0x7f71d80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.978+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 shutdown_connections 2021-10-20T23:27:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:37.978+0000 7f71d759e700 1 -- 172.21.15.12:0/757781974 wait complete. 2021-10-20T23:27:37.988 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 54 2021-10-20T23:27:38.299 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:27:35.417915+0000', 'modified': '2021-10-20T23:27:36.421728+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7257': {'gid': 7257, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/3124306556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 3124306556}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 3124306556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:27:38.299 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:27:38.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:27:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":7257,"want_state":"up:active","state":"up:active","rank_uptime":2.9808301570000002,"mdsmap_epoch":54,"osdmap_epoch":112,"osdmap_epoch_barrier":112,"uptime":7.6736745969999998} 2021-10-20T23:27:38.417 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 7257, "mdsmap_epoch": 54, "osdmap_epoch": 112, "osdmap_epoch_barrier": 112, "rank_uptime": 2.980830157, "state": "up:active", "uptime": 7.673674597, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:27:38.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:38.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.514+0000 7f1fc057e700 1 Processor -- start 2021-10-20T23:27:38.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.514+0000 7f1fc057e700 1 -- start start 2021-10-20T23:27:38.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1fb80b1db0 0x7f1fb80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1fb81483a0 0x7f1fb80b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80b0350 con 0x7f1fb80a70c0 2021-10-20T23:27:38.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb80a90c0 con 0x7f1fb81483a0 2021-10-20T23:27:38.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb80b05f0 con 0x7f1fb80b1db0 2021-10-20T23:27:38.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbdb19700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1fb81483a0 0x7f1fb80b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbeb1b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1fb80a70c0 0x7f1fb8144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41654/0 (socket says 172.21.15.12:41654) 2021-10-20T23:27:38.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbdb19700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1fb81483a0 0x7f1fb80b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43056/0 (socket says 172.21.15.12:43056) 2021-10-20T23:27:38.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbeb1b700 1 -- 172.21.15.12:0/2960707801 learned_addr learned my addr 172.21.15.12:0/2960707801 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:38.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbe31a700 1 --2- 172.21.15.12:0/2960707801 >> v2:172.21.15.31:3300/0 conn(0x7f1fb80b1db0 0x7f1fb80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbdb19700 1 -- 172.21.15.12:0/2960707801 >> v2:172.21.15.31:3300/0 conn(0x7f1fb80b1db0 msgr2=0x7f1fb80b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:38.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbdb19700 1 --2- 172.21.15.12:0/2960707801 >> v2:172.21.15.31:3300/0 conn(0x7f1fb80b1db0 0x7f1fb80b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbdb19700 1 -- 172.21.15.12:0/2960707801 >> v1:172.21.15.12:6789/0 conn(0x7f1fb80a70c0 legacy=0x7f1fb8144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbdb19700 1 -- 172.21.15.12:0/2960707801 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb80b0890 con 0x7f1fb81483a0 2021-10-20T23:27:38.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbdb19700 1 --2- 172.21.15.12:0/2960707801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb81483a0 0x7f1fb80b2190 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f1fb8147730 tx=0x7f1fb40091d0).ready entity=mon.0 client_cookie=f0a9e9ee83d67370 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:38.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbd318700 1 -- 172.21.15.12:0/2960707801 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb400b680 con 0x7f1fb81483a0 2021-10-20T23:27:38.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbd318700 1 -- 172.21.15.12:0/2960707801 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb400b7e0 con 0x7f1fb81483a0 2021-10-20T23:27:38.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fbd318700 1 -- 172.21.15.12:0/2960707801 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb400b950 con 0x7f1fb81483a0 2021-10-20T23:27:38.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 -- 172.21.15.12:0/2960707801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb81483a0 msgr2=0x7f1fb80b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 --2- 172.21.15.12:0/2960707801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb81483a0 0x7f1fb80b2190 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f1fb8147730 tx=0x7f1fb40091d0).stop 2021-10-20T23:27:38.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 -- 172.21.15.12:0/2960707801 shutdown_connections 2021-10-20T23:27:38.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 --2- 172.21.15.12:0/2960707801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb81483a0 0x7f1fb80b2190 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 --2- 172.21.15.12:0/2960707801 >> v2:172.21.15.31:3300/0 conn(0x7f1fb80b1db0 0x7f1fb80b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 -- 172.21.15.12:0/2960707801 >> 172.21.15.12:0/2960707801 conn(0x7f1fb805f6b0 msgr2=0x7f1fb805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:38.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 -- 172.21.15.12:0/2960707801 shutdown_connections 2021-10-20T23:27:38.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.518+0000 7f1fc057e700 1 -- 172.21.15.12:0/2960707801 wait complete. 2021-10-20T23:27:38.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 Processor -- start 2021-10-20T23:27:38.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 -- start start 2021-10-20T23:27:38.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb80a70c0 0x7f1fb814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fb80b1db0 0x7f1fb80ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fb81483a0 0x7f1fb80abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80ac0b0 con 0x7f1fb80a70c0 2021-10-20T23:27:38.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80a9f50 con 0x7f1fb80b1db0 2021-10-20T23:27:38.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80ab020 con 0x7f1fb81483a0 2021-10-20T23:27:38.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbe31a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb80a70c0 0x7f1fb814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbe31a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb80a70c0 0x7f1fb814a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43062/0 (socket says 172.21.15.12:43062) 2021-10-20T23:27:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbe31a700 1 -- 172.21.15.12:0/3458986411 learned_addr learned my addr 172.21.15.12:0/3458986411 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbdb19700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fb80b1db0 0x7f1fb80ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbeb1b700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fb81483a0 0x7f1fb80abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbe31a700 1 -- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fb81483a0 msgr2=0x7f1fb80abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbe31a700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fb81483a0 0x7f1fb80abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbe31a700 1 -- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fb80b1db0 msgr2=0x7f1fb80ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbe31a700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fb80b1db0 0x7f1fb80ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbe31a700 1 -- 172.21.15.12:0/3458986411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb4009470 con 0x7f1fb80a70c0 2021-10-20T23:27:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fbe31a700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb80a70c0 0x7f1fb814a540 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f1fa800c000 tx=0x7f1fa8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fa77fe700 1 -- 172.21.15.12:0/3458986411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa8010780 con 0x7f1fb80a70c0 2021-10-20T23:27:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fa77fe700 1 -- 172.21.15.12:0/3458986411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa80108e0 con 0x7f1fb80a70c0 2021-10-20T23:27:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb80aaae0 con 0x7f1fb80a70c0 2021-10-20T23:27:38.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fa77fe700 1 -- 172.21.15.12:0/3458986411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa8010c40 con 0x7f1fb80a70c0 2021-10-20T23:27:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.522+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb814b9f0 con 0x7f1fb80a70c0 2021-10-20T23:27:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.526+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb80aa0c0 con 0x7f1fb80a70c0 2021-10-20T23:27:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.526+0000 7f1fa77fe700 1 -- 172.21.15.12:0/3458986411 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fa801c460 con 0x7f1fb80a70c0 2021-10-20T23:27:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.526+0000 7f1fa77fe700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f98053640 0x7f1f98055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.526+0000 7f1fa77fe700 1 -- 172.21.15.12:0/3458986411 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1fa806be00 con 0x7f1fb80a70c0 2021-10-20T23:27:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.526+0000 7f1fbdb19700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f98053640 0x7f1f98055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.526+0000 7f1fbdb19700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f98053640 0x7f1f98055b00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f1fb401b000 tx=0x7f1fb4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.530+0000 7f1fa77fe700 1 -- 172.21.15.12:0/3458986411 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fa8042da0 con 0x7f1fb80a70c0 2021-10-20T23:27:38.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.658+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fb80b0b30 con 0x7f1fb80a70c0 2021-10-20T23:27:38.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.658+0000 7f1fa77fe700 1 -- 172.21.15.12:0/3458986411 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f1fa80463c0 con 0x7f1fb80a70c0 2021-10-20T23:27:38.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:38.668 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":112,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:36.420656+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:33.634838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:34.436087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.658+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f98053640 msgr2=0x7f1f98055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f98053640 0x7f1f98055b00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f1fb401b000 tx=0x7f1fb4016000).stop 2021-10-20T23:27:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb80a70c0 msgr2=0x7f1fb814a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb80a70c0 0x7f1fb814a540 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f1fa800c000 tx=0x7f1fa8006df0).stop 2021-10-20T23:27:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 shutdown_connections 2021-10-20T23:27:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1f98053640 0x7f1f98055b00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fb81483a0 0x7f1fb80abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fb80b1db0 0x7f1fb80ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 --2- 172.21.15.12:0/3458986411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fb80a70c0 0x7f1fb814a540 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 >> 172.21.15.12:0/3458986411 conn(0x7f1fb805f6b0 msgr2=0x7f1fb80b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 shutdown_connections 2021-10-20T23:27:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.662+0000 7f1fc057e700 1 -- 172.21.15.12:0/3458986411 wait complete. 2021-10-20T23:27:38.683 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:27:33.634838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:27:34.436087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:27:38.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:27:38.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f37495ca700 1 Processor -- start 2021-10-20T23:27:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f37495ca700 1 -- start start 2021-10-20T23:27:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f37495ca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3744061700 0x7f3744146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f37495ca700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37440aecf0 con 0x7f3744061320 2021-10-20T23:27:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f37495ca700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37440b6f20 con 0x7f37440ad5c0 2021-10-20T23:27:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f37495ca700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37440aef20 con 0x7f3744061700 2021-10-20T23:27:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3743fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3744061320 0x7f37440b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41664/0 (socket says 172.21.15.12:41664) 2021-10-20T23:27:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3743fff700 1 -- 172.21.15.12:0/248660229 learned_addr learned my addr 172.21.15.12:0/248660229 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3748dc9700 1 --2- 172.21.15.12:0/248660229 >> v2:172.21.15.31:3300/0 conn(0x7f3744061700 0x7f3744146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899865300 0 0) 0x7f37440aecf0 con 0x7f3744061320 2021-10-20T23:27:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3730003260 con 0x7f3744061320 2021-10-20T23:27:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1887212422 0 0) 0x7f3730003260 con 0x7f3744061320 2021-10-20T23:27:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 >> v2:172.21.15.31:3300/0 conn(0x7f3744061700 msgr2=0x7f3744146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 --2- 172.21.15.12:0/248660229 >> v2:172.21.15.31:3300/0 conn(0x7f3744061700 0x7f3744146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 >> v1:172.21.15.31:6789/0 conn(0x7f37440ad5c0 legacy=0x7f3744140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440af1c0 con 0x7f3744061320 2021-10-20T23:27:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f3734001660 con 0x7f3744061320 2021-10-20T23:27:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 >> v1:172.21.15.12:6789/0 conn(0x7f3744061320 legacy=0x7f37440b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3730003750 0x7f3730003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3730004500 0x7f3730004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3730004e70 0x7f373000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37440aef20 con 0x7f3730004500 2021-10-20T23:27:38.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373000bd20 con 0x7f3730004e70 2021-10-20T23:27:38.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373000bee0 con 0x7f3730003750 2021-10-20T23:27:38.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f37437fe700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3730004500 0x7f3730004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3748dc9700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3730004e70 0x7f373000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.786+0000 7f3743fff700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3730003750 0x7f3730003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37437fe700 1 -- 172.21.15.12:0/248660229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3730003750 msgr2=0x7f3730003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:38.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37437fe700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3730003750 0x7f3730003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37437fe700 1 -- 172.21.15.12:0/248660229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3730004e70 msgr2=0x7f373000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:38.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37437fe700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3730004e70 0x7f373000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f3748dc9700 1 -- 172.21.15.12:0/248660229 reap_dead start 2021-10-20T23:27:38.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37437fe700 1 -- 172.21.15.12:0/248660229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730003260 con 0x7f3730004500 2021-10-20T23:27:38.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37437fe700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3730004500 0x7f3730004980 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f37440af7e0 tx=0x7f37380079e0).ready entity=mon.0 client_cookie=7a108b7940294313 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:38.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3738014410 con 0x7f3730004500 2021-10-20T23:27:38.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3738014570 con 0x7f3730004500 2021-10-20T23:27:38.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f3742ffd700 1 -- 172.21.15.12:0/248660229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37380148d0 con 0x7f3730004500 2021-10-20T23:27:38.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37495ca700 1 -- 172.21.15.12:0/248660229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3730004500 msgr2=0x7f3730004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37495ca700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3730004500 0x7f3730004980 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f37440af7e0 tx=0x7f37380079e0).stop 2021-10-20T23:27:38.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37495ca700 1 -- 172.21.15.12:0/248660229 shutdown_connections 2021-10-20T23:27:38.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37495ca700 1 --2- 172.21.15.12:0/248660229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3730004500 0x7f3730004980 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37495ca700 1 -- 172.21.15.12:0/248660229 >> 172.21.15.12:0/248660229 conn(0x7f3744066de0 msgr2=0x7f37440671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:38.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37495ca700 1 -- 172.21.15.12:0/248660229 shutdown_connections 2021-10-20T23:27:38.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.790+0000 7f37495ca700 1 -- 172.21.15.12:0/248660229 wait complete. 2021-10-20T23:27:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 Processor -- start 2021-10-20T23:27:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 -- start start 2021-10-20T23:27:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3730004500 0x7f37440a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37440a2160 0x7f3744155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744155f30 0x7f37441563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37440acce0 con 0x7f37440a2160 2021-10-20T23:27:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37441568a0 con 0x7f3744155f30 2021-10-20T23:27:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3744152f90 con 0x7f3730004500 2021-10-20T23:27:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37437fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37440a2160 0x7f3744155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37437fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37440a2160 0x7f3744155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43084/0 (socket says 172.21.15.12:43084) 2021-10-20T23:27:38.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37437fe700 1 -- 172.21.15.12:0/1348118428 learned_addr learned my addr 172.21.15.12:0/1348118428 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:38.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f3743fff700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3730004500 0x7f37440a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f3748dc9700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744155f30 0x7f37441563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37437fe700 1 -- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3730004500 msgr2=0x7f37440a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37437fe700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3730004500 0x7f37440a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37437fe700 1 -- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744155f30 msgr2=0x7f37441563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37437fe700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744155f30 0x7f37441563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37437fe700 1 -- 172.21.15.12:0/1348118428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744153230 con 0x7f37440a2160 2021-10-20T23:27:38.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37437fe700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37440a2160 0x7f3744155a40 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f37440af7e0 tx=0x7f3738015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:38.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37417fa700 1 -- 172.21.15.12:0/1348118428 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3738014410 con 0x7f37440a2160 2021-10-20T23:27:38.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37417fa700 1 -- 172.21.15.12:0/1348118428 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3738018070 con 0x7f37440a2160 2021-10-20T23:27:38.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37440b3460 con 0x7f37440a2160 2021-10-20T23:27:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37417fa700 1 -- 172.21.15.12:0/1348118428 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3738007cd0 con 0x7f37440a2160 2021-10-20T23:27:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.794+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37440b2720 con 0x7f37440a2160 2021-10-20T23:27:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.798+0000 7f37417fa700 1 -- 172.21.15.12:0/1348118428 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f373801d070 con 0x7f37440a2160 2021-10-20T23:27:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.798+0000 7f37417fa700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37240534f0 0x7f37240559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.798+0000 7f37417fa700 1 -- 172.21.15.12:0/1348118428 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f373806c4d0 con 0x7f37440a2160 2021-10-20T23:27:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.798+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37440b35f0 con 0x7f37440a2160 2021-10-20T23:27:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.798+0000 7f3743fff700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37240534f0 0x7f37240559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.798+0000 7f3743fff700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37240534f0 0x7f37240559b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f3734005000 tx=0x7f37440af350).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.802+0000 7f37417fa700 1 -- 172.21.15.12:0/1348118428 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3738026020 con 0x7f37440a2160 2021-10-20T23:27:38.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f37440af460 con 0x7f37440a2160 2021-10-20T23:27:38.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37417fa700 1 -- 172.21.15.12:0/1348118428 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3738026020 con 0x7f37440a2160 2021-10-20T23:27:38.943 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:27:38.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37240534f0 msgr2=0x7f37240559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37240534f0 0x7f37240559b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f3734005000 tx=0x7f37440af350).stop 2021-10-20T23:27:38.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37440a2160 msgr2=0x7f3744155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:38.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37440a2160 0x7f3744155a40 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f37440af7e0 tx=0x7f3738015000).stop 2021-10-20T23:27:38.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 shutdown_connections 2021-10-20T23:27:38.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37240534f0 0x7f37240559b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744155f30 0x7f37441563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37440a2160 0x7f3744155a40 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 --2- 172.21.15.12:0/1348118428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3730004500 0x7f37440a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:38.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 >> 172.21.15.12:0/1348118428 conn(0x7f3744066de0 msgr2=0x7f3744146160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:38.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 shutdown_connections 2021-10-20T23:27:38.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:38.934+0000 7f37495ca700 1 -- 172.21.15.12:0/1348118428 wait complete. 2021-10-20T23:27:38.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff84a483700 1 Processor -- start 2021-10-20T23:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff84a483700 1 -- start start 2021-10-20T23:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff84a483700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff8440abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff84a483700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8440b1260 0x7ff8440ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff84a483700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440add80 con 0x7ff8440b1790 2021-10-20T23:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff84a483700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8440ae020 con 0x7ff8440b1260 2021-10-20T23:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff84a483700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440a9390 con 0x7ff8440b2580 2021-10-20T23:27:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff848c80700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8440b1260 0x7ff8440ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff848c80700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8440b1260 0x7ff8440ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43094/0 (socket says 172.21.15.12:43094) 2021-10-20T23:27:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff848c80700 1 -- 172.21.15.12:0/909661382 learned_addr learned my addr 172.21.15.12:0/909661382 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.066+0000 7ff849481700 1 --2- 172.21.15.12:0/909661382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff8440abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff848c80700 1 -- 172.21.15.12:0/909661382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 msgr2=0x7ff8440abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff848c80700 1 --2- 172.21.15.12:0/909661382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff8440abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff848c80700 1 -- 172.21.15.12:0/909661382 >> v1:172.21.15.31:6789/0 conn(0x7ff8440b1790 legacy=0x7ff8440afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff82ffff700 1 -- 172.21.15.12:0/909661382 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192791704 0 0) 0x7ff8440add80 con 0x7ff8440b1790 2021-10-20T23:27:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff848c80700 1 -- 172.21.15.12:0/909661382 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440a9830 con 0x7ff8440b1260 2021-10-20T23:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff849481700 1 --2- 172.21.15.12:0/909661382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff8440abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff848c80700 1 --2- 172.21.15.12:0/909661382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 0x7ff8440ac000 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7ff844067a30 tx=0x7ff838006eb0).ready entity=mon.0 client_cookie=6362759f1ca80b26 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff82ffff700 1 -- 172.21.15.12:0/909661382 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff83800d5c0 con 0x7ff8440b1260 2021-10-20T23:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff82ffff700 1 -- 172.21.15.12:0/909661382 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838000e90 con 0x7ff8440b1260 2021-10-20T23:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff82ffff700 1 -- 172.21.15.12:0/909661382 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff83800d910 con 0x7ff8440b1260 2021-10-20T23:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 -- 172.21.15.12:0/909661382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 msgr2=0x7ff8440ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 --2- 172.21.15.12:0/909661382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 0x7ff8440ac000 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7ff844067a30 tx=0x7ff838006eb0).stop 2021-10-20T23:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 -- 172.21.15.12:0/909661382 shutdown_connections 2021-10-20T23:27:39.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 --2- 172.21.15.12:0/909661382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 0x7ff8440ac000 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 --2- 172.21.15.12:0/909661382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff8440abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 -- 172.21.15.12:0/909661382 >> 172.21.15.12:0/909661382 conn(0x7ff844060180 msgr2=0x7ff8440b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:39.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 -- 172.21.15.12:0/909661382 shutdown_connections 2021-10-20T23:27:39.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 -- 172.21.15.12:0/909661382 wait complete. 2021-10-20T23:27:39.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 Processor -- start 2021-10-20T23:27:39.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 -- start start 2021-10-20T23:27:39.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 0x7ff844149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440b1790 0x7ff84413b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff84413be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84414a6b0 con 0x7ff8440b1260 2021-10-20T23:27:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844145050 con 0x7ff8440b1790 2021-10-20T23:27:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff84a483700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff844145280 con 0x7ff8440b2580 2021-10-20T23:27:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff849481700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 0x7ff844149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff849481700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 0x7ff844149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43098/0 (socket says 172.21.15.12:43098) 2021-10-20T23:27:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff849481700 1 -- 172.21.15.12:0/3890424363 learned_addr learned my addr 172.21.15.12:0/3890424363 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff848c80700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440b1790 0x7ff84413b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.070+0000 7ff849c82700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff84413be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff849481700 1 -- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 msgr2=0x7ff84413be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff849481700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff84413be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff849481700 1 -- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440b1790 msgr2=0x7ff84413b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff849481700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440b1790 0x7ff84413b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff849481700 1 -- 172.21.15.12:0/3890424363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84000b180 con 0x7ff8440b1260 2021-10-20T23:27:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff848c80700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440b1790 0x7ff84413b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff849c82700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff84413be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff849481700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 0x7ff844149cb0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7ff844144d00 tx=0x7ff840006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff836ffd700 1 -- 172.21.15.12:0/3890424363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff840010780 con 0x7ff8440b1260 2021-10-20T23:27:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff836ffd700 1 -- 172.21.15.12:0/3890424363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400108e0 con 0x7ff8440b1260 2021-10-20T23:27:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83800b1e0 con 0x7ff8440b1260 2021-10-20T23:27:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff836ffd700 1 -- 172.21.15.12:0/3890424363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff840010c40 con 0x7ff8440b1260 2021-10-20T23:27:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8441457c0 con 0x7ff8440b1260 2021-10-20T23:27:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.074+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84413c4a0 con 0x7ff8440b1260 2021-10-20T23:27:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.078+0000 7ff836ffd700 1 -- 172.21.15.12:0/3890424363 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff84001c460 con 0x7ff8440b1260 2021-10-20T23:27:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.078+0000 7ff836ffd700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff820053640 0x7ff820055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.078+0000 7ff836ffd700 1 -- 172.21.15.12:0/3890424363 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff84006bfe0 con 0x7ff8440b1260 2021-10-20T23:27:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.078+0000 7ff848c80700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff820053640 0x7ff820055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.078+0000 7ff848c80700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff820053640 0x7ff820055b00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7ff83801c000 tx=0x7ff838015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.082+0000 7ff836ffd700 1 -- 172.21.15.12:0/3890424363 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff840042ee0 con 0x7ff8440b1260 2021-10-20T23:27:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.210+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff844145c00 con 0x7ff8440b1260 2021-10-20T23:27:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.210+0000 7ff836ffd700 1 -- 172.21.15.12:0/3890424363 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff840046500 con 0x7ff8440b1260 2021-10-20T23:27:39.221 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:39.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff820053640 msgr2=0x7ff820055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff820053640 0x7ff820055b00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7ff83801c000 tx=0x7ff838015000).stop 2021-10-20T23:27:39.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 msgr2=0x7ff844149cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 0x7ff844149cb0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7ff844144d00 tx=0x7ff840006df0).stop 2021-10-20T23:27:39.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 shutdown_connections 2021-10-20T23:27:39.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff820053640 0x7ff820055b00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440b2580 0x7ff84413be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440b1790 0x7ff84413b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 --2- 172.21.15.12:0/3890424363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8440b1260 0x7ff844149cb0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 >> 172.21.15.12:0/3890424363 conn(0x7ff844060180 msgr2=0x7ff8440b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:39.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 shutdown_connections 2021-10-20T23:27:39.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.214+0000 7ff84a483700 1 -- 172.21.15.12:0/3890424363 wait complete. 2021-10-20T23:27:39.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:27:39.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae9a464700 1 Processor -- start 2021-10-20T23:27:39.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae9a464700 1 -- start start 2021-10-20T23:27:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae9a464700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940b2850 0x7fae940b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae9a464700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae940acf20 0x7fae940ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae9a464700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae940b2c30 con 0x7fae9413c6e0 2021-10-20T23:27:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae9a464700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9413d230 con 0x7fae940acf20 2021-10-20T23:27:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae9a464700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940b1660 con 0x7fae940b2850 2021-10-20T23:27:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99462700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940b2850 0x7fae940b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99c63700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae940acf20 0x7fae940ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99462700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940b2850 0x7fae940b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:48862/0 (socket says 172.21.15.12:48862) 2021-10-20T23:27:39.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99462700 1 -- 172.21.15.12:0/1572381868 learned_addr learned my addr 172.21.15.12:0/1572381868 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:39.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae98c61700 1 --1- 172.21.15.12:0/1572381868 >> v1:172.21.15.31:6789/0 conn(0x7fae9413c6e0 0x7fae9413cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:48762/0 (socket says 172.21.15.12:48762) 2021-10-20T23:27:39.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99c63700 1 -- 172.21.15.12:0/1572381868 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940b2850 msgr2=0x7fae940b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:39.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99c63700 1 --2- 172.21.15.12:0/1572381868 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940b2850 0x7fae940b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99c63700 1 -- 172.21.15.12:0/1572381868 >> v1:172.21.15.31:6789/0 conn(0x7fae9413c6e0 legacy=0x7fae9413cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99c63700 1 -- 172.21.15.12:0/1572381868 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae940b1900 con 0x7fae940acf20 2021-10-20T23:27:39.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99462700 1 --2- 172.21.15.12:0/1572381868 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940b2850 0x7fae940b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:39.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae99c63700 1 --2- 172.21.15.12:0/1572381868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae940acf20 0x7fae940ad3b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fae8c0032f0 tx=0x7fae8c00b470).ready entity=mon.1 client_cookie=acc9c945b4557d04 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae8bfff700 1 -- 172.21.15.12:0/1572381868 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c00dd70 con 0x7fae940acf20 2021-10-20T23:27:39.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae8bfff700 1 -- 172.21.15.12:0/1572381868 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c010470 con 0x7fae940acf20 2021-10-20T23:27:39.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.338+0000 7fae8bfff700 1 -- 172.21.15.12:0/1572381868 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c0107d0 con 0x7fae940acf20 2021-10-20T23:27:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 -- 172.21.15.12:0/1572381868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae940acf20 msgr2=0x7fae940ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 --2- 172.21.15.12:0/1572381868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae940acf20 0x7fae940ad3b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fae8c0032f0 tx=0x7fae8c00b470).stop 2021-10-20T23:27:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 -- 172.21.15.12:0/1572381868 shutdown_connections 2021-10-20T23:27:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 --2- 172.21.15.12:0/1572381868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae940acf20 0x7fae940ad3b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 --2- 172.21.15.12:0/1572381868 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940b2850 0x7fae940b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 -- 172.21.15.12:0/1572381868 >> 172.21.15.12:0/1572381868 conn(0x7fae94061230 msgr2=0x7fae94062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 -- 172.21.15.12:0/1572381868 shutdown_connections 2021-10-20T23:27:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 -- 172.21.15.12:0/1572381868 wait complete. 2021-10-20T23:27:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 Processor -- start 2021-10-20T23:27:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.342+0000 7fae9a464700 1 -- start start 2021-10-20T23:27:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae9a464700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940acf20 0x7fae940b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae9a464700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae940b2850 0x7fae9413eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae9a464700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9413c6e0 0x7fae940b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae9a464700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94146120 con 0x7fae940b2850 2021-10-20T23:27:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae9a464700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94141600 con 0x7fae9413c6e0 2021-10-20T23:27:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae9a464700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940b3b50 con 0x7fae940acf20 2021-10-20T23:27:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae98c61700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae940b2850 0x7fae9413eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae98c61700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae940b2850 0x7fae9413eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43112/0 (socket says 172.21.15.12:43112) 2021-10-20T23:27:39.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae99462700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940acf20 0x7fae940b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae98c61700 1 -- 172.21.15.12:0/3017845240 learned_addr learned my addr 172.21.15.12:0/3017845240 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:39.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae99c63700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9413c6e0 0x7fae940b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae98c61700 1 -- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940acf20 msgr2=0x7fae940b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae98c61700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940acf20 0x7fae940b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae98c61700 1 -- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9413c6e0 msgr2=0x7fae940b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae98c61700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9413c6e0 0x7fae940b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae98c61700 1 -- 172.21.15.12:0/3017845240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8400b1e0 con 0x7fae940b2850 2021-10-20T23:27:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae98c61700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae940b2850 0x7fae9413eb70 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fae94141740 tx=0x7fae90007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae8a7fc700 1 -- 172.21.15.12:0/3017845240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae900070d0 con 0x7fae940b2850 2021-10-20T23:27:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae8a7fc700 1 -- 172.21.15.12:0/3017845240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90007230 con 0x7fae940b2850 2021-10-20T23:27:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c00b710 con 0x7fae940b2850 2021-10-20T23:27:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae8a7fc700 1 -- 172.21.15.12:0/3017845240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae90005550 con 0x7fae940b2850 2021-10-20T23:27:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.346+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae94151650 con 0x7fae940b2850 2021-10-20T23:27:39.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.350+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae94057350 con 0x7fae940b2850 2021-10-20T23:27:39.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.350+0000 7fae8a7fc700 1 -- 172.21.15.12:0/3017845240 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fae90010070 con 0x7fae940b2850 2021-10-20T23:27:39.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.350+0000 7fae8a7fc700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae7c053640 0x7fae7c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.350+0000 7fae8a7fc700 1 -- 172.21.15.12:0/3017845240 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fae9006afb0 con 0x7fae940b2850 2021-10-20T23:27:39.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.350+0000 7fae99462700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae7c053640 0x7fae7c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.350+0000 7fae99462700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae7c053640 0x7fae7c055b00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fae8400b000 tx=0x7fae84006eb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.354+0000 7fae8a7fc700 1 -- 172.21.15.12:0/3017845240 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae90041f10 con 0x7fae940b2850 2021-10-20T23:27:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.482+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae9405f240 con 0x7fae940b2850 2021-10-20T23:27:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae8a7fc700 1 -- 172.21.15.12:0/3017845240 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+10 (secure 0 0 0) 0x7fae90018070 con 0x7fae940b2850 2021-10-20T23:27:39.493 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae7c053640 msgr2=0x7fae7c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae7c053640 0x7fae7c055b00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fae8400b000 tx=0x7fae84006eb0).stop 2021-10-20T23:27:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae940b2850 msgr2=0x7fae9413eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae940b2850 0x7fae9413eb70 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fae94141740 tx=0x7fae90007c60).stop 2021-10-20T23:27:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 shutdown_connections 2021-10-20T23:27:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fae7c053640 0x7fae7c055b00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9413c6e0 0x7fae940b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae940b2850 0x7fae9413eb70 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 --2- 172.21.15.12:0/3017845240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae940acf20 0x7fae940b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 >> 172.21.15.12:0/3017845240 conn(0x7fae94061230 msgr2=0x7fae94139830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 shutdown_connections 2021-10-20T23:27:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.486+0000 7fae9a464700 1 -- 172.21.15.12:0/3017845240 wait complete. 2021-10-20T23:27:39.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:27:39.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de61dc700 1 Processor -- start 2021-10-20T23:27:39.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de61dc700 1 -- start start 2021-10-20T23:27:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de61dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 0x7f5de00aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de61dc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5de00ad310 0x7f5de00af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de61dc700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de00af5e0 con 0x7f5de00b0690 2021-10-20T23:27:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de61dc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de00b2b00 con 0x7f5de00ad310 2021-10-20T23:27:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de61dc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00ac6f0 con 0x7f5de00b2720 2021-10-20T23:27:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de49d9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5de00ad310 0x7f5de00af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de49d9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5de00ad310 0x7f5de00af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43120/0 (socket says 172.21.15.12:43120) 2021-10-20T23:27:39.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de59db700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5de00b0690 0x7f5de005c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41714/0 (socket says 172.21.15.12:41714) 2021-10-20T23:27:39.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de49d9700 1 -- 172.21.15.12:0/785334961 learned_addr learned my addr 172.21.15.12:0/785334961 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:39.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de51da700 1 --2- 172.21.15.12:0/785334961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 0x7f5de00aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de49d9700 1 -- 172.21.15.12:0/785334961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 msgr2=0x7f5de00aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de49d9700 1 --2- 172.21.15.12:0/785334961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 0x7f5de00aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de49d9700 1 -- 172.21.15.12:0/785334961 >> v1:172.21.15.12:6789/0 conn(0x7f5de00b0690 legacy=0x7f5de005c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de49d9700 1 -- 172.21.15.12:0/785334961 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de00ac990 con 0x7f5de00ad310 2021-10-20T23:27:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5de49d9700 1 --2- 172.21.15.12:0/785334961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00ad310 0x7f5de00af0f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f5dd4002f70 tx=0x7f5dd4006eb0).ready entity=mon.0 client_cookie=4b60f4a8673d185 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5dcbfff700 1 -- 172.21.15.12:0/785334961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd400bcf0 con 0x7f5de00ad310 2021-10-20T23:27:39.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5dcbfff700 1 -- 172.21.15.12:0/785334961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd4000e90 con 0x7f5de00ad310 2021-10-20T23:27:39.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.610+0000 7f5dcbfff700 1 -- 172.21.15.12:0/785334961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd400be90 con 0x7f5de00ad310 2021-10-20T23:27:39.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 -- 172.21.15.12:0/785334961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00ad310 msgr2=0x7f5de00af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 --2- 172.21.15.12:0/785334961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00ad310 0x7f5de00af0f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f5dd4002f70 tx=0x7f5dd4006eb0).stop 2021-10-20T23:27:39.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 -- 172.21.15.12:0/785334961 shutdown_connections 2021-10-20T23:27:39.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 --2- 172.21.15.12:0/785334961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00ad310 0x7f5de00af0f0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 --2- 172.21.15.12:0/785334961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 0x7f5de00aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 -- 172.21.15.12:0/785334961 >> 172.21.15.12:0/785334961 conn(0x7f5de0060180 msgr2=0x7f5de00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:39.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 -- 172.21.15.12:0/785334961 shutdown_connections 2021-10-20T23:27:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 -- 172.21.15.12:0/785334961 wait complete. 2021-10-20T23:27:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 Processor -- start 2021-10-20T23:27:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 -- start start 2021-10-20T23:27:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5de00ad310 0x7f5de0066d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00b0690 0x7f5de0146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 0x7f5de00646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de0064040 con 0x7f5de00b0690 2021-10-20T23:27:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de0144f60 con 0x7f5de00ad310 2021-10-20T23:27:39.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de61dc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de0145200 con 0x7f5de00b2720 2021-10-20T23:27:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de49d9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00b0690 0x7f5de0146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de49d9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00b0690 0x7f5de0146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43126/0 (socket says 172.21.15.12:43126) 2021-10-20T23:27:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de49d9700 1 -- 172.21.15.12:0/1620757545 learned_addr learned my addr 172.21.15.12:0/1620757545 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de51da700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5de00ad310 0x7f5de0066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de59db700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 0x7f5de00646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de49d9700 1 -- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 msgr2=0x7f5de00646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de49d9700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 0x7f5de00646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de49d9700 1 -- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5de00ad310 msgr2=0x7f5de0066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de49d9700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5de00ad310 0x7f5de0066d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de49d9700 1 -- 172.21.15.12:0/1620757545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4009a50 con 0x7f5de00b0690 2021-10-20T23:27:39.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.614+0000 7f5de49d9700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00b0690 0x7f5de0146f00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f5dd4002f70 tx=0x7f5dd4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5dd2ffd700 1 -- 172.21.15.12:0/1620757545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd4011700 con 0x7f5de00b0690 2021-10-20T23:27:39.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5dd2ffd700 1 -- 172.21.15.12:0/1620757545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd4011860 con 0x7f5de00b0690 2021-10-20T23:27:39.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de01454a0 con 0x7f5de00b0690 2021-10-20T23:27:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5dd2ffd700 1 -- 172.21.15.12:0/1620757545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd4011bc0 con 0x7f5de00b0690 2021-10-20T23:27:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de01539c0 con 0x7f5de00b0690 2021-10-20T23:27:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de0145630 con 0x7f5de00b0690 2021-10-20T23:27:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5dd2ffd700 1 -- 172.21.15.12:0/1620757545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5dd4026030 con 0x7f5de00b0690 2021-10-20T23:27:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5dd2ffd700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dbc0536a0 0x7f5dbc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5dd2ffd700 1 -- 172.21.15.12:0/1620757545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5dd406c150 con 0x7f5de00b0690 2021-10-20T23:27:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5de51da700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dbc0536a0 0x7f5dbc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.618+0000 7f5de51da700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dbc0536a0 0x7f5dbc055b60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f5ddc00c000 tx=0x7f5ddc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.626+0000 7f5dd2ffd700 1 -- 172.21.15.12:0/1620757545 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5dd4043150 con 0x7f5de00b0690 2021-10-20T23:27:39.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.750+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5de00acc30 con 0x7f5de00b0690 2021-10-20T23:27:39.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.750+0000 7f5dd2ffd700 1 -- 172.21.15.12:0/1620757545 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5dd40150a0 con 0x7f5de00b0690 2021-10-20T23:27:39.761 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:39.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dbc0536a0 msgr2=0x7f5dbc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dbc0536a0 0x7f5dbc055b60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f5ddc00c000 tx=0x7f5ddc008040).stop 2021-10-20T23:27:39.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00b0690 msgr2=0x7f5de0146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00b0690 0x7f5de0146f00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f5dd4002f70 tx=0x7f5dd4016000).stop 2021-10-20T23:27:39.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 shutdown_connections 2021-10-20T23:27:39.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5dbc0536a0 0x7f5dbc055b60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5de00b2720 0x7f5de00646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de00b0690 0x7f5de0146f00 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 --2- 172.21.15.12:0/1620757545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5de00ad310 0x7f5de0066d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 >> 172.21.15.12:0/1620757545 conn(0x7f5de0060180 msgr2=0x7f5de005cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:39.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 shutdown_connections 2021-10-20T23:27:39.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.754+0000 7f5de61dc700 1 -- 172.21.15.12:0/1620757545 wait complete. 2021-10-20T23:27:39.774 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:27:39.775 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:39.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6a8a1700 1 Processor -- start 2021-10-20T23:27:39.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6a8a1700 1 -- start start 2021-10-20T23:27:39.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6a8a1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a640b2580 0x7f1a6414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6a8a1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640b0010 0x7f1a6414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6a8a1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a640a70c0 con 0x7f1a640afbd0 2021-10-20T23:27:39.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6a8a1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640a72f0 con 0x7f1a640b2580 2021-10-20T23:27:39.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6a8a1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640a7590 con 0x7f1a640b0010 2021-10-20T23:27:39.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6989f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a640b2580 0x7f1a6414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6a0a0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1a640afbd0 0x7f1a640a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41730/0 (socket says 172.21.15.12:41730) 2021-10-20T23:27:39.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6a0a0700 1 -- 172.21.15.12:0/3059508452 learned_addr learned my addr 172.21.15.12:0/3059508452 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:39.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6909e700 1 --2- 172.21.15.12:0/3059508452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640b0010 0x7f1a6414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6889d700 1 -- 172.21.15.12:0/3059508452 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470303395 0 0) 0x7f1a640a70c0 con 0x7f1a640afbd0 2021-10-20T23:27:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6889d700 1 -- 172.21.15.12:0/3059508452 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a4c003260 con 0x7f1a640afbd0 2021-10-20T23:27:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6989f700 1 -- 172.21.15.12:0/3059508452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640b0010 msgr2=0x7f1a6414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6989f700 1 --2- 172.21.15.12:0/3059508452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640b0010 0x7f1a6414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6989f700 1 -- 172.21.15.12:0/3059508452 >> v1:172.21.15.12:6789/0 conn(0x7f1a640afbd0 legacy=0x7f1a640a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6989f700 1 -- 172.21.15.12:0/3059508452 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a640a7830 con 0x7f1a640b2580 2021-10-20T23:27:39.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6909e700 1 --2- 172.21.15.12:0/3059508452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640b0010 0x7f1a6414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:39.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6989f700 1 --2- 172.21.15.12:0/3059508452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b2580 0x7f1a6414ae40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f1a54002f70 tx=0x7f1a54006df0).ready entity=mon.0 client_cookie=75ac8b17cf0f3de3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6889d700 1 -- 172.21.15.12:0/3059508452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5400d4a0 con 0x7f1a640b2580 2021-10-20T23:27:39.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.866+0000 7f1a6889d700 1 -- 172.21.15.12:0/3059508452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54000e90 con 0x7f1a640b2580 2021-10-20T23:27:39.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6889d700 1 -- 172.21.15.12:0/3059508452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5400d7f0 con 0x7f1a640b2580 2021-10-20T23:27:39.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/3059508452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b2580 msgr2=0x7f1a6414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 --2- 172.21.15.12:0/3059508452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b2580 0x7f1a6414ae40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f1a54002f70 tx=0x7f1a54006df0).stop 2021-10-20T23:27:39.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/3059508452 shutdown_connections 2021-10-20T23:27:39.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 --2- 172.21.15.12:0/3059508452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640b0010 0x7f1a6414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 --2- 172.21.15.12:0/3059508452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b2580 0x7f1a6414ae40 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/3059508452 >> 172.21.15.12:0/3059508452 conn(0x7f1a64060180 msgr2=0x7f1a640b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/3059508452 shutdown_connections 2021-10-20T23:27:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/3059508452 wait complete. 2021-10-20T23:27:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 Processor -- start 2021-10-20T23:27:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 -- start start 2021-10-20T23:27:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640afbd0 0x7f1a640aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b0010 0x7f1a640ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a640b2580 0x7f1a640ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640631c0 con 0x7f1a640b0010 2021-10-20T23:27:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64156e70 con 0x7f1a640b2580 2021-10-20T23:27:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a8a1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64157110 con 0x7f1a640afbd0 2021-10-20T23:27:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6909e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b0010 0x7f1a640ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6909e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b0010 0x7f1a640ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43140/0 (socket says 172.21.15.12:43140) 2021-10-20T23:27:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6909e700 1 -- 172.21.15.12:0/211001916 learned_addr learned my addr 172.21.15.12:0/211001916 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:39.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6989f700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640afbd0 0x7f1a640aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6a0a0700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a640b2580 0x7f1a640ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6909e700 1 -- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640afbd0 msgr2=0x7f1a640aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6909e700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640afbd0 0x7f1a640aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6909e700 1 -- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a640b2580 msgr2=0x7f1a640ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:39.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6909e700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a640b2580 0x7f1a640ab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:39.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6909e700 1 -- 172.21.15.12:0/211001916 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60009470 con 0x7f1a640b0010 2021-10-20T23:27:39.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.870+0000 7f1a6909e700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b0010 0x7f1a640ab310 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f1a6000c000 tx=0x7f1a600091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a52ffd700 1 -- 172.21.15.12:0/211001916 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a6000c920 con 0x7f1a640b0010 2021-10-20T23:27:39.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a52ffd700 1 -- 172.21.15.12:0/211001916 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6000ca80 con 0x7f1a640b0010 2021-10-20T23:27:39.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5400b180 con 0x7f1a640b0010 2021-10-20T23:27:39.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a52ffd700 1 -- 172.21.15.12:0/211001916 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a6000cde0 con 0x7f1a640b0010 2021-10-20T23:27:39.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a640b5be0 con 0x7f1a640b0010 2021-10-20T23:27:39.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a52ffd700 1 -- 172.21.15.12:0/211001916 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a60022070 con 0x7f1a640b0010 2021-10-20T23:27:39.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a640b5da0 con 0x7f1a640b0010 2021-10-20T23:27:39.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a52ffd700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a440536d0 0x7f1a44055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:39.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a52ffd700 1 -- 172.21.15.12:0/211001916 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1a6006c2b0 con 0x7f1a640b0010 2021-10-20T23:27:39.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a6989f700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a440536d0 0x7f1a44055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:39.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.874+0000 7f1a6989f700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a440536d0 0x7f1a44055b90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f1a5401a000 tx=0x7f1a54014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:39.882+0000 7f1a52ffd700 1 -- 172.21.15.12:0/211001916 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a600432b0 con 0x7f1a640b0010 2021-10-20T23:27:40.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.042+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a64057350 con 0x7f1a640b0010 2021-10-20T23:27:40.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a52ffd700 1 -- 172.21.15.12:0/211001916 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f1a600468d0 con 0x7f1a640b0010 2021-10-20T23:27:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:40.055 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1540805449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1540805449},{"type":"v1","addr":"172.21.15.31:6835","nonce":1540805449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2826685098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2826685098},{"type":"v1","addr":"172.21.15.12:6833","nonce":2826685098}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:35.417915+0000","modified":"2021-10-20T23:27:36.421728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3124306556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3124306556},{"type":"v1","addr":"172.21.15.12:6835","nonce":3124306556}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-20T23:27:40.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a440536d0 msgr2=0x7f1a44055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:40.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a440536d0 0x7f1a44055b90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f1a5401a000 tx=0x7f1a54014000).stop 2021-10-20T23:27:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b0010 msgr2=0x7f1a640ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b0010 0x7f1a640ab310 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f1a6000c000 tx=0x7f1a600091d0).stop 2021-10-20T23:27:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 shutdown_connections 2021-10-20T23:27:40.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a440536d0 0x7f1a44055b90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:40.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a640b2580 0x7f1a640ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640b0010 0x7f1a640ab310 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 --2- 172.21.15.12:0/211001916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a640afbd0 0x7f1a640aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 >> 172.21.15.12:0/211001916 conn(0x7f1a64060180 msgr2=0x7f1a64149b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 shutdown_connections 2021-10-20T23:27:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:40.046+0000 7f1a6a8a1700 1 -- 172.21.15.12:0/211001916 wait complete. 2021-10-20T23:27:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 54 2021-10-20T23:27:40.376 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:27:35.417915+0000', 'modified': '2021-10-20T23:27:36.421728+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7257': {'gid': 7257, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/3124306556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 3124306556}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 3124306556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:27:40.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:27:40.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:27:40.498 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":7257,"want_state":"up:active","state":"up:active","rank_uptime":5.0625549660000004,"mdsmap_epoch":54,"osdmap_epoch":112,"osdmap_epoch_barrier":112,"uptime":9.7553986909999999} 2021-10-20T23:27:40.499 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 7257, "mdsmap_epoch": 54, "osdmap_epoch": 112, "osdmap_epoch_barrier": 112, "rank_uptime": 5.062554966, "state": "up:active", "uptime": 9.755398691, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:27:40.500 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:27:40.500 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:27:40.500 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:27:40.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:40.501 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:40.510 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:27:40.570 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:27:40.571 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:27:40.585 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:27:40.586 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:27:40.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:40.589 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:27:40.596 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:27:40.597 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:40.639 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:27:40.655 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:27:40.656 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:27:40.668 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:27:40.670 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:27:40.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:40.671 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:27:40.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:27:40.710+0000 7fc032935080 -1 init, newargv = 0x55bb7015eb10 newargc=9ceph-fuse[14725]: starting ceph client 2021-10-20T23:27:40.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr: 2021-10-20T23:27:40.724 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14725]: starting fuse 2021-10-20T23:27:41.779 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:27:41.798 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:27:41.799 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:27:41.856 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:27:41.857 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:27:41.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:41.859 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:27:41.866 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:27:41.867 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:27:41.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:41.868 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:27:41.868 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:27:41.869 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:27:41.869 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:27:41.870 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:27:41.870 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:27:41.870 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:27:41.871 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:27:41.871 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:27:41.872 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:27:41.872 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:27:41.872 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:27:41.873 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:27:41.873 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:27:41.874 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:27:41.874 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:27:41.874 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:27:41.875 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:27:41.875 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:27:41.876 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:27:41.876 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:27:41.876 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:27:41.877 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:27:41.921 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14725.asok 2021-10-20T23:27:41.926 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14725.asok 2021-10-20T23:27:41.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:41.927 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14725.asok status 2021-10-20T23:27:42.015 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:27:42.015 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:27:42.015 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:27:42.016 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:27:42.016 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:27:42.016 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:27:42.016 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:27:42.016 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14725", 2021-10-20T23:27:42.017 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:27:42.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:27:42.017 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:27:42.017 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:27:42.018 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 7425, 2021-10-20T23:27:42.018 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:27:42.018 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:27:42.018 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:27:42.019 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 7425 2021-10-20T23:27:42.019 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:27:42.019 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:27:42.019 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:27:42.020 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:27:42.020 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 405584499 2021-10-20T23:27:42.020 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:27:42.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:27:42.025 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:27:42.026 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:27:42.026 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:27:42.026 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 405584499 2021-10-20T23:27:42.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:27:42.027 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.7425 172.21.15.119:0/405584499", 2021-10-20T23:27:42.027 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/405584499", 2021-10-20T23:27:42.027 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:27:42.027 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 54, 2021-10-20T23:27:42.027 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 112, 2021-10-20T23:27:42.028 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:27:42.028 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:27:42.028 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:27:42.028 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:27:42.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:42.030 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:42.031 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:42.037 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:27:42.038 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:27:42.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:42.039 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:42.098 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:42.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.202+0000 7fe6291fc700 1 Processor -- start 2021-10-20T23:27:42.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6291fc700 1 -- start start 2021-10-20T23:27:42.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6291fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe6240b0710 0x7fe624142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6291fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240ace70 0x7fe62413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6291fc700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe624143920 con 0x7fe6240b30d0 2021-10-20T23:27:42.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6291fc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6240b0af0 con 0x7fe6240b0710 2021-10-20T23:27:42.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6291fc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240ae680 con 0x7fe6240ace70 2021-10-20T23:27:42.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe623fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe6240b0710 0x7fe624142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe623fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe6240b0710 0x7fe624142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43146/0 (socket says 172.21.15.12:43146) 2021-10-20T23:27:42.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe61b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe6240b30d0 0x7fe624143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41742/0 (socket says 172.21.15.12:41742) 2021-10-20T23:27:42.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe623fff700 1 -- 172.21.15.12:0/840890829 learned_addr learned my addr 172.21.15.12:0/840890829 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:42.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6289fb700 1 --2- 172.21.15.12:0/840890829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240ace70 0x7fe62413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe623fff700 1 -- 172.21.15.12:0/840890829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240ace70 msgr2=0x7fe62413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:42.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe623fff700 1 --2- 172.21.15.12:0/840890829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240ace70 0x7fe62413f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6237fe700 1 -- 172.21.15.12:0/840890829 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164579577 0 0) 0x7fe624143920 con 0x7fe6240b30d0 2021-10-20T23:27:42.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe623fff700 1 -- 172.21.15.12:0/840890829 >> v1:172.21.15.12:6789/0 conn(0x7fe6240b30d0 legacy=0x7fe624143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe623fff700 1 -- 172.21.15.12:0/840890829 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6240ae920 con 0x7fe6240b0710 2021-10-20T23:27:42.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6289fb700 1 --2- 172.21.15.12:0/840890829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240ace70 0x7fe62413f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:42.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe623fff700 1 --2- 172.21.15.12:0/840890829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 0x7fe624142d20 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fe614002f70 tx=0x7fe614006eb0).ready entity=mon.0 client_cookie=1d92010242b8f235 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:42.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6237fe700 1 -- 172.21.15.12:0/840890829 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe61400d5c0 con 0x7fe6240b0710 2021-10-20T23:27:42.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6237fe700 1 -- 172.21.15.12:0/840890829 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe614000e90 con 0x7fe6240b0710 2021-10-20T23:27:42.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.206+0000 7fe6237fe700 1 -- 172.21.15.12:0/840890829 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe61400d910 con 0x7fe6240b0710 2021-10-20T23:27:42.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 -- 172.21.15.12:0/840890829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 msgr2=0x7fe624142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 --2- 172.21.15.12:0/840890829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 0x7fe624142d20 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fe614002f70 tx=0x7fe614006eb0).stop 2021-10-20T23:27:42.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 -- 172.21.15.12:0/840890829 shutdown_connections 2021-10-20T23:27:42.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 --2- 172.21.15.12:0/840890829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240ace70 0x7fe62413f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 --2- 172.21.15.12:0/840890829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 0x7fe624142d20 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 -- 172.21.15.12:0/840890829 >> 172.21.15.12:0/840890829 conn(0x7fe624061140 msgr2=0x7fe624062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:42.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 -- 172.21.15.12:0/840890829 shutdown_connections 2021-10-20T23:27:42.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 -- 172.21.15.12:0/840890829 wait complete. 2021-10-20T23:27:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 Processor -- start 2021-10-20T23:27:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.210+0000 7fe6291fc700 1 -- start start 2021-10-20T23:27:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6291fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240ace70 0x7fe624067100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6291fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 0x7fe62409f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6291fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240b30d0 0x7fe62409f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6291fc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62409fe70 con 0x7fe6240b0710 2021-10-20T23:27:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6291fc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe624143ec0 con 0x7fe6240ace70 2021-10-20T23:27:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6291fc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe624144160 con 0x7fe6240b30d0 2021-10-20T23:27:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe61b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 0x7fe62409f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe61b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 0x7fe62409f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43154/0 (socket says 172.21.15.12:43154) 2021-10-20T23:27:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe61b7fe700 1 -- 172.21.15.12:0/2146124259 learned_addr learned my addr 172.21.15.12:0/2146124259 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe623fff700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240ace70 0x7fe624067100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6289fb700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240b30d0 0x7fe62409f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe61b7fe700 1 -- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240b30d0 msgr2=0x7fe62409f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe61b7fe700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240b30d0 0x7fe62409f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe61b7fe700 1 -- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240ace70 msgr2=0x7fe624067100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe61b7fe700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240ace70 0x7fe624067100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe61b7fe700 1 -- 172.21.15.12:0/2146124259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61400b1e0 con 0x7fe6240b0710 2021-10-20T23:27:42.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6289fb700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240b30d0 0x7fe62409f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:42.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe61b7fe700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 0x7fe62409f490 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fe60c000ed0 tx=0x7fe60c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:42.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe621ffb700 1 -- 172.21.15.12:0/2146124259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe60c0070d0 con 0x7fe6240b0710 2021-10-20T23:27:42.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe621ffb700 1 -- 172.21.15.12:0/2146124259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c007230 con 0x7fe6240b0710 2021-10-20T23:27:42.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe624144400 con 0x7fe6240b0710 2021-10-20T23:27:42.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe621ffb700 1 -- 172.21.15.12:0/2146124259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe60c005550 con 0x7fe6240b0710 2021-10-20T23:27:42.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.214+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6240a2300 con 0x7fe6240b0710 2021-10-20T23:27:42.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.218+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe624057350 con 0x7fe6240b0710 2021-10-20T23:27:42.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.218+0000 7fe621ffb700 1 -- 172.21.15.12:0/2146124259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe60c010070 con 0x7fe6240b0710 2021-10-20T23:27:42.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.218+0000 7fe621ffb700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6080536d0 0x7fe608055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.218+0000 7fe621ffb700 1 -- 172.21.15.12:0/2146124259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe60c06b260 con 0x7fe6240b0710 2021-10-20T23:27:42.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.218+0000 7fe623fff700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6080536d0 0x7fe608055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.218+0000 7fe623fff700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6080536d0 0x7fe608055b90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fe61401c000 tx=0x7fe614015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:42.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.226+0000 7fe621ffb700 1 -- 172.21.15.12:0/2146124259 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe60c042150 con 0x7fe6240b0710 2021-10-20T23:27:42.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.354+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe62409ea50 con 0x7fe6240b0710 2021-10-20T23:27:42.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.354+0000 7fe621ffb700 1 -- 172.21.15.12:0/2146124259 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fe60c045770 con 0x7fe6240b0710 2021-10-20T23:27:42.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:42.365 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":112,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:36.420656+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:33.634838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:34.436087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:42.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6080536d0 msgr2=0x7fe608055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6080536d0 0x7fe608055b90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fe61401c000 tx=0x7fe614015000).stop 2021-10-20T23:27:42.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 msgr2=0x7fe62409f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 0x7fe62409f490 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fe60c000ed0 tx=0x7fe60c007c80).stop 2021-10-20T23:27:42.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 shutdown_connections 2021-10-20T23:27:42.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe6080536d0 0x7fe608055b90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6240b30d0 0x7fe62409f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240b0710 0x7fe62409f490 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 --2- 172.21.15.12:0/2146124259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240ace70 0x7fe624067100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 >> 172.21.15.12:0/2146124259 conn(0x7fe624061140 msgr2=0x7fe6240b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 shutdown_connections 2021-10-20T23:27:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.358+0000 7fe6291fc700 1 -- 172.21.15.12:0/2146124259 wait complete. 2021-10-20T23:27:42.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:27:33.634838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:27:34.436087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:27:42.379 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:27:42.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.478+0000 7f4b3359e700 1 Processor -- start 2021-10-20T23:27:42.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.478+0000 7f4b3359e700 1 -- start start 2021-10-20T23:27:42.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4b34061700 0x7f4b34146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340aecf0 con 0x7f4b34061320 2021-10-20T23:27:42.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340b6f20 con 0x7f4b340ad5c0 2021-10-20T23:27:42.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b340aef20 con 0x7f4b34061700 2021-10-20T23:27:42.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b32d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4b34061700 0x7f4b34146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4b34061320 0x7f4b340b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41754/0 (socket says 172.21.15.12:41754) 2021-10-20T23:27:42.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b32d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4b34061700 0x7f4b34146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43162/0 (socket says 172.21.15.12:43162) 2021-10-20T23:27:42.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3259c700 1 -- 172.21.15.12:0/4141743160 learned_addr learned my addr 172.21.15.12:0/4141743160 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:42.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b32d9d700 1 -- 172.21.15.12:0/4141743160 >> v1:172.21.15.31:6789/0 conn(0x7f4b340ad5c0 legacy=0x7f4b34140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b32d9d700 1 -- 172.21.15.12:0/4141743160 >> v1:172.21.15.12:6789/0 conn(0x7f4b34061320 legacy=0x7f4b340b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b32d9d700 1 -- 172.21.15.12:0/4141743160 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b340af1c0 con 0x7f4b34061700 2021-10-20T23:27:42.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b32d9d700 1 --2- 172.21.15.12:0/4141743160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 0x7f4b34146520 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f4b2c0032f0 tx=0x7f4b2c0091d0).ready entity=mon.0 client_cookie=89c73dcdc83a5ec5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:42.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3159a700 1 -- 172.21.15.12:0/4141743160 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2c009ea0 con 0x7f4b34061700 2021-10-20T23:27:42.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3159a700 1 -- 172.21.15.12:0/4141743160 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00b8a0 con 0x7f4b34061700 2021-10-20T23:27:42.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3159a700 1 -- 172.21.15.12:0/4141743160 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2c00ba10 con 0x7f4b34061700 2021-10-20T23:27:42.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 -- 172.21.15.12:0/4141743160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 msgr2=0x7f4b34146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 --2- 172.21.15.12:0/4141743160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 0x7f4b34146520 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f4b2c0032f0 tx=0x7f4b2c0091d0).stop 2021-10-20T23:27:42.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 -- 172.21.15.12:0/4141743160 shutdown_connections 2021-10-20T23:27:42.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 --2- 172.21.15.12:0/4141743160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 0x7f4b34146520 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 -- 172.21.15.12:0/4141743160 >> 172.21.15.12:0/4141743160 conn(0x7f4b34066de0 msgr2=0x7f4b340671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:42.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 -- 172.21.15.12:0/4141743160 shutdown_connections 2021-10-20T23:27:42.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.482+0000 7f4b3359e700 1 -- 172.21.15.12:0/4141743160 wait complete. 2021-10-20T23:27:42.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3359e700 1 Processor -- start 2021-10-20T23:27:42.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3359e700 1 -- start start 2021-10-20T23:27:42.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b34061320 0x7f4b340b8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 0x7f4b3413c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b340ad5c0 0x7f4b3413cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b0e70 con 0x7f4b34061700 2021-10-20T23:27:42.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b10a0 con 0x7f4b34061320 2021-10-20T23:27:42.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b1340 con 0x7f4b340ad5c0 2021-10-20T23:27:42.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b31d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 0x7f4b3413c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b34061320 0x7f4b340b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b32d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b340ad5c0 0x7f4b3413cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b34061320 0x7f4b340b8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:58140/0 (socket says 172.21.15.12:58140) 2021-10-20T23:27:42.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3259c700 1 -- 172.21.15.12:0/1800565754 learned_addr learned my addr 172.21.15.12:0/1800565754 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:42.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b31d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 0x7f4b3413c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43170/0 (socket says 172.21.15.12:43170) 2021-10-20T23:27:42.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b31d9b700 1 -- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b340ad5c0 msgr2=0x7f4b3413cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b31d9b700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b340ad5c0 0x7f4b3413cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b31d9b700 1 -- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b34061320 msgr2=0x7f4b340b8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b31d9b700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b34061320 0x7f4b340b8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b31d9b700 1 -- 172.21.15.12:0/1800565754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c009470 con 0x7f4b34061700 2021-10-20T23:27:42.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b3259c700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b34061320 0x7f4b340b8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:42.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.486+0000 7f4b31d9b700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 0x7f4b3413c7f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f4b340af7e0 tx=0x7f4b24007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:42.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.490+0000 7f4b2b7fe700 1 -- 172.21.15.12:0/1800565754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2400ce80 con 0x7f4b34061700 2021-10-20T23:27:42.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.490+0000 7f4b2b7fe700 1 -- 172.21.15.12:0/1800565754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24013450 con 0x7f4b34061700 2021-10-20T23:27:42.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.490+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b340b15e0 con 0x7f4b34061700 2021-10-20T23:27:42.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.490+0000 7f4b2b7fe700 1 -- 172.21.15.12:0/1800565754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b240137b0 con 0x7f4b34061700 2021-10-20T23:27:42.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.490+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3413d1d0 con 0x7f4b34061700 2021-10-20T23:27:42.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.490+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b34152510 con 0x7f4b34061700 2021-10-20T23:27:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.490+0000 7f4b2b7fe700 1 -- 172.21.15.12:0/1800565754 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b2401a060 con 0x7f4b34061700 2021-10-20T23:27:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.490+0000 7f4b2b7fe700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b180534f0 0x7f4b180559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.490+0000 7f4b2b7fe700 1 -- 172.21.15.12:0/1800565754 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4b2406b0d0 con 0x7f4b34061700 2021-10-20T23:27:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.494+0000 7f4b3259c700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b180534f0 0x7f4b180559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.494+0000 7f4b3259c700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b180534f0 0x7f4b180559b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f4b1c00d000 tx=0x7f4b1c007c40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.498+0000 7f4b2b7fe700 1 -- 172.21.15.12:0/1800565754 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b240420d0 con 0x7f4b34061700 2021-10-20T23:27:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.622+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4b340af460 con 0x7f4b34061700 2021-10-20T23:27:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.622+0000 7f4b2b7fe700 1 -- 172.21.15.12:0/1800565754 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4b24018030 con 0x7f4b34061700 2021-10-20T23:27:42.632 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:27:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b180534f0 msgr2=0x7f4b180559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b180534f0 0x7f4b180559b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f4b1c00d000 tx=0x7f4b1c007c40).stop 2021-10-20T23:27:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 msgr2=0x7f4b3413c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 0x7f4b3413c7f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f4b340af7e0 tx=0x7f4b24007b90).stop 2021-10-20T23:27:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 shutdown_connections 2021-10-20T23:27:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b180534f0 0x7f4b180559b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b340ad5c0 0x7f4b3413cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b34061700 0x7f4b3413c7f0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 --2- 172.21.15.12:0/1800565754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b34061320 0x7f4b340b8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 >> 172.21.15.12:0/1800565754 conn(0x7f4b34066de0 msgr2=0x7f4b340671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 shutdown_connections 2021-10-20T23:27:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.626+0000 7f4b3359e700 1 -- 172.21.15.12:0/1800565754 wait complete. 2021-10-20T23:27:42.644 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:27:42.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.742+0000 7fea6f88e700 1 Processor -- start 2021-10-20T23:27:42.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.742+0000 7fea6f88e700 1 -- start start 2021-10-20T23:27:42.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fea68144440 0x7fea68144970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea680604e0 con 0x7fea68065420 2021-10-20T23:27:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea680b23b0 con 0x7fea68060100 2021-10-20T23:27:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea68065c80 con 0x7fea68144440 2021-10-20T23:27:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6de2b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fea68065420 0x7fea6814b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41770/0 (socket says 172.21.15.12:41770) 2021-10-20T23:27:42.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6de2b700 1 -- 172.21.15.12:0/1607980557 learned_addr learned my addr 172.21.15.12:0/1607980557 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:42.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6ce29700 1 --2- 172.21.15.12:0/1607980557 >> v2:172.21.15.31:3300/0 conn(0x7fea68144440 0x7fea68144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea57fff700 1 -- 172.21.15.12:0/1607980557 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334862093 0 0) 0x7fea680604e0 con 0x7fea68065420 2021-10-20T23:27:42.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea57fff700 1 -- 172.21.15.12:0/1607980557 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea50003260 con 0x7fea68065420 2021-10-20T23:27:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea57fff700 1 -- 172.21.15.12:0/1607980557 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596767210 0 0) 0x7fea680b23b0 con 0x7fea68060100 2021-10-20T23:27:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea57fff700 1 -- 172.21.15.12:0/1607980557 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea680604e0 con 0x7fea68060100 2021-10-20T23:27:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6ce29700 1 -- 172.21.15.12:0/1607980557 >> v1:172.21.15.31:6789/0 conn(0x7fea68060100 legacy=0x7fea68064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6ce29700 1 -- 172.21.15.12:0/1607980557 >> v1:172.21.15.12:6789/0 conn(0x7fea68065420 legacy=0x7fea6814b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6ce29700 1 -- 172.21.15.12:0/1607980557 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680b2650 con 0x7fea68144440 2021-10-20T23:27:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6ce29700 1 --2- 172.21.15.12:0/1607980557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea68144440 0x7fea68144970 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fea58002f70 tx=0x7fea58006df0).ready entity=mon.1 client_cookie=310945706b37599e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea57fff700 1 -- 172.21.15.12:0/1607980557 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5800d540 con 0x7fea68144440 2021-10-20T23:27:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea57fff700 1 -- 172.21.15.12:0/1607980557 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58000e90 con 0x7fea68144440 2021-10-20T23:27:42.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea57fff700 1 -- 172.21.15.12:0/1607980557 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5800d890 con 0x7fea68144440 2021-10-20T23:27:42.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 -- 172.21.15.12:0/1607980557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea68144440 msgr2=0x7fea68144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 --2- 172.21.15.12:0/1607980557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea68144440 0x7fea68144970 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fea58002f70 tx=0x7fea58006df0).stop 2021-10-20T23:27:42.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 -- 172.21.15.12:0/1607980557 shutdown_connections 2021-10-20T23:27:42.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 --2- 172.21.15.12:0/1607980557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea68144440 0x7fea68144970 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 -- 172.21.15.12:0/1607980557 >> 172.21.15.12:0/1607980557 conn(0x7fea6805cf60 msgr2=0x7fea6805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:42.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 -- 172.21.15.12:0/1607980557 shutdown_connections 2021-10-20T23:27:42.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.746+0000 7fea6f88e700 1 -- 172.21.15.12:0/1607980557 wait complete. 2021-10-20T23:27:42.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 Processor -- start 2021-10-20T23:27:42.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 -- start start 2021-10-20T23:27:42.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea68060100 0x7fea68156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea68065420 0x7fea680b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea68142f30 0x7fea680a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68140ee0 con 0x7fea68065420 2021-10-20T23:27:42.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea681559c0 con 0x7fea68142f30 2021-10-20T23:27:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea68156850 con 0x7fea68060100 2021-10-20T23:27:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6ce29700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea68065420 0x7fea680b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6ce29700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea68065420 0x7fea680b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43182/0 (socket says 172.21.15.12:43182) 2021-10-20T23:27:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6ce29700 1 -- 172.21.15.12:0/2886482921 learned_addr learned my addr 172.21.15.12:0/2886482921 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6de2b700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea68142f30 0x7fea680a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6d62a700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea68060100 0x7fea68156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6ce29700 1 -- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea68060100 msgr2=0x7fea68156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6ce29700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea68060100 0x7fea68156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6ce29700 1 -- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea68142f30 msgr2=0x7fea680a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6ce29700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea68142f30 0x7fea680a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6ce29700 1 -- 172.21.15.12:0/2886482921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5800b180 con 0x7fea68065420 2021-10-20T23:27:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6ce29700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea68065420 0x7fea680b09d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fea58002f70 tx=0x7fea58014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea567fc700 1 -- 172.21.15.12:0/2886482921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5800d1c0 con 0x7fea68065420 2021-10-20T23:27:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea567fc700 1 -- 172.21.15.12:0/2886482921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58013bf0 con 0x7fea68065420 2021-10-20T23:27:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea68141110 con 0x7fea68065420 2021-10-20T23:27:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea567fc700 1 -- 172.21.15.12:0/2886482921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5801e400 con 0x7fea68065420 2021-10-20T23:27:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea68155ec0 con 0x7fea68065420 2021-10-20T23:27:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.750+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea68156080 con 0x7fea68065420 2021-10-20T23:27:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.754+0000 7fea567fc700 1 -- 172.21.15.12:0/2886482921 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea58025030 con 0x7fea68065420 2021-10-20T23:27:42.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.754+0000 7fea567fc700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fea480536a0 0x7fea48055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:42.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.754+0000 7fea567fc700 1 -- 172.21.15.12:0/2886482921 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fea5806c7d0 con 0x7fea68065420 2021-10-20T23:27:42.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.754+0000 7fea6d62a700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fea480536a0 0x7fea48055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:42.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.754+0000 7fea6d62a700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fea480536a0 0x7fea48055b60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fea6400d000 tx=0x7fea64007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:42.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.758+0000 7fea567fc700 1 -- 172.21.15.12:0/2886482921 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea580437d0 con 0x7fea68065420 2021-10-20T23:27:42.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea68064870 con 0x7fea68065420 2021-10-20T23:27:42.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea567fc700 1 -- 172.21.15.12:0/2886482921 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea58023020 con 0x7fea68065420 2021-10-20T23:27:42.895 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:42.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fea480536a0 msgr2=0x7fea48055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fea480536a0 0x7fea48055b60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fea6400d000 tx=0x7fea64007a20).stop 2021-10-20T23:27:42.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea68065420 msgr2=0x7fea680b09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:42.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea68065420 0x7fea680b09d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fea58002f70 tx=0x7fea58014000).stop 2021-10-20T23:27:42.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 shutdown_connections 2021-10-20T23:27:42.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fea480536a0 0x7fea48055b60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea68142f30 0x7fea680a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea68065420 0x7fea680b09d0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 --2- 172.21.15.12:0/2886482921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea68060100 0x7fea68156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:42.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.886+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 >> 172.21.15.12:0/2886482921 conn(0x7fea6805cf60 msgr2=0x7fea68139cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:42.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.890+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 shutdown_connections 2021-10-20T23:27:42.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:42.890+0000 7fea6f88e700 1 -- 172.21.15.12:0/2886482921 wait complete. 2021-10-20T23:27:42.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:27:43.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 Processor -- start 2021-10-20T23:27:43.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 -- start start 2021-10-20T23:27:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec00b54a0 0x7f0ec00af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ec01475a0 0x7f0ec00acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec00b5880 con 0x7f0ec00b0610 2021-10-20T23:27:43.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec01452e0 con 0x7f0ec01475a0 2021-10-20T23:27:43.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00adff0 con 0x7f0ec00b54a0 2021-10-20T23:27:43.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebdd9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0ec00b0610 0x7f0ec00675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41782/0 (socket says 172.21.15.12:41782) 2021-10-20T23:27:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebdd9b700 1 -- 172.21.15.12:0/2201399057 learned_addr learned my addr 172.21.15.12:0/2201399057 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebed9d700 1 --2- 172.21.15.12:0/2201399057 >> v2:172.21.15.31:3300/0 conn(0x7f0ec01475a0 0x7f0ec00acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebe59c700 1 --2- 172.21.15.12:0/2201399057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec00b54a0 0x7f0ec00af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebd59a700 1 -- 172.21.15.12:0/2201399057 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037310718 0 0) 0x7f0ec00b5880 con 0x7f0ec00b0610 2021-10-20T23:27:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebd59a700 1 -- 172.21.15.12:0/2201399057 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea4003260 con 0x7f0ec00b0610 2021-10-20T23:27:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebed9d700 1 -- 172.21.15.12:0/2201399057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec00b54a0 msgr2=0x7f0ec00af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebed9d700 1 --2- 172.21.15.12:0/2201399057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec00b54a0 0x7f0ec00af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebed9d700 1 -- 172.21.15.12:0/2201399057 >> v1:172.21.15.12:6789/0 conn(0x7f0ec00b0610 legacy=0x7f0ec00675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebed9d700 1 -- 172.21.15.12:0/2201399057 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00ac800 con 0x7f0ec01475a0 2021-10-20T23:27:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebe59c700 1 --2- 172.21.15.12:0/2201399057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec00b54a0 0x7f0ec00af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebed9d700 1 --2- 172.21.15.12:0/2201399057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec01475a0 0x7f0ec00acc60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f0eb80032f0 tx=0x7f0eb80091d0).ready entity=mon.1 client_cookie=abc588123bbd4896 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebd59a700 1 -- 172.21.15.12:0/2201399057 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb800b600 con 0x7f0ec01475a0 2021-10-20T23:27:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebd59a700 1 -- 172.21.15.12:0/2201399057 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb800b760 con 0x7f0ec01475a0 2021-10-20T23:27:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebd59a700 1 -- 172.21.15.12:0/2201399057 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb800b8d0 con 0x7f0ec01475a0 2021-10-20T23:27:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 -- 172.21.15.12:0/2201399057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec01475a0 msgr2=0x7f0ec00acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 --2- 172.21.15.12:0/2201399057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec01475a0 0x7f0ec00acc60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f0eb80032f0 tx=0x7f0eb80091d0).stop 2021-10-20T23:27:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 -- 172.21.15.12:0/2201399057 shutdown_connections 2021-10-20T23:27:43.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 --2- 172.21.15.12:0/2201399057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec01475a0 0x7f0ec00acc60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 --2- 172.21.15.12:0/2201399057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec00b54a0 0x7f0ec00af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.014+0000 7f0ebf59e700 1 -- 172.21.15.12:0/2201399057 >> 172.21.15.12:0/2201399057 conn(0x7f0ec0062560 msgr2=0x7f0ec0062940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:43.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 -- 172.21.15.12:0/2201399057 shutdown_connections 2021-10-20T23:27:43.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 -- 172.21.15.12:0/2201399057 wait complete. 2021-10-20T23:27:43.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 Processor -- start 2021-10-20T23:27:43.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 -- start start 2021-10-20T23:27:43.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ec00b0610 0x7f0ec0144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec00b54a0 0x7f0ec0156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec01475a0 0x7f0ec0156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00b4d90 con 0x7f0ec00b0610 2021-10-20T23:27:43.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec0066ef0 con 0x7f0ec00b54a0 2021-10-20T23:27:43.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebf59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00669d0 con 0x7f0ec01475a0 2021-10-20T23:27:43.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebe59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ec00b0610 0x7f0ec0144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebe59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ec00b0610 0x7f0ec0144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43194/0 (socket says 172.21.15.12:43194) 2021-10-20T23:27:43.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebe59c700 1 -- 172.21.15.12:0/3028483416 learned_addr learned my addr 172.21.15.12:0/3028483416 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:43.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebdd9b700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec00b54a0 0x7f0ec0156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebed9d700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec01475a0 0x7f0ec0156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebe59c700 1 -- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec01475a0 msgr2=0x7f0ec0156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebe59c700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec01475a0 0x7f0ec0156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebe59c700 1 -- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec00b54a0 msgr2=0x7f0ec0156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebe59c700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec00b54a0 0x7f0ec0156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebe59c700 1 -- 172.21.15.12:0/3028483416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb400b180 con 0x7f0ec00b0610 2021-10-20T23:27:43.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebdd9b700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec00b54a0 0x7f0ec0156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:43.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.018+0000 7f0ebe59c700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ec00b0610 0x7f0ec0144a50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f0ec014a550 tx=0x7f0eb4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:43.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0eaf7fe700 1 -- 172.21.15.12:0/3028483416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb400c7e0 con 0x7f0ec00b0610 2021-10-20T23:27:43.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0eaf7fe700 1 -- 172.21.15.12:0/3028483416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb400c940 con 0x7f0ec00b0610 2021-10-20T23:27:43.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb8009470 con 0x7f0ec00b0610 2021-10-20T23:27:43.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0eaf7fe700 1 -- 172.21.15.12:0/3028483416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb400cca0 con 0x7f0ec00b0610 2021-10-20T23:27:43.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec00b4af0 con 0x7f0ec00b0610 2021-10-20T23:27:43.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0eaf7fe700 1 -- 172.21.15.12:0/3028483416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0eb401c460 con 0x7f0ec00b0610 2021-10-20T23:27:43.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec0057350 con 0x7f0ec00b0610 2021-10-20T23:27:43.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0eaf7fe700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e9c053640 0x7f0e9c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0eaf7fe700 1 -- 172.21.15.12:0/3028483416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0eb406c080 con 0x7f0ec00b0610 2021-10-20T23:27:43.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0ebdd9b700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e9c053640 0x7f0e9c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.022+0000 7f0ebdd9b700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e9c053640 0x7f0e9c055b00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f0eb000d000 tx=0x7f0eb0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:43.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.026+0000 7f0eaf7fe700 1 -- 172.21.15.12:0/3028483416 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0eb4042f20 con 0x7f0ec00b0610 2021-10-20T23:27:43.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ec005f240 con 0x7f0ec00b0610 2021-10-20T23:27:43.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0eaf7fe700 1 -- 172.21.15.12:0/3028483416 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0eb400ce00 con 0x7f0ec00b0610 2021-10-20T23:27:43.168 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:43.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e9c053640 msgr2=0x7f0e9c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e9c053640 0x7f0e9c055b00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f0eb000d000 tx=0x7f0eb0009040).stop 2021-10-20T23:27:43.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ec00b0610 msgr2=0x7f0ec0144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ec00b0610 0x7f0ec0144a50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f0ec014a550 tx=0x7f0eb4006df0).stop 2021-10-20T23:27:43.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 shutdown_connections 2021-10-20T23:27:43.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0e9c053640 0x7f0e9c055b00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ec01475a0 0x7f0ec0156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec00b54a0 0x7f0ec0156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 --2- 172.21.15.12:0/3028483416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ec00b0610 0x7f0ec0144a50 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 >> 172.21.15.12:0/3028483416 conn(0x7f0ec0062560 msgr2=0x7f0ec00acb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:43.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 shutdown_connections 2021-10-20T23:27:43.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.158+0000 7f0ebf59e700 1 -- 172.21.15.12:0/3028483416 wait complete. 2021-10-20T23:27:43.180 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:27:43.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd789853700 1 Processor -- start 2021-10-20T23:27:43.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd789853700 1 -- start start 2021-10-20T23:27:43.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd789853700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7840665f0 0x7fd7840669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd789853700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd7840b1a30 0x7fd78405fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd789853700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78405f750 con 0x7fd784140cb0 2021-10-20T23:27:43.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd789853700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7840b14a0 con 0x7fd7840665f0 2021-10-20T23:27:43.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd789853700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78405f980 con 0x7fd7840b1a30 2021-10-20T23:27:43.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd788851700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7840665f0 0x7fd7840669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd788851700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7840665f0 0x7fd7840669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43202/0 (socket says 172.21.15.12:43202) 2021-10-20T23:27:43.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd788851700 1 -- 172.21.15.12:0/644438968 learned_addr learned my addr 172.21.15.12:0/644438968 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:43.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd783fff700 1 --2- 172.21.15.12:0/644438968 >> v2:172.21.15.31:3300/0 conn(0x7fd7840b1a30 0x7fd78405fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd788851700 1 -- 172.21.15.12:0/644438968 >> v2:172.21.15.31:3300/0 conn(0x7fd7840b1a30 msgr2=0x7fd78405fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:43.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd788851700 1 --2- 172.21.15.12:0/644438968 >> v2:172.21.15.31:3300/0 conn(0x7fd7840b1a30 0x7fd78405fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd788851700 1 -- 172.21.15.12:0/644438968 >> v1:172.21.15.31:6789/0 conn(0x7fd784140cb0 legacy=0x7fd78413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd788851700 1 -- 172.21.15.12:0/644438968 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd784060310 con 0x7fd7840665f0 2021-10-20T23:27:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.286+0000 7fd788851700 1 --2- 172.21.15.12:0/644438968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840665f0 0x7fd7840669d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fd778002f70 tx=0x7fd778006eb0).ready entity=mon.0 client_cookie=8b000822b22e5b98 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd7837fe700 1 -- 172.21.15.12:0/644438968 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77800d5c0 con 0x7fd7840665f0 2021-10-20T23:27:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd7837fe700 1 -- 172.21.15.12:0/644438968 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd778000e90 con 0x7fd7840665f0 2021-10-20T23:27:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd7837fe700 1 -- 172.21.15.12:0/644438968 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77800d950 con 0x7fd7840665f0 2021-10-20T23:27:43.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd789853700 1 -- 172.21.15.12:0/644438968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840665f0 msgr2=0x7fd7840669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd789853700 1 --2- 172.21.15.12:0/644438968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840665f0 0x7fd7840669d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fd778002f70 tx=0x7fd778006eb0).stop 2021-10-20T23:27:43.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd789853700 1 -- 172.21.15.12:0/644438968 shutdown_connections 2021-10-20T23:27:43.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd789853700 1 --2- 172.21.15.12:0/644438968 >> v2:172.21.15.31:3300/0 conn(0x7fd7840b1a30 0x7fd78405fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd789853700 1 --2- 172.21.15.12:0/644438968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840665f0 0x7fd7840669d0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd789853700 1 -- 172.21.15.12:0/644438968 >> 172.21.15.12:0/644438968 conn(0x7fd7840636e0 msgr2=0x7fd784063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd789853700 1 -- 172.21.15.12:0/644438968 shutdown_connections 2021-10-20T23:27:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.290+0000 7fd789853700 1 -- 172.21.15.12:0/644438968 wait complete. 2021-10-20T23:27:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd789853700 1 Processor -- start 2021-10-20T23:27:43.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd789853700 1 -- start start 2021-10-20T23:27:43.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd789853700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7840665f0 0x7fd78409f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd789853700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840b1a30 0x7fd7840af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd789853700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd784140cb0 0x7fd7840afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd789853700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd784150a90 con 0x7fd7840b1a30 2021-10-20T23:27:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd789853700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840add60 con 0x7fd7840665f0 2021-10-20T23:27:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd789853700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd784150cc0 con 0x7fd784140cb0 2021-10-20T23:27:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd783fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840b1a30 0x7fd7840af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd783fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840b1a30 0x7fd7840af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43210/0 (socket says 172.21.15.12:43210) 2021-10-20T23:27:43.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd783fff700 1 -- 172.21.15.12:0/3728322042 learned_addr learned my addr 172.21.15.12:0/3728322042 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:43.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd788851700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7840665f0 0x7fd78409f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd789052700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd784140cb0 0x7fd7840afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd783fff700 1 -- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd784140cb0 msgr2=0x7fd7840afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd783fff700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd784140cb0 0x7fd7840afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd783fff700 1 -- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7840665f0 msgr2=0x7fd78409f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd783fff700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7840665f0 0x7fd78409f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd783fff700 1 -- 172.21.15.12:0/3728322042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77800b1e0 con 0x7fd7840b1a30 2021-10-20T23:27:43.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd788851700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7840665f0 0x7fd78409f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:43.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd783fff700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840b1a30 0x7fd7840af730 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fd77000c000 tx=0x7fd770006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:43.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.294+0000 7fd781ffb700 1 -- 172.21.15.12:0/3728322042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd770010780 con 0x7fd7840b1a30 2021-10-20T23:27:43.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.298+0000 7fd781ffb700 1 -- 172.21.15.12:0/3728322042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7700108e0 con 0x7fd7840b1a30 2021-10-20T23:27:43.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.298+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7840ace50 con 0x7fd7840b1a30 2021-10-20T23:27:43.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.298+0000 7fd781ffb700 1 -- 172.21.15.12:0/3728322042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd770010c40 con 0x7fd7840b1a30 2021-10-20T23:27:43.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.298+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7840ad9a0 con 0x7fd7840b1a30 2021-10-20T23:27:43.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.298+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd784150e80 con 0x7fd7840b1a30 2021-10-20T23:27:43.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.298+0000 7fd781ffb700 1 -- 172.21.15.12:0/3728322042 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd77001c460 con 0x7fd7840b1a30 2021-10-20T23:27:43.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.298+0000 7fd781ffb700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd764053580 0x7fd764055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.298+0000 7fd781ffb700 1 -- 172.21.15.12:0/3728322042 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd77006bec0 con 0x7fd7840b1a30 2021-10-20T23:27:43.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.298+0000 7fd788851700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd764053580 0x7fd764055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.302+0000 7fd788851700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd764053580 0x7fd764055a40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fd77801c000 tx=0x7fd778015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:43.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.310+0000 7fd781ffb700 1 -- 172.21.15.12:0/3728322042 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd770042dc0 con 0x7fd7840b1a30 2021-10-20T23:27:43.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.438+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7840b1740 con 0x7fd7840b1a30 2021-10-20T23:27:43.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.438+0000 7fd781ffb700 1 -- 172.21.15.12:0/3728322042 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd7700463e0 con 0x7fd7840b1a30 2021-10-20T23:27:43.447 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.438+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd764053580 msgr2=0x7fd764055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.438+0000 7fd789853700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd764053580 0x7fd764055a40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fd77801c000 tx=0x7fd778015000).stop 2021-10-20T23:27:43.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.438+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840b1a30 msgr2=0x7fd7840af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.438+0000 7fd789853700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840b1a30 0x7fd7840af730 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fd77000c000 tx=0x7fd770006df0).stop 2021-10-20T23:27:43.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.438+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 shutdown_connections 2021-10-20T23:27:43.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.438+0000 7fd789853700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd764053580 0x7fd764055a40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.442+0000 7fd789853700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd784140cb0 0x7fd7840afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.442+0000 7fd789853700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7840b1a30 0x7fd7840af730 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.442+0000 7fd789853700 1 --2- 172.21.15.12:0/3728322042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7840665f0 0x7fd78409f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.442+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 >> 172.21.15.12:0/3728322042 conn(0x7fd7840636e0 msgr2=0x7fd784144080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:43.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.442+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 shutdown_connections 2021-10-20T23:27:43.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.442+0000 7fd789853700 1 -- 172.21.15.12:0/3728322042 wait complete. 2021-10-20T23:27:43.460 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:27:43.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889915d700 1 Processor -- start 2021-10-20T23:27:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889915d700 1 -- start start 2021-10-20T23:27:43.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889915d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f88940b0010 0x7f88940a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889915d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88940afbd0 0x7f88940a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889915d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88940a70c0 con 0x7f88940b2580 2021-10-20T23:27:43.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889915d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88940a72f0 con 0x7f88940afbd0 2021-10-20T23:27:43.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889915d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88940a7590 con 0x7f88940b0010 2021-10-20T23:27:43.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889895c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88940afbd0 0x7f88940a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889895c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88940afbd0 0x7f88940a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43218/0 (socket says 172.21.15.12:43218) 2021-10-20T23:27:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889895c700 1 -- 172.21.15.12:0/4238020133 learned_addr learned my addr 172.21.15.12:0/4238020133 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f88937fe700 1 --2- 172.21.15.12:0/4238020133 >> v2:172.21.15.31:3300/0 conn(0x7f88940b0010 0x7f88940a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889895c700 1 -- 172.21.15.12:0/4238020133 >> v2:172.21.15.31:3300/0 conn(0x7f88940b0010 msgr2=0x7f88940a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889895c700 1 --2- 172.21.15.12:0/4238020133 >> v2:172.21.15.31:3300/0 conn(0x7f88940b0010 0x7f88940a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889895c700 1 -- 172.21.15.12:0/4238020133 >> v1:172.21.15.31:6789/0 conn(0x7f88940b2580 legacy=0x7f889414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.558+0000 7f889895c700 1 -- 172.21.15.12:0/4238020133 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88940a7830 con 0x7f88940afbd0 2021-10-20T23:27:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889895c700 1 --2- 172.21.15.12:0/4238020133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940afbd0 0x7f88940a88a0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f888c0032f0 tx=0x7f888c009290).ready entity=mon.0 client_cookie=6911882dd7c259ab server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f8892ffd700 1 -- 172.21.15.12:0/4238020133 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888c00b870 con 0x7f88940afbd0 2021-10-20T23:27:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f8892ffd700 1 -- 172.21.15.12:0/4238020133 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c00b9d0 con 0x7f88940afbd0 2021-10-20T23:27:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f8892ffd700 1 -- 172.21.15.12:0/4238020133 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888c00bb40 con 0x7f88940afbd0 2021-10-20T23:27:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 -- 172.21.15.12:0/4238020133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940afbd0 msgr2=0x7f88940a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 --2- 172.21.15.12:0/4238020133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940afbd0 0x7f88940a88a0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f888c0032f0 tx=0x7f888c009290).stop 2021-10-20T23:27:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 -- 172.21.15.12:0/4238020133 shutdown_connections 2021-10-20T23:27:43.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 --2- 172.21.15.12:0/4238020133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940afbd0 0x7f88940a88a0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 --2- 172.21.15.12:0/4238020133 >> v2:172.21.15.31:3300/0 conn(0x7f88940b0010 0x7f88940a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 -- 172.21.15.12:0/4238020133 >> 172.21.15.12:0/4238020133 conn(0x7f8894060180 msgr2=0x7f88940b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:43.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 -- 172.21.15.12:0/4238020133 shutdown_connections 2021-10-20T23:27:43.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 -- 172.21.15.12:0/4238020133 wait complete. 2021-10-20T23:27:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 Processor -- start 2021-10-20T23:27:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 -- start start 2021-10-20T23:27:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88940afbd0 0x7f889414e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.562+0000 7f889915d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88940b0010 0x7f889415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889915d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940b2580 0x7f889415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889915d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8894157490 con 0x7f88940b2580 2021-10-20T23:27:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889915d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8894156490 con 0x7f88940b0010 2021-10-20T23:27:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889915d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8894156680 con 0x7f88940afbd0 2021-10-20T23:27:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889895c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940b2580 0x7f889415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889895c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940b2580 0x7f889415a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43226/0 (socket says 172.21.15.12:43226) 2021-10-20T23:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889895c700 1 -- 172.21.15.12:0/1626208338 learned_addr learned my addr 172.21.15.12:0/1626208338 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f88937fe700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88940b0010 0x7f889415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f8893fff700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88940afbd0 0x7f889414e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889895c700 1 -- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88940afbd0 msgr2=0x7f889414e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889895c700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88940afbd0 0x7f889414e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889895c700 1 -- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88940b0010 msgr2=0x7f889415a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889895c700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88940b0010 0x7f889415a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889895c700 1 -- 172.21.15.12:0/1626208338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c009530 con 0x7f88940b2580 2021-10-20T23:27:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889895c700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940b2580 0x7f889415a530 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f889414d3b0 tx=0x7f888c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f88917fa700 1 -- 172.21.15.12:0/1626208338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888c00b870 con 0x7f88940b2580 2021-10-20T23:27:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f88917fa700 1 -- 172.21.15.12:0/1626208338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c021440 con 0x7f88940b2580 2021-10-20T23:27:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f88917fa700 1 -- 172.21.15.12:0/1626208338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888c0217a0 con 0x7f88940b2580 2021-10-20T23:27:43.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8894159ba0 con 0x7f88940b2580 2021-10-20T23:27:43.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88940a9260 con 0x7f88940b2580 2021-10-20T23:27:43.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8894057350 con 0x7f88940b2580 2021-10-20T23:27:43.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.566+0000 7f88917fa700 1 -- 172.21.15.12:0/1626208338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f888c027020 con 0x7f88940b2580 2021-10-20T23:27:43.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.570+0000 7f88917fa700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88740536a0 0x7f8874055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:43.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.570+0000 7f88917fa700 1 -- 172.21.15.12:0/1626208338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f888c06cd30 con 0x7f88940b2580 2021-10-20T23:27:43.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.570+0000 7f8893fff700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88740536a0 0x7f8874055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:43.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.570+0000 7f8893fff700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88740536a0 0x7f8874055b60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f888800d000 tx=0x7f8888007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:43.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.574+0000 7f88917fa700 1 -- 172.21.15.12:0/1626208338 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f888c043d30 con 0x7f88940b2580 2021-10-20T23:27:43.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.742+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8894159d30 con 0x7f88940b2580 2021-10-20T23:27:43.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.742+0000 7f88917fa700 1 -- 172.21.15.12:0/1626208338 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f888c015020 con 0x7f88940b2580 2021-10-20T23:27:43.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:43.753 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1540805449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1540805449},{"type":"v1","addr":"172.21.15.31:6835","nonce":1540805449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2826685098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2826685098},{"type":"v1","addr":"172.21.15.12:6833","nonce":2826685098}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:35.417915+0000","modified":"2021-10-20T23:27:36.421728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3124306556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3124306556},{"type":"v1","addr":"172.21.15.12:6835","nonce":3124306556}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-20T23:27:43.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88740536a0 msgr2=0x7f8874055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88740536a0 0x7f8874055b60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f888800d000 tx=0x7f8888007b70).stop 2021-10-20T23:27:43.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940b2580 msgr2=0x7f889415a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:43.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940b2580 0x7f889415a530 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f889414d3b0 tx=0x7f888c016000).stop 2021-10-20T23:27:43.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 shutdown_connections 2021-10-20T23:27:43.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88740536a0 0x7f8874055b60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88940b2580 0x7f889415a530 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88940b0010 0x7f889415a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 --2- 172.21.15.12:0/1626208338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88940afbd0 0x7f889414e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 >> 172.21.15.12:0/1626208338 conn(0x7f8894060180 msgr2=0x7f8894148920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 shutdown_connections 2021-10-20T23:27:43.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:43.746+0000 7f889915d700 1 -- 172.21.15.12:0/1626208338 wait complete. 2021-10-20T23:27:43.759 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 54 2021-10-20T23:27:44.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:27:35.417915+0000', 'modified': '2021-10-20T23:27:36.421728+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7257': {'gid': 7257, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/3124306556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 3124306556}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 3124306556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:27:44.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:27:44.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:27:44.186 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":7257,"want_state":"up:active","state":"up:active","rank_uptime":8.7501849939999996,"mdsmap_epoch":54,"osdmap_epoch":112,"osdmap_epoch_barrier":112,"uptime":13.443028674000001} 2021-10-20T23:27:44.186 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 7257, "mdsmap_epoch": 54, "osdmap_epoch": 112, "osdmap_epoch_barrier": 112, "rank_uptime": 8.750184994, "state": "up:active", "uptime": 13.443028674, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:27:44.187 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:27:44.187 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:27:44.187 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:27:44.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:44.188 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:44.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:27:44.213 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:27:44.213 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:27:44.224 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:27:44.225 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:27:44.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:44.227 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:27:44.277 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:27:44.277 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:44.280 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:27:44.298 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:27:44.299 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:27:44.356 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-10-20T23:27:44.354+0000 7f99dab85080 -1 init, newargv = 0x55b048836cf0 newargc=9 2021-10-20T23:27:44.357 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14226]: starting ceph client 2021-10-20T23:27:44.361 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:27:44.363 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:27:44.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:44.364 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:27:44.368 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14226]: starting fuse 2021-10-20T23:27:44.371 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:27:44.372 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:27:44.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:44.373 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:27:44.373 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:27:44.374 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:27:44.374 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:27:44.375 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:27:44.375 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:27:44.376 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:27:44.376 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:27:44.377 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:27:44.377 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:27:44.378 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:27:44.378 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:27:44.378 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:27:44.379 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:27:44.379 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:27:44.380 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:27:44.380 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:27:44.380 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:27:44.381 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:27:44.381 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:27:44.382 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:27:44.382 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:27:44.382 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:27:44.457 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.14226.asok 2021-10-20T23:27:44.461 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14226.asok 2021-10-20T23:27:44.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:44.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14226.asok status 2021-10-20T23:27:44.549 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:27:44.549 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:27:44.550 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:27:44.550 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:27:44.550 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:27:44.550 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:27:44.551 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:27:44.551 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "14226", 2021-10-20T23:27:44.551 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:27:44.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:27:44.551 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:27:44.552 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:27:44.552 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 7473, 2021-10-20T23:27:44.554 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:27:44.554 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:27:44.554 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:27:44.555 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 7473 2021-10-20T23:27:44.555 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:27:44.555 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:27:44.555 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:27:44.555 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:27:44.556 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1898775244 2021-10-20T23:27:44.556 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:27:44.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:27:44.556 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:27:44.557 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:27:44.557 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:27:44.557 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1898775244 2021-10-20T23:27:44.557 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:27:44.558 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.7473 172.21.15.136:0/1898775244", 2021-10-20T23:27:44.558 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/1898775244", 2021-10-20T23:27:44.558 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:27:44.558 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 54, 2021-10-20T23:27:44.558 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 112, 2021-10-20T23:27:44.559 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:27:44.559 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:27:44.559 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:27:44.559 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:27:44.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:44.561 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:44.561 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:44.569 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:27:44.570 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:27:44.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:44.571 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:44.632 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-10-20T23:27:44.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.738+0000 7f6dbed89700 1 Processor -- start 2021-10-20T23:27:44.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.738+0000 7f6dbed89700 1 -- start start 2021-10-20T23:27:44.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db813d260 0x7f6db805c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:44.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db8147020 con 0x7f6db80b1e20 2021-10-20T23:27:44.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db81472c0 con 0x7f6db80b2600 2021-10-20T23:27:44.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80ad440 con 0x7f6db813d260 2021-10-20T23:27:44.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbd586700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6db80b1e20 0x7f6db813cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41826/0 (socket says 172.21.15.12:41826) 2021-10-20T23:27:44.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbd586700 1 -- 172.21.15.12:0/3700435154 learned_addr learned my addr 172.21.15.12:0/3700435154 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbe588700 1 --2- 172.21.15.12:0/3700435154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db813d260 0x7f6db805c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbcd85700 1 -- 172.21.15.12:0/3700435154 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180508662 0 0) 0x7f6db8147020 con 0x7f6db80b1e20 2021-10-20T23:27:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbcd85700 1 -- 172.21.15.12:0/3700435154 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da0003260 con 0x7f6db80b1e20 2021-10-20T23:27:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbcd85700 1 -- 172.21.15.12:0/3700435154 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942206362 0 0) 0x7f6db81472c0 con 0x7f6db80b2600 2021-10-20T23:27:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbcd85700 1 -- 172.21.15.12:0/3700435154 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db8147020 con 0x7f6db80b2600 2021-10-20T23:27:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbe588700 1 -- 172.21.15.12:0/3700435154 >> v1:172.21.15.31:6789/0 conn(0x7f6db80b2600 legacy=0x7f6db81436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbe588700 1 -- 172.21.15.12:0/3700435154 >> v1:172.21.15.12:6789/0 conn(0x7f6db80b1e20 legacy=0x7f6db813cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbcd85700 1 -- 172.21.15.12:0/3700435154 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2900465697 0 0) 0x7f6da0003260 con 0x7f6db80b1e20 2021-10-20T23:27:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbe588700 1 -- 172.21.15.12:0/3700435154 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8142fa0 con 0x7f6db813d260 2021-10-20T23:27:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbe588700 1 --2- 172.21.15.12:0/3700435154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db813d260 0x7f6db805c490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6da8001110 tx=0x7f6db00091d0).ready entity=mon.2 client_cookie=74eefe9e99627581 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbcd85700 1 -- 172.21.15.12:0/3700435154 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da8001660 con 0x7f6db813d260 2021-10-20T23:27:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbcd85700 1 -- 172.21.15.12:0/3700435154 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db000f510 con 0x7f6db813d260 2021-10-20T23:27:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbcd85700 1 -- 172.21.15.12:0/3700435154 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db000f680 con 0x7f6db813d260 2021-10-20T23:27:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 -- 172.21.15.12:0/3700435154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db813d260 msgr2=0x7f6db805c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 --2- 172.21.15.12:0/3700435154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db813d260 0x7f6db805c490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6da8001110 tx=0x7f6db00091d0).stop 2021-10-20T23:27:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 -- 172.21.15.12:0/3700435154 shutdown_connections 2021-10-20T23:27:44.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 --2- 172.21.15.12:0/3700435154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db813d260 0x7f6db805c490 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:44.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 -- 172.21.15.12:0/3700435154 >> 172.21.15.12:0/3700435154 conn(0x7f6db80611d0 msgr2=0x7f6db8062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:44.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 -- 172.21.15.12:0/3700435154 shutdown_connections 2021-10-20T23:27:44.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.742+0000 7f6dbed89700 1 -- 172.21.15.12:0/3700435154 wait complete. 2021-10-20T23:27:44.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbed89700 1 Processor -- start 2021-10-20T23:27:44.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbed89700 1 -- start start 2021-10-20T23:27:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbed89700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80b1e20 0x7f6db8152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbed89700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db80b2600 0x7f6db8152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbed89700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db813d260 0x7f6db8155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbed89700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80af610 con 0x7f6db80b2600 2021-10-20T23:27:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbed89700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8152d70 con 0x7f6db813d260 2021-10-20T23:27:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbed89700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db813ffa0 con 0x7f6db80b1e20 2021-10-20T23:27:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbd586700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db80b2600 0x7f6db8152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:44.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbd586700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db80b2600 0x7f6db8152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43238/0 (socket says 172.21.15.12:43238) 2021-10-20T23:27:44.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbd586700 1 -- 172.21.15.12:0/3244332704 learned_addr learned my addr 172.21.15.12:0/3244332704 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:44.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbdd87700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80b1e20 0x7f6db8152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:44.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbe588700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db813d260 0x7f6db8155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:44.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbd586700 1 -- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80b1e20 msgr2=0x7f6db8152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:44.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbd586700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80b1e20 0x7f6db8152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:44.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbd586700 1 -- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db813d260 msgr2=0x7f6db8155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:44.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbd586700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db813d260 0x7f6db8155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:44.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.746+0000 7f6dbd586700 1 -- 172.21.15.12:0/3244332704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0009470 con 0x7f6db80b2600 2021-10-20T23:27:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6dbd586700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db80b2600 0x7f6db8152880 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f6db8152eb0 tx=0x7f6da8001ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6da6ffd700 1 -- 172.21.15.12:0/3244332704 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da8007170 con 0x7f6db80b2600 2021-10-20T23:27:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6da6ffd700 1 -- 172.21.15.12:0/3244332704 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da80072d0 con 0x7f6db80b2600 2021-10-20T23:27:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6da6ffd700 1 -- 172.21.15.12:0/3244332704 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da8004920 con 0x7f6db80b2600 2021-10-20T23:27:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db80afbb0 con 0x7f6db80b2600 2021-10-20T23:27:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db81401d0 con 0x7f6db80b2600 2021-10-20T23:27:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6da6ffd700 1 -- 172.21.15.12:0/3244332704 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6da801b070 con 0x7f6db80b2600 2021-10-20T23:27:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db813e2b0 con 0x7f6db80b2600 2021-10-20T23:27:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6da6ffd700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d980535b0 0x7f6d98055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6da6ffd700 1 -- 172.21.15.12:0/3244332704 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6da806b360 con 0x7f6db80b2600 2021-10-20T23:27:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6dbdd87700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d980535b0 0x7f6d98055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.750+0000 7f6dbdd87700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d980535b0 0x7f6d98055a70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f6db400b000 tx=0x7f6db4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.754+0000 7f6da6ffd700 1 -- 172.21.15.12:0/3244332704 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6db813e2b0 con 0x7f6db80b2600 2021-10-20T23:27:44.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.926+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f6db813e2b0 con 0x7f6db80b2600 2021-10-20T23:27:44.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.926+0000 7f6da6ffd700 1 -- 172.21.15.12:0/3244332704 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1936 (secure 0 0 0) 0x7f6db813e2b0 con 0x7f6db80b2600 2021-10-20T23:27:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:44.936 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:27:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "total_bytes": 773094113280, 2021-10-20T23:27:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "total_avail_bytes": 764492886016, 2021-10-20T23:27:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_bytes": 11292672, 2021-10-20T23:27:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_bytes": 8601227264, 2021-10-20T23:27:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_ratio": 0.011125718243420124, 2021-10-20T23:27:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "num_osds": 8, 2021-10-20T23:27:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "num_per_pool_osds": 8, 2021-10-20T23:27:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "num_per_pool_omap_osds": 8 2021-10-20T23:27:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "stats_by_class": { 2021-10-20T23:27:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "ssd": { 2021-10-20T23:27:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "total_bytes": 773094113280, 2021-10-20T23:27:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "total_avail_bytes": 764492886016, 2021-10-20T23:27:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_bytes": 11292672, 2021-10-20T23:27:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_bytes": 8601227264, 2021-10-20T23:27:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_ratio": 0.011125718243420124 2021-10-20T23:27:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:27:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_health_metrics", 2021-10-20T23:27:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1, 2021-10-20T23:27:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:27:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:27:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 2, 2021-10-20T23:27:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:27:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:27:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:27:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362919034880 2021-10-20T23:27:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd", 2021-10-20T23:27:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2, 2021-10-20T23:27:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:27:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:27:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 0, 2021-10-20T23:27:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:27:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:27:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:27:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362919034880 2021-10-20T23:27:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs_metadata", 2021-10-20T23:27:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 19, 2021-10-20T23:27:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:27:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 2304, 2021-10-20T23:27:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 21, 2021-10-20T23:27:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 64, 2021-10-20T23:27:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 65536, 2021-10-20T23:27:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 9.0290100729362166e-08, 2021-10-20T23:27:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362919034880 2021-10-20T23:27:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs_data", 2021-10-20T23:27:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 20, 2021-10-20T23:27:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:27:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:27:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 0, 2021-10-20T23:27:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:27:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:27:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:27:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362919034880 2021-10-20T23:27:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:44.951 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:44.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d980535b0 msgr2=0x7f6d98055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:44.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d980535b0 0x7f6d98055a70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f6db400b000 tx=0x7f6db4009040).stop 2021-10-20T23:27:44.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db80b2600 msgr2=0x7f6db8152880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:44.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db80b2600 0x7f6db8152880 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f6db8152eb0 tx=0x7f6da8001ae0).stop 2021-10-20T23:27:44.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 shutdown_connections 2021-10-20T23:27:44.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d980535b0 0x7f6d98055a70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:44.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db813d260 0x7f6db8155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:44.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db80b2600 0x7f6db8152880 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:44.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 --2- 172.21.15.12:0/3244332704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80b1e20 0x7f6db8152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:44.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 >> 172.21.15.12:0/3244332704 conn(0x7f6db80611d0 msgr2=0x7f6db813c170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:44.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 shutdown_connections 2021-10-20T23:27:44.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:44.930+0000 7f6dbed89700 1 -- 172.21.15.12:0/3244332704 wait complete. 2021-10-20T23:27:44.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data size -f json-pretty 2021-10-20T23:27:45.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0b30e700 1 Processor -- start 2021-10-20T23:27:45.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0b30e700 1 -- start start 2021-10-20T23:27:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0b30e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fad040b6290 0x7fad04061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0b30e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad04142e60 0x7fad041432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0b30e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040b5f50 con 0x7fad040b4060 2021-10-20T23:27:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0b30e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040b1f70 con 0x7fad04142e60 2021-10-20T23:27:45.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0b30e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040b2210 con 0x7fad040b6290 2021-10-20T23:27:45.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0ab0d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad04142e60 0x7fad041432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0ab0d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad04142e60 0x7fad041432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43248/0 (socket says 172.21.15.12:43248) 2021-10-20T23:27:45.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0ab0d700 1 -- 172.21.15.12:0/330636405 learned_addr learned my addr 172.21.15.12:0/330636405 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:45.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.062+0000 7fad0a30c700 1 --2- 172.21.15.12:0/330636405 >> v2:172.21.15.31:3300/0 conn(0x7fad040b6290 0x7fad04061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0ab0d700 1 -- 172.21.15.12:0/330636405 >> v2:172.21.15.31:3300/0 conn(0x7fad040b6290 msgr2=0x7fad04061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:45.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0ab0d700 1 --2- 172.21.15.12:0/330636405 >> v2:172.21.15.31:3300/0 conn(0x7fad040b6290 0x7fad04061470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0ab0d700 1 -- 172.21.15.12:0/330636405 >> v1:172.21.15.31:6789/0 conn(0x7fad040b4060 legacy=0x7fad04061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0930a700 1 -- 172.21.15.12:0/330636405 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964708571 0 0) 0x7fad00001110 con 0x7fad040b4060 2021-10-20T23:27:45.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0ab0d700 1 -- 172.21.15.12:0/330636405 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040b24b0 con 0x7fad04142e60 2021-10-20T23:27:45.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0ab0d700 1 --2- 172.21.15.12:0/330636405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 0x7fad041432f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7facfc0032f0 tx=0x7facfc009290).ready entity=mon.0 client_cookie=b30950be85059767 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:45.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0930a700 1 -- 172.21.15.12:0/330636405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facfc00b870 con 0x7fad04142e60 2021-10-20T23:27:45.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0930a700 1 -- 172.21.15.12:0/330636405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc00b9d0 con 0x7fad04142e60 2021-10-20T23:27:45.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0930a700 1 -- 172.21.15.12:0/330636405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facfc00bb40 con 0x7fad04142e60 2021-10-20T23:27:45.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 -- 172.21.15.12:0/330636405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 msgr2=0x7fad041432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 --2- 172.21.15.12:0/330636405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 0x7fad041432f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7facfc0032f0 tx=0x7facfc009290).stop 2021-10-20T23:27:45.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 -- 172.21.15.12:0/330636405 shutdown_connections 2021-10-20T23:27:45.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 --2- 172.21.15.12:0/330636405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 0x7fad041432f0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 --2- 172.21.15.12:0/330636405 >> v2:172.21.15.31:3300/0 conn(0x7fad040b6290 0x7fad04061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 -- 172.21.15.12:0/330636405 >> 172.21.15.12:0/330636405 conn(0x7fad0405c490 msgr2=0x7fad0405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:45.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 -- 172.21.15.12:0/330636405 shutdown_connections 2021-10-20T23:27:45.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 -- 172.21.15.12:0/330636405 wait complete. 2021-10-20T23:27:45.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 Processor -- start 2021-10-20T23:27:45.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.066+0000 7fad0b30e700 1 -- start start 2021-10-20T23:27:45.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0b30e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad040b4060 0x7fad04146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0b30e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040b6290 0x7fad040b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0b30e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 0x7fad04155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0b30e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041466a0 con 0x7fad04142e60 2021-10-20T23:27:45.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0b30e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040affd0 con 0x7fad040b6290 2021-10-20T23:27:45.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0b30e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040b0270 con 0x7fad040b4060 2021-10-20T23:27:45.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0ab0d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 0x7fad04155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0ab0d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 0x7fad04155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43254/0 (socket says 172.21.15.12:43254) 2021-10-20T23:27:45.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0ab0d700 1 -- 172.21.15.12:0/1708968696 learned_addr learned my addr 172.21.15.12:0/1708968696 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:45.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad09b0b700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040b6290 0x7fad040b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0a30c700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad040b4060 0x7fad04146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0ab0d700 1 -- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad040b4060 msgr2=0x7fad04146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0ab0d700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad040b4060 0x7fad04146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0ab0d700 1 -- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040b6290 msgr2=0x7fad040b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0ab0d700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040b6290 0x7fad040b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0ab0d700 1 -- 172.21.15.12:0/1708968696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009530 con 0x7fad04142e60 2021-10-20T23:27:45.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0ab0d700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 0x7fad04155b20 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7facfc0032f0 tx=0x7facfc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:45.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7facf77fe700 1 -- 172.21.15.12:0/1708968696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facfc00b870 con 0x7fad04142e60 2021-10-20T23:27:45.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7facf77fe700 1 -- 172.21.15.12:0/1708968696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc021630 con 0x7fad04142e60 2021-10-20T23:27:45.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad040b0510 con 0x7fad04142e60 2021-10-20T23:27:45.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7facf77fe700 1 -- 172.21.15.12:0/1708968696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facfc021990 con 0x7fad04142e60 2021-10-20T23:27:45.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad04150100 con 0x7fad04142e60 2021-10-20T23:27:45.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad040b06a0 con 0x7fad04142e60 2021-10-20T23:27:45.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7facf77fe700 1 -- 172.21.15.12:0/1708968696 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7facfc027020 con 0x7fad04142e60 2021-10-20T23:27:45.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7facf77fe700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7face40535b0 0x7face4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7facf77fe700 1 -- 172.21.15.12:0/1708968696 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7facfc06cd70 con 0x7fad04142e60 2021-10-20T23:27:45.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.070+0000 7fad0a30c700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7face40535b0 0x7face4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.074+0000 7fad0a30c700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7face40535b0 0x7face4055a70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7facf800b000 tx=0x7facf8006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:45.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.078+0000 7facf77fe700 1 -- 172.21.15.12:0/1708968696 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7facfc043d10 con 0x7fad04142e60 2021-10-20T23:27:45.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7fad040b2750 con 0x7fad04142e60 2021-10-20T23:27:45.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7facf77fe700 1 -- 172.21.15.12:0/1708968696 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v112) v1 ==== 123+0+64 (secure 0 0 0) 0x7facfc015020 con 0x7fad04142e60 2021-10-20T23:27:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:45.214 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": "cephfs_data", 2021-10-20T23:27:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_id": 20, 2021-10-20T23:27:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2 2021-10-20T23:27:45.215 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7face40535b0 msgr2=0x7face4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7face40535b0 0x7face4055a70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7facf800b000 tx=0x7facf8006df0).stop 2021-10-20T23:27:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 msgr2=0x7fad04155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 0x7fad04155b20 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7facfc0032f0 tx=0x7facfc016000).stop 2021-10-20T23:27:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 shutdown_connections 2021-10-20T23:27:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7face40535b0 0x7face4055a70 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad04142e60 0x7fad04155b20 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040b6290 0x7fad040b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 --2- 172.21.15.12:0/1708968696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad040b4060 0x7fad04146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 >> 172.21.15.12:0/1708968696 conn(0x7fad0405c490 msgr2=0x7fad041421c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 shutdown_connections 2021-10-20T23:27:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.206+0000 7fad0b30e700 1 -- 172.21.15.12:0/1708968696 wait complete. 2021-10-20T23:27:45.228 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-20T23:27:45.228 DEBUG:teuthology.orchestra.run.smithi119:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-10-20T23:27:45.267 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-10-20T23:27:45.268 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-fuse 354410496 0 354410496 0% /home/ubuntu/cephtest/mnt.0 2021-10-20T23:27:45.269 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:27:45.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:45.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:45.314 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:45.336 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:45.359 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:27:45.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:45.361 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:45.361 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:45.384 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:27:45.385 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:27:45.386 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:27:45.386 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:27:45.387 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:45.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14725]: fuse finished with error 0 and tester_r 0 2021-10-20T23:27:45.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:45.405 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:45.405 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:45.413 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:27:45.413 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:27:45.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:27:45.516 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:45.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:45.525 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:45.525 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:45.533 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:27:45.534 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:27:45.535 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:27:45.535 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:27:45.535 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:45.592 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14226]: fuse finished with error 0 and tester_r 0 2021-10-20T23:27:45.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:45.595 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:45.596 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:45.603 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:27:45.604 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:27:45.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:27:45.720 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:45.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:27:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f8209186700 1 Processor -- start 2021-10-20T23:27:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f8209186700 1 -- start start 2021-10-20T23:27:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f8209186700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82040a8ac0 0x7f8204152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f8209186700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82040a70c0 con 0x7f82040b2580 2021-10-20T23:27:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f8209186700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82040a72f0 con 0x7f82040b0010 2021-10-20T23:27:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f8209186700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82040a7590 con 0x7f82040a8ac0 2021-10-20T23:27:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f8208985700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82040a8ac0 0x7f8204152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f8203fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f82040b2580 0x7f820414ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41854/0 (socket says 172.21.15.12:41854) 2021-10-20T23:27:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f8203fff700 1 -- 172.21.15.12:0/4108468117 learned_addr learned my addr 172.21.15.12:0/4108468117 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f82037fe700 1 -- 172.21.15.12:0/4108468117 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037436387 0 0) 0x7f82040a70c0 con 0x7f82040b2580 2021-10-20T23:27:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.834+0000 7f82037fe700 1 -- 172.21.15.12:0/4108468117 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e4003260 con 0x7f82040b2580 2021-10-20T23:27:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f82037fe700 1 -- 172.21.15.12:0/4108468117 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827315633 0 0) 0x7f82040a72f0 con 0x7f82040b0010 2021-10-20T23:27:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f82037fe700 1 -- 172.21.15.12:0/4108468117 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82040a70c0 con 0x7f82040b0010 2021-10-20T23:27:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f82037fe700 1 -- 172.21.15.12:0/4108468117 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3510749440 0 0) 0x7f81e4003260 con 0x7f82040b2580 2021-10-20T23:27:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8208985700 1 -- 172.21.15.12:0/4108468117 >> v1:172.21.15.31:6789/0 conn(0x7f82040b0010 legacy=0x7f82040a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8208985700 1 -- 172.21.15.12:0/4108468117 >> v1:172.21.15.12:6789/0 conn(0x7f82040b2580 legacy=0x7f820414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8208985700 1 -- 172.21.15.12:0/4108468117 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040a7830 con 0x7f82040a8ac0 2021-10-20T23:27:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8208985700 1 --2- 172.21.15.12:0/4108468117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040a8ac0 0x7f8204152be0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f81f4001110 tx=0x7f81fc0091d0).ready entity=mon.0 client_cookie=3aff128194349f65 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f82037fe700 1 -- 172.21.15.12:0/4108468117 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f4001660 con 0x7f82040a8ac0 2021-10-20T23:27:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f82037fe700 1 -- 172.21.15.12:0/4108468117 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc00f510 con 0x7f82040a8ac0 2021-10-20T23:27:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f82037fe700 1 -- 172.21.15.12:0/4108468117 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81fc00f680 con 0x7f82040a8ac0 2021-10-20T23:27:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8209186700 1 -- 172.21.15.12:0/4108468117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040a8ac0 msgr2=0x7f8204152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8209186700 1 --2- 172.21.15.12:0/4108468117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040a8ac0 0x7f8204152be0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f81f4001110 tx=0x7f81fc0091d0).stop 2021-10-20T23:27:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8209186700 1 -- 172.21.15.12:0/4108468117 shutdown_connections 2021-10-20T23:27:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8209186700 1 --2- 172.21.15.12:0/4108468117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040a8ac0 0x7f8204152be0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8209186700 1 -- 172.21.15.12:0/4108468117 >> 172.21.15.12:0/4108468117 conn(0x7f8204060180 msgr2=0x7f82040b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8209186700 1 -- 172.21.15.12:0/4108468117 shutdown_connections 2021-10-20T23:27:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8209186700 1 -- 172.21.15.12:0/4108468117 wait complete. 2021-10-20T23:27:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8209186700 1 Processor -- start 2021-10-20T23:27:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.838+0000 7f8209186700 1 -- start start 2021-10-20T23:27:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8209186700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82040a8ac0 0x7f8204064090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8209186700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82040b0010 0x7f820414a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8209186700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040b2580 0x7f820414a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8209186700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82041571b0 con 0x7f82040b2580 2021-10-20T23:27:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8209186700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8204157450 con 0x7f82040a8ac0 2021-10-20T23:27:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8209186700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8204149610 con 0x7f82040b0010 2021-10-20T23:27:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8208985700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040b2580 0x7f820414a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8208985700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040b2580 0x7f820414a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43268/0 (socket says 172.21.15.12:43268) 2021-10-20T23:27:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8208985700 1 -- 172.21.15.12:0/356033532 learned_addr learned my addr 172.21.15.12:0/356033532 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:45.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f81fb7fe700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82040b0010 0x7f820414a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8203fff700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82040a8ac0 0x7f8204064090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8208985700 1 -- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82040b0010 msgr2=0x7f820414a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8208985700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82040b0010 0x7f820414a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8208985700 1 -- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82040a8ac0 msgr2=0x7f8204064090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8208985700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82040a8ac0 0x7f8204064090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8208985700 1 -- 172.21.15.12:0/356033532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc009470 con 0x7f82040b2580 2021-10-20T23:27:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8208985700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040b2580 0x7f820414a6f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f81f4001110 tx=0x7f81fc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8201ffb700 1 -- 172.21.15.12:0/356033532 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81fc0032d0 con 0x7f82040b2580 2021-10-20T23:27:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8201ffb700 1 -- 172.21.15.12:0/356033532 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc011bf0 con 0x7f82040b2580 2021-10-20T23:27:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820414abe0 con 0x7f82040b2580 2021-10-20T23:27:45.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8201ffb700 1 -- 172.21.15.12:0/356033532 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81fc021440 con 0x7f82040b2580 2021-10-20T23:27:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8204148970 con 0x7f82040b2580 2021-10-20T23:27:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8204157610 con 0x7f82040b2580 2021-10-20T23:27:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.842+0000 7f8201ffb700 1 -- 172.21.15.12:0/356033532 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f81fc029070 con 0x7f82040b2580 2021-10-20T23:27:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.846+0000 7f8201ffb700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f81e8053580 0x7f81e8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.846+0000 7f8201ffb700 1 -- 172.21.15.12:0/356033532 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f81fc06c710 con 0x7f82040b2580 2021-10-20T23:27:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.846+0000 7f8203fff700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f81e8053580 0x7f81e8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.846+0000 7f8203fff700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f81e8053580 0x7f81e8055a40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f81f400b000 tx=0x7f81f4000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:45.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.850+0000 7f8201ffb700 1 -- 172.21.15.12:0/356033532 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f81fc043710 con 0x7f82040b2580 2021-10-20T23:27:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.978+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f82041497d0 con 0x7f82040b2580 2021-10-20T23:27:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.978+0000 7f8201ffb700 1 -- 172.21.15.12:0/356033532 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v112) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f81fc015090 con 0x7f82040b2580 2021-10-20T23:27:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:45.990 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 112, 2021-10-20T23:27:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:27:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:27:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:27:36.420656+0000", 2021-10-20T23:27:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:27:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:27:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:27:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:27:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:27:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:27:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:27:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:27:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:27:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:27:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:27:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:27:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 20, 2021-10-20T23:27:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:27:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:27:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:27:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:27:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:27:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:27:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:27:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:27:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:27:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:27:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:27:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:27:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:27:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:27:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:27:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:27:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:27:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:27:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:27:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:27:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:27:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:27:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:27:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:27:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:27:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:27:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:27:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:27:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 19, 2021-10-20T23:27:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:27:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:27:33.634838+0000", 2021-10-20T23:27:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:27:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:27:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:27:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:27:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:27:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "111", 2021-10-20T23:27:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:27:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:27:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:27:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:27:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:27:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:27:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 20, 2021-10-20T23:27:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:27:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:27:34.436087+0000", 2021-10-20T23:27:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:27:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:27:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:27:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:27:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:27:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.047 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "112", 2021-10-20T23:27:46.047 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:46.047 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:46.047 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:46.047 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:27:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:27:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:27:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:27:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:27:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:27:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:27:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:27:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:27:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:27:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:27:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:27:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:27:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:27:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:27:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:27:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:27:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:27:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:27:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:27:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:27:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:27:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:27:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:27:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:27:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:27:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:27:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:27:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:27:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:27:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:27:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 109, 2021-10-20T23:27:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:27:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:27:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:27:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:27:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:27:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:27:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:27:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:27:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:27:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:27:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:27:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:27:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:27:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:27:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:27:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:27:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:27:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:27:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:27:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:27:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:27:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:27:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:27:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:27:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:27:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:27:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 109, 2021-10-20T23:27:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:27:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:27:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:27:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:27:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:27:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:27:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:27:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:27:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:27:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:27:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:27:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:27:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:27:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 109, 2021-10-20T23:27:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:27:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:27:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:27:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:27:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:27:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:27:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:27:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:27:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:27:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:27:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:27:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:27:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:27:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:27:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:27:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:27:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:27:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:27:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:27:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:27:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:27:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:27:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:27:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:27:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:27:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:27:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:27:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:27:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:27:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:27:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:27:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:27:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:27:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:27:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:27:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:27:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:27:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:27:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:27:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:27:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:27:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:27:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:27:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:27:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:27:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:27:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:27:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:27:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:27:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:27:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:27:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:27:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:27:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:27:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:27:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:27:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:27:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:27:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:27:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:27:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:27:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:27:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:27:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:27:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:27:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:27:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:27:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:27:46.213 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:46.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f81e8053580 msgr2=0x7f81e8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f81e8053580 0x7f81e8055a40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f81f400b000 tx=0x7f81f4000bc0).stop 2021-10-20T23:27:46.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040b2580 msgr2=0x7f820414a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040b2580 0x7f820414a6f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f81f4001110 tx=0x7f81fc016000).stop 2021-10-20T23:27:46.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 shutdown_connections 2021-10-20T23:27:46.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f81e8053580 0x7f81e8055a40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82040b2580 0x7f820414a6f0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82040b0010 0x7f820414a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 --2- 172.21.15.12:0/356033532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82040a8ac0 0x7f8204064090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 >> 172.21.15.12:0/356033532 conn(0x7f8204060180 msgr2=0x7f82040b58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:46.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 shutdown_connections 2021-10-20T23:27:46.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:45.982+0000 7f8209186700 1 -- 172.21.15.12:0/356033532 wait complete. 2021-10-20T23:27:46.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:46.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 Processor -- start 2021-10-20T23:27:46.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 -- start start 2021-10-20T23:27:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f24341483a0 0x7f24340b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24340a70c0 0x7f2434144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24340b0350 con 0x7f24340b1db0 2021-10-20T23:27:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24340a90c0 con 0x7f24341483a0 2021-10-20T23:27:46.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24340b05f0 con 0x7f24340a70c0 2021-10-20T23:27:46.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f2433fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f24341483a0 0x7f24340b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f2438f16700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f24340b1db0 0x7f24340b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:48930/0 (socket says 172.21.15.12:48930) 2021-10-20T23:27:46.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f2439717700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24340a70c0 0x7f2434144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f2438f16700 1 -- 172.21.15.12:0/912980814 learned_addr learned my addr 172.21.15.12:0/912980814 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:46.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f2433fff700 1 -- 172.21.15.12:0/912980814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24340a70c0 msgr2=0x7f2434144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:46.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f2433fff700 1 --2- 172.21.15.12:0/912980814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24340a70c0 0x7f2434144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f2433fff700 1 -- 172.21.15.12:0/912980814 >> v1:172.21.15.31:6789/0 conn(0x7f24340b1db0 legacy=0x7f24340b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f2433fff700 1 -- 172.21.15.12:0/912980814 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340b0890 con 0x7f24341483a0 2021-10-20T23:27:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f24337fe700 1 -- 172.21.15.12:0/912980814 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893843624 0 0) 0x7f24340b0350 con 0x7f24340b1db0 2021-10-20T23:27:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f2433fff700 1 --2- 172.21.15.12:0/912980814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24341483a0 0x7f24340b0fd0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f2434147730 tx=0x7f242c0091d0).ready entity=mon.1 client_cookie=8c4c74a02dc9f1b4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f24337fe700 1 -- 172.21.15.12:0/912980814 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f242c00b680 con 0x7f24341483a0 2021-10-20T23:27:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f24337fe700 1 -- 172.21.15.12:0/912980814 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c00b7e0 con 0x7f24341483a0 2021-10-20T23:27:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f24337fe700 1 -- 172.21.15.12:0/912980814 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f242c00b950 con 0x7f24341483a0 2021-10-20T23:27:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 -- 172.21.15.12:0/912980814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24341483a0 msgr2=0x7f24340b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 --2- 172.21.15.12:0/912980814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24341483a0 0x7f24340b0fd0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f2434147730 tx=0x7f242c0091d0).stop 2021-10-20T23:27:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 -- 172.21.15.12:0/912980814 shutdown_connections 2021-10-20T23:27:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 --2- 172.21.15.12:0/912980814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24340a70c0 0x7f2434144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 --2- 172.21.15.12:0/912980814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24341483a0 0x7f24340b0fd0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.322+0000 7f243b17a700 1 -- 172.21.15.12:0/912980814 >> 172.21.15.12:0/912980814 conn(0x7f243405f6b0 msgr2=0x7f243405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 -- 172.21.15.12:0/912980814 shutdown_connections 2021-10-20T23:27:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 -- 172.21.15.12:0/912980814 wait complete. 2021-10-20T23:27:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 Processor -- start 2021-10-20T23:27:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 -- start start 2021-10-20T23:27:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24340a70c0 0x7f24340ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340b1db0 0x7f24340abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24341483a0 0x7f243414b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243414b030 con 0x7f24340b1db0 2021-10-20T23:27:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340a97c0 con 0x7f24340a70c0 2021-10-20T23:27:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f243b17a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24340a9a60 con 0x7f24341483a0 2021-10-20T23:27:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2433fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340b1db0 0x7f24340abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2433fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340b1db0 0x7f24340abca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43280/0 (socket says 172.21.15.12:43280) 2021-10-20T23:27:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2433fff700 1 -- 172.21.15.12:0/1211826067 learned_addr learned my addr 172.21.15.12:0/1211826067 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2438f16700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24340a70c0 0x7f24340ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2439717700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24341483a0 0x7f243414b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2433fff700 1 -- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24341483a0 msgr2=0x7f243414b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2433fff700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24341483a0 0x7f243414b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2433fff700 1 -- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24340a70c0 msgr2=0x7f24340ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2433fff700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24340a70c0 0x7f24340ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2433fff700 1 -- 172.21.15.12:0/1211826067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c009470 con 0x7f24340b1db0 2021-10-20T23:27:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.326+0000 7f2433fff700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340b1db0 0x7f24340abca0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f2434147730 tx=0x7f242c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f2431ffb700 1 -- 172.21.15.12:0/1211826067 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f242c00b680 con 0x7f24340b1db0 2021-10-20T23:27:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f2431ffb700 1 -- 172.21.15.12:0/1211826067 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c021630 con 0x7f24340b1db0 2021-10-20T23:27:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24340a9d00 con 0x7f24340b1db0 2021-10-20T23:27:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f2431ffb700 1 -- 172.21.15.12:0/1211826067 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f242c021990 con 0x7f24340b1db0 2021-10-20T23:27:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2434149ca0 con 0x7f24340b1db0 2021-10-20T23:27:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24340a9e90 con 0x7f24340b1db0 2021-10-20T23:27:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f2431ffb700 1 -- 172.21.15.12:0/1211826067 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f242c027020 con 0x7f24340b1db0 2021-10-20T23:27:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f2431ffb700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2418053610 0x7f2418055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f2431ffb700 1 -- 172.21.15.12:0/1211826067 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f242c06ce10 con 0x7f24340b1db0 2021-10-20T23:27:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.330+0000 7f2438f16700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2418053610 0x7f2418055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.334+0000 7f2438f16700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2418053610 0x7f2418055ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f241c00d000 tx=0x7f241c007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.338+0000 7f2431ffb700 1 -- 172.21.15.12:0/1211826067 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f242c043e10 con 0x7f24340b1db0 2021-10-20T23:27:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2434057350 con 0x7f24340b1db0 2021-10-20T23:27:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f2431ffb700 1 -- 172.21.15.12:0/1211826067 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f242c015020 con 0x7f24340b1db0 2021-10-20T23:27:46.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:46.511 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1540805449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1540805449},{"type":"v1","addr":"172.21.15.31:6835","nonce":1540805449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2826685098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2826685098},{"type":"v1","addr":"172.21.15.12:6833","nonce":2826685098}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:35.417915+0000","modified":"2021-10-20T23:27:36.421728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/3124306556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3124306556},{"type":"v1","addr":"172.21.15.12:6835","nonce":3124306556}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-20T23:27:46.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2418053610 msgr2=0x7f2418055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2418053610 0x7f2418055ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f241c00d000 tx=0x7f241c007a00).stop 2021-10-20T23:27:46.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340b1db0 msgr2=0x7f24340abca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340b1db0 0x7f24340abca0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f2434147730 tx=0x7f242c016000).stop 2021-10-20T23:27:46.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 shutdown_connections 2021-10-20T23:27:46.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2418053610 0x7f2418055ad0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f24341483a0 0x7f243414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24340b1db0 0x7f24340abca0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 --2- 172.21.15.12:0/1211826067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24340a70c0 0x7f24340ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 >> 172.21.15.12:0/1211826067 conn(0x7f243405f6b0 msgr2=0x7f2434144830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:46.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 shutdown_connections 2021-10-20T23:27:46.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.502+0000 7f243b17a700 1 -- 172.21.15.12:0/1211826067 wait complete. 2021-10-20T23:27:46.517 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 54 2021-10-20T23:27:46.524 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:27:46.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd54359e700 1 Processor -- start 2021-10-20T23:27:46.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd54359e700 1 -- start start 2021-10-20T23:27:46.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd54359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd54405c7d0 0x7fd5440b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd54359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd54405d0b0 0x7fd54413f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd54359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd5440ace30 0x7fd5440aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd54359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd544067d70 con 0x7fd5440ace30 2021-10-20T23:27:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd54359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54413f880 con 0x7fd54405c7d0 2021-10-20T23:27:46.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd54359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54405cbb0 con 0x7fd54405d0b0 2021-10-20T23:27:46.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd542d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd5440ace30 0x7fd5440aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd542d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd5440ace30 0x7fd5440aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43290/0 (socket says 172.21.15.12:43290) 2021-10-20T23:27:46.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd542d9d700 1 -- 172.21.15.12:0/3411976258 learned_addr learned my addr 172.21.15.12:0/3411976258 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd541d9b700 1 --2- 172.21.15.12:0/3411976258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd54405d0b0 0x7fd54413f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd54259c700 1 --2- 172.21.15.12:0/3411976258 >> v2:172.21.15.31:3300/0 conn(0x7fd54405c7d0 0x7fd5440b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd542d9d700 1 -- 172.21.15.12:0/3411976258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd54405d0b0 msgr2=0x7fd54413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd542d9d700 1 --2- 172.21.15.12:0/3411976258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd54405d0b0 0x7fd54413f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd542d9d700 1 -- 172.21.15.12:0/3411976258 >> v2:172.21.15.31:3300/0 conn(0x7fd54405c7d0 msgr2=0x7fd5440b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd542d9d700 1 --2- 172.21.15.12:0/3411976258 >> v2:172.21.15.31:3300/0 conn(0x7fd54405c7d0 0x7fd5440b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd542d9d700 1 -- 172.21.15.12:0/3411976258 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5440b1790 con 0x7fd5440ace30 2021-10-20T23:27:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.622+0000 7fd541d9b700 1 --2- 172.21.15.12:0/3411976258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd54405d0b0 0x7fd54413f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd542d9d700 1 --2- 172.21.15.12:0/3411976258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5440ace30 0x7fd5440aece0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fd53c0032f0 tx=0x7fd53c009290).ready entity=mon.0 client_cookie=4188e62f7f5e220d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:46.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54159a700 1 -- 172.21.15.12:0/3411976258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd53c00b680 con 0x7fd5440ace30 2021-10-20T23:27:46.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54159a700 1 -- 172.21.15.12:0/3411976258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c00b7e0 con 0x7fd5440ace30 2021-10-20T23:27:46.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54159a700 1 -- 172.21.15.12:0/3411976258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd53c00b950 con 0x7fd5440ace30 2021-10-20T23:27:46.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 -- 172.21.15.12:0/3411976258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5440ace30 msgr2=0x7fd5440aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 --2- 172.21.15.12:0/3411976258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5440ace30 0x7fd5440aece0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fd53c0032f0 tx=0x7fd53c009290).stop 2021-10-20T23:27:46.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 -- 172.21.15.12:0/3411976258 shutdown_connections 2021-10-20T23:27:46.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 --2- 172.21.15.12:0/3411976258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5440ace30 0x7fd5440aece0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 --2- 172.21.15.12:0/3411976258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd54405d0b0 0x7fd54413f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 --2- 172.21.15.12:0/3411976258 >> v2:172.21.15.31:3300/0 conn(0x7fd54405c7d0 0x7fd5440b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 -- 172.21.15.12:0/3411976258 >> 172.21.15.12:0/3411976258 conn(0x7fd544060180 msgr2=0x7fd5440b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:46.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 -- 172.21.15.12:0/3411976258 shutdown_connections 2021-10-20T23:27:46.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 -- 172.21.15.12:0/3411976258 wait complete. 2021-10-20T23:27:46.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 Processor -- start 2021-10-20T23:27:46.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.626+0000 7fd54359e700 1 -- start start 2021-10-20T23:27:46.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd54405c7d0 0x7fd544066eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd54405d0b0 0x7fd5440b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5440ace30 0x7fd5440b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544063990 con 0x7fd54405d0b0 2021-10-20T23:27:46.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54414ec80 con 0x7fd54405c7d0 2021-10-20T23:27:46.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd544063bc0 con 0x7fd5440ace30 2021-10-20T23:27:46.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd541d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd54405d0b0 0x7fd5440b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd541d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd54405d0b0 0x7fd5440b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43294/0 (socket says 172.21.15.12:43294) 2021-10-20T23:27:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd541d9b700 1 -- 172.21.15.12:0/2708484086 learned_addr learned my addr 172.21.15.12:0/2708484086 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54259c700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd54405c7d0 0x7fd544066eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd542d9d700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5440ace30 0x7fd5440b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd541d9b700 1 -- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5440ace30 msgr2=0x7fd5440b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd541d9b700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5440ace30 0x7fd5440b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd541d9b700 1 -- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd54405c7d0 msgr2=0x7fd544066eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd541d9b700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd54405c7d0 0x7fd544066eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd541d9b700 1 -- 172.21.15.12:0/2708484086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53400c310 con 0x7fd54405d0b0 2021-10-20T23:27:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd541d9b700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd54405d0b0 0x7fd5440b4570 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fd53400d000 tx=0x7fd534006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2708484086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd53400d960 con 0x7fd54405d0b0 2021-10-20T23:27:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2708484086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53400dac0 con 0x7fd54405d0b0 2021-10-20T23:27:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c009530 con 0x7fd54405d0b0 2021-10-20T23:27:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2708484086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd53400de20 con 0x7fd54405d0b0 2021-10-20T23:27:46.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54414e8a0 con 0x7fd54405d0b0 2021-10-20T23:27:46.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.630+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5440b1a30 con 0x7fd54405d0b0 2021-10-20T23:27:46.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.634+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2708484086 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd534021060 con 0x7fd54405d0b0 2021-10-20T23:27:46.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.634+0000 7fd53b7fe700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd528053520 0x7fd5280559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:46.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.634+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2708484086 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd53406dff0 con 0x7fd54405d0b0 2021-10-20T23:27:46.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.634+0000 7fd54259c700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd528053520 0x7fd5280559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:46.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.634+0000 7fd54259c700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd528053520 0x7fd5280559e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fd52c00b000 tx=0x7fd52c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:46.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.638+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2708484086 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd534044ff0 con 0x7fd54405d0b0 2021-10-20T23:27:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.802+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd544057350 con 0x7fd54405d0b0 2021-10-20T23:27:46.971 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:27:46.962+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:27:46.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.978+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2708484086 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd53401f020 con 0x7fd54405d0b0 2021-10-20T23:27:46.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd528053520 msgr2=0x7fd5280559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd528053520 0x7fd5280559e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fd52c00b000 tx=0x7fd52c006df0).stop 2021-10-20T23:27:46.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd54405d0b0 msgr2=0x7fd5440b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:46.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd54405d0b0 0x7fd5440b4570 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fd53400d000 tx=0x7fd534006e80).stop 2021-10-20T23:27:46.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 shutdown_connections 2021-10-20T23:27:46.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd528053520 0x7fd5280559e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5440ace30 0x7fd5440b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd54405d0b0 0x7fd5440b4570 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 --2- 172.21.15.12:0/2708484086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd54405c7d0 0x7fd544066eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:46.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 >> 172.21.15.12:0/2708484086 conn(0x7fd544060180 msgr2=0x7fd54413a300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:46.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 shutdown_connections 2021-10-20T23:27:46.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:46.982+0000 7fd54359e700 1 -- 172.21.15.12:0/2708484086 wait complete. 2021-10-20T23:27:46.993 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:27:47.009 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:47.015 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:27:47.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c1954d700 1 Processor -- start 2021-10-20T23:27:47.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c1954d700 1 -- start start 2021-10-20T23:27:47.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c1954d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c140b27a0 0x7f6c14147470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c1954d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c140b1d10 0x7f6c1414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c1954d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c140b2b80 con 0x7f6c1405c490 2021-10-20T23:27:47.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c1954d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c141451b0 con 0x7f6c140b1d10 2021-10-20T23:27:47.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c1954d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1414aad0 con 0x7f6c140b27a0 2021-10-20T23:27:47.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c137fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c140b1d10 0x7f6c1414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c137fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c140b1d10 0x7f6c1414b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43314/0 (socket says 172.21.15.12:43314) 2021-10-20T23:27:47.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c137fe700 1 -- 172.21.15.12:0/4225772186 learned_addr learned my addr 172.21.15.12:0/4225772186 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:47.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c13fff700 1 --2- 172.21.15.12:0/4225772186 >> v2:172.21.15.31:3300/0 conn(0x7f6c140b27a0 0x7f6c14147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c137fe700 1 -- 172.21.15.12:0/4225772186 >> v2:172.21.15.31:3300/0 conn(0x7f6c140b27a0 msgr2=0x7f6c14147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:47.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c137fe700 1 --2- 172.21.15.12:0/4225772186 >> v2:172.21.15.31:3300/0 conn(0x7f6c140b27a0 0x7f6c14147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c137fe700 1 -- 172.21.15.12:0/4225772186 >> v1:172.21.15.31:6789/0 conn(0x7f6c1405c490 legacy=0x7f6c140a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c137fe700 1 -- 172.21.15.12:0/4225772186 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140b0ec0 con 0x7f6c140b1d10 2021-10-20T23:27:47.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c137fe700 1 --2- 172.21.15.12:0/4225772186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140b1d10 0x7f6c1414b1d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f6bfc0032f0 tx=0x7f6bfc009290).ready entity=mon.0 client_cookie=9b0fcd82e8bddb77 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:47.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c12ffd700 1 -- 172.21.15.12:0/4225772186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bfc00b870 con 0x7f6c140b1d10 2021-10-20T23:27:47.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c12ffd700 1 -- 172.21.15.12:0/4225772186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc00b9d0 con 0x7f6c140b1d10 2021-10-20T23:27:47.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.102+0000 7f6c12ffd700 1 -- 172.21.15.12:0/4225772186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bfc00bb40 con 0x7f6c140b1d10 2021-10-20T23:27:47.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 -- 172.21.15.12:0/4225772186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140b1d10 msgr2=0x7f6c1414b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 --2- 172.21.15.12:0/4225772186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140b1d10 0x7f6c1414b1d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f6bfc0032f0 tx=0x7f6bfc009290).stop 2021-10-20T23:27:47.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 -- 172.21.15.12:0/4225772186 shutdown_connections 2021-10-20T23:27:47.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 --2- 172.21.15.12:0/4225772186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140b1d10 0x7f6c1414b1d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 --2- 172.21.15.12:0/4225772186 >> v2:172.21.15.31:3300/0 conn(0x7f6c140b27a0 0x7f6c14147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 -- 172.21.15.12:0/4225772186 >> 172.21.15.12:0/4225772186 conn(0x7f6c14061140 msgr2=0x7f6c14062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:47.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 -- 172.21.15.12:0/4225772186 shutdown_connections 2021-10-20T23:27:47.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 -- 172.21.15.12:0/4225772186 wait complete. 2021-10-20T23:27:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 Processor -- start 2021-10-20T23:27:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 -- start start 2021-10-20T23:27:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1405c490 0x7f6c1414c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c140b1d10 0x7f6c14144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c140b27a0 0x7f6c14144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140a9cd0 con 0x7f6c1405c490 2021-10-20T23:27:47.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140a9f70 con 0x7f6c140b27a0 2021-10-20T23:27:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c1954d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140aa210 con 0x7f6c140b1d10 2021-10-20T23:27:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c13fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1405c490 0x7f6c1414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c13fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1405c490 0x7f6c1414c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43318/0 (socket says 172.21.15.12:43318) 2021-10-20T23:27:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c13fff700 1 -- 172.21.15.12:0/1747367375 learned_addr learned my addr 172.21.15.12:0/1747367375 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c18d4c700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c140b27a0 0x7f6c14144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.106+0000 7f6c137fe700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c140b1d10 0x7f6c14144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c13fff700 1 -- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c140b1d10 msgr2=0x7f6c14144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c13fff700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c140b1d10 0x7f6c14144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c13fff700 1 -- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c140b27a0 msgr2=0x7f6c14144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c13fff700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c140b27a0 0x7f6c14144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c13fff700 1 -- 172.21.15.12:0/1747367375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc009530 con 0x7f6c1405c490 2021-10-20T23:27:47.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c18d4c700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c140b27a0 0x7f6c14144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:47.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c13fff700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1405c490 0x7f6c1414c310 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f6c0400c000 tx=0x7f6c04006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c117fa700 1 -- 172.21.15.12:0/1747367375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c04010780 con 0x7f6c1405c490 2021-10-20T23:27:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c117fa700 1 -- 172.21.15.12:0/1747367375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c040108e0 con 0x7f6c1405c490 2021-10-20T23:27:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c14144ef0 con 0x7f6c1405c490 2021-10-20T23:27:47.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c117fa700 1 -- 172.21.15.12:0/1747367375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c04010c40 con 0x7f6c1405c490 2021-10-20T23:27:47.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c14156580 con 0x7f6c1405c490 2021-10-20T23:27:47.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c14057350 con 0x7f6c1405c490 2021-10-20T23:27:47.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c117fa700 1 -- 172.21.15.12:0/1747367375 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c0401c460 con 0x7f6c1405c490 2021-10-20T23:27:47.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c117fa700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6bf8053610 0x7f6bf8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c117fa700 1 -- 172.21.15.12:0/1747367375 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f6c0406c170 con 0x7f6c1405c490 2021-10-20T23:27:47.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.110+0000 7f6c137fe700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6bf8053610 0x7f6bf8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.114+0000 7f6c137fe700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6bf8053610 0x7f6bf8055ad0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f6bfc019000 tx=0x7f6bfc016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.118+0000 7f6c117fa700 1 -- 172.21.15.12:0/1747367375 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c04043020 con 0x7f6c1405c490 2021-10-20T23:27:47.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.282+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c141567d0 con 0x7f6c1405c490 2021-10-20T23:27:47.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.282+0000 7f6c117fa700 1 -- 172.21.15.12:0/1747367375 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f6c04046640 con 0x7f6c1405c490 2021-10-20T23:27:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:47.292 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":55,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1540805449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1540805449},{"type":"v1","addr":"172.21.15.31:6835","nonce":1540805449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2826685098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2826685098},{"type":"v1","addr":"172.21.15.12:6833","nonce":2826685098}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:35.417915+0000","modified":"2021-10-20T23:27:46.965439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-20T23:27:47.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6bf8053610 msgr2=0x7f6bf8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6bf8053610 0x7f6bf8055ad0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f6bfc019000 tx=0x7f6bfc016000).stop 2021-10-20T23:27:47.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1405c490 msgr2=0x7f6c1414c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1405c490 0x7f6c1414c310 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f6c0400c000 tx=0x7f6c04006df0).stop 2021-10-20T23:27:47.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 shutdown_connections 2021-10-20T23:27:47.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6bf8053610 0x7f6bf8055ad0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c140b27a0 0x7f6c14144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c140b1d10 0x7f6c14144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 --2- 172.21.15.12:0/1747367375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1405c490 0x7f6c1414c310 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 >> 172.21.15.12:0/1747367375 conn(0x7f6c14061140 msgr2=0x7f6c140b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:47.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 shutdown_connections 2021-10-20T23:27:47.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.286+0000 7f6c1954d700 1 -- 172.21.15.12:0/1747367375 wait complete. 2021-10-20T23:27:47.297 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 55 2021-10-20T23:27:47.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:27:47.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.398+0000 7f1eb759e700 1 Processor -- start 2021-10-20T23:27:47.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.398+0000 7f1eb759e700 1 -- start start 2021-10-20T23:27:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.398+0000 7f1eb759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1eb80b7370 0x7f1eb80b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.398+0000 7f1eb759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb80b2380 con 0x7f1eb80aac20 2021-10-20T23:27:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.398+0000 7f1eb759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb8144250 con 0x7f1eb80b3060 2021-10-20T23:27:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.398+0000 7f1eb759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb80b3570 con 0x7f1eb80b7370 2021-10-20T23:27:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1eb80b7370 0x7f1eb80b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb6d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1eb80aac20 0x7f1eb8064ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41924/0 (socket says 172.21.15.12:41924) 2021-10-20T23:27:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1eb80b7370 0x7f1eb80b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43326/0 (socket says 172.21.15.12:43326) 2021-10-20T23:27:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb6d9d700 1 -- 172.21.15.12:0/217106383 learned_addr learned my addr 172.21.15.12:0/217106383 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb5d9b700 1 --1- 172.21.15.12:0/217106383 >> v1:172.21.15.31:6789/0 conn(0x7f1eb80b3060 0x7f1eb813e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:48984/0 (socket says 172.21.15.12:48984) 2021-10-20T23:27:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb659c700 1 -- 172.21.15.12:0/217106383 >> v1:172.21.15.31:6789/0 conn(0x7f1eb80b3060 legacy=0x7f1eb813e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb659c700 1 -- 172.21.15.12:0/217106383 >> v1:172.21.15.12:6789/0 conn(0x7f1eb80aac20 legacy=0x7f1eb8064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb659c700 1 -- 172.21.15.12:0/217106383 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80b25b0 con 0x7f1eb80b7370 2021-10-20T23:27:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb659c700 1 --2- 172.21.15.12:0/217106383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b7370 0x7f1eb80b7750 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f1ea8002f70 tx=0x7f1ea8006d90).ready entity=mon.0 client_cookie=5dd237d93159d835 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb559a700 1 -- 172.21.15.12:0/217106383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea800f6d0 con 0x7f1eb80b7370 2021-10-20T23:27:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb559a700 1 -- 172.21.15.12:0/217106383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea8000e90 con 0x7f1eb80b7370 2021-10-20T23:27:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb559a700 1 -- 172.21.15.12:0/217106383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea800fa20 con 0x7f1eb80b7370 2021-10-20T23:27:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb759e700 1 -- 172.21.15.12:0/217106383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b7370 msgr2=0x7f1eb80b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb759e700 1 --2- 172.21.15.12:0/217106383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b7370 0x7f1eb80b7750 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f1ea8002f70 tx=0x7f1ea8006d90).stop 2021-10-20T23:27:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb759e700 1 -- 172.21.15.12:0/217106383 shutdown_connections 2021-10-20T23:27:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb759e700 1 --2- 172.21.15.12:0/217106383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b7370 0x7f1eb80b7750 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb759e700 1 -- 172.21.15.12:0/217106383 >> 172.21.15.12:0/217106383 conn(0x7f1eb805f6b0 msgr2=0x7f1eb805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb759e700 1 -- 172.21.15.12:0/217106383 shutdown_connections 2021-10-20T23:27:47.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb759e700 1 -- 172.21.15.12:0/217106383 wait complete. 2021-10-20T23:27:47.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb759e700 1 Processor -- start 2021-10-20T23:27:47.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.402+0000 7f1eb759e700 1 -- start start 2021-10-20T23:27:47.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb80aac20 0x7f1eb80ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b3060 0x7f1eb80ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1eb80b7370 0x7f1eb809f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80abcd0 con 0x7f1eb80b3060 2021-10-20T23:27:47.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8151090 con 0x7f1eb80aac20 2021-10-20T23:27:47.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80abef0 con 0x7f1eb80b7370 2021-10-20T23:27:47.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b3060 0x7f1eb80ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b3060 0x7f1eb80ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43334/0 (socket says 172.21.15.12:43334) 2021-10-20T23:27:47.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb5d9b700 1 -- 172.21.15.12:0/4077725219 learned_addr learned my addr 172.21.15.12:0/4077725219 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:47.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb659c700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb80aac20 0x7f1eb80ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb6d9d700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1eb80b7370 0x7f1eb809f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb5d9b700 1 -- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1eb80b7370 msgr2=0x7f1eb809f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb5d9b700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1eb80b7370 0x7f1eb809f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb5d9b700 1 -- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb80aac20 msgr2=0x7f1eb80ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb5d9b700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb80aac20 0x7f1eb80ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb5d9b700 1 -- 172.21.15.12:0/4077725219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea800b120 con 0x7f1eb80b3060 2021-10-20T23:27:47.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb5d9b700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b3060 0x7f1eb80ace10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f1eb80b4fa0 tx=0x7f1eac007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:47.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1ea77fe700 1 -- 172.21.15.12:0/4077725219 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac0070d0 con 0x7f1eb80b3060 2021-10-20T23:27:47.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1ea77fe700 1 -- 172.21.15.12:0/4077725219 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac007230 con 0x7f1eb80b3060 2021-10-20T23:27:47.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1ea77fe700 1 -- 172.21.15.12:0/4077725219 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac005740 con 0x7f1eb80b3060 2021-10-20T23:27:47.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb80ac190 con 0x7f1eb80b3060 2021-10-20T23:27:47.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb80ad380 con 0x7f1eb80b3060 2021-10-20T23:27:47.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb8057350 con 0x7f1eb80b3060 2021-10-20T23:27:47.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.406+0000 7f1ea77fe700 1 -- 172.21.15.12:0/4077725219 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1eac010070 con 0x7f1eb80b3060 2021-10-20T23:27:47.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.410+0000 7f1ea77fe700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e940536a0 0x7f1e94055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:47.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.410+0000 7f1ea77fe700 1 -- 172.21.15.12:0/4077725219 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f1eac06b020 con 0x7f1eb80b3060 2021-10-20T23:27:47.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.410+0000 7f1eb659c700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e940536a0 0x7f1e94055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:47.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.410+0000 7f1eb659c700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e940536a0 0x7f1e94055b60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f1ea801b000 tx=0x7f1ea8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:47.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.414+0000 7f1ea77fe700 1 -- 172.21.15.12:0/4077725219 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1eac041fd0 con 0x7f1eb80b3060 2021-10-20T23:27:47.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.574+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1eb80601a0 con 0x7f1eb80b3060 2021-10-20T23:27:47.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.982+0000 7f1ea77fe700 1 -- 172.21.15.12:0/4077725219 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1eac018070 con 0x7f1eb80b3060 2021-10-20T23:27:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e940536a0 msgr2=0x7f1e94055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e940536a0 0x7f1e94055b60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f1ea801b000 tx=0x7f1ea8015000).stop 2021-10-20T23:27:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b3060 msgr2=0x7f1eb80ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b3060 0x7f1eb80ace10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f1eb80b4fa0 tx=0x7f1eac007c00).stop 2021-10-20T23:27:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 shutdown_connections 2021-10-20T23:27:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e940536a0 0x7f1e94055b60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1eb80b7370 0x7f1eb809f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb80b3060 0x7f1eb80ace10 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 --2- 172.21.15.12:0/4077725219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb80aac20 0x7f1eb80ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:47.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 >> 172.21.15.12:0/4077725219 conn(0x7f1eb805f6b0 msgr2=0x7f1eb813e560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:47.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 shutdown_connections 2021-10-20T23:27:47.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:47.986+0000 7f1eb759e700 1 -- 172.21.15.12:0/4077725219 wait complete. 2021-10-20T23:27:48.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:27:48.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.122+0000 7f87d4572700 1 Processor -- start 2021-10-20T23:27:48.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.122+0000 7f87d4572700 1 -- start start 2021-10-20T23:27:48.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc0b6760 0x7f87cc13ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:48.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f87cc0aa080 0x7f87cc13d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:48.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87cc13d6d0 con 0x7f87cc05fdb0 2021-10-20T23:27:48.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc0ac550 con 0x7f87cc0aa080 2021-10-20T23:27:48.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0ac7f0 con 0x7f87cc0b6760 2021-10-20T23:27:48.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d1b0d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f87cc0aa080 0x7f87cc13d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:48.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d1b0d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f87cc0aa080 0x7f87cc13d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43342/0 (socket says 172.21.15.12:43342) 2021-10-20T23:27:48.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d1b0d700 1 -- 172.21.15.12:0/1695857064 learned_addr learned my addr 172.21.15.12:0/1695857064 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d230e700 1 --2- 172.21.15.12:0/1695857064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc0b6760 0x7f87cc13ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d130c700 1 -- 172.21.15.12:0/1695857064 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066563147 0 0) 0x7f87cc13d6d0 con 0x7f87cc05fdb0 2021-10-20T23:27:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d130c700 1 -- 172.21.15.12:0/1695857064 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87b4003260 con 0x7f87cc05fdb0 2021-10-20T23:27:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d1b0d700 1 -- 172.21.15.12:0/1695857064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc0b6760 msgr2=0x7f87cc13ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d1b0d700 1 --2- 172.21.15.12:0/1695857064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc0b6760 0x7f87cc13ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d1b0d700 1 -- 172.21.15.12:0/1695857064 >> v1:172.21.15.31:6789/0 conn(0x7f87cc05fdb0 legacy=0x7f87cc1467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d1b0d700 1 -- 172.21.15.12:0/1695857064 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0aca90 con 0x7f87cc0aa080 2021-10-20T23:27:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d1b0d700 1 --2- 172.21.15.12:0/1695857064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 0x7f87cc13d1e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f87c8002f70 tx=0x7f87c8006eb0).ready entity=mon.0 client_cookie=da989f5dc9ae9be3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d130c700 1 -- 172.21.15.12:0/1695857064 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87c800d5c0 con 0x7f87cc0aa080 2021-10-20T23:27:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d130c700 1 -- 172.21.15.12:0/1695857064 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c8000e90 con 0x7f87cc0aa080 2021-10-20T23:27:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d130c700 1 -- 172.21.15.12:0/1695857064 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87c800d950 con 0x7f87cc0aa080 2021-10-20T23:27:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 -- 172.21.15.12:0/1695857064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 msgr2=0x7f87cc13d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 --2- 172.21.15.12:0/1695857064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 0x7f87cc13d1e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f87c8002f70 tx=0x7f87c8006eb0).stop 2021-10-20T23:27:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 -- 172.21.15.12:0/1695857064 shutdown_connections 2021-10-20T23:27:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 --2- 172.21.15.12:0/1695857064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 0x7f87cc13d1e0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 --2- 172.21.15.12:0/1695857064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc0b6760 0x7f87cc13ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 -- 172.21.15.12:0/1695857064 >> 172.21.15.12:0/1695857064 conn(0x7f87cc0b3480 msgr2=0x7f87cc0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 -- 172.21.15.12:0/1695857064 shutdown_connections 2021-10-20T23:27:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.126+0000 7f87d4572700 1 -- 172.21.15.12:0/1695857064 wait complete. 2021-10-20T23:27:48.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d4572700 1 Processor -- start 2021-10-20T23:27:48.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d4572700 1 -- start start 2021-10-20T23:27:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d4572700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc05fdb0 0x7f87cc146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d4572700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 0x7f87cc152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d4572700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87cc0b6760 0x7f87cc156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d4572700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc064b30 con 0x7f87cc0aa080 2021-10-20T23:27:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d4572700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc152900 con 0x7f87cc0b6760 2021-10-20T23:27:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d4572700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc064890 con 0x7f87cc05fdb0 2021-10-20T23:27:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d1b0d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 0x7f87cc152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d1b0d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 0x7f87cc152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43346/0 (socket says 172.21.15.12:43346) 2021-10-20T23:27:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d1b0d700 1 -- 172.21.15.12:0/3617199699 learned_addr learned my addr 172.21.15.12:0/3617199699 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d230e700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc05fdb0 0x7f87cc146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d2b0f700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87cc0b6760 0x7f87cc156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d1b0d700 1 -- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc05fdb0 msgr2=0x7f87cc146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d1b0d700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc05fdb0 0x7f87cc146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:48.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d1b0d700 1 -- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87cc0b6760 msgr2=0x7f87cc156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:48.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d1b0d700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87cc0b6760 0x7f87cc156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:48.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.130+0000 7f87d1b0d700 1 -- 172.21.15.12:0/3617199699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c800b1e0 con 0x7f87cc0aa080 2021-10-20T23:27:48.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.134+0000 7f87d1b0d700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 0x7f87cc152410 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f87c8002f70 tx=0x7f87c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.134+0000 7f87bf7fe700 1 -- 172.21.15.12:0/3617199699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87c80116e0 con 0x7f87cc0aa080 2021-10-20T23:27:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.134+0000 7f87bf7fe700 1 -- 172.21.15.12:0/3617199699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c8011840 con 0x7f87cc0aa080 2021-10-20T23:27:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.134+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc155af0 con 0x7f87cc0aa080 2021-10-20T23:27:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.134+0000 7f87bf7fe700 1 -- 172.21.15.12:0/3617199699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87c8011ba0 con 0x7f87cc0aa080 2021-10-20T23:27:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.134+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc0ae740 con 0x7f87cc0aa080 2021-10-20T23:27:48.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.134+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc0acd30 con 0x7f87cc0aa080 2021-10-20T23:27:48.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.134+0000 7f87bf7fe700 1 -- 172.21.15.12:0/3617199699 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f87c8025030 con 0x7f87cc0aa080 2021-10-20T23:27:48.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.134+0000 7f87bf7fe700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f87ac053610 0x7f87ac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:48.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.138+0000 7f87bf7fe700 1 -- 172.21.15.12:0/3617199699 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f87c806ca90 con 0x7f87cc0aa080 2021-10-20T23:27:48.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.138+0000 7f87d230e700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f87ac053610 0x7f87ac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:48.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.138+0000 7f87d230e700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f87ac053610 0x7f87ac055ad0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f87c000b000 tx=0x7f87c0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:48.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.142+0000 7f87bf7fe700 1 -- 172.21.15.12:0/3617199699 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f87c8043a40 con 0x7f87cc0aa080 2021-10-20T23:27:48.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.270+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87cc057350 con 0x7f87cc0aa080 2021-10-20T23:27:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:48.998+0000 7f87bf7fe700 1 -- 172.21.15.12:0/3617199699 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v114) v1 ==== 185+0+0 (secure 0 0 0) 0x7f87c80230e0 con 0x7f87cc0aa080 2021-10-20T23:27:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f87ac053610 msgr2=0x7f87ac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f87ac053610 0x7f87ac055ad0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f87c000b000 tx=0x7f87c0006df0).stop 2021-10-20T23:27:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 msgr2=0x7f87cc152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 0x7f87cc152410 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f87c8002f70 tx=0x7f87c8015000).stop 2021-10-20T23:27:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 shutdown_connections 2021-10-20T23:27:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f87ac053610 0x7f87ac055ad0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87cc0b6760 0x7f87cc156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87cc0aa080 0x7f87cc152410 secure :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0x7f87c8002f70 tx=0x7f87c8015000).stop 2021-10-20T23:27:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 --2- 172.21.15.12:0/3617199699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87cc05fdb0 0x7f87cc146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 >> 172.21.15.12:0/3617199699 conn(0x7f87cc0b3480 msgr2=0x7f87cc1415e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 shutdown_connections 2021-10-20T23:27:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.002+0000 7f87d4572700 1 -- 172.21.15.12:0/3617199699 wait complete. 2021-10-20T23:27:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:27:49.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:27:49.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.130+0000 7ff263ff2700 1 Processor -- start 2021-10-20T23:27:49.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.130+0000 7ff263ff2700 1 -- start start 2021-10-20T23:27:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff25c067300 0x7ff25c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c0aabb0 con 0x7ff25c060100 2021-10-20T23:27:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c0604e0 con 0x7ff25c143de0 2021-10-20T23:27:49.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c066ea0 con 0x7ff25c067300 2021-10-20T23:27:49.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff261d8e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff25c060100 0x7ff25c0b4750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41948/0 (socket says 172.21.15.12:41948) 2021-10-20T23:27:49.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff261d8e700 1 -- 172.21.15.12:0/2269814783 learned_addr learned my addr 172.21.15.12:0/2269814783 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:49.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff26158d700 1 --2- 172.21.15.12:0/2269814783 >> v2:172.21.15.12:3300/0 conn(0x7ff25c067300 0x7ff25c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:49.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff260d8c700 1 -- 172.21.15.12:0/2269814783 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759047017 0 0) 0x7ff25c0aabb0 con 0x7ff25c060100 2021-10-20T23:27:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff260d8c700 1 -- 172.21.15.12:0/2269814783 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff244003260 con 0x7ff25c060100 2021-10-20T23:27:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff260d8c700 1 -- 172.21.15.12:0/2269814783 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4144012357 0 0) 0x7ff244003260 con 0x7ff25c060100 2021-10-20T23:27:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff26158d700 1 -- 172.21.15.12:0/2269814783 >> v1:172.21.15.31:6789/0 conn(0x7ff25c143de0 legacy=0x7ff25c14b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff26158d700 1 -- 172.21.15.12:0/2269814783 >> v1:172.21.15.12:6789/0 conn(0x7ff25c060100 legacy=0x7ff25c0b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff26158d700 1 -- 172.21.15.12:0/2269814783 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0b33b0 con 0x7ff25c067300 2021-10-20T23:27:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff26158d700 1 --2- 172.21.15.12:0/2269814783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 0x7ff25c1438f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7ff258001800 tx=0x7ff24c006df0).ready entity=mon.0 client_cookie=579402538dfac711 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff260d8c700 1 -- 172.21.15.12:0/2269814783 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff258001660 con 0x7ff25c067300 2021-10-20T23:27:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff260d8c700 1 -- 172.21.15.12:0/2269814783 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c000e90 con 0x7ff25c067300 2021-10-20T23:27:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff260d8c700 1 -- 172.21.15.12:0/2269814783 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff24c00d4f0 con 0x7ff25c067300 2021-10-20T23:27:49.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 -- 172.21.15.12:0/2269814783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 msgr2=0x7ff25c1438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:49.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 --2- 172.21.15.12:0/2269814783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 0x7ff25c1438f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7ff258001800 tx=0x7ff24c006df0).stop 2021-10-20T23:27:49.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 -- 172.21.15.12:0/2269814783 shutdown_connections 2021-10-20T23:27:49.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 --2- 172.21.15.12:0/2269814783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 0x7ff25c1438f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:49.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 -- 172.21.15.12:0/2269814783 >> 172.21.15.12:0/2269814783 conn(0x7ff25c05cf30 msgr2=0x7ff25c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:49.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 -- 172.21.15.12:0/2269814783 shutdown_connections 2021-10-20T23:27:49.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.134+0000 7ff263ff2700 1 -- 172.21.15.12:0/2269814783 wait complete. 2021-10-20T23:27:49.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 Processor -- start 2021-10-20T23:27:49.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 -- start start 2021-10-20T23:27:49.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff25c060100 0x7ff25c0b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:49.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 0x7ff25c0ad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:49.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff25c143de0 0x7ff25c141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:49.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0ad2f0 con 0x7ff25c067300 2021-10-20T23:27:49.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0a0c30 con 0x7ff25c060100 2021-10-20T23:27:49.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0abfd0 con 0x7ff25c143de0 2021-10-20T23:27:49.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26158d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 0x7ff25c0ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:49.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26158d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 0x7ff25c0ad980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43360/0 (socket says 172.21.15.12:43360) 2021-10-20T23:27:49.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26158d700 1 -- 172.21.15.12:0/2814659334 learned_addr learned my addr 172.21.15.12:0/2814659334 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:49.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26258f700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff25c143de0 0x7ff25c141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:49.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff261d8e700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff25c060100 0x7ff25c0b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:49.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26158d700 1 -- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff25c143de0 msgr2=0x7ff25c141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:49.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26158d700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff25c143de0 0x7ff25c141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:49.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26158d700 1 -- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff25c060100 msgr2=0x7ff25c0b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:49.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26158d700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff25c060100 0x7ff25c0b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:49.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26158d700 1 -- 172.21.15.12:0/2814659334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c00b180 con 0x7ff25c067300 2021-10-20T23:27:49.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff261d8e700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff25c060100 0x7ff25c0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26258f700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff25c143de0 0x7ff25c141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff26158d700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 0x7ff25c0ad980 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7ff258001800 tx=0x7ff24c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:49.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff24affd700 1 -- 172.21.15.12:0/2814659334 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff24c002f50 con 0x7ff25c067300 2021-10-20T23:27:49.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff24affd700 1 -- 172.21.15.12:0/2814659334 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c00de40 con 0x7ff25c067300 2021-10-20T23:27:49.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c0ac270 con 0x7ff25c067300 2021-10-20T23:27:49.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff24affd700 1 -- 172.21.15.12:0/2814659334 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff24c01e5f0 con 0x7ff25c067300 2021-10-20T23:27:49.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.138+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c0ad4e0 con 0x7ff25c067300 2021-10-20T23:27:49.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.142+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c057350 con 0x7ff25c067300 2021-10-20T23:27:49.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.142+0000 7ff24affd700 1 -- 172.21.15.12:0/2814659334 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff24c025030 con 0x7ff25c067300 2021-10-20T23:27:49.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.142+0000 7ff24affd700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff23c053580 0x7ff23c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:49.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.142+0000 7ff24affd700 1 -- 172.21.15.12:0/2814659334 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6068+0+0 (secure 0 0 0) 0x7ff24c06c600 con 0x7ff25c067300 2021-10-20T23:27:49.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.142+0000 7ff261d8e700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff23c053580 0x7ff23c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:49.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.142+0000 7ff261d8e700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff23c053580 0x7ff23c055a40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff25800b000 tx=0x7ff258000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:49.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.146+0000 7ff24affd700 1 -- 172.21.15.12:0/2814659334 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff24c043760 con 0x7ff25c067300 2021-10-20T23:27:49.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:49.274+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff25c0b4ec0 con 0x7ff25c067300 2021-10-20T23:27:50.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.006+0000 7ff24affd700 1 -- 172.21.15.12:0/2814659334 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v115) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff24c023020 con 0x7ff25c067300 2021-10-20T23:27:50.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff23c053580 msgr2=0x7ff23c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff23c053580 0x7ff23c055a40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff25800b000 tx=0x7ff258000bc0).stop 2021-10-20T23:27:50.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 msgr2=0x7ff25c0ad980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 0x7ff25c0ad980 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7ff258001800 tx=0x7ff24c014000).stop 2021-10-20T23:27:50.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 shutdown_connections 2021-10-20T23:27:50.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff23c053580 0x7ff23c055a40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff25c143de0 0x7ff25c141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff25c067300 0x7ff25c0ad980 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 --2- 172.21.15.12:0/2814659334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff25c060100 0x7ff25c0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 >> 172.21.15.12:0/2814659334 conn(0x7ff25c05cf30 msgr2=0x7ff25c1436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:50.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 shutdown_connections 2021-10-20T23:27:50.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.010+0000 7ff263ff2700 1 -- 172.21.15.12:0/2814659334 wait complete. 2021-10-20T23:27:50.021 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:27:50.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:27:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb589d03700 1 Processor -- start 2021-10-20T23:27:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb589d03700 1 -- start start 2021-10-20T23:27:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb589d03700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5840ab160 0x7fb584067300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb589d03700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb5840b4d50 0x7fb5840b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb589d03700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb584065960 con 0x7fb5840aad80 2021-10-20T23:27:50.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb589d03700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb584064f10 con 0x7fb5840ab160 2021-10-20T23:27:50.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb589d03700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5840b3ce0 con 0x7fb5840b4d50 2021-10-20T23:27:50.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb583fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5840ab160 0x7fb584067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb583fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5840ab160 0x7fb584067300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43370/0 (socket says 172.21.15.12:43370) 2021-10-20T23:27:50.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb583fff700 1 -- 172.21.15.12:0/1186462331 learned_addr learned my addr 172.21.15.12:0/1186462331 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:50.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb589502700 1 --2- 172.21.15.12:0/1186462331 >> v2:172.21.15.31:3300/0 conn(0x7fb5840b4d50 0x7fb5840b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb583fff700 1 -- 172.21.15.12:0/1186462331 >> v2:172.21.15.31:3300/0 conn(0x7fb5840b4d50 msgr2=0x7fb5840b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:50.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb583fff700 1 --2- 172.21.15.12:0/1186462331 >> v2:172.21.15.31:3300/0 conn(0x7fb5840b4d50 0x7fb5840b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb583fff700 1 -- 172.21.15.12:0/1186462331 >> v1:172.21.15.31:6789/0 conn(0x7fb5840aad80 legacy=0x7fb584064800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb583fff700 1 -- 172.21.15.12:0/1186462331 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584066e60 con 0x7fb5840ab160 2021-10-20T23:27:50.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb589502700 1 --2- 172.21.15.12:0/1186462331 >> v2:172.21.15.31:3300/0 conn(0x7fb5840b4d50 0x7fb5840b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:50.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb583fff700 1 --2- 172.21.15.12:0/1186462331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ab160 0x7fb584067300 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fb578002f70 tx=0x7fb578006e50).ready entity=mon.0 client_cookie=7b5c6164ee8c9cfa server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:50.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb5837fe700 1 -- 172.21.15.12:0/1186462331 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb57800d610 con 0x7fb5840ab160 2021-10-20T23:27:50.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb5837fe700 1 -- 172.21.15.12:0/1186462331 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578000e90 con 0x7fb5840ab160 2021-10-20T23:27:50.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.122+0000 7fb5837fe700 1 -- 172.21.15.12:0/1186462331 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb57800d9a0 con 0x7fb5840ab160 2021-10-20T23:27:50.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 -- 172.21.15.12:0/1186462331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ab160 msgr2=0x7fb584067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 --2- 172.21.15.12:0/1186462331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ab160 0x7fb584067300 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fb578002f70 tx=0x7fb578006e50).stop 2021-10-20T23:27:50.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 -- 172.21.15.12:0/1186462331 shutdown_connections 2021-10-20T23:27:50.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 --2- 172.21.15.12:0/1186462331 >> v2:172.21.15.31:3300/0 conn(0x7fb5840b4d50 0x7fb5840b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 --2- 172.21.15.12:0/1186462331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ab160 0x7fb584067300 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 -- 172.21.15.12:0/1186462331 >> 172.21.15.12:0/1186462331 conn(0x7fb584062be0 msgr2=0x7fb58405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:50.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 -- 172.21.15.12:0/1186462331 shutdown_connections 2021-10-20T23:27:50.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 -- 172.21.15.12:0/1186462331 wait complete. 2021-10-20T23:27:50.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 Processor -- start 2021-10-20T23:27:50.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 -- start start 2021-10-20T23:27:50.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5840aad80 0x7fb5841509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b4d50 0x7fb5840b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ad1a0 0x7fb58414d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840b0bf0 con 0x7fb5840ad1a0 2021-10-20T23:27:50.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58409e8b0 con 0x7fb5840b4d50 2021-10-20T23:27:50.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589d03700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58409eb50 con 0x7fb5840aad80 2021-10-20T23:27:50.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589502700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ad1a0 0x7fb58414d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.126+0000 7fb589502700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ad1a0 0x7fb58414d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43378/0 (socket says 172.21.15.12:43378) 2021-10-20T23:27:50.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589502700 1 -- 172.21.15.12:0/394856278 learned_addr learned my addr 172.21.15.12:0/394856278 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:50.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb588d01700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5840aad80 0x7fb5841509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb583fff700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b4d50 0x7fb5840b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589502700 1 -- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5840aad80 msgr2=0x7fb5841509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589502700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5840aad80 0x7fb5841509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589502700 1 -- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b4d50 msgr2=0x7fb5840b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589502700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b4d50 0x7fb5840b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589502700 1 -- 172.21.15.12:0/394856278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57800b1e0 con 0x7fb5840ad1a0 2021-10-20T23:27:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589502700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ad1a0 0x7fb58414d3f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fb57c00a000 tx=0x7fb57c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb581ffb700 1 -- 172.21.15.12:0/394856278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb57c00f710 con 0x7fb5840ad1a0 2021-10-20T23:27:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb581ffb700 1 -- 172.21.15.12:0/394856278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c00f870 con 0x7fb5840ad1a0 2021-10-20T23:27:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58409edf0 con 0x7fb5840ad1a0 2021-10-20T23:27:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb581ffb700 1 -- 172.21.15.12:0/394856278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb57c00fbd0 con 0x7fb5840ad1a0 2021-10-20T23:27:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb584150eb0 con 0x7fb5840ad1a0 2021-10-20T23:27:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb584057350 con 0x7fb5840ad1a0 2021-10-20T23:27:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb581ffb700 1 -- 172.21.15.12:0/394856278 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb57c01a030 con 0x7fb5840ad1a0 2021-10-20T23:27:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb581ffb700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb564053610 0x7fb564055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb581ffb700 1 -- 172.21.15.12:0/394856278 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb57c06b6f0 con 0x7fb5840ad1a0 2021-10-20T23:27:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.130+0000 7fb588d01700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb564053610 0x7fb564055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.134+0000 7fb588d01700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb564053610 0x7fb564055ad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fb57400d000 tx=0x7fb574007b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:50.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.138+0000 7fb581ffb700 1 -- 172.21.15.12:0/394856278 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb57c0429d0 con 0x7fb5840ad1a0 2021-10-20T23:27:50.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.266+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb58405d9d0 con 0x7fb5840ad1a0 2021-10-20T23:27:50.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb581ffb700 1 -- 172.21.15.12:0/394856278 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb57c045ff0 con 0x7fb5840ad1a0 2021-10-20T23:27:50.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb564053610 msgr2=0x7fb564055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb564053610 0x7fb564055ad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fb57400d000 tx=0x7fb574007b50).stop 2021-10-20T23:27:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ad1a0 msgr2=0x7fb58414d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ad1a0 0x7fb58414d3f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fb57c00a000 tx=0x7fb57c008040).stop 2021-10-20T23:27:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 shutdown_connections 2021-10-20T23:27:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb564053610 0x7fb564055ad0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5840ad1a0 0x7fb58414d3f0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b4d50 0x7fb5840b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 --2- 172.21.15.12:0/394856278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5840aad80 0x7fb5841509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 >> 172.21.15.12:0/394856278 conn(0x7fb584062be0 msgr2=0x7fb584144bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 shutdown_connections 2021-10-20T23:27:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.274+0000 7fb589d03700 1 -- 172.21.15.12:0/394856278 wait complete. 2021-10-20T23:27:50.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-10-20T23:27:50.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.390+0000 7f37a359e700 1 Processor -- start 2021-10-20T23:27:50.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 -- start start 2021-10-20T23:27:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37a40b0710 0x7f37a4142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a4143920 con 0x7f37a40b30d0 2021-10-20T23:27:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a40b0af0 con 0x7f37a40ace70 2021-10-20T23:27:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a40ae680 con 0x7f37a40b0710 2021-10-20T23:27:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37a40b0710 0x7f37a4142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f379bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f37a40b30d0 0x7f37a4143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41978/0 (socket says 172.21.15.12:41978) 2021-10-20T23:27:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f379bfff700 1 -- 172.21.15.12:0/2481666511 learned_addr learned my addr 172.21.15.12:0/2481666511 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37a40b0710 0x7f37a4142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43382/0 (socket says 172.21.15.12:43382) 2021-10-20T23:27:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a259c700 1 -- 172.21.15.12:0/2481666511 >> v1:172.21.15.31:6789/0 conn(0x7f37a40ace70 legacy=0x7f37a413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a259c700 1 -- 172.21.15.12:0/2481666511 >> v1:172.21.15.12:6789/0 conn(0x7f37a40b30d0 legacy=0x7f37a4143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a1d9b700 1 -- 172.21.15.12:0/2481666511 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346970072 0 0) 0x7f37a4143920 con 0x7f37a40b30d0 2021-10-20T23:27:50.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a259c700 1 -- 172.21.15.12:0/2481666511 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a40ae920 con 0x7f37a40b0710 2021-10-20T23:27:50.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a259c700 1 --2- 172.21.15.12:0/2481666511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40b0710 0x7f37a4142d20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f3794002f70 tx=0x7f3794006df0).ready entity=mon.0 client_cookie=72b4571370b2eab server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:50.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a1d9b700 1 -- 172.21.15.12:0/2481666511 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f379400d610 con 0x7f37a40b0710 2021-10-20T23:27:50.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a1d9b700 1 -- 172.21.15.12:0/2481666511 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3794000e90 con 0x7f37a40b0710 2021-10-20T23:27:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a1d9b700 1 -- 172.21.15.12:0/2481666511 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f379400d960 con 0x7f37a40b0710 2021-10-20T23:27:50.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 -- 172.21.15.12:0/2481666511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40b0710 msgr2=0x7f37a4142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 --2- 172.21.15.12:0/2481666511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40b0710 0x7f37a4142d20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f3794002f70 tx=0x7f3794006df0).stop 2021-10-20T23:27:50.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 -- 172.21.15.12:0/2481666511 shutdown_connections 2021-10-20T23:27:50.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 --2- 172.21.15.12:0/2481666511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40b0710 0x7f37a4142d20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 -- 172.21.15.12:0/2481666511 >> 172.21.15.12:0/2481666511 conn(0x7f37a4061140 msgr2=0x7f37a4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 -- 172.21.15.12:0/2481666511 shutdown_connections 2021-10-20T23:27:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.394+0000 7f37a359e700 1 -- 172.21.15.12:0/2481666511 wait complete. 2021-10-20T23:27:50.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 Processor -- start 2021-10-20T23:27:50.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 -- start start 2021-10-20T23:27:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40ace70 0x7f37a40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a40b0710 0x7f37a4156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a40b30d0 0x7f37a4152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40ac4d0 con 0x7f37a40ace70 2021-10-20T23:27:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4155920 con 0x7f37a40b0710 2021-10-20T23:27:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4064890 con 0x7f37a40b30d0 2021-10-20T23:27:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40ace70 0x7f37a40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40ace70 0x7f37a40b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43388/0 (socket says 172.21.15.12:43388) 2021-10-20T23:27:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a259c700 1 -- 172.21.15.12:0/1197254583 learned_addr learned my addr 172.21.15.12:0/1197254583 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a2d9d700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a40b30d0 0x7f37a4152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f379bfff700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a40b0710 0x7f37a4156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a259c700 1 -- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a40b30d0 msgr2=0x7f37a4152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a259c700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a40b30d0 0x7f37a4152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a259c700 1 -- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a40b0710 msgr2=0x7f37a4156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:50.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a259c700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a40b0710 0x7f37a4156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:50.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a259c700 1 -- 172.21.15.12:0/1197254583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379400b180 con 0x7f37a40ace70 2021-10-20T23:27:50.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a259c700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40ace70 0x7f37a40b4d20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f3794002f70 tx=0x7f3794014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f379b7fe700 1 -- 172.21.15.12:0/1197254583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3794013de0 con 0x7f37a40ace70 2021-10-20T23:27:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f379b7fe700 1 -- 172.21.15.12:0/1197254583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379400d290 con 0x7f37a40ace70 2021-10-20T23:27:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a4155b50 con 0x7f37a40ace70 2021-10-20T23:27:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f379b7fe700 1 -- 172.21.15.12:0/1197254583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f379401e5f0 con 0x7f37a40ace70 2021-10-20T23:27:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.398+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a4156780 con 0x7f37a40ace70 2021-10-20T23:27:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.402+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a4057350 con 0x7f37a40ace70 2021-10-20T23:27:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.402+0000 7f379b7fe700 1 -- 172.21.15.12:0/1197254583 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3794025030 con 0x7f37a40ace70 2021-10-20T23:27:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.402+0000 7f379b7fe700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37880534f0 0x7f37880559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.402+0000 7f379b7fe700 1 -- 172.21.15.12:0/1197254583 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f379406c820 con 0x7f37a40ace70 2021-10-20T23:27:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.402+0000 7f379bfff700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37880534f0 0x7f37880559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.402+0000 7f379bfff700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37880534f0 0x7f37880559b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f378c00d000 tx=0x7f378c007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.406+0000 7f379b7fe700 1 -- 172.21.15.12:0/1197254583 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3794043a70 con 0x7f37a40ace70 2021-10-20T23:27:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:50.574+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f37a40b2c70 con 0x7f37a40ace70 2021-10-20T23:27:51.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.006+0000 7f379b7fe700 1 -- 172.21.15.12:0/1197254583 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v357) v1 ==== 127+0+0 (secure 0 0 0) 0x7f3794047010 con 0x7f37a40ace70 2021-10-20T23:27:51.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.010+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37880534f0 msgr2=0x7f37880559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:51.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.010+0000 7f37a359e700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37880534f0 0x7f37880559b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f378c00d000 tx=0x7f378c007a20).stop 2021-10-20T23:27:51.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.010+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40ace70 msgr2=0x7f37a40b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.010+0000 7f37a359e700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40ace70 0x7f37a40b4d20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f3794002f70 tx=0x7f3794014000).stop 2021-10-20T23:27:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.010+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 shutdown_connections 2021-10-20T23:27:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.010+0000 7f37a359e700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37880534f0 0x7f37880559b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.010+0000 7f37a359e700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37a40b30d0 0x7f37a4152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.010+0000 7f37a359e700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37a40b0710 0x7f37a4156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:51.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.010+0000 7f37a359e700 1 --2- 172.21.15.12:0/1197254583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a40ace70 0x7f37a40b4d20 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:51.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.014+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 >> 172.21.15.12:0/1197254583 conn(0x7f37a4061140 msgr2=0x7f37a4142010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:51.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.014+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 shutdown_connections 2021-10-20T23:27:51.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.014+0000 7f37a359e700 1 -- 172.21.15.12:0/1197254583 wait complete. 2021-10-20T23:27:51.037 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-20T23:27:51.038 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-10-20T23:27:51.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-10-20T23:27:51.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 Processor -- start 2021-10-20T23:27:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 -- start start 2021-10-20T23:27:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f76a413e740 0x7f76a4141080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a40aaa90 con 0x7f76a40b2720 2021-10-20T23:27:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a40b2b00 con 0x7f76a40b0ff0 2021-10-20T23:27:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a4140c90 con 0x7f76a413e740 2021-10-20T23:27:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f76a40b2720 0x7f76a413e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41992/0 (socket says 172.21.15.12:41992) 2021-10-20T23:27:51.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a259c700 1 -- 172.21.15.12:0/3974672946 learned_addr learned my addr 172.21.15.12:0/3974672946 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:51.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f769bfff700 1 --2- 172.21.15.12:0/3974672946 >> v2:172.21.15.31:3300/0 conn(0x7f76a413e740 0x7f76a4141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:51.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a1d9b700 1 -- 172.21.15.12:0/3974672946 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463308091 0 0) 0x7f7694001110 con 0x7f76a40b2720 2021-10-20T23:27:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a1d9b700 1 -- 172.21.15.12:0/3974672946 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7684003260 con 0x7f76a40b2720 2021-10-20T23:27:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f769bfff700 1 -- 172.21.15.12:0/3974672946 >> v1:172.21.15.31:6789/0 conn(0x7f76a40b0ff0 legacy=0x7f76a4141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f769bfff700 1 -- 172.21.15.12:0/3974672946 >> v1:172.21.15.12:6789/0 conn(0x7f76a40b2720 legacy=0x7f76a413e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f769bfff700 1 -- 172.21.15.12:0/3974672946 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a40aa2b0 con 0x7f76a413e740 2021-10-20T23:27:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f769bfff700 1 --2- 172.21.15.12:0/3974672946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a413e740 0x7f76a4141080 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f768c002f70 tx=0x7f768c006df0).ready entity=mon.1 client_cookie=aeaddfe077d558c3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a1d9b700 1 -- 172.21.15.12:0/3974672946 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768c00d610 con 0x7f76a413e740 2021-10-20T23:27:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a1d9b700 1 -- 172.21.15.12:0/3974672946 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c000e90 con 0x7f76a413e740 2021-10-20T23:27:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a1d9b700 1 -- 172.21.15.12:0/3974672946 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768c00d960 con 0x7f76a413e740 2021-10-20T23:27:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 -- 172.21.15.12:0/3974672946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a413e740 msgr2=0x7f76a4141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 --2- 172.21.15.12:0/3974672946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a413e740 0x7f76a4141080 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f768c002f70 tx=0x7f768c006df0).stop 2021-10-20T23:27:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 -- 172.21.15.12:0/3974672946 shutdown_connections 2021-10-20T23:27:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 --2- 172.21.15.12:0/3974672946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a413e740 0x7f76a4141080 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 -- 172.21.15.12:0/3974672946 >> 172.21.15.12:0/3974672946 conn(0x7f76a4060180 msgr2=0x7f76a40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 -- 172.21.15.12:0/3974672946 shutdown_connections 2021-10-20T23:27:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.142+0000 7f76a359e700 1 -- 172.21.15.12:0/3974672946 wait complete. 2021-10-20T23:27:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 Processor -- start 2021-10-20T23:27:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 -- start start 2021-10-20T23:27:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a40b0ff0 0x7f76a40b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a40b2720 0x7f76a405c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a405ccc0 0x7f76a4156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40a87f0 con 0x7f76a40b2720 2021-10-20T23:27:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4142c10 con 0x7f76a405ccc0 2021-10-20T23:27:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a405d2a0 con 0x7f76a40b0ff0 2021-10-20T23:27:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a40b2720 0x7f76a405c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a40b2720 0x7f76a405c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43404/0 (socket says 172.21.15.12:43404) 2021-10-20T23:27:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769bfff700 1 -- 172.21.15.12:0/3539336677 learned_addr learned my addr 172.21.15.12:0/3539336677 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a259c700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a40b0ff0 0x7f76a40b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a2d9d700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a405ccc0 0x7f76a4156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769bfff700 1 -- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a40b0ff0 msgr2=0x7f76a40b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769bfff700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a40b0ff0 0x7f76a40b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769bfff700 1 -- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a405ccc0 msgr2=0x7f76a4156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769bfff700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a405ccc0 0x7f76a4156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769bfff700 1 -- 172.21.15.12:0/3539336677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c00b180 con 0x7f76a40b2720 2021-10-20T23:27:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a2d9d700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a405ccc0 0x7f76a4156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769bfff700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a40b2720 0x7f76a405c7d0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f76a40b3f70 tx=0x7f768c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769b7fe700 1 -- 172.21.15.12:0/3539336677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768c016070 con 0x7f76a40b2720 2021-10-20T23:27:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769b7fe700 1 -- 172.21.15.12:0/3539336677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c00d290 con 0x7f76a40b2720 2021-10-20T23:27:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a40b3ca0 con 0x7f76a40b2720 2021-10-20T23:27:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f769b7fe700 1 -- 172.21.15.12:0/3539336677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768c013e50 con 0x7f76a40b2720 2021-10-20T23:27:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.146+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a4142030 con 0x7f76a40b2720 2021-10-20T23:27:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.150+0000 7f769b7fe700 1 -- 172.21.15.12:0/3539336677 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f768c024030 con 0x7f76a40b2720 2021-10-20T23:27:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.150+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a40aa490 con 0x7f76a40b2720 2021-10-20T23:27:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.150+0000 7f769b7fe700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7688053610 0x7f7688055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.150+0000 7f769b7fe700 1 -- 172.21.15.12:0/3539336677 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f768c06c430 con 0x7f76a40b2720 2021-10-20T23:27:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.150+0000 7f76a259c700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7688053610 0x7f7688055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:51.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.150+0000 7f76a259c700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7688053610 0x7f7688055ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f769400d000 tx=0x7f76940078a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:51.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.154+0000 7f769b7fe700 1 -- 172.21.15.12:0/3539336677 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f768c043710 con 0x7f76a40b2720 2021-10-20T23:27:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:51.326+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f76a4057350 con 0x7f76a40b2720 2021-10-20T23:27:52.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.010+0000 7f769b7fe700 1 -- 172.21.15.12:0/3539336677 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v358) v1 ==== 125+0+0 (secure 0 0 0) 0x7f768c022020 con 0x7f76a40b2720 2021-10-20T23:27:52.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7688053610 msgr2=0x7f7688055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7688053610 0x7f7688055ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f769400d000 tx=0x7f76940078a0).stop 2021-10-20T23:27:52.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a40b2720 msgr2=0x7f76a405c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a40b2720 0x7f76a405c7d0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f76a40b3f70 tx=0x7f768c014000).stop 2021-10-20T23:27:52.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 shutdown_connections 2021-10-20T23:27:52.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7688053610 0x7f7688055ad0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a405ccc0 0x7f76a4156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a40b2720 0x7f76a405c7d0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 --2- 172.21.15.12:0/3539336677 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a40b0ff0 0x7f76a40b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 >> 172.21.15.12:0/3539336677 conn(0x7f76a4060180 msgr2=0x7f76a40afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 shutdown_connections 2021-10-20T23:27:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.014+0000 7f76a359e700 1 -- 172.21.15.12:0/3539336677 wait complete. 2021-10-20T23:27:52.043 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:27:52.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.158+0000 7fab43151700 1 Processor -- start 2021-10-20T23:27:52.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab43151700 1 -- start start 2021-10-20T23:27:52.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab43151700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0aea40 0x7fab3c1437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab43151700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3c0b0990 con 0x7fab3c0ad000 2021-10-20T23:27:52.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab43151700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3c146700 con 0x7fab3c0b0480 2021-10-20T23:27:52.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab43151700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c0adc50 con 0x7fab3c0aea40 2021-10-20T23:27:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4194e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fab3c0ad000 0x7fab3c146b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42008/0 (socket says 172.21.15.12:42008) 2021-10-20T23:27:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4194e700 1 -- 172.21.15.12:0/1212203808 learned_addr learned my addr 172.21.15.12:0/1212203808 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4214f700 1 --2- 172.21.15.12:0/1212203808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0aea40 0x7fab3c1437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4114d700 1 -- 172.21.15.12:0/1212203808 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203291717 0 0) 0x7fab3c0b0990 con 0x7fab3c0ad000 2021-10-20T23:27:52.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4114d700 1 -- 172.21.15.12:0/1212203808 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab24003260 con 0x7fab3c0ad000 2021-10-20T23:27:52.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4114d700 1 -- 172.21.15.12:0/1212203808 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479290359 0 0) 0x7fab3c146700 con 0x7fab3c0b0480 2021-10-20T23:27:52.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4114d700 1 -- 172.21.15.12:0/1212203808 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab3c0b0990 con 0x7fab3c0b0480 2021-10-20T23:27:52.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4114d700 1 -- 172.21.15.12:0/1212203808 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 330092243 0 0) 0x7fab24003260 con 0x7fab3c0ad000 2021-10-20T23:27:52.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4214f700 1 -- 172.21.15.12:0/1212203808 >> v1:172.21.15.31:6789/0 conn(0x7fab3c0b0480 legacy=0x7fab3c14da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4214f700 1 -- 172.21.15.12:0/1212203808 >> v1:172.21.15.12:6789/0 conn(0x7fab3c0ad000 legacy=0x7fab3c146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4214f700 1 -- 172.21.15.12:0/1212203808 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c0aee20 con 0x7fab3c0aea40 2021-10-20T23:27:52.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4214f700 1 --2- 172.21.15.12:0/1212203808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0aea40 0x7fab3c1437b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fab38001b80 tx=0x7fab30006df0).ready entity=mon.2 client_cookie=4bfc79fb29680818 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:52.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4114d700 1 -- 172.21.15.12:0/1212203808 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab380019e0 con 0x7fab3c0aea40 2021-10-20T23:27:52.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4114d700 1 -- 172.21.15.12:0/1212203808 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab30000e90 con 0x7fab3c0aea40 2021-10-20T23:27:52.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.162+0000 7fab4114d700 1 -- 172.21.15.12:0/1212203808 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab30012460 con 0x7fab3c0aea40 2021-10-20T23:27:52.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 -- 172.21.15.12:0/1212203808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0aea40 msgr2=0x7fab3c1437b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 --2- 172.21.15.12:0/1212203808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0aea40 0x7fab3c1437b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fab38001b80 tx=0x7fab30006df0).stop 2021-10-20T23:27:52.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 -- 172.21.15.12:0/1212203808 shutdown_connections 2021-10-20T23:27:52.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 --2- 172.21.15.12:0/1212203808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0aea40 0x7fab3c1437b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 -- 172.21.15.12:0/1212203808 >> 172.21.15.12:0/1212203808 conn(0x7fab3c061230 msgr2=0x7fab3c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:52.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 -- 172.21.15.12:0/1212203808 shutdown_connections 2021-10-20T23:27:52.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 -- 172.21.15.12:0/1212203808 wait complete. 2021-10-20T23:27:52.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 Processor -- start 2021-10-20T23:27:52.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 -- start start 2021-10-20T23:27:52.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3c0ad000 0x7fab3c1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab3c0aea40 0x7fab3c148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0b0480 0x7fab3c0643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c063f80 con 0x7fab3c0ad000 2021-10-20T23:27:52.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c1563a0 con 0x7fab3c0aea40 2021-10-20T23:27:52.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab43151700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c152990 con 0x7fab3c0b0480 2021-10-20T23:27:52.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab4214f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3c0ad000 0x7fab3c1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.166+0000 7fab4214f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3c0ad000 0x7fab3c1524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43418/0 (socket says 172.21.15.12:43418) 2021-10-20T23:27:52.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab4214f700 1 -- 172.21.15.12:0/4086955855 learned_addr learned my addr 172.21.15.12:0/4086955855 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:52.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab42950700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0b0480 0x7fab3c0643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab4194e700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab3c0aea40 0x7fab3c148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab4214f700 1 -- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0b0480 msgr2=0x7fab3c0643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab4214f700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0b0480 0x7fab3c0643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab4214f700 1 -- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab3c0aea40 msgr2=0x7fab3c148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab4214f700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab3c0aea40 0x7fab3c148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab4214f700 1 -- 172.21.15.12:0/4086955855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3000b180 con 0x7fab3c0ad000 2021-10-20T23:27:52.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab4214f700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3c0ad000 0x7fab3c1524a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fab38001b80 tx=0x7fab30014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:52.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab2f7fe700 1 -- 172.21.15.12:0/4086955855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab30016070 con 0x7fab3c0ad000 2021-10-20T23:27:52.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab2f7fe700 1 -- 172.21.15.12:0/4086955855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab30002f50 con 0x7fab3c0ad000 2021-10-20T23:27:52.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c1497a0 con 0x7fab3c0ad000 2021-10-20T23:27:52.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab2f7fe700 1 -- 172.21.15.12:0/4086955855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab30012460 con 0x7fab3c0ad000 2021-10-20T23:27:52.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c1490e0 con 0x7fab3c0ad000 2021-10-20T23:27:52.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c0b0bc0 con 0x7fab3c0ad000 2021-10-20T23:27:52.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.170+0000 7fab2f7fe700 1 -- 172.21.15.12:0/4086955855 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab3000f030 con 0x7fab3c0ad000 2021-10-20T23:27:52.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.174+0000 7fab2f7fe700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab1c053610 0x7fab1c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.174+0000 7fab2f7fe700 1 -- 172.21.15.12:0/4086955855 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fab3006c2d0 con 0x7fab3c0ad000 2021-10-20T23:27:52.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.174+0000 7fab4194e700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab1c053610 0x7fab1c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.174+0000 7fab4194e700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab1c053610 0x7fab1c055ad0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fab3800d000 tx=0x7fab38001a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:52.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.178+0000 7fab2f7fe700 1 -- 172.21.15.12:0/4086955855 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab300435b0 con 0x7fab3c0ad000 2021-10-20T23:27:52.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.306+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fab3c057350 con 0x7fab3c0ad000 2021-10-20T23:27:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.314+0000 7fab2f7fe700 1 -- 172.21.15.12:0/4086955855 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fab300230c0 con 0x7fab3c0ad000 2021-10-20T23:27:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab1c053610 msgr2=0x7fab1c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab1c053610 0x7fab1c055ad0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fab3800d000 tx=0x7fab38001a00).stop 2021-10-20T23:27:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3c0ad000 msgr2=0x7fab3c1524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3c0ad000 0x7fab3c1524a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fab38001b80 tx=0x7fab30014000).stop 2021-10-20T23:27:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 shutdown_connections 2021-10-20T23:27:52.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fab1c053610 0x7fab1c055ad0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab3c0b0480 0x7fab3c0643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab3c0aea40 0x7fab3c148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 --2- 172.21.15.12:0/4086955855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3c0ad000 0x7fab3c1524a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 >> 172.21.15.12:0/4086955855 conn(0x7fab3c061230 msgr2=0x7fab3c0b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 shutdown_connections 2021-10-20T23:27:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.318+0000 7fab43151700 1 -- 172.21.15.12:0/4086955855 wait complete. 2021-10-20T23:27:52.341 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:27:52.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:52.366 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:52.387 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:52.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:27:52.458 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:27:52.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:52.460 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:52.461 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:27:52.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:27:52.484 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:27:52.485 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:27:52.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:27:52.490 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:27:52.492 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:27:52.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:27:52.524 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:27:52.525 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:27:52.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:27:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb61d204700 1 Processor -- start 2021-10-20T23:27:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb61d204700 1 -- start start 2021-10-20T23:27:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb61d204700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6180b6580 0x7fb6180b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb61d204700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6180b6960 0x7fb61812ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb61d204700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6181440b0 con 0x7fb6180b43c0 2021-10-20T23:27:52.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb61d204700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb618143b70 con 0x7fb6180b6580 2021-10-20T23:27:52.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb61d204700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb618143e10 con 0x7fb6180b6960 2021-10-20T23:27:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb61659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb6180b43c0 0x7fb618061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42020/0 (socket says 172.21.15.12:42020) 2021-10-20T23:27:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb61659c700 1 -- 172.21.15.12:0/1714918091 learned_addr learned my addr 172.21.15.12:0/1714918091 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.634+0000 7fb616d9d700 1 --2- 172.21.15.12:0/1714918091 >> v2:172.21.15.31:3300/0 conn(0x7fb6180b6580 0x7fb6180b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61759e700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6180b6960 0x7fb61812ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968977696 0 0) 0x7fb6181440b0 con 0x7fb6180b43c0 2021-10-20T23:27:52.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5fc003260 con 0x7fb6180b43c0 2021-10-20T23:27:52.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2707473407 0 0) 0x7fb5fc003260 con 0x7fb6180b43c0 2021-10-20T23:27:52.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6180b6960 msgr2=0x7fb61812ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:52.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6180b6960 0x7fb61812ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 >> v2:172.21.15.31:3300/0 conn(0x7fb6180b6580 msgr2=0x7fb6180b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:52.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 --2- 172.21.15.12:0/1714918091 >> v2:172.21.15.31:3300/0 conn(0x7fb6180b6580 0x7fb6180b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6180615f0 con 0x7fb6180b43c0 2021-10-20T23:27:52.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fb60c001660 con 0x7fb6180b43c0 2021-10-20T23:27:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 >> v1:172.21.15.12:6789/0 conn(0x7fb6180b43c0 legacy=0x7fb618061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc003750 0x7fb5fc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6180b6960 0x7fb5fc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5fc0049f0 0x7fb5fc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb618143b70 con 0x7fb5fc0049f0 2021-10-20T23:27:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb618143e10 con 0x7fb5fc003750 2021-10-20T23:27:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc00b750 con 0x7fb6180b6960 2021-10-20T23:27:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61759e700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5fc0049f0 0x7fb5fc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61659c700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6180b6960 0x7fb5fc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb616d9d700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc003750 0x7fb5fc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61759e700 1 -- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6180b6960 msgr2=0x7fb5fc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61759e700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6180b6960 0x7fb5fc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61759e700 1 -- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc003750 msgr2=0x7fb5fc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61759e700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc003750 0x7fb5fc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61759e700 1 -- 172.21.15.12:0/1714918091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc003260 con 0x7fb5fc0049f0 2021-10-20T23:27:52.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb616d9d700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc003750 0x7fb5fc003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:52.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61759e700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5fc0049f0 0x7fb5fc004e70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7fb61000c000 tx=0x7fb6100091d0).ready entity=mon.0 client_cookie=ac6810331662092 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:52.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61000e7e0 con 0x7fb5fc0049f0 2021-10-20T23:27:52.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000e940 con 0x7fb5fc0049f0 2021-10-20T23:27:52.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb615d9b700 1 -- 172.21.15.12:0/1714918091 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61000eca0 con 0x7fb5fc0049f0 2021-10-20T23:27:52.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61d204700 1 -- 172.21.15.12:0/1714918091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5fc0049f0 msgr2=0x7fb5fc004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61d204700 1 --2- 172.21.15.12:0/1714918091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5fc0049f0 0x7fb5fc004e70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7fb61000c000 tx=0x7fb6100091d0).stop 2021-10-20T23:27:52.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61759e700 1 -- 172.21.15.12:0/1714918091 reap_dead start 2021-10-20T23:27:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61d204700 1 -- 172.21.15.12:0/1714918091 shutdown_connections 2021-10-20T23:27:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61d204700 1 -- 172.21.15.12:0/1714918091 >> 172.21.15.12:0/1714918091 conn(0x7fb61805c490 msgr2=0x7fb61805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61d204700 1 -- 172.21.15.12:0/1714918091 shutdown_connections 2021-10-20T23:27:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.638+0000 7fb61d204700 1 -- 172.21.15.12:0/1714918091 wait complete. 2021-10-20T23:27:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61d204700 1 Processor -- start 2021-10-20T23:27:52.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61d204700 1 -- start start 2021-10-20T23:27:52.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61d204700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc0049f0 0x7fb618146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61d204700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6181523d0 0x7fb61812b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61d204700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb61812c2a0 0x7fb618155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61d204700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61812bc40 con 0x7fb6181523d0 2021-10-20T23:27:52.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61d204700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61812bee0 con 0x7fb5fc0049f0 2021-10-20T23:27:52.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61d204700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb618156430 con 0x7fb61812c2a0 2021-10-20T23:27:52.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6181523d0 0x7fb61812b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6181523d0 0x7fb61812b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43440/0 (socket says 172.21.15.12:43440) 2021-10-20T23:27:52.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61659c700 1 -- 172.21.15.12:0/283667759 learned_addr learned my addr 172.21.15.12:0/283667759 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:52.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61759e700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb61812c2a0 0x7fb618155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb616d9d700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc0049f0 0x7fb618146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61659c700 1 -- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb61812c2a0 msgr2=0x7fb618155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61659c700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb61812c2a0 0x7fb618155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61659c700 1 -- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc0049f0 msgr2=0x7fb618146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:52.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61659c700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc0049f0 0x7fb618146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:52.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61659c700 1 -- 172.21.15.12:0/283667759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6181565f0 con 0x7fb6181523d0 2021-10-20T23:27:52.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61759e700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb61812c2a0 0x7fb618155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61659c700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6181523d0 0x7fb61812b5a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7fb60c00b000 tx=0x7fb618061780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb607fff700 1 -- 172.21.15.12:0/283667759 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60c015630 con 0x7fb6181523d0 2021-10-20T23:27:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb607fff700 1 -- 172.21.15.12:0/283667759 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c010040 con 0x7fb6181523d0 2021-10-20T23:27:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb607fff700 1 -- 172.21.15.12:0/283667759 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60c015980 con 0x7fb6181523d0 2021-10-20T23:27:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.642+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6180b31c0 con 0x7fb6181523d0 2021-10-20T23:27:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.646+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6180b36c0 con 0x7fb6181523d0 2021-10-20T23:27:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.646+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61812c0a0 con 0x7fb6181523d0 2021-10-20T23:27:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.646+0000 7fb607fff700 1 -- 172.21.15.12:0/283667759 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb60c015ae0 con 0x7fb6181523d0 2021-10-20T23:27:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.646+0000 7fb607fff700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5f4053580 0x7fb5f4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.646+0000 7fb607fff700 1 -- 172.21.15.12:0/283667759 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb60c06b2a0 con 0x7fb6181523d0 2021-10-20T23:27:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.646+0000 7fb616d9d700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5f4053580 0x7fb5f4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.650+0000 7fb616d9d700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5f4053580 0x7fb5f4055a40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fb60800b000 tx=0x7fb608008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.654+0000 7fb607fff700 1 -- 172.21.15.12:0/283667759 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb60c042470 con 0x7fb6181523d0 2021-10-20T23:27:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.782+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb618155920 con 0x7fb6181523d0 2021-10-20T23:27:52.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb607fff700 1 -- 172.21.15.12:0/283667759 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v115) v1 ==== 81+0+29229 (secure 0 0 0) 0x7fb60c01a070 con 0x7fb6181523d0 2021-10-20T23:27:52.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:52.795 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:52.795 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 115, 2021-10-20T23:27:52.795 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:27:52.796 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:27:52.796 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:27:49.993079+0000", 2021-10-20T23:27:52.796 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:52.796 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:27:52.796 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:27:52.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:27:52.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:27:52.797 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:27:52.797 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:27:52.798 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:27:52.798 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:27:52.798 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:52.798 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:27:52.799 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:27:52.799 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:27:52.799 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:27:52.799 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:27:52.799 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 20, 2021-10-20T23:27:52.800 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:27:52.800 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:27:52.800 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:27:52.800 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:27:52.801 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:27:52.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.801 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:27:52.801 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:27:52.802 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:27:52.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:52.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:52.803 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:52.803 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:52.803 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:52.803 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:52.804 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:52.804 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:52.804 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:27:52.804 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:27:52.804 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:27:52.805 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:27:52.805 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:27:52.807 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:52.807 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:52.808 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:52.808 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:52.808 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:52.808 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:52.809 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:52.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.809 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:27:52.809 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:52.810 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:52.810 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:52.810 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:52.810 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:52.811 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:52.811 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:52.811 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:52.811 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:52.811 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:52.812 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:52.812 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:52.812 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:52.812 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:52.814 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:52.814 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:52.814 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:52.814 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:52.815 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:52.815 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:52.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:52.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.815 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:52.816 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:52.816 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:52.816 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:52.816 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:52.816 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:52.817 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:52.817 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:52.818 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:52.818 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:52.818 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:52.818 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:27:52.819 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:27:52.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.819 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:52.819 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:27:52.819 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.820 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:27:52.820 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:27:52.821 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:27:52.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:27:52.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:27:52.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:27:52.821 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:27:52.822 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:27:52.822 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:27:52.822 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:27:52.822 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:27:52.823 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:27:52.823 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:27:52.823 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:27:52.823 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:27:52.823 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:27:52.824 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:27:52.824 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:27:52.824 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:27:52.824 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:27:52.826 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:27:52.826 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:27:52.826 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:27:52.826 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:27:52.827 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:27:52.827 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:27:52.827 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:27:52.827 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:27:52.828 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:27:52.828 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:27:52.828 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:27:52.829 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:27:52.829 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:27:52.829 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:27:52.829 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:27:52.830 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:27:52.830 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:27:52.830 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:27:52.830 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:27:52.830 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:27:52.831 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:27:52.831 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:27:52.831 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:27:52.831 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:27:52.832 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:27:52.832 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:27:52.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.832 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:27:52.833 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:27:52.833 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:27:52.833 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:27:52.833 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:27:52.834 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:27:52.834 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:27:52.834 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:27:52.834 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:27:52.835 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:27:52.835 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:27:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:27:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:27:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:27:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:27:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:27:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:27:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:27:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:27:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:27:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:27:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:27:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:27:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:27:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:27:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:27:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:27:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:27:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:27:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:27:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:27:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:27:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:27:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:27:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:27:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:27:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:27:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:27:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:27:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:27:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:27:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:27:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:27:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:27:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 109, 2021-10-20T23:27:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:27:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:27:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:27:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:27:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:27:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:27:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:27:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:27:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:27:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:27:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:27:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:27:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:27:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:27:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:27:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:27:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:27:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:27:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:27:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:27:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:27:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:27:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:27:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:27:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:27:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:27:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:27:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:27:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 109, 2021-10-20T23:27:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:27:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:27:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:27:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:27:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:27:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:27:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:27:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:27:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:27:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:27:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:27:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:27:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:27:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:27:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:52.944 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:52.945 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:52.945 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:52.945 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:52.945 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 109, 2021-10-20T23:27:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.947 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:27:52.947 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:52.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:27:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:52.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.950 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:27:52.950 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:52.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.951 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:27:52.951 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:52.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:27:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:27:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.956 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:27:52.956 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:52.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:27:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:27:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.957 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.958 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:27:52.958 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:27:52.958 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:27:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:27:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:52.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:27:52.960 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:52.961 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:52.961 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:52.961 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:52.961 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:52.962 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:52.962 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:52.962 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:52.962 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:52.962 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.963 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:27:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.964 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:27:52.965 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:52.965 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.965 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.966 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:52.966 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:27:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:27:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.969 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:52.969 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:27:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.971 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:27:52.971 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:52.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.971 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.973 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:27:52.973 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:52.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.974 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:27:52.974 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:27:52.974 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.974 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.975 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:27:52.975 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:27:52.975 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:27:52.975 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:27:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:27:52.977 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:27:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:27:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:27:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:27:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:27:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:27:52.979 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:27:52.979 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 110, 2021-10-20T23:27:52.979 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:27:52.979 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:27:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:27:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.980 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:27:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.981 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:27:52.982 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:52.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.982 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:27:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:27:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.984 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:27:52.985 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:52.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.985 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:27:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.986 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:27:52.987 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:52.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:27:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.989 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:27:52.989 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:27:52.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:27:52.989 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:27:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:27:52.991 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:27:52.991 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:27:52.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.991 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:27:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:27:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:27:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:27:52.992 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:27:52.993 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:27:52.993 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:27:52.993 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:52.993 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:52.994 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:52.994 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:27:52.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.994 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:27:52.994 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:52.995 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:27:52.996 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:52.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.996 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:27:52.997 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:52.997 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:52.997 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:52.997 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:52.997 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:52.998 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:27:52.998 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:52.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:52.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:52.998 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:27:52.999 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:52.999 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:52.999 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:52.999 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:53.000 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:53.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:27:53.000 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:53.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:53.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:53.001 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:27:53.001 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:53.001 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:53.001 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:53.001 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:53.002 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:53.002 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:27:53.002 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:53.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:53.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:53.003 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:27:53.003 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:53.003 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:53.003 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:53.004 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:53.004 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:53.004 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:27:53.004 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:53.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:53.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:53.005 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:27:53.005 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:53.005 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:53.006 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:53.006 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:53.006 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:53.006 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:27:53.006 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:53.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:53.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:53.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:27:53.007 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:53.007 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:53.008 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:53.008 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:53.008 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:53.008 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:27:53.009 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:53.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:53.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:53.009 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:27:53.009 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:27:53.010 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:27:53.010 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:27:53.010 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:27:53.010 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:27:53.010 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:27:53.011 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:27:53.011 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:53.011 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:27:53.011 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:27:53.012 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:27:53.012 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:27:53.012 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:27:53.012 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:27:53.012 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6835/3124306556": "2021-10-21T23:27:46.805714+0000", 2021-10-20T23:27:53.013 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6834/3124306556": "2021-10-21T23:27:46.805714+0000" 2021-10-20T23:27:53.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:53.013 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:27:53.013 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:27:53.013 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:27:53.014 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:53.014 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:27:53.014 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:27:53.014 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:53.015 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:27:53.015 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:53.015 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:53.015 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:27:53.015 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:27:53.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:53.016 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:27:53.016 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:27:53.016 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:27:53.017 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:27:53.017 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:27:53.017 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:27:53.017 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:27:53.017 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:53.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:53.018 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:27:53.018 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:27:53.018 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:27:53.018 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:27:53.019 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:27:53.019 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5f4053580 msgr2=0x7fb5f4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5f4053580 0x7fb5f4055a40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fb60800b000 tx=0x7fb608008040).stop 2021-10-20T23:27:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6181523d0 msgr2=0x7fb61812b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6181523d0 0x7fb61812b5a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7fb60c00b000 tx=0x7fb618061780).stop 2021-10-20T23:27:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 shutdown_connections 2021-10-20T23:27:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5f4053580 0x7fb5f4055a40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb61812c2a0 0x7fb618155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6181523d0 0x7fb61812b5a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 --2- 172.21.15.12:0/283667759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5fc0049f0 0x7fb618146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 >> 172.21.15.12:0/283667759 conn(0x7fb61805c490 msgr2=0x7fb618143160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:53.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 shutdown_connections 2021-10-20T23:27:53.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:52.786+0000 7fb61d204700 1 -- 172.21.15.12:0/283667759 wait complete. 2021-10-20T23:27:53.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:53.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 Processor -- start 2021-10-20T23:27:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 -- start start 2021-10-20T23:27:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f235c13e740 0x7f235c141080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b0ff0 0x7f235c141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c0aaa90 con 0x7f235c0b2720 2021-10-20T23:27:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c140c90 con 0x7f235c13e740 2021-10-20T23:27:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0b2b00 con 0x7f235c0b0ff0 2021-10-20T23:27:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f2360e9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f235c13e740 0x7f235c141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f2361e9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b0ff0 0x7f235c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236169c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f235c0b2720 0x7f235c13e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:49104/0 (socket says 172.21.15.12:49104) 2021-10-20T23:27:53.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236169c700 1 -- 172.21.15.12:0/4017781861 learned_addr learned my addr 172.21.15.12:0/4017781861 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:53.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f2360e9b700 1 -- 172.21.15.12:0/4017781861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b0ff0 msgr2=0x7f235c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f2360e9b700 1 --2- 172.21.15.12:0/4017781861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b0ff0 0x7f235c141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f2360e9b700 1 -- 172.21.15.12:0/4017781861 >> v1:172.21.15.31:6789/0 conn(0x7f235c0b2720 legacy=0x7f235c13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f2360e9b700 1 -- 172.21.15.12:0/4017781861 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c0aa2b0 con 0x7f235c13e740 2021-10-20T23:27:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f2360e9b700 1 --2- 172.21.15.12:0/4017781861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c13e740 0x7f235c141080 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f234c002f70 tx=0x7f234c006df0).ready entity=mon.1 client_cookie=be4224bd57ee67a0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f234bfff700 1 -- 172.21.15.12:0/4017781861 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f234c00d570 con 0x7f235c13e740 2021-10-20T23:27:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f234bfff700 1 -- 172.21.15.12:0/4017781861 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234c000e90 con 0x7f235c13e740 2021-10-20T23:27:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f234bfff700 1 -- 172.21.15.12:0/4017781861 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f234c00d8c0 con 0x7f235c13e740 2021-10-20T23:27:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 -- 172.21.15.12:0/4017781861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c13e740 msgr2=0x7f235c141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 --2- 172.21.15.12:0/4017781861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c13e740 0x7f235c141080 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f234c002f70 tx=0x7f234c006df0).stop 2021-10-20T23:27:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 -- 172.21.15.12:0/4017781861 shutdown_connections 2021-10-20T23:27:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 --2- 172.21.15.12:0/4017781861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b0ff0 0x7f235c141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 --2- 172.21.15.12:0/4017781861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c13e740 0x7f235c141080 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 -- 172.21.15.12:0/4017781861 >> 172.21.15.12:0/4017781861 conn(0x7f235c060180 msgr2=0x7f235c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 -- 172.21.15.12:0/4017781861 shutdown_connections 2021-10-20T23:27:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.126+0000 7f236269e700 1 -- 172.21.15.12:0/4017781861 wait complete. 2021-10-20T23:27:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236269e700 1 Processor -- start 2021-10-20T23:27:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236269e700 1 -- start start 2021-10-20T23:27:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236269e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f235c0b0ff0 0x7f235c143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236269e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c0b2720 0x7f235c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236269e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b4240 0x7f235c153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236269e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0b38f0 con 0x7f235c0b0ff0 2021-10-20T23:27:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236269e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c142910 con 0x7f235c0b2720 2021-10-20T23:27:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236269e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1423d0 con 0x7f235c0b4240 2021-10-20T23:27:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236169c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f235c0b0ff0 0x7f235c143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236169c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f235c0b0ff0 0x7f235c143290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43452/0 (socket says 172.21.15.12:43452) 2021-10-20T23:27:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f2360e9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c0b2720 0x7f235c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236169c700 1 -- 172.21.15.12:0/646452600 learned_addr learned my addr 172.21.15.12:0/646452600 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f2361e9d700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b4240 0x7f235c153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236169c700 1 -- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b4240 msgr2=0x7f235c153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236169c700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b4240 0x7f235c153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236169c700 1 -- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c0b2720 msgr2=0x7f235c0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236169c700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c0b2720 0x7f235c0b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236169c700 1 -- 172.21.15.12:0/646452600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c00b180 con 0x7f235c0b0ff0 2021-10-20T23:27:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f2360e9b700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c0b2720 0x7f235c0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.130+0000 7f236169c700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f235c0b0ff0 0x7f235c143290 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f235c061a80 tx=0x7f2358007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f234a7fc700 1 -- 172.21.15.12:0/646452600 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23580070d0 con 0x7f235c0b0ff0 2021-10-20T23:27:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f234a7fc700 1 -- 172.21.15.12:0/646452600 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358007230 con 0x7f235c0b0ff0 2021-10-20T23:27:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c142670 con 0x7f235c0b0ff0 2021-10-20T23:27:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f234a7fc700 1 -- 172.21.15.12:0/646452600 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2358005610 con 0x7f235c0b0ff0 2021-10-20T23:27:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c142f10 con 0x7f235c0b0ff0 2021-10-20T23:27:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c0b3ab0 con 0x7f235c0b0ff0 2021-10-20T23:27:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f234a7fc700 1 -- 172.21.15.12:0/646452600 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2358010070 con 0x7f235c0b0ff0 2021-10-20T23:27:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f234a7fc700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f233c053520 0x7f233c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f234a7fc700 1 -- 172.21.15.12:0/646452600 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f235806aba0 con 0x7f235c0b0ff0 2021-10-20T23:27:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.134+0000 7f2360e9b700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f233c053520 0x7f233c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.138+0000 7f2360e9b700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f233c053520 0x7f233c0559e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f234c01a000 tx=0x7f234c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:53.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.142+0000 7f234a7fc700 1 -- 172.21.15.12:0/646452600 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f235c0b3ab0 con 0x7f235c0b0ff0 2021-10-20T23:27:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.306+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f235c0b3ab0 con 0x7f235c0b0ff0 2021-10-20T23:27:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.306+0000 7f234a7fc700 1 -- 172.21.15.12:0/646452600 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f235c0b3ab0 con 0x7f235c0b0ff0 2021-10-20T23:27:53.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:53.316 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1540805449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1540805449},{"type":"v1","addr":"172.21.15.31:6835","nonce":1540805449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2826685098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2826685098},{"type":"v1","addr":"172.21.15.12:6833","nonce":2826685098}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7512,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3900856587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3900856587},{"type":"v1","addr":"172.21.15.12:6835","nonce":3900856587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[]} 2021-10-20T23:27:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f233c053520 msgr2=0x7f233c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f233c053520 0x7f233c0559e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f234c01a000 tx=0x7f234c014000).stop 2021-10-20T23:27:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f235c0b0ff0 msgr2=0x7f235c143290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f235c0b0ff0 0x7f235c143290 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f235c061a80 tx=0x7f2358007c40).stop 2021-10-20T23:27:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 shutdown_connections 2021-10-20T23:27:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f233c053520 0x7f233c0559e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f235c0b4240 0x7f235c153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f235c0b2720 0x7f235c0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 --2- 172.21.15.12:0/646452600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f235c0b0ff0 0x7f235c143290 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 >> 172.21.15.12:0/646452600 conn(0x7f235c060180 msgr2=0x7f235c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 shutdown_connections 2021-10-20T23:27:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.310+0000 7f236269e700 1 -- 172.21.15.12:0/646452600 wait complete. 2021-10-20T23:27:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 57 2021-10-20T23:27:53.329 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:53.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.426+0000 7f32334d7700 1 Processor -- start 2021-10-20T23:27:53.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.426+0000 7f32334d7700 1 -- start start 2021-10-20T23:27:53.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32334d7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f322c0a8ac0 0x7f322c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32334d7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322c0a70c0 con 0x7f322c0b0010 2021-10-20T23:27:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32334d7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322c0a72f0 con 0x7f322c0b2580 2021-10-20T23:27:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32334d7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322c0a7590 con 0x7f322c0a8ac0 2021-10-20T23:27:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f3231cd4700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f322c0b0010 0x7f322c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42054/0 (socket says 172.21.15.12:42054) 2021-10-20T23:27:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f3231cd4700 1 -- 172.21.15.12:0/1752260544 learned_addr learned my addr 172.21.15.12:0/1752260544 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f3232cd6700 1 --2- 172.21.15.12:0/1752260544 >> v2:172.21.15.31:3300/0 conn(0x7f322c0a8ac0 0x7f322c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640481038 0 0) 0x7f322c0a70c0 con 0x7f322c0b0010 2021-10-20T23:27:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3214003260 con 0x7f322c0b0010 2021-10-20T23:27:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224468114 0 0) 0x7f3214003260 con 0x7f322c0b0010 2021-10-20T23:27:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 >> v2:172.21.15.31:3300/0 conn(0x7f322c0a8ac0 msgr2=0x7f322c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:53.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 --2- 172.21.15.12:0/1752260544 >> v2:172.21.15.31:3300/0 conn(0x7f322c0a8ac0 0x7f322c152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 >> v1:172.21.15.31:6789/0 conn(0x7f322c0b2580 legacy=0x7f322c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0a7830 con 0x7f322c0b0010 2021-10-20T23:27:53.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f32280019e0 con 0x7f322c0b0010 2021-10-20T23:27:53.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 >> v1:172.21.15.12:6789/0 conn(0x7f322c0b0010 legacy=0x7f322c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3214003750 0x7f3214003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3214004500 0x7f3214004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3214004e70 0x7f321400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0a7590 con 0x7f3214003750 2021-10-20T23:27:53.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321400bc70 con 0x7f3214004500 2021-10-20T23:27:53.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321400be30 con 0x7f3214004e70 2021-10-20T23:27:53.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32324d5700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3214003750 0x7f3214003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f3231cd4700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3214004500 0x7f3214004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32324d5700 1 -- 172.21.15.12:0/1752260544 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3214004e70 msgr2=0x7f321400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:53.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32324d5700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3214004e70 0x7f321400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-10-20T23:27:53.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32324d5700 1 -- 172.21.15.12:0/1752260544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3214004500 msgr2=0x7f3214004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:53.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32324d5700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3214004500 0x7f3214004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32324d5700 1 -- 172.21.15.12:0/1752260544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3214003260 con 0x7f3214003750 2021-10-20T23:27:53.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f3232cd6700 1 -- 172.21.15.12:0/1752260544 reap_dead start 2021-10-20T23:27:53.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32324d5700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3214003750 0x7f3214003b30 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f321c001110 tx=0x7f321c007a00).ready entity=mon.0 client_cookie=5249988ef258a157 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:53.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f321c007d10 con 0x7f3214003750 2021-10-20T23:27:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c007030 con 0x7f3214003750 2021-10-20T23:27:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32314d3700 1 -- 172.21.15.12:0/1752260544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f321c007390 con 0x7f3214003750 2021-10-20T23:27:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32334d7700 1 -- 172.21.15.12:0/1752260544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3214003750 msgr2=0x7f3214003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.430+0000 7f32334d7700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3214003750 0x7f3214003b30 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f321c001110 tx=0x7f321c007a00).stop 2021-10-20T23:27:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 -- 172.21.15.12:0/1752260544 shutdown_connections 2021-10-20T23:27:53.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 --2- 172.21.15.12:0/1752260544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3214003750 0x7f3214003b30 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 -- 172.21.15.12:0/1752260544 >> 172.21.15.12:0/1752260544 conn(0x7f322c060180 msgr2=0x7f322c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:53.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 -- 172.21.15.12:0/1752260544 shutdown_connections 2021-10-20T23:27:53.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 -- 172.21.15.12:0/1752260544 wait complete. 2021-10-20T23:27:53.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 Processor -- start 2021-10-20T23:27:53.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 -- start start 2021-10-20T23:27:53.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3214003750 0x7f322c0ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f322c0aa7e0 0x7f322c159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f322c159d10 0x7f322c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0a7c70 con 0x7f322c159d10 2021-10-20T23:27:53.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0a9140 con 0x7f322c0aa7e0 2021-10-20T23:27:53.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f32334d7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0b5750 con 0x7f3214003750 2021-10-20T23:27:53.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f3232cd6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f322c159d10 0x7f322c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f3232cd6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f322c159d10 0x7f322c14cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43476/0 (socket says 172.21.15.12:43476) 2021-10-20T23:27:53.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.434+0000 7f3232cd6700 1 -- 172.21.15.12:0/4135092342 learned_addr learned my addr 172.21.15.12:0/4135092342 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:53.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f32324d5700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3214003750 0x7f322c0ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f3231cd4700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f322c0aa7e0 0x7f322c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f3232cd6700 1 -- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3214003750 msgr2=0x7f322c0ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f3232cd6700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3214003750 0x7f322c0ab370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f3232cd6700 1 -- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f322c0aa7e0 msgr2=0x7f322c159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f3232cd6700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f322c0aa7e0 0x7f322c159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f3232cd6700 1 -- 172.21.15.12:0/4135092342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c15a1a0 con 0x7f322c159d10 2021-10-20T23:27:53.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f3232cd6700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f322c159d10 0x7f322c14cbd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f3224000e90 tx=0x7f3224006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:53.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f321b7fe700 1 -- 172.21.15.12:0/4135092342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3224013640 con 0x7f322c159d10 2021-10-20T23:27:53.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c0a9370 con 0x7f322c159d10 2021-10-20T23:27:53.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f321b7fe700 1 -- 172.21.15.12:0/4135092342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32240137a0 con 0x7f322c159d10 2021-10-20T23:27:53.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c0a9b40 con 0x7f322c159d10 2021-10-20T23:27:53.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f321b7fe700 1 -- 172.21.15.12:0/4135092342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3224013b00 con 0x7f322c159d10 2021-10-20T23:27:53.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c0a9d00 con 0x7f322c159d10 2021-10-20T23:27:53.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f321b7fe700 1 -- 172.21.15.12:0/4135092342 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f322401a030 con 0x7f322c159d10 2021-10-20T23:27:53.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f321b7fe700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f320c0536d0 0x7f320c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.438+0000 7f321b7fe700 1 -- 172.21.15.12:0/4135092342 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f322406b9c0 con 0x7f322c159d10 2021-10-20T23:27:53.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.442+0000 7f32324d5700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f320c0536d0 0x7f320c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.442+0000 7f32324d5700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f320c0536d0 0x7f320c055b90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f321c019000 tx=0x7f321c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:53.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.446+0000 7f321b7fe700 1 -- 172.21.15.12:0/4135092342 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3224042ca0 con 0x7f322c159d10 2021-10-20T23:27:53.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.606+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f322c15a1a0 con 0x7f322c159d10 2021-10-20T23:27:53.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.606+0000 7f321b7fe700 1 -- 172.21.15.12:0/4135092342 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f322c15a1a0 con 0x7f322c159d10 2021-10-20T23:27:53.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:53.621 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1540805449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1540805449},{"type":"v1","addr":"172.21.15.31:6835","nonce":1540805449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2826685098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2826685098},{"type":"v1","addr":"172.21.15.12:6833","nonce":2826685098}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7512,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3900856587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3900856587},{"type":"v1","addr":"172.21.15.12:6835","nonce":3900856587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[]} 2021-10-20T23:27:53.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f320c0536d0 msgr2=0x7f320c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f320c0536d0 0x7f320c055b90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f321c019000 tx=0x7f321c015000).stop 2021-10-20T23:27:53.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f322c159d10 msgr2=0x7f322c14cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f322c159d10 0x7f322c14cbd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f3224000e90 tx=0x7f3224006df0).stop 2021-10-20T23:27:53.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 shutdown_connections 2021-10-20T23:27:53.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f320c0536d0 0x7f320c055b90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f322c159d10 0x7f322c14cbd0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f322c0aa7e0 0x7f322c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 --2- 172.21.15.12:0/4135092342 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3214003750 0x7f322c0ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 >> 172.21.15.12:0/4135092342 conn(0x7f322c060180 msgr2=0x7f322c067250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:53.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 shutdown_connections 2021-10-20T23:27:53.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.610+0000 7f32334d7700 1 -- 172.21.15.12:0/4135092342 wait complete. 2021-10-20T23:27:53.626 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 57 2021-10-20T23:27:53.628 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:27:53.629 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:27:53.629 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:27:53.629 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:27:53.630 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:27:53.630 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:27:53.631 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:27:53.631 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:27:53.631 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:27:53.631 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:27:53.632 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:27:53.632 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:27:53.641 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:27:53.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:27:53.644 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:27:53.645 DEBUG:teuthology.parallel:result is None 2021-10-20T23:27:53.645 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:27:53.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:27:53.649 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:27:53.649 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:27:53.651 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:27:53.652 DEBUG:teuthology.parallel:result is None 2021-10-20T23:27:53.690 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:27:53.691 DEBUG:teuthology.parallel:result is None 2021-10-20T23:27:53.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:27:53.719 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:27:53.726 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:27:53.755 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:27:53.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.774+0000 7f973be95700 1 Processor -- start 2021-10-20T23:27:53.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.774+0000 7f973be95700 1 -- start start 2021-10-20T23:27:53.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f97340ad1b0 0x7f97341438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f97340affd0 0x7f9734143da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97340673d0 con 0x7f9734066ff0 2021-10-20T23:27:53.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97340b1650 con 0x7f97340ad1b0 2021-10-20T23:27:53.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97340b18f0 con 0x7f97340affd0 2021-10-20T23:27:53.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9739c31700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9734066ff0 0x7f97340ae520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42098/0 (socket says 172.21.15.12:42098) 2021-10-20T23:27:53.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9739c31700 1 -- 172.21.15.12:0/1841577556 learned_addr learned my addr 172.21.15.12:0/1841577556 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:53.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9739430700 1 --2- 172.21.15.12:0/1841577556 >> v2:172.21.15.12:3300/0 conn(0x7f97340ad1b0 0x7f97341438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973a432700 1 --2- 172.21.15.12:0/1841577556 >> v2:172.21.15.31:3300/0 conn(0x7f97340affd0 0x7f9734143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9738c2f700 1 -- 172.21.15.12:0/1841577556 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674843338 0 0) 0x7f97340673d0 con 0x7f9734066ff0 2021-10-20T23:27:53.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9738c2f700 1 -- 172.21.15.12:0/1841577556 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f971c003260 con 0x7f9734066ff0 2021-10-20T23:27:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9739430700 1 -- 172.21.15.12:0/1841577556 >> v2:172.21.15.31:3300/0 conn(0x7f97340affd0 msgr2=0x7f9734143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9739430700 1 --2- 172.21.15.12:0/1841577556 >> v2:172.21.15.31:3300/0 conn(0x7f97340affd0 0x7f9734143da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9739430700 1 -- 172.21.15.12:0/1841577556 >> v1:172.21.15.12:6789/0 conn(0x7f9734066ff0 legacy=0x7f97340ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9739430700 1 -- 172.21.15.12:0/1841577556 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97340b1b90 con 0x7f97340ad1b0 2021-10-20T23:27:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973a432700 1 --2- 172.21.15.12:0/1841577556 >> v2:172.21.15.31:3300/0 conn(0x7f97340affd0 0x7f9734143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9739430700 1 --2- 172.21.15.12:0/1841577556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340ad1b0 0x7f97341438b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f9724002f70 tx=0x7f9724006df0).ready entity=mon.0 client_cookie=d8c51fa58830452e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9738c2f700 1 -- 172.21.15.12:0/1841577556 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f972400d4f0 con 0x7f97340ad1b0 2021-10-20T23:27:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9738c2f700 1 -- 172.21.15.12:0/1841577556 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724000e90 con 0x7f97340ad1b0 2021-10-20T23:27:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f9738c2f700 1 -- 172.21.15.12:0/1841577556 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f972400d840 con 0x7f97340ad1b0 2021-10-20T23:27:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 -- 172.21.15.12:0/1841577556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340ad1b0 msgr2=0x7f97341438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 --2- 172.21.15.12:0/1841577556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340ad1b0 0x7f97341438b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f9724002f70 tx=0x7f9724006df0).stop 2021-10-20T23:27:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 -- 172.21.15.12:0/1841577556 shutdown_connections 2021-10-20T23:27:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 --2- 172.21.15.12:0/1841577556 >> v2:172.21.15.31:3300/0 conn(0x7f97340affd0 0x7f9734143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 --2- 172.21.15.12:0/1841577556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340ad1b0 0x7f97341438b0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 -- 172.21.15.12:0/1841577556 >> 172.21.15.12:0/1841577556 conn(0x7f97340608d0 msgr2=0x7f9734060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 -- 172.21.15.12:0/1841577556 shutdown_connections 2021-10-20T23:27:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.778+0000 7f973be95700 1 -- 172.21.15.12:0/1841577556 wait complete. 2021-10-20T23:27:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 Processor -- start 2021-10-20T23:27:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 -- start start 2021-10-20T23:27:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9734066ff0 0x7f9734146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97340ad1b0 0x7f9734155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340affd0 0x7f97340a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97341560f0 con 0x7f97340affd0 2021-10-20T23:27:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9734153250 con 0x7f97340ad1b0 2021-10-20T23:27:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97341534f0 con 0x7f9734066ff0 2021-10-20T23:27:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973a432700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340affd0 0x7f97340a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973a432700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340affd0 0x7f97340a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43514/0 (socket says 172.21.15.12:43514) 2021-10-20T23:27:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973a432700 1 -- 172.21.15.12:0/1423141688 learned_addr learned my addr 172.21.15.12:0/1423141688 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f9739430700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97340ad1b0 0x7f9734155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f9739c31700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9734066ff0 0x7f9734146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973a432700 1 -- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9734066ff0 msgr2=0x7f9734146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973a432700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9734066ff0 0x7f9734146ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973a432700 1 -- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97340ad1b0 msgr2=0x7f9734155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973a432700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97340ad1b0 0x7f9734155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973a432700 1 -- 172.21.15.12:0/1423141688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c009470 con 0x7f97340affd0 2021-10-20T23:27:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f9739c31700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9734066ff0 0x7f9734146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:53.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973a432700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340affd0 0x7f97340a15e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f972c00c000 tx=0x7f972c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:53.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f9722ffd700 1 -- 172.21.15.12:0/1423141688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f972c00c850 con 0x7f97340affd0 2021-10-20T23:27:53.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f9722ffd700 1 -- 172.21.15.12:0/1423141688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c00c9b0 con 0x7f97340affd0 2021-10-20T23:27:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972400b180 con 0x7f97340affd0 2021-10-20T23:27:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f9722ffd700 1 -- 172.21.15.12:0/1423141688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f972c00cd10 con 0x7f97340affd0 2021-10-20T23:27:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.782+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97340a1ad0 con 0x7f97340affd0 2021-10-20T23:27:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.786+0000 7f9722ffd700 1 -- 172.21.15.12:0/1423141688 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f972c022070 con 0x7f97340affd0 2021-10-20T23:27:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.786+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9734153080 con 0x7f97340affd0 2021-10-20T23:27:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.786+0000 7f9722ffd700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f97140536d0 0x7f9714055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:53.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.786+0000 7f9722ffd700 1 -- 172.21.15.12:0/1423141688 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f972c06c090 con 0x7f97340affd0 2021-10-20T23:27:53.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.786+0000 7f9739c31700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f97140536d0 0x7f9714055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:53.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.786+0000 7f9739c31700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f97140536d0 0x7f9714055b90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f973000b000 tx=0x7f9730009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:53.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.790+0000 7f9722ffd700 1 -- 172.21.15.12:0/1423141688 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f972c0432f0 con 0x7f97340affd0 2021-10-20T23:27:53.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:53.926+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f97340aca70 con 0x7f97340affd0 2021-10-20T23:27:54.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.766+0000 7f9722ffd700 1 -- 172.21.15.12:0/1423141688 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v117) v1 ==== 97+0+0 (secure 0 0 0) 0x7f972c016070 con 0x7f97340affd0 2021-10-20T23:27:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f97140536d0 msgr2=0x7f9714055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f97140536d0 0x7f9714055b90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f973000b000 tx=0x7f9730009040).stop 2021-10-20T23:27:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340affd0 msgr2=0x7f97340a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340affd0 0x7f97340a15e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f972c00c000 tx=0x7f972c0091d0).stop 2021-10-20T23:27:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 shutdown_connections 2021-10-20T23:27:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f97140536d0 0x7f9714055b90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97340affd0 0x7f97340a15e0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97340ad1b0 0x7f9734155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 --2- 172.21.15.12:0/1423141688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9734066ff0 0x7f9734146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 >> 172.21.15.12:0/1423141688 conn(0x7f97340608d0 msgr2=0x7f9734144b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 shutdown_connections 2021-10-20T23:27:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.770+0000 7f973be95700 1 -- 172.21.15.12:0/1423141688 wait complete. 2021-10-20T23:27:54.781 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:27:54.794 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:27:54.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:27:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feba0d77700 1 Processor -- start 2021-10-20T23:27:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feba0d77700 1 -- start start 2021-10-20T23:27:54.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feba0d77700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb9c0b30d0 0x7feb9c143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:54.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feba0d77700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c143920 con 0x7feb9c0b0710 2021-10-20T23:27:54.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feba0d77700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0b0af0 con 0x7feb9c0ace70 2021-10-20T23:27:54.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feba0d77700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c0ae680 con 0x7feb9c0b30d0 2021-10-20T23:27:54.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feb9affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb9c0b30d0 0x7feb9c143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:54.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feb9b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feb9c0b0710 0x7feb9c142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42114/0 (socket says 172.21.15.12:42114) 2021-10-20T23:27:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feb9b7fe700 1 -- 172.21.15.12:0/3196783162 learned_addr learned my addr 172.21.15.12:0/3196783162 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feb9affd700 1 -- 172.21.15.12:0/3196783162 >> v1:172.21.15.31:6789/0 conn(0x7feb9c0ace70 legacy=0x7feb9c13f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feb9a7fc700 1 -- 172.21.15.12:0/3196783162 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039965632 0 0) 0x7feb9c0b0af0 con 0x7feb9c0ace70 2021-10-20T23:27:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feb9affd700 1 -- 172.21.15.12:0/3196783162 >> v1:172.21.15.12:6789/0 conn(0x7feb9c0b0710 legacy=0x7feb9c142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feb9affd700 1 -- 172.21.15.12:0/3196783162 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0ae920 con 0x7feb9c0b30d0 2021-10-20T23:27:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.898+0000 7feb9affd700 1 --2- 172.21.15.12:0/3196783162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0b30d0 0x7feb9c143430 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7feb84002f70 tx=0x7feb84006e80).ready entity=mon.0 client_cookie=aa888516a793b81e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feb9a7fc700 1 -- 172.21.15.12:0/3196783162 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb8400ba40 con 0x7feb9c0b30d0 2021-10-20T23:27:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feb9a7fc700 1 -- 172.21.15.12:0/3196783162 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb84000e90 con 0x7feb9c0b30d0 2021-10-20T23:27:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feb9a7fc700 1 -- 172.21.15.12:0/3196783162 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb8400bd90 con 0x7feb9c0b30d0 2021-10-20T23:27:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feba0d77700 1 -- 172.21.15.12:0/3196783162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0b30d0 msgr2=0x7feb9c143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feba0d77700 1 --2- 172.21.15.12:0/3196783162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0b30d0 0x7feb9c143430 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7feb84002f70 tx=0x7feb84006e80).stop 2021-10-20T23:27:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feba0d77700 1 -- 172.21.15.12:0/3196783162 shutdown_connections 2021-10-20T23:27:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feba0d77700 1 --2- 172.21.15.12:0/3196783162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0b30d0 0x7feb9c143430 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feba0d77700 1 -- 172.21.15.12:0/3196783162 >> 172.21.15.12:0/3196783162 conn(0x7feb9c061140 msgr2=0x7feb9c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feba0d77700 1 -- 172.21.15.12:0/3196783162 shutdown_connections 2021-10-20T23:27:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.902+0000 7feba0d77700 1 -- 172.21.15.12:0/3196783162 wait complete. 2021-10-20T23:27:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 Processor -- start 2021-10-20T23:27:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 -- start start 2021-10-20T23:27:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0ace70 0x7feb9c1410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9c0b0710 0x7feb9c152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb9c0b30d0 0x7feb9c0a2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c063a00 con 0x7feb9c0ace70 2021-10-20T23:27:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c156490 con 0x7feb9c0b30d0 2021-10-20T23:27:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c156730 con 0x7feb9c0b0710 2021-10-20T23:27:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0ace70 0x7feb9c1410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0ace70 0x7feb9c1410f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43524/0 (socket says 172.21.15.12:43524) 2021-10-20T23:27:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9b7fe700 1 -- 172.21.15.12:0/644681518 learned_addr learned my addr 172.21.15.12:0/644681518 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9bfff700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb9c0b30d0 0x7feb9c0a2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9affd700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9c0b0710 0x7feb9c152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9b7fe700 1 -- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9c0b0710 msgr2=0x7feb9c152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9b7fe700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9c0b0710 0x7feb9c152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9b7fe700 1 -- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb9c0b30d0 msgr2=0x7feb9c0a2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9b7fe700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb9c0b30d0 0x7feb9c0a2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9b7fe700 1 -- 172.21.15.12:0/644681518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8400d410 con 0x7feb9c0ace70 2021-10-20T23:27:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9affd700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9c0b0710 0x7feb9c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb9b7fe700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0ace70 0x7feb9c1410f0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7feb9c0b6a40 tx=0x7feb8c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb98ff9700 1 -- 172.21.15.12:0/644681518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb8c0070d0 con 0x7feb9c0ace70 2021-10-20T23:27:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb98ff9700 1 -- 172.21.15.12:0/644681518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c007230 con 0x7feb9c0ace70 2021-10-20T23:27:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feb98ff9700 1 -- 172.21.15.12:0/644681518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb8c005610 con 0x7feb9c0ace70 2021-10-20T23:27:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c063c30 con 0x7feb9c0ace70 2021-10-20T23:27:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.906+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c064320 con 0x7feb9c0ace70 2021-10-20T23:27:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.910+0000 7feb98ff9700 1 -- 172.21.15.12:0/644681518 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feb8c010070 con 0x7feb9c0ace70 2021-10-20T23:27:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.910+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c063dc0 con 0x7feb9c0ace70 2021-10-20T23:27:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.910+0000 7feb98ff9700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb800536a0 0x7feb80055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.910+0000 7feb98ff9700 1 -- 172.21.15.12:0/644681518 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5600+0+0 (secure 0 0 0) 0x7feb8c06ac90 con 0x7feb9c0ace70 2021-10-20T23:27:54.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.910+0000 7feb9affd700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb800536a0 0x7feb80055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:54.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.910+0000 7feb9affd700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb800536a0 0x7feb80055b60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7feb84018000 tx=0x7feb9c0ae5a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:54.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:54.914+0000 7feb98ff9700 1 -- 172.21.15.12:0/644681518 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feb8c041fd0 con 0x7feb9c0ace70 2021-10-20T23:27:55.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.082+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feb9c057350 con 0x7feb9c0ace70 2021-10-20T23:27:55.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feb98ff9700 1 -- 172.21.15.12:0/644681518 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) v1 ==== 80+0+4255 (secure 0 0 0) 0x7feb8c018030 con 0x7feb9c0ace70 2021-10-20T23:27:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:55.094 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:27:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:27:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:27:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:27:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:27:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:27:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:27:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:27:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:27:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:27:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:27:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:27:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:27:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:27:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:27:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:27:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:27:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:27:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:27:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:27:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:27:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:27:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:27:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:27:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:27:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:27:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:27:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:27:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:27:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:27:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:27:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:27:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:27:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:27:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:27:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:27:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:27:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:27:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:27:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:27:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:27:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:27:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:27:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:27:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:27:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:27:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:27:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:27:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:27:55.130 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:27:55.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb800536a0 msgr2=0x7feb80055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb800536a0 0x7feb80055b60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7feb84018000 tx=0x7feb9c0ae5a0).stop 2021-10-20T23:27:55.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0ace70 msgr2=0x7feb9c1410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0ace70 0x7feb9c1410f0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7feb9c0b6a40 tx=0x7feb8c007c00).stop 2021-10-20T23:27:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 shutdown_connections 2021-10-20T23:27:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feb800536a0 0x7feb80055b60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb9c0b30d0 0x7feb9c0a2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9c0b0710 0x7feb9c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 --2- 172.21.15.12:0/644681518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb9c0ace70 0x7feb9c1410f0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 >> 172.21.15.12:0/644681518 conn(0x7feb9c061140 msgr2=0x7feb9c142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:55.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 shutdown_connections 2021-10-20T23:27:55.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.086+0000 7feba0d77700 1 -- 172.21.15.12:0/644681518 wait complete. 2021-10-20T23:27:55.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.230+0000 7f929bfff700 1 Processor -- start 2021-10-20T23:27:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.230+0000 7f929bfff700 1 -- start start 2021-10-20T23:27:55.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f929c061700 0x7f929c146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0aecf0 con 0x7f929c0ad5c0 2021-10-20T23:27:55.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0b6f20 con 0x7f929c061320 2021-10-20T23:27:55.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c0aef20 con 0x7f929c061700 2021-10-20T23:27:55.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f929c061700 0x7f929c146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f929c061700 0x7f929c146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43536/0 (socket says 172.21.15.12:43536) 2021-10-20T23:27:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929a7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f929c0ad5c0 0x7f929c140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42128/0 (socket says 172.21.15.12:42128) 2021-10-20T23:27:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929b7fe700 1 -- 172.21.15.12:0/2688605075 learned_addr learned my addr 172.21.15.12:0/2688605075 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929b7fe700 1 -- 172.21.15.12:0/2688605075 >> v1:172.21.15.31:6789/0 conn(0x7f929c061320 legacy=0x7f929c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929b7fe700 1 -- 172.21.15.12:0/2688605075 >> v1:172.21.15.12:6789/0 conn(0x7f929c0ad5c0 legacy=0x7f929c140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929b7fe700 1 -- 172.21.15.12:0/2688605075 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0af1c0 con 0x7f929c061700 2021-10-20T23:27:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929b7fe700 1 --2- 172.21.15.12:0/2688605075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 0x7f929c146520 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f92940032f0 tx=0x7f9294009290).ready entity=mon.0 client_cookie=8a85fe729bf384e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f9299ffb700 1 -- 172.21.15.12:0/2688605075 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f929400b8a0 con 0x7f929c061700 2021-10-20T23:27:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f9299ffb700 1 -- 172.21.15.12:0/2688605075 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929400ba00 con 0x7f929c061700 2021-10-20T23:27:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f9299ffb700 1 -- 172.21.15.12:0/2688605075 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f929400bb70 con 0x7f929c061700 2021-10-20T23:27:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 -- 172.21.15.12:0/2688605075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 msgr2=0x7f929c146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 --2- 172.21.15.12:0/2688605075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 0x7f929c146520 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f92940032f0 tx=0x7f9294009290).stop 2021-10-20T23:27:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 -- 172.21.15.12:0/2688605075 shutdown_connections 2021-10-20T23:27:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 --2- 172.21.15.12:0/2688605075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 0x7f929c146520 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 -- 172.21.15.12:0/2688605075 >> 172.21.15.12:0/2688605075 conn(0x7f929c066de0 msgr2=0x7f929c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 -- 172.21.15.12:0/2688605075 shutdown_connections 2021-10-20T23:27:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.234+0000 7f929bfff700 1 -- 172.21.15.12:0/2688605075 wait complete. 2021-10-20T23:27:55.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.238+0000 7f929bfff700 1 Processor -- start 2021-10-20T23:27:55.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.238+0000 7f929bfff700 1 -- start start 2021-10-20T23:27:55.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.238+0000 7f929bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c061320 0x7f929c144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.238+0000 7f929bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 0x7f929c141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.238+0000 7f929bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0ad5c0 0x7f929c146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.238+0000 7f929bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0b3dc0 con 0x7f929c061700 2021-10-20T23:27:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.238+0000 7f929bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0b33e0 con 0x7f929c061320 2021-10-20T23:27:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.238+0000 7f929bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0b3680 con 0x7f929c0ad5c0 2021-10-20T23:27:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 0x7f929c141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 0x7f929c141a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43540/0 (socket says 172.21.15.12:43540) 2021-10-20T23:27:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0ad5c0 0x7f929c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929a7fc700 1 -- 172.21.15.12:0/3471400110 learned_addr learned my addr 172.21.15.12:0/3471400110 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929affd700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c061320 0x7f929c144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929a7fc700 1 -- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0ad5c0 msgr2=0x7f929c146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929a7fc700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0ad5c0 0x7f929c146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929a7fc700 1 -- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c061320 msgr2=0x7f929c144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929a7fc700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c061320 0x7f929c144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929a7fc700 1 -- 172.21.15.12:0/3471400110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294009530 con 0x7f929c061700 2021-10-20T23:27:55.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929a7fc700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 0x7f929c141a70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f929c0ae120 tx=0x7f9284007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:55.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f9293fff700 1 -- 172.21.15.12:0/3471400110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9284001d70 con 0x7f929c061700 2021-10-20T23:27:55.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f9293fff700 1 -- 172.21.15.12:0/3471400110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92840070d0 con 0x7f929c061700 2021-10-20T23:27:55.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c0b3920 con 0x7f929c061700 2021-10-20T23:27:55.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f9293fff700 1 -- 172.21.15.12:0/3471400110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9284007430 con 0x7f929c061700 2021-10-20T23:27:55.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c1455b0 con 0x7f929c061700 2021-10-20T23:27:55.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.242+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c0b3ab0 con 0x7f929c061700 2021-10-20T23:27:55.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.246+0000 7f9293fff700 1 -- 172.21.15.12:0/3471400110 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9284010070 con 0x7f929c061700 2021-10-20T23:27:55.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.246+0000 7f9293fff700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.246+0000 7f9293fff700 1 -- 172.21.15.12:0/3471400110 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f928406ab00 con 0x7f929c061700 2021-10-20T23:27:55.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.246+0000 7f929affd700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.246+0000 7f929affd700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f928c00d000 tx=0x7f928c007b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:55.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.250+0000 7f9293fff700 1 -- 172.21.15.12:0/3471400110 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9284041e40 con 0x7f929c061700 2021-10-20T23:27:55.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.378+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f929c0af460 con 0x7f929c061700 2021-10-20T23:27:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f9293fff700 1 -- 172.21.15.12:0/3471400110 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f9284045460 con 0x7f929c061700 2021-10-20T23:27:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:55.391 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":117,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:54.758411+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 msgr2=0x7f9280055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f928c00d000 tx=0x7f928c007b50).stop 2021-10-20T23:27:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 msgr2=0x7f929c141a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 0x7f929c141a70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f929c0ae120 tx=0x7f9284007c30).stop 2021-10-20T23:27:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 shutdown_connections 2021-10-20T23:27:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9280053610 0x7f9280055ad0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f929c0ad5c0 0x7f929c146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f929c061700 0x7f929c141a70 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 --2- 172.21.15.12:0/3471400110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f929c061320 0x7f929c144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 >> 172.21.15.12:0/3471400110 conn(0x7f929c066de0 msgr2=0x7f929c13fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 shutdown_connections 2021-10-20T23:27:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.382+0000 7f929bfff700 1 -- 172.21.15.12:0/3471400110 wait complete. 2021-10-20T23:27:55.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:27:55.404 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:27:55.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271f56e700 1 Processor -- start 2021-10-20T23:27:55.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271f56e700 1 -- start start 2021-10-20T23:27:55.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271f56e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718142e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271f56e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f27180ac6f0 0x7f2718143360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271f56e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2718067880 con 0x7f27180b2580 2021-10-20T23:27:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271f56e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180ad5b0 con 0x7f27180ac6f0 2021-10-20T23:27:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271f56e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2718067b20 con 0x7f27180b00e0 2021-10-20T23:27:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271ed6d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f27180ac6f0 0x7f2718143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271ed6d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f27180ac6f0 0x7f2718143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43550/0 (socket says 172.21.15.12:43550) 2021-10-20T23:27:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271ed6d700 1 -- 172.21.15.12:0/13026348 learned_addr learned my addr 172.21.15.12:0/13026348 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271dd6b700 1 --2- 172.21.15.12:0/13026348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.502+0000 7f271e56c700 1 --1- 172.21.15.12:0/13026348 >> v1:172.21.15.31:6789/0 conn(0x7f27180b2580 0x7f2718140050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:49204/0 (socket says 172.21.15.12:49204) 2021-10-20T23:27:55.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271dd6b700 1 -- 172.21.15.12:0/13026348 >> v2:172.21.15.12:3300/0 conn(0x7f27180ac6f0 msgr2=0x7f2718143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:55.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271dd6b700 1 --2- 172.21.15.12:0/13026348 >> v2:172.21.15.12:3300/0 conn(0x7f27180ac6f0 0x7f2718143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271dd6b700 1 -- 172.21.15.12:0/13026348 >> v1:172.21.15.31:6789/0 conn(0x7f27180b2580 legacy=0x7f2718140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271dd6b700 1 -- 172.21.15.12:0/13026348 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718146fd0 con 0x7f27180b00e0 2021-10-20T23:27:55.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271dd6b700 1 --2- 172.21.15.12:0/13026348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718142e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f2714002f70 tx=0x7f2714006df0).ready entity=mon.2 client_cookie=db925a905ca990fc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:55.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271d56a700 1 -- 172.21.15.12:0/13026348 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f271400d570 con 0x7f27180b00e0 2021-10-20T23:27:55.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271d56a700 1 -- 172.21.15.12:0/13026348 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2714000e90 con 0x7f27180b00e0 2021-10-20T23:27:55.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271d56a700 1 -- 172.21.15.12:0/13026348 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f271400d8c0 con 0x7f27180b00e0 2021-10-20T23:27:55.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 -- 172.21.15.12:0/13026348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 msgr2=0x7f2718142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 --2- 172.21.15.12:0/13026348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718142e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f2714002f70 tx=0x7f2714006df0).stop 2021-10-20T23:27:55.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 -- 172.21.15.12:0/13026348 shutdown_connections 2021-10-20T23:27:55.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 --2- 172.21.15.12:0/13026348 >> v2:172.21.15.12:3300/0 conn(0x7f27180ac6f0 0x7f2718143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 --2- 172.21.15.12:0/13026348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718142e70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 -- 172.21.15.12:0/13026348 >> 172.21.15.12:0/13026348 conn(0x7f2718060180 msgr2=0x7f27180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 -- 172.21.15.12:0/13026348 shutdown_connections 2021-10-20T23:27:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 -- 172.21.15.12:0/13026348 wait complete. 2021-10-20T23:27:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 Processor -- start 2021-10-20T23:27:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.506+0000 7f271f56e700 1 -- start start 2021-10-20T23:27:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271f56e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180ac6f0 0x7f271809ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271f56e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271f56e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27180b2580 0x7f2718141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271f56e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180ab460 con 0x7f27180ac6f0 2021-10-20T23:27:55.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271f56e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180ab6c0 con 0x7f27180b2580 2021-10-20T23:27:55.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271f56e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180ab960 con 0x7f27180b00e0 2021-10-20T23:27:55.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271e56c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180ac6f0 0x7f271809ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271e56c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180ac6f0 0x7f271809ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43552/0 (socket says 172.21.15.12:43552) 2021-10-20T23:27:55.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271e56c700 1 -- 172.21.15.12:0/2837924143 learned_addr learned my addr 172.21.15.12:0/2837924143 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:55.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271dd6b700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271ed6d700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27180b2580 0x7f2718141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271e56c700 1 -- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 msgr2=0x7f2718152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271e56c700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271e56c700 1 -- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27180b2580 msgr2=0x7f2718141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271e56c700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27180b2580 0x7f2718141d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271e56c700 1 -- 172.21.15.12:0/2837924143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271400b180 con 0x7f27180ac6f0 2021-10-20T23:27:55.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271dd6b700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:55.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271ed6d700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27180b2580 0x7f2718141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:55.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271e56c700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180ac6f0 0x7f271809ebf0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f2718061a80 tx=0x7f2708007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:55.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f27077fe700 1 -- 172.21.15.12:0/2837924143 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27080070d0 con 0x7f27180ac6f0 2021-10-20T23:27:55.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f27077fe700 1 -- 172.21.15.12:0/2837924143 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2708007230 con 0x7f27180ac6f0 2021-10-20T23:27:55.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27180abc00 con 0x7f27180ac6f0 2021-10-20T23:27:55.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f27077fe700 1 -- 172.21.15.12:0/2837924143 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2708005550 con 0x7f27180ac6f0 2021-10-20T23:27:55.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.510+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27180aad50 con 0x7f27180ac6f0 2021-10-20T23:27:55.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.514+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2718057350 con 0x7f27180ac6f0 2021-10-20T23:27:55.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.514+0000 7f27077fe700 1 -- 172.21.15.12:0/2837924143 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2708010070 con 0x7f27180ac6f0 2021-10-20T23:27:55.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.514+0000 7f27077fe700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26f80536d0 0x7f26f8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.514+0000 7f27077fe700 1 -- 172.21.15.12:0/2837924143 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f270806ae20 con 0x7f27180ac6f0 2021-10-20T23:27:55.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.514+0000 7f271dd6b700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26f80536d0 0x7f26f8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.514+0000 7f271dd6b700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26f80536d0 0x7f26f8055b90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f271401a000 tx=0x7f2714014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:55.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.522+0000 7f27077fe700 1 -- 172.21.15.12:0/2837924143 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2708041fd0 con 0x7f27180ac6f0 2021-10-20T23:27:55.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.646+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f27180a9140 con 0x7f27180ac6f0 2021-10-20T23:27:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f27077fe700 1 -- 172.21.15.12:0/2837924143 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v117) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2708018070 con 0x7f27180ac6f0 2021-10-20T23:27:55.658 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:27:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26f80536d0 msgr2=0x7f26f8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26f80536d0 0x7f26f8055b90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f271401a000 tx=0x7f2714014000).stop 2021-10-20T23:27:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180ac6f0 msgr2=0x7f271809ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180ac6f0 0x7f271809ebf0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f2718061a80 tx=0x7f2708007c40).stop 2021-10-20T23:27:55.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 shutdown_connections 2021-10-20T23:27:55.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f26f80536d0 0x7f26f8055b90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27180b2580 0x7f2718141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27180b00e0 0x7f2718152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 --2- 172.21.15.12:0/2837924143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180ac6f0 0x7f271809ebf0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 >> 172.21.15.12:0/2837924143 conn(0x7f2718060180 msgr2=0x7f27180add60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:55.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 shutdown_connections 2021-10-20T23:27:55.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.650+0000 7f271f56e700 1 -- 172.21.15.12:0/2837924143 wait complete. 2021-10-20T23:27:55.677 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:27:55.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d94e700 1 Processor -- start 2021-10-20T23:27:55.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d94e700 1 -- start start 2021-10-20T23:27:55.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d94e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde0805c7d0 0x7fde080b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d94e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0813f390 0x7fde080aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d94e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0805cbb0 con 0x7fde0805d0b0 2021-10-20T23:27:55.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d94e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde080ad540 con 0x7fde0805c7d0 2021-10-20T23:27:55.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d94e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde08067d70 con 0x7fde0813f390 2021-10-20T23:27:55.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d14d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0813f390 0x7fde080aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0c94c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde0805c7d0 0x7fde080b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d14d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0813f390 0x7fde080aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:49320/0 (socket says 172.21.15.12:49320) 2021-10-20T23:27:55.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d14d700 1 -- 172.21.15.12:0/2493345403 learned_addr learned my addr 172.21.15.12:0/2493345403 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:55.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d14d700 1 -- 172.21.15.12:0/2493345403 >> v2:172.21.15.31:3300/0 conn(0x7fde0805c7d0 msgr2=0x7fde080b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:55.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d14d700 1 --2- 172.21.15.12:0/2493345403 >> v2:172.21.15.31:3300/0 conn(0x7fde0805c7d0 0x7fde080b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d14d700 1 -- 172.21.15.12:0/2493345403 >> v1:172.21.15.31:6789/0 conn(0x7fde0805d0b0 legacy=0x7fde080ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d14d700 1 -- 172.21.15.12:0/2493345403 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080b1790 con 0x7fde0813f390 2021-10-20T23:27:55.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.782+0000 7fde0d14d700 1 --2- 172.21.15.12:0/2493345403 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0813f390 0x7fde080aece0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fde000032f0 tx=0x7fde00009290).ready entity=mon.2 client_cookie=258fc3b4ecb4db26 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde077fe700 1 -- 172.21.15.12:0/2493345403 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde0000b8a0 con 0x7fde0813f390 2021-10-20T23:27:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde077fe700 1 -- 172.21.15.12:0/2493345403 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0000ba00 con 0x7fde0813f390 2021-10-20T23:27:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde077fe700 1 -- 172.21.15.12:0/2493345403 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde0000bb70 con 0x7fde0813f390 2021-10-20T23:27:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 -- 172.21.15.12:0/2493345403 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0813f390 msgr2=0x7fde080aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 --2- 172.21.15.12:0/2493345403 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0813f390 0x7fde080aece0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fde000032f0 tx=0x7fde00009290).stop 2021-10-20T23:27:55.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 -- 172.21.15.12:0/2493345403 shutdown_connections 2021-10-20T23:27:55.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 --2- 172.21.15.12:0/2493345403 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0813f390 0x7fde080aece0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 --2- 172.21.15.12:0/2493345403 >> v2:172.21.15.31:3300/0 conn(0x7fde0805c7d0 0x7fde080b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 -- 172.21.15.12:0/2493345403 >> 172.21.15.12:0/2493345403 conn(0x7fde08060180 msgr2=0x7fde080b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:55.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 -- 172.21.15.12:0/2493345403 shutdown_connections 2021-10-20T23:27:55.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 -- 172.21.15.12:0/2493345403 wait complete. 2021-10-20T23:27:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 Processor -- start 2021-10-20T23:27:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 -- start start 2021-10-20T23:27:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0805c7d0 0x7fde08132300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0805d0b0 0x7fde0814ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde0813f390 0x7fde080af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde08152da0 con 0x7fde0805c7d0 2021-10-20T23:27:55.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0814f330 con 0x7fde0813f390 2021-10-20T23:27:55.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0d94e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde08152fd0 con 0x7fde0805d0b0 2021-10-20T23:27:55.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.786+0000 7fde0c94c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0805c7d0 0x7fde08132300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d14d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde0813f390 0x7fde080af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde07fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0805d0b0 0x7fde0814ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0c94c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0805c7d0 0x7fde08132300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43566/0 (socket says 172.21.15.12:43566) 2021-10-20T23:27:55.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d14d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde0813f390 0x7fde080af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:58544/0 (socket says 172.21.15.12:58544) 2021-10-20T23:27:55.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde07fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0805d0b0 0x7fde0814ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:49326/0 (socket says 172.21.15.12:49326) 2021-10-20T23:27:55.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0c94c700 1 -- 172.21.15.12:0/3469436933 learned_addr learned my addr 172.21.15.12:0/3469436933 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:55.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d14d700 1 -- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0805d0b0 msgr2=0x7fde0814ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d14d700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0805d0b0 0x7fde0814ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d14d700 1 -- 172.21.15.12:0/3469436933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0805c7d0 msgr2=0x7fde08132300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d14d700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0805c7d0 0x7fde08132300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d14d700 1 -- 172.21.15.12:0/3469436933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde00009530 con 0x7fde0813f390 2021-10-20T23:27:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde07fff700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0805d0b0 0x7fde0814ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0c94c700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0805c7d0 0x7fde08132300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d14d700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde0813f390 0x7fde080af530 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fde000032f0 tx=0x7fde00016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde05ffb700 1 -- 172.21.15.12:0/3469436933 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde0000b8a0 con 0x7fde0813f390 2021-10-20T23:27:55.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde080aedf0 con 0x7fde0813f390 2021-10-20T23:27:55.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde05ffb700 1 -- 172.21.15.12:0/3469436933 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00021440 con 0x7fde0813f390 2021-10-20T23:27:55.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde05ffb700 1 -- 172.21.15.12:0/3469436933 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde000217a0 con 0x7fde0813f390 2021-10-20T23:27:55.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde080afa20 con 0x7fde0813f390 2021-10-20T23:27:55.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde081531d0 con 0x7fde0813f390 2021-10-20T23:27:55.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.790+0000 7fde05ffb700 1 -- 172.21.15.12:0/3469436933 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde00027020 con 0x7fde0813f390 2021-10-20T23:27:55.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.794+0000 7fde05ffb700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddec0536d0 0x7fddec055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:55.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.794+0000 7fde05ffb700 1 -- 172.21.15.12:0/3469436933 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fde0006cc20 con 0x7fde0813f390 2021-10-20T23:27:55.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.794+0000 7fde0c94c700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddec0536d0 0x7fddec055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:55.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.794+0000 7fde0c94c700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddec0536d0 0x7fddec055b90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fddf000b000 tx=0x7fddf0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:55.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.802+0000 7fde05ffb700 1 -- 172.21.15.12:0/3469436933 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde00043f00 con 0x7fde0813f390 2021-10-20T23:27:55.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.930+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde080b1a30 con 0x7fde0813f390 2021-10-20T23:27:55.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde05ffb700 1 -- 172.21.15.12:0/3469436933 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v117) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde00015070 con 0x7fde0813f390 2021-10-20T23:27:55.942 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:27:55.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddec0536d0 msgr2=0x7fddec055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddec0536d0 0x7fddec055b90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fddf000b000 tx=0x7fddf0006df0).stop 2021-10-20T23:27:55.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde0813f390 msgr2=0x7fde080af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:55.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde0813f390 0x7fde080af530 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fde000032f0 tx=0x7fde00016000).stop 2021-10-20T23:27:55.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 shutdown_connections 2021-10-20T23:27:55.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddec0536d0 0x7fddec055b90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde0813f390 0x7fde080af530 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fde0805d0b0 0x7fde0814ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 --2- 172.21.15.12:0/3469436933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0805c7d0 0x7fde08132300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 >> 172.21.15.12:0/3469436933 conn(0x7fde08060180 msgr2=0x7fde08136df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:55.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 shutdown_connections 2021-10-20T23:27:55.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:55.934+0000 7fde0d94e700 1 -- 172.21.15.12:0/3469436933 wait complete. 2021-10-20T23:27:55.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:27:56.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.050+0000 7f571f59e700 1 Processor -- start 2021-10-20T23:27:56.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.050+0000 7f571f59e700 1 -- start start 2021-10-20T23:27:56.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5720061320 0x7f5720061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 0x7f57201408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200aecf0 con 0x7f57200ad5c0 2021-10-20T23:27:56.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200b6f20 con 0x7f5720061320 2021-10-20T23:27:56.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200aef20 con 0x7f5720140440 2021-10-20T23:27:56.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5720061320 0x7f5720061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5720061320 0x7f5720061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43574/0 (socket says 172.21.15.12:43574) 2021-10-20T23:27:56.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571e59c700 1 -- 172.21.15.12:0/812064138 learned_addr learned my addr 172.21.15.12:0/812064138 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:56.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571ed9d700 1 --2- 172.21.15.12:0/812064138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 0x7f57201408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571e59c700 1 -- 172.21.15.12:0/812064138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 msgr2=0x7f57201408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:56.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571e59c700 1 --2- 172.21.15.12:0/812064138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 0x7f57201408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571e59c700 1 -- 172.21.15.12:0/812064138 >> v1:172.21.15.31:6789/0 conn(0x7f57200ad5c0 legacy=0x7f57200b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571e59c700 1 -- 172.21.15.12:0/812064138 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200af1c0 con 0x7f5720061320 2021-10-20T23:27:56.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571e59c700 1 --2- 172.21.15.12:0/812064138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 0x7f5720061700 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f57200aeba0 tx=0x7f5710006eb0).ready entity=mon.0 client_cookie=100ca5331c337ac server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:56.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571dd9b700 1 -- 172.21.15.12:0/812064138 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571000d5c0 con 0x7f5720061320 2021-10-20T23:27:56.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571dd9b700 1 -- 172.21.15.12:0/812064138 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710000e90 con 0x7f5720061320 2021-10-20T23:27:56.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571dd9b700 1 -- 172.21.15.12:0/812064138 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571000d950 con 0x7f5720061320 2021-10-20T23:27:56.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 -- 172.21.15.12:0/812064138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 msgr2=0x7f5720061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 --2- 172.21.15.12:0/812064138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 0x7f5720061700 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f57200aeba0 tx=0x7f5710006eb0).stop 2021-10-20T23:27:56.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 -- 172.21.15.12:0/812064138 shutdown_connections 2021-10-20T23:27:56.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 --2- 172.21.15.12:0/812064138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 0x7f57201408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 --2- 172.21.15.12:0/812064138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 0x7f5720061700 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 -- 172.21.15.12:0/812064138 >> 172.21.15.12:0/812064138 conn(0x7f5720066de0 msgr2=0x7f57200671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:56.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 -- 172.21.15.12:0/812064138 shutdown_connections 2021-10-20T23:27:56.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.054+0000 7f571f59e700 1 -- 172.21.15.12:0/812064138 wait complete. 2021-10-20T23:27:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 Processor -- start 2021-10-20T23:27:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 -- start start 2021-10-20T23:27:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 0x7f57200b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200ad5c0 0x7f572009ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 0x7f5720155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5720153500 con 0x7f5720061320 2021-10-20T23:27:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200afe80 con 0x7f57200ad5c0 2021-10-20T23:27:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5720153260 con 0x7f5720140440 2021-10-20T23:27:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 0x7f57200b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 0x7f57200b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43582/0 (socket says 172.21.15.12:43582) 2021-10-20T23:27:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571e59c700 1 -- 172.21.15.12:0/1795455313 learned_addr learned my addr 172.21.15.12:0/1795455313 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571ed9d700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 0x7f5720155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f5717fff700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200ad5c0 0x7f572009ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571e59c700 1 -- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 msgr2=0x7f5720155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571e59c700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 0x7f5720155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571e59c700 1 -- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200ad5c0 msgr2=0x7f572009ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571e59c700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200ad5c0 0x7f572009ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571e59c700 1 -- 172.21.15.12:0/1795455313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571000b1e0 con 0x7f5720061320 2021-10-20T23:27:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571e59c700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 0x7f57200b0480 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f57200aeba0 tx=0x7f5710015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f57177fe700 1 -- 172.21.15.12:0/1795455313 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5710011860 con 0x7f5720061320 2021-10-20T23:27:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f57177fe700 1 -- 172.21.15.12:0/1795455313 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57100119c0 con 0x7f5720061320 2021-10-20T23:27:56.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57200b0e30 con 0x7f5720061320 2021-10-20T23:27:56.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f57177fe700 1 -- 172.21.15.12:0/1795455313 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5710011d20 con 0x7f5720061320 2021-10-20T23:27:56.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.058+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57200b0970 con 0x7f5720061320 2021-10-20T23:27:56.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.062+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57200af460 con 0x7f5720061320 2021-10-20T23:27:56.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.062+0000 7f57177fe700 1 -- 172.21.15.12:0/1795455313 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5710025030 con 0x7f5720061320 2021-10-20T23:27:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.062+0000 7f57177fe700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5704053580 0x7f5704055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.062+0000 7f57177fe700 1 -- 172.21.15.12:0/1795455313 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f571006c9a0 con 0x7f5720061320 2021-10-20T23:27:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.062+0000 7f5717fff700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5704053580 0x7f5704055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.062+0000 7f5717fff700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5704053580 0x7f5704055a40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f570800d000 tx=0x7f5708007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.066+0000 7f57177fe700 1 -- 172.21.15.12:0/1795455313 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5710043ce0 con 0x7f5720061320 2021-10-20T23:27:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.206+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5720057350 con 0x7f5720061320 2021-10-20T23:27:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.206+0000 7f57177fe700 1 -- 172.21.15.12:0/1795455313 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v117) v1 ==== 84+0+143 (secure 0 0 0) 0x7f5710023070 con 0x7f5720061320 2021-10-20T23:27:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:56.217 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:27:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:27:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:27:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:27:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:27:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:27:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:27:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:27:56.220 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:27:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5704053580 msgr2=0x7f5704055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5704053580 0x7f5704055a40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f570800d000 tx=0x7f5708007b90).stop 2021-10-20T23:27:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 msgr2=0x7f57200b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 0x7f57200b0480 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f57200aeba0 tx=0x7f5710015000).stop 2021-10-20T23:27:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 shutdown_connections 2021-10-20T23:27:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5704053580 0x7f5704055a40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5720140440 0x7f5720155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200ad5c0 0x7f572009ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 --2- 172.21.15.12:0/1795455313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720061320 0x7f57200b0480 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 >> 172.21.15.12:0/1795455313 conn(0x7f5720066de0 msgr2=0x7f5720143600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 shutdown_connections 2021-10-20T23:27:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.210+0000 7f571f59e700 1 -- 172.21.15.12:0/1795455313 wait complete. 2021-10-20T23:27:56.228 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:27:56.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:27:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 Processor -- start 2021-10-20T23:27:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 -- start start 2021-10-20T23:27:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fefd40aeab0 0x7fefd40aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd40b0000 con 0x7fefd40b0480 2021-10-20T23:27:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd40ad0a0 con 0x7fefd4146ed0 2021-10-20T23:27:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd40adf40 con 0x7fefd40aeab0 2021-10-20T23:27:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fefd40aeab0 0x7fefd40aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd1d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fefd40b0480 0x7fefd41467c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42182/0 (socket says 172.21.15.12:42182) 2021-10-20T23:27:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd1d9b700 1 -- 172.21.15.12:0/1300921641 learned_addr learned my addr 172.21.15.12:0/1300921641 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd259c700 1 -- 172.21.15.12:0/1300921641 >> v1:172.21.15.31:6789/0 conn(0x7fefd4146ed0 legacy=0x7fefd413ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd159a700 1 -- 172.21.15.12:0/1300921641 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649712041 0 0) 0x7fefd40b0000 con 0x7fefd40b0480 2021-10-20T23:27:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd259c700 1 -- 172.21.15.12:0/1300921641 >> v1:172.21.15.12:6789/0 conn(0x7fefd40b0480 legacy=0x7fefd41467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd259c700 1 -- 172.21.15.12:0/1300921641 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4147380 con 0x7fefd40aeab0 2021-10-20T23:27:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd259c700 1 --2- 172.21.15.12:0/1300921641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd40aeab0 0x7fefd40aee90 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7fefc4002f70 tx=0x7fefc4006df0).ready entity=mon.0 client_cookie=ca1ab3ee15ce2c98 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd159a700 1 -- 172.21.15.12:0/1300921641 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc400d610 con 0x7fefd40aeab0 2021-10-20T23:27:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd159a700 1 -- 172.21.15.12:0/1300921641 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4000e90 con 0x7fefd40aeab0 2021-10-20T23:27:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd159a700 1 -- 172.21.15.12:0/1300921641 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc400d960 con 0x7fefd40aeab0 2021-10-20T23:27:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 -- 172.21.15.12:0/1300921641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd40aeab0 msgr2=0x7fefd40aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 --2- 172.21.15.12:0/1300921641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd40aeab0 0x7fefd40aee90 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7fefc4002f70 tx=0x7fefc4006df0).stop 2021-10-20T23:27:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 -- 172.21.15.12:0/1300921641 shutdown_connections 2021-10-20T23:27:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 --2- 172.21.15.12:0/1300921641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd40aeab0 0x7fefd40aee90 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 -- 172.21.15.12:0/1300921641 >> 172.21.15.12:0/1300921641 conn(0x7fefd4061230 msgr2=0x7fefd4062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 -- 172.21.15.12:0/1300921641 shutdown_connections 2021-10-20T23:27:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.326+0000 7fefd359e700 1 -- 172.21.15.12:0/1300921641 wait complete. 2021-10-20T23:27:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 Processor -- start 2021-10-20T23:27:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 -- start start 2021-10-20T23:27:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd40aeab0 0x7fefd413e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd40b0480 0x7fefd4143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd4146ed0 0x7fefd413e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd413ebd0 con 0x7fefd4146ed0 2021-10-20T23:27:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd413edb0 con 0x7fefd40b0480 2021-10-20T23:27:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd413f300 con 0x7fefd40aeab0 2021-10-20T23:27:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd4146ed0 0x7fefd413e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd4146ed0 0x7fefd413e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43596/0 (socket says 172.21.15.12:43596) 2021-10-20T23:27:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd2d9d700 1 -- 172.21.15.12:0/194865725 learned_addr learned my addr 172.21.15.12:0/194865725 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd1d9b700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd40b0480 0x7fefd4143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd259c700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd40aeab0 0x7fefd413e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd2d9d700 1 -- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd40aeab0 msgr2=0x7fefd413e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd2d9d700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd40aeab0 0x7fefd413e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd2d9d700 1 -- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd40b0480 msgr2=0x7fefd4143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd2d9d700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd40b0480 0x7fefd4143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd2d9d700 1 -- 172.21.15.12:0/194865725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc400b180 con 0x7fefd4146ed0 2021-10-20T23:27:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd2d9d700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd4146ed0 0x7fefd413e6e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fefd4063500 tx=0x7fefcc0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefcb7fe700 1 -- 172.21.15.12:0/194865725 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefcc006aa0 con 0x7fefd4146ed0 2021-10-20T23:27:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefcb7fe700 1 -- 172.21.15.12:0/194865725 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc006c00 con 0x7fefd4146ed0 2021-10-20T23:27:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd413f5a0 con 0x7fefd4146ed0 2021-10-20T23:27:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefcb7fe700 1 -- 172.21.15.12:0/194865725 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefcc007030 con 0x7fefd4146ed0 2021-10-20T23:27:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.330+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd413fce0 con 0x7fefd4146ed0 2021-10-20T23:27:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.334+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd40b0990 con 0x7fefd4146ed0 2021-10-20T23:27:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.334+0000 7fefcb7fe700 1 -- 172.21.15.12:0/194865725 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fefcc010030 con 0x7fefd4146ed0 2021-10-20T23:27:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.334+0000 7fefcb7fe700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053580 0x7fefb8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.334+0000 7fefcb7fe700 1 -- 172.21.15.12:0/194865725 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fefcc06b620 con 0x7fefd4146ed0 2021-10-20T23:27:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.334+0000 7fefd259c700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053580 0x7fefb8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.334+0000 7fefd259c700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053580 0x7fefb8055a40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fefc401c000 tx=0x7fefc4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:56.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.338+0000 7fefcb7fe700 1 -- 172.21.15.12:0/194865725 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fefcc042850 con 0x7fefd4146ed0 2021-10-20T23:27:56.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:56.470+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fefd4057350 con 0x7fefd4146ed0 2021-10-20T23:27:57.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.062+0000 7fefcb7fe700 1 -- 172.21.15.12:0/194865725 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v118) v1 ==== 133+0+0 (secure 0 0 0) 0x7fefcc045e70 con 0x7fefd4146ed0 2021-10-20T23:27:57.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053580 msgr2=0x7fefb8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053580 0x7fefb8055a40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fefc401c000 tx=0x7fefc4015000).stop 2021-10-20T23:27:57.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd4146ed0 msgr2=0x7fefd413e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd4146ed0 0x7fefd413e6e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fefd4063500 tx=0x7fefcc0013a0).stop 2021-10-20T23:27:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 shutdown_connections 2021-10-20T23:27:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fefb8053580 0x7fefb8055a40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefd4146ed0 0x7fefd413e6e0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefd40b0480 0x7fefd4143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 --2- 172.21.15.12:0/194865725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefd40aeab0 0x7fefd413e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 >> 172.21.15.12:0/194865725 conn(0x7fefd4061230 msgr2=0x7fefd40b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 shutdown_connections 2021-10-20T23:27:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.066+0000 7fefd359e700 1 -- 172.21.15.12:0/194865725 wait complete. 2021-10-20T23:27:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:27:57.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:27:57.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.194+0000 7f110d15a700 1 Processor -- start 2021-10-20T23:27:57.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.194+0000 7f110d15a700 1 -- start start 2021-10-20T23:27:57.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f11080b0b80 0x7f1108146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11080b03d0 0x7f11081401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11080b1140 con 0x7f11080a9190 2021-10-20T23:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11080a9570 con 0x7f11080b0b80 2021-10-20T23:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11080b1370 con 0x7f11080b03d0 2021-10-20T23:27:57.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f11077fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f11080b0b80 0x7f1108146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f11077fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f11080b0b80 0x7f1108146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43604/0 (socket says 172.21.15.12:43604) 2021-10-20T23:27:57.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f11077fe700 1 -- 172.21.15.12:0/1295708384 learned_addr learned my addr 172.21.15.12:0/1295708384 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:57.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110c959700 1 --2- 172.21.15.12:0/1295708384 >> v2:172.21.15.31:3300/0 conn(0x7f11080b03d0 0x7f11081401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f11077fe700 1 -- 172.21.15.12:0/1295708384 >> v2:172.21.15.31:3300/0 conn(0x7f11080b03d0 msgr2=0x7f11081401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f11077fe700 1 --2- 172.21.15.12:0/1295708384 >> v2:172.21.15.31:3300/0 conn(0x7f11080b03d0 0x7f11081401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f11077fe700 1 -- 172.21.15.12:0/1295708384 >> v1:172.21.15.31:6789/0 conn(0x7f11080a9190 legacy=0x7f1108146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f11077fe700 1 -- 172.21.15.12:0/1295708384 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11080b1610 con 0x7f11080b0b80 2021-10-20T23:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f11077fe700 1 --2- 172.21.15.12:0/1295708384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b0b80 0x7f1108146c60 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f10fc002f70 tx=0x7f10fc006eb0).ready entity=mon.0 client_cookie=7033ee8f82181f51 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f1106ffd700 1 -- 172.21.15.12:0/1295708384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10fc00d5c0 con 0x7f11080b0b80 2021-10-20T23:27:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f1106ffd700 1 -- 172.21.15.12:0/1295708384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc000e90 con 0x7f11080b0b80 2021-10-20T23:27:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f1106ffd700 1 -- 172.21.15.12:0/1295708384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10fc00d950 con 0x7f11080b0b80 2021-10-20T23:27:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 -- 172.21.15.12:0/1295708384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b0b80 msgr2=0x7f1108146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 --2- 172.21.15.12:0/1295708384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b0b80 0x7f1108146c60 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f10fc002f70 tx=0x7f10fc006eb0).stop 2021-10-20T23:27:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 -- 172.21.15.12:0/1295708384 shutdown_connections 2021-10-20T23:27:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 --2- 172.21.15.12:0/1295708384 >> v2:172.21.15.31:3300/0 conn(0x7f11080b03d0 0x7f11081401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 --2- 172.21.15.12:0/1295708384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b0b80 0x7f1108146c60 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 -- 172.21.15.12:0/1295708384 >> 172.21.15.12:0/1295708384 conn(0x7f1108061140 msgr2=0x7f1108062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 -- 172.21.15.12:0/1295708384 shutdown_connections 2021-10-20T23:27:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.198+0000 7f110d15a700 1 -- 172.21.15.12:0/1295708384 wait complete. 2021-10-20T23:27:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f110d15a700 1 Processor -- start 2021-10-20T23:27:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f110d15a700 1 -- start start 2021-10-20T23:27:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f110d15a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11080a9190 0x7f1108145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f110d15a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b03d0 0x7f1108148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f110d15a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11080b0b80 0x7f1108139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f110d15a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1108139c30 con 0x7f11080b03d0 2021-10-20T23:27:57.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f110d15a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1108152e00 con 0x7f11080b0b80 2021-10-20T23:27:57.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f110d15a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1108153030 con 0x7f11080a9190 2021-10-20T23:27:57.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f11077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b03d0 0x7f1108148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f11077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b03d0 0x7f1108148c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43610/0 (socket says 172.21.15.12:43610) 2021-10-20T23:27:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f11077fe700 1 -- 172.21.15.12:0/3498349666 learned_addr learned my addr 172.21.15.12:0/3498349666 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f1107fff700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11080a9190 0x7f1108145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f110c959700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11080b0b80 0x7f1108139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f11077fe700 1 -- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11080a9190 msgr2=0x7f1108145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f11077fe700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11080a9190 0x7f1108145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f11077fe700 1 -- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11080b0b80 msgr2=0x7f1108139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f11077fe700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11080b0b80 0x7f1108139e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f11077fe700 1 -- 172.21.15.12:0/3498349666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc00b1e0 con 0x7f11080b03d0 2021-10-20T23:27:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.202+0000 7f11077fe700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b03d0 0x7f1108148c00 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f10fc002f70 tx=0x7f10fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.206+0000 7f11057fa700 1 -- 172.21.15.12:0/3498349666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10fc011760 con 0x7f11080b03d0 2021-10-20T23:27:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.206+0000 7f11057fa700 1 -- 172.21.15.12:0/3498349666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc0118c0 con 0x7f11080b03d0 2021-10-20T23:27:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.206+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11081532d0 con 0x7f11080b03d0 2021-10-20T23:27:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.206+0000 7f11057fa700 1 -- 172.21.15.12:0/3498349666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10fc011c20 con 0x7f11080b03d0 2021-10-20T23:27:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.206+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11081457d0 con 0x7f11080b03d0 2021-10-20T23:27:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.206+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1108057350 con 0x7f11080b03d0 2021-10-20T23:27:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.206+0000 7f11057fa700 1 -- 172.21.15.12:0/3498349666 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f10fc025030 con 0x7f11080b03d0 2021-10-20T23:27:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.206+0000 7f11057fa700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f10e80536a0 0x7f10e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.206+0000 7f11057fa700 1 -- 172.21.15.12:0/3498349666 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f10fc06c850 con 0x7f11080b03d0 2021-10-20T23:27:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.210+0000 7f1107fff700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f10e80536a0 0x7f10e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.210+0000 7f1107fff700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f10e80536a0 0x7f10e8055b60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f10f800d000 tx=0x7f10f8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.214+0000 7f11057fa700 1 -- 172.21.15.12:0/3498349666 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10fc043a20 con 0x7f11080b03d0 2021-10-20T23:27:57.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.346+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f11081459d0 con 0x7f11080b03d0 2021-10-20T23:27:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.730+0000 7f11057fa700 1 -- 172.21.15.12:0/3498349666 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v119) v1 ==== 125+0+0 (secure 0 0 0) 0x7f10fc023020 con 0x7f11080b03d0 2021-10-20T23:27:57.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f10e80536a0 msgr2=0x7f10e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f10e80536a0 0x7f10e8055b60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f10f800d000 tx=0x7f10f8009040).stop 2021-10-20T23:27:57.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b03d0 msgr2=0x7f1108148c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b03d0 0x7f1108148c00 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f10fc002f70 tx=0x7f10fc015000).stop 2021-10-20T23:27:57.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 shutdown_connections 2021-10-20T23:27:57.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f10e80536a0 0x7f10e8055b60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11080b0b80 0x7f1108139e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11080b03d0 0x7f1108148c00 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 --2- 172.21.15.12:0/3498349666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11080a9190 0x7f1108145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 >> 172.21.15.12:0/3498349666 conn(0x7f1108061140 msgr2=0x7f11081469e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:57.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 shutdown_connections 2021-10-20T23:27:57.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.738+0000 7f110d15a700 1 -- 172.21.15.12:0/3498349666 wait complete. 2021-10-20T23:27:57.751 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:27:57.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:27:57.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.858+0000 7f46034ae700 1 Processor -- start 2021-10-20T23:27:57.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.858+0000 7f46034ae700 1 -- start start 2021-10-20T23:27:57.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 0x7f45fc0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f45fc05d0b0 0x7f45fc13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45fc0ace30 0x7f45fc0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc067d70 con 0x7f45fc0ace30 2021-10-20T23:27:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc13f880 con 0x7f45fc05d0b0 2021-10-20T23:27:57.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc05cbb0 con 0x7f45fc05c7d0 2021-10-20T23:27:57.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4602cad700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45fc0ace30 0x7f45fc0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4602cad700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45fc0ace30 0x7f45fc0aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43616/0 (socket says 172.21.15.12:43616) 2021-10-20T23:27:57.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4602cad700 1 -- 172.21.15.12:0/1190843928 learned_addr learned my addr 172.21.15.12:0/1190843928 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:57.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4601cab700 1 --2- 172.21.15.12:0/1190843928 >> v2:172.21.15.31:3300/0 conn(0x7f45fc05d0b0 0x7f45fc13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46024ac700 1 --2- 172.21.15.12:0/1190843928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 0x7f45fc0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4602cad700 1 -- 172.21.15.12:0/1190843928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 msgr2=0x7f45fc0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:57.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4602cad700 1 --2- 172.21.15.12:0/1190843928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 0x7f45fc0b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4602cad700 1 -- 172.21.15.12:0/1190843928 >> v2:172.21.15.31:3300/0 conn(0x7f45fc05d0b0 msgr2=0x7f45fc13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:57.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4602cad700 1 --2- 172.21.15.12:0/1190843928 >> v2:172.21.15.31:3300/0 conn(0x7f45fc05d0b0 0x7f45fc13f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4602cad700 1 -- 172.21.15.12:0/1190843928 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc0b1790 con 0x7f45fc0ace30 2021-10-20T23:27:57.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4601cab700 1 --2- 172.21.15.12:0/1190843928 >> v2:172.21.15.31:3300/0 conn(0x7f45fc05d0b0 0x7f45fc13f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:57.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f4602cad700 1 --2- 172.21.15.12:0/1190843928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc0ace30 0x7f45fc0aece0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f45f40032f0 tx=0x7f45f4009290).ready entity=mon.0 client_cookie=c41d1332913dbdc0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:57.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46014aa700 1 -- 172.21.15.12:0/1190843928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f400b680 con 0x7f45fc0ace30 2021-10-20T23:27:57.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46014aa700 1 -- 172.21.15.12:0/1190843928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f400b7e0 con 0x7f45fc0ace30 2021-10-20T23:27:57.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46014aa700 1 -- 172.21.15.12:0/1190843928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f400b950 con 0x7f45fc0ace30 2021-10-20T23:27:57.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 -- 172.21.15.12:0/1190843928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc0ace30 msgr2=0x7f45fc0aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 --2- 172.21.15.12:0/1190843928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc0ace30 0x7f45fc0aece0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f45f40032f0 tx=0x7f45f4009290).stop 2021-10-20T23:27:57.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 -- 172.21.15.12:0/1190843928 shutdown_connections 2021-10-20T23:27:57.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 --2- 172.21.15.12:0/1190843928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc0ace30 0x7f45fc0aece0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 --2- 172.21.15.12:0/1190843928 >> v2:172.21.15.31:3300/0 conn(0x7f45fc05d0b0 0x7f45fc13f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 --2- 172.21.15.12:0/1190843928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 0x7f45fc0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 -- 172.21.15.12:0/1190843928 >> 172.21.15.12:0/1190843928 conn(0x7f45fc060180 msgr2=0x7f45fc0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:57.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 -- 172.21.15.12:0/1190843928 shutdown_connections 2021-10-20T23:27:57.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.862+0000 7f46034ae700 1 -- 172.21.15.12:0/1190843928 wait complete. 2021-10-20T23:27:57.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 Processor -- start 2021-10-20T23:27:57.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 -- start start 2021-10-20T23:27:57.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 0x7f45fc13e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc05d0b0 0x7f45fc1409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45fc0ace30 0x7f45fc140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0abb40 con 0x7f45fc05d0b0 2021-10-20T23:27:57.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc1308b0 con 0x7f45fc0ace30 2021-10-20T23:27:57.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0b3930 con 0x7f45fc05c7d0 2021-10-20T23:27:57.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4601cab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc05d0b0 0x7f45fc1409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4601cab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc05d0b0 0x7f45fc1409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43622/0 (socket says 172.21.15.12:43622) 2021-10-20T23:27:57.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46024ac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 0x7f45fc13e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4601cab700 1 -- 172.21.15.12:0/1009364393 learned_addr learned my addr 172.21.15.12:0/1009364393 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:57.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4602cad700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45fc0ace30 0x7f45fc140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4601cab700 1 -- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 msgr2=0x7f45fc13e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4601cab700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 0x7f45fc13e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4601cab700 1 -- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45fc0ace30 msgr2=0x7f45fc140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:57.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4601cab700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45fc0ace30 0x7f45fc140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:57.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4601cab700 1 -- 172.21.15.12:0/1009364393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f800b180 con 0x7f45fc05d0b0 2021-10-20T23:27:57.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46024ac700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 0x7f45fc13e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:57.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f4601cab700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc05d0b0 0x7f45fc1409a0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f45f800c000 tx=0x7f45f8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:57.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f45ef7fe700 1 -- 172.21.15.12:0/1009364393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f800c890 con 0x7f45fc05d0b0 2021-10-20T23:27:57.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f45ef7fe700 1 -- 172.21.15.12:0/1009364393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f800c9f0 con 0x7f45fc05d0b0 2021-10-20T23:27:57.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f4009530 con 0x7f45fc05d0b0 2021-10-20T23:27:57.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f45ef7fe700 1 -- 172.21.15.12:0/1009364393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f800cd50 con 0x7f45fc05d0b0 2021-10-20T23:27:57.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.866+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc141dc0 con 0x7f45fc05d0b0 2021-10-20T23:27:57.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.870+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc0b1a30 con 0x7f45fc05d0b0 2021-10-20T23:27:57.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.870+0000 7f45ef7fe700 1 -- 172.21.15.12:0/1009364393 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45f801c460 con 0x7f45fc05d0b0 2021-10-20T23:27:57.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.870+0000 7f45ef7fe700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45dc0536d0 0x7f45dc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:57.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.870+0000 7f45ef7fe700 1 -- 172.21.15.12:0/1009364393 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f45f806c0a0 con 0x7f45fc05d0b0 2021-10-20T23:27:57.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.870+0000 7f46024ac700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45dc0536d0 0x7f45dc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:57.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.870+0000 7f46024ac700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45dc0536d0 0x7f45dc055b90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f45f000b000 tx=0x7f45f0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:57.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:57.878+0000 7f45ef7fe700 1 -- 172.21.15.12:0/1009364393 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45f8043020 con 0x7f45fc05d0b0 2021-10-20T23:27:58.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.042+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f45fc057350 con 0x7f45fc05d0b0 2021-10-20T23:27:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.054+0000 7f45ef7fe700 1 -- 172.21.15.12:0/1009364393 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v59) v1 ==== 189+0+0 (secure 0 0 0) 0x7f45f8046640 con 0x7f45fc05d0b0 2021-10-20T23:27:58.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45dc0536d0 msgr2=0x7f45dc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45dc0536d0 0x7f45dc055b90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f45f000b000 tx=0x7f45f0006df0).stop 2021-10-20T23:27:58.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc05d0b0 msgr2=0x7f45fc1409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc05d0b0 0x7f45fc1409a0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f45f800c000 tx=0x7f45f8006df0).stop 2021-10-20T23:27:58.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 shutdown_connections 2021-10-20T23:27:58.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f45dc0536d0 0x7f45dc055b90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45fc0ace30 0x7f45fc140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45fc05d0b0 0x7f45fc1409a0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 --2- 172.21.15.12:0/1009364393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45fc05c7d0 0x7f45fc13e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 >> 172.21.15.12:0/1009364393 conn(0x7f45fc060180 msgr2=0x7f45fc0b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:58.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 shutdown_connections 2021-10-20T23:27:58.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.058+0000 7f46034ae700 1 -- 172.21.15.12:0/1009364393 wait complete. 2021-10-20T23:27:58.072 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 21 and data pool 22 2021-10-20T23:27:58.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:58.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.170+0000 7fee6c924700 1 Processor -- start 2021-10-20T23:27:58.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.170+0000 7fee6c924700 1 -- start start 2021-10-20T23:27:58.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 0x7fee680af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee680ad320 0x7fee68143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee68143640 0x7fee680a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680afda0 con 0x7fee68143640 2021-10-20T23:27:58.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6805c610 con 0x7fee680ad320 2021-10-20T23:27:58.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee68140800 con 0x7fee680af2c0 2021-10-20T23:27:58.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee68143640 0x7fee680a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee68143640 0x7fee680a8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43648/0 (socket says 172.21.15.12:43648) 2021-10-20T23:27:58.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6759e700 1 -- 172.21.15.12:0/1180011650 learned_addr learned my addr 172.21.15.12:0/1180011650 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:58.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee66d9d700 1 --2- 172.21.15.12:0/1180011650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 0x7fee680af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6659c700 1 --2- 172.21.15.12:0/1180011650 >> v2:172.21.15.31:3300/0 conn(0x7fee680ad320 0x7fee68143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6759e700 1 -- 172.21.15.12:0/1180011650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 msgr2=0x7fee680af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:58.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6759e700 1 --2- 172.21.15.12:0/1180011650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 0x7fee680af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6759e700 1 -- 172.21.15.12:0/1180011650 >> v2:172.21.15.31:3300/0 conn(0x7fee680ad320 msgr2=0x7fee68143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:58.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6759e700 1 --2- 172.21.15.12:0/1180011650 >> v2:172.21.15.31:3300/0 conn(0x7fee680ad320 0x7fee68143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6759e700 1 -- 172.21.15.12:0/1180011650 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680ad850 con 0x7fee68143640 2021-10-20T23:27:58.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6759e700 1 --2- 172.21.15.12:0/1180011650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 0x7fee680a8cb0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fee6813fc30 tx=0x7fee6000b530).ready entity=mon.0 client_cookie=58974a2f06b6773 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:58.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee65d9b700 1 -- 172.21.15.12:0/1180011650 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6000dd30 con 0x7fee68143640 2021-10-20T23:27:58.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee65d9b700 1 -- 172.21.15.12:0/1180011650 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000de90 con 0x7fee68143640 2021-10-20T23:27:58.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee65d9b700 1 -- 172.21.15.12:0/1180011650 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee60010660 con 0x7fee68143640 2021-10-20T23:27:58.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 -- 172.21.15.12:0/1180011650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 msgr2=0x7fee680a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 --2- 172.21.15.12:0/1180011650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 0x7fee680a8cb0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fee6813fc30 tx=0x7fee6000b530).stop 2021-10-20T23:27:58.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 -- 172.21.15.12:0/1180011650 shutdown_connections 2021-10-20T23:27:58.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 --2- 172.21.15.12:0/1180011650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 0x7fee680a8cb0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 --2- 172.21.15.12:0/1180011650 >> v2:172.21.15.31:3300/0 conn(0x7fee680ad320 0x7fee68143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 --2- 172.21.15.12:0/1180011650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 0x7fee680af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.174+0000 7fee6c924700 1 -- 172.21.15.12:0/1180011650 >> 172.21.15.12:0/1180011650 conn(0x7fee68061140 msgr2=0x7fee68062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:58.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.178+0000 7fee6c924700 1 -- 172.21.15.12:0/1180011650 shutdown_connections 2021-10-20T23:27:58.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.178+0000 7fee6c924700 1 -- 172.21.15.12:0/1180011650 wait complete. 2021-10-20T23:27:58.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.178+0000 7fee6c924700 1 Processor -- start 2021-10-20T23:27:58.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.178+0000 7fee6c924700 1 -- start start 2021-10-20T23:27:58.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6c924700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee680ad320 0x7fee680a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6c924700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 0x7fee6813cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6c924700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 0x7fee6813d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6c924700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee680abcb0 con 0x7fee68143640 2021-10-20T23:27:58.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6c924700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6814edc0 con 0x7fee680ad320 2021-10-20T23:27:58.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6c924700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680b0730 con 0x7fee680af2c0 2021-10-20T23:27:58.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 0x7fee6813d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 0x7fee6813d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43652/0 (socket says 172.21.15.12:43652) 2021-10-20T23:27:58.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6759e700 1 -- 172.21.15.12:0/2480998322 learned_addr learned my addr 172.21.15.12:0/2480998322 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:58.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee66d9d700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee680ad320 0x7fee680a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6659c700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 0x7fee6813cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6759e700 1 -- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 msgr2=0x7fee6813cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6759e700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 0x7fee6813cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6759e700 1 -- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee680ad320 msgr2=0x7fee680a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6759e700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee680ad320 0x7fee680a8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6759e700 1 -- 172.21.15.12:0/2480998322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6000b7d0 con 0x7fee68143640 2021-10-20T23:27:58.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6759e700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 0x7fee6813d0c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7fee6813fc30 tx=0x7fee6000b530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:58.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee57fff700 1 -- 172.21.15.12:0/2480998322 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6001d070 con 0x7fee68143640 2021-10-20T23:27:58.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee57fff700 1 -- 172.21.15.12:0/2480998322 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60018800 con 0x7fee68143640 2021-10-20T23:27:58.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee680b0990 con 0x7fee68143640 2021-10-20T23:27:58.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee57fff700 1 -- 172.21.15.12:0/2480998322 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee60018b60 con 0x7fee68143640 2021-10-20T23:27:58.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6813d5b0 con 0x7fee68143640 2021-10-20T23:27:58.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee57fff700 1 -- 172.21.15.12:0/2480998322 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee60029070 con 0x7fee68143640 2021-10-20T23:27:58.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee68057350 con 0x7fee68143640 2021-10-20T23:27:58.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.182+0000 7fee57fff700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee440534f0 0x7fee440559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.186+0000 7fee57fff700 1 -- 172.21.15.12:0/2480998322 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fee6006d360 con 0x7fee68143640 2021-10-20T23:27:58.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.186+0000 7fee66d9d700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee440534f0 0x7fee440559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.186+0000 7fee66d9d700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee440534f0 0x7fee440559b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fee5800b000 tx=0x7fee58006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:58.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.186+0000 7fee57fff700 1 -- 172.21.15.12:0/2480998322 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee600441d0 con 0x7fee68143640 2021-10-20T23:27:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.314+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee68061990 con 0x7fee68143640 2021-10-20T23:27:58.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.318+0000 7fee57fff700 1 -- 172.21.15.12:0/2480998322 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fee600477f0 con 0x7fee68143640 2021-10-20T23:27:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:58.328 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":121,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:58.045916+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:56.525958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:57.402829+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:58.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee440534f0 msgr2=0x7fee440559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee440534f0 0x7fee440559b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fee5800b000 tx=0x7fee58006df0).stop 2021-10-20T23:27:58.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 msgr2=0x7fee6813d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 0x7fee6813d0c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7fee6813fc30 tx=0x7fee6000b530).stop 2021-10-20T23:27:58.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 shutdown_connections 2021-10-20T23:27:58.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee440534f0 0x7fee440559b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee68143640 0x7fee6813d0c0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee680af2c0 0x7fee6813cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 --2- 172.21.15.12:0/2480998322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee680ad320 0x7fee680a8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 >> 172.21.15.12:0/2480998322 conn(0x7fee68061140 msgr2=0x7fee68142ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:58.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 shutdown_connections 2021-10-20T23:27:58.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.322+0000 7fee6c924700 1 -- 172.21.15.12:0/2480998322 wait complete. 2021-10-20T23:27:58.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:58.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1759e700 1 Processor -- start 2021-10-20T23:27:58.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1759e700 1 -- start start 2021-10-20T23:27:58.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf180b2580 0x7fcf1814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf180a8ac0 0x7fcf1814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180a70c0 con 0x7fcf180b0010 2021-10-20T23:27:58.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf180a72f0 con 0x7fcf180b2580 2021-10-20T23:27:58.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf180a7590 con 0x7fcf180a8ac0 2021-10-20T23:27:58.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf180b2580 0x7fcf1814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf180b2580 0x7fcf1814ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43660/0 (socket says 172.21.15.12:43660) 2021-10-20T23:27:58.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1659c700 1 -- 172.21.15.12:0/3314162840 learned_addr learned my addr 172.21.15.12:0/3314162840 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:58.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf16d9d700 1 --2- 172.21.15.12:0/3314162840 >> v2:172.21.15.31:3300/0 conn(0x7fcf180a8ac0 0x7fcf1814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1659c700 1 -- 172.21.15.12:0/3314162840 >> v2:172.21.15.31:3300/0 conn(0x7fcf180a8ac0 msgr2=0x7fcf1814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1659c700 1 --2- 172.21.15.12:0/3314162840 >> v2:172.21.15.31:3300/0 conn(0x7fcf180a8ac0 0x7fcf1814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1659c700 1 -- 172.21.15.12:0/3314162840 >> v1:172.21.15.31:6789/0 conn(0x7fcf180b0010 legacy=0x7fcf180a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1659c700 1 -- 172.21.15.12:0/3314162840 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180a7830 con 0x7fcf180b2580 2021-10-20T23:27:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1659c700 1 --2- 172.21.15.12:0/3314162840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180b2580 0x7fcf1814ae40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fcf0c002f70 tx=0x7fcf0c006eb0).ready entity=mon.0 client_cookie=4c7f3b41381ab8da server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1559a700 1 -- 172.21.15.12:0/3314162840 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0c00d5c0 con 0x7fcf180b2580 2021-10-20T23:27:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1559a700 1 -- 172.21.15.12:0/3314162840 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c000e90 con 0x7fcf180b2580 2021-10-20T23:27:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.446+0000 7fcf1559a700 1 -- 172.21.15.12:0/3314162840 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0c00d950 con 0x7fcf180b2580 2021-10-20T23:27:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 -- 172.21.15.12:0/3314162840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180b2580 msgr2=0x7fcf1814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 --2- 172.21.15.12:0/3314162840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180b2580 0x7fcf1814ae40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fcf0c002f70 tx=0x7fcf0c006eb0).stop 2021-10-20T23:27:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 -- 172.21.15.12:0/3314162840 shutdown_connections 2021-10-20T23:27:58.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 --2- 172.21.15.12:0/3314162840 >> v2:172.21.15.31:3300/0 conn(0x7fcf180a8ac0 0x7fcf1814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 --2- 172.21.15.12:0/3314162840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180b2580 0x7fcf1814ae40 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 -- 172.21.15.12:0/3314162840 >> 172.21.15.12:0/3314162840 conn(0x7fcf18060180 msgr2=0x7fcf180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:58.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 -- 172.21.15.12:0/3314162840 shutdown_connections 2021-10-20T23:27:58.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 -- 172.21.15.12:0/3314162840 wait complete. 2021-10-20T23:27:58.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 Processor -- start 2021-10-20T23:27:58.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 -- start start 2021-10-20T23:27:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180a8ac0 0x7fcf1815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf180b0010 0x7fcf18156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf180b2580 0x7fcf180ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18145fe0 con 0x7fcf180a8ac0 2021-10-20T23:27:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1811e3a0 con 0x7fcf180b0010 2021-10-20T23:27:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18159ad0 con 0x7fcf180b2580 2021-10-20T23:27:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180a8ac0 0x7fcf1815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180a8ac0 0x7fcf1815a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43664/0 (socket says 172.21.15.12:43664) 2021-10-20T23:27:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf1659c700 1 -- 172.21.15.12:0/4276444011 learned_addr learned my addr 172.21.15.12:0/4276444011 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.450+0000 7fcf15d9b700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf180b0010 0x7fcf18156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf16d9d700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf180b2580 0x7fcf180ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf1659c700 1 -- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf180b2580 msgr2=0x7fcf180ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf1659c700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf180b2580 0x7fcf180ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf1659c700 1 -- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf180b0010 msgr2=0x7fcf18156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf1659c700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf180b0010 0x7fcf18156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf1659c700 1 -- 172.21.15.12:0/4276444011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c00b1e0 con 0x7fcf180a8ac0 2021-10-20T23:27:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf16d9d700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf180b2580 0x7fcf180ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf15d9b700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf180b0010 0x7fcf18156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:27:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf1659c700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180a8ac0 0x7fcf1815a4b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fcf0c002f70 tx=0x7fcf0c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf077fe700 1 -- 172.21.15.12:0/4276444011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0c00d940 con 0x7fcf180a8ac0 2021-10-20T23:27:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf077fe700 1 -- 172.21.15.12:0/4276444011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c011ce0 con 0x7fcf180a8ac0 2021-10-20T23:27:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf18159d70 con 0x7fcf180a8ac0 2021-10-20T23:27:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf077fe700 1 -- 172.21.15.12:0/4276444011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0c01e650 con 0x7fcf180a8ac0 2021-10-20T23:27:58.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf18065110 con 0x7fcf180a8ac0 2021-10-20T23:27:58.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf18057350 con 0x7fcf180a8ac0 2021-10-20T23:27:58.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf077fe700 1 -- 172.21.15.12:0/4276444011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf0c025030 con 0x7fcf180a8ac0 2021-10-20T23:27:58.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf077fe700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcef40534f0 0x7fcef40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf077fe700 1 -- 172.21.15.12:0/4276444011 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcf0c06cc70 con 0x7fcf180a8ac0 2021-10-20T23:27:58.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.454+0000 7fcf15d9b700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcef40534f0 0x7fcef40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.458+0000 7fcf15d9b700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcef40534f0 0x7fcef40559b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fcf0800b000 tx=0x7fcf08009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:58.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.458+0000 7fcf077fe700 1 -- 172.21.15.12:0/4276444011 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf0c043cb0 con 0x7fcf180a8ac0 2021-10-20T23:27:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.586+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf180698e0 con 0x7fcf180a8ac0 2021-10-20T23:27:58.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf077fe700 1 -- 172.21.15.12:0/4276444011 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fcf0c023020 con 0x7fcf180a8ac0 2021-10-20T23:27:58.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":121,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:58.045916+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:56.525958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:57.402829+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcef40534f0 msgr2=0x7fcef40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcef40534f0 0x7fcef40559b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fcf0800b000 tx=0x7fcf08009040).stop 2021-10-20T23:27:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180a8ac0 msgr2=0x7fcf1815a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180a8ac0 0x7fcf1815a4b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fcf0c002f70 tx=0x7fcf0c015000).stop 2021-10-20T23:27:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 shutdown_connections 2021-10-20T23:27:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcef40534f0 0x7fcef40559b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf180b2580 0x7fcf180ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf180b0010 0x7fcf18156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 --2- 172.21.15.12:0/4276444011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf180a8ac0 0x7fcf1815a4b0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 >> 172.21.15.12:0/4276444011 conn(0x7fcf18060180 msgr2=0x7fcf180aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:58.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 shutdown_connections 2021-10-20T23:27:58.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.590+0000 7fcf1759e700 1 -- 172.21.15.12:0/4276444011 wait complete. 2021-10-20T23:27:58.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:27:58.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb2415700 1 Processor -- start 2021-10-20T23:27:58.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb2415700 1 -- start start 2021-10-20T23:27:58.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb2415700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7cac061b80 0x7f7cac1444a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb2415700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac0b4060 0x7f7cac144990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb2415700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac0b1f70 con 0x7f7cac0b6430 2021-10-20T23:27:58.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb2415700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac0b14a0 con 0x7f7cac061b80 2021-10-20T23:27:58.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb2415700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac0b6810 con 0x7f7cac0b4060 2021-10-20T23:27:58.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb1c14700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac0b4060 0x7f7cac144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb0c12700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7cac061b80 0x7f7cac1444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb1c14700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac0b4060 0x7f7cac144990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:49434/0 (socket says 172.21.15.12:49434) 2021-10-20T23:27:58.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb1c14700 1 -- 172.21.15.12:0/210137892 learned_addr learned my addr 172.21.15.12:0/210137892 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:58.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb1c14700 1 -- 172.21.15.12:0/210137892 >> v2:172.21.15.31:3300/0 conn(0x7f7cac061b80 msgr2=0x7f7cac1444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:58.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb1c14700 1 --2- 172.21.15.12:0/210137892 >> v2:172.21.15.31:3300/0 conn(0x7f7cac061b80 0x7f7cac1444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb1c14700 1 -- 172.21.15.12:0/210137892 >> v1:172.21.15.31:6789/0 conn(0x7f7cac0b6430 legacy=0x7f7cac061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb1c14700 1 -- 172.21.15.12:0/210137892 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac148110 con 0x7f7cac0b4060 2021-10-20T23:27:58.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7cb1c14700 1 --2- 172.21.15.12:0/210137892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac0b4060 0x7f7cac144990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7ca40032f0 tx=0x7f7ca4009290).ready entity=mon.2 client_cookie=fd2f4197de3d93c7 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:58.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7ca3fff700 1 -- 172.21.15.12:0/210137892 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca400b8a0 con 0x7f7cac0b4060 2021-10-20T23:27:58.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7ca3fff700 1 -- 172.21.15.12:0/210137892 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca400ba00 con 0x7f7cac0b4060 2021-10-20T23:27:58.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.710+0000 7f7ca3fff700 1 -- 172.21.15.12:0/210137892 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca400bb70 con 0x7f7cac0b4060 2021-10-20T23:27:58.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 -- 172.21.15.12:0/210137892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac0b4060 msgr2=0x7f7cac144990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 --2- 172.21.15.12:0/210137892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac0b4060 0x7f7cac144990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7ca40032f0 tx=0x7f7ca4009290).stop 2021-10-20T23:27:58.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 -- 172.21.15.12:0/210137892 shutdown_connections 2021-10-20T23:27:58.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 --2- 172.21.15.12:0/210137892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac0b4060 0x7f7cac144990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 --2- 172.21.15.12:0/210137892 >> v2:172.21.15.31:3300/0 conn(0x7f7cac061b80 0x7f7cac1444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 -- 172.21.15.12:0/210137892 >> 172.21.15.12:0/210137892 conn(0x7f7cac05c490 msgr2=0x7f7cac05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:58.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 -- 172.21.15.12:0/210137892 shutdown_connections 2021-10-20T23:27:58.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 -- 172.21.15.12:0/210137892 wait complete. 2021-10-20T23:27:58.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 Processor -- start 2021-10-20T23:27:58.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 -- start start 2021-10-20T23:27:58.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac061b80 0x7f7cac0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cac0b4060 0x7f7cac157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cac0b6430 0x7f7cac0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac14ebe0 con 0x7f7cac0b4060 2021-10-20T23:27:58.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac14a8c0 con 0x7f7cac0b6430 2021-10-20T23:27:58.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.714+0000 7f7cb2415700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac1576f0 con 0x7f7cac061b80 2021-10-20T23:27:58.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb0c12700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cac0b4060 0x7f7cac157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb0c12700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cac0b4060 0x7f7cac157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43680/0 (socket says 172.21.15.12:43680) 2021-10-20T23:27:58.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb0c12700 1 -- 172.21.15.12:0/121146344 learned_addr learned my addr 172.21.15.12:0/121146344 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:58.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb1413700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac061b80 0x7f7cac0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb1c14700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cac0b6430 0x7f7cac0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb0c12700 1 -- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac061b80 msgr2=0x7f7cac0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb0c12700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac061b80 0x7f7cac0b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb0c12700 1 -- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cac0b6430 msgr2=0x7f7cac0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:58.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb0c12700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cac0b6430 0x7f7cac0adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:58.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb0c12700 1 -- 172.21.15.12:0/121146344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca4009530 con 0x7f7cac0b4060 2021-10-20T23:27:58.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb0c12700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cac0b4060 0x7f7cac157200 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f7c9c00c000 tx=0x7f7c9c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:58.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7ca27fc700 1 -- 172.21.15.12:0/121146344 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9c010780 con 0x7f7cac0b4060 2021-10-20T23:27:58.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7ca27fc700 1 -- 172.21.15.12:0/121146344 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c0108e0 con 0x7f7cac0b4060 2021-10-20T23:27:58.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac149fd0 con 0x7f7cac0b4060 2021-10-20T23:27:58.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7ca27fc700 1 -- 172.21.15.12:0/121146344 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9c010c40 con 0x7f7cac0b4060 2021-10-20T23:27:58.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac0ada80 con 0x7f7cac0b4060 2021-10-20T23:27:58.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cac0adc40 con 0x7f7cac0b4060 2021-10-20T23:27:58.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7ca27fc700 1 -- 172.21.15.12:0/121146344 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c9c01c460 con 0x7f7cac0b4060 2021-10-20T23:27:58.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7c94053610 0x7f7c94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:58.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.718+0000 7f7ca27fc700 1 -- 172.21.15.12:0/121146344 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7c9c06be60 con 0x7f7cac0b4060 2021-10-20T23:27:58.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.722+0000 7f7cb1413700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7c94053610 0x7f7c94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:58.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.722+0000 7f7cb1413700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7c94053610 0x7f7c94055ad0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f7ca800d000 tx=0x7f7ca8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:58.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.726+0000 7f7ca27fc700 1 -- 172.21.15.12:0/121146344 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c9c042e00 con 0x7f7cac0b4060 2021-10-20T23:27:58.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:58.890+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7cac0b21a0 con 0x7f7cac0b4060 2021-10-20T23:27:59.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.074+0000 7f7ca27fc700 1 -- 172.21.15.12:0/121146344 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7c9c046420 con 0x7f7cac0b4060 2021-10-20T23:27:59.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7c94053610 msgr2=0x7f7c94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7c94053610 0x7f7c94055ad0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f7ca800d000 tx=0x7f7ca8009040).stop 2021-10-20T23:27:59.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cac0b4060 msgr2=0x7f7cac157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cac0b4060 0x7f7cac157200 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f7c9c00c000 tx=0x7f7c9c006df0).stop 2021-10-20T23:27:59.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 shutdown_connections 2021-10-20T23:27:59.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7c94053610 0x7f7c94055ad0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cac0b6430 0x7f7cac0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cac0b4060 0x7f7cac157200 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 --2- 172.21.15.12:0/121146344 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cac061b80 0x7f7cac0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 >> 172.21.15.12:0/121146344 conn(0x7f7cac05c490 msgr2=0x7f7cac061470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:59.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 shutdown_connections 2021-10-20T23:27:59.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.078+0000 7f7cb2415700 1 -- 172.21.15.12:0/121146344 wait complete. 2021-10-20T23:27:59.102 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:27:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b6bfff700 1 Processor -- start 2021-10-20T23:27:59.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b6bfff700 1 -- start start 2021-10-20T23:27:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b6bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 0x7f2b6c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b6bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c0a70c0 con 0x7f2b6c0afbd0 2021-10-20T23:27:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b6bfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c0a72f0 con 0x7f2b6c0b2580 2021-10-20T23:27:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b6bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0a7590 con 0x7f2b6c0b0010 2021-10-20T23:27:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b6b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2b6c0afbd0 0x7f2b6c151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42284/0 (socket says 172.21.15.12:42284) 2021-10-20T23:27:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b6b7fe700 1 -- 172.21.15.12:0/1791398050 learned_addr learned my addr 172.21.15.12:0/1791398050 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:59.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b6a7fc700 1 --2- 172.21.15.12:0/1791398050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 0x7f2b6c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.202+0000 7f2b69ffb700 1 -- 172.21.15.12:0/1791398050 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423331526 0 0) 0x7f2b6c0a70c0 con 0x7f2b6c0afbd0 2021-10-20T23:27:59.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b69ffb700 1 -- 172.21.15.12:0/1791398050 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b4c003260 con 0x7f2b6c0afbd0 2021-10-20T23:27:59.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b69ffb700 1 -- 172.21.15.12:0/1791398050 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917550261 0 0) 0x7f2b6c0a72f0 con 0x7f2b6c0b2580 2021-10-20T23:27:59.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6a7fc700 1 -- 172.21.15.12:0/1791398050 >> v1:172.21.15.31:6789/0 conn(0x7f2b6c0b2580 legacy=0x7f2b6c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6a7fc700 1 -- 172.21.15.12:0/1791398050 >> v1:172.21.15.12:6789/0 conn(0x7f2b6c0afbd0 legacy=0x7f2b6c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6a7fc700 1 -- 172.21.15.12:0/1791398050 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c0a7830 con 0x7f2b6c0b0010 2021-10-20T23:27:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6a7fc700 1 --2- 172.21.15.12:0/1791398050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 0x7f2b6c0a83b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2b5c0032f0 tx=0x7f2b5c0091d0).ready entity=mon.2 client_cookie=2aef85467a704938 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b69ffb700 1 -- 172.21.15.12:0/1791398050 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b5c00b6c0 con 0x7f2b6c0b0010 2021-10-20T23:27:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b69ffb700 1 -- 172.21.15.12:0/1791398050 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c00b820 con 0x7f2b6c0b0010 2021-10-20T23:27:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b69ffb700 1 -- 172.21.15.12:0/1791398050 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b5c00b990 con 0x7f2b6c0b0010 2021-10-20T23:27:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6bfff700 1 -- 172.21.15.12:0/1791398050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 msgr2=0x7f2b6c0a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6bfff700 1 --2- 172.21.15.12:0/1791398050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 0x7f2b6c0a83b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2b5c0032f0 tx=0x7f2b5c0091d0).stop 2021-10-20T23:27:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6bfff700 1 -- 172.21.15.12:0/1791398050 shutdown_connections 2021-10-20T23:27:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6bfff700 1 --2- 172.21.15.12:0/1791398050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 0x7f2b6c0a83b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6bfff700 1 -- 172.21.15.12:0/1791398050 >> 172.21.15.12:0/1791398050 conn(0x7f2b6c060180 msgr2=0x7f2b6c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:59.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6bfff700 1 -- 172.21.15.12:0/1791398050 shutdown_connections 2021-10-20T23:27:59.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.206+0000 7f2b6bfff700 1 -- 172.21.15.12:0/1791398050 wait complete. 2021-10-20T23:27:59.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6bfff700 1 Processor -- start 2021-10-20T23:27:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6bfff700 1 -- start start 2021-10-20T23:27:59.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b6c0afbd0 0x7f2b6c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 0x7f2b6c0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b6c0b2580 0x7f2b6c141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0b5c30 con 0x7f2b6c0b2580 2021-10-20T23:27:59.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0b5e40 con 0x7f2b6c0afbd0 2021-10-20T23:27:59.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0b5050 con 0x7f2b6c0b0010 2021-10-20T23:27:59.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b6c0b2580 0x7f2b6c141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b6c0b2580 0x7f2b6c141430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43696/0 (socket says 172.21.15.12:43696) 2021-10-20T23:27:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6b7fe700 1 -- 172.21.15.12:0/2659859512 learned_addr learned my addr 172.21.15.12:0/2659859512 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6affd700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b6c0afbd0 0x7f2b6c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6a7fc700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 0x7f2b6c0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6b7fe700 1 -- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 msgr2=0x7f2b6c0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6b7fe700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 0x7f2b6c0aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6b7fe700 1 -- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b6c0afbd0 msgr2=0x7f2b6c0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6b7fe700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b6c0afbd0 0x7f2b6c0b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6b7fe700 1 -- 172.21.15.12:0/2659859512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c009470 con 0x7f2b6c0b2580 2021-10-20T23:27:59.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.209+0000 7f2b6b7fe700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b6c0b2580 0x7f2b6c141430 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f2b64001110 tx=0x7f2b64007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:59.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b63fff700 1 -- 172.21.15.12:0/2659859512 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6400ce80 con 0x7f2b6c0b2580 2021-10-20T23:27:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b63fff700 1 -- 172.21.15.12:0/2659859512 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b640070d0 con 0x7f2b6c0b2580 2021-10-20T23:27:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c0b52f0 con 0x7f2b6c0b2580 2021-10-20T23:27:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b63fff700 1 -- 172.21.15.12:0/2659859512 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b64007430 con 0x7f2b6c0b2580 2021-10-20T23:27:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c0b4370 con 0x7f2b6c0b2580 2021-10-20T23:27:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b63fff700 1 -- 172.21.15.12:0/2659859512 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2b6401a060 con 0x7f2b6c0b2580 2021-10-20T23:27:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c0b4e90 con 0x7f2b6c0b2580 2021-10-20T23:27:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b63fff700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b50053610 0x7f2b50055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b63fff700 1 -- 172.21.15.12:0/2659859512 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2b6406b180 con 0x7f2b6c0b2580 2021-10-20T23:27:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b6affd700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b50053610 0x7f2b50055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.213+0000 7f2b6affd700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b50053610 0x7f2b50055ad0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f2b5400d000 tx=0x7f2b54007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:59.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.217+0000 7f2b63fff700 1 -- 172.21.15.12:0/2659859512 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b64042180 con 0x7f2b6c0b2580 2021-10-20T23:27:59.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b6c0b5480 con 0x7f2b6c0b2580 2021-10-20T23:27:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b63fff700 1 -- 172.21.15.12:0/2659859512 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f2b64018070 con 0x7f2b6c0b2580 2021-10-20T23:27:59.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:59.396 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":60,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7593,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/164978387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":164978387},{"type":"v1","addr":"172.21.15.12:6833","nonce":164978387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59},{"gid":7600,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/865815505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":865815505},{"type":"v1","addr":"172.21.15.31:6835","nonce":865815505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:58.046238+0000","modified":"2021-10-20T23:27:59.064679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1094154714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1094154714},{"type":"v1","addr":"172.21.15.12:6835","nonce":1094154714}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-10-20T23:27:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b50053610 msgr2=0x7f2b50055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b50053610 0x7f2b50055ad0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f2b5400d000 tx=0x7f2b54007b70).stop 2021-10-20T23:27:59.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b6c0b2580 msgr2=0x7f2b6c141430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b6c0b2580 0x7f2b6c141430 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f2b64001110 tx=0x7f2b64007a80).stop 2021-10-20T23:27:59.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 shutdown_connections 2021-10-20T23:27:59.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2b50053610 0x7f2b50055ad0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b6c0b2580 0x7f2b6c141430 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b6c0b0010 0x7f2b6c0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 --2- 172.21.15.12:0/2659859512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b6c0afbd0 0x7f2b6c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 >> 172.21.15.12:0/2659859512 conn(0x7f2b6c060180 msgr2=0x7f2b6c149620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:59.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 shutdown_connections 2021-10-20T23:27:59.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.385+0000 7f2b6bfff700 1 -- 172.21.15.12:0/2659859512 wait complete. 2021-10-20T23:27:59.407 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 60 2021-10-20T23:27:59.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:27:59.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.505+0000 7fa20585b700 1 Processor -- start 2021-10-20T23:27:59.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 -- start start 2021-10-20T23:27:59.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2000a9eb0 0x7fa2000b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2000af070 0x7fa200144480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2000aa290 con 0x7fa2000b3130 2021-10-20T23:27:59.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2000ae300 con 0x7fa2000a9eb0 2021-10-20T23:27:59.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa200148170 con 0x7fa2000af070 2021-10-20T23:27:59.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1fe7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa2000b3130 0x7fa20014b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42294/0 (socket says 172.21.15.12:42294) 2021-10-20T23:27:59.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1fe7fc700 1 -- 172.21.15.12:0/4285404023 learned_addr learned my addr 172.21.15.12:0/4285404023 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:27:59.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1feffd700 1 --2- 172.21.15.12:0/4285404023 >> v2:172.21.15.12:3300/0 conn(0x7fa2000a9eb0 0x7fa2000b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1ff7fe700 1 --2- 172.21.15.12:0/4285404023 >> v2:172.21.15.31:3300/0 conn(0x7fa2000af070 0x7fa200144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1fdffb700 1 -- 172.21.15.12:0/4285404023 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545973666 0 0) 0x7fa2000aa290 con 0x7fa2000b3130 2021-10-20T23:27:59.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1fdffb700 1 -- 172.21.15.12:0/4285404023 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e4003260 con 0x7fa2000b3130 2021-10-20T23:27:59.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1feffd700 1 -- 172.21.15.12:0/4285404023 >> v2:172.21.15.31:3300/0 conn(0x7fa2000af070 msgr2=0x7fa200144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:27:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1feffd700 1 --2- 172.21.15.12:0/4285404023 >> v2:172.21.15.31:3300/0 conn(0x7fa2000af070 0x7fa200144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1feffd700 1 -- 172.21.15.12:0/4285404023 >> v1:172.21.15.12:6789/0 conn(0x7fa2000b3130 legacy=0x7fa20014b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1feffd700 1 -- 172.21.15.12:0/4285404023 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200148410 con 0x7fa2000a9eb0 2021-10-20T23:27:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1ff7fe700 1 --2- 172.21.15.12:0/4285404023 >> v2:172.21.15.31:3300/0 conn(0x7fa2000af070 0x7fa200144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:27:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1feffd700 1 --2- 172.21.15.12:0/4285404023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000a9eb0 0x7fa2000b36e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fa1f0002f70 tx=0x7fa1f0006df0).ready entity=mon.0 client_cookie=7449ad54d1005919 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:59.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1fdffb700 1 -- 172.21.15.12:0/4285404023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f000d4f0 con 0x7fa2000a9eb0 2021-10-20T23:27:59.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1fdffb700 1 -- 172.21.15.12:0/4285404023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0000e90 con 0x7fa2000a9eb0 2021-10-20T23:27:59.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa1fdffb700 1 -- 172.21.15.12:0/4285404023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f000d840 con 0x7fa2000a9eb0 2021-10-20T23:27:59.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 -- 172.21.15.12:0/4285404023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000a9eb0 msgr2=0x7fa2000b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 --2- 172.21.15.12:0/4285404023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000a9eb0 0x7fa2000b36e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fa1f0002f70 tx=0x7fa1f0006df0).stop 2021-10-20T23:27:59.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 -- 172.21.15.12:0/4285404023 shutdown_connections 2021-10-20T23:27:59.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 --2- 172.21.15.12:0/4285404023 >> v2:172.21.15.31:3300/0 conn(0x7fa2000af070 0x7fa200144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 --2- 172.21.15.12:0/4285404023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000a9eb0 0x7fa2000b36e0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 -- 172.21.15.12:0/4285404023 >> 172.21.15.12:0/4285404023 conn(0x7fa2000607c0 msgr2=0x7fa200060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:59.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 -- 172.21.15.12:0/4285404023 shutdown_connections 2021-10-20T23:27:59.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.509+0000 7fa20585b700 1 -- 172.21.15.12:0/4285404023 wait complete. 2021-10-20T23:27:59.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 Processor -- start 2021-10-20T23:27:59.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 -- start start 2021-10-20T23:27:59.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2000a9eb0 0x7fa20014d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000af070 0x7fa200140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b3130 0x7fa200140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200149510 con 0x7fa2000af070 2021-10-20T23:27:59.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200143530 con 0x7fa2000a9eb0 2021-10-20T23:27:59.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001437d0 con 0x7fa2000b3130 2021-10-20T23:27:59.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1fe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000af070 0x7fa200140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1fe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000af070 0x7fa200140080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43708/0 (socket says 172.21.15.12:43708) 2021-10-20T23:27:59.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1fe7fc700 1 -- 172.21.15.12:0/2626690420 learned_addr learned my addr 172.21.15.12:0/2626690420 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1feffd700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2000a9eb0 0x7fa20014d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1ff7fe700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b3130 0x7fa200140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1fe7fc700 1 -- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b3130 msgr2=0x7fa200140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1fe7fc700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b3130 0x7fa200140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1fe7fc700 1 -- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2000a9eb0 msgr2=0x7fa20014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1fe7fc700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2000a9eb0 0x7fa20014d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1fe7fc700 1 -- 172.21.15.12:0/2626690420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f800b180 con 0x7fa2000af070 2021-10-20T23:27:59.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1fe7fc700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000af070 0x7fa200140080 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fa1f4001490 tx=0x7fa1f4007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1effff700 1 -- 172.21.15.12:0/2626690420 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f4005ba0 con 0x7fa2000af070 2021-10-20T23:27:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1effff700 1 -- 172.21.15.12:0/2626690420 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f4005d00 con 0x7fa2000af070 2021-10-20T23:27:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f000b180 con 0x7fa2000af070 2021-10-20T23:27:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa1effff700 1 -- 172.21.15.12:0/2626690420 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f40072c0 con 0x7fa2000af070 2021-10-20T23:27:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.513+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa200143d10 con 0x7fa2000af070 2021-10-20T23:27:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.517+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa200143ed0 con 0x7fa2000af070 2021-10-20T23:27:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.517+0000 7fa1effff700 1 -- 172.21.15.12:0/2626690420 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa1f4010070 con 0x7fa2000af070 2021-10-20T23:27:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.517+0000 7fa1effff700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1dc0534f0 0x7fa1dc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.517+0000 7fa1effff700 1 -- 172.21.15.12:0/2626690420 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa1f406b550 con 0x7fa2000af070 2021-10-20T23:27:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.517+0000 7fa1feffd700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1dc0534f0 0x7fa1dc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.517+0000 7fa1feffd700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1dc0534f0 0x7fa1dc0559b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fa1f001a000 tx=0x7fa1f0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.525+0000 7fa1effff700 1 -- 172.21.15.12:0/2626690420 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1f40423c0 con 0x7fa2000af070 2021-10-20T23:27:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.653+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa20014ae20 con 0x7fa2000af070 2021-10-20T23:27:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.653+0000 7fa1effff700 1 -- 172.21.15.12:0/2626690420 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fa1f40459e0 con 0x7fa2000af070 2021-10-20T23:27:59.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:27:59.670 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":122,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:59.064803+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:56.525958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:57.402829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:27:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1dc0534f0 msgr2=0x7fa1dc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1dc0534f0 0x7fa1dc0559b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fa1f001a000 tx=0x7fa1f0014000).stop 2021-10-20T23:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000af070 msgr2=0x7fa200140080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000af070 0x7fa200140080 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fa1f4001490 tx=0x7fa1f4007e50).stop 2021-10-20T23:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 shutdown_connections 2021-10-20T23:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa1dc0534f0 0x7fa1dc0559b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2000b3130 0x7fa200140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2000af070 0x7fa200140080 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 --2- 172.21.15.12:0/2626690420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2000a9eb0 0x7fa20014d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 >> 172.21.15.12:0/2626690420 conn(0x7fa2000607c0 msgr2=0x7fa2000af9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 shutdown_connections 2021-10-20T23:27:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.657+0000 7fa20585b700 1 -- 172.21.15.12:0/2626690420 wait complete. 2021-10-20T23:27:59.679 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:27:59.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.777+0000 7f1d46fa1700 1 Processor -- start 2021-10-20T23:27:59.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.777+0000 7f1d46fa1700 1 -- start start 2021-10-20T23:27:59.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d400b1f10 0x7f1d400b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d400aa390 con 0x7f1d400a9b70 2021-10-20T23:27:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d400ab260 con 0x7f1d400b00c0 2021-10-20T23:27:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d400b04a0 con 0x7f1d400b1f10 2021-10-20T23:27:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d37fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d400b1f10 0x7f1d400b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d37fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d400b1f10 0x7f1d400b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43716/0 (socket says 172.21.15.12:43716) 2021-10-20T23:27:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d37fff700 1 -- 172.21.15.12:0/4000266228 learned_addr learned my addr 172.21.15.12:0/4000266228 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:59.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d37fff700 1 -- 172.21.15.12:0/4000266228 >> v1:172.21.15.31:6789/0 conn(0x7f1d400b00c0 legacy=0x7f1d400aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d37fff700 1 -- 172.21.15.12:0/4000266228 >> v1:172.21.15.12:6789/0 conn(0x7f1d400a9b70 legacy=0x7f1d400b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d37fff700 1 -- 172.21.15.12:0/4000266228 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d400aa0f0 con 0x7f1d400b1f10 2021-10-20T23:27:59.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d37fff700 1 --2- 172.21.15.12:0/4000266228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 0x7f1d400b1920 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f1d30002f70 tx=0x7f1d30006eb0).ready entity=mon.0 client_cookie=baa35af48ac634cf server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:59.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d377fe700 1 -- 172.21.15.12:0/4000266228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3000d660 con 0x7f1d400b1f10 2021-10-20T23:27:59.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d377fe700 1 -- 172.21.15.12:0/4000266228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30000e90 con 0x7f1d400b1f10 2021-10-20T23:27:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d377fe700 1 -- 172.21.15.12:0/4000266228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3000d9f0 con 0x7f1d400b1f10 2021-10-20T23:27:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4000266228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 msgr2=0x7f1d400b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 --2- 172.21.15.12:0/4000266228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 0x7f1d400b1920 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f1d30002f70 tx=0x7f1d30006eb0).stop 2021-10-20T23:27:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4000266228 shutdown_connections 2021-10-20T23:27:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 --2- 172.21.15.12:0/4000266228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 0x7f1d400b1920 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4000266228 >> 172.21.15.12:0/4000266228 conn(0x7f1d400607c0 msgr2=0x7f1d40060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4000266228 shutdown_connections 2021-10-20T23:27:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.781+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4000266228 wait complete. 2021-10-20T23:27:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d46fa1700 1 Processor -- start 2021-10-20T23:27:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d46fa1700 1 -- start start 2021-10-20T23:27:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d46fa1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400a9b70 0x7f1d401331b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d46fa1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d400b00c0 0x7f1d401404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d46fa1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 0x7f1d4013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d46fa1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401409a0 con 0x7f1d400b1f10 2021-10-20T23:27:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d46fa1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40142370 con 0x7f1d400b00c0 2021-10-20T23:27:59.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d46fa1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4013f7d0 con 0x7f1d400a9b70 2021-10-20T23:27:59.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d4553e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 0x7f1d4013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d4553e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 0x7f1d4013fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43724/0 (socket says 172.21.15.12:43724) 2021-10-20T23:27:59.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d4553e700 1 -- 172.21.15.12:0/4260962106 learned_addr learned my addr 172.21.15.12:0/4260962106 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:27:59.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d37fff700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d400b00c0 0x7f1d401404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d44d3d700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400a9b70 0x7f1d401331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d4553e700 1 -- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400a9b70 msgr2=0x7f1d401331b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d4553e700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400a9b70 0x7f1d401331b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d4553e700 1 -- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d400b00c0 msgr2=0x7f1d401404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d4553e700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d400b00c0 0x7f1d401404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.785+0000 7f1d4553e700 1 -- 172.21.15.12:0/4260962106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3000b1e0 con 0x7f1d400b1f10 2021-10-20T23:27:59.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.789+0000 7f1d4553e700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 0x7f1d4013fc00 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f1d400ad9e0 tx=0x7f1d38007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:59.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.789+0000 7f1d35ffb700 1 -- 172.21.15.12:0/4260962106 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3800e4a0 con 0x7f1d400b1f10 2021-10-20T23:27:59.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.789+0000 7f1d35ffb700 1 -- 172.21.15.12:0/4260962106 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3800e600 con 0x7f1d400b1f10 2021-10-20T23:27:59.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.789+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d401425a0 con 0x7f1d400b1f10 2021-10-20T23:27:59.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.789+0000 7f1d35ffb700 1 -- 172.21.15.12:0/4260962106 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3800e960 con 0x7f1d400b1f10 2021-10-20T23:27:59.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.789+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d40141e20 con 0x7f1d400b1f10 2021-10-20T23:27:59.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.789+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4013f910 con 0x7f1d400b1f10 2021-10-20T23:27:59.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.789+0000 7f1d35ffb700 1 -- 172.21.15.12:0/4260962106 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d38019030 con 0x7f1d400b1f10 2021-10-20T23:27:59.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.789+0000 7f1d35ffb700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d200536a0 0x7f1d20055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:27:59.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.793+0000 7f1d35ffb700 1 -- 172.21.15.12:0/4260962106 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1d3806b1f0 con 0x7f1d400b1f10 2021-10-20T23:27:59.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.793+0000 7f1d44d3d700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d200536a0 0x7f1d20055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:27:59.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.793+0000 7f1d44d3d700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d200536a0 0x7f1d20055b60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f1d3c00b000 tx=0x7f1d3c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:27:59.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.797+0000 7f1d35ffb700 1 -- 172.21.15.12:0/4260962106 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d38042190 con 0x7f1d400b1f10 2021-10-20T23:27:59.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.965+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1d40057350 con 0x7f1d400b1f10 2021-10-20T23:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d35ffb700 1 -- 172.21.15.12:0/4260962106 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1d380457b0 con 0x7f1d400b1f10 2021-10-20T23:27:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d200536a0 msgr2=0x7f1d20055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d200536a0 0x7f1d20055b60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f1d3c00b000 tx=0x7f1d3c009040).stop 2021-10-20T23:27:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 msgr2=0x7f1d4013fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:27:59.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 0x7f1d4013fc00 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f1d400ad9e0 tx=0x7f1d38007f40).stop 2021-10-20T23:27:59.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 shutdown_connections 2021-10-20T23:27:59.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d200536a0 0x7f1d20055b60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d400b1f10 0x7f1d4013fc00 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d400b00c0 0x7f1d401404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 --2- 172.21.15.12:0/4260962106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400a9b70 0x7f1d401331b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:27:59.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 >> 172.21.15.12:0/4260962106 conn(0x7f1d400607c0 msgr2=0x7f1d400b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:27:59.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 shutdown_connections 2021-10-20T23:27:59.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:27:59.973+0000 7f1d46fa1700 1 -- 172.21.15.12:0/4260962106 wait complete. 2021-10-20T23:27:59.988 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:27:59.996 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:28:00.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.105+0000 7faa3b59e700 1 Processor -- start 2021-10-20T23:28:00.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.105+0000 7faa3b59e700 1 -- start start 2021-10-20T23:28:00.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.105+0000 7faa3b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa3c0af2c0 0x7faa3c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.105+0000 7faa3b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0ad320 0x7faa3c143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.105+0000 7faa3b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa3c143640 0x7faa3c0a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.105+0000 7faa3b59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3c0afda0 con 0x7faa3c0af2c0 2021-10-20T23:28:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.105+0000 7faa3b59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3c05c610 con 0x7faa3c143640 2021-10-20T23:28:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.105+0000 7faa3b59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c140800 con 0x7faa3c0ad320 2021-10-20T23:28:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.105+0000 7faa3a59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa3c0af2c0 0x7faa3c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3a59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa3c0af2c0 0x7faa3c0af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43728/0 (socket says 172.21.15.12:43728) 2021-10-20T23:28:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3a59c700 1 -- 172.21.15.12:0/2151955606 learned_addr learned my addr 172.21.15.12:0/2151955606 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3ad9d700 1 --2- 172.21.15.12:0/2151955606 >> v2:172.21.15.31:3300/0 conn(0x7faa3c143640 0x7faa3c0a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa39d9b700 1 --2- 172.21.15.12:0/2151955606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0ad320 0x7faa3c143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3a59c700 1 -- 172.21.15.12:0/2151955606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0ad320 msgr2=0x7faa3c143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3a59c700 1 --2- 172.21.15.12:0/2151955606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0ad320 0x7faa3c143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3a59c700 1 -- 172.21.15.12:0/2151955606 >> v2:172.21.15.31:3300/0 conn(0x7faa3c143640 msgr2=0x7faa3c0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3a59c700 1 --2- 172.21.15.12:0/2151955606 >> v2:172.21.15.31:3300/0 conn(0x7faa3c143640 0x7faa3c0a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3a59c700 1 -- 172.21.15.12:0/2151955606 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c0ad850 con 0x7faa3c0af2c0 2021-10-20T23:28:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3a59c700 1 --2- 172.21.15.12:0/2151955606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0af2c0 0x7faa3c0af6a0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7faa3c13fc30 tx=0x7faa2c006eb0).ready entity=mon.0 client_cookie=d5c2ccf979365860 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3959a700 1 -- 172.21.15.12:0/2151955606 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c00e610 con 0x7faa3c0af2c0 2021-10-20T23:28:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3959a700 1 -- 172.21.15.12:0/2151955606 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c000e90 con 0x7faa3c0af2c0 2021-10-20T23:28:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3959a700 1 -- 172.21.15.12:0/2151955606 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c00e9a0 con 0x7faa3c0af2c0 2021-10-20T23:28:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 -- 172.21.15.12:0/2151955606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0af2c0 msgr2=0x7faa3c0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 --2- 172.21.15.12:0/2151955606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0af2c0 0x7faa3c0af6a0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7faa3c13fc30 tx=0x7faa2c006eb0).stop 2021-10-20T23:28:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 -- 172.21.15.12:0/2151955606 shutdown_connections 2021-10-20T23:28:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 --2- 172.21.15.12:0/2151955606 >> v2:172.21.15.31:3300/0 conn(0x7faa3c143640 0x7faa3c0a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 --2- 172.21.15.12:0/2151955606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0ad320 0x7faa3c143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 --2- 172.21.15.12:0/2151955606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0af2c0 0x7faa3c0af6a0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 -- 172.21.15.12:0/2151955606 >> 172.21.15.12:0/2151955606 conn(0x7faa3c061140 msgr2=0x7faa3c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 -- 172.21.15.12:0/2151955606 shutdown_connections 2021-10-20T23:28:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 -- 172.21.15.12:0/2151955606 wait complete. 2021-10-20T23:28:00.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 Processor -- start 2021-10-20T23:28:00.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.109+0000 7faa3b59e700 1 -- start start 2021-10-20T23:28:00.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0ad320 0x7faa3c0a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0af2c0 0x7faa3c063a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c143640 0x7faa3c065340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c064b00 con 0x7faa3c0ad320 2021-10-20T23:28:00.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c0aa760 con 0x7faa3c143640 2021-10-20T23:28:00.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3b59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c0aaa00 con 0x7faa3c0af2c0 2021-10-20T23:28:00.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0ad320 0x7faa3c0a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0ad320 0x7faa3c0a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43734/0 (socket says 172.21.15.12:43734) 2021-10-20T23:28:00.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3a59c700 1 -- 172.21.15.12:0/1475231390 learned_addr learned my addr 172.21.15.12:0/1475231390 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:00.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa39d9b700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0af2c0 0x7faa3c063a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3ad9d700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c143640 0x7faa3c065340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3a59c700 1 -- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0af2c0 msgr2=0x7faa3c063a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3a59c700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0af2c0 0x7faa3c063a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3a59c700 1 -- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c143640 msgr2=0x7faa3c065340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3a59c700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c143640 0x7faa3c065340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3a59c700 1 -- 172.21.15.12:0/1475231390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c00b1e0 con 0x7faa3c0ad320 2021-10-20T23:28:00.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3a59c700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0ad320 0x7faa3c0a9ff0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7faa3c13fc30 tx=0x7faa2c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:00.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa2b7fe700 1 -- 172.21.15.12:0/1475231390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c011760 con 0x7faa3c0ad320 2021-10-20T23:28:00.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa2b7fe700 1 -- 172.21.15.12:0/1475231390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c0118c0 con 0x7faa3c0ad320 2021-10-20T23:28:00.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3c0ab6b0 con 0x7faa3c0ad320 2021-10-20T23:28:00.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa2b7fe700 1 -- 172.21.15.12:0/1475231390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c011c20 con 0x7faa3c0ad320 2021-10-20T23:28:00.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.113+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3c0aaff0 con 0x7faa3c0ad320 2021-10-20T23:28:00.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.117+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3c0aabc0 con 0x7faa3c0ad320 2021-10-20T23:28:00.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.117+0000 7faa2b7fe700 1 -- 172.21.15.12:0/1475231390 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa2c01a040 con 0x7faa3c0ad320 2021-10-20T23:28:00.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.117+0000 7faa2b7fe700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa18053580 0x7faa18055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.117+0000 7faa2b7fe700 1 -- 172.21.15.12:0/1475231390 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7faa2c06c8a0 con 0x7faa3c0ad320 2021-10-20T23:28:00.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.117+0000 7faa39d9b700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa18053580 0x7faa18055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.117+0000 7faa39d9b700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa18053580 0x7faa18055a40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7faa3000b000 tx=0x7faa30006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:00.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.121+0000 7faa2b7fe700 1 -- 172.21.15.12:0/1475231390 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa2c043920 con 0x7faa3c0ad320 2021-10-20T23:28:00.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.293+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7faa3c057350 con 0x7faa3c0ad320 2021-10-20T23:28:00.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.301+0000 7faa2b7fe700 1 -- 172.21.15.12:0/1475231390 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7faa2c0230e0 con 0x7faa3c0ad320 2021-10-20T23:28:00.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.301+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa18053580 msgr2=0x7faa18055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.301+0000 7faa3b59e700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa18053580 0x7faa18055a40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7faa3000b000 tx=0x7faa30006df0).stop 2021-10-20T23:28:00.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.301+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0ad320 msgr2=0x7faa3c0a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.301+0000 7faa3b59e700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0ad320 0x7faa3c0a9ff0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7faa3c13fc30 tx=0x7faa2c015000).stop 2021-10-20T23:28:00.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.301+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 shutdown_connections 2021-10-20T23:28:00.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.301+0000 7faa3b59e700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa18053580 0x7faa18055a40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.301+0000 7faa3b59e700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c143640 0x7faa3c065340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.305+0000 7faa3b59e700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3c0af2c0 0x7faa3c063a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.305+0000 7faa3b59e700 1 --2- 172.21.15.12:0/1475231390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa3c0ad320 0x7faa3c0a9ff0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.305+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 >> 172.21.15.12:0/1475231390 conn(0x7faa3c061140 msgr2=0x7faa3c0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:00.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.305+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 shutdown_connections 2021-10-20T23:28:00.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.305+0000 7faa3b59e700 1 -- 172.21.15.12:0/1475231390 wait complete. 2021-10-20T23:28:00.316 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:28:00.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 Processor -- start 2021-10-20T23:28:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 -- start start 2021-10-20T23:28:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf900b6580 0x7fbf900b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf900b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf901440b0 con 0x7fbf90061d30 2021-10-20T23:28:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf900b6e50 con 0x7fbf900b6580 2021-10-20T23:28:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf90143b70 con 0x7fbf900b43c0 2021-10-20T23:28:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8f59e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbf90061d30 0x7fbf901466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42340/0 (socket says 172.21.15.12:42340) 2021-10-20T23:28:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8f59e700 1 -- 172.21.15.12:0/863676188 learned_addr learned my addr 172.21.15.12:0/863676188 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8e59c700 1 --2- 172.21.15.12:0/863676188 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf900b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8ed9d700 1 --2- 172.21.15.12:0/863676188 >> v2:172.21.15.31:3300/0 conn(0x7fbf900b6580 0x7fbf900b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8dd9b700 1 -- 172.21.15.12:0/863676188 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895704411 0 0) 0x7fbf901440b0 con 0x7fbf90061d30 2021-10-20T23:28:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8dd9b700 1 -- 172.21.15.12:0/863676188 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf74003260 con 0x7fbf90061d30 2021-10-20T23:28:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8e59c700 1 -- 172.21.15.12:0/863676188 >> v2:172.21.15.31:3300/0 conn(0x7fbf900b6580 msgr2=0x7fbf900b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8e59c700 1 --2- 172.21.15.12:0/863676188 >> v2:172.21.15.31:3300/0 conn(0x7fbf900b6580 0x7fbf900b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8e59c700 1 -- 172.21.15.12:0/863676188 >> v1:172.21.15.12:6789/0 conn(0x7fbf90061d30 legacy=0x7fbf901466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8dd9b700 1 -- 172.21.15.12:0/863676188 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2095970624 0 0) 0x7fbf74003260 con 0x7fbf90061d30 2021-10-20T23:28:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8e59c700 1 -- 172.21.15.12:0/863676188 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf90143e10 con 0x7fbf900b43c0 2021-10-20T23:28:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8e59c700 1 --2- 172.21.15.12:0/863676188 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf900b6960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fbf88001b80 tx=0x7fbf80006df0).ready entity=mon.2 client_cookie=d367298ae6178c9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8dd9b700 1 -- 172.21.15.12:0/863676188 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf880019e0 con 0x7fbf900b43c0 2021-10-20T23:28:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8dd9b700 1 -- 172.21.15.12:0/863676188 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf80000e90 con 0x7fbf900b43c0 2021-10-20T23:28:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf8dd9b700 1 -- 172.21.15.12:0/863676188 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf80012460 con 0x7fbf900b43c0 2021-10-20T23:28:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 -- 172.21.15.12:0/863676188 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 msgr2=0x7fbf900b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 --2- 172.21.15.12:0/863676188 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf900b6960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fbf88001b80 tx=0x7fbf80006df0).stop 2021-10-20T23:28:00.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 -- 172.21.15.12:0/863676188 shutdown_connections 2021-10-20T23:28:00.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 --2- 172.21.15.12:0/863676188 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf900b6960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 --2- 172.21.15.12:0/863676188 >> v2:172.21.15.31:3300/0 conn(0x7fbf900b6580 0x7fbf900b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 -- 172.21.15.12:0/863676188 >> 172.21.15.12:0/863676188 conn(0x7fbf9005c490 msgr2=0x7fbf9005c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 -- 172.21.15.12:0/863676188 shutdown_connections 2021-10-20T23:28:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.417+0000 7fbf950ee700 1 -- 172.21.15.12:0/863676188 wait complete. 2021-10-20T23:28:00.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 Processor -- start 2021-10-20T23:28:00.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 -- start start 2021-10-20T23:28:00.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf90061d30 0x7fbf9013c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf901520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf900b6580 0x7fbf9013b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9013fa30 con 0x7fbf900b6580 2021-10-20T23:28:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf90140200 con 0x7fbf90061d30 2021-10-20T23:28:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf901407a0 con 0x7fbf900b43c0 2021-10-20T23:28:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf900b6580 0x7fbf9013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf900b6580 0x7fbf9013b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43752/0 (socket says 172.21.15.12:43752) 2021-10-20T23:28:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8f59e700 1 -- 172.21.15.12:0/1610322548 learned_addr learned my addr 172.21.15.12:0/1610322548 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8e59c700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf901520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8ed9d700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf90061d30 0x7fbf9013c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8f59e700 1 -- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 msgr2=0x7fbf901520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8f59e700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf901520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8f59e700 1 -- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf90061d30 msgr2=0x7fbf9013c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8f59e700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf90061d30 0x7fbf9013c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8f59e700 1 -- 172.21.15.12:0/1610322548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8000b180 con 0x7fbf900b6580 2021-10-20T23:28:00.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8e59c700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf901520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:00.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf8f59e700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf900b6580 0x7fbf9013b760 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fbf88001c40 tx=0x7fbf880021a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:00.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf7ffff700 1 -- 172.21.15.12:0/1610322548 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf88004ab0 con 0x7fbf900b6580 2021-10-20T23:28:00.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf7ffff700 1 -- 172.21.15.12:0/1610322548 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf88004c10 con 0x7fbf900b6580 2021-10-20T23:28:00.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf900b3750 con 0x7fbf900b6580 2021-10-20T23:28:00.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf7ffff700 1 -- 172.21.15.12:0/1610322548 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf88007170 con 0x7fbf900b6580 2021-10-20T23:28:00.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.421+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf901525a0 con 0x7fbf900b6580 2021-10-20T23:28:00.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.425+0000 7fbf7ffff700 1 -- 172.21.15.12:0/1610322548 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf8801b060 con 0x7fbf900b6580 2021-10-20T23:28:00.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.425+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf90140960 con 0x7fbf900b6580 2021-10-20T23:28:00.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.425+0000 7fbf7ffff700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf6c0535b0 0x7fbf6c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:00.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.425+0000 7fbf7ffff700 1 -- 172.21.15.12:0/1610322548 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbf8806b880 con 0x7fbf900b6580 2021-10-20T23:28:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.425+0000 7fbf8ed9d700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf6c0535b0 0x7fbf6c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.425+0000 7fbf8ed9d700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf6c0535b0 0x7fbf6c055a70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fbf8400b000 tx=0x7fbf84008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.429+0000 7fbf7ffff700 1 -- 172.21.15.12:0/1610322548 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf88042880 con 0x7fbf900b6580 2021-10-20T23:28:00.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.601+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf9013fc10 con 0x7fbf900b6580 2021-10-20T23:28:00.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf7ffff700 1 -- 172.21.15.12:0/1610322548 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2489 (secure 0 0 0) 0x7fbf88019070 con 0x7fbf900b6580 2021-10-20T23:28:00.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:00.614 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":60,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7593,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/164978387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":164978387},{"type":"v1","addr":"172.21.15.12:6833","nonce":164978387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59},{"gid":7600,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/865815505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":865815505},{"type":"v1","addr":"172.21.15.31:6835","nonce":865815505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:58.046238+0000","modified":"2021-10-20T23:27:59.064679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1094154714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1094154714},{"type":"v1","addr":"172.21.15.12:6835","nonce":1094154714}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-10-20T23:28:00.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf6c0535b0 msgr2=0x7fbf6c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf6c0535b0 0x7fbf6c055a70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fbf8400b000 tx=0x7fbf84008040).stop 2021-10-20T23:28:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf900b6580 msgr2=0x7fbf9013b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf900b6580 0x7fbf9013b760 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fbf88001c40 tx=0x7fbf880021a0).stop 2021-10-20T23:28:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 shutdown_connections 2021-10-20T23:28:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf6c0535b0 0x7fbf6c055a70 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf900b6580 0x7fbf9013b760 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf900b43c0 0x7fbf901520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 --2- 172.21.15.12:0/1610322548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf90061d30 0x7fbf9013c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:00.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 >> 172.21.15.12:0/1610322548 conn(0x7fbf9005c490 msgr2=0x7fbf901287f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:00.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 shutdown_connections 2021-10-20T23:28:00.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:00.605+0000 7fbf950ee700 1 -- 172.21.15.12:0/1610322548 wait complete. 2021-10-20T23:28:00.619 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 60 2021-10-20T23:28:00.929 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:27:58.046238+0000', 'modified': '2021-10-20T23:27:59.064679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7605}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7605': {'gid': 7605, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1094154714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1094154714}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1094154714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:28:00.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:28:00.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:28:01.050 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":7605,"want_state":"up:active","state":"up:active","rank_uptime":2.9833633850000001,"mdsmap_epoch":60,"osdmap_epoch":122,"osdmap_epoch_barrier":121,"uptime":7.2817660990000004} 2021-10-20T23:28:01.050 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 7605, "mdsmap_epoch": 60, "osdmap_epoch": 122, "osdmap_epoch_barrier": 121, "rank_uptime": 2.983363385, "state": "up:active", "uptime": 7.281766099, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:28:01.051 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:28:01.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.149+0000 7f1ba2844700 1 Processor -- start 2021-10-20T23:28:01.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.149+0000 7f1ba2844700 1 -- start start 2021-10-20T23:28:01.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.149+0000 7f1ba2844700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b9c0b0880 0x7f1b9c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.149+0000 7f1ba2844700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c0b2af0 con 0x7f1b9c0aa120 2021-10-20T23:28:01.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.149+0000 7f1ba2844700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c0b2770 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.149+0000 7f1ba2844700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c0b2d20 con 0x7f1b9c0b0880 2021-10-20T23:28:01.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.149+0000 7f1b9b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1b9c0aa120 0x7f1b9c0ae440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42352/0 (socket says 172.21.15.12:42352) 2021-10-20T23:28:01.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.149+0000 7f1b9b7fe700 1 -- 172.21.15.12:0/1465313527 learned_addr learned my addr 172.21.15.12:0/1465313527 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:01.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.149+0000 7f1ba0de1700 1 --2- 172.21.15.12:0/1465313527 >> v2:172.21.15.31:3300/0 conn(0x7f1b9c0b0880 0x7f1b9c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1b9affd700 1 -- 172.21.15.12:0/1465313527 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922261470 0 0) 0x7f1b9c0b2af0 con 0x7f1b9c0aa120 2021-10-20T23:28:01.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1b9affd700 1 -- 172.21.15.12:0/1465313527 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b88003260 con 0x7f1b9c0aa120 2021-10-20T23:28:01.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba0de1700 1 -- 172.21.15.12:0/1465313527 >> v1:172.21.15.31:6789/0 conn(0x7f1b9c0b04a0 legacy=0x7f1b9c0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba0de1700 1 -- 172.21.15.12:0/1465313527 >> v1:172.21.15.12:6789/0 conn(0x7f1b9c0aa120 legacy=0x7f1b9c0ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba0de1700 1 -- 172.21.15.12:0/1465313527 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0a9b70 con 0x7f1b9c0b0880 2021-10-20T23:28:01.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba0de1700 1 --2- 172.21.15.12:0/1465313527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9c0b0880 0x7f1b9c14ac60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f1b9c0ad3d0 tx=0x7f1b940091d0).ready entity=mon.1 client_cookie=e05a117770fca9a9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1b9affd700 1 -- 172.21.15.12:0/1465313527 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b9400b680 con 0x7f1b9c0b0880 2021-10-20T23:28:01.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1b9affd700 1 -- 172.21.15.12:0/1465313527 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9400b7e0 con 0x7f1b9c0b0880 2021-10-20T23:28:01.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1b9affd700 1 -- 172.21.15.12:0/1465313527 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b9400b950 con 0x7f1b9c0b0880 2021-10-20T23:28:01.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba2844700 1 -- 172.21.15.12:0/1465313527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9c0b0880 msgr2=0x7f1b9c14ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba2844700 1 --2- 172.21.15.12:0/1465313527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9c0b0880 0x7f1b9c14ac60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f1b9c0ad3d0 tx=0x7f1b940091d0).stop 2021-10-20T23:28:01.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba2844700 1 -- 172.21.15.12:0/1465313527 shutdown_connections 2021-10-20T23:28:01.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba2844700 1 --2- 172.21.15.12:0/1465313527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9c0b0880 0x7f1b9c14ac60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba2844700 1 -- 172.21.15.12:0/1465313527 >> 172.21.15.12:0/1465313527 conn(0x7f1b9c0607c0 msgr2=0x7f1b9c060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:01.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba2844700 1 -- 172.21.15.12:0/1465313527 shutdown_connections 2021-10-20T23:28:01.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.153+0000 7f1ba2844700 1 -- 172.21.15.12:0/1465313527 wait complete. 2021-10-20T23:28:01.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba2844700 1 Processor -- start 2021-10-20T23:28:01.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba2844700 1 -- start start 2021-10-20T23:28:01.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba2844700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b9c0aa120 0x7f1b9c05f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba2844700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9c0b04a0 0x7f1b9c13f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba2844700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9c0b0880 0x7f1b9c144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba2844700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0658e0 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba2844700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0a97e0 con 0x7f1b9c0b0880 2021-10-20T23:28:01.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba2844700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c150420 con 0x7f1b9c0aa120 2021-10-20T23:28:01.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9c0b04a0 0x7f1b9c13f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9c0b04a0 0x7f1b9c13f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43764/0 (socket says 172.21.15.12:43764) 2021-10-20T23:28:01.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9b7fe700 1 -- 172.21.15.12:0/2998613596 learned_addr learned my addr 172.21.15.12:0/2998613596 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:01.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9bfff700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b9c0aa120 0x7f1b9c05f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba0de1700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9c0b0880 0x7f1b9c144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9b7fe700 1 -- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b9c0aa120 msgr2=0x7f1b9c05f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9b7fe700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b9c0aa120 0x7f1b9c05f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9b7fe700 1 -- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9c0b0880 msgr2=0x7f1b9c144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9b7fe700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9c0b0880 0x7f1b9c144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9b7fe700 1 -- 172.21.15.12:0/2998613596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94009470 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b9b7fe700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9c0b04a0 0x7f1b9c13f590 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f1b9c1527a0 tx=0x7f1b90007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b997fa700 1 -- 172.21.15.12:0/2998613596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b9000cea0 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1b997fa700 1 -- 172.21.15.12:0/2998613596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900070d0 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.157+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c143070 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.161+0000 7f1b997fa700 1 -- 172.21.15.12:0/2998613596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b90007430 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.161+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c153290 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.161+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c057350 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.161+0000 7f1b997fa700 1 -- 172.21.15.12:0/2998613596 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1b90010070 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.161+0000 7f1b997fa700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b7c053610 0x7f1b7c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.161+0000 7f1b997fa700 1 -- 172.21.15.12:0/2998613596 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1b9006b1a0 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.161+0000 7f1b9bfff700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b7c053610 0x7f1b7c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.161+0000 7f1b9bfff700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b7c053610 0x7f1b7c055ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f1b8c00d000 tx=0x7f1b8c007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.169+0000 7f1b997fa700 1 -- 172.21.15.12:0/2998613596 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1b900420a0 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.301+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b9c0ae200 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.301+0000 7f1b997fa700 1 -- 172.21.15.12:0/2998613596 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f1b900456c0 con 0x7f1b9c0b04a0 2021-10-20T23:28:01.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:01.313 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":122,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:59.064803+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:56.525958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:57.402829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:28:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b7c053610 msgr2=0x7f1b7c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b7c053610 0x7f1b7c055ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f1b8c00d000 tx=0x7f1b8c007b90).stop 2021-10-20T23:28:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9c0b04a0 msgr2=0x7f1b9c13f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9c0b04a0 0x7f1b9c13f590 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f1b9c1527a0 tx=0x7f1b90007aa0).stop 2021-10-20T23:28:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 shutdown_connections 2021-10-20T23:28:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b7c053610 0x7f1b7c055ad0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b9c0b0880 0x7f1b9c144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9c0b04a0 0x7f1b9c13f590 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 --2- 172.21.15.12:0/2998613596 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b9c0aa120 0x7f1b9c05f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 >> 172.21.15.12:0/2998613596 conn(0x7f1b9c0607c0 msgr2=0x7f1b9c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:01.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 shutdown_connections 2021-10-20T23:28:01.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.305+0000 7f1ba2844700 1 -- 172.21.15.12:0/2998613596 wait complete. 2021-10-20T23:28:01.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:27:56.525958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:27:57.402829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:28:01.331 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:28:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53d04cf700 1 Processor -- start 2021-10-20T23:28:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53d04cf700 1 -- start start 2021-10-20T23:28:01.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53d04cf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f53c80b4180 0x7f53c8140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53d04cf700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53c80b4690 0x7f53c80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53d04cf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c8143b60 con 0x7f53c8146950 2021-10-20T23:28:01.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53d04cf700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c8147510 con 0x7f53c80b4690 2021-10-20T23:28:01.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53d04cf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c8143e00 con 0x7f53c80b4180 2021-10-20T23:28:01.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cea6c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53c80b4690 0x7f53c80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cea6c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53c80b4690 0x7f53c80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43774/0 (socket says 172.21.15.12:43774) 2021-10-20T23:28:01.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cda6a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f53c80b4180 0x7f53c8140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cea6c700 1 -- 172.21.15.12:0/2849233995 learned_addr learned my addr 172.21.15.12:0/2849233995 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:01.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cea6c700 1 -- 172.21.15.12:0/2849233995 >> v2:172.21.15.31:3300/0 conn(0x7f53c80b4180 msgr2=0x7f53c8140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:01.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cea6c700 1 --2- 172.21.15.12:0/2849233995 >> v2:172.21.15.31:3300/0 conn(0x7f53c80b4180 0x7f53c8140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cea6c700 1 -- 172.21.15.12:0/2849233995 >> v1:172.21.15.31:6789/0 conn(0x7f53c8146950 legacy=0x7f53c8140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cea6c700 1 -- 172.21.15.12:0/2849233995 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80b0c90 con 0x7f53c80b4690 2021-10-20T23:28:01.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cea6c700 1 --2- 172.21.15.12:0/2849233995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80b4690 0x7f53c80b4ed0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f53c00032f0 tx=0x7f53c0009290).ready entity=mon.0 client_cookie=1ddafde4b139f379 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cd269700 1 -- 172.21.15.12:0/2849233995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c000b870 con 0x7f53c80b4690 2021-10-20T23:28:01.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cd269700 1 -- 172.21.15.12:0/2849233995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c000b9d0 con 0x7f53c80b4690 2021-10-20T23:28:01.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53cd269700 1 -- 172.21.15.12:0/2849233995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c000bb40 con 0x7f53c80b4690 2021-10-20T23:28:01.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53d04cf700 1 -- 172.21.15.12:0/2849233995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80b4690 msgr2=0x7f53c80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.429+0000 7f53d04cf700 1 --2- 172.21.15.12:0/2849233995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80b4690 0x7f53c80b4ed0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f53c00032f0 tx=0x7f53c0009290).stop 2021-10-20T23:28:01.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 -- 172.21.15.12:0/2849233995 shutdown_connections 2021-10-20T23:28:01.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 --2- 172.21.15.12:0/2849233995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80b4690 0x7f53c80b4ed0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 --2- 172.21.15.12:0/2849233995 >> v2:172.21.15.31:3300/0 conn(0x7f53c80b4180 0x7f53c8140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 -- 172.21.15.12:0/2849233995 >> 172.21.15.12:0/2849233995 conn(0x7f53c805c490 msgr2=0x7f53c805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:01.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 -- 172.21.15.12:0/2849233995 shutdown_connections 2021-10-20T23:28:01.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 -- 172.21.15.12:0/2849233995 wait complete. 2021-10-20T23:28:01.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 Processor -- start 2021-10-20T23:28:01.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 -- start start 2021-10-20T23:28:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80b4180 0x7f53c8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c80b4690 0x7f53c81561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.433+0000 7f53d04cf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c8146950 0x7f53c80af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53d04cf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80aeb10 con 0x7f53c8146950 2021-10-20T23:28:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53d04cf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80ae870 con 0x7f53c80b4690 2021-10-20T23:28:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cea6c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c8146950 0x7f53c80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53d04cf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80aeff0 con 0x7f53c80b4180 2021-10-20T23:28:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cea6c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c8146950 0x7f53c80af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43780/0 (socket says 172.21.15.12:43780) 2021-10-20T23:28:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cea6c700 1 -- 172.21.15.12:0/2277159337 learned_addr learned my addr 172.21.15.12:0/2277159337 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:01.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cda6a700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c80b4690 0x7f53c81561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53ce26b700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80b4180 0x7f53c8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cea6c700 1 -- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80b4180 msgr2=0x7f53c8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cea6c700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80b4180 0x7f53c8155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cea6c700 1 -- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c80b4690 msgr2=0x7f53c81561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cea6c700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c80b4690 0x7f53c81561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cea6c700 1 -- 172.21.15.12:0/2277159337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0009530 con 0x7f53c8146950 2021-10-20T23:28:01.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53cea6c700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c8146950 0x7f53c80af730 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f53c00032f0 tx=0x7f53c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53b77fe700 1 -- 172.21.15.12:0/2277159337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c000b870 con 0x7f53c8146950 2021-10-20T23:28:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53b77fe700 1 -- 172.21.15.12:0/2277159337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0021440 con 0x7f53c8146950 2021-10-20T23:28:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c80af290 con 0x7f53c8146950 2021-10-20T23:28:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53b77fe700 1 -- 172.21.15.12:0/2277159337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c00217a0 con 0x7f53c8146950 2021-10-20T23:28:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c80ae3f0 con 0x7f53c8146950 2021-10-20T23:28:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c80af420 con 0x7f53c8146950 2021-10-20T23:28:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53b77fe700 1 -- 172.21.15.12:0/2277159337 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f53c0027020 con 0x7f53c8146950 2021-10-20T23:28:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53b77fe700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53a80535b0 0x7f53a8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.437+0000 7f53b77fe700 1 -- 172.21.15.12:0/2277159337 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f53c006cfb0 con 0x7f53c8146950 2021-10-20T23:28:01.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.441+0000 7f53ce26b700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53a80535b0 0x7f53a8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.441+0000 7f53ce26b700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53a80535b0 0x7f53a8055a70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f53c400d000 tx=0x7f53c4000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.445+0000 7f53b77fe700 1 -- 172.21.15.12:0/2277159337 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f53c0043f10 con 0x7f53c8146950 2021-10-20T23:28:01.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.573+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f53c8057350 con 0x7f53c8146950 2021-10-20T23:28:01.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.573+0000 7f53b77fe700 1 -- 172.21.15.12:0/2277159337 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v122) v1 ==== 110+0+10 (secure 0 0 0) 0x7f53c0015070 con 0x7f53c8146950 2021-10-20T23:28:01.585 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:28:01.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53a80535b0 msgr2=0x7f53a8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53a80535b0 0x7f53a8055a70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f53c400d000 tx=0x7f53c4000bc0).stop 2021-10-20T23:28:01.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c8146950 msgr2=0x7f53c80af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c8146950 0x7f53c80af730 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f53c00032f0 tx=0x7f53c0016000).stop 2021-10-20T23:28:01.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 shutdown_connections 2021-10-20T23:28:01.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f53a80535b0 0x7f53a8055a70 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c8146950 0x7f53c80af730 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c80b4690 0x7f53c81561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 --2- 172.21.15.12:0/2277159337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80b4180 0x7f53c8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 >> 172.21.15.12:0/2277159337 conn(0x7f53c805c490 msgr2=0x7f53c813b320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:01.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 shutdown_connections 2021-10-20T23:28:01.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.577+0000 7f53d04cf700 1 -- 172.21.15.12:0/2277159337 wait complete. 2021-10-20T23:28:01.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:28:01.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.701+0000 7f358e7e9700 1 Processor -- start 2021-10-20T23:28:01.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.701+0000 7f358e7e9700 1 -- start start 2021-10-20T23:28:01.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358e7e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35880b10f0 0x7f358813f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358e7e9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358813f880 con 0x7f358805c7d0 2021-10-20T23:28:01.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358e7e9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35880b1540 con 0x7f358805d0b0 2021-10-20T23:28:01.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358e7e9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35880ad540 con 0x7f35880b10f0 2021-10-20T23:28:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358d7e7700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f358805c7d0 0x7f35880ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42380/0 (socket says 172.21.15.12:42380) 2021-10-20T23:28:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358d7e7700 1 -- 172.21.15.12:0/1680097892 learned_addr learned my addr 172.21.15.12:0/1680097892 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358dfe8700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35880b10f0 0x7f358813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477060958 0 0) 0x7f3578001110 con 0x7f358805c7d0 2021-10-20T23:28:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3570003260 con 0x7f358805c7d0 2021-10-20T23:28:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129900624 0 0) 0x7f35880b1540 con 0x7f358805d0b0 2021-10-20T23:28:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3578001110 con 0x7f358805d0b0 2021-10-20T23:28:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3414573151 0 0) 0x7f3570003260 con 0x7f358805c7d0 2021-10-20T23:28:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35880b10f0 msgr2=0x7f358813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35880b10f0 0x7f358813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 >> v1:172.21.15.31:6789/0 conn(0x7f358805d0b0 legacy=0x7f35880aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358805cbb0 con 0x7f358805c7d0 2021-10-20T23:28:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f35780017f0 con 0x7f358805c7d0 2021-10-20T23:28:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 >> v1:172.21.15.12:6789/0 conn(0x7f358805c7d0 legacy=0x7f35880ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35880b10f0 0x7f3570003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3570003e20 0x7f3570004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35700049f0 0x7f3570004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35880ad540 con 0x7f35700049f0 2021-10-20T23:28:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357000da10 con 0x7f3570003e20 2021-10-20T23:28:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357000dbd0 con 0x7f35880b10f0 2021-10-20T23:28:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358dfe8700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35700049f0 0x7f3570004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358d7e7700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35880b10f0 0x7f3570003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358cfe6700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3570003e20 0x7f3570004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358dfe8700 1 -- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35880b10f0 msgr2=0x7f3570003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358dfe8700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35880b10f0 0x7f3570003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358dfe8700 1 -- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3570003e20 msgr2=0x7f3570004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358dfe8700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3570003e20 0x7f3570004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358dfe8700 1 -- 172.21.15.12:0/1680097892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570003260 con 0x7f35700049f0 2021-10-20T23:28:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f358dfe8700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35700049f0 0x7f3570004e70 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f358000c000 tx=0x7f35800091d0).ready entity=mon.0 client_cookie=8f31cf61e18776c1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f358000e7e0 con 0x7f35700049f0 2021-10-20T23:28:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358000e940 con 0x7f35700049f0 2021-10-20T23:28:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.705+0000 7f3577fff700 1 -- 172.21.15.12:0/1680097892 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f358000eca0 con 0x7f35700049f0 2021-10-20T23:28:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 -- 172.21.15.12:0/1680097892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35700049f0 msgr2=0x7f3570004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 --2- 172.21.15.12:0/1680097892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35700049f0 0x7f3570004e70 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f358000c000 tx=0x7f35800091d0).stop 2021-10-20T23:28:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358dfe8700 1 -- 172.21.15.12:0/1680097892 reap_dead start 2021-10-20T23:28:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 -- 172.21.15.12:0/1680097892 shutdown_connections 2021-10-20T23:28:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 -- 172.21.15.12:0/1680097892 >> 172.21.15.12:0/1680097892 conn(0x7f3588060180 msgr2=0x7f35880b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 -- 172.21.15.12:0/1680097892 shutdown_connections 2021-10-20T23:28:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 -- 172.21.15.12:0/1680097892 wait complete. 2021-10-20T23:28:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 Processor -- start 2021-10-20T23:28:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 -- start start 2021-10-20T23:28:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35880a9480 0x7f3588138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3588142c10 0x7f358814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35880abfa0 0x7f358814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35880a9860 con 0x7f35880a9480 2021-10-20T23:28:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3588142960 con 0x7f35880abfa0 2021-10-20T23:28:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358e7e9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358813ed60 con 0x7f3588142c10 2021-10-20T23:28:01.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358d7e7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35880a9480 0x7f3588138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358d7e7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35880a9480 0x7f3588138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43798/0 (socket says 172.21.15.12:43798) 2021-10-20T23:28:01.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358d7e7700 1 -- 172.21.15.12:0/961649453 learned_addr learned my addr 172.21.15.12:0/961649453 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:01.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358dfe8700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35880abfa0 0x7f358814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358cfe6700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3588142c10 0x7f358814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358d7e7700 1 -- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3588142c10 msgr2=0x7f358814de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358d7e7700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3588142c10 0x7f358814de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358d7e7700 1 -- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35880abfa0 msgr2=0x7f358814e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358d7e7700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35880abfa0 0x7f358814e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.709+0000 7f358d7e7700 1 -- 172.21.15.12:0/961649453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3588151f30 con 0x7f35880a9480 2021-10-20T23:28:01.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f358d7e7700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35880a9480 0x7f3588138ab0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f3578001360 tx=0x7f358805d520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f35767fc700 1 -- 172.21.15.12:0/961649453 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3578011780 con 0x7f35880a9480 2021-10-20T23:28:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f35767fc700 1 -- 172.21.15.12:0/961649453 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35780118e0 con 0x7f35880a9480 2021-10-20T23:28:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f35767fc700 1 -- 172.21.15.12:0/961649453 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3578011c40 con 0x7f35880a9480 2021-10-20T23:28:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358813e620 con 0x7f35880a9480 2021-10-20T23:28:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35881521d0 con 0x7f35880a9480 2021-10-20T23:28:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3588057350 con 0x7f35880a9480 2021-10-20T23:28:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f35767fc700 1 -- 172.21.15.12:0/961649453 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f357801c360 con 0x7f35880a9480 2021-10-20T23:28:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f35767fc700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35680535b0 0x7f3568055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f35767fc700 1 -- 172.21.15.12:0/961649453 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f357806b610 con 0x7f35880a9480 2021-10-20T23:28:01.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.713+0000 7f358cfe6700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35680535b0 0x7f3568055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.717+0000 7f358cfe6700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35680535b0 0x7f3568055a70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f3584003000 tx=0x7f3584007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.717+0000 7f35767fc700 1 -- 172.21.15.12:0/961649453 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35780424a0 con 0x7f35880a9480 2021-10-20T23:28:01.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.849+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f358813f880 con 0x7f35880a9480 2021-10-20T23:28:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.849+0000 7f35767fc700 1 -- 172.21.15.12:0/961649453 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7f358813f880 con 0x7f35880a9480 2021-10-20T23:28:01.860 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35680535b0 msgr2=0x7f3568055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35680535b0 0x7f3568055a70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f3584003000 tx=0x7f3584007a00).stop 2021-10-20T23:28:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35880a9480 msgr2=0x7f3588138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35880a9480 0x7f3588138ab0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f3578001360 tx=0x7f358805d520).stop 2021-10-20T23:28:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 shutdown_connections 2021-10-20T23:28:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f35680535b0 0x7f3568055a70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35880abfa0 0x7f358814e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3588142c10 0x7f358814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 --2- 172.21.15.12:0/961649453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35880a9480 0x7f3588138ab0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 >> 172.21.15.12:0/961649453 conn(0x7f3588060180 msgr2=0x7f35880aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:01.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 shutdown_connections 2021-10-20T23:28:01.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.853+0000 7f358e7e9700 1 -- 172.21.15.12:0/961649453 wait complete. 2021-10-20T23:28:01.877 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:28:01.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.981+0000 7f3a12c42700 1 Processor -- start 2021-10-20T23:28:01.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.981+0000 7f3a12c42700 1 -- start start 2021-10-20T23:28:01.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3a0c0b2850 0x7f3a0c067150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a0c0af130 0x7f3a0c067640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c144450 con 0x7f3a0c0afd60 2021-10-20T23:28:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c0b2c30 con 0x7f3a0c0b2850 2021-10-20T23:28:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c145300 con 0x7f3a0c0af130 2021-10-20T23:28:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a11c40700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3a0c0b2850 0x7f3a0c067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12441700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3a0c0afd60 0x7f3a0c140e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42402/0 (socket says 172.21.15.12:42402) 2021-10-20T23:28:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12441700 1 -- 172.21.15.12:0/1177059692 learned_addr learned my addr 172.21.15.12:0/1177059692 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a1143f700 1 --2- 172.21.15.12:0/1177059692 >> v2:172.21.15.31:3300/0 conn(0x7f3a0c0af130 0x7f3a0c067640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a11c40700 1 -- 172.21.15.12:0/1177059692 >> v2:172.21.15.31:3300/0 conn(0x7f3a0c0af130 msgr2=0x7f3a0c067640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a11c40700 1 --2- 172.21.15.12:0/1177059692 >> v2:172.21.15.31:3300/0 conn(0x7f3a0c0af130 0x7f3a0c067640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a11c40700 1 -- 172.21.15.12:0/1177059692 >> v1:172.21.15.12:6789/0 conn(0x7f3a0c0afd60 legacy=0x7f3a0c140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a11c40700 1 -- 172.21.15.12:0/1177059692 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c144680 con 0x7f3a0c0b2850 2021-10-20T23:28:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a11c40700 1 --2- 172.21.15.12:0/1177059692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0b2850 0x7f3a0c067150 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f3a080032f0 tx=0x7f3a080091d0).ready entity=mon.0 client_cookie=a7a06bf10b9e3fcc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:01.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a10c3e700 1 -- 172.21.15.12:0/1177059692 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a08009ea0 con 0x7f3a0c0b2850 2021-10-20T23:28:01.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a10c3e700 1 -- 172.21.15.12:0/1177059692 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0800b870 con 0x7f3a0c0b2850 2021-10-20T23:28:01.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a10c3e700 1 -- 172.21.15.12:0/1177059692 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0800b9e0 con 0x7f3a0c0b2850 2021-10-20T23:28:02.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 -- 172.21.15.12:0/1177059692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0b2850 msgr2=0x7f3a0c067150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 --2- 172.21.15.12:0/1177059692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0b2850 0x7f3a0c067150 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f3a080032f0 tx=0x7f3a080091d0).stop 2021-10-20T23:28:02.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 -- 172.21.15.12:0/1177059692 shutdown_connections 2021-10-20T23:28:02.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 --2- 172.21.15.12:0/1177059692 >> v2:172.21.15.31:3300/0 conn(0x7f3a0c0af130 0x7f3a0c067640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 --2- 172.21.15.12:0/1177059692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0b2850 0x7f3a0c067150 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 -- 172.21.15.12:0/1177059692 >> 172.21.15.12:0/1177059692 conn(0x7f3a0c061230 msgr2=0x7f3a0c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:02.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 -- 172.21.15.12:0/1177059692 shutdown_connections 2021-10-20T23:28:02.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.985+0000 7f3a12c42700 1 -- 172.21.15.12:0/1177059692 wait complete. 2021-10-20T23:28:02.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.989+0000 7f3a12c42700 1 Processor -- start 2021-10-20T23:28:02.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.989+0000 7f3a12c42700 1 -- start start 2021-10-20T23:28:02.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12c42700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0af130 0x7f3a0c0661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12c42700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a0c0afd60 0x7f3a0c13ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12c42700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a0c0b2850 0x7f3a0c13f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12c42700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c0ae2d0 con 0x7f3a0c0af130 2021-10-20T23:28:02.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12c42700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c0adce0 con 0x7f3a0c0b2850 2021-10-20T23:28:02.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12c42700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c0ad3d0 con 0x7f3a0c0afd60 2021-10-20T23:28:02.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a11c40700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0af130 0x7f3a0c0661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a11c40700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0af130 0x7f3a0c0661f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43810/0 (socket says 172.21.15.12:43810) 2021-10-20T23:28:02.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a11c40700 1 -- 172.21.15.12:0/2802972823 learned_addr learned my addr 172.21.15.12:0/2802972823 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:02.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12441700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a0c0b2850 0x7f3a0c13f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a1143f700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a0c0afd60 0x7f3a0c13ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a11c40700 1 -- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a0c0afd60 msgr2=0x7f3a0c13ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a11c40700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a0c0afd60 0x7f3a0c13ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a11c40700 1 -- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a0c0b2850 msgr2=0x7f3a0c13f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a11c40700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a0c0b2850 0x7f3a0c13f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a11c40700 1 -- 172.21.15.12:0/2802972823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08009470 con 0x7f3a0c0af130 2021-10-20T23:28:02.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12441700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a0c0b2850 0x7f3a0c13f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:02.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a11c40700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0af130 0x7f3a0c0661f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f3a080032f0 tx=0x7f3a08016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:02.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f39faffd700 1 -- 172.21.15.12:0/2802972823 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0801f5e0 con 0x7f3a0c0af130 2021-10-20T23:28:02.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f39faffd700 1 -- 172.21.15.12:0/2802972823 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0801f740 con 0x7f3a0c0af130 2021-10-20T23:28:02.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0c0aedf0 con 0x7f3a0c0af130 2021-10-20T23:28:02.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f39faffd700 1 -- 172.21.15.12:0/2802972823 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0801faa0 con 0x7f3a0c0af130 2021-10-20T23:28:02.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0c141720 con 0x7f3a0c0af130 2021-10-20T23:28:02.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0c057350 con 0x7f3a0c0af130 2021-10-20T23:28:02.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.993+0000 7f39faffd700 1 -- 172.21.15.12:0/2802972823 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a08026030 con 0x7f3a0c0af130 2021-10-20T23:28:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.997+0000 7f39faffd700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39ec053610 0x7f39ec055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.997+0000 7f39faffd700 1 -- 172.21.15.12:0/2802972823 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3a0806cb20 con 0x7f3a0c0af130 2021-10-20T23:28:02.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.997+0000 7f3a1143f700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39ec053610 0x7f39ec055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:01.997+0000 7f3a1143f700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39ec053610 0x7f39ec055ad0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f39fc00c000 tx=0x7f39fc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:02.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.001+0000 7f39faffd700 1 -- 172.21.15.12:0/2802972823 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a08043b20 con 0x7f3a0c0af130 2021-10-20T23:28:02.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a0c13eae0 con 0x7f3a0c0af130 2021-10-20T23:28:02.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f39faffd700 1 -- 172.21.15.12:0/2802972823 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3a0c13eae0 con 0x7f3a0c0af130 2021-10-20T23:28:02.135 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:02.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39ec053610 msgr2=0x7f39ec055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39ec053610 0x7f39ec055ad0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f39fc00c000 tx=0x7f39fc008040).stop 2021-10-20T23:28:02.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0af130 msgr2=0x7f3a0c0661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0af130 0x7f3a0c0661f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f3a080032f0 tx=0x7f3a08016000).stop 2021-10-20T23:28:02.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 shutdown_connections 2021-10-20T23:28:02.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f39ec053610 0x7f39ec055ad0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a0c0b2850 0x7f3a0c13f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a0c0afd60 0x7f3a0c13ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 --2- 172.21.15.12:0/2802972823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0c0af130 0x7f3a0c0661f0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 >> 172.21.15.12:0/2802972823 conn(0x7f3a0c061230 msgr2=0x7f3a0c067150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:02.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 shutdown_connections 2021-10-20T23:28:02.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.125+0000 7f3a12c42700 1 -- 172.21.15.12:0/2802972823 wait complete. 2021-10-20T23:28:02.148 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:28:02.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.249+0000 7fa83f3f1700 1 Processor -- start 2021-10-20T23:28:02.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.249+0000 7fa83f3f1700 1 -- start start 2021-10-20T23:28:02.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.249+0000 7fa83f3f1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 0x7fa83813d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.249+0000 7fa83f3f1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8380b0cd0 0x7fa83813d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.249+0000 7fa83f3f1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83813daf0 con 0x7fa838064370 2021-10-20T23:28:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.249+0000 7fa83f3f1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa838066960 con 0x7fa8380b0cd0 2021-10-20T23:28:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.249+0000 7fa83f3f1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa838066c00 con 0x7fa8380b6380 2021-10-20T23:28:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83dbee700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8380b0cd0 0x7fa83813d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83ebf0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa838064370 0x7fa838060830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42416/0 (socket says 172.21.15.12:42416) 2021-10-20T23:28:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83ebf0700 1 -- 172.21.15.12:0/2004795124 learned_addr learned my addr 172.21.15.12:0/2004795124 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:02.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83e3ef700 1 --2- 172.21.15.12:0/2004795124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 0x7fa83813d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83d3ed700 1 -- 172.21.15.12:0/2004795124 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307375647 0 0) 0x7fa83813daf0 con 0x7fa838064370 2021-10-20T23:28:02.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83d3ed700 1 -- 172.21.15.12:0/2004795124 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa820003260 con 0x7fa838064370 2021-10-20T23:28:02.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83dbee700 1 -- 172.21.15.12:0/2004795124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 msgr2=0x7fa83813d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83dbee700 1 --2- 172.21.15.12:0/2004795124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 0x7fa83813d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83dbee700 1 -- 172.21.15.12:0/2004795124 >> v1:172.21.15.12:6789/0 conn(0x7fa838064370 legacy=0x7fa838060830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83dbee700 1 -- 172.21.15.12:0/2004795124 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838066ea0 con 0x7fa8380b0cd0 2021-10-20T23:28:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83dbee700 1 --2- 172.21.15.12:0/2004795124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 0x7fa83813d600 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fa828002f70 tx=0x7fa828006df0).ready entity=mon.0 client_cookie=d7d50325e432c8dd server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83d3ed700 1 -- 172.21.15.12:0/2004795124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa82800d4a0 con 0x7fa8380b0cd0 2021-10-20T23:28:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83d3ed700 1 -- 172.21.15.12:0/2004795124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa828000e90 con 0x7fa8380b0cd0 2021-10-20T23:28:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83d3ed700 1 -- 172.21.15.12:0/2004795124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa82800d7f0 con 0x7fa8380b0cd0 2021-10-20T23:28:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2004795124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 msgr2=0x7fa83813d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83f3f1700 1 --2- 172.21.15.12:0/2004795124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 0x7fa83813d600 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fa828002f70 tx=0x7fa828006df0).stop 2021-10-20T23:28:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2004795124 shutdown_connections 2021-10-20T23:28:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83f3f1700 1 --2- 172.21.15.12:0/2004795124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 0x7fa83813d600 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83f3f1700 1 --2- 172.21.15.12:0/2004795124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 0x7fa83813d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2004795124 >> 172.21.15.12:0/2004795124 conn(0x7fa838063670 msgr2=0x7fa838063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2004795124 shutdown_connections 2021-10-20T23:28:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.253+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2004795124 wait complete. 2021-10-20T23:28:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 Processor -- start 2021-10-20T23:28:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 -- start start 2021-10-20T23:28:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa838064370 0x7fa8380b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 0x7fa8380aa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 0x7fa8380aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8381532f0 con 0x7fa8380b0cd0 2021-10-20T23:28:02.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa838143fc0 con 0x7fa838064370 2021-10-20T23:28:02.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380acb00 con 0x7fa8380b6380 2021-10-20T23:28:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83dbee700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 0x7fa8380aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83dbee700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 0x7fa8380aa240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43826/0 (socket says 172.21.15.12:43826) 2021-10-20T23:28:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83dbee700 1 -- 172.21.15.12:0/2873839133 learned_addr learned my addr 172.21.15.12:0/2873839133 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83ebf0700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 0x7fa8380aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83e3ef700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa838064370 0x7fa8380b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83dbee700 1 -- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 msgr2=0x7fa8380aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83dbee700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 0x7fa8380aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83dbee700 1 -- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa838064370 msgr2=0x7fa8380b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83dbee700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa838064370 0x7fa8380b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83dbee700 1 -- 172.21.15.12:0/2873839133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82800b180 con 0x7fa8380b0cd0 2021-10-20T23:28:02.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83e3ef700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa838064370 0x7fa8380b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:28:02.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83dbee700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 0x7fa8380aa240 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fa828002f70 tx=0x7fa828014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:02.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa8277fe700 1 -- 172.21.15.12:0/2873839133 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa828013a40 con 0x7fa8380b0cd0 2021-10-20T23:28:02.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa8277fe700 1 -- 172.21.15.12:0/2873839133 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa828020070 con 0x7fa8380b0cd0 2021-10-20T23:28:02.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8380acda0 con 0x7fa8380b0cd0 2021-10-20T23:28:02.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa8277fe700 1 -- 172.21.15.12:0/2873839133 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa828013d90 con 0x7fa8380b0cd0 2021-10-20T23:28:02.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.257+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8380ad4e0 con 0x7fa8380b0cd0 2021-10-20T23:28:02.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.261+0000 7fa8277fe700 1 -- 172.21.15.12:0/2873839133 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa82802c070 con 0x7fa8380b0cd0 2021-10-20T23:28:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.261+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa838057350 con 0x7fa8380b0cd0 2021-10-20T23:28:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.261+0000 7fa8277fe700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa818053580 0x7fa818055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.261+0000 7fa8277fe700 1 -- 172.21.15.12:0/2873839133 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa82806f420 con 0x7fa8380b0cd0 2021-10-20T23:28:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.261+0000 7fa83e3ef700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa818053580 0x7fa818055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.261+0000 7fa83e3ef700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa818053580 0x7fa818055a40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fa83400b000 tx=0x7fa834008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:02.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.269+0000 7fa8277fe700 1 -- 172.21.15.12:0/2873839133 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa828046420 con 0x7fa8380b0cd0 2021-10-20T23:28:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.393+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa83813da60 con 0x7fa8380b0cd0 2021-10-20T23:28:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.393+0000 7fa8277fe700 1 -- 172.21.15.12:0/2873839133 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa828049a40 con 0x7fa8380b0cd0 2021-10-20T23:28:02.406 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:02.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa818053580 msgr2=0x7fa818055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa818053580 0x7fa818055a40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fa83400b000 tx=0x7fa834008040).stop 2021-10-20T23:28:02.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 msgr2=0x7fa8380aa240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 0x7fa8380aa240 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fa828002f70 tx=0x7fa828014000).stop 2021-10-20T23:28:02.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 shutdown_connections 2021-10-20T23:28:02.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa818053580 0x7fa818055a40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8380b6380 0x7fa8380aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8380b0cd0 0x7fa8380aa240 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 --2- 172.21.15.12:0/2873839133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa838064370 0x7fa8380b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 >> 172.21.15.12:0/2873839133 conn(0x7fa838063670 msgr2=0x7fa83813dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:02.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 shutdown_connections 2021-10-20T23:28:02.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.397+0000 7fa83f3f1700 1 -- 172.21.15.12:0/2873839133 wait complete. 2021-10-20T23:28:02.420 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:28:02.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ebfff700 1 Processor -- start 2021-10-20T23:28:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ebfff700 1 -- start start 2021-10-20T23:28:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ebfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0ec0ad5c0 0x7fd0ec061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ebfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec0aecf0 con 0x7fd0ec140440 2021-10-20T23:28:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ebfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec0b6f20 con 0x7fd0ec061320 2021-10-20T23:28:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ebfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0aef20 con 0x7fd0ec0ad5c0 2021-10-20T23:28:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0eb7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd0ec140440 0x7fd0ec146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42428/0 (socket says 172.21.15.12:42428) 2021-10-20T23:28:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0eb7fe700 1 -- 172.21.15.12:0/3353002940 learned_addr learned my addr 172.21.15.12:0/3353002940 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ea7fc700 1 --2- 172.21.15.12:0/3353002940 >> v2:172.21.15.31:3300/0 conn(0x7fd0ec0ad5c0 0x7fd0ec061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0e9ffb700 1 -- 172.21.15.12:0/3353002940 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001445377 0 0) 0x7fd0ec0aecf0 con 0x7fd0ec140440 2021-10-20T23:28:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0e9ffb700 1 -- 172.21.15.12:0/3353002940 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0d0003260 con 0x7fd0ec140440 2021-10-20T23:28:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ea7fc700 1 -- 172.21.15.12:0/3353002940 >> v1:172.21.15.31:6789/0 conn(0x7fd0ec061320 legacy=0x7fd0ec0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ea7fc700 1 -- 172.21.15.12:0/3353002940 >> v1:172.21.15.12:6789/0 conn(0x7fd0ec140440 legacy=0x7fd0ec146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ea7fc700 1 -- 172.21.15.12:0/3353002940 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec0af1c0 con 0x7fd0ec0ad5c0 2021-10-20T23:28:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0ea7fc700 1 --2- 172.21.15.12:0/3353002940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 0x7fd0ec061700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fd0e0002f70 tx=0x7fd0e0006df0).ready entity=mon.1 client_cookie=de91f8108825dcb5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0e9ffb700 1 -- 172.21.15.12:0/3353002940 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0e000d610 con 0x7fd0ec0ad5c0 2021-10-20T23:28:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0e9ffb700 1 -- 172.21.15.12:0/3353002940 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0000e90 con 0x7fd0ec0ad5c0 2021-10-20T23:28:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.513+0000 7fd0e9ffb700 1 -- 172.21.15.12:0/3353002940 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0e000d960 con 0x7fd0ec0ad5c0 2021-10-20T23:28:02.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 -- 172.21.15.12:0/3353002940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 msgr2=0x7fd0ec061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 --2- 172.21.15.12:0/3353002940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 0x7fd0ec061700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fd0e0002f70 tx=0x7fd0e0006df0).stop 2021-10-20T23:28:02.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 -- 172.21.15.12:0/3353002940 shutdown_connections 2021-10-20T23:28:02.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 --2- 172.21.15.12:0/3353002940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 0x7fd0ec061700 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 -- 172.21.15.12:0/3353002940 >> 172.21.15.12:0/3353002940 conn(0x7fd0ec066de0 msgr2=0x7fd0ec0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 -- 172.21.15.12:0/3353002940 shutdown_connections 2021-10-20T23:28:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 -- 172.21.15.12:0/3353002940 wait complete. 2021-10-20T23:28:02.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 Processor -- start 2021-10-20T23:28:02.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 -- start start 2021-10-20T23:28:02.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0ec061320 0x7fd0ec156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 0x7fd0ec144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ec140440 0x7fd0ec1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec155900 con 0x7fd0ec140440 2021-10-20T23:28:02.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec156760 con 0x7fd0ec0ad5c0 2021-10-20T23:28:02.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.517+0000 7fd0ebfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec140e70 con 0x7fd0ec061320 2021-10-20T23:28:02.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ec140440 0x7fd0ec1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ec140440 0x7fd0ec1522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43840/0 (socket says 172.21.15.12:43840) 2021-10-20T23:28:02.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eb7fe700 1 -- 172.21.15.12:0/619297828 learned_addr learned my addr 172.21.15.12:0/619297828 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:02.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eaffd700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0ec061320 0x7fd0ec156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0ea7fc700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 0x7fd0ec144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eb7fe700 1 -- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0ec061320 msgr2=0x7fd0ec156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eb7fe700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0ec061320 0x7fd0ec156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eb7fe700 1 -- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 msgr2=0x7fd0ec144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eb7fe700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 0x7fd0ec144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eb7fe700 1 -- 172.21.15.12:0/619297828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e000b180 con 0x7fd0ec140440 2021-10-20T23:28:02.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0ea7fc700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 0x7fd0ec144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:02.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0eb7fe700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ec140440 0x7fd0ec1522d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fd0dc001110 tx=0x7fd0dc007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:02.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0dbfff700 1 -- 172.21.15.12:0/619297828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0dc00cdf0 con 0x7fd0ec140440 2021-10-20T23:28:02.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0dbfff700 1 -- 172.21.15.12:0/619297828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc0070d0 con 0x7fd0ec140440 2021-10-20T23:28:02.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec155b30 con 0x7fd0ec140440 2021-10-20T23:28:02.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0dbfff700 1 -- 172.21.15.12:0/619297828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0dc007430 con 0x7fd0ec140440 2021-10-20T23:28:02.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec144920 con 0x7fd0ec140440 2021-10-20T23:28:02.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec0af460 con 0x7fd0ec140440 2021-10-20T23:28:02.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0dbfff700 1 -- 172.21.15.12:0/619297828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd0dc01a060 con 0x7fd0ec140440 2021-10-20T23:28:02.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.521+0000 7fd0dbfff700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c80536d0 0x7fd0c8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:02.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.525+0000 7fd0dbfff700 1 -- 172.21.15.12:0/619297828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd0dc06b200 con 0x7fd0ec140440 2021-10-20T23:28:02.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.525+0000 7fd0eaffd700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c80536d0 0x7fd0c8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:02.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.525+0000 7fd0eaffd700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c80536d0 0x7fd0c8055b90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fd0e400d000 tx=0x7fd0e4007f10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:02.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.529+0000 7fd0dbfff700 1 -- 172.21.15.12:0/619297828 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0dc0420f0 con 0x7fd0ec140440 2021-10-20T23:28:02.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.689+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0ec057350 con 0x7fd0ec140440 2021-10-20T23:28:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0dbfff700 1 -- 172.21.15.12:0/619297828 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2489 (secure 0 0 0) 0x7fd0dc018070 con 0x7fd0ec140440 2021-10-20T23:28:02.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:02.703 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":60,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7593,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/164978387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":164978387},{"type":"v1","addr":"172.21.15.12:6833","nonce":164978387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59},{"gid":7600,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/865815505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":865815505},{"type":"v1","addr":"172.21.15.31:6835","nonce":865815505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:58.046238+0000","modified":"2021-10-20T23:27:59.064679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1094154714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1094154714},{"type":"v1","addr":"172.21.15.12:6835","nonce":1094154714}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-10-20T23:28:02.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c80536d0 msgr2=0x7fd0c8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c80536d0 0x7fd0c8055b90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fd0e400d000 tx=0x7fd0e4007f10).stop 2021-10-20T23:28:02.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ec140440 msgr2=0x7fd0ec1522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:02.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ec140440 0x7fd0ec1522d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fd0dc001110 tx=0x7fd0dc007a80).stop 2021-10-20T23:28:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 shutdown_connections 2021-10-20T23:28:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd0c80536d0 0x7fd0c8055b90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ec140440 0x7fd0ec1522d0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec0ad5c0 0x7fd0ec144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 --2- 172.21.15.12:0/619297828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0ec061320 0x7fd0ec156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 >> 172.21.15.12:0/619297828 conn(0x7fd0ec066de0 msgr2=0x7fd0ec0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:02.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 shutdown_connections 2021-10-20T23:28:02.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:02.693+0000 7fd0ebfff700 1 -- 172.21.15.12:0/619297828 wait complete. 2021-10-20T23:28:02.710 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 60 2021-10-20T23:28:03.018 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:27:58.046238+0000', 'modified': '2021-10-20T23:27:59.064679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7605}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7605': {'gid': 7605, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1094154714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1094154714}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1094154714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:28:03.018 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:28:03.019 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:28:03.140 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":7605,"want_state":"up:active","state":"up:active","rank_uptime":5.0733757009999998,"mdsmap_epoch":60,"osdmap_epoch":122,"osdmap_epoch_barrier":121,"uptime":9.3717687069999993} 2021-10-20T23:28:03.141 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 7605, "mdsmap_epoch": 60, "osdmap_epoch": 122, "osdmap_epoch_barrier": 121, "rank_uptime": 5.073375701, "state": "up:active", "uptime": 9.371768707, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:28:03.142 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:28:03.142 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:28:03.143 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:28:03.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:03.144 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:03.153 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:28:03.219 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:03.219 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:03.231 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:03.232 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:03.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:03.233 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:28:03.239 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:28:03.239 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:03.283 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:28:03.301 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:03.302 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:03.313 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:03.314 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:03.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:03.316 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:28:03.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:28:03.354+0000 7f267dfc7080 -1 init, newargv = 0x55b17f084c30 newargc=9ceph-fuse[ 2021-10-20T23:28:03.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:14810]: starting ceph client 2021-10-20T23:28:03.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14810]: starting fuse 2021-10-20T23:28:04.463 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:28:04.482 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:04.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:04.541 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:04.542 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:04.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:04.545 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:28:04.551 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:28:04.552 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:28:04.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:04.554 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:28:04.555 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:28:04.555 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:28:04.556 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:28:04.557 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:28:04.558 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:28:04.558 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:28:04.559 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:28:04.560 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:28:04.560 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:28:04.561 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:28:04.562 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:28:04.562 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:28:04.563 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:28:04.563 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:28:04.564 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:28:04.564 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:28:04.565 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:28:04.565 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:28:04.565 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:28:04.566 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:28:04.566 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:28:04.567 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:28:04.611 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14810.asok 2021-10-20T23:28:04.616 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14810.asok 2021-10-20T23:28:04.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:04.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14810.asok status 2021-10-20T23:28:04.751 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:28:04.752 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:28:04.752 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:28:04.752 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:28:04.752 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:28:04.753 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:28:04.753 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:28:04.753 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14810", 2021-10-20T23:28:04.753 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:28:04.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:28:04.754 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:28:04.754 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:28:04.754 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 7762, 2021-10-20T23:28:04.755 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:28:04.755 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:28:04.755 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:28:04.755 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 7762 2021-10-20T23:28:04.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:28:04.756 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:28:04.756 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:28:04.756 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:28:04.757 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3436632168 2021-10-20T23:28:04.757 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:28:04.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:28:04.757 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:28:04.758 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:28:04.758 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:28:04.758 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3436632168 2021-10-20T23:28:04.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:28:04.759 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.7762 172.21.15.119:0/3436632168", 2021-10-20T23:28:04.759 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/3436632168", 2021-10-20T23:28:04.759 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:28:04.760 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 60, 2021-10-20T23:28:04.760 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 122, 2021-10-20T23:28:04.760 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:28:04.760 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:28:04.760 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:28:04.761 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:28:04.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:04.763 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:04.763 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:04.770 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:28:04.771 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:28:04.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:04.772 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:04.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:28:04.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.889+0000 7fac45e96700 1 Processor -- start 2021-10-20T23:28:04.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.889+0000 7fac45e96700 1 -- start start 2021-10-20T23:28:04.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac40064980 0x7fac40144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:04.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 0x7fac40141130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac40066500 con 0x7fac400b3550 2021-10-20T23:28:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac400b3ea0 con 0x7fac40064980 2021-10-20T23:28:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac40140d40 con 0x7fac40067110 2021-10-20T23:28:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac3ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fac400b3550 0x7fac40066a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42438/0 (socket says 172.21.15.12:42438) 2021-10-20T23:28:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac3ffff700 1 -- 172.21.15.12:0/1266594800 learned_addr learned my addr 172.21.15.12:0/1266594800 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45695700 1 --2- 172.21.15.12:0/1266594800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 0x7fac40141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac44e94700 1 --2- 172.21.15.12:0/1266594800 >> v2:172.21.15.31:3300/0 conn(0x7fac40064980 0x7fac40144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac3f7fe700 1 -- 172.21.15.12:0/1266594800 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080724911 0 0) 0x7fac40066500 con 0x7fac400b3550 2021-10-20T23:28:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac3f7fe700 1 -- 172.21.15.12:0/1266594800 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2c003260 con 0x7fac400b3550 2021-10-20T23:28:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45695700 1 -- 172.21.15.12:0/1266594800 >> v2:172.21.15.31:3300/0 conn(0x7fac40064980 msgr2=0x7fac40144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45695700 1 --2- 172.21.15.12:0/1266594800 >> v2:172.21.15.31:3300/0 conn(0x7fac40064980 0x7fac40144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45695700 1 -- 172.21.15.12:0/1266594800 >> v1:172.21.15.12:6789/0 conn(0x7fac400b3550 legacy=0x7fac40066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45695700 1 -- 172.21.15.12:0/1266594800 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac400b46c0 con 0x7fac40067110 2021-10-20T23:28:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45695700 1 --2- 172.21.15.12:0/1266594800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 0x7fac40141130 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fac380032f0 tx=0x7fac380091d0).ready entity=mon.2 client_cookie=42696de125b530c2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac3f7fe700 1 -- 172.21.15.12:0/1266594800 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac3800b600 con 0x7fac40067110 2021-10-20T23:28:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac3f7fe700 1 -- 172.21.15.12:0/1266594800 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3800b760 con 0x7fac40067110 2021-10-20T23:28:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac3f7fe700 1 -- 172.21.15.12:0/1266594800 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac3800b8d0 con 0x7fac40067110 2021-10-20T23:28:04.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 -- 172.21.15.12:0/1266594800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 msgr2=0x7fac40141130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 --2- 172.21.15.12:0/1266594800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 0x7fac40141130 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fac380032f0 tx=0x7fac380091d0).stop 2021-10-20T23:28:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 -- 172.21.15.12:0/1266594800 shutdown_connections 2021-10-20T23:28:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 --2- 172.21.15.12:0/1266594800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 0x7fac40141130 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 --2- 172.21.15.12:0/1266594800 >> v2:172.21.15.31:3300/0 conn(0x7fac40064980 0x7fac40144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 -- 172.21.15.12:0/1266594800 >> 172.21.15.12:0/1266594800 conn(0x7fac4005f6b0 msgr2=0x7fac4005fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 -- 172.21.15.12:0/1266594800 shutdown_connections 2021-10-20T23:28:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.893+0000 7fac45e96700 1 -- 172.21.15.12:0/1266594800 wait complete. 2021-10-20T23:28:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac45e96700 1 Processor -- start 2021-10-20T23:28:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac45e96700 1 -- start start 2021-10-20T23:28:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac45e96700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40064980 0x7fac4005cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac45e96700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 0x7fac4013c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac45e96700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac400b3550 0x7fac40143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac45e96700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4013bfc0 con 0x7fac40064980 2021-10-20T23:28:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac45e96700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4013dc50 con 0x7fac400b3550 2021-10-20T23:28:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac45e96700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4013b5d0 con 0x7fac40067110 2021-10-20T23:28:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac44e94700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40064980 0x7fac4005cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac44e94700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40064980 0x7fac4005cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43850/0 (socket says 172.21.15.12:43850) 2021-10-20T23:28:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac44e94700 1 -- 172.21.15.12:0/3556618138 learned_addr learned my addr 172.21.15.12:0/3556618138 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac3ffff700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 0x7fac4013c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.897+0000 7fac45695700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac400b3550 0x7fac40143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac44e94700 1 -- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 msgr2=0x7fac4013c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac44e94700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 0x7fac4013c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac44e94700 1 -- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac400b3550 msgr2=0x7fac40143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac44e94700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac400b3550 0x7fac40143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac44e94700 1 -- 172.21.15.12:0/3556618138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38009470 con 0x7fac40064980 2021-10-20T23:28:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac44e94700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40064980 0x7fac4005cc90 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fac3400c000 tx=0x7fac34006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac3dffb700 1 -- 172.21.15.12:0/3556618138 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac34010780 con 0x7fac40064980 2021-10-20T23:28:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac3dffb700 1 -- 172.21.15.12:0/3556618138 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac340108e0 con 0x7fac40064980 2021-10-20T23:28:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4013bd20 con 0x7fac40064980 2021-10-20T23:28:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac3dffb700 1 -- 172.21.15.12:0/3556618138 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac34010c40 con 0x7fac40064980 2021-10-20T23:28:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4013d940 con 0x7fac40064980 2021-10-20T23:28:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac40057350 con 0x7fac40064980 2021-10-20T23:28:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.901+0000 7fac3dffb700 1 -- 172.21.15.12:0/3556618138 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac3401c460 con 0x7fac40064980 2021-10-20T23:28:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.905+0000 7fac3dffb700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac20053660 0x7fac20055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.905+0000 7fac3dffb700 1 -- 172.21.15.12:0/3556618138 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fac3406bef0 con 0x7fac40064980 2021-10-20T23:28:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.905+0000 7fac3ffff700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac20053660 0x7fac20055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.905+0000 7fac3ffff700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac20053660 0x7fac20055b20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fac3000d000 tx=0x7fac30009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:04.909+0000 7fac3dffb700 1 -- 172.21.15.12:0/3556618138 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac34042e90 con 0x7fac40064980 2021-10-20T23:28:05.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.041+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac40069c00 con 0x7fac40064980 2021-10-20T23:28:05.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.041+0000 7fac3dffb700 1 -- 172.21.15.12:0/3556618138 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fac340464b0 con 0x7fac40064980 2021-10-20T23:28:05.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:05.053 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":122,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:27:59.064803+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:27:56.525958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-20T23:27:57.402829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:28:05.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac20053660 msgr2=0x7fac20055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac20053660 0x7fac20055b20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fac3000d000 tx=0x7fac30009040).stop 2021-10-20T23:28:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40064980 msgr2=0x7fac4005cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40064980 0x7fac4005cc90 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fac3400c000 tx=0x7fac34006df0).stop 2021-10-20T23:28:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 shutdown_connections 2021-10-20T23:28:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fac20053660 0x7fac20055b20 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac400b3550 0x7fac40143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac40067110 0x7fac4013c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 --2- 172.21.15.12:0/3556618138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40064980 0x7fac4005cc90 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 >> 172.21.15.12:0/3556618138 conn(0x7fac4005f6b0 msgr2=0x7fac4013a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 shutdown_connections 2021-10-20T23:28:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.045+0000 7fac45e96700 1 -- 172.21.15.12:0/3556618138 wait complete. 2021-10-20T23:28:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:27:56.525958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:27:57.402829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:28:05.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:28:05.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf815f700 1 Processor -- start 2021-10-20T23:28:05.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf815f700 1 -- start start 2021-10-20T23:28:05.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf815f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdbf00a9ec0 0x7fdbf00aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf815f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbf00603d0 0x7fdbf013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf815f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf013d1c0 0x7fdbf013f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf815f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf0061990 con 0x7fdbf00603d0 2021-10-20T23:28:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf815f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf0061c30 con 0x7fdbf00a9ec0 2021-10-20T23:28:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf815f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0060b90 con 0x7fdbf013d1c0 2021-10-20T23:28:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf56fa700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbf00603d0 0x7fdbf013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf56fa700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbf00603d0 0x7fdbf013ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43860/0 (socket says 172.21.15.12:43860) 2021-10-20T23:28:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf56fa700 1 -- 172.21.15.12:0/4121021952 learned_addr learned my addr 172.21.15.12:0/4121021952 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf5efb700 1 --2- 172.21.15.12:0/4121021952 >> v2:172.21.15.31:3300/0 conn(0x7fdbf00a9ec0 0x7fdbf00aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf66fc700 1 --2- 172.21.15.12:0/4121021952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf013d1c0 0x7fdbf013f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf5efb700 1 -- 172.21.15.12:0/4121021952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf013d1c0 msgr2=0x7fdbf013f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf5efb700 1 --2- 172.21.15.12:0/4121021952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf013d1c0 0x7fdbf013f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf5efb700 1 -- 172.21.15.12:0/4121021952 >> v2:172.21.15.12:3300/0 conn(0x7fdbf00603d0 msgr2=0x7fdbf013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf5efb700 1 --2- 172.21.15.12:0/4121021952 >> v2:172.21.15.12:3300/0 conn(0x7fdbf00603d0 0x7fdbf013ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf5efb700 1 -- 172.21.15.12:0/4121021952 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0060e30 con 0x7fdbf00a9ec0 2021-10-20T23:28:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf5efb700 1 --2- 172.21.15.12:0/4121021952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00a9ec0 0x7fdbf00aa2a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fdbf005f870 tx=0x7fdbec006df0).ready entity=mon.1 client_cookie=d3ad1d8b462c5671 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.165+0000 7fdbf4ef9700 1 -- 172.21.15.12:0/4121021952 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbec00d4a0 con 0x7fdbf00a9ec0 2021-10-20T23:28:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf4ef9700 1 -- 172.21.15.12:0/4121021952 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec000e90 con 0x7fdbf00a9ec0 2021-10-20T23:28:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf4ef9700 1 -- 172.21.15.12:0/4121021952 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbec00d7f0 con 0x7fdbf00a9ec0 2021-10-20T23:28:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 -- 172.21.15.12:0/4121021952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00a9ec0 msgr2=0x7fdbf00aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 --2- 172.21.15.12:0/4121021952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00a9ec0 0x7fdbf00aa2a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fdbf005f870 tx=0x7fdbec006df0).stop 2021-10-20T23:28:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 -- 172.21.15.12:0/4121021952 shutdown_connections 2021-10-20T23:28:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 --2- 172.21.15.12:0/4121021952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf013d1c0 0x7fdbf013f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 --2- 172.21.15.12:0/4121021952 >> v2:172.21.15.12:3300/0 conn(0x7fdbf00603d0 0x7fdbf013ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 --2- 172.21.15.12:0/4121021952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00a9ec0 0x7fdbf00aa2a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 -- 172.21.15.12:0/4121021952 >> 172.21.15.12:0/4121021952 conn(0x7fdbf00b2970 msgr2=0x7fdbf00b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 -- 172.21.15.12:0/4121021952 shutdown_connections 2021-10-20T23:28:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 -- 172.21.15.12:0/4121021952 wait complete. 2021-10-20T23:28:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 Processor -- start 2021-10-20T23:28:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.169+0000 7fdbf815f700 1 -- start start 2021-10-20T23:28:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf815f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00603d0 0x7fdbf0142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf815f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf00a9ec0 0x7fdbf013f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf815f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf013d1c0 0x7fdbf0136fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf815f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0141e00 con 0x7fdbf013d1c0 2021-10-20T23:28:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf815f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0143400 con 0x7fdbf00603d0 2021-10-20T23:28:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf815f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf01436a0 con 0x7fdbf00a9ec0 2021-10-20T23:28:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf66fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf013d1c0 0x7fdbf0136fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf66fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf013d1c0 0x7fdbf0136fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43868/0 (socket says 172.21.15.12:43868) 2021-10-20T23:28:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf66fc700 1 -- 172.21.15.12:0/1126414232 learned_addr learned my addr 172.21.15.12:0/1126414232 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf56fa700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf00a9ec0 0x7fdbf013f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf5efb700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00603d0 0x7fdbf0142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf66fc700 1 -- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf00a9ec0 msgr2=0x7fdbf013f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf66fc700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf00a9ec0 0x7fdbf013f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf66fc700 1 -- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00603d0 msgr2=0x7fdbf0142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf66fc700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00603d0 0x7fdbf0142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf66fc700 1 -- 172.21.15.12:0/1126414232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec00b180 con 0x7fdbf013d1c0 2021-10-20T23:28:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf5efb700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00603d0 0x7fdbf0142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf66fc700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf013d1c0 0x7fdbf0136fd0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fdbe8006e00 tx=0x7fdbe80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbdeffd700 1 -- 172.21.15.12:0/1126414232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbe800c7f0 con 0x7fdbf013d1c0 2021-10-20T23:28:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbdeffd700 1 -- 172.21.15.12:0/1126414232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe800c950 con 0x7fdbf013d1c0 2021-10-20T23:28:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbdeffd700 1 -- 172.21.15.12:0/1126414232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbe800ccb0 con 0x7fdbf013d1c0 2021-10-20T23:28:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf0143940 con 0x7fdbf013d1c0 2021-10-20T23:28:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.173+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf0142260 con 0x7fdbf013d1c0 2021-10-20T23:28:05.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.177+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf01406c0 con 0x7fdbf013d1c0 2021-10-20T23:28:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.177+0000 7fdbdeffd700 1 -- 172.21.15.12:0/1126414232 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdbe8022070 con 0x7fdbf013d1c0 2021-10-20T23:28:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.177+0000 7fdbdeffd700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbd00534f0 0x7fdbd00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.177+0000 7fdbdeffd700 1 -- 172.21.15.12:0/1126414232 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdbe806c140 con 0x7fdbf013d1c0 2021-10-20T23:28:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.177+0000 7fdbf5efb700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbd00534f0 0x7fdbd00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.177+0000 7fdbf5efb700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbd00534f0 0x7fdbd00559b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fdbec018000 tx=0x7fdbec014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.185+0000 7fdbdeffd700 1 -- 172.21.15.12:0/1126414232 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdbe8043140 con 0x7fdbf013d1c0 2021-10-20T23:28:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.309+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdbf0143ad0 con 0x7fdbf013d1c0 2021-10-20T23:28:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbdeffd700 1 -- 172.21.15.12:0/1126414232 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v122) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdbe80160b0 con 0x7fdbf013d1c0 2021-10-20T23:28:05.322 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:28:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbd00534f0 msgr2=0x7fdbd00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbd00534f0 0x7fdbd00559b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fdbec018000 tx=0x7fdbec014000).stop 2021-10-20T23:28:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf013d1c0 msgr2=0x7fdbf0136fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf013d1c0 0x7fdbf0136fd0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fdbe8006e00 tx=0x7fdbe80091d0).stop 2021-10-20T23:28:05.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 shutdown_connections 2021-10-20T23:28:05.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbd00534f0 0x7fdbd00559b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf013d1c0 0x7fdbf0136fd0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbf00a9ec0 0x7fdbf013f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 --2- 172.21.15.12:0/1126414232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbf00603d0 0x7fdbf0142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 >> 172.21.15.12:0/1126414232 conn(0x7fdbf00b2970 msgr2=0x7fdbf00b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:05.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 shutdown_connections 2021-10-20T23:28:05.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.313+0000 7fdbf815f700 1 -- 172.21.15.12:0/1126414232 wait complete. 2021-10-20T23:28:05.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:28:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.429+0000 7f1b79b74700 1 Processor -- start 2021-10-20T23:28:05.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.429+0000 7f1b79b74700 1 -- start start 2021-10-20T23:28:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b740b4180 0x7f1b74140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b740b4690 0x7f1b740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b74143b60 con 0x7f1b74146950 2021-10-20T23:28:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b74147510 con 0x7f1b740b4180 2021-10-20T23:28:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b74143e00 con 0x7f1b740b4690 2021-10-20T23:28:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b72ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b740b4180 0x7f1b74140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b737fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1b74146950 0x7f1b74140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42466/0 (socket says 172.21.15.12:42466) 2021-10-20T23:28:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b72ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b740b4180 0x7f1b74140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43874/0 (socket says 172.21.15.12:43874) 2021-10-20T23:28:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b737fe700 1 -- 172.21.15.12:0/3907599600 learned_addr learned my addr 172.21.15.12:0/3907599600 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b73fff700 1 --2- 172.21.15.12:0/3907599600 >> v2:172.21.15.31:3300/0 conn(0x7f1b740b4690 0x7f1b740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b72ffd700 1 -- 172.21.15.12:0/3907599600 >> v2:172.21.15.31:3300/0 conn(0x7f1b740b4690 msgr2=0x7f1b740b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b72ffd700 1 --2- 172.21.15.12:0/3907599600 >> v2:172.21.15.31:3300/0 conn(0x7f1b740b4690 0x7f1b740b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b727fc700 1 -- 172.21.15.12:0/3907599600 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314509204 0 0) 0x7f1b74143b60 con 0x7f1b74146950 2021-10-20T23:28:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b72ffd700 1 -- 172.21.15.12:0/3907599600 >> v1:172.21.15.12:6789/0 conn(0x7f1b74146950 legacy=0x7f1b74140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b72ffd700 1 -- 172.21.15.12:0/3907599600 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b740b0c90 con 0x7f1b740b4180 2021-10-20T23:28:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b72ffd700 1 --2- 172.21.15.12:0/3907599600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 0x7f1b74140940 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f1b64002f70 tx=0x7f1b64006df0).ready entity=mon.0 client_cookie=adc907421ad59e87 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b727fc700 1 -- 172.21.15.12:0/3907599600 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6400d570 con 0x7f1b740b4180 2021-10-20T23:28:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b727fc700 1 -- 172.21.15.12:0/3907599600 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b64000e90 con 0x7f1b740b4180 2021-10-20T23:28:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b727fc700 1 -- 172.21.15.12:0/3907599600 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6400d8c0 con 0x7f1b740b4180 2021-10-20T23:28:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 -- 172.21.15.12:0/3907599600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 msgr2=0x7f1b74140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 --2- 172.21.15.12:0/3907599600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 0x7f1b74140940 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f1b64002f70 tx=0x7f1b64006df0).stop 2021-10-20T23:28:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 -- 172.21.15.12:0/3907599600 shutdown_connections 2021-10-20T23:28:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 --2- 172.21.15.12:0/3907599600 >> v2:172.21.15.31:3300/0 conn(0x7f1b740b4690 0x7f1b740b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 --2- 172.21.15.12:0/3907599600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 0x7f1b74140940 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.433+0000 7f1b79b74700 1 -- 172.21.15.12:0/3907599600 >> 172.21.15.12:0/3907599600 conn(0x7f1b7405c490 msgr2=0x7f1b7405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.437+0000 7f1b79b74700 1 -- 172.21.15.12:0/3907599600 shutdown_connections 2021-10-20T23:28:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.437+0000 7f1b79b74700 1 -- 172.21.15.12:0/3907599600 wait complete. 2021-10-20T23:28:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.437+0000 7f1b79b74700 1 Processor -- start 2021-10-20T23:28:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.437+0000 7f1b79b74700 1 -- start start 2021-10-20T23:28:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b79b74700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 0x7f1b740b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b79b74700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b740b4690 0x7f1b74152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b79b74700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b74146950 0x7f1b74152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b79b74700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74152130 con 0x7f1b740b4180 2021-10-20T23:28:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b79b74700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740ad970 con 0x7f1b740b4690 2021-10-20T23:28:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b79b74700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740ae610 con 0x7f1b74146950 2021-10-20T23:28:05.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b737fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 0x7f1b740b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b737fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 0x7f1b740b6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43878/0 (socket says 172.21.15.12:43878) 2021-10-20T23:28:05.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b737fe700 1 -- 172.21.15.12:0/1551214170 learned_addr learned my addr 172.21.15.12:0/1551214170 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:05.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b72ffd700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b740b4690 0x7f1b74152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b73fff700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b74146950 0x7f1b74152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b737fe700 1 -- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b74146950 msgr2=0x7f1b74152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b737fe700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b74146950 0x7f1b74152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b737fe700 1 -- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b740b4690 msgr2=0x7f1b74152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b737fe700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b740b4690 0x7f1b74152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b737fe700 1 -- 172.21.15.12:0/1551214170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6400b180 con 0x7f1b740b4180 2021-10-20T23:28:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b737fe700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 0x7f1b740b6650 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f1b74155730 tx=0x7f1b5c007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b70ff9700 1 -- 172.21.15.12:0/1551214170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5c0070d0 con 0x7f1b740b4180 2021-10-20T23:28:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b70ff9700 1 -- 172.21.15.12:0/1551214170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c007230 con 0x7f1b740b4180 2021-10-20T23:28:05.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b70ff9700 1 -- 172.21.15.12:0/1551214170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5c005610 con 0x7f1b740b4180 2021-10-20T23:28:05.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b740ae0d0 con 0x7f1b740b4180 2021-10-20T23:28:05.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b74153000 con 0x7f1b740b4180 2021-10-20T23:28:05.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b74155770 con 0x7f1b740b4180 2021-10-20T23:28:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.441+0000 7f1b70ff9700 1 -- 172.21.15.12:0/1551214170 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1b5c010070 con 0x7f1b740b4180 2021-10-20T23:28:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.445+0000 7f1b70ff9700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b58053580 0x7f1b58055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.445+0000 7f1b70ff9700 1 -- 172.21.15.12:0/1551214170 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1b5c06b1f0 con 0x7f1b740b4180 2021-10-20T23:28:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.445+0000 7f1b72ffd700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b58053580 0x7f1b58055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.445+0000 7f1b72ffd700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b58053580 0x7f1b58055a40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f1b6401a000 tx=0x7f1b64014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.449+0000 7f1b70ff9700 1 -- 172.21.15.12:0/1551214170 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1b5c0421f0 con 0x7f1b740b4180 2021-10-20T23:28:05.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.577+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b74057350 con 0x7f1b740b4180 2021-10-20T23:28:05.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b70ff9700 1 -- 172.21.15.12:0/1551214170 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b5c045810 con 0x7f1b740b4180 2021-10-20T23:28:05.590 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b58053580 msgr2=0x7f1b58055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b58053580 0x7f1b58055a40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f1b6401a000 tx=0x7f1b64014000).stop 2021-10-20T23:28:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 msgr2=0x7f1b740b6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 0x7f1b740b6650 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f1b74155730 tx=0x7f1b5c007ac0).stop 2021-10-20T23:28:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 shutdown_connections 2021-10-20T23:28:05.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1b58053580 0x7f1b58055a40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b74146950 0x7f1b74152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b740b4690 0x7f1b74152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 --2- 172.21.15.12:0/1551214170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b740b4180 0x7f1b740b6650 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 >> 172.21.15.12:0/1551214170 conn(0x7f1b7405c490 msgr2=0x7f1b7413b090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 shutdown_connections 2021-10-20T23:28:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.581+0000 7f1b79b74700 1 -- 172.21.15.12:0/1551214170 wait complete. 2021-10-20T23:28:05.604 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:28:05.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7e3b3700 1 Processor -- start 2021-10-20T23:28:05.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7e3b3700 1 -- start start 2021-10-20T23:28:05.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7e3b3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d780aad80 0x7f7d78067300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7e3b3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 0x7f7d780b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7e3b3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d78065960 con 0x7f7d780ab160 2021-10-20T23:28:05.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7e3b3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d78064f10 con 0x7f7d780aad80 2021-10-20T23:28:05.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7e3b3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780b3ce0 con 0x7f7d780b4d50 2021-10-20T23:28:05.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7cbb0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7d780ab160 0x7f7d78064800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42482/0 (socket says 172.21.15.12:42482) 2021-10-20T23:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7cbb0700 1 -- 172.21.15.12:0/2815886543 learned_addr learned my addr 172.21.15.12:0/2815886543 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7dbb2700 1 --2- 172.21.15.12:0/2815886543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 0x7f7d780b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7d3b1700 1 --2- 172.21.15.12:0/2815886543 >> v2:172.21.15.31:3300/0 conn(0x7f7d780aad80 0x7f7d78067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d6ffff700 1 -- 172.21.15.12:0/2815886543 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274371060 0 0) 0x7f7d78065960 con 0x7f7d780ab160 2021-10-20T23:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d6ffff700 1 -- 172.21.15.12:0/2815886543 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d5c003260 con 0x7f7d780ab160 2021-10-20T23:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7dbb2700 1 -- 172.21.15.12:0/2815886543 >> v2:172.21.15.31:3300/0 conn(0x7f7d780aad80 msgr2=0x7f7d78067300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7dbb2700 1 --2- 172.21.15.12:0/2815886543 >> v2:172.21.15.31:3300/0 conn(0x7f7d780aad80 0x7f7d78067300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.701+0000 7f7d7dbb2700 1 -- 172.21.15.12:0/2815886543 >> v1:172.21.15.12:6789/0 conn(0x7f7d780ab160 legacy=0x7f7d78064800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7dbb2700 1 -- 172.21.15.12:0/2815886543 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d78066e60 con 0x7f7d780b4d50 2021-10-20T23:28:05.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7dbb2700 1 --2- 172.21.15.12:0/2815886543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 0x7f7d780b7520 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f7d74002f70 tx=0x7f7d74006df0).ready entity=mon.2 client_cookie=b841eb0c7e58214e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d6ffff700 1 -- 172.21.15.12:0/2815886543 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d7400d4a0 con 0x7f7d780b4d50 2021-10-20T23:28:05.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d6ffff700 1 -- 172.21.15.12:0/2815886543 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d74000e90 con 0x7f7d780b4d50 2021-10-20T23:28:05.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d6ffff700 1 -- 172.21.15.12:0/2815886543 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d7400d7f0 con 0x7f7d780b4d50 2021-10-20T23:28:05.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/2815886543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 msgr2=0x7f7d780b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 --2- 172.21.15.12:0/2815886543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 0x7f7d780b7520 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f7d74002f70 tx=0x7f7d74006df0).stop 2021-10-20T23:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/2815886543 shutdown_connections 2021-10-20T23:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 --2- 172.21.15.12:0/2815886543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 0x7f7d780b7520 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 --2- 172.21.15.12:0/2815886543 >> v2:172.21.15.31:3300/0 conn(0x7f7d780aad80 0x7f7d78067300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/2815886543 >> 172.21.15.12:0/2815886543 conn(0x7f7d78062be0 msgr2=0x7f7d7805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/2815886543 shutdown_connections 2021-10-20T23:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/2815886543 wait complete. 2021-10-20T23:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 Processor -- start 2021-10-20T23:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.705+0000 7f7d7e3b3700 1 -- start start 2021-10-20T23:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7e3b3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d780aad80 0x7f7d7813af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7e3b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d780ab160 0x7f7d78142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7e3b3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 0x7f7d781434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7e3b3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d781439c0 con 0x7f7d780aad80 2021-10-20T23:28:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7e3b3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780af1d0 con 0x7f7d780ab160 2021-10-20T23:28:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7e3b3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78145050 con 0x7f7d780b4d50 2021-10-20T23:28:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7d3b1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d780aad80 0x7f7d7813af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7d3b1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d780aad80 0x7f7d7813af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43892/0 (socket says 172.21.15.12:43892) 2021-10-20T23:28:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7d3b1700 1 -- 172.21.15.12:0/3314277464 learned_addr learned my addr 172.21.15.12:0/3314277464 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7dbb2700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 0x7f7d781434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7cbb0700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d780ab160 0x7f7d78142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7d3b1700 1 -- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 msgr2=0x7f7d781434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7d3b1700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 0x7f7d781434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7d3b1700 1 -- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d780ab160 msgr2=0x7f7d78142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7d3b1700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d780ab160 0x7f7d78142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7d3b1700 1 -- 172.21.15.12:0/3314277464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7400b180 con 0x7f7d780aad80 2021-10-20T23:28:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7cbb0700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d780ab160 0x7f7d78142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7d3b1700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d780aad80 0x7f7d7813af50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f7d780b1e30 tx=0x7f7d700091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d6e7fc700 1 -- 172.21.15.12:0/3314277464 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d7000c7f0 con 0x7f7d780aad80 2021-10-20T23:28:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d6e7fc700 1 -- 172.21.15.12:0/3314277464 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7000c950 con 0x7f7d780aad80 2021-10-20T23:28:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d781509d0 con 0x7f7d780aad80 2021-10-20T23:28:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d6e7fc700 1 -- 172.21.15.12:0/3314277464 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d7000ccb0 con 0x7f7d780aad80 2021-10-20T23:28:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d780af400 con 0x7f7d780aad80 2021-10-20T23:28:05.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d780af600 con 0x7f7d780aad80 2021-10-20T23:28:05.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.709+0000 7f7d6e7fc700 1 -- 172.21.15.12:0/3314277464 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7d70022070 con 0x7f7d780aad80 2021-10-20T23:28:05.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.713+0000 7f7d6e7fc700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7d600536a0 0x7f7d60055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.713+0000 7f7d6e7fc700 1 -- 172.21.15.12:0/3314277464 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7d7006c310 con 0x7f7d780aad80 2021-10-20T23:28:05.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.713+0000 7f7d7cbb0700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7d600536a0 0x7f7d60055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.713+0000 7f7d7cbb0700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7d600536a0 0x7f7d60055b60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f7d6800b000 tx=0x7f7d68009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.717+0000 7f7d6e7fc700 1 -- 172.21.15.12:0/3314277464 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7d780af600 con 0x7f7d780aad80 2021-10-20T23:28:05.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.845+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d780af600 con 0x7f7d780aad80 2021-10-20T23:28:05.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.845+0000 7f7d6e7fc700 1 -- 172.21.15.12:0/3314277464 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7d780af600 con 0x7f7d780aad80 2021-10-20T23:28:05.857 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7d600536a0 msgr2=0x7f7d60055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7d600536a0 0x7f7d60055b60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f7d6800b000 tx=0x7f7d68009040).stop 2021-10-20T23:28:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d780aad80 msgr2=0x7f7d7813af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d780aad80 0x7f7d7813af50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f7d780b1e30 tx=0x7f7d700091d0).stop 2021-10-20T23:28:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 shutdown_connections 2021-10-20T23:28:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7d600536a0 0x7f7d60055b60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d780b4d50 0x7f7d781434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d780ab160 0x7f7d78142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 --2- 172.21.15.12:0/3314277464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d780aad80 0x7f7d7813af50 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 >> 172.21.15.12:0/3314277464 conn(0x7f7d78062be0 msgr2=0x7f7d781452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 shutdown_connections 2021-10-20T23:28:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.849+0000 7f7d7e3b3700 1 -- 172.21.15.12:0/3314277464 wait complete. 2021-10-20T23:28:05.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:28:05.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.973+0000 7f8b0b59e700 1 Processor -- start 2021-10-20T23:28:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.973+0000 7f8b0b59e700 1 -- start start 2021-10-20T23:28:05.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8b0c0af3c0 0x7f8b0c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b0c0601a0 0x7f8b0c144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c144940 0x7f8b0c0a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:05.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0b59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c0b1450 con 0x7f8b0c0601a0 2021-10-20T23:28:05.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0b59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c0aa4a0 con 0x7f8b0c0af3c0 2021-10-20T23:28:05.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0b59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c05f6b0 con 0x7f8b0c144940 2021-10-20T23:28:05.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b09d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b0c0601a0 0x7f8b0c144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b09d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b0c0601a0 0x7f8b0c144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43900/0 (socket says 172.21.15.12:43900) 2021-10-20T23:28:05.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b09d9b700 1 -- 172.21.15.12:0/3128452923 learned_addr learned my addr 172.21.15.12:0/3128452923 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:05.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0ad9d700 1 --2- 172.21.15.12:0/3128452923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c144940 0x7f8b0c0a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0a59c700 1 --2- 172.21.15.12:0/3128452923 >> v2:172.21.15.31:3300/0 conn(0x7f8b0c0af3c0 0x7f8b0c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:05.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b09d9b700 1 -- 172.21.15.12:0/3128452923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c144940 msgr2=0x7f8b0c0a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:05.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b09d9b700 1 --2- 172.21.15.12:0/3128452923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c144940 0x7f8b0c0a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b09d9b700 1 -- 172.21.15.12:0/3128452923 >> v2:172.21.15.31:3300/0 conn(0x7f8b0c0af3c0 msgr2=0x7f8b0c0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:05.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b09d9b700 1 --2- 172.21.15.12:0/3128452923 >> v2:172.21.15.31:3300/0 conn(0x7f8b0c0af3c0 0x7f8b0c0b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:05.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b09d9b700 1 -- 172.21.15.12:0/3128452923 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c05fb80 con 0x7f8b0c0601a0 2021-10-20T23:28:05.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0a59c700 1 --2- 172.21.15.12:0/3128452923 >> v2:172.21.15.31:3300/0 conn(0x7f8b0c0af3c0 0x7f8b0c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:05.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b09d9b700 1 --2- 172.21.15.12:0/3128452923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c0601a0 0x7f8b0c144450 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f8af4002f70 tx=0x7f8af4006eb0).ready entity=mon.0 client_cookie=c625821e7872e2f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:05.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0959a700 1 -- 172.21.15.12:0/3128452923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8af400d570 con 0x7f8b0c0601a0 2021-10-20T23:28:05.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0959a700 1 -- 172.21.15.12:0/3128452923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af4000e90 con 0x7f8b0c0601a0 2021-10-20T23:28:05.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.977+0000 7f8b0959a700 1 -- 172.21.15.12:0/3128452923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8af400d900 con 0x7f8b0c0601a0 2021-10-20T23:28:05.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 -- 172.21.15.12:0/3128452923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c0601a0 msgr2=0x7f8b0c144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:05.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/3128452923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c0601a0 0x7f8b0c144450 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f8af4002f70 tx=0x7f8af4006eb0).stop 2021-10-20T23:28:05.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 -- 172.21.15.12:0/3128452923 shutdown_connections 2021-10-20T23:28:05.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/3128452923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c144940 0x7f8b0c0a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/3128452923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c0601a0 0x7f8b0c144450 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/3128452923 >> v2:172.21.15.31:3300/0 conn(0x7f8b0c0af3c0 0x7f8b0c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 -- 172.21.15.12:0/3128452923 >> 172.21.15.12:0/3128452923 conn(0x7f8b0c061140 msgr2=0x7f8b0c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:06.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 -- 172.21.15.12:0/3128452923 shutdown_connections 2021-10-20T23:28:06.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 -- 172.21.15.12:0/3128452923 wait complete. 2021-10-20T23:28:06.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 Processor -- start 2021-10-20T23:28:06.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.981+0000 7f8b0b59e700 1 -- start start 2021-10-20T23:28:06.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b0c0601a0 0x7f8b0c09ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c0af3c0 0x7f8b0c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c144940 0x7f8b0c150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c09f2f0 con 0x7f8b0c144940 2021-10-20T23:28:06.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0665b0 con 0x7f8b0c0601a0 2021-10-20T23:28:06.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0b59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c150700 con 0x7f8b0c0af3c0 2021-10-20T23:28:06.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c144940 0x7f8b0c150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b09d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c0af3c0 0x7f8b0c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c144940 0x7f8b0c150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43910/0 (socket says 172.21.15.12:43910) 2021-10-20T23:28:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0ad9d700 1 -- 172.21.15.12:0/2790344162 learned_addr learned my addr 172.21.15.12:0/2790344162 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0a59c700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b0c0601a0 0x7f8b0c09ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0ad9d700 1 -- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c0af3c0 msgr2=0x7f8b0c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0ad9d700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c0af3c0 0x7f8b0c14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0ad9d700 1 -- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b0c0601a0 msgr2=0x7f8b0c09ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0ad9d700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b0c0601a0 0x7f8b0c09ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0ad9d700 1 -- 172.21.15.12:0/2790344162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af400b1e0 con 0x7f8b0c144940 2021-10-20T23:28:06.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0ad9d700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c144940 0x7f8b0c150210 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f8b0c066d90 tx=0x7f8b040091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:06.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b037fe700 1 -- 172.21.15.12:0/2790344162 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0400c640 con 0x7f8b0c144940 2021-10-20T23:28:06.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b037fe700 1 -- 172.21.15.12:0/2790344162 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0400c7a0 con 0x7f8b0c144940 2021-10-20T23:28:06.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c064a10 con 0x7f8b0c144940 2021-10-20T23:28:06.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b037fe700 1 -- 172.21.15.12:0/2790344162 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0400cb00 con 0x7f8b0c144940 2021-10-20T23:28:06.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c064020 con 0x7f8b0c144940 2021-10-20T23:28:06.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.985+0000 7f8b037fe700 1 -- 172.21.15.12:0/2790344162 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b0400cc60 con 0x7f8b0c144940 2021-10-20T23:28:06.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.989+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c064660 con 0x7f8b0c144940 2021-10-20T23:28:06.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.989+0000 7f8b037fe700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8af0053580 0x7f8af0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.989+0000 7f8b037fe700 1 -- 172.21.15.12:0/2790344162 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8b0406bca0 con 0x7f8b0c144940 2021-10-20T23:28:06.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.989+0000 7f8b0a59c700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8af0053580 0x7f8af0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.989+0000 7f8b0a59c700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8af0053580 0x7f8af0055a40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8afc00c000 tx=0x7f8afc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:06.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:05.993+0000 7f8b037fe700 1 -- 172.21.15.12:0/2790344162 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b04070070 con 0x7f8b0c144940 2021-10-20T23:28:06.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.121+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b0c057350 con 0x7f8b0c144940 2021-10-20T23:28:06.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.121+0000 7f8b037fe700 1 -- 172.21.15.12:0/2790344162 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8b04043070 con 0x7f8b0c144940 2021-10-20T23:28:06.133 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8af0053580 msgr2=0x7f8af0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8af0053580 0x7f8af0055a40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8afc00c000 tx=0x7f8afc008040).stop 2021-10-20T23:28:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c144940 msgr2=0x7f8b0c150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c144940 0x7f8b0c150210 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f8b0c066d90 tx=0x7f8b040091d0).stop 2021-10-20T23:28:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 shutdown_connections 2021-10-20T23:28:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8af0053580 0x7f8af0055a40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b0c144940 0x7f8b0c150210 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b0c0af3c0 0x7f8b0c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 --2- 172.21.15.12:0/2790344162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b0c0601a0 0x7f8b0c09ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 >> 172.21.15.12:0/2790344162 conn(0x7f8b0c061140 msgr2=0x7f8b0c0a8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 shutdown_connections 2021-10-20T23:28:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.125+0000 7f8b0b59e700 1 -- 172.21.15.12:0/2790344162 wait complete. 2021-10-20T23:28:06.151 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:28:06.151 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:06.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.241+0000 7f5bdc88e700 1 Processor -- start 2021-10-20T23:28:06.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.241+0000 7f5bdc88e700 1 -- start start 2021-10-20T23:28:06.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.241+0000 7f5bdc88e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5bd80af3c0 0x7f5bd80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.241+0000 7f5bdc88e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80601a0 0x7f5bd8144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.241+0000 7f5bdc88e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80aa4a0 con 0x7f5bd8144940 2021-10-20T23:28:06.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.241+0000 7f5bdc88e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd80b1450 con 0x7f5bd80af3c0 2021-10-20T23:28:06.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.241+0000 7f5bdc88e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80af7a0 con 0x7f5bd80601a0 2021-10-20T23:28:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.241+0000 7f5bd77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5bd80af3c0 0x7f5bd80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.241+0000 7f5bd77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5bd80af3c0 0x7f5bd80b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43914/0 (socket says 172.21.15.12:43914) 2021-10-20T23:28:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd77fe700 1 -- 172.21.15.12:0/250470405 learned_addr learned my addr 172.21.15.12:0/250470405 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd6ffd700 1 --2- 172.21.15.12:0/250470405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80601a0 0x7f5bd8144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd77fe700 1 -- 172.21.15.12:0/250470405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80601a0 msgr2=0x7f5bd8144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:06.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd77fe700 1 --2- 172.21.15.12:0/250470405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80601a0 0x7f5bd8144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd77fe700 1 -- 172.21.15.12:0/250470405 >> v1:172.21.15.31:6789/0 conn(0x7f5bd8144940 legacy=0x7f5bd80a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd77fe700 1 -- 172.21.15.12:0/250470405 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd805fb80 con 0x7f5bd80af3c0 2021-10-20T23:28:06.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd6ffd700 1 --2- 172.21.15.12:0/250470405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80601a0 0x7f5bd8144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:06.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd77fe700 1 --2- 172.21.15.12:0/250470405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd80af3c0 0x7f5bd80b0cb0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f5bc8002f70 tx=0x7f5bc8006eb0).ready entity=mon.0 client_cookie=423a87fe188393f4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:06.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd67fc700 1 -- 172.21.15.12:0/250470405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bc800d5c0 con 0x7f5bd80af3c0 2021-10-20T23:28:06.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd67fc700 1 -- 172.21.15.12:0/250470405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc8000e90 con 0x7f5bd80af3c0 2021-10-20T23:28:06.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bd67fc700 1 -- 172.21.15.12:0/250470405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bc800d950 con 0x7f5bd80af3c0 2021-10-20T23:28:06.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 -- 172.21.15.12:0/250470405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd80af3c0 msgr2=0x7f5bd80b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 --2- 172.21.15.12:0/250470405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd80af3c0 0x7f5bd80b0cb0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f5bc8002f70 tx=0x7f5bc8006eb0).stop 2021-10-20T23:28:06.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 -- 172.21.15.12:0/250470405 shutdown_connections 2021-10-20T23:28:06.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 --2- 172.21.15.12:0/250470405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80601a0 0x7f5bd8144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 --2- 172.21.15.12:0/250470405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd80af3c0 0x7f5bd80b0cb0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 -- 172.21.15.12:0/250470405 >> 172.21.15.12:0/250470405 conn(0x7f5bd8061140 msgr2=0x7f5bd8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 -- 172.21.15.12:0/250470405 shutdown_connections 2021-10-20T23:28:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 -- 172.21.15.12:0/250470405 wait complete. 2021-10-20T23:28:06.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 Processor -- start 2021-10-20T23:28:06.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.245+0000 7f5bdc88e700 1 -- start start 2021-10-20T23:28:06.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bdc88e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd80601a0 0x7f5bd8064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bdc88e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80af3c0 0x7f5bd8064b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bdc88e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd8144940 0x7f5bd8066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bdc88e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8141880 con 0x7f5bd8144940 2021-10-20T23:28:06.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bdc88e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8153ed0 con 0x7f5bd80601a0 2021-10-20T23:28:06.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bdc88e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8154330 con 0x7f5bd80af3c0 2021-10-20T23:28:06.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd8144940 0x7f5bd8066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd8144940 0x7f5bd8066ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43924/0 (socket says 172.21.15.12:43924) 2021-10-20T23:28:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd7fff700 1 -- 172.21.15.12:0/675899303 learned_addr learned my addr 172.21.15.12:0/675899303 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd77fe700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd80601a0 0x7f5bd8064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd6ffd700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80af3c0 0x7f5bd8064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd7fff700 1 -- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80af3c0 msgr2=0x7f5bd8064b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd7fff700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80af3c0 0x7f5bd8064b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd7fff700 1 -- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd80601a0 msgr2=0x7f5bd8064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd7fff700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd80601a0 0x7f5bd8064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd7fff700 1 -- 172.21.15.12:0/675899303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc800b1e0 con 0x7f5bd8144940 2021-10-20T23:28:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd7fff700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd8144940 0x7f5bd8066ea0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f5bd80b02c0 tx=0x7f5bd0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd4ff9700 1 -- 172.21.15.12:0/675899303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd000cea0 con 0x7f5bd8144940 2021-10-20T23:28:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd4ff9700 1 -- 172.21.15.12:0/675899303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd0006aa0 con 0x7f5bd8144940 2021-10-20T23:28:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd805f6b0 con 0x7f5bd8144940 2021-10-20T23:28:06.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd4ff9700 1 -- 172.21.15.12:0/675899303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd0006e00 con 0x7f5bd8144940 2021-10-20T23:28:06.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd8141ab0 con 0x7f5bd8144940 2021-10-20T23:28:06.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd8154040 con 0x7f5bd8144940 2021-10-20T23:28:06.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.249+0000 7f5bd4ff9700 1 -- 172.21.15.12:0/675899303 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5bd0010030 con 0x7f5bd8144940 2021-10-20T23:28:06.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.253+0000 7f5bd4ff9700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bb8053540 0x7f5bb8055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:06.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.253+0000 7f5bd4ff9700 1 -- 172.21.15.12:0/675899303 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5bd006b7f0 con 0x7f5bd8144940 2021-10-20T23:28:06.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.253+0000 7f5bd77fe700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bb8053540 0x7f5bb8055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:06.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.253+0000 7f5bd77fe700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bb8053540 0x7f5bb8055a00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f5bc801c000 tx=0x7f5bc8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:06.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.257+0000 7f5bd4ff9700 1 -- 172.21.15.12:0/675899303 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5bd00427f0 con 0x7f5bd8144940 2021-10-20T23:28:06.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.421+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bd805f8e0 con 0x7f5bd8144940 2021-10-20T23:28:06.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bd4ff9700 1 -- 172.21.15.12:0/675899303 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f5bd0045e10 con 0x7f5bd8144940 2021-10-20T23:28:06.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:06.435 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":60,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7593,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/164978387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":164978387},{"type":"v1","addr":"172.21.15.12:6833","nonce":164978387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59},{"gid":7600,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/865815505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":865815505},{"type":"v1","addr":"172.21.15.31:6835","nonce":865815505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:27:58.046238+0000","modified":"2021-10-20T23:27:59.064679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1094154714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1094154714},{"type":"v1","addr":"172.21.15.12:6835","nonce":1094154714}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-10-20T23:28:06.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bb8053540 msgr2=0x7f5bb8055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bb8053540 0x7f5bb8055a00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f5bc801c000 tx=0x7f5bc8015000).stop 2021-10-20T23:28:06.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd8144940 msgr2=0x7f5bd8066ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:06.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd8144940 0x7f5bd8066ea0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f5bd80b02c0 tx=0x7f5bd0007f70).stop 2021-10-20T23:28:06.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 shutdown_connections 2021-10-20T23:28:06.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5bb8053540 0x7f5bb8055a00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bd8144940 0x7f5bd8066ea0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bd80af3c0 0x7f5bd8064b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 --2- 172.21.15.12:0/675899303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd80601a0 0x7f5bd8064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:06.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 >> 172.21.15.12:0/675899303 conn(0x7f5bd8061140 msgr2=0x7f5bd8062de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:06.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 shutdown_connections 2021-10-20T23:28:06.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:06.425+0000 7f5bdc88e700 1 -- 172.21.15.12:0/675899303 wait complete. 2021-10-20T23:28:06.443 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 60 2021-10-20T23:28:06.749 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:27:58.046238+0000', 'modified': '2021-10-20T23:27:59.064679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7605}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7605': {'gid': 7605, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1094154714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1094154714}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1094154714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:28:06.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:28:06.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-20T23:28:06.873 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":7605,"want_state":"up:active","state":"up:active","rank_uptime":8.8064674039999993,"mdsmap_epoch":60,"osdmap_epoch":122,"osdmap_epoch_barrier":121,"uptime":13.104871644999999} 2021-10-20T23:28:06.874 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 7605, "mdsmap_epoch": 60, "osdmap_epoch": 122, "osdmap_epoch_barrier": 121, "rank_uptime": 8.806467404, "state": "up:active", "uptime": 13.104871645, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:28:06.875 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:28:06.875 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:28:06.875 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:28:06.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:06.876 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:06.886 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:28:06.945 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:06.947 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:06.960 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:06.960 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:06.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:06.962 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:28:06.968 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:28:06.968 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:07.012 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:28:07.030 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:07.031 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:07.041 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:07.043 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:07.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:07.044 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:28:07.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14306]: starting ceph client2021-10-20T23:28:07.081+0000 7f8f5850b080 -1 init, newargv = 0x55b349f6eba0 newargc=9 2021-10-20T23:28:07.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr: 2021-10-20T23:28:07.098 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14306]: starting fuse 2021-10-20T23:28:07.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:28:07.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:28:07.453 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:28:07.455 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:28:08.195 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:28:08.214 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:08.215 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:08.228 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:08.229 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:08.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:08.230 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:28:08.236 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:28:08.236 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:28:08.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:08.238 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:28:08.238 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:28:08.239 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:28:08.239 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:28:08.240 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:28:08.240 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:08.240 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:28:08.241 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:28:08.242 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:28:08.242 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:08.243 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:28:08.243 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:28:08.243 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:28:08.244 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:28:08.244 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:08.245 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:28:08.246 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:28:08.246 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:28:08.247 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:28:08.247 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:28:08.247 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:08.248 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:28:08.248 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:28:08.326 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.14306.asok 2021-10-20T23:28:08.329 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14306.asok 2021-10-20T23:28:08.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:08.330 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14306.asok status 2021-10-20T23:28:08.423 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:28:08.424 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:28:08.424 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:28:08.424 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:28:08.425 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:28:08.425 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:28:08.425 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:28:08.426 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "14306", 2021-10-20T23:28:08.426 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:28:08.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:08.426 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:28:08.426 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:28:08.427 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 7815, 2021-10-20T23:28:08.427 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:28:08.427 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:28:08.427 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:28:08.428 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 7815 2021-10-20T23:28:08.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:08.428 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:28:08.428 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:28:08.428 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:28:08.429 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 544219417 2021-10-20T23:28:08.429 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:28:08.429 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:08.429 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:28:08.429 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:28:08.430 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:28:08.430 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 544219417 2021-10-20T23:28:08.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:08.430 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.7815 172.21.15.136:0/544219417", 2021-10-20T23:28:08.431 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/544219417", 2021-10-20T23:28:08.431 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:28:08.431 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 60, 2021-10-20T23:28:08.431 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 122, 2021-10-20T23:28:08.431 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:28:08.432 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:28:08.432 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:28:08.432 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:28:08.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:08.434 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:08.434 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:08.442 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:28:08.444 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:08.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:08.446 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:08.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:08.465 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:08.466 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:08.477 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:28:08.477 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:28:08.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:08.478 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:08.478 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:08.526 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:28:08.527 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:28:08.528 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:28:08.533 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:28:08.534 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:08.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14810]: fuse finished with error 0 and tester_r 0 2021-10-20T23:28:08.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:08.556 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:08.557 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:08.609 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:28:08.609 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:28:08.609 INFO:teuthology.orchestra.run:waiting for 900 2021-10-20T23:28:14.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:28:14.715 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:14.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:14.724 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:14.724 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:14.733 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:28:14.734 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:14.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:14.735 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:14.736 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:14.743 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:28:14.745 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:14.745 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:28:14.746 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:28:14.746 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:14.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14306]: fuse finished with error 0 and tester_r 0 2021-10-20T23:28:14.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:14.804 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:14.804 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:14.810 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:28:14.811 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:28:14.812 INFO:teuthology.orchestra.run:waiting for 900 2021-10-20T23:28:14.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:28:14.893 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:14.901 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:28:14.902 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:28:14.902 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:28:14.903 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:28:14.903 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:28:14.903 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:28:14.919 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:28:14.920 DEBUG:teuthology.parallel:result is None 2021-10-20T23:28:14.921 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:28:14.921 DEBUG:teuthology.parallel:result is None 2021-10-20T23:28:14.922 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:28:14.923 DEBUG:teuthology.parallel:result is None 2021-10-20T23:28:14.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2021-10-20T23:28:14.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2021-10-20T23:28:14.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2021-10-20T23:28:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19cac5c700 1 Processor -- start 2021-10-20T23:28:15.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19cac5c700 1 -- start start 2021-10-20T23:28:15.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19cac5c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19c40b6580 0x7f19c40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19cac5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c40b43c0 0x7f19c40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19cac5c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c41440b0 con 0x7f19c4061d30 2021-10-20T23:28:15.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19cac5c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c40b6e50 con 0x7f19c40b6580 2021-10-20T23:28:15.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19cac5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4143b70 con 0x7f19c40b43c0 2021-10-20T23:28:15.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c89f8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19c40b6580 0x7f19c40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c40b43c0 0x7f19c40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c40b43c0 0x7f19c40b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:49686/0 (socket says 172.21.15.12:49686) 2021-10-20T23:28:15.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c3fff700 1 -- 172.21.15.12:0/985435203 learned_addr learned my addr 172.21.15.12:0/985435203 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:15.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c89f8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19c40b6580 0x7f19c40b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43930/0 (socket says 172.21.15.12:43930) 2021-10-20T23:28:15.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c3fff700 1 -- 172.21.15.12:0/985435203 >> v2:172.21.15.12:3300/0 conn(0x7f19c40b6580 msgr2=0x7f19c40b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:15.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c3fff700 1 --2- 172.21.15.12:0/985435203 >> v2:172.21.15.12:3300/0 conn(0x7f19c40b6580 0x7f19c40b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c37fe700 1 -- 172.21.15.12:0/985435203 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578184763 0 0) 0x7f19c41440b0 con 0x7f19c4061d30 2021-10-20T23:28:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c3fff700 1 -- 172.21.15.12:0/985435203 >> v1:172.21.15.31:6789/0 conn(0x7f19c4061d30 legacy=0x7f19c41466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c3fff700 1 -- 172.21.15.12:0/985435203 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c4143e10 con 0x7f19c40b43c0 2021-10-20T23:28:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c3fff700 1 --2- 172.21.15.12:0/985435203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c40b43c0 0x7f19c40b6960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f19b8002f70 tx=0x7f19b8006eb0).ready entity=mon.2 client_cookie=845c07c7da97a97a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c37fe700 1 -- 172.21.15.12:0/985435203 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19b800d570 con 0x7f19c40b43c0 2021-10-20T23:28:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c37fe700 1 -- 172.21.15.12:0/985435203 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b8000e90 con 0x7f19c40b43c0 2021-10-20T23:28:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.057+0000 7f19c37fe700 1 -- 172.21.15.12:0/985435203 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19b800d8c0 con 0x7f19c40b43c0 2021-10-20T23:28:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 -- 172.21.15.12:0/985435203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c40b43c0 msgr2=0x7f19c40b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 --2- 172.21.15.12:0/985435203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c40b43c0 0x7f19c40b6960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f19b8002f70 tx=0x7f19b8006eb0).stop 2021-10-20T23:28:15.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 -- 172.21.15.12:0/985435203 shutdown_connections 2021-10-20T23:28:15.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 --2- 172.21.15.12:0/985435203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c40b43c0 0x7f19c40b6960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 --2- 172.21.15.12:0/985435203 >> v2:172.21.15.12:3300/0 conn(0x7f19c40b6580 0x7f19c40b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 -- 172.21.15.12:0/985435203 >> 172.21.15.12:0/985435203 conn(0x7f19c405c490 msgr2=0x7f19c405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:15.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 -- 172.21.15.12:0/985435203 shutdown_connections 2021-10-20T23:28:15.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 -- 172.21.15.12:0/985435203 wait complete. 2021-10-20T23:28:15.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 Processor -- start 2021-10-20T23:28:15.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.061+0000 7f19cac5c700 1 -- start start 2021-10-20T23:28:15.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19cac5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c4061d30 0x7f19c40ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19cac5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c40b43c0 0x7f19c414f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19cac5c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c40b6580 0x7f19c414fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19cac5c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c41567b0 con 0x7f19c40b6580 2021-10-20T23:28:15.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19cac5c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40ade40 con 0x7f19c40b43c0 2021-10-20T23:28:15.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19cac5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40ae1e0 con 0x7f19c4061d30 2021-10-20T23:28:15.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c91f9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c40b6580 0x7f19c414fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c91f9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c40b6580 0x7f19c414fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43938/0 (socket says 172.21.15.12:43938) 2021-10-20T23:28:15.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c91f9700 1 -- 172.21.15.12:0/1141411269 learned_addr learned my addr 172.21.15.12:0/1141411269 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:15.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c89f8700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c4061d30 0x7f19c40ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c3fff700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c40b43c0 0x7f19c414f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c91f9700 1 -- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c4061d30 msgr2=0x7f19c40ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c91f9700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c4061d30 0x7f19c40ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c91f9700 1 -- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c40b43c0 msgr2=0x7f19c414f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c91f9700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c40b43c0 0x7f19c414f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c91f9700 1 -- 172.21.15.12:0/1141411269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b800b1e0 con 0x7f19c40b6580 2021-10-20T23:28:15.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c91f9700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c40b6580 0x7f19c414fed0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f19bc000f40 tx=0x7f19bc007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c1ffb700 1 -- 172.21.15.12:0/1141411269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19bc00f470 con 0x7f19c40b6580 2021-10-20T23:28:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c1ffb700 1 -- 172.21.15.12:0/1141411269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00f5d0 con 0x7f19c40b6580 2021-10-20T23:28:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19c1ffb700 1 -- 172.21.15.12:0/1141411269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19bc00f930 con 0x7f19c40b6580 2021-10-20T23:28:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c4156410 con 0x7f19c40b6580 2021-10-20T23:28:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c412b300 con 0x7f19c40b6580 2021-10-20T23:28:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.065+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c4156600 con 0x7f19c40b6580 2021-10-20T23:28:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.069+0000 7f19c1ffb700 1 -- 172.21.15.12:0/1141411269 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f19bc010070 con 0x7f19c40b6580 2021-10-20T23:28:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.069+0000 7f19c1ffb700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19a40536a0 0x7f19a4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.069+0000 7f19c1ffb700 1 -- 172.21.15.12:0/1141411269 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f19bc06ad70 con 0x7f19c40b6580 2021-10-20T23:28:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.069+0000 7f19c89f8700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19a40536a0 0x7f19a4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.069+0000 7f19c89f8700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19a40536a0 0x7f19a4055b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f19b000b000 tx=0x7f19b0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.073+0000 7f19c1ffb700 1 -- 172.21.15.12:0/1141411269 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f19bc041d10 con 0x7f19c40b6580 2021-10-20T23:28:15.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc581511700 1 Processor -- start 2021-10-20T23:28:15.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc581511700 1 -- start start 2021-10-20T23:28:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc581511700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 0x7fc57c1467e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc581511700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc57c0aa080 0x7fc57c146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc581511700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c0ac550 con 0x7fc57c0b6760 2021-10-20T23:28:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc581511700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c0ac7f0 con 0x7fc57c0aa080 2021-10-20T23:28:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc581511700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0aca90 con 0x7fc57c13d400 2021-10-20T23:28:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc57b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc57c0aa080 0x7fc57c146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc57b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc57c0aa080 0x7fc57c146cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43946/0 (socket says 172.21.15.12:43946) 2021-10-20T23:28:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc57b7fe700 1 -- 172.21.15.12:0/1716476429 learned_addr learned my addr 172.21.15.12:0/1716476429 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc57a7fc700 1 --2- 172.21.15.12:0/1716476429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 0x7fc57c1467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc57b7fe700 1 -- 172.21.15.12:0/1716476429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 msgr2=0x7fc57c1467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:15.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc57b7fe700 1 --2- 172.21.15.12:0/1716476429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 0x7fc57c1467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc57b7fe700 1 -- 172.21.15.12:0/1716476429 >> v1:172.21.15.31:6789/0 conn(0x7fc57c0b6760 legacy=0x7fc57c13ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc57b7fe700 1 -- 172.21.15.12:0/1716476429 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0acd30 con 0x7fc57c0aa080 2021-10-20T23:28:15.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc57b7fe700 1 --2- 172.21.15.12:0/1716476429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0aa080 0x7fc57c146cd0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fc5740032f0 tx=0x7fc574009290).ready entity=mon.0 client_cookie=708e3e955326536a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:15.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc579ffb700 1 -- 172.21.15.12:0/1716476429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57400b8a0 con 0x7fc57c0aa080 2021-10-20T23:28:15.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc579ffb700 1 -- 172.21.15.12:0/1716476429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400ba00 con 0x7fc57c0aa080 2021-10-20T23:28:15.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.081+0000 7fc579ffb700 1 -- 172.21.15.12:0/1716476429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57400bb70 con 0x7fc57c0aa080 2021-10-20T23:28:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 Processor -- start 2021-10-20T23:28:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 -- start start 2021-10-20T23:28:15.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 -- 172.21.15.12:0/1716476429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0aa080 msgr2=0x7fc57c146cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 --2- 172.21.15.12:0/1716476429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0aa080 0x7fc57c146cd0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fc5740032f0 tx=0x7fc574009290).stop 2021-10-20T23:28:15.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 -- 172.21.15.12:0/1716476429 shutdown_connections 2021-10-20T23:28:15.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 --2- 172.21.15.12:0/1716476429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0aa080 0x7fc57c146cd0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 --2- 172.21.15.12:0/1716476429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 0x7fc57c1467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 -- 172.21.15.12:0/1716476429 >> 172.21.15.12:0/1716476429 conn(0x7fc57c0b3480 msgr2=0x7fc57c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:15.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 -- 172.21.15.12:0/1716476429 shutdown_connections 2021-10-20T23:28:15.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 -- 172.21.15.12:0/1716476429 wait complete. 2021-10-20T23:28:15.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcacc0a9060 0x7fcacc0aca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc13f800 0x7fcacc13fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc0a9c30 con 0x7fcacc0a9850 2021-10-20T23:28:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc143080 con 0x7fcacc0a9060 2021-10-20T23:28:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc143320 con 0x7fcacc13f800 2021-10-20T23:28:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad0ed3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcacc0a9850 0x7fcacc0a8950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:49606/0 (socket says 172.21.15.12:49606) 2021-10-20T23:28:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad0ed3700 1 -- 172.21.15.12:0/1388904863 learned_addr learned my addr 172.21.15.12:0/1388904863 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacbfff700 1 --2- 172.21.15.12:0/1388904863 >> v2:172.21.15.31:3300/0 conn(0x7fcacc0a9060 0x7fcacc0aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad16d4700 1 --2- 172.21.15.12:0/1388904863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc13f800 0x7fcacc13fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacb7fe700 1 -- 172.21.15.12:0/1388904863 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067469366 0 0) 0x7fcacc0a9c30 con 0x7fcacc0a9850 2021-10-20T23:28:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacb7fe700 1 -- 172.21.15.12:0/1388904863 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab8003260 con 0x7fcacc0a9850 2021-10-20T23:28:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacbfff700 1 -- 172.21.15.12:0/1388904863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc13f800 msgr2=0x7fcacc13fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacbfff700 1 --2- 172.21.15.12:0/1388904863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc13f800 0x7fcacc13fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacbfff700 1 -- 172.21.15.12:0/1388904863 >> v1:172.21.15.31:6789/0 conn(0x7fcacc0a9850 legacy=0x7fcacc0a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacbfff700 1 -- 172.21.15.12:0/1388904863 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc1435c0 con 0x7fcacc0a9060 2021-10-20T23:28:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacbfff700 1 --2- 172.21.15.12:0/1388904863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcacc0a9060 0x7fcacc0aca70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fcac0002f70 tx=0x7fcac0006df0).ready entity=mon.1 client_cookie=78f9725c9da26a38 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 Processor -- start 2021-10-20T23:28:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fc581511700 1 -- start start 2021-10-20T23:28:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacb7fe700 1 -- 172.21.15.12:0/1388904863 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac000d4a0 con 0x7fcacc0a9060 2021-10-20T23:28:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacb7fe700 1 -- 172.21.15.12:0/1388904863 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0000e90 con 0x7fcacc0a9060 2021-10-20T23:28:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcacb7fe700 1 -- 172.21.15.12:0/1388904863 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac000d7f0 con 0x7fcacc0a9060 2021-10-20T23:28:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 -- 172.21.15.12:0/1388904863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcacc0a9060 msgr2=0x7fcacc0aca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 --2- 172.21.15.12:0/1388904863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcacc0a9060 0x7fcacc0aca70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fcac0002f70 tx=0x7fcac0006df0).stop 2021-10-20T23:28:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 -- 172.21.15.12:0/1388904863 shutdown_connections 2021-10-20T23:28:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 --2- 172.21.15.12:0/1388904863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc13f800 0x7fcacc13fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 --2- 172.21.15.12:0/1388904863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcacc0a9060 0x7fcacc0aca70 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 -- 172.21.15.12:0/1388904863 >> 172.21.15.12:0/1388904863 conn(0x7fcacc0608d0 msgr2=0x7fcacc060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 -- 172.21.15.12:0/1388904863 shutdown_connections 2021-10-20T23:28:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.085+0000 7fcad3137700 1 -- 172.21.15.12:0/1388904863 wait complete. 2021-10-20T23:28:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc581511700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0aa080 0x7fc57c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc581511700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6760 0x7fc57c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc581511700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 0x7fc57c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc581511700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1469a0 con 0x7fc57c0b6760 2021-10-20T23:28:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc581511700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c146610 con 0x7fc57c0aa080 2021-10-20T23:28:15.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc581511700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c146bd0 con 0x7fc57c13d400 2021-10-20T23:28:15.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6760 0x7fc57c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6760 0x7fc57c152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43956/0 (socket says 172.21.15.12:43956) 2021-10-20T23:28:15.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57a7fc700 1 -- 172.21.15.12:0/1949719975 learned_addr learned my addr 172.21.15.12:0/1949719975 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:15.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57affd700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0aa080 0x7fc57c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57b7fe700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 0x7fc57c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 Processor -- start 2021-10-20T23:28:15.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 -- start start 2021-10-20T23:28:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57a7fc700 1 -- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 msgr2=0x7fc57c152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57a7fc700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 0x7fc57c152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57a7fc700 1 -- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0aa080 msgr2=0x7fc57c0b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57a7fc700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0aa080 0x7fc57c0b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57a7fc700 1 -- 172.21.15.12:0/1949719975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009530 con 0x7fc57c0b6760 2021-10-20T23:28:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc57a7fc700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6760 0x7fc57c152690 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fc57000c000 tx=0x7fc570006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc56bfff700 1 -- 172.21.15.12:0/1949719975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc570011750 con 0x7fc57c0b6760 2021-10-20T23:28:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc56bfff700 1 -- 172.21.15.12:0/1949719975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5700118b0 con 0x7fc57c0b6760 2021-10-20T23:28:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c146e70 con 0x7fc57c0b6760 2021-10-20T23:28:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc56bfff700 1 -- 172.21.15.12:0/1949719975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc570011c10 con 0x7fc57c0b6760 2021-10-20T23:28:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c1474d0 con 0x7fc57c0b6760 2021-10-20T23:28:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcacc0a9060 0x7fcacc153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc0a9850 0x7fcacc13ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcacc13f800 0x7fcacc066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc066840 con 0x7fcacc13f800 2021-10-20T23:28:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc065520 con 0x7fcacc0a9060 2021-10-20T23:28:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0657c0 con 0x7fcacc0a9850 2021-10-20T23:28:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad16d4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcacc13f800 0x7fcacc066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad16d4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcacc13f800 0x7fcacc066c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43962/0 (socket says 172.21.15.12:43962) 2021-10-20T23:28:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad16d4700 1 -- 172.21.15.12:0/4234261273 learned_addr learned my addr 172.21.15.12:0/4234261273 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad0ed3700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcacc0a9060 0x7fcacc153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcacbfff700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc0a9850 0x7fcacc13ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad16d4700 1 -- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc0a9850 msgr2=0x7fcacc13ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad16d4700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc0a9850 0x7fcacc13ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad16d4700 1 -- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcacc0a9060 msgr2=0x7fcacc153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad16d4700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcacc0a9060 0x7fcacc153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad16d4700 1 -- 172.21.15.12:0/4234261273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac000b180 con 0x7fcacc13f800 2021-10-20T23:28:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad16d4700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcacc13f800 0x7fcacc066c70 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fcac4006e00 tx=0x7fcac40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c147000 con 0x7fc57c0b6760 2021-10-20T23:28:15.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcac9ffb700 1 -- 172.21.15.12:0/4234261273 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac4012600 con 0x7fcacc13f800 2021-10-20T23:28:15.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcac9ffb700 1 -- 172.21.15.12:0/4234261273 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4012760 con 0x7fcacc13f800 2021-10-20T23:28:15.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc065a60 con 0x7fcacc13f800 2021-10-20T23:28:15.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcac9ffb700 1 -- 172.21.15.12:0/4234261273 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac4012ac0 con 0x7fcacc13f800 2021-10-20T23:28:15.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc067160 con 0x7fcacc13f800 2021-10-20T23:28:15.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.089+0000 7fc56bfff700 1 -- 172.21.15.12:0/1949719975 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc570011d70 con 0x7fc57c0b6760 2021-10-20T23:28:15.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.093+0000 7fc56bfff700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc558053520 0x7fc5580559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.093+0000 7fc56bfff700 1 -- 172.21.15.12:0/1949719975 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc57006bf40 con 0x7fc57c0b6760 2021-10-20T23:28:15.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.093+0000 7fc57affd700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc558053520 0x7fc5580559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.093+0000 7fcac9ffb700 1 -- 172.21.15.12:0/4234261273 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcac4022070 con 0x7fcacc13f800 2021-10-20T23:28:15.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.093+0000 7fc57affd700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc558053520 0x7fc5580559e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fc56c00d000 tx=0x7fc56c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:15.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.093+0000 7fcac9ffb700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaac053610 0x7fcaac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:15.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.093+0000 7fcac9ffb700 1 -- 172.21.15.12:0/4234261273 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcac406c090 con 0x7fcacc13f800 2021-10-20T23:28:15.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.093+0000 7fcad0ed3700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaac053610 0x7fcaac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:15.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.093+0000 7fcad0ed3700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaac053610 0x7fcaac055ad0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fcabc00d000 tx=0x7fcabc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:15.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.097+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc066980 con 0x7fcacc13f800 2021-10-20T23:28:15.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.097+0000 7fc56bfff700 1 -- 172.21.15.12:0/1949719975 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc570042e40 con 0x7fc57c0b6760 2021-10-20T23:28:15.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.105+0000 7fcac9ffb700 1 -- 172.21.15.12:0/4234261273 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcac4016020 con 0x7fcacc13f800 2021-10-20T23:28:15.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.265+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fc57c057350 con 0x7fc57c0b6760 2021-10-20T23:28:15.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.321+0000 7fc56bfff700 1 -- 172.21.15.12:0/1949719975 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7600 v61) v1 ==== 95+0+0 (secure 0 0 0) 0x7fc570046460 con 0x7fc57c0b6760 2021-10-20T23:28:15.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc558053520 msgr2=0x7fc5580559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc558053520 0x7fc5580559e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fc56c00d000 tx=0x7fc56c009040).stop 2021-10-20T23:28:15.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6760 msgr2=0x7fc57c152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:15.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6760 0x7fc57c152690 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fc57000c000 tx=0x7fc570006df0).stop 2021-10-20T23:28:15.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 shutdown_connections 2021-10-20T23:28:15.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc558053520 0x7fc5580559e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c13d400 0x7fc57c152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6760 0x7fc57c152690 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 --2- 172.21.15.12:0/1949719975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0aa080 0x7fc57c0b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:15.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 >> 172.21.15.12:0/1949719975 conn(0x7fc57c0b3480 msgr2=0x7fc57c13c550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:15.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 shutdown_connections 2021-10-20T23:28:15.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7fc581511700 1 -- 172.21.15.12:0/1949719975 wait complete. 2021-10-20T23:28:15.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.325+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f19c4146990 con 0x7f19c40b6580 2021-10-20T23:28:15.340 INFO:teuthology.orchestra.run.smithi012.stderr:failed mds gid 7600 2021-10-20T23:28:15.350 DEBUG:teuthology.parallel:result is '' 2021-10-20T23:28:15.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:15.357+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fcacc057350 con 0x7fcacc13f800 2021-10-20T23:28:16.337 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:28:16.325+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:28:16.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.337+0000 7f19c1ffb700 1 -- 172.21.15.12:0/1141411269 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7605 v62) v1 ==== 95+0+0 (secure 0 0 0) 0x7f19bc045330 con 0x7f19c40b6580 2021-10-20T23:28:16.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.337+0000 7fcac9ffb700 1 -- 172.21.15.12:0/4234261273 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7593 v62) v1 ==== 95+0+0 (secure 0 0 0) 0x7fcac4016020 con 0x7fcacc13f800 2021-10-20T23:28:16.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaac053610 msgr2=0x7fcaac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:16.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaac053610 0x7fcaac055ad0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fcabc00d000 tx=0x7fcabc009040).stop 2021-10-20T23:28:16.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcacc13f800 msgr2=0x7fcacc066c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:16.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcacc13f800 0x7fcacc066c70 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fcac4006e00 tx=0x7fcac40091d0).stop 2021-10-20T23:28:16.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19a40536a0 msgr2=0x7f19a4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:16.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19a40536a0 0x7f19a4055b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f19b000b000 tx=0x7f19b0006df0).stop 2021-10-20T23:28:16.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c40b6580 msgr2=0x7f19c414fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:16.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c40b6580 0x7f19c414fed0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f19bc000f40 tx=0x7f19bc007d60).stop 2021-10-20T23:28:16.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 shutdown_connections 2021-10-20T23:28:16.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcaac053610 0x7fcaac055ad0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcacc13f800 0x7fcacc066c70 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcacc0a9850 0x7fcacc13ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 --2- 172.21.15.12:0/4234261273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcacc0a9060 0x7fcacc153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 >> 172.21.15.12:0/4234261273 conn(0x7fcacc0608d0 msgr2=0x7fcacc0af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:16.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 shutdown_connections 2021-10-20T23:28:16.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f19a40536a0 0x7f19a4055b60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c40b6580 0x7f19c414fed0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c40b43c0 0x7f19c414f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 --2- 172.21.15.12:0/1141411269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19c4061d30 0x7f19c40ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 >> 172.21.15.12:0/1141411269 conn(0x7f19c405c490 msgr2=0x7f19c41444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:16.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 shutdown_connections 2021-10-20T23:28:16.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 shutdown_connections 2021-10-20T23:28:16.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7f19cac5c700 1 -- 172.21.15.12:0/1141411269 wait complete. 2021-10-20T23:28:16.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.341+0000 7fcad3137700 1 -- 172.21.15.12:0/4234261273 wait complete. 2021-10-20T23:28:16.360 INFO:teuthology.orchestra.run.smithi012.stderr:failed mds gid 7593 2021-10-20T23:28:16.360 INFO:teuthology.orchestra.run.smithi012.stderr:failed mds gid 7605 2021-10-20T23:28:16.369 DEBUG:teuthology.parallel:result is '' 2021-10-20T23:28:16.370 DEBUG:teuthology.parallel:result is '' 2021-10-20T23:28:16.371 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:28:16.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.461+0000 7fc9c8eed700 1 Processor -- start 2021-10-20T23:28:16.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.461+0000 7fc9c8eed700 1 -- start start 2021-10-20T23:28:16.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc9c40b1ec0 0x7fc9c40b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:16.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c40b0420 con 0x7fc9c40b22a0 2021-10-20T23:28:16.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c40a77d0 con 0x7fc9c40affb0 2021-10-20T23:28:16.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c40b0650 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c2d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc9c40b22a0 0x7fc9c4141250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42568/0 (socket says 172.21.15.12:42568) 2021-10-20T23:28:16.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c2d9d700 1 -- 172.21.15.12:0/3884369567 learned_addr learned my addr 172.21.15.12:0/3884369567 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:16.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c259c700 1 --2- 172.21.15.12:0/3884369567 >> v2:172.21.15.31:3300/0 conn(0x7fc9c40b1ec0 0x7fc9c40b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:16.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c159a700 1 -- 172.21.15.12:0/3884369567 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750903761 0 0) 0x7fc9c40b0420 con 0x7fc9c40b22a0 2021-10-20T23:28:16.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c159a700 1 -- 172.21.15.12:0/3884369567 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a8003260 con 0x7fc9c40b22a0 2021-10-20T23:28:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c159a700 1 -- 172.21.15.12:0/3884369567 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127192714 0 0) 0x7fc9c40a77d0 con 0x7fc9c40affb0 2021-10-20T23:28:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c159a700 1 -- 172.21.15.12:0/3884369567 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c40b0420 con 0x7fc9c40affb0 2021-10-20T23:28:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c259c700 1 -- 172.21.15.12:0/3884369567 >> v1:172.21.15.31:6789/0 conn(0x7fc9c40affb0 legacy=0x7fc9c40a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c259c700 1 -- 172.21.15.12:0/3884369567 >> v1:172.21.15.12:6789/0 conn(0x7fc9c40b22a0 legacy=0x7fc9c4141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c259c700 1 -- 172.21.15.12:0/3884369567 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40b08f0 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c259c700 1 --2- 172.21.15.12:0/3884369567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40b1ec0 0x7fc9c40b12d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fc9b8002f70 tx=0x7fc9b8006df0).ready entity=mon.1 client_cookie=6939a3b8e972b2a8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c159a700 1 -- 172.21.15.12:0/3884369567 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9b800d540 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c159a700 1 -- 172.21.15.12:0/3884369567 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8000e90 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c159a700 1 -- 172.21.15.12:0/3884369567 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9b800d890 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 -- 172.21.15.12:0/3884369567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40b1ec0 msgr2=0x7fc9c40b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:16.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 --2- 172.21.15.12:0/3884369567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40b1ec0 0x7fc9c40b12d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fc9b8002f70 tx=0x7fc9b8006df0).stop 2021-10-20T23:28:16.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 -- 172.21.15.12:0/3884369567 shutdown_connections 2021-10-20T23:28:16.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 --2- 172.21.15.12:0/3884369567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40b1ec0 0x7fc9c40b12d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 -- 172.21.15.12:0/3884369567 >> 172.21.15.12:0/3884369567 conn(0x7fc9c405f6b0 msgr2=0x7fc9c405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:16.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 -- 172.21.15.12:0/3884369567 shutdown_connections 2021-10-20T23:28:16.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.465+0000 7fc9c8eed700 1 -- 172.21.15.12:0/3884369567 wait complete. 2021-10-20T23:28:16.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 Processor -- start 2021-10-20T23:28:16.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 -- start start 2021-10-20T23:28:16.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9c40affb0 0x7fc9c4138dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:16.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9c40b1ec0 0x7fc9c414a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:16.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40b22a0 0x7fc9c40aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:16.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40a9530 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40a97d0 con 0x7fc9c40b22a0 2021-10-20T23:28:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40a9a70 con 0x7fc9c40affb0 2021-10-20T23:28:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9c40b1ec0 0x7fc9c414a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9c40b1ec0 0x7fc9c414a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43978/0 (socket says 172.21.15.12:43978) 2021-10-20T23:28:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c1d9b700 1 -- 172.21.15.12:0/1474045799 learned_addr learned my addr 172.21.15.12:0/1474045799 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c259c700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9c40affb0 0x7fc9c4138dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:16.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c2d9d700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40b22a0 0x7fc9c40aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:16.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c1d9b700 1 -- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9c40affb0 msgr2=0x7fc9c4138dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:16.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c1d9b700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9c40affb0 0x7fc9c4138dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c1d9b700 1 -- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40b22a0 msgr2=0x7fc9c40aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c1d9b700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40b22a0 0x7fc9c40aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:16.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c1d9b700 1 -- 172.21.15.12:0/1474045799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b800b180 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c1d9b700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9c40b1ec0 0x7fc9c414a770 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7fc9b4001110 tx=0x7fc9b4007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9b37fe700 1 -- 172.21.15.12:0/1474045799 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9b4012400 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9b37fe700 1 -- 172.21.15.12:0/1474045799 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4012560 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c41494d0 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9b37fe700 1 -- 172.21.15.12:0/1474045799 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9b40128c0 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.469+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c40ac2a0 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.473+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c40a9c30 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.473+0000 7fc9b37fe700 1 -- 172.21.15.12:0/1474045799 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc9b4019030 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.473+0000 7fc9b37fe700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc9a0053610 0x7fc9a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.473+0000 7fc9b37fe700 1 -- 172.21.15.12:0/1474045799 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fc9b406afe0 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.473+0000 7fc9c259c700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc9a0053610 0x7fc9a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:16.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.473+0000 7fc9c259c700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc9a0053610 0x7fc9a0055ad0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fc9b801a000 tx=0x7fc9b8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:16.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.481+0000 7fc9b37fe700 1 -- 172.21.15.12:0/1474045799 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9b4041ee0 con 0x7fc9c40b1ec0 2021-10-20T23:28:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:16.645+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc9c40b0b90 con 0x7fc9c40b1ec0 2021-10-20T23:28:17.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.369+0000 7fc9b37fe700 1 -- 172.21.15.12:0/1474045799 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc9b4045500 con 0x7fc9c40b1ec0 2021-10-20T23:28:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc9a0053610 msgr2=0x7fc9a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc9a0053610 0x7fc9a0055ad0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fc9b801a000 tx=0x7fc9b8014000).stop 2021-10-20T23:28:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9c40b1ec0 msgr2=0x7fc9c414a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9c40b1ec0 0x7fc9c414a770 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7fc9b4001110 tx=0x7fc9b4007ae0).stop 2021-10-20T23:28:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 shutdown_connections 2021-10-20T23:28:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc9a0053610 0x7fc9a0055ad0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40b22a0 0x7fc9c40aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9c40b1ec0 0x7fc9c414a770 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 --2- 172.21.15.12:0/1474045799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9c40affb0 0x7fc9c4138dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 >> 172.21.15.12:0/1474045799 conn(0x7fc9c405f6b0 msgr2=0x7fc9c40ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 shutdown_connections 2021-10-20T23:28:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.373+0000 7fc9c8eed700 1 -- 172.21.15.12:0/1474045799 wait complete. 2021-10-20T23:28:17.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:28:17.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.509+0000 7fc4a7fff700 1 Processor -- start 2021-10-20T23:28:17.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.509+0000 7fc4a7fff700 1 -- start start 2021-10-20T23:28:17.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc4a8064980 0x7fc4a8144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:17.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a8066500 con 0x7fc4a8067110 2021-10-20T23:28:17.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a80b46c0 con 0x7fc4a80b3550 2021-10-20T23:28:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a80b3ea0 con 0x7fc4a8064980 2021-10-20T23:28:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a77fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc4a8067110 0x7fc4a8141130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42578/0 (socket says 172.21.15.12:42578) 2021-10-20T23:28:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a77fe700 1 -- 172.21.15.12:0/656385951 learned_addr learned my addr 172.21.15.12:0/656385951 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a6ffd700 1 --2- 172.21.15.12:0/656385951 >> v2:172.21.15.12:3300/0 conn(0x7fc4a8064980 0x7fc4a8144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:17.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a5ffb700 1 -- 172.21.15.12:0/656385951 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413388648 0 0) 0x7fc4a8066500 con 0x7fc4a8067110 2021-10-20T23:28:17.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a5ffb700 1 -- 172.21.15.12:0/656385951 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc48c003260 con 0x7fc4a8067110 2021-10-20T23:28:17.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a6ffd700 1 -- 172.21.15.12:0/656385951 >> v1:172.21.15.31:6789/0 conn(0x7fc4a80b3550 legacy=0x7fc4a8066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:17.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a5ffb700 1 -- 172.21.15.12:0/656385951 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716524065 0 0) 0x7fc4a80b46c0 con 0x7fc4a80b3550 2021-10-20T23:28:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a6ffd700 1 -- 172.21.15.12:0/656385951 >> v1:172.21.15.12:6789/0 conn(0x7fc4a8067110 legacy=0x7fc4a8141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a6ffd700 1 -- 172.21.15.12:0/656385951 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a8064d60 con 0x7fc4a8064980 2021-10-20T23:28:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a6ffd700 1 --2- 172.21.15.12:0/656385951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 0x7fc4a8144ce0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fc49c002f70 tx=0x7fc49c006df0).ready entity=mon.0 client_cookie=6854fcf1a6026592 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a5ffb700 1 -- 172.21.15.12:0/656385951 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c00d5c0 con 0x7fc4a8064980 2021-10-20T23:28:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a5ffb700 1 -- 172.21.15.12:0/656385951 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c000e90 con 0x7fc4a8064980 2021-10-20T23:28:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a5ffb700 1 -- 172.21.15.12:0/656385951 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c00d910 con 0x7fc4a8064980 2021-10-20T23:28:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 -- 172.21.15.12:0/656385951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 msgr2=0x7fc4a8144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 --2- 172.21.15.12:0/656385951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 0x7fc4a8144ce0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fc49c002f70 tx=0x7fc49c006df0).stop 2021-10-20T23:28:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 -- 172.21.15.12:0/656385951 shutdown_connections 2021-10-20T23:28:17.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 --2- 172.21.15.12:0/656385951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 0x7fc4a8144ce0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:17.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 -- 172.21.15.12:0/656385951 >> 172.21.15.12:0/656385951 conn(0x7fc4a805f6b0 msgr2=0x7fc4a805fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:17.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 -- 172.21.15.12:0/656385951 shutdown_connections 2021-10-20T23:28:17.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.513+0000 7fc4a7fff700 1 -- 172.21.15.12:0/656385951 wait complete. 2021-10-20T23:28:17.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a7fff700 1 Processor -- start 2021-10-20T23:28:17.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a7fff700 1 -- start start 2021-10-20T23:28:17.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 0x7fc4a8143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:17.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4a8067110 0x7fc4a80b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4a80b3550 0x7fc4a80b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80b6280 con 0x7fc4a8064980 2021-10-20T23:28:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a81385b0 con 0x7fc4a80b3550 2021-10-20T23:28:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80b65f0 con 0x7fc4a8067110 2021-10-20T23:28:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 0x7fc4a8143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 0x7fc4a8143d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43992/0 (socket says 172.21.15.12:43992) 2021-10-20T23:28:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a6ffd700 1 -- 172.21.15.12:0/1504121255 learned_addr learned my addr 172.21.15.12:0/1504121255 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a77fe700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4a80b3550 0x7fc4a80b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.517+0000 7fc4a67fc700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4a8067110 0x7fc4a80b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a6ffd700 1 -- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4a8067110 msgr2=0x7fc4a80b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a6ffd700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4a8067110 0x7fc4a80b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:17.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a6ffd700 1 -- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4a80b3550 msgr2=0x7fc4a80b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:17.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a6ffd700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4a80b3550 0x7fc4a80b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:17.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a6ffd700 1 -- 172.21.15.12:0/1504121255 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c00b180 con 0x7fc4a8064980 2021-10-20T23:28:17.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a6ffd700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 0x7fc4a8143d20 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fc49c002f70 tx=0x7fc49c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc497fff700 1 -- 172.21.15.12:0/1504121255 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c016070 con 0x7fc4a8064980 2021-10-20T23:28:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc497fff700 1 -- 172.21.15.12:0/1504121255 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c00de40 con 0x7fc4a8064980 2021-10-20T23:28:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a8144550 con 0x7fc4a8064980 2021-10-20T23:28:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc497fff700 1 -- 172.21.15.12:0/1504121255 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c013d20 con 0x7fc4a8064980 2021-10-20T23:28:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a813e2f0 con 0x7fc4a8064980 2021-10-20T23:28:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc497fff700 1 -- 172.21.15.12:0/1504121255 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc49c024030 con 0x7fc4a8064980 2021-10-20T23:28:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a8138410 con 0x7fc4a8064980 2021-10-20T23:28:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc497fff700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc484053640 0x7fc484055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc497fff700 1 -- 172.21.15.12:0/1504121255 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fc49c06c5b0 con 0x7fc4a8064980 2021-10-20T23:28:17.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.521+0000 7fc4a67fc700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc484053640 0x7fc484055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:17.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.525+0000 7fc4a67fc700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc484053640 0x7fc484055b00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fc49800d000 tx=0x7fc498007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:17.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.529+0000 7fc497fff700 1 -- 172.21.15.12:0/1504121255 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc4a8138410 con 0x7fc4a8064980 2021-10-20T23:28:17.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:17.657+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc4a8138410 con 0x7fc4a8064980 2021-10-20T23:28:18.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.373+0000 7fc497fff700 1 -- 172.21.15.12:0/1504121255 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v126) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc4a8138410 con 0x7fc4a8064980 2021-10-20T23:28:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc484053640 msgr2=0x7fc484055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc484053640 0x7fc484055b00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fc49800d000 tx=0x7fc498007a00).stop 2021-10-20T23:28:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 msgr2=0x7fc4a8143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 0x7fc4a8143d20 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fc49c002f70 tx=0x7fc49c014000).stop 2021-10-20T23:28:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 shutdown_connections 2021-10-20T23:28:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc484053640 0x7fc484055b00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4a80b3550 0x7fc4a80b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc4a8067110 0x7fc4a80b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 --2- 172.21.15.12:0/1504121255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a8064980 0x7fc4a8143d20 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 >> 172.21.15.12:0/1504121255 conn(0x7fc4a805f6b0 msgr2=0x7fc4a8139ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 shutdown_connections 2021-10-20T23:28:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.377+0000 7fc4a7fff700 1 -- 172.21.15.12:0/1504121255 wait complete. 2021-10-20T23:28:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:28:18.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:28:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf88c0700 1 Processor -- start 2021-10-20T23:28:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf88c0700 1 -- start start 2021-10-20T23:28:18.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf88c0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9bf413c6e0 0x7f9bf413cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:18.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf88c0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40acf20 0x7f9bf40ad390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:18.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf88c0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf40b2c30 con 0x7f9bf40b2850 2021-10-20T23:28:18.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf88c0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40b11b0 con 0x7f9bf413c6e0 2021-10-20T23:28:18.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf88c0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b1660 con 0x7f9bf40acf20 2021-10-20T23:28:18.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9bf413c6e0 0x7f9bf413cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:18.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9bf413c6e0 0x7f9bf413cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44000/0 (socket says 172.21.15.12:44000) 2021-10-20T23:28:18.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf259c700 1 -- 172.21.15.12:0/2352666469 learned_addr learned my addr 172.21.15.12:0/2352666469 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:18.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf359e700 1 --2- 172.21.15.12:0/2352666469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40acf20 0x7f9bf40ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:18.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf259c700 1 -- 172.21.15.12:0/2352666469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40acf20 msgr2=0x7f9bf40ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:18.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf259c700 1 --2- 172.21.15.12:0/2352666469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40acf20 0x7f9bf40ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:18.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf259c700 1 -- 172.21.15.12:0/2352666469 >> v1:172.21.15.31:6789/0 conn(0x7f9bf40b2850 legacy=0x7f9bf40b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:18.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf259c700 1 -- 172.21.15.12:0/2352666469 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40b1900 con 0x7f9bf413c6e0 2021-10-20T23:28:18.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf259c700 1 --2- 172.21.15.12:0/2352666469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 0x7f9bf413cb20 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f9bdc002f70 tx=0x7f9bdc006eb0).ready entity=mon.0 client_cookie=660f545ad89a6297 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:18.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.513+0000 7f9bf1d9b700 1 -- 172.21.15.12:0/2352666469 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc00d570 con 0x7f9bf413c6e0 2021-10-20T23:28:18.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf1d9b700 1 -- 172.21.15.12:0/2352666469 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc000e90 con 0x7f9bf413c6e0 2021-10-20T23:28:18.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf1d9b700 1 -- 172.21.15.12:0/2352666469 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc00d900 con 0x7f9bf413c6e0 2021-10-20T23:28:18.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 -- 172.21.15.12:0/2352666469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 msgr2=0x7f9bf413cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:18.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 --2- 172.21.15.12:0/2352666469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 0x7f9bf413cb20 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f9bdc002f70 tx=0x7f9bdc006eb0).stop 2021-10-20T23:28:18.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 -- 172.21.15.12:0/2352666469 shutdown_connections 2021-10-20T23:28:18.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 --2- 172.21.15.12:0/2352666469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40acf20 0x7f9bf40ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:18.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 --2- 172.21.15.12:0/2352666469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 0x7f9bf413cb20 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:18.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 -- 172.21.15.12:0/2352666469 >> 172.21.15.12:0/2352666469 conn(0x7f9bf4061230 msgr2=0x7f9bf4062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:18.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 -- 172.21.15.12:0/2352666469 shutdown_connections 2021-10-20T23:28:18.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 -- 172.21.15.12:0/2352666469 wait complete. 2021-10-20T23:28:18.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 Processor -- start 2021-10-20T23:28:18.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.517+0000 7f9bf88c0700 1 -- start start 2021-10-20T23:28:18.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf88c0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf40acf20 0x7f9bf40b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:18.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf88c0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40b2850 0x7f9bf4138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:18.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf88c0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 0x7f9bf4138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:18.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf88c0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4149830 con 0x7f9bf413c6e0 2021-10-20T23:28:18.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf88c0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4147f90 con 0x7f9bf40acf20 2021-10-20T23:28:18.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf88c0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4156610 con 0x7f9bf40b2850 2021-10-20T23:28:18.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 0x7f9bf4138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 0x7f9bf4138960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44008/0 (socket says 172.21.15.12:44008) 2021-10-20T23:28:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf359e700 1 -- 172.21.15.12:0/4278037234 learned_addr learned my addr 172.21.15.12:0/4278037234 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf259c700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40b2850 0x7f9bf4138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf2d9d700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf40acf20 0x7f9bf40b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:18.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf359e700 1 -- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40b2850 msgr2=0x7f9bf4138470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:18.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf359e700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40b2850 0x7f9bf4138470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:18.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf359e700 1 -- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf40acf20 msgr2=0x7f9bf40b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:18.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf359e700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf40acf20 0x7f9bf40b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:18.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf359e700 1 -- 172.21.15.12:0/4278037234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc00b1e0 con 0x7f9bf413c6e0 2021-10-20T23:28:18.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf259c700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40b2850 0x7f9bf4138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:18.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf359e700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 0x7f9bf4138960 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f9bec00c000 tx=0x7f9bec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:18.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bebfff700 1 -- 172.21.15.12:0/4278037234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bec011750 con 0x7f9bf413c6e0 2021-10-20T23:28:18.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bebfff700 1 -- 172.21.15.12:0/4278037234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec0118b0 con 0x7f9bf413c6e0 2021-10-20T23:28:18.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf41568b0 con 0x7f9bf413c6e0 2021-10-20T23:28:18.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bebfff700 1 -- 172.21.15.12:0/4278037234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bec011c10 con 0x7f9bf413c6e0 2021-10-20T23:28:18.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.521+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf41494b0 con 0x7f9bf413c6e0 2021-10-20T23:28:18.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.525+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf4149cc0 con 0x7f9bf413c6e0 2021-10-20T23:28:18.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.525+0000 7f9bebfff700 1 -- 172.21.15.12:0/4278037234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9bec011d70 con 0x7f9bf413c6e0 2021-10-20T23:28:18.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.525+0000 7f9bebfff700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bd80534f0 0x7f9bd80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:18.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.525+0000 7f9bebfff700 1 -- 172.21.15.12:0/4278037234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f9bec06bdd0 con 0x7f9bf413c6e0 2021-10-20T23:28:18.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.525+0000 7f9bf2d9d700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bd80534f0 0x7f9bd80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:18.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.525+0000 7f9bf2d9d700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bd80534f0 0x7f9bd80559b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f9be400d000 tx=0x7f9be4007ed0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:18.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.533+0000 7f9bebfff700 1 -- 172.21.15.12:0/4278037234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9bf4149cc0 con 0x7f9bf413c6e0 2021-10-20T23:28:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:18.661+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9bf41527a0 con 0x7f9bf413c6e0 2021-10-20T23:28:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.381+0000 7f9bebfff700 1 -- 172.21.15.12:0/4278037234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v127) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9bf41527a0 con 0x7f9bf413c6e0 2021-10-20T23:28:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bd80534f0 msgr2=0x7f9bd80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bd80534f0 0x7f9bd80559b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f9be400d000 tx=0x7f9be4007ed0).stop 2021-10-20T23:28:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 msgr2=0x7f9bf4138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 0x7f9bf4138960 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f9bec00c000 tx=0x7f9bec006df0).stop 2021-10-20T23:28:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 shutdown_connections 2021-10-20T23:28:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bd80534f0 0x7f9bd80559b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf413c6e0 0x7f9bf4138960 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9bf40b2850 0x7f9bf4138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 --2- 172.21.15.12:0/4278037234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf40acf20 0x7f9bf40b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 >> 172.21.15.12:0/4278037234 conn(0x7f9bf4061230 msgr2=0x7f9bf40b5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 shutdown_connections 2021-10-20T23:28:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:19.385+0000 7f9bf88c0700 1 -- 172.21.15.12:0/4278037234 wait complete. 2021-10-20T23:28:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:28:19.414 DEBUG:teuthology.orchestra.run.smithi119:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-10-20T23:28:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.449+0000 7f7557a85b80 1 Processor -- start 2021-10-20T23:28:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.449+0000 7f7557a85b80 1 -- start start 2021-10-20T23:28:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.449+0000 7f7557a85b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 0x556ebeb1e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.449+0000 7f7557a85b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb1ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.449+0000 7f7557a85b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 0x556ebeb1a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.449+0000 7f7557a85b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebea06460 con 0x556ebeb1f590 2021-10-20T23:28:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.449+0000 7f7557a85b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebeb1f3a0 con 0x556ebeb130d0 2021-10-20T23:28:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.449+0000 7f7557a85b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x556ebeb1aa40 con 0x556ebeb21e70 2021-10-20T23:28:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 0x556ebeb1a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7555ec3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 0x556ebeb1e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb1ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 0x556ebeb1a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.119:59170/0 (socket says 172.21.15.119:59170) 2021-10-20T23:28:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb1ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.119:51230/0 (socket says 172.21.15.119:51230) 2021-10-20T23:28:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 -- 172.21.15.119:0/2671445999 learned_addr learned my addr 172.21.15.119:0/2671445999 (peer_addr_for_me v2:172.21.15.119:0/0) 2021-10-20T23:28:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 -- 172.21.15.119:0/2671445999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 msgr2=0x556ebeb1a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:19.468 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 --2- 172.21.15.119:0/2671445999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 0x556ebeb1a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.468 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 -- 172.21.15.119:0/2671445999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 msgr2=0x556ebeb1e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:19.468 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 --2- 172.21.15.119:0/2671445999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 0x556ebeb1e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.468 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 -- 172.21.15.119:0/2671445999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550005d90 con 0x556ebeb1f590 2021-10-20T23:28:19.469 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7555ec3700 1 --2- 172.21.15.119:0/2671445999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 0x556ebeb1e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:19.469 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 --2- 172.21.15.119:0/2671445999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb1ec30 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f754000b000 tx=0x7f754000c040).ready entity=mon.0 client_cookie=b89c4912d694a30c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:19.469 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f754f7fe700 1 -- 172.21.15.119:0/2671445999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f754000f040 con 0x556ebeb1f590 2021-10-20T23:28:19.469 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f754f7fe700 1 -- 172.21.15.119:0/2671445999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540008890 con 0x556ebeb1f590 2021-10-20T23:28:19.470 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f754f7fe700 1 -- 172.21.15.119:0/2671445999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7540008bf0 con 0x556ebeb1f590 2021-10-20T23:28:19.470 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 -- 172.21.15.119:0/2671445999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 msgr2=0x556ebeb1ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:19.470 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 --2- 172.21.15.119:0/2671445999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb1ec30 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f754000b000 tx=0x7f754000c040).stop 2021-10-20T23:28:19.470 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 -- 172.21.15.119:0/2671445999 shutdown_connections 2021-10-20T23:28:19.471 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 --2- 172.21.15.119:0/2671445999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 0x556ebeb1a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.471 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 --2- 172.21.15.119:0/2671445999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb1ec30 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.471 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 --2- 172.21.15.119:0/2671445999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 0x556ebeb1e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.471 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 -- 172.21.15.119:0/2671445999 >> 172.21.15.119:0/2671445999 conn(0x556ebeb0ebe0 msgr2=0x556ebeb10fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:19.472 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 -- 172.21.15.119:0/2671445999 shutdown_connections 2021-10-20T23:28:19.472 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 -- 172.21.15.119:0/2671445999 wait complete. 2021-10-20T23:28:19.472 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 Processor -- start 2021-10-20T23:28:19.472 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 -- start start 2021-10-20T23:28:19.472 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 0x556ebeb2cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:19.473 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb2d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:19.473 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 0x556ebeb26e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:19.473 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebeb26d00 con 0x556ebeb1f590 2021-10-20T23:28:19.474 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebeb27330 con 0x556ebeb130d0 2021-10-20T23:28:19.474 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7557a85b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x556ebeb274f0 con 0x556ebeb21e70 2021-10-20T23:28:19.475 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb2d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:19.475 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 0x556ebeb26e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:19.475 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb2d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.119:51236/0 (socket says 172.21.15.119:51236) 2021-10-20T23:28:19.475 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f7555ec3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 0x556ebeb2cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:19.476 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75556c2700 1 -- 172.21.15.119:0/1002762297 learned_addr learned my addr 172.21.15.119:0/1002762297 (peer_addr_for_me v2:172.21.15.119:0/0) 2021-10-20T23:28:19.476 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 -- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 msgr2=0x556ebeb2cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:19.476 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556ebeb130d0 0x556ebeb2cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.476 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 -- 172.21.15.119:0/1002762297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 msgr2=0x556ebeb2d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:19.477 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ebeb1f590 0x556ebeb2d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:19.477 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 -- 172.21.15.119:0/1002762297 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ebea25420 con 0x556ebeb21e70 2021-10-20T23:28:19.477 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.453+0000 7f75566c4700 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 0x556ebeb26e40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x556ebeb283f0 tx=0x7f7550015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:19.478 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.457+0000 7f754effd700 1 -- 172.21.15.119:0/1002762297 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755001f660 con 0x556ebeb21e70 2021-10-20T23:28:19.478 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.457+0000 7f754effd700 1 -- 172.21.15.119:0/1002762297 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755001f7c0 con 0x556ebeb21e70 2021-10-20T23:28:19.479 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.457+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7540009430 con 0x556ebeb21e70 2021-10-20T23:28:19.479 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.457+0000 7f754effd700 1 -- 172.21.15.119:0/1002762297 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755001fb20 con 0x556ebeb21e70 2021-10-20T23:28:19.480 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.457+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ebea2ab00 con 0x556ebeb21e70 2021-10-20T23:28:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.457+0000 7f754effd700 1 -- 172.21.15.119:0/1002762297 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f755001fc80 con 0x556ebeb21e70 2021-10-20T23:28:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.457+0000 7f754effd700 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7538052190 0x7f7538054650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.461+0000 7f754effd700 1 -- 172.21.15.119:0/1002762297 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f755006cd20 con 0x556ebeb21e70 2021-10-20T23:28:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.461+0000 7f7555ec3700 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7538052190 0x7f7538054650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.461+0000 7f7557a85b80 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x556ebeb34270 0x556ebeb36660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.461+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 --> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e127) v8 -- 0x556ebeb36b50 con 0x556ebeb34270 2021-10-20T23:28:19.485 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.461+0000 7f7555ec3700 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7538052190 0x7f7538054650 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f7548004000 tx=0x7f7548006a70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:19.485 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.461+0000 7f75556c2700 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x556ebeb34270 0x556ebeb36660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:19.485 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:19.461+0000 7f75556c2700 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x556ebeb34270 0x556ebeb36660 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:20.490 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f754effd700 1 -- 172.21.15.119:0/1002762297 <== osd.0 v2:172.21.15.12:6816/14574 1 ==== osd_map(128..128 src has 1..128) v4 ==== 320+0+0 (crc 0 0 0) 0x7f7540008bb0 con 0x556ebeb34270 2021-10-20T23:28:20.493 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f75556c2700 1 -- 172.21.15.119:0/1002762297 <== osd.0 v2:172.21.15.12:6816/14574 2 ==== osd_op_reply(1 key [writefull 0~617] v128'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f7540008d70 con 0x556ebeb34270 2021-10-20T23:28:20.493 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x556ebeb34270 msgr2=0x556ebeb36660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:20.495 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x556ebeb34270 0x556ebeb36660 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.495 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7538052190 msgr2=0x7f7538054650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:20.495 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7538052190 0x7f7538054650 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f7548004000 tx=0x7f7548006a70).stop 2021-10-20T23:28:20.496 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 msgr2=0x556ebeb26e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:20.496 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 --2- 172.21.15.119:0/1002762297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556ebeb21e70 0x556ebeb26e40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x556ebeb283f0 tx=0x7f7550015000).stop 2021-10-20T23:28:20.496 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f75566c4700 1 -- 172.21.15.119:0/1002762297 reap_dead start 2021-10-20T23:28:20.497 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 shutdown_connections 2021-10-20T23:28:20.497 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 >> 172.21.15.119:0/1002762297 conn(0x556ebeb0ebe0 msgr2=0x556ebeb10fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:20.498 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 shutdown_connections 2021-10-20T23:28:20.498 INFO:teuthology.orchestra.run.smithi119.stderr:2021-10-20T23:28:20.485+0000 7f7557a85b80 1 -- 172.21.15.119:0/1002762297 wait complete. 2021-10-20T23:28:20.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-10-20T23:28:20.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.597+0000 7f6f6e8be700 1 Processor -- start 2021-10-20T23:28:20.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.597+0000 7f6f6e8be700 1 -- start start 2021-10-20T23:28:20.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f680b6430 0x7f6f68061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:20.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b4060 0x7f6f68061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:20.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f680b1f70 con 0x7f6f68147bf0 2021-10-20T23:28:20.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680b14a0 con 0x7f6f680b6430 2021-10-20T23:28:20.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68061e50 con 0x7f6f680b4060 2021-10-20T23:28:20.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6d8bc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f680b6430 0x7f6f68061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:20.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e0bd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6f68147bf0 0x7f6f681444a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42610/0 (socket says 172.21.15.12:42610) 2021-10-20T23:28:20.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e0bd700 1 -- 172.21.15.12:0/1781747831 learned_addr learned my addr 172.21.15.12:0/1781747831 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:20.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6d0bb700 1 --2- 172.21.15.12:0/1781747831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b4060 0x7f6f68061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:20.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6d8bc700 1 -- 172.21.15.12:0/1781747831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b4060 msgr2=0x7f6f68061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:20.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6d8bc700 1 --2- 172.21.15.12:0/1781747831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b4060 0x7f6f68061960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6d8bc700 1 -- 172.21.15.12:0/1781747831 >> v1:172.21.15.12:6789/0 conn(0x7f6f68147bf0 legacy=0x7f6f681444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:20.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6c8ba700 1 -- 172.21.15.12:0/1781747831 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844289442 0 0) 0x7f6f680b1f70 con 0x7f6f68147bf0 2021-10-20T23:28:20.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6d8bc700 1 -- 172.21.15.12:0/1781747831 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680b6810 con 0x7f6f680b6430 2021-10-20T23:28:20.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6d8bc700 1 --2- 172.21.15.12:0/1781747831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b6430 0x7f6f68061470 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f6f64002f70 tx=0x7f6f64006df0).ready entity=mon.0 client_cookie=855ff9632a5e13f8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:20.618 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6c8ba700 1 -- 172.21.15.12:0/1781747831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6400d570 con 0x7f6f680b6430 2021-10-20T23:28:20.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6c8ba700 1 -- 172.21.15.12:0/1781747831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64000e90 con 0x7f6f680b6430 2021-10-20T23:28:20.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6c8ba700 1 -- 172.21.15.12:0/1781747831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6400d8c0 con 0x7f6f680b6430 2021-10-20T23:28:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 -- 172.21.15.12:0/1781747831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b6430 msgr2=0x7f6f68061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 --2- 172.21.15.12:0/1781747831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b6430 0x7f6f68061470 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f6f64002f70 tx=0x7f6f64006df0).stop 2021-10-20T23:28:20.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 -- 172.21.15.12:0/1781747831 shutdown_connections 2021-10-20T23:28:20.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 --2- 172.21.15.12:0/1781747831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b4060 0x7f6f68061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 --2- 172.21.15.12:0/1781747831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b6430 0x7f6f68061470 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 -- 172.21.15.12:0/1781747831 >> 172.21.15.12:0/1781747831 conn(0x7f6f6805c490 msgr2=0x7f6f6805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:20.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 -- 172.21.15.12:0/1781747831 shutdown_connections 2021-10-20T23:28:20.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.601+0000 7f6f6e8be700 1 -- 172.21.15.12:0/1781747831 wait complete. 2021-10-20T23:28:20.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 Processor -- start 2021-10-20T23:28:20.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 -- start start 2021-10-20T23:28:20.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b4060 0x7f6f680b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:20.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b6430 0x7f6f6814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:20.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f68147bf0 0x7f6f680afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:20.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6814a050 con 0x7f6f680b4060 2021-10-20T23:28:20.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6814b060 con 0x7f6f68147bf0 2021-10-20T23:28:20.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6814a280 con 0x7f6f680b6430 2021-10-20T23:28:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d8bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b4060 0x7f6f680b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d8bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b4060 0x7f6f680b8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44018/0 (socket says 172.21.15.12:44018) 2021-10-20T23:28:20.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d8bc700 1 -- 172.21.15.12:0/3438976165 learned_addr learned my addr 172.21.15.12:0/3438976165 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:20.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d0bb700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b6430 0x7f6f6814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:20.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e0bd700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f68147bf0 0x7f6f680afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:20.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d8bc700 1 -- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b6430 msgr2=0x7f6f6814ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:20.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d8bc700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b6430 0x7f6f6814ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d8bc700 1 -- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f68147bf0 msgr2=0x7f6f680afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:20.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d8bc700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f68147bf0 0x7f6f680afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d8bc700 1 -- 172.21.15.12:0/3438976165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6400b180 con 0x7f6f680b4060 2021-10-20T23:28:20.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e0bd700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f68147bf0 0x7f6f680afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:20.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6d8bc700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b4060 0x7f6f680b8530 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f6f64002f70 tx=0x7f6f64014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:20.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f5affd700 1 -- 172.21.15.12:0/3438976165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6400dea0 con 0x7f6f680b4060 2021-10-20T23:28:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f5affd700 1 -- 172.21.15.12:0/3438976165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6401e400 con 0x7f6f680b4060 2021-10-20T23:28:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6814a520 con 0x7f6f680b4060 2021-10-20T23:28:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f5affd700 1 -- 172.21.15.12:0/3438976165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6401e760 con 0x7f6f680b4060 2021-10-20T23:28:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.605+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f68159e00 con 0x7f6f680b4060 2021-10-20T23:28:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.609+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f680ad9c0 con 0x7f6f680b4060 2021-10-20T23:28:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.609+0000 7f6f5affd700 1 -- 172.21.15.12:0/3438976165 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f64025030 con 0x7f6f680b4060 2021-10-20T23:28:20.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.609+0000 7f6f5affd700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f48053580 0x7f6f48055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.609+0000 7f6f5affd700 1 -- 172.21.15.12:0/3438976165 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f6f6406c990 con 0x7f6f680b4060 2021-10-20T23:28:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.609+0000 7f6f6d0bb700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f48053580 0x7f6f48055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.609+0000 7f6f6d0bb700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f48053580 0x7f6f48055a40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f6f5c00b000 tx=0x7f6f5c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.613+0000 7f6f5affd700 1 -- 172.21.15.12:0/3438976165 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f680ad9c0 con 0x7f6f680b4060 2021-10-20T23:28:20.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f6f680afaf0 con 0x7f6f680b4060 2021-10-20T23:28:20.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f5affd700 1 -- 172.21.15.12:0/3438976165 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1906 (secure 0 0 0) 0x7f6f680afaf0 con 0x7f6f680b4060 2021-10-20T23:28:20.796 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:20.796 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:28:20.797 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:20.797 INFO:teuthology.orchestra.run.smithi012.stdout: "total_bytes": 773094113280, 2021-10-20T23:28:20.797 INFO:teuthology.orchestra.run.smithi012.stdout: "total_avail_bytes": 764491505664, 2021-10-20T23:28:20.797 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_bytes": 12673024, 2021-10-20T23:28:20.798 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_bytes": 8602607616, 2021-10-20T23:28:20.798 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_ratio": 0.011127503588795662, 2021-10-20T23:28:20.798 INFO:teuthology.orchestra.run.smithi012.stdout: "num_osds": 8, 2021-10-20T23:28:20.798 INFO:teuthology.orchestra.run.smithi012.stdout: "num_per_pool_osds": 8, 2021-10-20T23:28:20.798 INFO:teuthology.orchestra.run.smithi012.stdout: "num_per_pool_omap_osds": 8 2021-10-20T23:28:20.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:20.799 INFO:teuthology.orchestra.run.smithi012.stdout: "stats_by_class": { 2021-10-20T23:28:20.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ssd": { 2021-10-20T23:28:20.799 INFO:teuthology.orchestra.run.smithi012.stdout: "total_bytes": 773094113280, 2021-10-20T23:28:20.800 INFO:teuthology.orchestra.run.smithi012.stdout: "total_avail_bytes": 764491505664, 2021-10-20T23:28:20.800 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_bytes": 12673024, 2021-10-20T23:28:20.800 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_bytes": 8602607616, 2021-10-20T23:28:20.800 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_ratio": 0.011127503588795662 2021-10-20T23:28:20.801 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:20.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:20.801 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:28:20.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:20.802 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_health_metrics", 2021-10-20T23:28:20.802 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1, 2021-10-20T23:28:20.802 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:20.802 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:28:20.803 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 2, 2021-10-20T23:28:20.803 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:28:20.803 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:28:20.803 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:28:20.803 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362918313984 2021-10-20T23:28:20.804 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:20.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:20.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:20.804 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd", 2021-10-20T23:28:20.805 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2, 2021-10-20T23:28:20.805 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:20.805 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:28:20.805 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 0, 2021-10-20T23:28:20.805 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:28:20.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:28:20.806 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:28:20.806 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362918313984 2021-10-20T23:28:20.807 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:20.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:20.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:20.807 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs_data", 2021-10-20T23:28:20.808 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 22, 2021-10-20T23:28:20.808 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:20.808 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:28:20.808 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 0, 2021-10-20T23:28:20.808 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:28:20.809 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:28:20.809 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:28:20.809 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362918313984 2021-10-20T23:28:20.809 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:20.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:20.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:20.810 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs_metadata", 2021-10-20T23:28:20.811 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 23, 2021-10-20T23:28:20.811 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:20.811 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:28:20.811 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 0, 2021-10-20T23:28:20.812 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:28:20.812 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:28:20.812 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:28:20.812 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362918313984 2021-10-20T23:28:20.813 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:20.813 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:20.813 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:20.813 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:28:20.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f48053580 msgr2=0x7f6f48055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:20.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f48053580 0x7f6f48055a40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f6f5c00b000 tx=0x7f6f5c006df0).stop 2021-10-20T23:28:20.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b4060 msgr2=0x7f6f680b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b4060 0x7f6f680b8530 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f6f64002f70 tx=0x7f6f64014000).stop 2021-10-20T23:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 shutdown_connections 2021-10-20T23:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f48053580 0x7f6f48055a40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f68147bf0 0x7f6f680afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f680b6430 0x7f6f6814ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 --2- 172.21.15.12:0/3438976165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f680b4060 0x7f6f680b8530 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:20.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.785+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 >> 172.21.15.12:0/3438976165 conn(0x7f6f6805c490 msgr2=0x7f6f680b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:20.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.789+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 shutdown_connections 2021-10-20T23:28:20.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:20.789+0000 7f6f6e8be700 1 -- 172.21.15.12:0/3438976165 wait complete. 2021-10-20T23:28:20.819 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2021-10-20T23:28:25.832 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-10-20T23:28:25.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 Processor -- start 2021-10-20T23:28:25.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 -- start start 2021-10-20T23:28:25.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b140669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:25.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b140b1a30 0x7f7b1405fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:25.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7b14140cb0 0x7f7b1413e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1405f750 con 0x7f7b14140cb0 2021-10-20T23:28:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b140b14a0 con 0x7f7b140b1a30 2021-10-20T23:28:25.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1405f980 con 0x7f7b140665f0 2021-10-20T23:28:25.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b137fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7b14140cb0 0x7f7b1413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b12ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b140669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b127fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b140b1a30 0x7f7b1405fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b12ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b140669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:49784/0 (socket says 172.21.15.12:49784) 2021-10-20T23:28:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b12ffd700 1 -- 172.21.15.12:0/1772621212 learned_addr learned my addr 172.21.15.12:0/1772621212 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b137fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7b14140cb0 0x7f7b1413e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44030/0 (socket says 172.21.15.12:44030) 2021-10-20T23:28:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b12ffd700 1 -- 172.21.15.12:0/1772621212 >> v2:172.21.15.31:3300/0 conn(0x7f7b140b1a30 msgr2=0x7f7b1405fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b12ffd700 1 --2- 172.21.15.12:0/1772621212 >> v2:172.21.15.31:3300/0 conn(0x7f7b140b1a30 0x7f7b1405fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b12ffd700 1 -- 172.21.15.12:0/1772621212 >> v2:172.21.15.12:3300/0 conn(0x7f7b14140cb0 msgr2=0x7f7b1413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b12ffd700 1 --2- 172.21.15.12:0/1772621212 >> v2:172.21.15.12:3300/0 conn(0x7f7b14140cb0 0x7f7b1413e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b12ffd700 1 -- 172.21.15.12:0/1772621212 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14060310 con 0x7f7b140665f0 2021-10-20T23:28:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b12ffd700 1 --2- 172.21.15.12:0/1772621212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b140669d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f7b040032f0 tx=0x7f7b04009290).ready entity=mon.2 client_cookie=6c17cf0bedd6b497 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b11ffb700 1 -- 172.21.15.12:0/1772621212 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0400b680 con 0x7f7b140665f0 2021-10-20T23:28:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b11ffb700 1 -- 172.21.15.12:0/1772621212 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0400b7e0 con 0x7f7b140665f0 2021-10-20T23:28:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b11ffb700 1 -- 172.21.15.12:0/1772621212 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0400b950 con 0x7f7b140665f0 2021-10-20T23:28:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 -- 172.21.15.12:0/1772621212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 msgr2=0x7f7b140669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 --2- 172.21.15.12:0/1772621212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b140669d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f7b040032f0 tx=0x7f7b04009290).stop 2021-10-20T23:28:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 -- 172.21.15.12:0/1772621212 shutdown_connections 2021-10-20T23:28:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 --2- 172.21.15.12:0/1772621212 >> v2:172.21.15.12:3300/0 conn(0x7f7b14140cb0 0x7f7b1413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 --2- 172.21.15.12:0/1772621212 >> v2:172.21.15.31:3300/0 conn(0x7f7b140b1a30 0x7f7b1405fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 --2- 172.21.15.12:0/1772621212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b140669d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.929+0000 7f7b13fff700 1 -- 172.21.15.12:0/1772621212 >> 172.21.15.12:0/1772621212 conn(0x7f7b140636e0 msgr2=0x7f7b14063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 -- 172.21.15.12:0/1772621212 shutdown_connections 2021-10-20T23:28:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 -- 172.21.15.12:0/1772621212 wait complete. 2021-10-20T23:28:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 Processor -- start 2021-10-20T23:28:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 -- start start 2021-10-20T23:28:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b14142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b140b1a30 0x7f7b14150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b14140cb0 0x7f7b14150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b14150b70 con 0x7f7b14140cb0 2021-10-20T23:28:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140abf50 con 0x7f7b140b1a30 2021-10-20T23:28:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b13fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1413b5f0 con 0x7f7b140665f0 2021-10-20T23:28:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b12ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b14142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b14140cb0 0x7f7b14150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b12ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b14142480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:49790/0 (socket says 172.21.15.12:49790) 2021-10-20T23:28:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b12ffd700 1 -- 172.21.15.12:0/3246565040 learned_addr learned my addr 172.21.15.12:0/3246565040 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.933+0000 7f7b127fc700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b140b1a30 0x7f7b14150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b12ffd700 1 -- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b140b1a30 msgr2=0x7f7b14150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b12ffd700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b140b1a30 0x7f7b14150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b12ffd700 1 -- 172.21.15.12:0/3246565040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b14140cb0 msgr2=0x7f7b14150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b12ffd700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b14140cb0 0x7f7b14150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b12ffd700 1 -- 172.21.15.12:0/3246565040 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04009530 con 0x7f7b140665f0 2021-10-20T23:28:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b12ffd700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b14142480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f7b040032f0 tx=0x7f7b04017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b03fff700 1 -- 172.21.15.12:0/3246565040 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0400b680 con 0x7f7b140665f0 2021-10-20T23:28:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b03fff700 1 -- 172.21.15.12:0/3246565040 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b04011e50 con 0x7f7b140665f0 2021-10-20T23:28:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b140ab570 con 0x7f7b140665f0 2021-10-20T23:28:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b03fff700 1 -- 172.21.15.12:0/3246565040 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0400bee0 con 0x7f7b140665f0 2021-10-20T23:28:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b140abab0 con 0x7f7b140665f0 2021-10-20T23:28:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b140abcb0 con 0x7f7b140665f0 2021-10-20T23:28:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b03fff700 1 -- 172.21.15.12:0/3246565040 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b0400f070 con 0x7f7b140665f0 2021-10-20T23:28:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b03fff700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7af00534f0 0x7f7af00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.937+0000 7f7b03fff700 1 -- 172.21.15.12:0/3246565040 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f7b0406cf30 con 0x7f7b140665f0 2021-10-20T23:28:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.941+0000 7f7b127fc700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7af00534f0 0x7f7af00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.941+0000 7f7b127fc700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7af00534f0 0x7f7af00559b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f7b0800b000 tx=0x7f7b08006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:25.949+0000 7f7b03fff700 1 -- 172.21.15.12:0/3246565040 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b140abcb0 con 0x7f7b140665f0 2021-10-20T23:28:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.125+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f7b140abcb0 con 0x7f7b140665f0 2021-10-20T23:28:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.125+0000 7f7b03fff700 1 -- 172.21.15.12:0/3246565040 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1932 (secure 0 0 0) 0x7f7b140abcb0 con 0x7f7b140665f0 2021-10-20T23:28:26.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:26.140 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:28:26.141 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:26.141 INFO:teuthology.orchestra.run.smithi012.stdout: "total_bytes": 773094113280, 2021-10-20T23:28:26.141 INFO:teuthology.orchestra.run.smithi012.stdout: "total_avail_bytes": 764491186176, 2021-10-20T23:28:26.141 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_bytes": 12992512, 2021-10-20T23:28:26.141 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_bytes": 8602927104, 2021-10-20T23:28:26.142 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_ratio": 0.011127917096018791, 2021-10-20T23:28:26.142 INFO:teuthology.orchestra.run.smithi012.stdout: "num_osds": 8, 2021-10-20T23:28:26.142 INFO:teuthology.orchestra.run.smithi012.stdout: "num_per_pool_osds": 8, 2021-10-20T23:28:26.142 INFO:teuthology.orchestra.run.smithi012.stdout: "num_per_pool_omap_osds": 8 2021-10-20T23:28:26.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:26.143 INFO:teuthology.orchestra.run.smithi012.stdout: "stats_by_class": { 2021-10-20T23:28:26.143 INFO:teuthology.orchestra.run.smithi012.stdout: "ssd": { 2021-10-20T23:28:26.143 INFO:teuthology.orchestra.run.smithi012.stdout: "total_bytes": 773094113280, 2021-10-20T23:28:26.144 INFO:teuthology.orchestra.run.smithi012.stdout: "total_avail_bytes": 764491186176, 2021-10-20T23:28:26.144 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_bytes": 12992512, 2021-10-20T23:28:26.144 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_bytes": 8602927104, 2021-10-20T23:28:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "total_used_raw_ratio": 0.011127917096018791 2021-10-20T23:28:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:28:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_health_metrics", 2021-10-20T23:28:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1, 2021-10-20T23:28:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:28:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 2, 2021-10-20T23:28:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:28:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:28:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:28:26.148 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362918215680 2021-10-20T23:28:26.148 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:26.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:26.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:26.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd", 2021-10-20T23:28:26.149 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2, 2021-10-20T23:28:26.149 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:26.149 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:28:26.149 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 0, 2021-10-20T23:28:26.150 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:28:26.150 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:28:26.150 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:28:26.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362918215680 2021-10-20T23:28:26.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:26.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:26.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:26.151 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs_data", 2021-10-20T23:28:26.151 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 22, 2021-10-20T23:28:26.151 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:26.152 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 0, 2021-10-20T23:28:26.152 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 0, 2021-10-20T23:28:26.152 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 0, 2021-10-20T23:28:26.152 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 0, 2021-10-20T23:28:26.153 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 0, 2021-10-20T23:28:26.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362918215680 2021-10-20T23:28:26.153 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:26.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:26.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:26.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs_metadata", 2021-10-20T23:28:26.154 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 23, 2021-10-20T23:28:26.154 INFO:teuthology.orchestra.run.smithi012.stdout: "stats": { 2021-10-20T23:28:26.158 INFO:teuthology.orchestra.run.smithi012.stdout: "stored": 617, 2021-10-20T23:28:26.158 INFO:teuthology.orchestra.run.smithi012.stdout: "objects": 1, 2021-10-20T23:28:26.158 INFO:teuthology.orchestra.run.smithi012.stdout: "kb_used": 8, 2021-10-20T23:28:26.158 INFO:teuthology.orchestra.run.smithi012.stdout: "bytes_used": 8192, 2021-10-20T23:28:26.159 INFO:teuthology.orchestra.run.smithi012.stdout: "percent_used": 1.1286289236522862e-08, 2021-10-20T23:28:26.159 INFO:teuthology.orchestra.run.smithi012.stdout: "max_avail": 362918215680 2021-10-20T23:28:26.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:26.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:26.160 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:26.160 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:28:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7af00534f0 msgr2=0x7f7af00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7af00534f0 0x7f7af00559b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f7b0800b000 tx=0x7f7b08006df0).stop 2021-10-20T23:28:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 msgr2=0x7f7b14142480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b14142480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f7b040032f0 tx=0x7f7b04017000).stop 2021-10-20T23:28:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 shutdown_connections 2021-10-20T23:28:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7af00534f0 0x7f7af00559b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b14140cb0 0x7f7b14150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b140b1a30 0x7f7b14150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 --2- 172.21.15.12:0/3246565040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b140665f0 0x7f7b14142480 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 >> 172.21.15.12:0/3246565040 conn(0x7f7b140636e0 msgr2=0x7f7b140b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:26.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 shutdown_connections 2021-10-20T23:28:26.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.129+0000 7f7b13fff700 1 -- 172.21.15.12:0/3246565040 wait complete. 2021-10-20T23:28:26.166 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-10-20T23:28:26.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-10-20T23:28:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.265+0000 7f3d41d44700 1 Processor -- start 2021-10-20T23:28:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.265+0000 7f3d41d44700 1 -- start start 2021-10-20T23:28:26.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c0a9ec0 0x7f3d3c0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3c061990 con 0x7f3d3c0603d0 2021-10-20T23:28:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3c061c30 con 0x7f3d3c13f790 2021-10-20T23:28:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c060b90 con 0x7f3d3c0a9ec0 2021-10-20T23:28:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3d3c0603d0 0x7f3d3c13ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42636/0 (socket says 172.21.15.12:42636) 2021-10-20T23:28:26.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3affd700 1 -- 172.21.15.12:0/2737008990 learned_addr learned my addr 172.21.15.12:0/2737008990 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:26.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3b7fe700 1 --2- 172.21.15.12:0/2737008990 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c0a9ec0 0x7f3d3c0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3a7fc700 1 -- 172.21.15.12:0/2737008990 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135006564 0 0) 0x7f3d3c061990 con 0x7f3d3c0603d0 2021-10-20T23:28:26.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3a7fc700 1 -- 172.21.15.12:0/2737008990 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d28003260 con 0x7f3d3c0603d0 2021-10-20T23:28:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3b7fe700 1 -- 172.21.15.12:0/2737008990 >> v1:172.21.15.31:6789/0 conn(0x7f3d3c13f790 legacy=0x7f3d3c14a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3b7fe700 1 -- 172.21.15.12:0/2737008990 >> v1:172.21.15.12:6789/0 conn(0x7f3d3c0603d0 legacy=0x7f3d3c13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3b7fe700 1 -- 172.21.15.12:0/2737008990 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c060e30 con 0x7f3d3c0a9ec0 2021-10-20T23:28:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3b7fe700 1 --2- 172.21.15.12:0/2737008990 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c0a9ec0 0x7f3d3c0aa2a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3d340032f0 tx=0x7f3d3400a370).ready entity=mon.2 client_cookie=863500f7ead384e5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3a7fc700 1 -- 172.21.15.12:0/2737008990 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3400cba0 con 0x7f3d3c0a9ec0 2021-10-20T23:28:26.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3a7fc700 1 -- 172.21.15.12:0/2737008990 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3400cd00 con 0x7f3d3c0a9ec0 2021-10-20T23:28:26.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d3a7fc700 1 -- 172.21.15.12:0/2737008990 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d34010600 con 0x7f3d3c0a9ec0 2021-10-20T23:28:26.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 -- 172.21.15.12:0/2737008990 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c0a9ec0 msgr2=0x7f3d3c0aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 --2- 172.21.15.12:0/2737008990 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c0a9ec0 0x7f3d3c0aa2a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3d340032f0 tx=0x7f3d3400a370).stop 2021-10-20T23:28:26.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 -- 172.21.15.12:0/2737008990 shutdown_connections 2021-10-20T23:28:26.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 --2- 172.21.15.12:0/2737008990 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c0a9ec0 0x7f3d3c0aa2a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 -- 172.21.15.12:0/2737008990 >> 172.21.15.12:0/2737008990 conn(0x7f3d3c0b2970 msgr2=0x7f3d3c0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:26.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 -- 172.21.15.12:0/2737008990 shutdown_connections 2021-10-20T23:28:26.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.269+0000 7f3d41d44700 1 -- 172.21.15.12:0/2737008990 wait complete. 2021-10-20T23:28:26.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 Processor -- start 2021-10-20T23:28:26.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 -- start start 2021-10-20T23:28:26.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0603d0 0x7f3d3c0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d3c0a9ec0 0x7f3d3c137750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c13f790 0x7f3d3c137c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c142220 con 0x7f3d3c0603d0 2021-10-20T23:28:26.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c145590 con 0x7f3d3c0a9ec0 2021-10-20T23:28:26.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c146840 con 0x7f3d3c13f790 2021-10-20T23:28:26.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0603d0 0x7f3d3c0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0603d0 0x7f3d3c0b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44046/0 (socket says 172.21.15.12:44046) 2021-10-20T23:28:26.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3b7fe700 1 -- 172.21.15.12:0/2541760046 learned_addr learned my addr 172.21.15.12:0/2541760046 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:26.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3bfff700 1 --2- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c13f790 0x7f3d3c137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3affd700 1 --2- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d3c0a9ec0 0x7f3d3c137750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3b7fe700 1 -- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c13f790 msgr2=0x7f3d3c137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3b7fe700 1 --2- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c13f790 0x7f3d3c137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3b7fe700 1 -- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d3c0a9ec0 msgr2=0x7f3d3c137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3b7fe700 1 --2- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d3c0a9ec0 0x7f3d3c137750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3b7fe700 1 -- 172.21.15.12:0/2541760046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3400a610 con 0x7f3d3c0603d0 2021-10-20T23:28:26.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3bfff700 1 --2- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d3c13f790 0x7f3d3c137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:26.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d3b7fe700 1 --2- 172.21.15.12:0/2541760046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0603d0 0x7f3d3c0b4f50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f3d34006f40 tx=0x7f3d3c061dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:26.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d38ff9700 1 -- 172.21.15.12:0/2541760046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3401a650 con 0x7f3d3c0603d0 2021-10-20T23:28:26.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d38ff9700 1 -- 172.21.15.12:0/2541760046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3401a7b0 con 0x7f3d3c0603d0 2021-10-20T23:28:26.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 -- 172.21.15.12:0/2541760046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3c138130 con 0x7f3d3c0603d0 2021-10-20T23:28:26.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d38ff9700 1 -- 172.21.15.12:0/2541760046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3401ab10 con 0x7f3d3c0603d0 2021-10-20T23:28:26.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.273+0000 7f3d41d44700 1 -- 172.21.15.12:0/2541760046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3c146a70 con 0x7f3d3c0603d0 2021-10-20T23:28:26.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.277+0000 7f3d41d44700 1 -- 172.21.15.12:0/2541760046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3c0610d0 con 0x7f3d3c0603d0 2021-10-20T23:28:26.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.277+0000 7f3d38ff9700 1 -- 172.21.15.12:0/2541760046 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3d3402a070 con 0x7f3d3c0603d0 2021-10-20T23:28:26.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.277+0000 7f3d38ff9700 1 --2- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3d1c053580 0x7f3d1c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.277+0000 7f3d38ff9700 1 -- 172.21.15.12:0/2541760046 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f3d3406d5d0 con 0x7f3d3c0603d0 2021-10-20T23:28:26.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.277+0000 7f3d3affd700 1 --2- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3d1c053580 0x7f3d1c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.277+0000 7f3d3affd700 1 --2- 172.21.15.12:0/2541760046 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3d1c053580 0x7f3d1c055a40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f3d3000d000 tx=0x7f3d30009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:26.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.285+0000 7f3d38ff9700 1 -- 172.21.15.12:0/2541760046 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3d340444c0 con 0x7f3d3c0603d0 2021-10-20T23:28:26.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.449+0000 7f3d41d44700 1 -- 172.21.15.12:0/2541760046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3d3c138130 con 0x7f3d3c0603d0 2021-10-20T23:28:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.449+0000 7f3d38ff9700 1 -- 172.21.15.12:0/2541760046 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v63) v1 ==== 209+0+0 (secure 0 0 0) 0x7f3d3c138130 con 0x7f3d3c0603d0 2021-10-20T23:28:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-10-20T23:28:26.467 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-10-20T23:28:26.469 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:28:26.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc5844be700 1 Processor -- start 2021-10-20T23:28:26.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc5844be700 1 -- start start 2021-10-20T23:28:26.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc5844be700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc57c0b43c0 0x7fc57c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc5844be700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c1440b0 con 0x7fc57c0b6580 2021-10-20T23:28:26.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc5844be700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c143b70 con 0x7fc57c0b6960 2021-10-20T23:28:26.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc5844be700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c143e10 con 0x7fc57c0b43c0 2021-10-20T23:28:26.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc581a59700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc57c0b43c0 0x7fc57c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc58225a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc57c0b6580 0x7fc57c061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42648/0 (socket says 172.21.15.12:42648) 2021-10-20T23:28:26.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc58225a700 1 -- 172.21.15.12:0/2544471632 learned_addr learned my addr 172.21.15.12:0/2544471632 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:26.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc581a59700 1 -- 172.21.15.12:0/2544471632 >> v1:172.21.15.31:6789/0 conn(0x7fc57c0b6960 legacy=0x7fc57c12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc581a59700 1 -- 172.21.15.12:0/2544471632 >> v1:172.21.15.12:6789/0 conn(0x7fc57c0b6580 legacy=0x7fc57c061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc581a59700 1 -- 172.21.15.12:0/2544471632 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0615f0 con 0x7fc57c0b43c0 2021-10-20T23:28:26.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc581a59700 1 --2- 172.21.15.12:0/2544471632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b43c0 0x7fc57c0b5bf0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fc57c143120 tx=0x7fc56c006df0).ready entity=mon.0 client_cookie=79640b1c489c9080 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:26.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc581258700 1 -- 172.21.15.12:0/2544471632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c00d610 con 0x7fc57c0b43c0 2021-10-20T23:28:26.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc581258700 1 -- 172.21.15.12:0/2544471632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c000e90 con 0x7fc57c0b43c0 2021-10-20T23:28:26.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.573+0000 7fc581258700 1 -- 172.21.15.12:0/2544471632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c00d960 con 0x7fc57c0b43c0 2021-10-20T23:28:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- 172.21.15.12:0/2544471632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b43c0 msgr2=0x7fc57c0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 --2- 172.21.15.12:0/2544471632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b43c0 0x7fc57c0b5bf0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fc57c143120 tx=0x7fc56c006df0).stop 2021-10-20T23:28:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- 172.21.15.12:0/2544471632 shutdown_connections 2021-10-20T23:28:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 --2- 172.21.15.12:0/2544471632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b43c0 0x7fc57c0b5bf0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- 172.21.15.12:0/2544471632 >> 172.21.15.12:0/2544471632 conn(0x7fc57c05c490 msgr2=0x7fc57c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:26.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- 172.21.15.12:0/2544471632 shutdown_connections 2021-10-20T23:28:26.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- 172.21.15.12:0/2544471632 wait complete. 2021-10-20T23:28:26.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 Processor -- start 2021-10-20T23:28:26.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- start start 2021-10-20T23:28:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c0b43c0 0x7fc57c1264a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0b6580 0x7fc57c1527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6960 0x7fc57c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1523b0 con 0x7fc57c0b6960 2021-10-20T23:28:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0ad9a0 con 0x7fc57c0b6580 2021-10-20T23:28:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0adc40 con 0x7fc57c0b43c0 2021-10-20T23:28:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc582a5b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6960 0x7fc57c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc582a5b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6960 0x7fc57c152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44064/0 (socket says 172.21.15.12:44064) 2021-10-20T23:28:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc582a5b700 1 -- 172.21.15.12:0/100214596 learned_addr learned my addr 172.21.15.12:0/100214596 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:26.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc58225a700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c0b43c0 0x7fc57c1264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc581a59700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0b6580 0x7fc57c1527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc582a5b700 1 -- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c0b43c0 msgr2=0x7fc57c1264a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc582a5b700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c0b43c0 0x7fc57c1264a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc582a5b700 1 -- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0b6580 msgr2=0x7fc57c1527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc582a5b700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0b6580 0x7fc57c1527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc582a5b700 1 -- 172.21.15.12:0/100214596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c00b180 con 0x7fc57c0b6960 2021-10-20T23:28:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc582a5b700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6960 0x7fc57c152c90 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fc57c0608b0 tx=0x7fc5740013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc56b7fe700 1 -- 172.21.15.12:0/100214596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc574006aa0 con 0x7fc57c0b6960 2021-10-20T23:28:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc56b7fe700 1 -- 172.21.15.12:0/100214596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574006c00 con 0x7fc57c0b6960 2021-10-20T23:28:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c0adee0 con 0x7fc57c0b6960 2021-10-20T23:28:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc56b7fe700 1 -- 172.21.15.12:0/100214596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc574007030 con 0x7fc57c0b6960 2021-10-20T23:28:26.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.577+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c153180 con 0x7fc57c0b6960 2021-10-20T23:28:26.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.581+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c061890 con 0x7fc57c0b6960 2021-10-20T23:28:26.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.581+0000 7fc56b7fe700 1 -- 172.21.15.12:0/100214596 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc574010030 con 0x7fc57c0b6960 2021-10-20T23:28:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.581+0000 7fc56b7fe700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc55c053610 0x7fc55c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.581+0000 7fc56b7fe700 1 -- 172.21.15.12:0/100214596 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6422+0+0 (secure 0 0 0) 0x7fc57406ba20 con 0x7fc57c0b6960 2021-10-20T23:28:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.581+0000 7fc58225a700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc55c053610 0x7fc55c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.581+0000 7fc58225a700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc55c053610 0x7fc55c055ad0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fc57800d000 tx=0x7fc578009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.589+0000 7fc56b7fe700 1 -- 172.21.15.12:0/100214596 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc574042910 con 0x7fc57c0b6960 2021-10-20T23:28:26.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.753+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fc57c057350 con 0x7fc57c0b6960 2021-10-20T23:28:26.765 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:28:26.753+0000 7f549d58b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:28:26.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.761+0000 7fc56b7fe700 1 -- 172.21.15.12:0/100214596 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v64) v1 ==== 189+0+0 (secure 0 0 0) 0x7fc574045f30 con 0x7fc57c0b6960 2021-10-20T23:28:26.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc55c053610 msgr2=0x7fc55c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc55c053610 0x7fc55c055ad0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fc57800d000 tx=0x7fc578009040).stop 2021-10-20T23:28:26.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6960 msgr2=0x7fc57c152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6960 0x7fc57c152c90 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fc57c0608b0 tx=0x7fc5740013a0).stop 2021-10-20T23:28:26.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 shutdown_connections 2021-10-20T23:28:26.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc55c053610 0x7fc55c055ad0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0b6960 0x7fc57c152c90 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c0b6580 0x7fc57c1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 --2- 172.21.15.12:0/100214596 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc57c0b43c0 0x7fc57c1264a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 >> 172.21.15.12:0/100214596 conn(0x7fc57c05c490 msgr2=0x7fc57c140f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:26.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 shutdown_connections 2021-10-20T23:28:26.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.765+0000 7fc5844be700 1 -- 172.21.15.12:0/100214596 wait complete. 2021-10-20T23:28:26.780 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 23 and data pool 22 2021-10-20T23:28:26.788 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:28:26.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6726086700 1 Processor -- start 2021-10-20T23:28:26.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6726086700 1 -- start start 2021-10-20T23:28:26.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6726086700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f672005c7d0 0x7f67200b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6726086700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f672005d0b0 0x7f672013f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6726086700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672013f880 con 0x7f67200ace30 2021-10-20T23:28:26.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6726086700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6720067d70 con 0x7f672005d0b0 2021-10-20T23:28:26.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6726086700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67200b2af0 con 0x7f672005c7d0 2021-10-20T23:28:26.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6724883700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f672005d0b0 0x7f672013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6724883700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f672005d0b0 0x7f672013f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44072/0 (socket says 172.21.15.12:44072) 2021-10-20T23:28:26.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6724883700 1 -- 172.21.15.12:0/2129196841 learned_addr learned my addr 172.21.15.12:0/2129196841 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:26.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.881+0000 7f6725084700 1 --2- 172.21.15.12:0/2129196841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f672005c7d0 0x7f67200b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f670ffff700 1 -- 172.21.15.12:0/2129196841 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239871729 0 0) 0x7f6718001490 con 0x7f67200ace30 2021-10-20T23:28:26.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f670ffff700 1 -- 172.21.15.12:0/2129196841 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6708003260 con 0x7f67200ace30 2021-10-20T23:28:26.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6724883700 1 -- 172.21.15.12:0/2129196841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f672005c7d0 msgr2=0x7f67200b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:26.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6724883700 1 --2- 172.21.15.12:0/2129196841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f672005c7d0 0x7f67200b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6724883700 1 -- 172.21.15.12:0/2129196841 >> v1:172.21.15.31:6789/0 conn(0x7f67200ace30 legacy=0x7f67200b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6724883700 1 -- 172.21.15.12:0/2129196841 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672005cbb0 con 0x7f672005d0b0 2021-10-20T23:28:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6724883700 1 --2- 172.21.15.12:0/2129196841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 0x7f672013f390 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f6710002f70 tx=0x7f6710006f40).ready entity=mon.0 client_cookie=ce7b07c0a48b236e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f670ffff700 1 -- 172.21.15.12:0/2129196841 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671000d9a0 con 0x7f672005d0b0 2021-10-20T23:28:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f670ffff700 1 -- 172.21.15.12:0/2129196841 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710000e90 con 0x7f672005d0b0 2021-10-20T23:28:26.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f670ffff700 1 -- 172.21.15.12:0/2129196841 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671000dd30 con 0x7f672005d0b0 2021-10-20T23:28:26.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 -- 172.21.15.12:0/2129196841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 msgr2=0x7f672013f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 --2- 172.21.15.12:0/2129196841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 0x7f672013f390 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f6710002f70 tx=0x7f6710006f40).stop 2021-10-20T23:28:26.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 -- 172.21.15.12:0/2129196841 shutdown_connections 2021-10-20T23:28:26.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 --2- 172.21.15.12:0/2129196841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 0x7f672013f390 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 --2- 172.21.15.12:0/2129196841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f672005c7d0 0x7f67200b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 -- 172.21.15.12:0/2129196841 >> 172.21.15.12:0/2129196841 conn(0x7f6720060180 msgr2=0x7f67200b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:26.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 -- 172.21.15.12:0/2129196841 shutdown_connections 2021-10-20T23:28:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 -- 172.21.15.12:0/2129196841 wait complete. 2021-10-20T23:28:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 Processor -- start 2021-10-20T23:28:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.885+0000 7f6726086700 1 -- start start 2021-10-20T23:28:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6726086700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f672005c7d0 0x7f672009ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6726086700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 0x7f67201416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6726086700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67200ace30 0x7f6720141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6726086700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67200b0760 con 0x7f672005d0b0 2021-10-20T23:28:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6726086700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67200aad50 con 0x7f672005c7d0 2021-10-20T23:28:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6726086700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67200a8740 con 0x7f67200ace30 2021-10-20T23:28:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6724883700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 0x7f67201416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6724883700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 0x7f67201416e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44074/0 (socket says 172.21.15.12:44074) 2021-10-20T23:28:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6724883700 1 -- 172.21.15.12:0/1921523620 learned_addr learned my addr 172.21.15.12:0/1921523620 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6725084700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f672005c7d0 0x7f672009ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6725885700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67200ace30 0x7f6720141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6724883700 1 -- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67200ace30 msgr2=0x7f6720141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6724883700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67200ace30 0x7f6720141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6724883700 1 -- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f672005c7d0 msgr2=0x7f672009ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6724883700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f672005c7d0 0x7f672009ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:26.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6724883700 1 -- 172.21.15.12:0/1921523620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671000b460 con 0x7f672005d0b0 2021-10-20T23:28:26.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6724883700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 0x7f67201416e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f6710002f70 tx=0x7f6710006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:26.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f670e7fc700 1 -- 172.21.15.12:0/1921523620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671001d070 con 0x7f672005d0b0 2021-10-20T23:28:26.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f670e7fc700 1 -- 172.21.15.12:0/1921523620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710018800 con 0x7f672005d0b0 2021-10-20T23:28:26.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67200ab800 con 0x7f672005d0b0 2021-10-20T23:28:26.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f670e7fc700 1 -- 172.21.15.12:0/1921523620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671000dee0 con 0x7f672005d0b0 2021-10-20T23:28:26.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6720143610 con 0x7f672005d0b0 2021-10-20T23:28:26.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.889+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67200ab660 con 0x7f672005d0b0 2021-10-20T23:28:26.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.893+0000 7f670e7fc700 1 -- 172.21.15.12:0/1921523620 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6710018b60 con 0x7f672005d0b0 2021-10-20T23:28:26.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.893+0000 7f670e7fc700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6700053580 0x7f6700055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:26.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.893+0000 7f670e7fc700 1 -- 172.21.15.12:0/1921523620 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f671006d4b0 con 0x7f672005d0b0 2021-10-20T23:28:26.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.893+0000 7f6725084700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6700053580 0x7f6700055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:26.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.893+0000 7f6725084700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6700053580 0x7f6700055a40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f671c00b000 tx=0x7f671c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:26.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:26.897+0000 7f670e7fc700 1 -- 172.21.15.12:0/1921523620 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67200ab660 con 0x7f672005d0b0 2021-10-20T23:28:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.065+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f67200ab660 con 0x7f672005d0b0 2021-10-20T23:28:27.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.965+0000 7f670e7fc700 1 -- 172.21.15.12:0/1921523620 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7f67200ab660 con 0x7f672005d0b0 2021-10-20T23:28:27.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6700053580 msgr2=0x7f6700055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:27.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6700053580 0x7f6700055a40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f671c00b000 tx=0x7f671c008040).stop 2021-10-20T23:28:27.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 msgr2=0x7f67201416e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:27.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 0x7f67201416e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f6710002f70 tx=0x7f6710006f40).stop 2021-10-20T23:28:27.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 shutdown_connections 2021-10-20T23:28:27.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6700053580 0x7f6700055a40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:27.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67200ace30 0x7f6720141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:27.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f672005d0b0 0x7f67201416e0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:27.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 --2- 172.21.15.12:0/1921523620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f672005c7d0 0x7f672009ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:27.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 >> 172.21.15.12:0/1921523620 conn(0x7f6720060180 msgr2=0x7f67200b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:27.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 shutdown_connections 2021-10-20T23:28:27.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:27.969+0000 7f6726086700 1 -- 172.21.15.12:0/1921523620 wait complete. 2021-10-20T23:28:27.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:28:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.109+0000 7f6a8cb17700 1 Processor -- start 2021-10-20T23:28:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.109+0000 7f6a8cb17700 1 -- start start 2021-10-20T23:28:28.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a8cb17700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6a880af780 0x7f6a88143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:28.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a8cb17700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 0x7f6a88140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a8cb17700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a880b3880 con 0x7f6a880b34a0 2021-10-20T23:28:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a8cb17700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a88144260 con 0x7f6a880af780 2021-10-20T23:28:28.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a8cb17700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a881469b0 con 0x7f6a880a9f40 2021-10-20T23:28:28.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a8659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6a880b34a0 0x7f6a880af070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42676/0 (socket says 172.21.15.12:42676) 2021-10-20T23:28:28.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a8659c700 1 -- 172.21.15.12:0/1223942741 learned_addr learned my addr 172.21.15.12:0/1223942741 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:28.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a7ffff700 1 --2- 172.21.15.12:0/1223942741 >> v2:172.21.15.31:3300/0 conn(0x7f6a880af780 0x7f6a88143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:28.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a86d9d700 1 --2- 172.21.15.12:0/1223942741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 0x7f6a88140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:28.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a85d9b700 1 -- 172.21.15.12:0/1223942741 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928480767 0 0) 0x7f6a880b3880 con 0x7f6a880b34a0 2021-10-20T23:28:28.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a85d9b700 1 -- 172.21.15.12:0/1223942741 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a68003260 con 0x7f6a880b34a0 2021-10-20T23:28:28.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a7ffff700 1 -- 172.21.15.12:0/1223942741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 msgr2=0x7f6a88140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:28.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a7ffff700 1 --2- 172.21.15.12:0/1223942741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 0x7f6a88140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:28.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a7ffff700 1 -- 172.21.15.12:0/1223942741 >> v1:172.21.15.12:6789/0 conn(0x7f6a880b34a0 legacy=0x7f6a880af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:28.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a7ffff700 1 -- 172.21.15.12:0/1223942741 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88146c50 con 0x7f6a880af780 2021-10-20T23:28:28.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a86d9d700 1 --2- 172.21.15.12:0/1223942741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 0x7f6a88140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:28.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a7ffff700 1 --2- 172.21.15.12:0/1223942741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 0x7f6a88143d70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f6a70002f70 tx=0x7f6a70006df0).ready entity=mon.1 client_cookie=1414da5779c23a0b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:28.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a85d9b700 1 -- 172.21.15.12:0/1223942741 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a7000d4a0 con 0x7f6a880af780 2021-10-20T23:28:28.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a85d9b700 1 -- 172.21.15.12:0/1223942741 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a70000e90 con 0x7f6a880af780 2021-10-20T23:28:28.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.113+0000 7f6a85d9b700 1 -- 172.21.15.12:0/1223942741 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a7000d7f0 con 0x7f6a880af780 2021-10-20T23:28:28.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1223942741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 msgr2=0x7f6a88143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:28.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 --2- 172.21.15.12:0/1223942741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 0x7f6a88143d70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f6a70002f70 tx=0x7f6a70006df0).stop 2021-10-20T23:28:28.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1223942741 shutdown_connections 2021-10-20T23:28:28.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 --2- 172.21.15.12:0/1223942741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 0x7f6a88140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:28.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 --2- 172.21.15.12:0/1223942741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 0x7f6a88143d70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:28.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1223942741 >> 172.21.15.12:0/1223942741 conn(0x7f6a880607c0 msgr2=0x7f6a88060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:28.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1223942741 shutdown_connections 2021-10-20T23:28:28.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1223942741 wait complete. 2021-10-20T23:28:28.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 Processor -- start 2021-10-20T23:28:28.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 -- start start 2021-10-20T23:28:28.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 0x7f6a88142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:28.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 0x7f6a88155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:28.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a880b34a0 0x7f6a88156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:28.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88156530 con 0x7f6a880b34a0 2021-10-20T23:28:28.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88150260 con 0x7f6a880af780 2021-10-20T23:28:28.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.117+0000 7f6a8cb17700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88144d00 con 0x7f6a880a9f40 2021-10-20T23:28:28.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a86d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a880b34a0 0x7f6a88156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:28.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a86d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a880b34a0 0x7f6a88156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44092/0 (socket says 172.21.15.12:44092) 2021-10-20T23:28:28.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a86d9d700 1 -- 172.21.15.12:0/1171615055 learned_addr learned my addr 172.21.15.12:0/1171615055 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:28.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a8659c700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 0x7f6a88142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:28.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a7ffff700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 0x7f6a88155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:28.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a86d9d700 1 -- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 msgr2=0x7f6a88142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:28.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a86d9d700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 0x7f6a88142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:28.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a86d9d700 1 -- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 msgr2=0x7f6a88155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:28.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a86d9d700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 0x7f6a88155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:28.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a86d9d700 1 -- 172.21.15.12:0/1171615055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80009470 con 0x7f6a880b34a0 2021-10-20T23:28:28.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a7ffff700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 0x7f6a88155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:28.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a86d9d700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a880b34a0 0x7f6a88156040 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f6a8000c000 tx=0x7f6a800091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:28.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a7f7fe700 1 -- 172.21.15.12:0/1171615055 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8000c850 con 0x7f6a880b34a0 2021-10-20T23:28:28.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a7f7fe700 1 -- 172.21.15.12:0/1171615055 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8000c9b0 con 0x7f6a880b34a0 2021-10-20T23:28:28.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7000b180 con 0x7f6a880b34a0 2021-10-20T23:28:28.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a7f7fe700 1 -- 172.21.15.12:0/1171615055 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8000cd10 con 0x7f6a880b34a0 2021-10-20T23:28:28.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a88148030 con 0x7f6a880b34a0 2021-10-20T23:28:28.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a7f7fe700 1 -- 172.21.15.12:0/1171615055 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a80022070 con 0x7f6a880b34a0 2021-10-20T23:28:28.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a881481f0 con 0x7f6a880b34a0 2021-10-20T23:28:28.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a7f7fe700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6a6c053610 0x7f6a6c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:28.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.121+0000 7f6a7f7fe700 1 -- 172.21.15.12:0/1171615055 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f6a8006c2d0 con 0x7f6a880b34a0 2021-10-20T23:28:28.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.125+0000 7f6a8659c700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6a6c053610 0x7f6a6c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:28.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.125+0000 7f6a8659c700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6a6c053610 0x7f6a6c055ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f6a7800d000 tx=0x7f6a78009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:28.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.129+0000 7f6a7f7fe700 1 -- 172.21.15.12:0/1171615055 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a80069e90 con 0x7f6a880b34a0 2021-10-20T23:28:28.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:28.253+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a88144ec0 con 0x7f6a880b34a0 2021-10-20T23:28:29.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.209+0000 7f6a7f7fe700 1 -- 172.21.15.12:0/1171615055 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v131) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6a80016020 con 0x7f6a880b34a0 2021-10-20T23:28:29.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6a6c053610 msgr2=0x7f6a6c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:29.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6a6c053610 0x7f6a6c055ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f6a7800d000 tx=0x7f6a78009040).stop 2021-10-20T23:28:29.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a880b34a0 msgr2=0x7f6a88156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:29.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a880b34a0 0x7f6a88156040 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f6a8000c000 tx=0x7f6a800091d0).stop 2021-10-20T23:28:29.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 shutdown_connections 2021-10-20T23:28:29.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6a6c053610 0x7f6a6c055ad0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:29.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a880b34a0 0x7f6a88156040 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:29.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a880af780 0x7f6a88155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:29.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 --2- 172.21.15.12:0/1171615055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a880a9f40 0x7f6a88142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:29.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 >> 172.21.15.12:0/1171615055 conn(0x7f6a880607c0 msgr2=0x7f6a881439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:29.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 shutdown_connections 2021-10-20T23:28:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.213+0000 7f6a8cb17700 1 -- 172.21.15.12:0/1171615055 wait complete. 2021-10-20T23:28:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:28:29.239 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:28:29.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28ddc7700 1 Processor -- start 2021-10-20T23:28:29.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28ddc7700 1 -- start start 2021-10-20T23:28:29.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28ddc7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd288064ba0 0x7fd2880b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:29.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28ddc7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2880b1fd0 0x7fd288061a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:29.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28ddc7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd288066c00 con 0x7fd288061ef0 2021-10-20T23:28:29.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28ddc7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd288066150 con 0x7fd288064ba0 2021-10-20T23:28:29.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28ddc7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd288064f80 con 0x7fd2880b1fd0 2021-10-20T23:28:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28cdc5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd288064ba0 0x7fd2880b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28cdc5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd288064ba0 0x7fd2880b7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44096/0 (socket says 172.21.15.12:44096) 2021-10-20T23:28:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28cdc5700 1 -- 172.21.15.12:0/1386607638 learned_addr learned my addr 172.21.15.12:0/1386607638 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd287fff700 1 --2- 172.21.15.12:0/1386607638 >> v2:172.21.15.31:3300/0 conn(0x7fd2880b1fd0 0x7fd288061a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28cdc5700 1 -- 172.21.15.12:0/1386607638 >> v2:172.21.15.31:3300/0 conn(0x7fd2880b1fd0 msgr2=0x7fd288061a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28cdc5700 1 --2- 172.21.15.12:0/1386607638 >> v2:172.21.15.31:3300/0 conn(0x7fd2880b1fd0 0x7fd288061a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28cdc5700 1 -- 172.21.15.12:0/1386607638 >> v1:172.21.15.12:6789/0 conn(0x7fd288061ef0 legacy=0x7fd2880b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28cdc5700 1 -- 172.21.15.12:0/1386607638 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288066ea0 con 0x7fd288064ba0 2021-10-20T23:28:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd28cdc5700 1 --2- 172.21.15.12:0/1386607638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288064ba0 0x7fd2880b7e20 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fd2880628e0 tx=0x7fd278009290).ready entity=mon.0 client_cookie=bd4d268cb30a1b20 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:29.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.341+0000 7fd2877fe700 1 -- 172.21.15.12:0/1386607638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd27800b860 con 0x7fd288064ba0 2021-10-20T23:28:29.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd2877fe700 1 -- 172.21.15.12:0/1386607638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27800b9c0 con 0x7fd288064ba0 2021-10-20T23:28:29.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd2877fe700 1 -- 172.21.15.12:0/1386607638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd27800bb30 con 0x7fd288064ba0 2021-10-20T23:28:29.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 -- 172.21.15.12:0/1386607638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288064ba0 msgr2=0x7fd2880b7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:29.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 --2- 172.21.15.12:0/1386607638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288064ba0 0x7fd2880b7e20 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fd2880628e0 tx=0x7fd278009290).stop 2021-10-20T23:28:29.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 -- 172.21.15.12:0/1386607638 shutdown_connections 2021-10-20T23:28:29.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 --2- 172.21.15.12:0/1386607638 >> v2:172.21.15.31:3300/0 conn(0x7fd2880b1fd0 0x7fd288061a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 --2- 172.21.15.12:0/1386607638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288064ba0 0x7fd2880b7e20 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 -- 172.21.15.12:0/1386607638 >> 172.21.15.12:0/1386607638 conn(0x7fd288062be0 msgr2=0x7fd28805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 -- 172.21.15.12:0/1386607638 shutdown_connections 2021-10-20T23:28:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 -- 172.21.15.12:0/1386607638 wait complete. 2021-10-20T23:28:29.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 Processor -- start 2021-10-20T23:28:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 -- start start 2021-10-20T23:28:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288061ef0 0x7fd2880ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd288064ba0 0x7fd2880b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2880b1fd0 0x7fd2880b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880b1cd0 con 0x7fd288061ef0 2021-10-20T23:28:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880ad330 con 0x7fd2880b1fd0 2021-10-20T23:28:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28ddc7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880ad5d0 con 0x7fd288064ba0 2021-10-20T23:28:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28cdc5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288061ef0 0x7fd2880ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:29.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28cdc5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288061ef0 0x7fd2880ad940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44102/0 (socket says 172.21.15.12:44102) 2021-10-20T23:28:29.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28cdc5700 1 -- 172.21.15.12:0/3870341134 learned_addr learned my addr 172.21.15.12:0/3870341134 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:29.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd287fff700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd288064ba0 0x7fd2880b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:29.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28d5c6700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2880b1fd0 0x7fd2880b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:29.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28cdc5700 1 -- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd288064ba0 msgr2=0x7fd2880b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:29.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28cdc5700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd288064ba0 0x7fd2880b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:29.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28cdc5700 1 -- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2880b1fd0 msgr2=0x7fd2880b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:29.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28cdc5700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2880b1fd0 0x7fd2880b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:29.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28cdc5700 1 -- 172.21.15.12:0/3870341134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278009530 con 0x7fd288061ef0 2021-10-20T23:28:29.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.345+0000 7fd28d5c6700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2880b1fd0 0x7fd2880b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:29.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd28cdc5700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288061ef0 0x7fd2880ad940 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7fd2880628e0 tx=0x7fd278016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:29.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd285ffb700 1 -- 172.21.15.12:0/3870341134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd278021630 con 0x7fd288061ef0 2021-10-20T23:28:29.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd285ffb700 1 -- 172.21.15.12:0/3870341134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd278021790 con 0x7fd288061ef0 2021-10-20T23:28:29.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2880af8b0 con 0x7fd288061ef0 2021-10-20T23:28:29.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd285ffb700 1 -- 172.21.15.12:0/3870341134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd278021af0 con 0x7fd288061ef0 2021-10-20T23:28:29.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28805fb50 con 0x7fd288061ef0 2021-10-20T23:28:29.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd288067140 con 0x7fd288061ef0 2021-10-20T23:28:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd285ffb700 1 -- 172.21.15.12:0/3870341134 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd278027020 con 0x7fd288061ef0 2021-10-20T23:28:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd285ffb700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd26c0536d0 0x7fd26c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd285ffb700 1 -- 172.21.15.12:0/3870341134 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fd27806d070 con 0x7fd288061ef0 2021-10-20T23:28:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.349+0000 7fd287fff700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd26c0536d0 0x7fd26c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.353+0000 7fd287fff700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd26c0536d0 0x7fd26c055b90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fd27000c000 tx=0x7fd270008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:29.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.357+0000 7fd285ffb700 1 -- 172.21.15.12:0/3870341134 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2780441d0 con 0x7fd288061ef0 2021-10-20T23:28:29.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:29.481+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fd288057350 con 0x7fd288061ef0 2021-10-20T23:28:30.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.221+0000 7fd285ffb700 1 -- 172.21.15.12:0/3870341134 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v132) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd278015070 con 0x7fd288061ef0 2021-10-20T23:28:30.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd26c0536d0 msgr2=0x7fd26c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd26c0536d0 0x7fd26c055b90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fd27000c000 tx=0x7fd270008040).stop 2021-10-20T23:28:30.239 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288061ef0 msgr2=0x7fd2880ad940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288061ef0 0x7fd2880ad940 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7fd2880628e0 tx=0x7fd278016000).stop 2021-10-20T23:28:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 shutdown_connections 2021-10-20T23:28:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd26c0536d0 0x7fd26c055b90 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2880b1fd0 0x7fd2880b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd288064ba0 0x7fd2880b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 --2- 172.21.15.12:0/3870341134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd288061ef0 0x7fd2880ad940 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 >> 172.21.15.12:0/3870341134 conn(0x7fd288062be0 msgr2=0x7fd2880607c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 shutdown_connections 2021-10-20T23:28:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.229+0000 7fd28ddc7700 1 -- 172.21.15.12:0/3870341134 wait complete. 2021-10-20T23:28:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:28:30.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-10-20T23:28:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c7073700 1 Processor -- start 2021-10-20T23:28:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c7073700 1 -- start start 2021-10-20T23:28:30.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c7073700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1c0061700 0x7fb1c0146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c7073700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c00aecf0 con 0x7fb1c00ad5c0 2021-10-20T23:28:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c7073700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c00b6f20 con 0x7fb1c0061320 2021-10-20T23:28:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c7073700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c00aef20 con 0x7fb1c0061700 2021-10-20T23:28:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c6872700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1c0061700 0x7fb1c0146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c5870700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb1c00ad5c0 0x7fb1c0140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42706/0 (socket says 172.21.15.12:42706) 2021-10-20T23:28:30.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c5870700 1 -- 172.21.15.12:0/3708587332 learned_addr learned my addr 172.21.15.12:0/3708587332 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:30.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c6872700 1 -- 172.21.15.12:0/3708587332 >> v1:172.21.15.31:6789/0 conn(0x7fb1c0061320 legacy=0x7fb1c00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c506f700 1 -- 172.21.15.12:0/3708587332 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316174413 0 0) 0x7fb1c00aecf0 con 0x7fb1c00ad5c0 2021-10-20T23:28:30.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c6872700 1 -- 172.21.15.12:0/3708587332 >> v1:172.21.15.12:6789/0 conn(0x7fb1c00ad5c0 legacy=0x7fb1c0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c6872700 1 -- 172.21.15.12:0/3708587332 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00af1c0 con 0x7fb1c0061700 2021-10-20T23:28:30.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.353+0000 7fb1c6872700 1 --2- 172.21.15.12:0/3708587332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 0x7fb1c0146520 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fb1b80032f0 tx=0x7fb1b80091d0).ready entity=mon.0 client_cookie=c3a5f4777a152a38 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c506f700 1 -- 172.21.15.12:0/3708587332 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b8009ea0 con 0x7fb1c0061700 2021-10-20T23:28:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c506f700 1 -- 172.21.15.12:0/3708587332 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800b8a0 con 0x7fb1c0061700 2021-10-20T23:28:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c506f700 1 -- 172.21.15.12:0/3708587332 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b800ba10 con 0x7fb1c0061700 2021-10-20T23:28:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c7073700 1 -- 172.21.15.12:0/3708587332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 msgr2=0x7fb1c0146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c7073700 1 --2- 172.21.15.12:0/3708587332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 0x7fb1c0146520 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fb1b80032f0 tx=0x7fb1b80091d0).stop 2021-10-20T23:28:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c7073700 1 -- 172.21.15.12:0/3708587332 shutdown_connections 2021-10-20T23:28:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c7073700 1 --2- 172.21.15.12:0/3708587332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 0x7fb1c0146520 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c7073700 1 -- 172.21.15.12:0/3708587332 >> 172.21.15.12:0/3708587332 conn(0x7fb1c0066de0 msgr2=0x7fb1c00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c7073700 1 -- 172.21.15.12:0/3708587332 shutdown_connections 2021-10-20T23:28:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c7073700 1 -- 172.21.15.12:0/3708587332 wait complete. 2021-10-20T23:28:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c7073700 1 Processor -- start 2021-10-20T23:28:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.357+0000 7fb1c7073700 1 -- start start 2021-10-20T23:28:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c7073700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1c0061320 0x7fb1c00aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c7073700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 0x7fb1c005cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c7073700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1c00ad5c0 0x7fb1c00b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c7073700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00b2a20 con 0x7fb1c0061700 2021-10-20T23:28:30.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c7073700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00abfb0 con 0x7fb1c0061320 2021-10-20T23:28:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c7073700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00ac250 con 0x7fb1c00ad5c0 2021-10-20T23:28:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c5870700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 0x7fb1c005cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c5870700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 0x7fb1c005cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44118/0 (socket says 172.21.15.12:44118) 2021-10-20T23:28:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c5870700 1 -- 172.21.15.12:0/3902009558 learned_addr learned my addr 172.21.15.12:0/3902009558 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c6071700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1c0061320 0x7fb1c00aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c6872700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1c00ad5c0 0x7fb1c00b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c5870700 1 -- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1c00ad5c0 msgr2=0x7fb1c00b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c5870700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1c00ad5c0 0x7fb1c00b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c5870700 1 -- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1c0061320 msgr2=0x7fb1c00aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c5870700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1c0061320 0x7fb1c00aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c5870700 1 -- 172.21.15.12:0/3902009558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8009470 con 0x7fb1c0061700 2021-10-20T23:28:30.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c5870700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 0x7fb1c005cf70 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fb1b0000bc0 tx=0x7fb1b0007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:30.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1af7fe700 1 -- 172.21.15.12:0/3902009558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b00070d0 con 0x7fb1c0061700 2021-10-20T23:28:30.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1af7fe700 1 -- 172.21.15.12:0/3902009558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b0007230 con 0x7fb1c0061700 2021-10-20T23:28:30.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c00ac4f0 con 0x7fb1c0061700 2021-10-20T23:28:30.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1af7fe700 1 -- 172.21.15.12:0/3902009558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b0005610 con 0x7fb1c0061700 2021-10-20T23:28:30.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c00b2cb0 con 0x7fb1c0061700 2021-10-20T23:28:30.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.361+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c00ac680 con 0x7fb1c0061700 2021-10-20T23:28:30.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.365+0000 7fb1af7fe700 1 -- 172.21.15.12:0/3902009558 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb1b001a060 con 0x7fb1c0061700 2021-10-20T23:28:30.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.365+0000 7fb1af7fe700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1a00534f0 0x7fb1a00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.365+0000 7fb1af7fe700 1 -- 172.21.15.12:0/3902009558 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6422+0+0 (secure 0 0 0) 0x7fb1b006ad00 con 0x7fb1c0061700 2021-10-20T23:28:30.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.365+0000 7fb1c6071700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1a00534f0 0x7fb1a00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.365+0000 7fb1c6071700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1a00534f0 0x7fb1a00559b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fb1bc00d000 tx=0x7fb1bc007b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:30.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.369+0000 7fb1af7fe700 1 -- 172.21.15.12:0/3902009558 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb1b006e030 con 0x7fb1c0061700 2021-10-20T23:28:30.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.537+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb1c0057350 con 0x7fb1c0061700 2021-10-20T23:28:30.548 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:28:30.537+0000 7f549d58b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:28:30.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.545+0000 7fb1af7fe700 1 -- 172.21.15.12:0/3902009558 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb1b0018070 con 0x7fb1c0061700 2021-10-20T23:28:30.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1a00534f0 msgr2=0x7fb1a00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1a00534f0 0x7fb1a00559b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fb1bc00d000 tx=0x7fb1bc007b50).stop 2021-10-20T23:28:30.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 msgr2=0x7fb1c005cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 0x7fb1c005cf70 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fb1b0000bc0 tx=0x7fb1b0007c60).stop 2021-10-20T23:28:30.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 shutdown_connections 2021-10-20T23:28:30.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb1a00534f0 0x7fb1a00559b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1c00ad5c0 0x7fb1c00b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c0061700 0x7fb1c005cf70 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 --2- 172.21.15.12:0/3902009558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1c0061320 0x7fb1c00aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 >> 172.21.15.12:0/3902009558 conn(0x7fb1c0066de0 msgr2=0x7fb1c00b8600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:30.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 shutdown_connections 2021-10-20T23:28:30.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.549+0000 7fb1c7073700 1 -- 172.21.15.12:0/3902009558 wait complete. 2021-10-20T23:28:30.564 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 24 and data pool 22 2021-10-20T23:28:30.573 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:28:30.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:30.589 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:30.610 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:30.632 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:30.655 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:28:30.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:30.657 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:30.657 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:30.664 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:28:30.665 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:28:30.666 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:28:30.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:28:30.667 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:30.715 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:28:30.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:28:30.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:30.717 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:30.718 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:30.725 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:28:30.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:28:30.727 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:30.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:28:30.728 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:30.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:28:30.736 INFO:teuthology.orchestra.run.smithi136.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:28:30.737 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:28:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.837+0000 7fad8759e700 1 Processor -- start 2021-10-20T23:28:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.837+0000 7fad8759e700 1 -- start start 2021-10-20T23:28:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.837+0000 7fad8759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad880b0010 0x7fad880a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.837+0000 7fad8759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880afbd0 0x7fad880a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.837+0000 7fad8759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad880a70c0 con 0x7fad880b2580 2021-10-20T23:28:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.837+0000 7fad8759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad880a72f0 con 0x7fad880b0010 2021-10-20T23:28:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.837+0000 7fad8759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad880a7590 con 0x7fad880afbd0 2021-10-20T23:28:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.837+0000 7fad85d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad880b0010 0x7fad880a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.837+0000 7fad85d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad880b0010 0x7fad880a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44126/0 (socket says 172.21.15.12:44126) 2021-10-20T23:28:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad85d9b700 1 -- 172.21.15.12:0/330535241 learned_addr learned my addr 172.21.15.12:0/330535241 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad86d9d700 1 --2- 172.21.15.12:0/330535241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880afbd0 0x7fad880a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad85d9b700 1 -- 172.21.15.12:0/330535241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880afbd0 msgr2=0x7fad880a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad85d9b700 1 --2- 172.21.15.12:0/330535241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880afbd0 0x7fad880a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad85d9b700 1 -- 172.21.15.12:0/330535241 >> v1:172.21.15.31:6789/0 conn(0x7fad880b2580 legacy=0x7fad8814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad85d9b700 1 -- 172.21.15.12:0/330535241 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad880a7830 con 0x7fad880b0010 2021-10-20T23:28:30.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad86d9d700 1 --2- 172.21.15.12:0/330535241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880afbd0 0x7fad880a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:30.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad85d9b700 1 --2- 172.21.15.12:0/330535241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880b0010 0x7fad880a83b0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fad780032f0 tx=0x7fad78009290).ready entity=mon.0 client_cookie=63a1d95b1f0413bf server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:30.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8559a700 1 -- 172.21.15.12:0/330535241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7800b8a0 con 0x7fad880b0010 2021-10-20T23:28:30.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8559a700 1 -- 172.21.15.12:0/330535241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7800ba00 con 0x7fad880b0010 2021-10-20T23:28:30.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8559a700 1 -- 172.21.15.12:0/330535241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7800bb70 con 0x7fad880b0010 2021-10-20T23:28:30.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8759e700 1 -- 172.21.15.12:0/330535241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880b0010 msgr2=0x7fad880a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8759e700 1 --2- 172.21.15.12:0/330535241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880b0010 0x7fad880a83b0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fad780032f0 tx=0x7fad78009290).stop 2021-10-20T23:28:30.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8759e700 1 -- 172.21.15.12:0/330535241 shutdown_connections 2021-10-20T23:28:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8759e700 1 --2- 172.21.15.12:0/330535241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880afbd0 0x7fad880a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8759e700 1 --2- 172.21.15.12:0/330535241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880b0010 0x7fad880a83b0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8759e700 1 -- 172.21.15.12:0/330535241 >> 172.21.15.12:0/330535241 conn(0x7fad88060180 msgr2=0x7fad880b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8759e700 1 -- 172.21.15.12:0/330535241 shutdown_connections 2021-10-20T23:28:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.841+0000 7fad8759e700 1 -- 172.21.15.12:0/330535241 wait complete. 2021-10-20T23:28:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 Processor -- start 2021-10-20T23:28:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 -- start start 2021-10-20T23:28:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880afbd0 0x7fad88066830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880b0010 0x7fad880abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad880b2580 0x7fad88159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88064a00 con 0x7fad880afbd0 2021-10-20T23:28:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88065e50 con 0x7fad880b2580 2021-10-20T23:28:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad880660f0 con 0x7fad880b0010 2021-10-20T23:28:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880afbd0 0x7fad88066830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad85d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880b0010 0x7fad880abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad86d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad880b2580 0x7fad88159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad85d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880b0010 0x7fad880abb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:49888/0 (socket says 172.21.15.12:49888) 2021-10-20T23:28:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad85d9b700 1 -- 172.21.15.12:0/1623914790 learned_addr learned my addr 172.21.15.12:0/1623914790 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880afbd0 0x7fad88066830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44132/0 (socket says 172.21.15.12:44132) 2021-10-20T23:28:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8659c700 1 -- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880b0010 msgr2=0x7fad880abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8659c700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880b0010 0x7fad880abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8659c700 1 -- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad880b2580 msgr2=0x7fad88159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8659c700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad880b2580 0x7fad88159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8659c700 1 -- 172.21.15.12:0/1623914790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78009530 con 0x7fad880afbd0 2021-10-20T23:28:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8659c700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880afbd0 0x7fad88066830 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7fad8806b7c0 tx=0x7fad7c007b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad777fe700 1 -- 172.21.15.12:0/1623914790 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7c00cca0 con 0x7fad880afbd0 2021-10-20T23:28:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad777fe700 1 -- 172.21.15.12:0/1623914790 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c00ce00 con 0x7fad880afbd0 2021-10-20T23:28:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad88066390 con 0x7fad880afbd0 2021-10-20T23:28:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad777fe700 1 -- 172.21.15.12:0/1623914790 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7c007220 con 0x7fad880afbd0 2021-10-20T23:28:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.845+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad88157260 con 0x7fad880afbd0 2021-10-20T23:28:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.849+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad88066520 con 0x7fad880afbd0 2021-10-20T23:28:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.849+0000 7fad777fe700 1 -- 172.21.15.12:0/1623914790 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fad7c010030 con 0x7fad880afbd0 2021-10-20T23:28:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.849+0000 7fad777fe700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fad64053610 0x7fad64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:30.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.849+0000 7fad777fe700 1 -- 172.21.15.12:0/1623914790 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fad7c06b4f0 con 0x7fad880afbd0 2021-10-20T23:28:30.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.849+0000 7fad85d9b700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fad64053610 0x7fad64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:30.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.853+0000 7fad85d9b700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fad64053610 0x7fad64055ad0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fad7801a000 tx=0x7fad78016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:30.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.857+0000 7fad777fe700 1 -- 172.21.15.12:0/1623914790 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad7c0424a0 con 0x7fad880afbd0 2021-10-20T23:28:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.985+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fad88057350 con 0x7fad880afbd0 2021-10-20T23:28:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.985+0000 7fad777fe700 1 -- 172.21.15.12:0/1623914790 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v133) v1 ==== 81+0+34218 (secure 0 0 0) 0x7fad7c045ac0 con 0x7fad880afbd0 2021-10-20T23:28:30.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:30.998 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:28:30.998 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 133, 2021-10-20T23:28:30.998 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:28:30.999 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:28:30.999 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:28:30.541570+0000", 2021-10-20T23:28:30.999 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:28:30.999 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:28:31.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:28:31.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:28:31.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:28:31.000 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:28:31.001 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:28:31.001 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:28:31.001 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:28:31.001 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:31.002 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:28:31.002 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:28:31.002 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:28:31.002 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:28:31.003 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:28:31.003 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 24, 2021-10-20T23:28:31.003 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:28:31.003 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:28:31.003 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:28:31.004 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:28:31.004 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:28:31.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.004 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:28:31.005 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:28:31.005 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:28:31.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:28:31.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:28:31.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:31.006 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:31.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:31.007 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:31.007 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:31.008 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:31.008 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:28:31.008 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:28:31.009 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:28:31.009 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:28:31.009 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:28:31.009 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:31.010 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:31.010 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:31.010 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:31.011 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:31.011 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:31.011 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:31.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.011 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:28:31.012 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:31.012 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:31.012 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:31.012 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:31.014 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:31.014 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:31.014 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:31.015 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:31.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:31.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:31.016 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:31.016 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:31.016 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:31.018 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:31.018 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:31.019 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:31.019 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:31.019 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:31.019 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:31.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:31.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.020 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:31.020 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:31.021 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:31.021 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:31.021 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:31.022 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:31.022 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:31.022 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:31.023 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:31.023 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:31.023 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:31.023 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:28:31.024 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:28:31.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.024 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:31.025 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:28:31.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.026 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:28:31.026 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:28:31.026 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:28:31.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:28:31.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:28:31.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:31.027 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:31.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:31.027 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:31.028 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:31.028 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:31.028 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:28:31.029 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:28:31.029 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:28:31.029 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:28:31.029 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:28:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:31.031 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:31.031 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:31.032 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:31.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.033 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:28:31.033 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:31.033 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:31.033 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:31.034 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:31.034 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:31.034 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:31.034 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:31.035 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:31.035 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:31.035 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:31.035 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:31.036 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:31.036 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:31.036 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:31.036 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:31.037 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:31.037 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:31.037 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:31.037 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:31.037 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:31.038 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:31.038 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:31.038 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:31.038 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:31.039 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:31.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:31.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.039 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:31.040 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:31.040 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:31.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:31.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:31.041 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:31.041 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:31.041 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:31.041 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:31.042 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:31.042 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:31.042 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:28:31.042 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:31.043 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:28:31.043 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.044 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 22, 2021-10-20T23:28:31.044 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:28:31.044 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:27:57.402829+0000", 2021-10-20T23:28:31.044 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:28:31.045 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:28:31.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:31.045 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:31.045 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:31.046 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:31.046 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:31.046 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:31.046 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:28:31.047 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:28:31.047 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:28:31.047 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:28:31.047 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:28:31.047 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:31.048 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:31.048 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:31.048 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:31.048 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:31.049 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:31.049 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:31.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.049 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "133", 2021-10-20T23:28:31.050 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:31.050 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:31.050 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:31.050 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:31.051 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:31.051 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:31.051 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:31.051 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:31.052 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:31.052 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:31.052 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:31.052 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:31.053 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:31.053 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:31.053 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:31.053 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:31.054 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:31.054 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:31.054 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:31.054 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:31.055 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:31.055 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:31.055 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:31.055 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:31.056 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:31.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:31.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.056 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:31.057 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:31.057 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:31.057 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:31.057 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:31.058 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:31.058 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:31.058 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:31.058 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:31.059 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:31.059 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:31.059 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:28:31.059 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:31.060 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:28:31.060 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:28:31.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.061 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 24, 2021-10-20T23:28:31.061 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:28:31.062 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:28:29.542619+0000", 2021-10-20T23:28:31.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 32769, 2021-10-20T23:28:31.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,creating", 2021-10-20T23:28:31.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:31.063 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:31.063 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:31.063 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:31.063 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:31.064 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:31.064 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:28:31.064 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:28:31.064 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:28:31.065 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:28:31.065 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:28:31.065 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:31.065 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:31.066 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:31.066 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:31.066 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:31.066 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:31.067 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:31.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.067 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "133", 2021-10-20T23:28:31.067 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:31.068 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:31.068 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:31.068 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:31.068 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:31.069 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:31.069 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:31.069 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:31.069 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:31.070 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:31.070 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:31.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:31.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:31.071 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:31.071 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:31.071 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:31.071 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:31.072 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:31.072 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:31.072 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:31.072 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:31.073 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:31.073 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:31.073 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:31.073 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:31.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:31.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.074 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:31.074 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:31.075 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:31.075 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:31.075 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:31.075 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:31.076 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:31.076 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:31.076 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:31.076 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:31.077 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:31.077 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:28:31.077 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:28:31.077 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:28:31.078 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:28:31.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.078 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:31.078 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:28:31.079 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:28:31.079 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.079 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.079 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.079 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:31.080 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:28:31.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.080 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:28:31.080 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:28:31.081 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:31.081 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:31.081 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:31.081 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:31.082 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:31.082 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:31.082 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:31.082 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:31.083 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:31.083 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:31.083 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:31.083 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.084 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:28:31.084 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:31.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.085 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:28:31.086 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:31.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.086 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.087 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:31.087 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.087 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:28:31.088 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:31.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.089 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:28:31.089 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:31.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.089 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.090 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:31.090 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.091 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:28:31.091 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:31.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.092 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:28:31.092 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:31.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.093 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.093 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:31.094 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.094 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:28:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:28:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:28:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:28:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:28:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:28:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:28:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:28:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:28:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:28:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:28:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:28:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:28:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:28:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:28:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:28:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:28:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:28:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:28:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:28:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:28:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:28:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 127, 2021-10-20T23:28:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:28:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:28:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:28:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:28:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:28:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:28:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:28:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:28:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:28:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:28:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:28:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:28:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:28:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:28:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:28:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:28:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:28:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:28:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:28:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:28:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:28:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:28:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:28:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:28:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:28:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:28:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:28:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:28:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 127, 2021-10-20T23:28:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:28:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:28:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:28:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:28:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:28:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:28:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:28:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:28:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:28:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:28:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:28:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:28:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:28:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:28:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:28:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:28:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:28:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:28:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:28:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:28:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:28:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:28:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:28:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:28:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:28:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:28:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:28:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:28:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:28:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:28:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.203 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:28:31.203 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:28:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:28:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:28:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:28:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:31.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.211 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:28:31.212 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:31.212 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.212 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.213 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:28:31.213 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:28:31.213 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:28:31.213 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:28:31.214 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:31.214 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:31.214 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:31.215 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.215 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:28:31.216 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:28:31.216 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:31.216 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:31.216 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:31.217 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:31.217 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:31.217 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:31.217 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:31.218 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 118, 2021-10-20T23:28:31.218 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:31.218 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:31.218 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:31.219 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.219 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:28:31.220 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:31.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.221 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:28:31.221 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:31.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.221 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.222 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:31.222 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.223 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:28:31.223 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:31.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.224 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:28:31.224 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:31.225 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.225 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.225 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:31.226 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.226 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:28:31.226 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:31.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.227 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:28:31.228 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:31.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.228 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.229 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:31.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:31.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:31.230 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:28:31.230 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:31.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:31.231 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:28:31.231 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:31.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.232 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.232 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:28:31.232 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:28:31.233 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:28:31.233 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:28:31.233 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:31.233 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:31.234 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:31.234 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:31.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.234 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:31.234 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:28:31.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.235 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:28:31.235 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:31.235 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:31.236 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:31.236 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:31.236 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:31.237 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:28:31.237 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:31.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.238 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:28:31.238 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:31.238 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:31.238 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:31.238 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:31.239 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:31.239 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:28:31.239 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:31.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.240 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:28:31.240 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:31.240 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:31.241 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:31.241 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:31.241 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:31.241 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:28:31.242 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:31.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.242 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:28:31.243 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:31.243 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:31.243 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:31.243 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:31.244 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:31.244 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:28:31.244 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:31.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.245 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:28:31.245 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:31.245 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:31.246 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:31.246 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:31.246 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:31.246 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:28:31.246 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:31.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.247 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:28:31.247 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:31.248 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:31.248 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:31.248 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:31.248 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:31.249 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:28:31.249 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:31.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.250 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:28:31.250 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:31.250 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:31.250 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:31.251 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:31.251 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:31.251 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:28:31.251 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:31.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:31.252 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:28:31.252 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:31.253 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:31.253 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:31.253 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:31.253 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:31.254 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:28:31.254 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:31.254 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.254 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:31.255 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:28:31.255 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:28:31.255 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:28:31.255 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:28:31.255 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:28:31.256 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6835/1094154714": "2021-10-21T23:28:15.336080+0000", 2021-10-20T23:28:31.256 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6834/1094154714": "2021-10-21T23:28:15.336080+0000" 2021-10-20T23:28:31.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.256 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:28:31.257 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:28:31.257 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:28:31.257 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:28:31.257 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:28:31.258 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:28:31.258 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:28:31.258 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:28:31.258 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:28:31.259 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:28:31.259 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:28:31.259 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:28:31.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.260 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:28:31.260 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:28:31.260 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:28:31.260 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:28:31.261 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:28:31.261 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:28:31.261 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:28:31.261 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:28:31.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fad64053610 msgr2=0x7fad64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fad64053610 0x7fad64055ad0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fad7801a000 tx=0x7fad78016000).stop 2021-10-20T23:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880afbd0 msgr2=0x7fad88066830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880afbd0 0x7fad88066830 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7fad8806b7c0 tx=0x7fad7c007b70).stop 2021-10-20T23:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 shutdown_connections 2021-10-20T23:28:31.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fad64053610 0x7fad64055ad0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad880b2580 0x7fad88159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad880b0010 0x7fad880abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 --2- 172.21.15.12:0/1623914790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880afbd0 0x7fad88066830 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 >> 172.21.15.12:0/1623914790 conn(0x7fad88060180 msgr2=0x7fad88067550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:31.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 shutdown_connections 2021-10-20T23:28:31.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:30.989+0000 7fad8759e700 1 -- 172.21.15.12:0/1623914790 wait complete. 2021-10-20T23:28:31.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:31.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.369+0000 7f0569e3a700 1 Processor -- start 2021-10-20T23:28:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.369+0000 7f0569e3a700 1 -- start start 2021-10-20T23:28:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640b1db0 0x7f05640b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05641483a0 0x7f05640b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05640b0350 con 0x7f05640a70c0 2021-10-20T23:28:31.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05640a90c0 con 0x7f05641483a0 2021-10-20T23:28:31.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b05f0 con 0x7f05640b1db0 2021-10-20T23:28:31.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0563fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f05640a70c0 0x7f0564144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42736/0 (socket says 172.21.15.12:42736) 2021-10-20T23:28:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0563fff700 1 -- 172.21.15.12:0/350676012 learned_addr learned my addr 172.21.15.12:0/350676012 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05637fe700 1 --2- 172.21.15.12:0/350676012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640b1db0 0x7f05640b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0562ffd700 1 --2- 172.21.15.12:0/350676012 >> v2:172.21.15.31:3300/0 conn(0x7f05641483a0 0x7f05640b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05627fc700 1 -- 172.21.15.12:0/350676012 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593380709 0 0) 0x7f05640b0350 con 0x7f05640a70c0 2021-10-20T23:28:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05627fc700 1 -- 172.21.15.12:0/350676012 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0550003260 con 0x7f05640a70c0 2021-10-20T23:28:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05627fc700 1 -- 172.21.15.12:0/350676012 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2499808821 0 0) 0x7f0550003260 con 0x7f05640a70c0 2021-10-20T23:28:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05637fe700 1 -- 172.21.15.12:0/350676012 >> v2:172.21.15.31:3300/0 conn(0x7f05641483a0 msgr2=0x7f05640b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05637fe700 1 --2- 172.21.15.12:0/350676012 >> v2:172.21.15.31:3300/0 conn(0x7f05641483a0 0x7f05640b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05637fe700 1 -- 172.21.15.12:0/350676012 >> v1:172.21.15.12:6789/0 conn(0x7f05640a70c0 legacy=0x7f0564144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05637fe700 1 -- 172.21.15.12:0/350676012 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640b0890 con 0x7f05640b1db0 2021-10-20T23:28:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0562ffd700 1 --2- 172.21.15.12:0/350676012 >> v2:172.21.15.31:3300/0 conn(0x7f05641483a0 0x7f05640b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05637fe700 1 --2- 172.21.15.12:0/350676012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640b1db0 0x7f05640b0fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f055c001b80 tx=0x7f0558006df0).ready entity=mon.2 client_cookie=1460ad775cb6a199 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05627fc700 1 -- 172.21.15.12:0/350676012 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055c0019e0 con 0x7f05640b1db0 2021-10-20T23:28:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05627fc700 1 -- 172.21.15.12:0/350676012 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0558000e90 con 0x7f05640b1db0 2021-10-20T23:28:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f05627fc700 1 -- 172.21.15.12:0/350676012 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0558012460 con 0x7f05640b1db0 2021-10-20T23:28:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 -- 172.21.15.12:0/350676012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640b1db0 msgr2=0x7f05640b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 --2- 172.21.15.12:0/350676012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640b1db0 0x7f05640b0fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f055c001b80 tx=0x7f0558006df0).stop 2021-10-20T23:28:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 -- 172.21.15.12:0/350676012 shutdown_connections 2021-10-20T23:28:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 --2- 172.21.15.12:0/350676012 >> v2:172.21.15.31:3300/0 conn(0x7f05641483a0 0x7f05640b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 --2- 172.21.15.12:0/350676012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640b1db0 0x7f05640b0fd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 -- 172.21.15.12:0/350676012 >> 172.21.15.12:0/350676012 conn(0x7f056405f6b0 msgr2=0x7f056405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 -- 172.21.15.12:0/350676012 shutdown_connections 2021-10-20T23:28:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.373+0000 7f0569e3a700 1 -- 172.21.15.12:0/350676012 wait complete. 2021-10-20T23:28:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0569e3a700 1 Processor -- start 2021-10-20T23:28:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0569e3a700 1 -- start start 2021-10-20T23:28:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0569e3a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640a70c0 0x7f0564140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0569e3a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05640b1db0 0x7f05641424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0569e3a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05641483a0 0x7f0564156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0569e3a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0564159ce0 con 0x7f05640b1db0 2021-10-20T23:28:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0569e3a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0564159f80 con 0x7f05641483a0 2021-10-20T23:28:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0569e3a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056415a220 con 0x7f05640a70c0 2021-10-20T23:28:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0562ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05640b1db0 0x7f05641424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0562ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05640b1db0 0x7f05641424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44146/0 (socket says 172.21.15.12:44146) 2021-10-20T23:28:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0562ffd700 1 -- 172.21.15.12:0/2743891442 learned_addr learned my addr 172.21.15.12:0/2743891442 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f05637fe700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640a70c0 0x7f0564140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0563fff700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05641483a0 0x7f0564156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0562ffd700 1 -- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640a70c0 msgr2=0x7f0564140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0562ffd700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640a70c0 0x7f0564140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0562ffd700 1 -- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05641483a0 msgr2=0x7f0564156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0562ffd700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05641483a0 0x7f0564156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0562ffd700 1 -- 172.21.15.12:0/2743891442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055400b180 con 0x7f05640b1db0 2021-10-20T23:28:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0562ffd700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05640b1db0 0x7f05641424f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f055400c000 tx=0x7f0554006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:31.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0560ff9700 1 -- 172.21.15.12:0/2743891442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0554010780 con 0x7f05640b1db0 2021-10-20T23:28:31.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.377+0000 7f0560ff9700 1 -- 172.21.15.12:0/2743891442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05540108e0 con 0x7f05640b1db0 2021-10-20T23:28:31.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.381+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055800b180 con 0x7f05640b1db0 2021-10-20T23:28:31.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.381+0000 7f0560ff9700 1 -- 172.21.15.12:0/2743891442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0554010c40 con 0x7f05640b1db0 2021-10-20T23:28:31.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.381+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0564142a60 con 0x7f05640b1db0 2021-10-20T23:28:31.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.381+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056415a660 con 0x7f05640b1db0 2021-10-20T23:28:31.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.381+0000 7f0560ff9700 1 -- 172.21.15.12:0/2743891442 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f055401c460 con 0x7f05640b1db0 2021-10-20T23:28:31.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.381+0000 7f0560ff9700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05440534f0 0x7f05440559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.381+0000 7f0560ff9700 1 -- 172.21.15.12:0/2743891442 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f055406bf60 con 0x7f05640b1db0 2021-10-20T23:28:31.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.381+0000 7f05637fe700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05440534f0 0x7f05440559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.385+0000 7f05637fe700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05440534f0 0x7f05440559b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f055801a000 tx=0x7f0558014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:31.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.389+0000 7f0560ff9700 1 -- 172.21.15.12:0/2743891442 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0554042e10 con 0x7f05640b1db0 2021-10-20T23:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.549+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05640b0b30 con 0x7f05640b1db0 2021-10-20T23:28:31.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0560ff9700 1 -- 172.21.15.12:0/2743891442 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f0554046430 con 0x7f05640b1db0 2021-10-20T23:28:31.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:31.563 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":66,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:28:30.541999+0000","modified":"2021-10-20T23:28:30.542146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-10-20T23:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05440534f0 msgr2=0x7f05440559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05440534f0 0x7f05440559b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f055801a000 tx=0x7f0558014000).stop 2021-10-20T23:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05640b1db0 msgr2=0x7f05641424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05640b1db0 0x7f05641424f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f055400c000 tx=0x7f0554006df0).stop 2021-10-20T23:28:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 shutdown_connections 2021-10-20T23:28:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f05440534f0 0x7f05440559b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05641483a0 0x7f0564156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05640b1db0 0x7f05641424f0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 --2- 172.21.15.12:0/2743891442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640a70c0 0x7f0564140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 >> 172.21.15.12:0/2743891442 conn(0x7f056405f6b0 msgr2=0x7f0564142de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 shutdown_connections 2021-10-20T23:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.553+0000 7f0569e3a700 1 -- 172.21.15.12:0/2743891442 wait complete. 2021-10-20T23:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 66 2021-10-20T23:28:31.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:28:31.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.665+0000 7f8093c29700 1 Processor -- start 2021-10-20T23:28:31.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.665+0000 7f8093c29700 1 -- start start 2021-10-20T23:28:31.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c066ff0 0x7f808c1438d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808c0673d0 con 0x7f808c0b06e0 2021-10-20T23:28:31.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808c0affd0 con 0x7f808c0ad030 2021-10-20T23:28:31.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0b0270 con 0x7f808c066ff0 2021-10-20T23:28:31.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80921c6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f808c0b06e0 0x7f808c0b0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42748/0 (socket says 172.21.15.12:42748) 2021-10-20T23:28:31.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80921c6700 1 -- 172.21.15.12:0/4117212937 learned_addr learned my addr 172.21.15.12:0/4117212937 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:31.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80919c5700 1 --2- 172.21.15.12:0/4117212937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c066ff0 0x7f808c1438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80909c3700 1 -- 172.21.15.12:0/4117212937 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310267773 0 0) 0x7f808c0673d0 con 0x7f808c0b06e0 2021-10-20T23:28:31.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80909c3700 1 -- 172.21.15.12:0/4117212937 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8078003260 con 0x7f808c0b06e0 2021-10-20T23:28:31.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80909c3700 1 -- 172.21.15.12:0/4117212937 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607070335 0 0) 0x7f808c0affd0 con 0x7f808c0ad030 2021-10-20T23:28:31.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80919c5700 1 -- 172.21.15.12:0/4117212937 >> v1:172.21.15.31:6789/0 conn(0x7f808c0ad030 legacy=0x7f808c143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80919c5700 1 -- 172.21.15.12:0/4117212937 >> v1:172.21.15.12:6789/0 conn(0x7f808c0b06e0 legacy=0x7f808c0b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80919c5700 1 -- 172.21.15.12:0/4117212937 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0af3a0 con 0x7f808c066ff0 2021-10-20T23:28:31.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80919c5700 1 --2- 172.21.15.12:0/4117212937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c066ff0 0x7f808c1438d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8084002f70 tx=0x7f8084006df0).ready entity=mon.2 client_cookie=2350a6017a436875 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:31.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80909c3700 1 -- 172.21.15.12:0/4117212937 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808400d570 con 0x7f808c066ff0 2021-10-20T23:28:31.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80909c3700 1 -- 172.21.15.12:0/4117212937 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8084000e90 con 0x7f808c066ff0 2021-10-20T23:28:31.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f80909c3700 1 -- 172.21.15.12:0/4117212937 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808400d8c0 con 0x7f808c066ff0 2021-10-20T23:28:31.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 -- 172.21.15.12:0/4117212937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c066ff0 msgr2=0x7f808c1438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 --2- 172.21.15.12:0/4117212937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c066ff0 0x7f808c1438d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8084002f70 tx=0x7f8084006df0).stop 2021-10-20T23:28:31.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 -- 172.21.15.12:0/4117212937 shutdown_connections 2021-10-20T23:28:31.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 --2- 172.21.15.12:0/4117212937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c066ff0 0x7f808c1438d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 -- 172.21.15.12:0/4117212937 >> 172.21.15.12:0/4117212937 conn(0x7f808c05f6b0 msgr2=0x7f808c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:31.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 -- 172.21.15.12:0/4117212937 shutdown_connections 2021-10-20T23:28:31.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.669+0000 7f8093c29700 1 -- 172.21.15.12:0/4117212937 wait complete. 2021-10-20T23:28:31.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 Processor -- start 2021-10-20T23:28:31.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 -- start start 2021-10-20T23:28:31.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c066ff0 0x7f808c149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f808c0b06e0 0x7f808c152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c153230 0x7f808c155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0abf00 con 0x7f808c066ff0 2021-10-20T23:28:31.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0a3390 con 0x7f808c0b06e0 2021-10-20T23:28:31.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1536c0 con 0x7f808c153230 2021-10-20T23:28:31.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80919c5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c066ff0 0x7f808c149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80919c5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c066ff0 0x7f808c149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44160/0 (socket says 172.21.15.12:44160) 2021-10-20T23:28:31.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80919c5700 1 -- 172.21.15.12:0/1685823524 learned_addr learned my addr 172.21.15.12:0/1685823524 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:31.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80911c4700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f808c0b06e0 0x7f808c152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80921c6700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c153230 0x7f808c155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80919c5700 1 -- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c153230 msgr2=0x7f808c155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80919c5700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c153230 0x7f808c155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80919c5700 1 -- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f808c0b06e0 msgr2=0x7f808c152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:31.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80919c5700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f808c0b06e0 0x7f808c152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:31.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80919c5700 1 -- 172.21.15.12:0/1685823524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808400b180 con 0x7f808c066ff0 2021-10-20T23:28:31.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f80919c5700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c066ff0 0x7f808c149530 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f8084002f70 tx=0x7f8084014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:31.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f808affd700 1 -- 172.21.15.12:0/1685823524 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8084016070 con 0x7f808c066ff0 2021-10-20T23:28:31.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f808affd700 1 -- 172.21.15.12:0/1685823524 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8084013970 con 0x7f808c066ff0 2021-10-20T23:28:31.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c0a1110 con 0x7f808c066ff0 2021-10-20T23:28:31.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f808affd700 1 -- 172.21.15.12:0/1685823524 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8084013cd0 con 0x7f808c066ff0 2021-10-20T23:28:31.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.673+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c0a13b0 con 0x7f808c066ff0 2021-10-20T23:28:31.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.677+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c057350 con 0x7f808c066ff0 2021-10-20T23:28:31.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.677+0000 7f808affd700 1 -- 172.21.15.12:0/1685823524 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8084025030 con 0x7f808c066ff0 2021-10-20T23:28:31.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.677+0000 7f808affd700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f806c053610 0x7f806c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:31.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.677+0000 7f808affd700 1 -- 172.21.15.12:0/1685823524 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f808406ca30 con 0x7f808c066ff0 2021-10-20T23:28:31.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.677+0000 7f80911c4700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f806c053610 0x7f806c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:31.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.677+0000 7f80911c4700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f806c053610 0x7f806c055ad0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f808000b000 tx=0x7f8080009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:31.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.681+0000 7f808affd700 1 -- 172.21.15.12:0/1685823524 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f80840439e0 con 0x7f808c066ff0 2021-10-20T23:28:31.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:31.849+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f808c067810 con 0x7f808c066ff0 2021-10-20T23:28:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.548+0000 7f808affd700 1 -- 172.21.15.12:0/1685823524 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8084023020 con 0x7f808c066ff0 2021-10-20T23:28:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f806c053610 msgr2=0x7f806c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f806c053610 0x7f806c055ad0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f808000b000 tx=0x7f8080009040).stop 2021-10-20T23:28:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c066ff0 msgr2=0x7f808c149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c066ff0 0x7f808c149530 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f8084002f70 tx=0x7f8084014000).stop 2021-10-20T23:28:32.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 shutdown_connections 2021-10-20T23:28:32.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f806c053610 0x7f806c055ad0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f808c153230 0x7f808c155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f808c0b06e0 0x7f808c152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 --2- 172.21.15.12:0/1685823524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c066ff0 0x7f808c149530 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 >> 172.21.15.12:0/1685823524 conn(0x7f808c05f6b0 msgr2=0x7f808c0b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:32.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 shutdown_connections 2021-10-20T23:28:32.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.552+0000 7f8093c29700 1 -- 172.21.15.12:0/1685823524 wait complete. 2021-10-20T23:28:32.568 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:28:32.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:32.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.676+0000 7fc3cd622700 1 Processor -- start 2021-10-20T23:28:32.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 -- start start 2021-10-20T23:28:32.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3c8139ae0 0x7fc3c8142db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:32.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3c80b1c50 0x7fc3c80a8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:32.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c80ac470 con 0x7fc3c81432a0 2021-10-20T23:28:32.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c80b3010 con 0x7fc3c8139ae0 2021-10-20T23:28:32.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c80af320 con 0x7fc3c80b1c50 2021-10-20T23:28:32.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3c8139ae0 0x7fc3c8142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:32.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c67fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc3c81432a0 0x7fc3c80ab530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42762/0 (socket says 172.21.15.12:42762) 2021-10-20T23:28:32.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c67fc700 1 -- 172.21.15.12:0/3652631658 learned_addr learned my addr 172.21.15.12:0/3652631658 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:32.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3c8139ae0 0x7fc3c8142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44166/0 (socket says 172.21.15.12:44166) 2021-10-20T23:28:32.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c77fe700 1 --2- 172.21.15.12:0/3652631658 >> v2:172.21.15.31:3300/0 conn(0x7fc3c80b1c50 0x7fc3c80a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:32.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c6ffd700 1 -- 172.21.15.12:0/3652631658 >> v2:172.21.15.31:3300/0 conn(0x7fc3c80b1c50 msgr2=0x7fc3c80a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:32.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c6ffd700 1 --2- 172.21.15.12:0/3652631658 >> v2:172.21.15.31:3300/0 conn(0x7fc3c80b1c50 0x7fc3c80a8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c6ffd700 1 -- 172.21.15.12:0/3652631658 >> v1:172.21.15.12:6789/0 conn(0x7fc3c81432a0 legacy=0x7fc3c80ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:32.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c5ffb700 1 -- 172.21.15.12:0/3652631658 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459774423 0 0) 0x7fc3c80ac470 con 0x7fc3c81432a0 2021-10-20T23:28:32.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c6ffd700 1 -- 172.21.15.12:0/3652631658 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8143730 con 0x7fc3c8139ae0 2021-10-20T23:28:32.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c6ffd700 1 --2- 172.21.15.12:0/3652631658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c8139ae0 0x7fc3c8142db0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fc3b80032f0 tx=0x7fc3b80091d0).ready entity=mon.0 client_cookie=e10b9001f80ca14 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:32.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c5ffb700 1 -- 172.21.15.12:0/3652631658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3b800b680 con 0x7fc3c8139ae0 2021-10-20T23:28:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c5ffb700 1 -- 172.21.15.12:0/3652631658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b800b7e0 con 0x7fc3c8139ae0 2021-10-20T23:28:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3c5ffb700 1 -- 172.21.15.12:0/3652631658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3b800b950 con 0x7fc3c8139ae0 2021-10-20T23:28:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 -- 172.21.15.12:0/3652631658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c8139ae0 msgr2=0x7fc3c8142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 --2- 172.21.15.12:0/3652631658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c8139ae0 0x7fc3c8142db0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fc3b80032f0 tx=0x7fc3b80091d0).stop 2021-10-20T23:28:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 -- 172.21.15.12:0/3652631658 shutdown_connections 2021-10-20T23:28:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 --2- 172.21.15.12:0/3652631658 >> v2:172.21.15.31:3300/0 conn(0x7fc3c80b1c50 0x7fc3c80a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 --2- 172.21.15.12:0/3652631658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c8139ae0 0x7fc3c8142db0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 -- 172.21.15.12:0/3652631658 >> 172.21.15.12:0/3652631658 conn(0x7fc3c805f6b0 msgr2=0x7fc3c805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:32.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 -- 172.21.15.12:0/3652631658 shutdown_connections 2021-10-20T23:28:32.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.680+0000 7fc3cd622700 1 -- 172.21.15.12:0/3652631658 wait complete. 2021-10-20T23:28:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3cd622700 1 Processor -- start 2021-10-20T23:28:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3cd622700 1 -- start start 2021-10-20T23:28:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3cd622700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c80b1c50 0x7fc3c813b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3cd622700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c813c700 0x7fc3c813b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3cd622700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c8063240 0x7fc3c80636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3cd622700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c814f0e0 con 0x7fc3c813c700 2021-10-20T23:28:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3cd622700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c813be80 con 0x7fc3c8063240 2021-10-20T23:28:32.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3cd622700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c814eba0 con 0x7fc3c80b1c50 2021-10-20T23:28:32.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c813c700 0x7fc3c813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:32.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c813c700 0x7fc3c813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44172/0 (socket says 172.21.15.12:44172) 2021-10-20T23:28:32.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c67fc700 1 -- 172.21.15.12:0/1675997454 learned_addr learned my addr 172.21.15.12:0/1675997454 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c6ffd700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c80b1c50 0x7fc3c813b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c77fe700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c8063240 0x7fc3c80636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c67fc700 1 -- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c80b1c50 msgr2=0x7fc3c813b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:32.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c67fc700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c80b1c50 0x7fc3c813b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c67fc700 1 -- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c8063240 msgr2=0x7fc3c80636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:32.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c67fc700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c8063240 0x7fc3c80636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c67fc700 1 -- 172.21.15.12:0/1675997454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8009470 con 0x7fc3c813c700 2021-10-20T23:28:32.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.684+0000 7fc3c67fc700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c813c700 0x7fc3c813b990 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fc3b0000bc0 tx=0x7fc3b0007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:32.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3bffff700 1 -- 172.21.15.12:0/1675997454 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3b00070d0 con 0x7fc3c813c700 2021-10-20T23:28:32.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3bffff700 1 -- 172.21.15.12:0/1675997454 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b0007230 con 0x7fc3c813c700 2021-10-20T23:28:32.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c814eea0 con 0x7fc3c813c700 2021-10-20T23:28:32.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3bffff700 1 -- 172.21.15.12:0/1675997454 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3b0005610 con 0x7fc3c813c700 2021-10-20T23:28:32.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c813ae50 con 0x7fc3c813c700 2021-10-20T23:28:32.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c813a480 con 0x7fc3c813c700 2021-10-20T23:28:32.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3bffff700 1 -- 172.21.15.12:0/1675997454 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc3b001a060 con 0x7fc3c813c700 2021-10-20T23:28:32.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3bffff700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3ac053640 0x7fc3ac055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:32.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3bffff700 1 -- 172.21.15.12:0/1675997454 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fc3b006b110 con 0x7fc3c813c700 2021-10-20T23:28:32.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.688+0000 7fc3c6ffd700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3ac053640 0x7fc3ac055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.692+0000 7fc3c6ffd700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3ac053640 0x7fc3ac055b00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fc3b801b000 tx=0x7fc3b8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.696+0000 7fc3bffff700 1 -- 172.21.15.12:0/1675997454 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3b0041fb0 con 0x7fc3c813c700 2021-10-20T23:28:32.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3c8143c70 con 0x7fc3c813c700 2021-10-20T23:28:32.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3bffff700 1 -- 172.21.15.12:0/1675997454 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+1426 (secure 0 0 0) 0x7fc3b0018070 con 0x7fc3c813c700 2021-10-20T23:28:32.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:32.872 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":67,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:28:30.541999+0000","modified":"2021-10-20T23:28:32.547713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-10-20T23:28:32.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3ac053640 msgr2=0x7fc3ac055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:32.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3ac053640 0x7fc3ac055b00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fc3b801b000 tx=0x7fc3b8016000).stop 2021-10-20T23:28:32.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c813c700 msgr2=0x7fc3c813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:32.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c813c700 0x7fc3c813b990 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fc3b0000bc0 tx=0x7fc3b0007c60).stop 2021-10-20T23:28:32.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 shutdown_connections 2021-10-20T23:28:32.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc3ac053640 0x7fc3ac055b00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c8063240 0x7fc3c80636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3c813c700 0x7fc3c813b990 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 --2- 172.21.15.12:0/1675997454 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c80b1c50 0x7fc3c813b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:32.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 >> 172.21.15.12:0/1675997454 conn(0x7fc3c805f6b0 msgr2=0x7fc3c80b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:32.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 shutdown_connections 2021-10-20T23:28:32.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.860+0000 7fc3cd622700 1 -- 172.21.15.12:0/1675997454 wait complete. 2021-10-20T23:28:32.879 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 67 2021-10-20T23:28:32.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:28:32.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.984+0000 7f338625a700 1 Processor -- start 2021-10-20T23:28:32.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.984+0000 7f338625a700 1 -- start start 2021-10-20T23:28:32.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.984+0000 7f338625a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33800b4690 0x7f3380140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:32.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.984+0000 7f338625a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3380143b60 con 0x7f3380146950 2021-10-20T23:28:33.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.984+0000 7f338625a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3380143e00 con 0x7f33800b4180 2021-10-20T23:28:33.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.984+0000 7f338625a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3380147510 con 0x7f33800b4690 2021-10-20T23:28:33.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.984+0000 7f337f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3380146950 0x7f3380140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42774/0 (socket says 172.21.15.12:42774) 2021-10-20T23:28:33.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.984+0000 7f337f7fe700 1 -- 172.21.15.12:0/2580310395 learned_addr learned my addr 172.21.15.12:0/2580310395 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:33.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337ffff700 1 --2- 172.21.15.12:0/2580310395 >> v2:172.21.15.31:3300/0 conn(0x7f33800b4690 0x7f3380140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:33.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337e7fc700 1 -- 172.21.15.12:0/2580310395 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271420688 0 0) 0x7f3380143b60 con 0x7f3380146950 2021-10-20T23:28:33.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337e7fc700 1 -- 172.21.15.12:0/2580310395 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3360003260 con 0x7f3380146950 2021-10-20T23:28:33.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337e7fc700 1 -- 172.21.15.12:0/2580310395 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091162511 0 0) 0x7f3380143e00 con 0x7f33800b4180 2021-10-20T23:28:33.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337e7fc700 1 -- 172.21.15.12:0/2580310395 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3380143b60 con 0x7f33800b4180 2021-10-20T23:28:33.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337ffff700 1 -- 172.21.15.12:0/2580310395 >> v1:172.21.15.31:6789/0 conn(0x7f33800b4180 legacy=0x7f33800b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:33.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337ffff700 1 -- 172.21.15.12:0/2580310395 >> v1:172.21.15.12:6789/0 conn(0x7f3380146950 legacy=0x7f3380140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:33.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337ffff700 1 -- 172.21.15.12:0/2580310395 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33800b0c90 con 0x7f33800b4690 2021-10-20T23:28:33.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337ffff700 1 --2- 172.21.15.12:0/2580310395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33800b4690 0x7f3380140940 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f33780032f0 tx=0x7f33780091d0).ready entity=mon.1 client_cookie=10668d15b7d71b30 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:33.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337e7fc700 1 -- 172.21.15.12:0/2580310395 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f337800b600 con 0x7f33800b4690 2021-10-20T23:28:33.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337e7fc700 1 -- 172.21.15.12:0/2580310395 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337800b760 con 0x7f33800b4690 2021-10-20T23:28:33.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f337e7fc700 1 -- 172.21.15.12:0/2580310395 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f337800b8d0 con 0x7f33800b4690 2021-10-20T23:28:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f338625a700 1 -- 172.21.15.12:0/2580310395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33800b4690 msgr2=0x7f3380140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f338625a700 1 --2- 172.21.15.12:0/2580310395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33800b4690 0x7f3380140940 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f33780032f0 tx=0x7f33780091d0).stop 2021-10-20T23:28:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f338625a700 1 -- 172.21.15.12:0/2580310395 shutdown_connections 2021-10-20T23:28:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f338625a700 1 --2- 172.21.15.12:0/2580310395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33800b4690 0x7f3380140940 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f338625a700 1 -- 172.21.15.12:0/2580310395 >> 172.21.15.12:0/2580310395 conn(0x7f338005c490 msgr2=0x7f338005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f338625a700 1 -- 172.21.15.12:0/2580310395 shutdown_connections 2021-10-20T23:28:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.988+0000 7f338625a700 1 -- 172.21.15.12:0/2580310395 wait complete. 2021-10-20T23:28:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 Processor -- start 2021-10-20T23:28:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 -- start start 2021-10-20T23:28:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33800b4180 0x7f33800b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33800b4690 0x7f338013a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:33.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3380146950 0x7f338013a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3380146da0 con 0x7f3380146950 2021-10-20T23:28:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338013aac0 con 0x7f33800b4180 2021-10-20T23:28:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3380144560 con 0x7f33800b4690 2021-10-20T23:28:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3380146950 0x7f338013a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3380146950 0x7f338013a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44188/0 (socket says 172.21.15.12:44188) 2021-10-20T23:28:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337ffff700 1 -- 172.21.15.12:0/1859630248 learned_addr learned my addr 172.21.15.12:0/1859630248 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337f7fe700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33800b4180 0x7f33800b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337effd700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33800b4690 0x7f338013a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337ffff700 1 -- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33800b4690 msgr2=0x7f338013a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337ffff700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33800b4690 0x7f338013a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337ffff700 1 -- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33800b4180 msgr2=0x7f33800b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337ffff700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33800b4180 0x7f33800b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337ffff700 1 -- 172.21.15.12:0/1859630248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3378009470 con 0x7f3380146950 2021-10-20T23:28:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337ffff700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3380146950 0x7f338013a5d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f33780032f0 tx=0x7f3378016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337cff9700 1 -- 172.21.15.12:0/1859630248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3378011b60 con 0x7f3380146950 2021-10-20T23:28:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337cff9700 1 -- 172.21.15.12:0/1859630248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378011cc0 con 0x7f3380146950 2021-10-20T23:28:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33800af480 con 0x7f3380146950 2021-10-20T23:28:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f337cff9700 1 -- 172.21.15.12:0/1859630248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f337801f5e0 con 0x7f3380146950 2021-10-20T23:28:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.992+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33800af9c0 con 0x7f3380146950 2021-10-20T23:28:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.996+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33800afe00 con 0x7f3380146950 2021-10-20T23:28:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.996+0000 7f337cff9700 1 -- 172.21.15.12:0/1859630248 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3378026030 con 0x7f3380146950 2021-10-20T23:28:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.996+0000 7f337cff9700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3364053610 0x7f3364055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:32.996+0000 7f337cff9700 1 -- 172.21.15.12:0/1859630248 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f337806c910 con 0x7f3380146950 2021-10-20T23:28:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.000+0000 7f337f7fe700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3364053610 0x7f3364055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.000+0000 7f337f7fe700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3364053610 0x7f3364055ad0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f337000d000 tx=0x7f3370009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:33.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.004+0000 7f337cff9700 1 -- 172.21.15.12:0/1859630248 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3378043860 con 0x7f3380146950 2021-10-20T23:28:33.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.168+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3380057350 con 0x7f3380146950 2021-10-20T23:28:33.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.968+0000 7f337cff9700 1 -- 172.21.15.12:0/1859630248 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33780150a0 con 0x7f3380146950 2021-10-20T23:28:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3364053610 msgr2=0x7f3364055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:33.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3364053610 0x7f3364055ad0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f337000d000 tx=0x7f3370009040).stop 2021-10-20T23:28:33.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3380146950 msgr2=0x7f338013a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:33.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3380146950 0x7f338013a5d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f33780032f0 tx=0x7f3378016000).stop 2021-10-20T23:28:33.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 shutdown_connections 2021-10-20T23:28:33.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3364053610 0x7f3364055ad0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:33.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3380146950 0x7f338013a5d0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:33.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33800b4690 0x7f338013a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:33.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 --2- 172.21.15.12:0/1859630248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33800b4180 0x7f33800b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:33.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 >> 172.21.15.12:0/1859630248 conn(0x7f338005c490 msgr2=0x7f33801487d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:33.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 shutdown_connections 2021-10-20T23:28:33.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:33.972+0000 7f338625a700 1 -- 172.21.15.12:0/1859630248 wait complete. 2021-10-20T23:28:33.999 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:28:34.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.104+0000 7f0024039700 1 Processor -- start 2021-10-20T23:28:34.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.104+0000 7f0024039700 1 -- start start 2021-10-20T23:28:34.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0024039700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c0b43c0 0x7f001c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:34.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0024039700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c1440b0 con 0x7f001c0b6960 2021-10-20T23:28:34.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0024039700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c143b70 con 0x7f001c0b6580 2021-10-20T23:28:34.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0024039700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c143e10 con 0x7f001c0b43c0 2021-10-20T23:28:34.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f00225d6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f001c0b6960 0x7f001c12ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42792/0 (socket says 172.21.15.12:42792) 2021-10-20T23:28:34.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f00225d6700 1 -- 172.21.15.12:0/1154491500 learned_addr learned my addr 172.21.15.12:0/1154491500 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:34.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f00215d4700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c0b43c0 0x7f001c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:34.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162532237 0 0) 0x7f001c1440b0 con 0x7f001c0b6960 2021-10-20T23:28:34.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0004003260 con 0x7f001c0b6960 2021-10-20T23:28:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596802723 0 0) 0x7f001c143b70 con 0x7f001c0b6580 2021-10-20T23:28:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f001c1440b0 con 0x7f001c0b6580 2021-10-20T23:28:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1507089541 0 0) 0x7f0004003260 con 0x7f001c0b6960 2021-10-20T23:28:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c0b43c0 msgr2=0x7f001c0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c0b43c0 0x7f001c0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 >> v1:172.21.15.31:6789/0 conn(0x7f001c0b6580 legacy=0x7f001c061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c0615f0 con 0x7f001c0b6960 2021-10-20T23:28:34.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f00140019e0 con 0x7f001c0b6960 2021-10-20T23:28:34.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 >> v1:172.21.15.12:6789/0 conn(0x7f001c0b6960 legacy=0x7f001c12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:34.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0004003910 0x7f0004003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:34.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c0b43c0 0x7f0004004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:34.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00040049f0 0x7f0004004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:34.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c143e10 con 0x7f0004003910 2021-10-20T23:28:34.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000400b7b0 con 0x7f00040049f0 2021-10-20T23:28:34.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000400b970 con 0x7f001c0b43c0 2021-10-20T23:28:34.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0021dd5700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0004003910 0x7f0004003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:34.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f00215d4700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c0b43c0 0x7f0004004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:34.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f00225d6700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00040049f0 0x7f0004004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:34.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0021dd5700 1 -- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c0b43c0 msgr2=0x7f0004004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:34.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0021dd5700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c0b43c0 0x7f0004004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:34.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0021dd5700 1 -- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00040049f0 msgr2=0x7f0004004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:34.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0021dd5700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00040049f0 0x7f0004004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:34.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0021dd5700 1 -- 172.21.15.12:0/1154491500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004003260 con 0x7f0004003910 2021-10-20T23:28:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0021dd5700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0004003910 0x7f0004003d10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f0018001110 tx=0x7f0018007a00).ready entity=mon.0 client_cookie=51e479de16692ec5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0018007d10 con 0x7f0004003910 2021-10-20T23:28:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0018007030 con 0x7f0004003910 2021-10-20T23:28:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0020dd3700 1 -- 172.21.15.12:0/1154491500 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0018007390 con 0x7f0004003910 2021-10-20T23:28:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0024039700 1 -- 172.21.15.12:0/1154491500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0004003910 msgr2=0x7f0004003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:34.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0024039700 1 --2- 172.21.15.12:0/1154491500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0004003910 0x7f0004003d10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f0018001110 tx=0x7f0018007a00).stop 2021-10-20T23:28:34.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f00225d6700 1 -- 172.21.15.12:0/1154491500 reap_dead start 2021-10-20T23:28:34.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0024039700 1 -- 172.21.15.12:0/1154491500 shutdown_connections 2021-10-20T23:28:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.108+0000 7f0024039700 1 -- 172.21.15.12:0/1154491500 >> 172.21.15.12:0/1154491500 conn(0x7f001c05c490 msgr2=0x7f001c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 -- 172.21.15.12:0/1154491500 shutdown_connections 2021-10-20T23:28:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 -- 172.21.15.12:0/1154491500 wait complete. 2021-10-20T23:28:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 Processor -- start 2021-10-20T23:28:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 -- start start 2021-10-20T23:28:34.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001c144ef0 0x7f001c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:34.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001c0b39f0 0x7f001c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:34.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c1452d0 0x7f001c0b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:34.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0ae540 con 0x7f001c144ef0 2021-10-20T23:28:34.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0b33c0 con 0x7f001c0b39f0 2021-10-20T23:28:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0af3f0 con 0x7f001c1452d0 2021-10-20T23:28:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0021dd5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001c144ef0 0x7f001c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0021dd5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001c144ef0 0x7f001c0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44206/0 (socket says 172.21.15.12:44206) 2021-10-20T23:28:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0021dd5700 1 -- 172.21.15.12:0/1314453362 learned_addr learned my addr 172.21.15.12:0/1314453362 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f00215d4700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001c0b39f0 0x7f001c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f00225d6700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c1452d0 0x7f001c0b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0021dd5700 1 -- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c1452d0 msgr2=0x7f001c0b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0021dd5700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c1452d0 0x7f001c0b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:34.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0021dd5700 1 -- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001c0b39f0 msgr2=0x7f001c0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:34.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0021dd5700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001c0b39f0 0x7f001c0ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:34.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0021dd5700 1 -- 172.21.15.12:0/1314453362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c0af690 con 0x7f001c144ef0 2021-10-20T23:28:34.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0021dd5700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001c144ef0 0x7f001c0adb60 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f0018001110 tx=0x7f0018016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:34.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f000effd700 1 -- 172.21.15.12:0/1314453362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0018013810 con 0x7f001c144ef0 2021-10-20T23:28:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f000effd700 1 -- 172.21.15.12:0/1314453362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0018013970 con 0x7f001c144ef0 2021-10-20T23:28:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c0afb30 con 0x7f001c144ef0 2021-10-20T23:28:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.112+0000 7f000effd700 1 -- 172.21.15.12:0/1314453362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0018013cd0 con 0x7f001c144ef0 2021-10-20T23:28:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.116+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c0b30f0 con 0x7f001c144ef0 2021-10-20T23:28:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.116+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c0b3580 con 0x7f001c144ef0 2021-10-20T23:28:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.116+0000 7f000effd700 1 -- 172.21.15.12:0/1314453362 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0018010030 con 0x7f001c144ef0 2021-10-20T23:28:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.116+0000 7f000effd700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efffc053580 0x7efffc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.116+0000 7f000effd700 1 -- 172.21.15.12:0/1314453362 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f001806cbe0 con 0x7f001c144ef0 2021-10-20T23:28:34.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.116+0000 7f00215d4700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efffc053580 0x7efffc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:34.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.120+0000 7f00215d4700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efffc053580 0x7efffc055a40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f001000b000 tx=0x7f0010008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:34.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.120+0000 7f000effd700 1 -- 172.21.15.12:0/1314453362 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0018043b90 con 0x7f001c144ef0 2021-10-20T23:28:34.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.248+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f001c0b30f0 con 0x7f001c144ef0 2021-10-20T23:28:34.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.976+0000 7f000effd700 1 -- 172.21.15.12:0/1314453362 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v136) v1 ==== 185+0+0 (secure 0 0 0) 0x7f001c0b30f0 con 0x7f001c144ef0 2021-10-20T23:28:34.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efffc053580 msgr2=0x7efffc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:34.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efffc053580 0x7efffc055a40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f001000b000 tx=0x7f0010008040).stop 2021-10-20T23:28:34.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001c144ef0 msgr2=0x7f001c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:34.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001c144ef0 0x7f001c0adb60 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f0018001110 tx=0x7f0018016000).stop 2021-10-20T23:28:34.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 shutdown_connections 2021-10-20T23:28:34.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efffc053580 0x7efffc055a40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:34.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f001c1452d0 0x7f001c0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:34.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001c0b39f0 0x7f001c0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:34.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 --2- 172.21.15.12:0/1314453362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001c144ef0 0x7f001c0adb60 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 >> 172.21.15.12:0/1314453362 conn(0x7f001c05c490 msgr2=0x7f001c1492a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 shutdown_connections 2021-10-20T23:28:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:34.984+0000 7f0024039700 1 -- 172.21.15.12:0/1314453362 wait complete. 2021-10-20T23:28:34.999 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:28:35.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:28:35.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb98123b700 1 Processor -- start 2021-10-20T23:28:35.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb98123b700 1 -- start start 2021-10-20T23:28:35.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb98123b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb97c0b6580 0x7fb97c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:35.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb98123b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb97c0b43c0 0x7fb97c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:35.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb98123b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c1440b0 con 0x7fb97c061d30 2021-10-20T23:28:35.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb98123b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c0b6e50 con 0x7fb97c0b6580 2021-10-20T23:28:35.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb98123b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c143b70 con 0x7fb97c0b43c0 2021-10-20T23:28:35.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb97ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb97c0b6580 0x7fb97c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:35.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb97ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb97c0b6580 0x7fb97c0b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44214/0 (socket says 172.21.15.12:44214) 2021-10-20T23:28:35.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb97ad9d700 1 -- 172.21.15.12:0/1969216259 learned_addr learned my addr 172.21.15.12:0/1969216259 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:35.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.116+0000 7fb97a59c700 1 --2- 172.21.15.12:0/1969216259 >> v2:172.21.15.31:3300/0 conn(0x7fb97c0b43c0 0x7fb97c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:35.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb97ad9d700 1 -- 172.21.15.12:0/1969216259 >> v2:172.21.15.31:3300/0 conn(0x7fb97c0b43c0 msgr2=0x7fb97c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:35.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb97ad9d700 1 --2- 172.21.15.12:0/1969216259 >> v2:172.21.15.31:3300/0 conn(0x7fb97c0b43c0 0x7fb97c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:35.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb97ad9d700 1 -- 172.21.15.12:0/1969216259 >> v1:172.21.15.31:6789/0 conn(0x7fb97c061d30 legacy=0x7fb97c1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:35.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb97ad9d700 1 -- 172.21.15.12:0/1969216259 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c143e10 con 0x7fb97c0b6580 2021-10-20T23:28:35.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb97ad9d700 1 --2- 172.21.15.12:0/1969216259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c0b6580 0x7fb97c0b5bf0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7fb97c143120 tx=0x7fb964006eb0).ready entity=mon.0 client_cookie=64795280204b084e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:35.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb979d9b700 1 -- 172.21.15.12:0/1969216259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb96400d610 con 0x7fb97c0b6580 2021-10-20T23:28:35.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb979d9b700 1 -- 172.21.15.12:0/1969216259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb964000e90 con 0x7fb97c0b6580 2021-10-20T23:28:35.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb979d9b700 1 -- 172.21.15.12:0/1969216259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb96400d9a0 con 0x7fb97c0b6580 2021-10-20T23:28:35.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb98123b700 1 -- 172.21.15.12:0/1969216259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c0b6580 msgr2=0x7fb97c0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:35.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb98123b700 1 --2- 172.21.15.12:0/1969216259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c0b6580 0x7fb97c0b5bf0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7fb97c143120 tx=0x7fb964006eb0).stop 2021-10-20T23:28:35.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb98123b700 1 -- 172.21.15.12:0/1969216259 shutdown_connections 2021-10-20T23:28:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb98123b700 1 --2- 172.21.15.12:0/1969216259 >> v2:172.21.15.31:3300/0 conn(0x7fb97c0b43c0 0x7fb97c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb98123b700 1 --2- 172.21.15.12:0/1969216259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c0b6580 0x7fb97c0b5bf0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb98123b700 1 -- 172.21.15.12:0/1969216259 >> 172.21.15.12:0/1969216259 conn(0x7fb97c05c490 msgr2=0x7fb97c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb98123b700 1 -- 172.21.15.12:0/1969216259 shutdown_connections 2021-10-20T23:28:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.120+0000 7fb98123b700 1 -- 172.21.15.12:0/1969216259 wait complete. 2021-10-20T23:28:35.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 Processor -- start 2021-10-20T23:28:35.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 -- start start 2021-10-20T23:28:35.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c061d30 0x7fb97c1250e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:35.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97c0b43c0 0x7fb97c128c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:35.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb97c0b6580 0x7fb97c1261a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:35.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c126c00 con 0x7fb97c061d30 2021-10-20T23:28:35.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c1257a0 con 0x7fb97c0b43c0 2021-10-20T23:28:35.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c125a40 con 0x7fb97c0b6580 2021-10-20T23:28:35.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c061d30 0x7fb97c1250e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:35.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c061d30 0x7fb97c1250e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44224/0 (socket says 172.21.15.12:44224) 2021-10-20T23:28:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97ad9d700 1 -- 172.21.15.12:0/234123481 learned_addr learned my addr 172.21.15.12:0/234123481 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97a59c700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97c0b43c0 0x7fb97c128c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97b59e700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb97c0b6580 0x7fb97c1261a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97ad9d700 1 -- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb97c0b6580 msgr2=0x7fb97c1261a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97ad9d700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb97c0b6580 0x7fb97c1261a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:35.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97ad9d700 1 -- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97c0b43c0 msgr2=0x7fb97c128c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:35.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97ad9d700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97c0b43c0 0x7fb97c128c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:35.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97ad9d700 1 -- 172.21.15.12:0/234123481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96400b1e0 con 0x7fb97c061d30 2021-10-20T23:28:35.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb97ad9d700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c061d30 0x7fb97c1250e0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fb97c143120 tx=0x7fb964015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:35.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb973fff700 1 -- 172.21.15.12:0/234123481 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb964011860 con 0x7fb97c061d30 2021-10-20T23:28:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb973fff700 1 -- 172.21.15.12:0/234123481 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9640119c0 con 0x7fb97c061d30 2021-10-20T23:28:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c125ce0 con 0x7fb97c061d30 2021-10-20T23:28:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb973fff700 1 -- 172.21.15.12:0/234123481 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb964011d20 con 0x7fb97c061d30 2021-10-20T23:28:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.124+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c12c5d0 con 0x7fb97c061d30 2021-10-20T23:28:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.128+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c0615f0 con 0x7fb97c061d30 2021-10-20T23:28:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.128+0000 7fb973fff700 1 -- 172.21.15.12:0/234123481 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb964025030 con 0x7fb97c061d30 2021-10-20T23:28:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.128+0000 7fb973fff700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb960053610 0x7fb960055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.128+0000 7fb973fff700 1 -- 172.21.15.12:0/234123481 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fb96406cb90 con 0x7fb97c061d30 2021-10-20T23:28:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.128+0000 7fb97a59c700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb960053610 0x7fb960055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:35.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.128+0000 7fb97a59c700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb960053610 0x7fb960055ad0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fb96c00b000 tx=0x7fb96c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:35.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.136+0000 7fb973fff700 1 -- 172.21.15.12:0/234123481 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb964043c20 con 0x7fb97c061d30 2021-10-20T23:28:35.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.264+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb97c057350 con 0x7fb97c061d30 2021-10-20T23:28:36.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.992+0000 7fb973fff700 1 -- 172.21.15.12:0/234123481 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v137) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb964047200 con 0x7fb97c061d30 2021-10-20T23:28:36.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb960053610 msgr2=0x7fb960055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb960053610 0x7fb960055ad0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fb96c00b000 tx=0x7fb96c006df0).stop 2021-10-20T23:28:36.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c061d30 msgr2=0x7fb97c1250e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c061d30 0x7fb97c1250e0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fb97c143120 tx=0x7fb964015000).stop 2021-10-20T23:28:36.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 shutdown_connections 2021-10-20T23:28:36.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb960053610 0x7fb960055ad0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb97c0b6580 0x7fb97c1261a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97c0b43c0 0x7fb97c128c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 --2- 172.21.15.12:0/234123481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb97c061d30 0x7fb97c1250e0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 >> 172.21.15.12:0/234123481 conn(0x7fb97c05c490 msgr2=0x7fb97c127150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:36.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 shutdown_connections 2021-10-20T23:28:36.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:35.996+0000 7fb98123b700 1 -- 172.21.15.12:0/234123481 wait complete. 2021-10-20T23:28:36.011 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:28:36.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:28:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.120+0000 7f0f1e7e6700 1 Processor -- start 2021-10-20T23:28:36.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.120+0000 7f0f1e7e6700 1 -- start start 2021-10-20T23:28:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.120+0000 7f0f1e7e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1813e460 0x7f0f18064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.120+0000 7f0f1e7e6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0f181443a0 0x7f0f18066da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.120+0000 7f0f1e7e6700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f180653a0 con 0x7f0f180b38a0 2021-10-20T23:28:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.120+0000 7f0f1e7e6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f18065fd0 con 0x7f0f181443a0 2021-10-20T23:28:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.120+0000 7f0f1e7e6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180b30d0 con 0x7f0f1813e460 2021-10-20T23:28:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f0f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0f180b38a0 0x7f0f180b7530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42824/0 (socket says 172.21.15.12:42824) 2021-10-20T23:28:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f0f7fe700 1 -- 172.21.15.12:0/2612677935 learned_addr learned my addr 172.21.15.12:0/2612677935 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f17fff700 1 --2- 172.21.15.12:0/2612677935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1813e460 0x7f0f18064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1cd83700 1 --2- 172.21.15.12:0/2612677935 >> v2:172.21.15.31:3300/0 conn(0x7f0f181443a0 0x7f0f18066da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f177fe700 1 -- 172.21.15.12:0/2612677935 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42113988 0 0) 0x7f0f180653a0 con 0x7f0f180b38a0 2021-10-20T23:28:36.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f177fe700 1 -- 172.21.15.12:0/2612677935 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef8003260 con 0x7f0f180b38a0 2021-10-20T23:28:36.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f17fff700 1 -- 172.21.15.12:0/2612677935 >> v2:172.21.15.31:3300/0 conn(0x7f0f181443a0 msgr2=0x7f0f18066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:36.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f17fff700 1 --2- 172.21.15.12:0/2612677935 >> v2:172.21.15.31:3300/0 conn(0x7f0f181443a0 0x7f0f18066da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f17fff700 1 -- 172.21.15.12:0/2612677935 >> v1:172.21.15.12:6789/0 conn(0x7f0f180b38a0 legacy=0x7f0f180b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f17fff700 1 -- 172.21.15.12:0/2612677935 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180b7c40 con 0x7f0f1813e460 2021-10-20T23:28:36.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1cd83700 1 --2- 172.21.15.12:0/2612677935 >> v2:172.21.15.31:3300/0 conn(0x7f0f181443a0 0x7f0f18066da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:36.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f17fff700 1 --2- 172.21.15.12:0/2612677935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1813e460 0x7f0f18064870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0f08002f70 tx=0x7f0f08006df0).ready entity=mon.2 client_cookie=7bb096671e04378a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:36.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f177fe700 1 -- 172.21.15.12:0/2612677935 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f0800d4a0 con 0x7f0f1813e460 2021-10-20T23:28:36.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f177fe700 1 -- 172.21.15.12:0/2612677935 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08000e90 con 0x7f0f1813e460 2021-10-20T23:28:36.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f177fe700 1 -- 172.21.15.12:0/2612677935 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f0800d7f0 con 0x7f0f1813e460 2021-10-20T23:28:36.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/2612677935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1813e460 msgr2=0x7f0f18064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 --2- 172.21.15.12:0/2612677935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1813e460 0x7f0f18064870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0f08002f70 tx=0x7f0f08006df0).stop 2021-10-20T23:28:36.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/2612677935 shutdown_connections 2021-10-20T23:28:36.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 --2- 172.21.15.12:0/2612677935 >> v2:172.21.15.31:3300/0 conn(0x7f0f181443a0 0x7f0f18066da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 --2- 172.21.15.12:0/2612677935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1813e460 0x7f0f18064870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/2612677935 >> 172.21.15.12:0/2612677935 conn(0x7f0f180629d0 msgr2=0x7f0f18062de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:36.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/2612677935 shutdown_connections 2021-10-20T23:28:36.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/2612677935 wait complete. 2021-10-20T23:28:36.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 Processor -- start 2021-10-20T23:28:36.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.124+0000 7f0f1e7e6700 1 -- start start 2021-10-20T23:28:36.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1e7e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f180b38a0 0x7f0f180b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1e7e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f1813e460 0x7f0f18154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1e7e6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f181443a0 0x7f0f180ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1e7e6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1809f160 con 0x7f0f181443a0 2021-10-20T23:28:36.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1e7e6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1813ed10 con 0x7f0f1813e460 2021-10-20T23:28:36.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1e7e6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1809e9c0 con 0x7f0f180b38a0 2021-10-20T23:28:36.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1cd83700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f181443a0 0x7f0f180ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1cd83700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f181443a0 0x7f0f180ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44236/0 (socket says 172.21.15.12:44236) 2021-10-20T23:28:36.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1cd83700 1 -- 172.21.15.12:0/3293057194 learned_addr learned my addr 172.21.15.12:0/3293057194 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:36.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f17fff700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f180b38a0 0x7f0f180b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f0f7fe700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f1813e460 0x7f0f18154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1cd83700 1 -- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f180b38a0 msgr2=0x7f0f180b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1cd83700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f180b38a0 0x7f0f180b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1cd83700 1 -- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f1813e460 msgr2=0x7f0f18154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1cd83700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f1813e460 0x7f0f18154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1cd83700 1 -- 172.21.15.12:0/3293057194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10009470 con 0x7f0f181443a0 2021-10-20T23:28:36.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1cd83700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f181443a0 0x7f0f180ad5b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f0f1000c000 tx=0x7f0f100091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:36.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f15ffb700 1 -- 172.21.15.12:0/3293057194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1000ee60 con 0x7f0f181443a0 2021-10-20T23:28:36.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f15ffb700 1 -- 172.21.15.12:0/3293057194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1000c850 con 0x7f0f181443a0 2021-10-20T23:28:36.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0800b180 con 0x7f0f181443a0 2021-10-20T23:28:36.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f15ffb700 1 -- 172.21.15.12:0/3293057194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1000cbb0 con 0x7f0f181443a0 2021-10-20T23:28:36.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1809eec0 con 0x7f0f181443a0 2021-10-20T23:28:36.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1805f2f0 con 0x7f0f181443a0 2021-10-20T23:28:36.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.128+0000 7f0f15ffb700 1 -- 172.21.15.12:0/3293057194 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0f10022070 con 0x7f0f181443a0 2021-10-20T23:28:36.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.132+0000 7f0f15ffb700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0efc053580 0x7f0efc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.132+0000 7f0f15ffb700 1 -- 172.21.15.12:0/3293057194 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f0f1006be10 con 0x7f0f181443a0 2021-10-20T23:28:36.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.132+0000 7f0f17fff700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0efc053580 0x7f0efc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.132+0000 7f0f17fff700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0efc053580 0x7f0efc055a40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f0f0801a000 tx=0x7f0f08014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:36.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.136+0000 7f0f15ffb700 1 -- 172.21.15.12:0/3293057194 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f1805f2f0 con 0x7f0f181443a0 2021-10-20T23:28:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.264+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0f1805f2f0 con 0x7f0f181443a0 2021-10-20T23:28:36.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.272+0000 7f0f15ffb700 1 -- 172.21.15.12:0/3293057194 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f1805f2f0 con 0x7f0f181443a0 2021-10-20T23:28:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0efc053580 msgr2=0x7f0efc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0efc053580 0x7f0efc055a40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f0f0801a000 tx=0x7f0f08014000).stop 2021-10-20T23:28:36.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f181443a0 msgr2=0x7f0f180ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f181443a0 0x7f0f180ad5b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f0f1000c000 tx=0x7f0f100091d0).stop 2021-10-20T23:28:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 shutdown_connections 2021-10-20T23:28:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0efc053580 0x7f0efc055a40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f181443a0 0x7f0f180ad5b0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f1813e460 0x7f0f18154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 --2- 172.21.15.12:0/3293057194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f180b38a0 0x7f0f180b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 >> 172.21.15.12:0/3293057194 conn(0x7f0f180629d0 msgr2=0x7f0f181421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:36.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 shutdown_connections 2021-10-20T23:28:36.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.276+0000 7f0f1e7e6700 1 -- 172.21.15.12:0/3293057194 wait complete. 2021-10-20T23:28:36.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-10-20T23:28:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f355a259700 1 Processor -- start 2021-10-20T23:28:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f355a259700 1 -- start start 2021-10-20T23:28:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f355a259700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35540b04a0 0x7f35540add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f355a259700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35540aa120 0x7f35540ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f355a259700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540b2af0 con 0x7f35540b0880 2021-10-20T23:28:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f355a259700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35540b2770 con 0x7f35540b04a0 2021-10-20T23:28:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f355a259700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35540b2d20 con 0x7f35540aa120 2021-10-20T23:28:36.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f35537fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35540b04a0 0x7f35540add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f354bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35540aa120 0x7f35540ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f35537fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35540b04a0 0x7f35540add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44244/0 (socket says 172.21.15.12:44244) 2021-10-20T23:28:36.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f35537fe700 1 -- 172.21.15.12:0/3684335373 learned_addr learned my addr 172.21.15.12:0/3684335373 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:36.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f354bfff700 1 -- 172.21.15.12:0/3684335373 >> v2:172.21.15.12:3300/0 conn(0x7f35540b04a0 msgr2=0x7f35540add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:36.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f354bfff700 1 --2- 172.21.15.12:0/3684335373 >> v2:172.21.15.12:3300/0 conn(0x7f35540b04a0 0x7f35540add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f354bfff700 1 -- 172.21.15.12:0/3684335373 >> v1:172.21.15.31:6789/0 conn(0x7f35540b0880 legacy=0x7f3554143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.396+0000 7f354bfff700 1 -- 172.21.15.12:0/3684335373 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540a9b70 con 0x7f35540aa120 2021-10-20T23:28:36.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f354bfff700 1 --2- 172.21.15.12:0/3684335373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35540aa120 0x7f35540ae220 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f353c002f70 tx=0x7f353c006df0).ready entity=mon.1 client_cookie=e629674937d5f453 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:36.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f3552ffd700 1 -- 172.21.15.12:0/3684335373 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f353c00d570 con 0x7f35540aa120 2021-10-20T23:28:36.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f3552ffd700 1 -- 172.21.15.12:0/3684335373 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c000e90 con 0x7f35540aa120 2021-10-20T23:28:36.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f3552ffd700 1 -- 172.21.15.12:0/3684335373 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f353c00d8c0 con 0x7f35540aa120 2021-10-20T23:28:36.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 -- 172.21.15.12:0/3684335373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35540aa120 msgr2=0x7f35540ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 --2- 172.21.15.12:0/3684335373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35540aa120 0x7f35540ae220 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f353c002f70 tx=0x7f353c006df0).stop 2021-10-20T23:28:36.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 -- 172.21.15.12:0/3684335373 shutdown_connections 2021-10-20T23:28:36.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 --2- 172.21.15.12:0/3684335373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35540aa120 0x7f35540ae220 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 --2- 172.21.15.12:0/3684335373 >> v2:172.21.15.12:3300/0 conn(0x7f35540b04a0 0x7f35540add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 -- 172.21.15.12:0/3684335373 >> 172.21.15.12:0/3684335373 conn(0x7f35540607c0 msgr2=0x7f3554060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:36.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 -- 172.21.15.12:0/3684335373 shutdown_connections 2021-10-20T23:28:36.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 -- 172.21.15.12:0/3684335373 wait complete. 2021-10-20T23:28:36.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 Processor -- start 2021-10-20T23:28:36.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 -- start start 2021-10-20T23:28:36.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35540aa120 0x7f35540663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35540b04a0 0x7f35540a2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35540b0880 0x7f35540a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35541526b0 con 0x7f35540aa120 2021-10-20T23:28:36.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3554152950 con 0x7f35540b0880 2021-10-20T23:28:36.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.400+0000 7f355a259700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3554152bf0 con 0x7f35540b04a0 2021-10-20T23:28:36.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35540aa120 0x7f35540663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35540aa120 0x7f35540663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44248/0 (socket says 172.21.15.12:44248) 2021-10-20T23:28:36.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35537fe700 1 -- 172.21.15.12:0/1074896688 learned_addr learned my addr 172.21.15.12:0/1074896688 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f354bfff700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35540b04a0 0x7f35540a2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f3553fff700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35540b0880 0x7f35540a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35537fe700 1 -- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35540b04a0 msgr2=0x7f35540a2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35537fe700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35540b04a0 0x7f35540a2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35537fe700 1 -- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35540b0880 msgr2=0x7f35540a31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35537fe700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35540b0880 0x7f35540a31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35537fe700 1 -- 172.21.15.12:0/1074896688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c00b180 con 0x7f35540aa120 2021-10-20T23:28:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f354bfff700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35540b04a0 0x7f35540a2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35537fe700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35540aa120 0x7f35540663a0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f354400c000 tx=0x7f3544008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35517fa700 1 -- 172.21.15.12:0/1074896688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3544013610 con 0x7f35540aa120 2021-10-20T23:28:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3554152e90 con 0x7f35540aa120 2021-10-20T23:28:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35517fa700 1 -- 172.21.15.12:0/1074896688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3544013770 con 0x7f35540aa120 2021-10-20T23:28:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35517fa700 1 -- 172.21.15.12:0/1074896688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3544013ad0 con 0x7f35540aa120 2021-10-20T23:28:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35541535d0 con 0x7f35540aa120 2021-10-20T23:28:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3554057350 con 0x7f35540aa120 2021-10-20T23:28:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.404+0000 7f35517fa700 1 -- 172.21.15.12:0/1074896688 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3544023070 con 0x7f35540aa120 2021-10-20T23:28:36.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.408+0000 7f35517fa700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3538053520 0x7f35380559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:36.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.408+0000 7f35517fa700 1 -- 172.21.15.12:0/1074896688 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f354406b9c0 con 0x7f35540aa120 2021-10-20T23:28:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.408+0000 7f354bfff700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3538053520 0x7f35380559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.408+0000 7f354bfff700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3538053520 0x7f35380559e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f353c01a000 tx=0x7f353c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.416+0000 7f35517fa700 1 -- 172.21.15.12:0/1074896688 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3544042c00 con 0x7f35540aa120 2021-10-20T23:28:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:36.580+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f3554044650 con 0x7f35540aa120 2021-10-20T23:28:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.000+0000 7f35517fa700 1 -- 172.21.15.12:0/1074896688 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v397) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3544046220 con 0x7f35540aa120 2021-10-20T23:28:37.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3538053520 msgr2=0x7f35380559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:37.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3538053520 0x7f35380559e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f353c01a000 tx=0x7f353c014000).stop 2021-10-20T23:28:37.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35540aa120 msgr2=0x7f35540663a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35540aa120 0x7f35540663a0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f354400c000 tx=0x7f3544008040).stop 2021-10-20T23:28:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 shutdown_connections 2021-10-20T23:28:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3538053520 0x7f35380559e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35540b0880 0x7f35540a31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35540b04a0 0x7f35540a2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 --2- 172.21.15.12:0/1074896688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35540aa120 0x7f35540663a0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 >> 172.21.15.12:0/1074896688 conn(0x7f35540607c0 msgr2=0x7f35540b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 shutdown_connections 2021-10-20T23:28:37.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.004+0000 7f355a259700 1 -- 172.21.15.12:0/1074896688 wait complete. 2021-10-20T23:28:37.032 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-20T23:28:37.033 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-10-20T23:28:37.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-10-20T23:28:37.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.132+0000 7f75d0c97700 1 Processor -- start 2021-10-20T23:28:37.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.132+0000 7f75d0c97700 1 -- start start 2021-10-20T23:28:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 0x7f75cc0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f75cc13f390 0x7f75cc0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc05cbb0 con 0x7f75cc05c7d0 2021-10-20T23:28:37.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0ad540 con 0x7f75cc13f390 2021-10-20T23:28:37.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc067d70 con 0x7f75cc05d0b0 2021-10-20T23:28:37.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75c3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 0x7f75cc0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:37.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75cbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f75cc13f390 0x7f75cc0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:37.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75cb7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f75cc05c7d0 0x7f75cc0ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:49914/0 (socket says 172.21.15.12:49914) 2021-10-20T23:28:37.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75cb7fe700 1 -- 172.21.15.12:0/4179124223 learned_addr learned my addr 172.21.15.12:0/4179124223 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:37.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75c3fff700 1 -- 172.21.15.12:0/4179124223 >> v2:172.21.15.31:3300/0 conn(0x7f75cc13f390 msgr2=0x7f75cc0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:37.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75c3fff700 1 --2- 172.21.15.12:0/4179124223 >> v2:172.21.15.31:3300/0 conn(0x7f75cc13f390 0x7f75cc0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:37.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75c3fff700 1 -- 172.21.15.12:0/4179124223 >> v1:172.21.15.31:6789/0 conn(0x7f75cc05c7d0 legacy=0x7f75cc0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:37.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75c3fff700 1 -- 172.21.15.12:0/4179124223 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0b1790 con 0x7f75cc05d0b0 2021-10-20T23:28:37.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75c3fff700 1 --2- 172.21.15.12:0/4179124223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 0x7f75cc0b10f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f75b4002f70 tx=0x7f75b4006df0).ready entity=mon.2 client_cookie=24a7283721e66dcb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:37.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75caffd700 1 -- 172.21.15.12:0/4179124223 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b400d570 con 0x7f75cc05d0b0 2021-10-20T23:28:37.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75caffd700 1 -- 172.21.15.12:0/4179124223 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b4000e90 con 0x7f75cc05d0b0 2021-10-20T23:28:37.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75caffd700 1 -- 172.21.15.12:0/4179124223 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b400d8c0 con 0x7f75cc05d0b0 2021-10-20T23:28:37.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 -- 172.21.15.12:0/4179124223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 msgr2=0x7f75cc0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:37.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 --2- 172.21.15.12:0/4179124223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 0x7f75cc0b10f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f75b4002f70 tx=0x7f75b4006df0).stop 2021-10-20T23:28:37.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 -- 172.21.15.12:0/4179124223 shutdown_connections 2021-10-20T23:28:37.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 --2- 172.21.15.12:0/4179124223 >> v2:172.21.15.31:3300/0 conn(0x7f75cc13f390 0x7f75cc0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:37.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 --2- 172.21.15.12:0/4179124223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 0x7f75cc0b10f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:37.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 -- 172.21.15.12:0/4179124223 >> 172.21.15.12:0/4179124223 conn(0x7f75cc060180 msgr2=0x7f75cc0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:37.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 -- 172.21.15.12:0/4179124223 shutdown_connections 2021-10-20T23:28:37.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.136+0000 7f75d0c97700 1 -- 172.21.15.12:0/4179124223 wait complete. 2021-10-20T23:28:37.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75d0c97700 1 Processor -- start 2021-10-20T23:28:37.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75d0c97700 1 -- start start 2021-10-20T23:28:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75d0c97700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75cc05c7d0 0x7f75cc0aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75d0c97700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 0x7f75cc145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75d0c97700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc13f390 0x7f75cc145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75d0c97700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc142970 con 0x7f75cc13f390 2021-10-20T23:28:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75d0c97700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc141f90 con 0x7f75cc05c7d0 2021-10-20T23:28:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75d0c97700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc142230 con 0x7f75cc05d0b0 2021-10-20T23:28:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc13f390 0x7f75cc145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc13f390 0x7f75cc145f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44266/0 (socket says 172.21.15.12:44266) 2021-10-20T23:28:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75cbfff700 1 -- 172.21.15.12:0/3653566218 learned_addr learned my addr 172.21.15.12:0/3653566218 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75cb7fe700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75cc05c7d0 0x7f75cc0aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75c3fff700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 0x7f75cc145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75cbfff700 1 -- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 msgr2=0x7f75cc145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75cbfff700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 0x7f75cc145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:37.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75cbfff700 1 -- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75cc05c7d0 msgr2=0x7f75cc0aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:37.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75cbfff700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75cc05c7d0 0x7f75cc0aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:37.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.140+0000 7f75cbfff700 1 -- 172.21.15.12:0/3653566218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b400b180 con 0x7f75cc13f390 2021-10-20T23:28:37.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75cbfff700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc13f390 0x7f75cc145f40 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f75c4006e00 tx=0x7f75c400b470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:37.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75c97fa700 1 -- 172.21.15.12:0/3653566218 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c401a470 con 0x7f75cc13f390 2021-10-20T23:28:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75c97fa700 1 -- 172.21.15.12:0/3653566218 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c401a5d0 con 0x7f75cc13f390 2021-10-20T23:28:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc1424d0 con 0x7f75cc13f390 2021-10-20T23:28:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75c97fa700 1 -- 172.21.15.12:0/3653566218 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c401a930 con 0x7f75cc13f390 2021-10-20T23:28:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc145460 con 0x7f75cc13f390 2021-10-20T23:28:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc0b1a30 con 0x7f75cc13f390 2021-10-20T23:28:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75c97fa700 1 -- 172.21.15.12:0/3653566218 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75c401aa90 con 0x7f75cc13f390 2021-10-20T23:28:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75c97fa700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f75b0053520 0x7f75b00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75c97fa700 1 -- 172.21.15.12:0/3653566218 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f75c406ebf0 con 0x7f75cc13f390 2021-10-20T23:28:37.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.144+0000 7f75cb7fe700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f75b0053520 0x7f75b00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:37.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.148+0000 7f75cb7fe700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f75b0053520 0x7f75b00559e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f75bc00d000 tx=0x7f75bc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:37.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.156+0000 7f75c97fa700 1 -- 172.21.15.12:0/3653566218 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75c4045f80 con 0x7f75cc13f390 2021-10-20T23:28:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:37.324+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f75cc057350 con 0x7f75cc13f390 2021-10-20T23:28:37.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:28:37.518 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:28:37.521 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:28:37.524 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:28:38.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.004+0000 7f75c97fa700 1 -- 172.21.15.12:0/3653566218 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v398) v1 ==== 131+0+0 (secure 0 0 0) 0x7f75c40495a0 con 0x7f75cc13f390 2021-10-20T23:28:38.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f75b0053520 msgr2=0x7f75b00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f75b0053520 0x7f75b00559e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f75bc00d000 tx=0x7f75bc009040).stop 2021-10-20T23:28:38.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc13f390 msgr2=0x7f75cc145f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc13f390 0x7f75cc145f40 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f75c4006e00 tx=0x7f75c400b470).stop 2021-10-20T23:28:38.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 shutdown_connections 2021-10-20T23:28:38.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f75b0053520 0x7f75b00559e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc13f390 0x7f75cc145f40 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75cc05d0b0 0x7f75cc145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 --2- 172.21.15.12:0/3653566218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75cc05c7d0 0x7f75cc0aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 >> 172.21.15.12:0/3653566218 conn(0x7f75cc060180 msgr2=0x7f75cc13dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:38.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 shutdown_connections 2021-10-20T23:28:38.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.008+0000 7f75d0c97700 1 -- 172.21.15.12:0/3653566218 wait complete. 2021-10-20T23:28:38.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:28:38.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.140+0000 7f1a60584700 1 Processor -- start 2021-10-20T23:28:38.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.140+0000 7f1a60584700 1 -- start start 2021-10-20T23:28:38.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a580b29c0 0x7f1a580af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a580ad810 con 0x7f1a580b15e0 2021-10-20T23:28:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a580adab0 con 0x7f1a580b56c0 2021-10-20T23:28:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a580add50 con 0x7f1a580b29c0 2021-10-20T23:28:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5e320700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a580b29c0 0x7f1a580af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5db1f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1a580b15e0 0x7f1a580afc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42868/0 (socket says 172.21.15.12:42868) 2021-10-20T23:28:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5db1f700 1 -- 172.21.15.12:0/822209277 learned_addr learned my addr 172.21.15.12:0/822209277 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5e320700 1 -- 172.21.15.12:0/822209277 >> v1:172.21.15.31:6789/0 conn(0x7f1a580b56c0 legacy=0x7f1a581434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5e320700 1 -- 172.21.15.12:0/822209277 >> v1:172.21.15.12:6789/0 conn(0x7f1a580b15e0 legacy=0x7f1a580afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5e320700 1 -- 172.21.15.12:0/822209277 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a580adff0 con 0x7f1a580b29c0 2021-10-20T23:28:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5e320700 1 --2- 172.21.15.12:0/822209277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 0x7f1a580af720 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f1a54002f70 tx=0x7f1a54006df0).ready entity=mon.0 client_cookie=9edc330399c439a7 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5d31e700 1 -- 172.21.15.12:0/822209277 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5400d610 con 0x7f1a580b29c0 2021-10-20T23:28:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5d31e700 1 -- 172.21.15.12:0/822209277 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54000e90 con 0x7f1a580b29c0 2021-10-20T23:28:38.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a5d31e700 1 -- 172.21.15.12:0/822209277 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5400d960 con 0x7f1a580b29c0 2021-10-20T23:28:38.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 -- 172.21.15.12:0/822209277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 msgr2=0x7f1a580af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 --2- 172.21.15.12:0/822209277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 0x7f1a580af720 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f1a54002f70 tx=0x7f1a54006df0).stop 2021-10-20T23:28:38.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 -- 172.21.15.12:0/822209277 shutdown_connections 2021-10-20T23:28:38.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 --2- 172.21.15.12:0/822209277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 0x7f1a580af720 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 -- 172.21.15.12:0/822209277 >> 172.21.15.12:0/822209277 conn(0x7f1a5806a110 msgr2=0x7f1a5805cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:38.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 -- 172.21.15.12:0/822209277 shutdown_connections 2021-10-20T23:28:38.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.144+0000 7f1a60584700 1 -- 172.21.15.12:0/822209277 wait complete. 2021-10-20T23:28:38.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a60584700 1 Processor -- start 2021-10-20T23:28:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a60584700 1 -- start start 2021-10-20T23:28:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a60584700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a580b15e0 0x7f1a58145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a60584700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 0x7f1a58146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a60584700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a580b56c0 0x7f1a58147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a60584700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58147870 con 0x7f1a580b29c0 2021-10-20T23:28:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a60584700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58141d00 con 0x7f1a580b56c0 2021-10-20T23:28:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a60584700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58141520 con 0x7f1a580b15e0 2021-10-20T23:28:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a5db1f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 0x7f1a58146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a5e320700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a580b15e0 0x7f1a58145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a5db1f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 0x7f1a58146e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44278/0 (socket says 172.21.15.12:44278) 2021-10-20T23:28:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.148+0000 7f1a5db1f700 1 -- 172.21.15.12:0/269935249 learned_addr learned my addr 172.21.15.12:0/269935249 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a5eb21700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a580b56c0 0x7f1a58147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a5db1f700 1 -- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a580b15e0 msgr2=0x7f1a58145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a5db1f700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a580b15e0 0x7f1a58145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a5db1f700 1 -- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a580b56c0 msgr2=0x7f1a58147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a5db1f700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a580b56c0 0x7f1a58147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a5db1f700 1 -- 172.21.15.12:0/269935249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5400b180 con 0x7f1a580b29c0 2021-10-20T23:28:38.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a5e320700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a580b15e0 0x7f1a58145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:38.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a5db1f700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 0x7f1a58146e90 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f1a580ae370 tx=0x7f1a48007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:38.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a477fe700 1 -- 172.21.15.12:0/269935249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a480070d0 con 0x7f1a580b29c0 2021-10-20T23:28:38.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a477fe700 1 -- 172.21.15.12:0/269935249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a48007230 con 0x7f1a580b29c0 2021-10-20T23:28:38.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a581417c0 con 0x7f1a580b29c0 2021-10-20T23:28:38.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a477fe700 1 -- 172.21.15.12:0/269935249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a48005610 con 0x7f1a580b29c0 2021-10-20T23:28:38.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a58146910 con 0x7f1a580b29c0 2021-10-20T23:28:38.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a477fe700 1 -- 172.21.15.12:0/269935249 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a48010070 con 0x7f1a580b29c0 2021-10-20T23:28:38.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a477fe700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a380536a0 0x7f1a38055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a477fe700 1 -- 172.21.15.12:0/269935249 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f1a4806add0 con 0x7f1a580b29c0 2021-10-20T23:28:38.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a5e320700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a380536a0 0x7f1a38055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.152+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a58146bd0 con 0x7f1a580b29c0 2021-10-20T23:28:38.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.156+0000 7f1a5e320700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a380536a0 0x7f1a38055b60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f1a5401c000 tx=0x7f1a54015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.160+0000 7f1a477fe700 1 -- 172.21.15.12:0/269935249 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a58146bd0 con 0x7f1a580b29c0 2021-10-20T23:28:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.288+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1a58146bd0 con 0x7f1a580b29c0 2021-10-20T23:28:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a477fe700 1 -- 172.21.15.12:0/269935249 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1a58146bd0 con 0x7f1a580b29c0 2021-10-20T23:28:38.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a380536a0 msgr2=0x7f1a38055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a380536a0 0x7f1a38055b60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f1a5401c000 tx=0x7f1a54015000).stop 2021-10-20T23:28:38.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 msgr2=0x7f1a58146e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 0x7f1a58146e90 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f1a580ae370 tx=0x7f1a48007c10).stop 2021-10-20T23:28:38.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 shutdown_connections 2021-10-20T23:28:38.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a380536a0 0x7f1a38055b60 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a580b56c0 0x7f1a58147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a580b29c0 0x7f1a58146e90 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 --2- 172.21.15.12:0/269935249 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a580b15e0 0x7f1a58145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 >> 172.21.15.12:0/269935249 conn(0x7f1a5806a110 msgr2=0x7f1a580af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:38.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 shutdown_connections 2021-10-20T23:28:38.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.300+0000 7f1a60584700 1 -- 172.21.15.12:0/269935249 wait complete. 2021-10-20T23:28:38.327 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:28:38.327 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:38.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:38.367 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:38.389 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:38.411 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:28:38.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:38.412 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:38.413 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:38.440 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:28:38.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:28:38.442 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:28:38.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:38.443 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:38.443 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:38.451 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:28:38.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:28:38.453 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:38.453 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:28:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 Processor -- start 2021-10-20T23:28:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 -- start start 2021-10-20T23:28:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f877c1483a0 0x7f877c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f877c0a70c0 0x7f877c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c0b0350 con 0x7f877c0b1db0 2021-10-20T23:28:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877c0a90c0 con 0x7f877c0a70c0 2021-10-20T23:28:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877c0b05f0 con 0x7f877c1483a0 2021-10-20T23:28:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f877b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f877c0a70c0 0x7f877c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f877a7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f877c1483a0 0x7f877c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f877affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f877c0b1db0 0x7f877c0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:49942/0 (socket says 172.21.15.12:49942) 2021-10-20T23:28:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f877affd700 1 -- 172.21.15.12:0/1324929357 learned_addr learned my addr 172.21.15.12:0/1324929357 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f877b7fe700 1 -- 172.21.15.12:0/1324929357 >> v2:172.21.15.31:3300/0 conn(0x7f877c1483a0 msgr2=0x7f877c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f877b7fe700 1 --2- 172.21.15.12:0/1324929357 >> v2:172.21.15.31:3300/0 conn(0x7f877c1483a0 0x7f877c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f877b7fe700 1 -- 172.21.15.12:0/1324929357 >> v1:172.21.15.31:6789/0 conn(0x7f877c0b1db0 legacy=0x7f877c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f877b7fe700 1 -- 172.21.15.12:0/1324929357 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c0b0890 con 0x7f877c0a70c0 2021-10-20T23:28:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f877b7fe700 1 --2- 172.21.15.12:0/1324929357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c0a70c0 0x7f877c144720 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f877c147730 tx=0x7f876c006df0).ready entity=mon.0 client_cookie=3e5ffef627389a09 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f8779ffb700 1 -- 172.21.15.12:0/1324929357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f876c00d5c0 con 0x7f877c0a70c0 2021-10-20T23:28:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f8779ffb700 1 -- 172.21.15.12:0/1324929357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c000e90 con 0x7f877c0a70c0 2021-10-20T23:28:38.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f8779ffb700 1 -- 172.21.15.12:0/1324929357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f876c00d910 con 0x7f877c0a70c0 2021-10-20T23:28:38.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 -- 172.21.15.12:0/1324929357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c0a70c0 msgr2=0x7f877c144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 --2- 172.21.15.12:0/1324929357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c0a70c0 0x7f877c144720 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f877c147730 tx=0x7f876c006df0).stop 2021-10-20T23:28:38.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 -- 172.21.15.12:0/1324929357 shutdown_connections 2021-10-20T23:28:38.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 --2- 172.21.15.12:0/1324929357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c0a70c0 0x7f877c144720 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 --2- 172.21.15.12:0/1324929357 >> v2:172.21.15.31:3300/0 conn(0x7f877c1483a0 0x7f877c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 -- 172.21.15.12:0/1324929357 >> 172.21.15.12:0/1324929357 conn(0x7f877c05f6b0 msgr2=0x7f877c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:38.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.556+0000 7f87812df700 1 -- 172.21.15.12:0/1324929357 shutdown_connections 2021-10-20T23:28:38.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.560+0000 7f87812df700 1 -- 172.21.15.12:0/1324929357 wait complete. 2021-10-20T23:28:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.560+0000 7f87812df700 1 Processor -- start 2021-10-20T23:28:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.560+0000 7f87812df700 1 -- start start 2021-10-20T23:28:38.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f87812df700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877c0a70c0 0x7f877c0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f87812df700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f877c0b1db0 0x7f877c157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f87812df700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c1483a0 0x7f877c1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f87812df700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c1579e0 con 0x7f877c1483a0 2021-10-20T23:28:38.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f87812df700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c063980 con 0x7f877c0a70c0 2021-10-20T23:28:38.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f87812df700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c063c20 con 0x7f877c0b1db0 2021-10-20T23:28:38.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c1483a0 0x7f877c1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c1483a0 0x7f877c1574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44294/0 (socket says 172.21.15.12:44294) 2021-10-20T23:28:38.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877b7fe700 1 -- 172.21.15.12:0/221553080 learned_addr learned my addr 172.21.15.12:0/221553080 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877a7fc700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f877c0b1db0 0x7f877c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877affd700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877c0a70c0 0x7f877c0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877b7fe700 1 -- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f877c0b1db0 msgr2=0x7f877c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877b7fe700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f877c0b1db0 0x7f877c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877b7fe700 1 -- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877c0a70c0 msgr2=0x7f877c0af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877b7fe700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877c0a70c0 0x7f877c0af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877b7fe700 1 -- 172.21.15.12:0/221553080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c00b180 con 0x7f877c1483a0 2021-10-20T23:28:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f877b7fe700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c1483a0 0x7f877c1574f0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f877c147730 tx=0x7f876c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f8773fff700 1 -- 172.21.15.12:0/221553080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f876c016070 con 0x7f877c1483a0 2021-10-20T23:28:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f8773fff700 1 -- 172.21.15.12:0/221553080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c0137d0 con 0x7f877c1483a0 2021-10-20T23:28:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c063ec0 con 0x7f877c1483a0 2021-10-20T23:28:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f8773fff700 1 -- 172.21.15.12:0/221553080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f876c013b30 con 0x7f877c1483a0 2021-10-20T23:28:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.564+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c0aad20 con 0x7f877c1483a0 2021-10-20T23:28:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.568+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c0636f0 con 0x7f877c1483a0 2021-10-20T23:28:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.568+0000 7f8773fff700 1 -- 172.21.15.12:0/221553080 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f876c025030 con 0x7f877c1483a0 2021-10-20T23:28:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.568+0000 7f8773fff700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8760053640 0x7f8760055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.568+0000 7f8773fff700 1 -- 172.21.15.12:0/221553080 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f876c06c600 con 0x7f877c1483a0 2021-10-20T23:28:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.568+0000 7f877affd700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8760053640 0x7f8760055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.568+0000 7f877affd700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8760053640 0x7f8760055b00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f876400d000 tx=0x7f8764009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.576+0000 7f8773fff700 1 -- 172.21.15.12:0/221553080 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f876c0438e0 con 0x7f877c1483a0 2021-10-20T23:28:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.700+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f877c0b0b30 con 0x7f877c1483a0 2021-10-20T23:28:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.700+0000 7f8773fff700 1 -- 172.21.15.12:0/221553080 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f876c023020 con 0x7f877c1483a0 2021-10-20T23:28:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:38.713 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:28:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 137, 2021-10-20T23:28:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:28:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:28:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:28:35.979851+0000", 2021-10-20T23:28:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:28:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:28:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:28:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:28:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:28:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:28:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:28:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:28:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:28:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:28:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:28:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:28:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:28:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:28:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 24, 2021-10-20T23:28:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:28:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:28:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:28:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:28:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:28:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:28:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:28:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:28:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:28:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:28:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:28:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:28:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:28:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:28:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:28:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:28:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:28:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:28:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:28:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:28:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:28:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:28:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:28:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:28:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:28:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:28:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:28:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:28:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:28:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:28:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:28:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:28:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:28:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:28:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:28:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:28:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:28:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:28:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:28:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:28:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:28:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:28:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:28:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:28:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:28:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:28:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:28:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:28:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:28:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:28:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:28:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:28:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:28:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:28:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:28:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:28:38.790 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:38.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.790 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.790 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:28:38.791 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:38.791 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.791 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.792 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:28:38.792 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:28:38.792 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:28:38.792 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:28:38.792 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:38.793 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:38.793 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:38.793 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.794 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:28:38.794 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:28:38.794 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:38.794 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:38.795 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:38.795 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:38.795 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:38.795 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:38.795 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:38.796 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 127, 2021-10-20T23:28:38.796 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:38.796 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:38.796 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:38.797 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.797 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:28:38.798 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:38.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.798 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.798 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:28:38.799 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:38.799 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.799 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.800 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:38.800 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.800 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:28:38.801 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:38.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.801 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.801 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:28:38.802 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:38.802 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.802 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.803 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:38.803 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.803 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.803 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:28:38.804 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:38.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.804 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.804 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:28:38.805 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:38.805 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.805 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.806 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:38.806 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.806 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.806 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:28:38.807 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:38.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.807 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:28:38.808 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:38.808 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.808 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.809 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:28:38.809 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:28:38.809 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:28:38.809 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:28:38.809 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:38.810 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:38.810 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:38.810 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:28:38.811 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:28:38.811 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:38.811 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:38.812 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:38.812 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:38.812 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:38.812 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:38.812 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:38.813 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:38.813 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:38.813 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:38.813 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:38.814 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.814 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.815 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:28:38.815 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:38.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.816 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:28:38.816 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:38.816 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.816 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.817 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:38.817 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.818 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:28:38.818 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:38.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.819 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:28:38.819 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:38.819 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.819 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.820 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:38.820 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.820 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.820 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:28:38.821 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:38.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.822 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:28:38.822 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:38.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.822 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.823 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:38.823 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.823 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.824 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:28:38.824 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:38.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.825 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:28:38.825 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:38.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.825 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.826 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:28:38.826 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:28:38.826 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:28:38.826 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:28:38.826 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:38.827 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:38.827 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:38.827 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.828 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:28:38.828 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:28:38.828 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:38.829 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:38.829 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:38.829 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:38.829 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:38.830 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:38.830 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:38.830 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 127, 2021-10-20T23:28:38.831 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:38.831 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:38.831 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:38.831 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.832 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.832 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:28:38.832 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:38.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.833 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:28:38.833 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:38.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.834 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.834 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:38.835 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.836 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:28:38.836 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:38.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.837 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:28:38.837 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:38.837 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.837 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.838 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:38.838 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.838 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.839 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:28:38.839 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:38.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.840 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.840 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:28:38.840 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:38.840 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.840 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.841 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:38.841 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.842 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:28:38.842 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:38.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.843 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:28:38.843 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:38.843 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.844 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.844 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:28:38.845 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:28:38.845 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:28:38.845 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:28:38.845 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:38.845 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:38.846 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:38.846 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.847 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:28:38.847 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:28:38.847 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:38.847 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:38.847 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:38.848 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:38.848 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:38.848 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:38.848 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:38.849 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:38.849 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:38.849 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:38.849 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:38.849 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.850 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.850 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:28:38.850 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:38.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.851 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:28:38.852 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:38.852 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.852 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.853 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:38.853 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.853 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.854 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:28:38.854 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:38.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.855 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:28:38.855 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:38.855 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.855 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.856 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:38.856 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.857 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:28:38.857 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:38.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.858 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:28:38.858 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:38.858 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.859 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.859 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:38.859 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.860 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:28:38.860 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:38.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.861 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:28:38.861 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:38.861 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.862 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.862 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:28:38.862 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:28:38.863 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:28:38.863 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:28:38.863 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:38.863 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:38.864 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:38.864 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.864 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:28:38.865 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:28:38.865 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:38.865 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:38.865 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:38.866 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:38.866 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:38.866 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:38.866 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:38.866 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:38.867 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:38.867 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:38.867 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:38.868 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.868 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:28:38.868 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:38.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.869 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:28:38.870 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:38.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.870 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.870 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:38.871 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.871 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:28:38.872 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:38.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.873 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:28:38.873 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:38.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.873 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.874 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:38.874 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:28:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:28:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.878 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:28:38.878 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:38.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.879 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:28:38.879 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:38.879 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.879 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.880 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:28:38.880 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:28:38.880 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:28:38.881 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:28:38.881 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:38.881 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:38.881 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:38.881 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.882 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:28:38.882 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:28:38.883 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:38.883 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:38.883 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:38.883 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:38.883 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:38.884 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:38.884 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:38.884 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 133, 2021-10-20T23:28:38.884 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:38.885 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:38.885 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:38.885 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.886 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:28:38.886 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:38.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.887 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:28:38.887 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:38.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.887 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.888 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:38.888 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.889 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:28:38.889 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:38.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.890 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:28:38.890 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:38.890 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.890 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.891 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:38.891 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.892 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.892 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:28:38.892 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:38.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.893 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:28:38.893 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:38.893 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.894 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.894 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:38.894 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:38.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:38.895 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:28:38.895 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:38.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:38.896 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:28:38.896 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:38.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.897 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.897 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:28:38.898 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:28:38.898 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:28:38.898 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:28:38.898 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:38.899 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:38.899 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:38.899 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:38.899 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.899 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:38.900 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:28:38.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.900 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:28:38.900 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:38.901 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:38.901 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:38.901 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:38.901 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:38.901 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:28:38.902 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:38.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.902 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:28:38.903 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:38.903 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:38.903 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:38.903 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:38.903 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:38.904 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:28:38.904 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:38.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.905 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:28:38.905 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:38.905 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:38.905 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:38.905 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:38.906 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:38.906 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:28:38.906 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:38.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.907 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:28:38.907 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:38.907 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:38.908 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:38.908 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:38.908 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:38.908 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:28:38.908 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:38.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.909 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:28:38.909 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:38.910 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:38.910 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:38.910 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:38.910 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:38.910 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:28:38.911 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:38.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.911 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:28:38.912 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:38.912 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:38.912 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:38.912 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:38.913 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:38.913 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:28:38.913 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:38.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.914 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:28:38.914 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:38.915 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:38.915 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:38.915 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:38.915 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:38.915 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:28:38.916 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:38.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:38.916 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:28:38.917 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:38.917 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:38.917 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:38.917 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:38.918 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:38.918 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:28:38.919 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:38.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.919 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:38.919 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:28:38.919 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:28:38.920 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:28:38.920 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:28:38.920 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:28:38.920 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6835/1094154714": "2021-10-21T23:28:15.336080+0000", 2021-10-20T23:28:38.921 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6834/1094154714": "2021-10-21T23:28:15.336080+0000" 2021-10-20T23:28:38.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.921 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:28:38.921 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:28:38.921 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:28:38.922 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:28:38.922 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:28:38.922 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:28:38.922 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:28:38.923 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:28:38.923 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:28:38.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:28:38.923 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:28:38.923 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:28:38.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.924 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:28:38.924 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:28:38.924 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:28:38.925 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:28:38.925 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:28:38.925 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:28:38.925 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:28:38.925 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:38.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:38.926 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:28:38.926 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:28:38.926 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:28:38.927 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:28:38.927 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:28:38.927 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:28:38.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8760053640 msgr2=0x7f8760055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8760053640 0x7f8760055b00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f876400d000 tx=0x7f8764009040).stop 2021-10-20T23:28:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c1483a0 msgr2=0x7f877c1574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c1483a0 0x7f877c1574f0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f877c147730 tx=0x7f876c014000).stop 2021-10-20T23:28:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 shutdown_connections 2021-10-20T23:28:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8760053640 0x7f8760055b00 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f877c1483a0 0x7f877c1574f0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f877c0b1db0 0x7f877c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 --2- 172.21.15.12:0/221553080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877c0a70c0 0x7f877c0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 >> 172.21.15.12:0/221553080 conn(0x7f877c05f6b0 msgr2=0x7f877c143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 shutdown_connections 2021-10-20T23:28:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:38.704+0000 7f87812df700 1 -- 172.21.15.12:0/221553080 wait complete. 2021-10-20T23:28:38.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:39.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 Processor -- start 2021-10-20T23:28:39.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 -- start start 2021-10-20T23:28:39.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9d2c0b04a0 0x7f9d2c0add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c0b2af0 con 0x7f9d2c0b0880 2021-10-20T23:28:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2c0b2770 con 0x7f9d2c0b04a0 2021-10-20T23:28:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0b2d20 con 0x7f9d2c0aa120 2021-10-20T23:28:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d30f82700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9d2c0b04a0 0x7f9d2c0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d31783700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9d2c0b0880 0x7f9d2c143710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42896/0 (socket says 172.21.15.12:42896) 2021-10-20T23:28:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d2bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d30f82700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9d2c0b04a0 0x7f9d2c0add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44298/0 (socket says 172.21.15.12:44298) 2021-10-20T23:28:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d31783700 1 -- 172.21.15.12:0/2601307810 learned_addr learned my addr 172.21.15.12:0/2601307810 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:39.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d2bfff700 1 -- 172.21.15.12:0/2601307810 >> v2:172.21.15.12:3300/0 conn(0x7f9d2c0b04a0 msgr2=0x7f9d2c0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:39.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d2bfff700 1 --2- 172.21.15.12:0/2601307810 >> v2:172.21.15.12:3300/0 conn(0x7f9d2c0b04a0 0x7f9d2c0add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d2bfff700 1 -- 172.21.15.12:0/2601307810 >> v1:172.21.15.12:6789/0 conn(0x7f9d2c0b0880 legacy=0x7f9d2c143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d2bfff700 1 -- 172.21.15.12:0/2601307810 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c0a9b70 con 0x7f9d2c0aa120 2021-10-20T23:28:39.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d2bfff700 1 --2- 172.21.15.12:0/2601307810 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0ae220 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f9d240032f0 tx=0x7f9d2400b470).ready entity=mon.2 client_cookie=3718f6a9b37106f5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:39.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d2b7fe700 1 -- 172.21.15.12:0/2601307810 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d2400dd70 con 0x7f9d2c0aa120 2021-10-20T23:28:39.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d2b7fe700 1 -- 172.21.15.12:0/2601307810 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24010470 con 0x7f9d2c0aa120 2021-10-20T23:28:39.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d2b7fe700 1 -- 172.21.15.12:0/2601307810 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d240107d0 con 0x7f9d2c0aa120 2021-10-20T23:28:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 -- 172.21.15.12:0/2601307810 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 msgr2=0x7f9d2c0ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 --2- 172.21.15.12:0/2601307810 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0ae220 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f9d240032f0 tx=0x7f9d2400b470).stop 2021-10-20T23:28:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 -- 172.21.15.12:0/2601307810 shutdown_connections 2021-10-20T23:28:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 --2- 172.21.15.12:0/2601307810 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0ae220 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 --2- 172.21.15.12:0/2601307810 >> v2:172.21.15.12:3300/0 conn(0x7f9d2c0b04a0 0x7f9d2c0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 -- 172.21.15.12:0/2601307810 >> 172.21.15.12:0/2601307810 conn(0x7f9d2c0607c0 msgr2=0x7f9d2c060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 -- 172.21.15.12:0/2601307810 shutdown_connections 2021-10-20T23:28:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.032+0000 7f9d331e6700 1 -- 172.21.15.12:0/2601307810 wait complete. 2021-10-20T23:28:39.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d331e6700 1 Processor -- start 2021-10-20T23:28:39.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d331e6700 1 -- start start 2021-10-20T23:28:39.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d331e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d331e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0b04a0 0x7f9d2c05f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d331e6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2c0b0880 0x7f9d2c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d331e6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c060150 con 0x7f9d2c0b0880 2021-10-20T23:28:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d331e6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0a34e0 con 0x7f9d2c0b04a0 2021-10-20T23:28:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d331e6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0677b0 con 0x7f9d2c0aa120 2021-10-20T23:28:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d31783700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2c0b0880 0x7f9d2c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d31783700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2c0b0880 0x7f9d2c155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44308/0 (socket says 172.21.15.12:44308) 2021-10-20T23:28:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d31783700 1 -- 172.21.15.12:0/4039599254 learned_addr learned my addr 172.21.15.12:0/4039599254 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d30f82700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d2bfff700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0b04a0 0x7f9d2c05f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d31783700 1 -- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 msgr2=0x7f9d2c0672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d31783700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d31783700 1 -- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0b04a0 msgr2=0x7f9d2c05f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d31783700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0b04a0 0x7f9d2c05f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d31783700 1 -- 172.21.15.12:0/4039599254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2400b710 con 0x7f9d2c0b0880 2021-10-20T23:28:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d30f82700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d31783700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2c0b0880 0x7f9d2c155e70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f9d2c067940 tx=0x7f9d1c007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d29ffb700 1 -- 172.21.15.12:0/4039599254 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d1c001d70 con 0x7f9d2c0b0880 2021-10-20T23:28:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.036+0000 7f9d29ffb700 1 -- 172.21.15.12:0/4039599254 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0070d0 con 0x7f9d2c0b0880 2021-10-20T23:28:39.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.040+0000 7f9d29ffb700 1 -- 172.21.15.12:0/4039599254 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d1c007430 con 0x7f9d2c0b0880 2021-10-20T23:28:39.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.040+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c0a3240 con 0x7f9d2c0b0880 2021-10-20T23:28:39.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.040+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c05fd40 con 0x7f9d2c0b0880 2021-10-20T23:28:39.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.040+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c057350 con 0x7f9d2c0b0880 2021-10-20T23:28:39.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.040+0000 7f9d29ffb700 1 -- 172.21.15.12:0/4039599254 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9d1c010070 con 0x7f9d2c0b0880 2021-10-20T23:28:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.040+0000 7f9d29ffb700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9d10053580 0x7f9d10055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.040+0000 7f9d29ffb700 1 -- 172.21.15.12:0/4039599254 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f9d1c06ad10 con 0x7f9d2c0b0880 2021-10-20T23:28:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.040+0000 7f9d30f82700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9d10053580 0x7f9d10055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.040+0000 7f9d30f82700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9d10053580 0x7f9d10055a40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f9d1400b000 tx=0x7f9d14006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.044+0000 7f9d29ffb700 1 -- 172.21.15.12:0/4039599254 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d1c041ff0 con 0x7f9d2c0b0880 2021-10-20T23:28:39.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d2c0b3730 con 0x7f9d2c0b0880 2021-10-20T23:28:39.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d29ffb700 1 -- 172.21.15.12:0/4039599254 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+504 (secure 0 0 0) 0x7f9d1c045610 con 0x7f9d2c0b0880 2021-10-20T23:28:39.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:39.224 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-10-20T23:28:39.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9d10053580 msgr2=0x7f9d10055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9d10053580 0x7f9d10055a40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f9d1400b000 tx=0x7f9d14006df0).stop 2021-10-20T23:28:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2c0b0880 msgr2=0x7f9d2c155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2c0b0880 0x7f9d2c155e70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f9d2c067940 tx=0x7f9d1c007c30).stop 2021-10-20T23:28:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 shutdown_connections 2021-10-20T23:28:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9d10053580 0x7f9d10055a40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2c0b0880 0x7f9d2c155e70 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0b04a0 0x7f9d2c05f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 --2- 172.21.15.12:0/4039599254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c0aa120 0x7f9d2c0672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 >> 172.21.15.12:0/4039599254 conn(0x7f9d2c0607c0 msgr2=0x7f9d2c0b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 shutdown_connections 2021-10-20T23:28:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.212+0000 7f9d331e6700 1 -- 172.21.15.12:0/4039599254 wait complete. 2021-10-20T23:28:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 68 2021-10-20T23:28:39.237 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:39.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb639e4e700 1 Processor -- start 2021-10-20T23:28:39.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb639e4e700 1 -- start start 2021-10-20T23:28:39.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb639e4e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6340b3550 0x7fb634067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb639e4e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb634144ce0 0x7fb634141130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb639e4e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb634066500 con 0x7fb634064980 2021-10-20T23:28:39.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb639e4e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6340b3ea0 con 0x7fb6340b3550 2021-10-20T23:28:39.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb639e4e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb634140d40 con 0x7fb634144ce0 2021-10-20T23:28:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb633fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6340b3550 0x7fb634067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb633fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6340b3550 0x7fb634067110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44312/0 (socket says 172.21.15.12:44312) 2021-10-20T23:28:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb633fff700 1 -- 172.21.15.12:0/847423280 learned_addr learned my addr 172.21.15.12:0/847423280 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb63964d700 1 --2- 172.21.15.12:0/847423280 >> v2:172.21.15.31:3300/0 conn(0x7fb634144ce0 0x7fb634141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb633fff700 1 -- 172.21.15.12:0/847423280 >> v2:172.21.15.31:3300/0 conn(0x7fb634144ce0 msgr2=0x7fb634141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb633fff700 1 --2- 172.21.15.12:0/847423280 >> v2:172.21.15.31:3300/0 conn(0x7fb634144ce0 0x7fb634141130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb633fff700 1 -- 172.21.15.12:0/847423280 >> v1:172.21.15.31:6789/0 conn(0x7fb634064980 legacy=0x7fb634066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.332+0000 7fb633fff700 1 -- 172.21.15.12:0/847423280 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340b46c0 con 0x7fb6340b3550 2021-10-20T23:28:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb633fff700 1 --2- 172.21.15.12:0/847423280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6340b3550 0x7fb634067110 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fb6340b7310 tx=0x7fb624006eb0).ready entity=mon.0 client_cookie=38664c9c26c6f7e4 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:39.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb6337fe700 1 -- 172.21.15.12:0/847423280 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb62400d5c0 con 0x7fb6340b3550 2021-10-20T23:28:39.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb6337fe700 1 -- 172.21.15.12:0/847423280 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb624000e90 con 0x7fb6340b3550 2021-10-20T23:28:39.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb6337fe700 1 -- 172.21.15.12:0/847423280 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb62400d910 con 0x7fb6340b3550 2021-10-20T23:28:39.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb639e4e700 1 -- 172.21.15.12:0/847423280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6340b3550 msgr2=0x7fb634067110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb639e4e700 1 --2- 172.21.15.12:0/847423280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6340b3550 0x7fb634067110 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fb6340b7310 tx=0x7fb624006eb0).stop 2021-10-20T23:28:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb639e4e700 1 -- 172.21.15.12:0/847423280 shutdown_connections 2021-10-20T23:28:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb639e4e700 1 --2- 172.21.15.12:0/847423280 >> v2:172.21.15.31:3300/0 conn(0x7fb634144ce0 0x7fb634141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb639e4e700 1 --2- 172.21.15.12:0/847423280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6340b3550 0x7fb634067110 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb639e4e700 1 -- 172.21.15.12:0/847423280 >> 172.21.15.12:0/847423280 conn(0x7fb63405f6b0 msgr2=0x7fb63405fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb639e4e700 1 -- 172.21.15.12:0/847423280 shutdown_connections 2021-10-20T23:28:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.336+0000 7fb639e4e700 1 -- 172.21.15.12:0/847423280 wait complete. 2021-10-20T23:28:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 Processor -- start 2021-10-20T23:28:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 -- start start 2021-10-20T23:28:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb634064980 0x7fb634141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6340b3550 0x7fb6340ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb634144ce0 0x7fb6340ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6340ae300 con 0x7fb634064980 2021-10-20T23:28:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6340ae060 con 0x7fb634144ce0 2021-10-20T23:28:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb634154200 con 0x7fb6340b3550 2021-10-20T23:28:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb638e4c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb634064980 0x7fb634141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb638e4c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb634064980 0x7fb634141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44318/0 (socket says 172.21.15.12:44318) 2021-10-20T23:28:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb638e4c700 1 -- 172.21.15.12:0/1305145503 learned_addr learned my addr 172.21.15.12:0/1305145503 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb63964d700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb634144ce0 0x7fb6340ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb633fff700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6340b3550 0x7fb6340ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb638e4c700 1 -- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6340b3550 msgr2=0x7fb6340ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb638e4c700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6340b3550 0x7fb6340ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb638e4c700 1 -- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb634144ce0 msgr2=0x7fb6340ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb638e4c700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb634144ce0 0x7fb6340ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb638e4c700 1 -- 172.21.15.12:0/1305145503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62400b1e0 con 0x7fb634064980 2021-10-20T23:28:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb638e4c700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb634064980 0x7fb634141390 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fb628001fa0 tx=0x7fb628007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb631ffb700 1 -- 172.21.15.12:0/1305145503 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb62800ce80 con 0x7fb634064980 2021-10-20T23:28:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb631ffb700 1 -- 172.21.15.12:0/1305145503 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628007240 con 0x7fb634064980 2021-10-20T23:28:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6341544a0 con 0x7fb634064980 2021-10-20T23:28:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb631ffb700 1 -- 172.21.15.12:0/1305145503 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb628006510 con 0x7fb634064980 2021-10-20T23:28:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.340+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63413d9b0 con 0x7fb634064980 2021-10-20T23:28:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.344+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb634057350 con 0x7fb634064980 2021-10-20T23:28:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.344+0000 7fb631ffb700 1 -- 172.21.15.12:0/1305145503 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb628010030 con 0x7fb634064980 2021-10-20T23:28:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.344+0000 7fb631ffb700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6140536d0 0x7fb614055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.344+0000 7fb631ffb700 1 -- 172.21.15.12:0/1305145503 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb62806b640 con 0x7fb634064980 2021-10-20T23:28:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.344+0000 7fb633fff700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6140536d0 0x7fb614055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.344+0000 7fb633fff700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6140536d0 0x7fb614055b90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fb62401a000 tx=0x7fb624015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.352+0000 7fb631ffb700 1 -- 172.21.15.12:0/1305145503 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb628042810 con 0x7fb634064980 2021-10-20T23:28:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.512+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb634069c00 con 0x7fb634064980 2021-10-20T23:28:39.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb631ffb700 1 -- 172.21.15.12:0/1305145503 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+504 (secure 0 0 0) 0x7fb628045e30 con 0x7fb634064980 2021-10-20T23:28:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:39.528 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-10-20T23:28:39.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6140536d0 msgr2=0x7fb614055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6140536d0 0x7fb614055b90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fb62401a000 tx=0x7fb624015000).stop 2021-10-20T23:28:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb634064980 msgr2=0x7fb634141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb634064980 0x7fb634141390 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fb628001fa0 tx=0x7fb628007c30).stop 2021-10-20T23:28:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 shutdown_connections 2021-10-20T23:28:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6140536d0 0x7fb614055b90 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb634144ce0 0x7fb6340ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6340b3550 0x7fb6340ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 --2- 172.21.15.12:0/1305145503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb634064980 0x7fb634141390 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 >> 172.21.15.12:0/1305145503 conn(0x7fb63405f6b0 msgr2=0x7fb6340b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 shutdown_connections 2021-10-20T23:28:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.516+0000 7fb639e4e700 1 -- 172.21.15.12:0/1305145503 wait complete. 2021-10-20T23:28:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 68 2021-10-20T23:28:39.542 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:28:39.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:28:39.543 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:28:39.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:28:39.544 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:28:39.544 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:28:39.547 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:28:39.547 DEBUG:teuthology.parallel:result is None 2021-10-20T23:28:39.549 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:28:39.549 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:28:39.550 DEBUG:teuthology.parallel:result is None 2021-10-20T23:28:39.550 DEBUG:teuthology.parallel:result is None 2021-10-20T23:28:39.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:28:39.621 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:28:39.625 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:28:39.643 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:28:39.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 Processor -- start 2021-10-20T23:28:39.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 -- start start 2021-10-20T23:28:39.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fa8061700 0x7f8fa8146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa80aecf0 con 0x7f8fa80ad5c0 2021-10-20T23:28:39.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa80b6f20 con 0x7f8fa8061320 2021-10-20T23:28:39.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa80aef20 con 0x7f8fa8061700 2021-10-20T23:28:39.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fa8061700 0x7f8fa8146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fa8061700 0x7f8fa8146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44354/0 (socket says 172.21.15.12:44354) 2021-10-20T23:28:39.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa77fe700 1 -- 172.21.15.12:0/1414473855 learned_addr learned my addr 172.21.15.12:0/1414473855 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:39.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa67fc700 1 --1- 172.21.15.12:0/1414473855 >> v1:172.21.15.12:6789/0 conn(0x7f8fa80ad5c0 0x7f8fa8140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42946/0 (socket says 172.21.15.12:42946) 2021-10-20T23:28:39.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa77fe700 1 -- 172.21.15.12:0/1414473855 >> v1:172.21.15.31:6789/0 conn(0x7f8fa8061320 legacy=0x7f8fa80b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa77fe700 1 -- 172.21.15.12:0/1414473855 >> v1:172.21.15.12:6789/0 conn(0x7f8fa80ad5c0 legacy=0x7f8fa8140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa77fe700 1 -- 172.21.15.12:0/1414473855 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80af1c0 con 0x7f8fa8061700 2021-10-20T23:28:39.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa77fe700 1 --2- 172.21.15.12:0/1414473855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 0x7f8fa8146520 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f8fa00032f0 tx=0x7f8fa0009290).ready entity=mon.0 client_cookie=ca5a75f9c88826ac server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:39.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa5ffb700 1 -- 172.21.15.12:0/1414473855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa000b8a0 con 0x7f8fa8061700 2021-10-20T23:28:39.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa5ffb700 1 -- 172.21.15.12:0/1414473855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa000ba00 con 0x7f8fa8061700 2021-10-20T23:28:39.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa5ffb700 1 -- 172.21.15.12:0/1414473855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa000bb70 con 0x7f8fa8061700 2021-10-20T23:28:39.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1414473855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 msgr2=0x7f8fa8146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 --2- 172.21.15.12:0/1414473855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 0x7f8fa8146520 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f8fa00032f0 tx=0x7f8fa0009290).stop 2021-10-20T23:28:39.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1414473855 shutdown_connections 2021-10-20T23:28:39.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 --2- 172.21.15.12:0/1414473855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 0x7f8fa8146520 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1414473855 >> 172.21.15.12:0/1414473855 conn(0x7f8fa8066de0 msgr2=0x7f8fa80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:39.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1414473855 shutdown_connections 2021-10-20T23:28:39.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.660+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1414473855 wait complete. 2021-10-20T23:28:39.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa7fff700 1 Processor -- start 2021-10-20T23:28:39.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa7fff700 1 -- start start 2021-10-20T23:28:39.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fa8061320 0x7f8fa809ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 0x7f8fa8152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fa80ad5c0 0x7f8fa8153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8146910 con 0x7f8fa8061700 2021-10-20T23:28:39.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8146cb0 con 0x7f8fa80ad5c0 2021-10-20T23:28:39.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80accb0 con 0x7f8fa8061320 2021-10-20T23:28:39.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 0x7f8fa8152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.664+0000 7f8fa67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 0x7f8fa8152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44358/0 (socket says 172.21.15.12:44358) 2021-10-20T23:28:39.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa67fc700 1 -- 172.21.15.12:0/1357353915 learned_addr learned my addr 172.21.15.12:0/1357353915 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:39.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa6ffd700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fa8061320 0x7f8fa809ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa77fe700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fa80ad5c0 0x7f8fa8153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa67fc700 1 -- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fa8061320 msgr2=0x7f8fa809ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa67fc700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fa8061320 0x7f8fa809ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa67fc700 1 -- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fa80ad5c0 msgr2=0x7f8fa8153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:39.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa67fc700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fa80ad5c0 0x7f8fa8153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:39.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa67fc700 1 -- 172.21.15.12:0/1357353915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0009530 con 0x7f8fa8061700 2021-10-20T23:28:39.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa67fc700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 0x7f8fa8152b60 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f8fa80ae120 tx=0x7f8f9c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:39.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8f97fff700 1 -- 172.21.15.12:0/1357353915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f9c0070d0 con 0x7f8fa8061700 2021-10-20T23:28:39.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8f97fff700 1 -- 172.21.15.12:0/1357353915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c007230 con 0x7f8fa8061700 2021-10-20T23:28:39.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8f97fff700 1 -- 172.21.15.12:0/1357353915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f9c005550 con 0x7f8fa8061700 2021-10-20T23:28:39.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa80aca10 con 0x7f8fa8061700 2021-10-20T23:28:39.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa80a22b0 con 0x7f8fa8061700 2021-10-20T23:28:39.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa80af460 con 0x7f8fa8061700 2021-10-20T23:28:39.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.668+0000 7f8f97fff700 1 -- 172.21.15.12:0/1357353915 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8f9c010070 con 0x7f8fa8061700 2021-10-20T23:28:39.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.672+0000 7f8f97fff700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f840536a0 0x7f8f84055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:39.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.672+0000 7f8f97fff700 1 -- 172.21.15.12:0/1357353915 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f8f9c06ac80 con 0x7f8fa8061700 2021-10-20T23:28:39.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.672+0000 7f8fa6ffd700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f840536a0 0x7f8f84055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:39.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.672+0000 7f8fa6ffd700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f840536a0 0x7f8f84055b60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f8f9800d000 tx=0x7f8f98007b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:39.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.676+0000 7f8f97fff700 1 -- 172.21.15.12:0/1357353915 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f9c041f60 con 0x7f8fa8061700 2021-10-20T23:28:39.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:39.812+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f8fa8057350 con 0x7f8fa8061700 2021-10-20T23:28:40.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.628+0000 7f8f97fff700 1 -- 172.21.15.12:0/1357353915 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v138) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8f9c018070 con 0x7f8fa8061700 2021-10-20T23:28:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f840536a0 msgr2=0x7f8f84055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f840536a0 0x7f8f84055b60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f8f9800d000 tx=0x7f8f98007b50).stop 2021-10-20T23:28:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 msgr2=0x7f8fa8152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 0x7f8fa8152b60 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f8fa80ae120 tx=0x7f8f9c007c10).stop 2021-10-20T23:28:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 shutdown_connections 2021-10-20T23:28:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8f840536a0 0x7f8f84055b60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fa80ad5c0 0x7f8fa8153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa8061700 0x7f8fa8152b60 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 --2- 172.21.15.12:0/1357353915 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fa8061320 0x7f8fa809ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 >> 172.21.15.12:0/1357353915 conn(0x7f8fa8066de0 msgr2=0x7f8fa80b8520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 shutdown_connections 2021-10-20T23:28:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.632+0000 7f8fa7fff700 1 -- 172.21.15.12:0/1357353915 wait complete. 2021-10-20T23:28:40.649 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:28:40.661 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:28:40.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:28:40.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcbce80700 1 Processor -- start 2021-10-20T23:28:40.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcbce80700 1 -- start start 2021-10-20T23:28:40.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcbce80700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbcb80b65c0 0x7fbcb80b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:40.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcbce80700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcb8060d70 0x7fbcb81450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:40.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcbce80700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80ac5f0 0x7fbcb8141000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:40.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcbce80700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb80aca80 con 0x7fbcb8060d70 2021-10-20T23:28:40.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcbce80700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb80acc90 con 0x7fbcb80b65c0 2021-10-20T23:28:40.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcbce80700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80ae560 con 0x7fbcb80ac5f0 2021-10-20T23:28:40.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcb8060d70 0x7fbcb81450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:40.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcb8060d70 0x7fbcb81450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44364/0 (socket says 172.21.15.12:44364) 2021-10-20T23:28:40.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb5d9b700 1 -- 172.21.15.12:0/3327145338 learned_addr learned my addr 172.21.15.12:0/3327145338 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb659c700 1 --2- 172.21.15.12:0/3327145338 >> v2:172.21.15.31:3300/0 conn(0x7fbcb80b65c0 0x7fbcb80b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb6d9d700 1 --2- 172.21.15.12:0/3327145338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80ac5f0 0x7fbcb8141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb659c700 1 -- 172.21.15.12:0/3327145338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80ac5f0 msgr2=0x7fbcb8141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb659c700 1 --2- 172.21.15.12:0/3327145338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80ac5f0 0x7fbcb8141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb659c700 1 -- 172.21.15.12:0/3327145338 >> v2:172.21.15.12:3300/0 conn(0x7fbcb8060d70 msgr2=0x7fbcb81450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:40.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb659c700 1 --2- 172.21.15.12:0/3327145338 >> v2:172.21.15.12:3300/0 conn(0x7fbcb8060d70 0x7fbcb81450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb659c700 1 -- 172.21.15.12:0/3327145338 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb81446e0 con 0x7fbcb80b65c0 2021-10-20T23:28:40.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb5d9b700 1 --2- 172.21.15.12:0/3327145338 >> v2:172.21.15.12:3300/0 conn(0x7fbcb8060d70 0x7fbcb81450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:40.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb659c700 1 --2- 172.21.15.12:0/3327145338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcb80b65c0 0x7fbcb80b69a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fbcb00032f0 tx=0x7fbcb00091d0).ready entity=mon.1 client_cookie=e17f5e86dc33dfd1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:40.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb559a700 1 -- 172.21.15.12:0/3327145338 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcb000b600 con 0x7fbcb80b65c0 2021-10-20T23:28:40.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb559a700 1 -- 172.21.15.12:0/3327145338 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb000b760 con 0x7fbcb80b65c0 2021-10-20T23:28:40.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.760+0000 7fbcb559a700 1 -- 172.21.15.12:0/3327145338 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcb000b8d0 con 0x7fbcb80b65c0 2021-10-20T23:28:40.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 -- 172.21.15.12:0/3327145338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcb80b65c0 msgr2=0x7fbcb80b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:40.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 --2- 172.21.15.12:0/3327145338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcb80b65c0 0x7fbcb80b69a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fbcb00032f0 tx=0x7fbcb00091d0).stop 2021-10-20T23:28:40.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 -- 172.21.15.12:0/3327145338 shutdown_connections 2021-10-20T23:28:40.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 --2- 172.21.15.12:0/3327145338 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80ac5f0 0x7fbcb8141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 --2- 172.21.15.12:0/3327145338 >> v2:172.21.15.12:3300/0 conn(0x7fbcb8060d70 0x7fbcb81450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 --2- 172.21.15.12:0/3327145338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcb80b65c0 0x7fbcb80b69a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 -- 172.21.15.12:0/3327145338 >> 172.21.15.12:0/3327145338 conn(0x7fbcb80b3480 msgr2=0x7fbcb80b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:40.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 -- 172.21.15.12:0/3327145338 shutdown_connections 2021-10-20T23:28:40.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 -- 172.21.15.12:0/3327145338 wait complete. 2021-10-20T23:28:40.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 Processor -- start 2021-10-20T23:28:40.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 -- start start 2021-10-20T23:28:40.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcb8060d70 0x7fbcb8140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:40.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcb80ac5f0 0x7fbcb8063030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:40.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80b65c0 0x7fbcb813d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:40.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8063860 con 0x7fbcb8060d70 2021-10-20T23:28:40.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8064d40 con 0x7fbcb80ac5f0 2021-10-20T23:28:40.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcbce80700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8064fe0 con 0x7fbcb80b65c0 2021-10-20T23:28:40.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcb659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcb8060d70 0x7fbcb8140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:40.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcb659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcb8060d70 0x7fbcb8140f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44372/0 (socket says 172.21.15.12:44372) 2021-10-20T23:28:40.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcb659c700 1 -- 172.21.15.12:0/1760840981 learned_addr learned my addr 172.21.15.12:0/1760840981 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:40.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcb6d9d700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80b65c0 0x7fbcb813d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:40.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.764+0000 7fbcb5d9b700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcb80ac5f0 0x7fbcb8063030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:40.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcb659c700 1 -- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80b65c0 msgr2=0x7fbcb813d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:40.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcb659c700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80b65c0 0x7fbcb813d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcb659c700 1 -- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcb80ac5f0 msgr2=0x7fbcb8063030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:40.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcb659c700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcb80ac5f0 0x7fbcb8063030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcb659c700 1 -- 172.21.15.12:0/1760840981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca000b1e0 con 0x7fbcb8060d70 2021-10-20T23:28:40.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcb659c700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcb8060d70 0x7fbcb8140f90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7fbcb00032f0 tx=0x7fbcb0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:40.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcaf7fe700 1 -- 172.21.15.12:0/1760840981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcb000b600 con 0x7fbcb8060d70 2021-10-20T23:28:40.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcaf7fe700 1 -- 172.21.15.12:0/1760840981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb001f5e0 con 0x7fbcb8060d70 2021-10-20T23:28:40.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb0009470 con 0x7fbcb8060d70 2021-10-20T23:28:40.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcaf7fe700 1 -- 172.21.15.12:0/1760840981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcb000bee0 con 0x7fbcb8060d70 2021-10-20T23:28:40.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb8065720 con 0x7fbcb8060d70 2021-10-20T23:28:40.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb8065480 con 0x7fbcb8060d70 2021-10-20T23:28:40.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.768+0000 7fbcaf7fe700 1 -- 172.21.15.12:0/1760840981 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbcb0026030 con 0x7fbcb8060d70 2021-10-20T23:28:40.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.772+0000 7fbcaf7fe700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc9c0534f0 0x7fbc9c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:40.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.772+0000 7fbcaf7fe700 1 -- 172.21.15.12:0/1760840981 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fbcb006c390 con 0x7fbcb8060d70 2021-10-20T23:28:40.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.772+0000 7fbcb5d9b700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc9c0534f0 0x7fbc9c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:40.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.772+0000 7fbcb5d9b700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc9c0534f0 0x7fbc9c0559b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fbca000b000 tx=0x7fbca0006eb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:40.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.776+0000 7fbcaf7fe700 1 -- 172.21.15.12:0/1760840981 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbcb8065480 con 0x7fbcb8060d70 2021-10-20T23:28:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.944+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbcb8065480 con 0x7fbcb8060d70 2021-10-20T23:28:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.944+0000 7fbcaf7fe700 1 -- 172.21.15.12:0/1760840981 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fbcb8065480 con 0x7fbcb8060d70 2021-10-20T23:28:40.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:40.958 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:28:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:28:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:28:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:28:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.960 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:28:40.960 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.960 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.960 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.961 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.962 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:28:40.962 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:28:40.963 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.963 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:28:40.963 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.963 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.964 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.964 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:28:40.965 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:28:40.965 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.965 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:28:40.965 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.966 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.966 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.966 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.967 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:28:40.967 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:28:40.967 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.967 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.968 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.968 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.968 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.969 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:28:40.969 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:28:40.969 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.969 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.970 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.970 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.970 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.971 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:28:40.971 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:28:40.971 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.971 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.972 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.972 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.972 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.973 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:28:40.973 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:28:40.973 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.973 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.973 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.974 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.974 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:28:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:28:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:28:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:28:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:28:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:28:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.980 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.980 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.980 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:28:40.981 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:28:40.981 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.981 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.981 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.981 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.983 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:28:40.983 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:28:40.983 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.983 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:28:40.983 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:28:40.984 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:28:40.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.985 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:28:40.985 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:28:40.985 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.985 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:28:40.985 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:28:40.986 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:28:40.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.987 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:28:40.987 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:28:40.987 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.987 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:28:40.987 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:28:40.988 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:28:40.988 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.988 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.989 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:28:40.989 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:28:40.989 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.989 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:28:40.990 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:28:40.990 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.990 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:40.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:40.991 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:28:40.991 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:28:40.991 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:28:40.991 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:28:40.992 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:28:40.992 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:28:40.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:40.992 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:40.993 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:28:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc9c0534f0 msgr2=0x7fbc9c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc9c0534f0 0x7fbc9c0559b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fbca000b000 tx=0x7fbca0006eb0).stop 2021-10-20T23:28:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcb8060d70 msgr2=0x7fbcb8140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcb8060d70 0x7fbcb8140f90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7fbcb00032f0 tx=0x7fbcb0016000).stop 2021-10-20T23:28:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 shutdown_connections 2021-10-20T23:28:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbc9c0534f0 0x7fbc9c0559b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcb80b65c0 0x7fbcb813d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcb80ac5f0 0x7fbcb8063030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 --2- 172.21.15.12:0/1760840981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcb8060d70 0x7fbcb8140f90 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:40.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 >> 172.21.15.12:0/1760840981 conn(0x7fbcb80b3480 msgr2=0x7fbcb80b5510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:40.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 shutdown_connections 2021-10-20T23:28:40.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:40.948+0000 7fbcbce80700 1 -- 172.21.15.12:0/1760840981 wait complete. 2021-10-20T23:28:40.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:28:41.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.096+0000 7f356679d700 1 Processor -- start 2021-10-20T23:28:41.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.096+0000 7f356679d700 1 -- start start 2021-10-20T23:28:41.114 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560064980 0x7f3560144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3560066500 con 0x7f35600b3550 2021-10-20T23:28:41.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35600b46c0 con 0x7f3560067110 2021-10-20T23:28:41.115 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600b3ea0 con 0x7f3560064980 2021-10-20T23:28:41.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3564f9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f35600b3550 0x7f3560066a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42972/0 (socket says 172.21.15.12:42972) 2021-10-20T23:28:41.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3564f9a700 1 -- 172.21.15.12:0/3654978262 learned_addr learned my addr 172.21.15.12:0/3654978262 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:41.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356579b700 1 --2- 172.21.15.12:0/3654978262 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560064980 0x7f3560144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3553fff700 1 -- 172.21.15.12:0/3654978262 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820018892 0 0) 0x7f3560066500 con 0x7f35600b3550 2021-10-20T23:28:41.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3553fff700 1 -- 172.21.15.12:0/3654978262 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3544003260 con 0x7f35600b3550 2021-10-20T23:28:41.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3553fff700 1 -- 172.21.15.12:0/3654978262 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903482622 0 0) 0x7f35600b46c0 con 0x7f3560067110 2021-10-20T23:28:41.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3553fff700 1 -- 172.21.15.12:0/3654978262 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3560066500 con 0x7f3560067110 2021-10-20T23:28:41.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3553fff700 1 -- 172.21.15.12:0/3654978262 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931045685 0 0) 0x7f3544003260 con 0x7f35600b3550 2021-10-20T23:28:41.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356579b700 1 -- 172.21.15.12:0/3654978262 >> v1:172.21.15.31:6789/0 conn(0x7f3560067110 legacy=0x7f3560141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356579b700 1 -- 172.21.15.12:0/3654978262 >> v1:172.21.15.12:6789/0 conn(0x7f35600b3550 legacy=0x7f3560066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356579b700 1 -- 172.21.15.12:0/3654978262 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3560064d60 con 0x7f3560064980 2021-10-20T23:28:41.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356579b700 1 --2- 172.21.15.12:0/3654978262 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560064980 0x7f3560144ce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f355c001490 tx=0x7f3554006df0).ready entity=mon.2 client_cookie=1eeb8a1a77c1dc87 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3553fff700 1 -- 172.21.15.12:0/3654978262 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f355c001a00 con 0x7f3560064980 2021-10-20T23:28:41.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3553fff700 1 -- 172.21.15.12:0/3654978262 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554000e90 con 0x7f3560064980 2021-10-20T23:28:41.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f3553fff700 1 -- 172.21.15.12:0/3654978262 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3554012460 con 0x7f3560064980 2021-10-20T23:28:41.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 -- 172.21.15.12:0/3654978262 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560064980 msgr2=0x7f3560144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 --2- 172.21.15.12:0/3654978262 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560064980 0x7f3560144ce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f355c001490 tx=0x7f3554006df0).stop 2021-10-20T23:28:41.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 -- 172.21.15.12:0/3654978262 shutdown_connections 2021-10-20T23:28:41.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 --2- 172.21.15.12:0/3654978262 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560064980 0x7f3560144ce0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 -- 172.21.15.12:0/3654978262 >> 172.21.15.12:0/3654978262 conn(0x7f356005f6b0 msgr2=0x7f356005fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:41.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 -- 172.21.15.12:0/3654978262 shutdown_connections 2021-10-20T23:28:41.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.100+0000 7f356679d700 1 -- 172.21.15.12:0/3654978262 wait complete. 2021-10-20T23:28:41.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 Processor -- start 2021-10-20T23:28:41.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 -- start start 2021-10-20T23:28:41.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3560064980 0x7f35601524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560067110 0x7f35600b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35600b3550 0x7f35601562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600ae1d0 con 0x7f35600b3550 2021-10-20T23:28:41.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35601529e0 con 0x7f3560064980 2021-10-20T23:28:41.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3560155be0 con 0x7f3560067110 2021-10-20T23:28:41.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3565f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35600b3550 0x7f35601562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3565f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35600b3550 0x7f35601562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44388/0 (socket says 172.21.15.12:44388) 2021-10-20T23:28:41.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3565f9c700 1 -- 172.21.15.12:0/2592203258 learned_addr learned my addr 172.21.15.12:0/2592203258 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:41.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356579b700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3560064980 0x7f35601524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3564f9a700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560067110 0x7f35600b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3565f9c700 1 -- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560067110 msgr2=0x7f35600b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3565f9c700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560067110 0x7f35600b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3565f9c700 1 -- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3560064980 msgr2=0x7f35601524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3565f9c700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3560064980 0x7f35601524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3565f9c700 1 -- 172.21.15.12:0/2592203258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355400b180 con 0x7f35600b3550 2021-10-20T23:28:41.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f3565f9c700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35600b3550 0x7f35601562e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f3558001110 tx=0x7f3558007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f35527fc700 1 -- 172.21.15.12:0/2592203258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f355800ce80 con 0x7f35600b3550 2021-10-20T23:28:41.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f35527fc700 1 -- 172.21.15.12:0/2592203258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3558012400 con 0x7f35600b3550 2021-10-20T23:28:41.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35600adf30 con 0x7f35600b3550 2021-10-20T23:28:41.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f35527fc700 1 -- 172.21.15.12:0/2592203258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3558012760 con 0x7f35600b3550 2021-10-20T23:28:41.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35600b6850 con 0x7f35600b3550 2021-10-20T23:28:41.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.104+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35600b48f0 con 0x7f35600b3550 2021-10-20T23:28:41.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.108+0000 7f35527fc700 1 -- 172.21.15.12:0/2592203258 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3558019030 con 0x7f35600b3550 2021-10-20T23:28:41.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.108+0000 7f35527fc700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3548053640 0x7f3548055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.108+0000 7f35527fc700 1 -- 172.21.15.12:0/2592203258 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f355806b0d0 con 0x7f35600b3550 2021-10-20T23:28:41.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.108+0000 7f356579b700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3548053640 0x7f3548055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.108+0000 7f356579b700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3548053640 0x7f3548055b00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f355401a000 tx=0x7f3554014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.112+0000 7f35527fc700 1 -- 172.21.15.12:0/2592203258 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3558042390 con 0x7f35600b3550 2021-10-20T23:28:41.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.240+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3560057350 con 0x7f35600b3550 2021-10-20T23:28:41.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.240+0000 7f35527fc700 1 -- 172.21.15.12:0/2592203258 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f35580459b0 con 0x7f35600b3550 2021-10-20T23:28:41.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:41.253 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":138,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:28:40.626633+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:28:41.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3548053640 msgr2=0x7f3548055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3548053640 0x7f3548055b00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f355401a000 tx=0x7f3554014000).stop 2021-10-20T23:28:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35600b3550 msgr2=0x7f35601562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35600b3550 0x7f35601562e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f3558001110 tx=0x7f3558007a50).stop 2021-10-20T23:28:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 shutdown_connections 2021-10-20T23:28:41.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3548053640 0x7f3548055b00 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35600b3550 0x7f35601562e0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3560067110 0x7f35600b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 --2- 172.21.15.12:0/2592203258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3560064980 0x7f35601524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 >> 172.21.15.12:0/2592203258 conn(0x7f356005f6b0 msgr2=0x7f356013f540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 shutdown_connections 2021-10-20T23:28:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.244+0000 7f356679d700 1 -- 172.21.15.12:0/2592203258 wait complete. 2021-10-20T23:28:41.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:28:41.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:28:41.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.360+0000 7f6f915b3700 1 Processor -- start 2021-10-20T23:28:41.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.360+0000 7f6f915b3700 1 -- start start 2021-10-20T23:28:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.360+0000 7f6f915b3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f8c064640 0x7f6f8c0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.360+0000 7f6f915b3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c0b4aa0 0x7f6f8c064a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.360+0000 7f6f915b3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c0b8090 con 0x7f6f8c143870 2021-10-20T23:28:41.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.360+0000 7f6f915b3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c067510 con 0x7f6f8c064640 2021-10-20T23:28:41.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.360+0000 7f6f915b3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c142f40 con 0x7f6f8c0b4aa0 2021-10-20T23:28:41.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.360+0000 7f6f8bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f8c064640 0x7f6f8c0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f83fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c0b4aa0 0x7f6f8c064a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f8bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f8c064640 0x7f6f8c0b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44392/0 (socket says 172.21.15.12:44392) 2021-10-20T23:28:41.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f83fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c0b4aa0 0x7f6f8c064a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:50152/0 (socket says 172.21.15.12:50152) 2021-10-20T23:28:41.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f83fff700 1 -- 172.21.15.12:0/1190553884 learned_addr learned my addr 172.21.15.12:0/1190553884 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:41.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f90db2700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6f8c143870 0x7f6f8c146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:50054/0 (socket says 172.21.15.12:50054) 2021-10-20T23:28:41.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f83fff700 1 -- 172.21.15.12:0/1190553884 >> v2:172.21.15.12:3300/0 conn(0x7f6f8c064640 msgr2=0x7f6f8c0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:41.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f8b7fe700 1 -- 172.21.15.12:0/1190553884 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227763775 0 0) 0x7f6f8c0b8090 con 0x7f6f8c143870 2021-10-20T23:28:41.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f83fff700 1 --2- 172.21.15.12:0/1190553884 >> v2:172.21.15.12:3300/0 conn(0x7f6f8c064640 0x7f6f8c0b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f83fff700 1 -- 172.21.15.12:0/1190553884 >> v1:172.21.15.31:6789/0 conn(0x7f6f8c143870 legacy=0x7f6f8c146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f83fff700 1 -- 172.21.15.12:0/1190553884 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c143130 con 0x7f6f8c0b4aa0 2021-10-20T23:28:41.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f8bfff700 1 --2- 172.21.15.12:0/1190553884 >> v2:172.21.15.12:3300/0 conn(0x7f6f8c064640 0x7f6f8c0b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:41.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f83fff700 1 --2- 172.21.15.12:0/1190553884 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c0b4aa0 0x7f6f8c064a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f6f74002f70 tx=0x7f6f74006eb0).ready entity=mon.2 client_cookie=acd43f8d91e285df server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f8b7fe700 1 -- 172.21.15.12:0/1190553884 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7400d570 con 0x7f6f8c0b4aa0 2021-10-20T23:28:41.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f8b7fe700 1 -- 172.21.15.12:0/1190553884 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74000e90 con 0x7f6f8c0b4aa0 2021-10-20T23:28:41.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f8b7fe700 1 -- 172.21.15.12:0/1190553884 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7400d900 con 0x7f6f8c0b4aa0 2021-10-20T23:28:41.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f915b3700 1 -- 172.21.15.12:0/1190553884 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c0b4aa0 msgr2=0x7f6f8c064a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f915b3700 1 --2- 172.21.15.12:0/1190553884 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c0b4aa0 0x7f6f8c064a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f6f74002f70 tx=0x7f6f74006eb0).stop 2021-10-20T23:28:41.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f915b3700 1 -- 172.21.15.12:0/1190553884 shutdown_connections 2021-10-20T23:28:41.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f915b3700 1 --2- 172.21.15.12:0/1190553884 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c0b4aa0 0x7f6f8c064a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f915b3700 1 --2- 172.21.15.12:0/1190553884 >> v2:172.21.15.12:3300/0 conn(0x7f6f8c064640 0x7f6f8c0b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f915b3700 1 -- 172.21.15.12:0/1190553884 >> 172.21.15.12:0/1190553884 conn(0x7f6f8c05f6b0 msgr2=0x7f6f8c05fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f915b3700 1 -- 172.21.15.12:0/1190553884 shutdown_connections 2021-10-20T23:28:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.364+0000 7f6f915b3700 1 -- 172.21.15.12:0/1190553884 wait complete. 2021-10-20T23:28:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 Processor -- start 2021-10-20T23:28:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 -- start start 2021-10-20T23:28:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c064640 0x7f6f8c062160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f8c0b4aa0 0x7f6f8c13d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c143870 0x7f6f8c13c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c13fc80 con 0x7f6f8c064640 2021-10-20T23:28:41.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c13dc00 con 0x7f6f8c0b4aa0 2021-10-20T23:28:41.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c13f2a0 con 0x7f6f8c143870 2021-10-20T23:28:41.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f8bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c064640 0x7f6f8c062160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f8bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c064640 0x7f6f8c062160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44398/0 (socket says 172.21.15.12:44398) 2021-10-20T23:28:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f8bfff700 1 -- 172.21.15.12:0/1811514664 learned_addr learned my addr 172.21.15.12:0/1811514664 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f83fff700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f8c0b4aa0 0x7f6f8c13d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f90db2700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c143870 0x7f6f8c13c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f8bfff700 1 -- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c143870 msgr2=0x7f6f8c13c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f8bfff700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c143870 0x7f6f8c13c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f8bfff700 1 -- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f8c0b4aa0 msgr2=0x7f6f8c13d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f8bfff700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f8c0b4aa0 0x7f6f8c13d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f8bfff700 1 -- 172.21.15.12:0/1811514664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c00b180 con 0x7f6f8c064640 2021-10-20T23:28:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f90db2700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c143870 0x7f6f8c13c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f8bfff700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c064640 0x7f6f8c062160 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f6f7c00c000 tx=0x7f6f7c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f89ffb700 1 -- 172.21.15.12:0/1811514664 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7c00c890 con 0x7f6f8c064640 2021-10-20T23:28:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f89ffb700 1 -- 172.21.15.12:0/1811514664 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c00c9f0 con 0x7f6f8c064640 2021-10-20T23:28:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7400b1e0 con 0x7f6f8c064640 2021-10-20T23:28:41.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f89ffb700 1 -- 172.21.15.12:0/1811514664 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7c00cd50 con 0x7f6f8c064640 2021-10-20T23:28:41.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.368+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c13f7e0 con 0x7f6f8c064640 2021-10-20T23:28:41.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.372+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c0afcd0 con 0x7f6f8c064640 2021-10-20T23:28:41.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.372+0000 7f6f89ffb700 1 -- 172.21.15.12:0/1811514664 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f7c01c460 con 0x7f6f8c064640 2021-10-20T23:28:41.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.372+0000 7f6f89ffb700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f700534f0 0x7f6f700559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.372+0000 7f6f89ffb700 1 -- 172.21.15.12:0/1811514664 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f6f7c06bdf0 con 0x7f6f8c064640 2021-10-20T23:28:41.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.372+0000 7f6f83fff700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f700534f0 0x7f6f700559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.372+0000 7f6f83fff700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f700534f0 0x7f6f700559b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f6f7401c000 tx=0x7f6f74015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.376+0000 7f6f89ffb700 1 -- 172.21.15.12:0/1811514664 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f8c0afcd0 con 0x7f6f8c064640 2021-10-20T23:28:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.500+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6f8c13f970 con 0x7f6f8c064640 2021-10-20T23:28:41.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.500+0000 7f6f89ffb700 1 -- 172.21.15.12:0/1811514664 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v138) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6f7c043030 con 0x7f6f8c064640 2021-10-20T23:28:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:28:41.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f700534f0 msgr2=0x7f6f700559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f700534f0 0x7f6f700559b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f6f7401c000 tx=0x7f6f74015000).stop 2021-10-20T23:28:41.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c064640 msgr2=0x7f6f8c062160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c064640 0x7f6f8c062160 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f6f7c00c000 tx=0x7f6f7c006df0).stop 2021-10-20T23:28:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 shutdown_connections 2021-10-20T23:28:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6f700534f0 0x7f6f700559b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f8c143870 0x7f6f8c13c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f8c0b4aa0 0x7f6f8c13d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 --2- 172.21.15.12:0/1811514664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c064640 0x7f6f8c062160 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 >> 172.21.15.12:0/1811514664 conn(0x7f6f8c05f6b0 msgr2=0x7f6f8c05cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:41.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 shutdown_connections 2021-10-20T23:28:41.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.504+0000 7f6f915b3700 1 -- 172.21.15.12:0/1811514664 wait complete. 2021-10-20T23:28:41.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:28:41.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.620+0000 7ffaba8c0700 1 Processor -- start 2021-10-20T23:28:41.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.620+0000 7ffaba8c0700 1 -- start start 2021-10-20T23:28:41.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffab40b3060 0x7ffab40b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab40b2380 con 0x7ffab40b7370 2021-10-20T23:28:41.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab4144250 con 0x7ffab40aac20 2021-10-20T23:28:41.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40b3570 con 0x7ffab40b3060 2021-10-20T23:28:41.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab90bd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffab40b3060 0x7ffab40b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab98be700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffab40b7370 0x7ffab413e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43000/0 (socket says 172.21.15.12:43000) 2021-10-20T23:28:41.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab90bd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffab40b3060 0x7ffab40b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44408/0 (socket says 172.21.15.12:44408) 2021-10-20T23:28:41.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab98be700 1 -- 172.21.15.12:0/2803122227 learned_addr learned my addr 172.21.15.12:0/2803122227 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:41.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab90bd700 1 -- 172.21.15.12:0/2803122227 >> v1:172.21.15.31:6789/0 conn(0x7ffab40aac20 legacy=0x7ffab4064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab90bd700 1 -- 172.21.15.12:0/2803122227 >> v1:172.21.15.12:6789/0 conn(0x7ffab40b7370 legacy=0x7ffab413e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab90bd700 1 -- 172.21.15.12:0/2803122227 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40b25b0 con 0x7ffab40b3060 2021-10-20T23:28:41.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab90bd700 1 --2- 172.21.15.12:0/2803122227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 0x7ffab40b7750 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7ffab0002f70 tx=0x7ffab0006df0).ready entity=mon.0 client_cookie=9eb9e00b7f63142e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab88bc700 1 -- 172.21.15.12:0/2803122227 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffab000d610 con 0x7ffab40b3060 2021-10-20T23:28:41.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab88bc700 1 -- 172.21.15.12:0/2803122227 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab0000e90 con 0x7ffab40b3060 2021-10-20T23:28:41.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffab88bc700 1 -- 172.21.15.12:0/2803122227 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffab000d960 con 0x7ffab40b3060 2021-10-20T23:28:41.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 -- 172.21.15.12:0/2803122227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 msgr2=0x7ffab40b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 --2- 172.21.15.12:0/2803122227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 0x7ffab40b7750 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7ffab0002f70 tx=0x7ffab0006df0).stop 2021-10-20T23:28:41.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 -- 172.21.15.12:0/2803122227 shutdown_connections 2021-10-20T23:28:41.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 --2- 172.21.15.12:0/2803122227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 0x7ffab40b7750 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 -- 172.21.15.12:0/2803122227 >> 172.21.15.12:0/2803122227 conn(0x7ffab405f6b0 msgr2=0x7ffab405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:41.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 -- 172.21.15.12:0/2803122227 shutdown_connections 2021-10-20T23:28:41.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 -- 172.21.15.12:0/2803122227 wait complete. 2021-10-20T23:28:41.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 Processor -- start 2021-10-20T23:28:41.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.624+0000 7ffaba8c0700 1 -- start start 2021-10-20T23:28:41.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba8c0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffab40aac20 0x7ffab4143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba8c0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 0x7ffab40aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba8c0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffab40b7370 0x7ffab413d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba8c0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40ad420 con 0x7ffab40b3060 2021-10-20T23:28:41.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba8c0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40ac3f0 con 0x7ffab40b7370 2021-10-20T23:28:41.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba8c0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40ac690 con 0x7ffab40aac20 2021-10-20T23:28:41.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab90bd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 0x7ffab40aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab90bd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 0x7ffab40aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44414/0 (socket says 172.21.15.12:44414) 2021-10-20T23:28:41.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab90bd700 1 -- 172.21.15.12:0/895780294 learned_addr learned my addr 172.21.15.12:0/895780294 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:41.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba0bf700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffab40b7370 0x7ffab413d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab98be700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffab40aac20 0x7ffab4143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab90bd700 1 -- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffab40aac20 msgr2=0x7ffab4143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab90bd700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffab40aac20 0x7ffab4143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab90bd700 1 -- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffab40b7370 msgr2=0x7ffab413d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab90bd700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffab40b7370 0x7ffab413d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab90bd700 1 -- 172.21.15.12:0/895780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab000b180 con 0x7ffab40b3060 2021-10-20T23:28:41.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba0bf700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffab40b7370 0x7ffab413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:41.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffab90bd700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 0x7ffab40aea40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7ffab0002f70 tx=0x7ffab0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaa6ffd700 1 -- 172.21.15.12:0/895780294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffab000d990 con 0x7ffab40b3060 2021-10-20T23:28:41.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaa6ffd700 1 -- 172.21.15.12:0/895780294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab0011ce0 con 0x7ffab40b3060 2021-10-20T23:28:41.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab40ac930 con 0x7ffab40b3060 2021-10-20T23:28:41.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaa6ffd700 1 -- 172.21.15.12:0/895780294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffab001e650 con 0x7ffab40b3060 2021-10-20T23:28:41.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab40acf10 con 0x7ffab40b3060 2021-10-20T23:28:41.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.628+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab40acac0 con 0x7ffab40b3060 2021-10-20T23:28:41.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.632+0000 7ffaa6ffd700 1 -- 172.21.15.12:0/895780294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffab0025030 con 0x7ffab40b3060 2021-10-20T23:28:41.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.632+0000 7ffaa6ffd700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa940536a0 0x7ffa94055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.632+0000 7ffaa6ffd700 1 -- 172.21.15.12:0/895780294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ffab006cae0 con 0x7ffab40b3060 2021-10-20T23:28:41.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.632+0000 7ffab98be700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa940536a0 0x7ffa94055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.632+0000 7ffab98be700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa940536a0 0x7ffa94055b60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7ffaa800b000 tx=0x7ffaa8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.636+0000 7ffaa6ffd700 1 -- 172.21.15.12:0/895780294 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffab0043e60 con 0x7ffab40b3060 2021-10-20T23:28:41.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.764+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffab4057350 con 0x7ffab40b3060 2021-10-20T23:28:41.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.764+0000 7ffaa6ffd700 1 -- 172.21.15.12:0/895780294 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v138) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffab0023020 con 0x7ffab40b3060 2021-10-20T23:28:41.783 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:41.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa940536a0 msgr2=0x7ffa94055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa940536a0 0x7ffa94055b60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7ffaa800b000 tx=0x7ffaa8009040).stop 2021-10-20T23:28:41.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 msgr2=0x7ffab40aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 0x7ffab40aea40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7ffab0002f70 tx=0x7ffab0015000).stop 2021-10-20T23:28:41.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 shutdown_connections 2021-10-20T23:28:41.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffa940536a0 0x7ffa94055b60 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffab40b7370 0x7ffab413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab40b3060 0x7ffab40aea40 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 --2- 172.21.15.12:0/895780294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffab40aac20 0x7ffab4143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 >> 172.21.15.12:0/895780294 conn(0x7ffab405f6b0 msgr2=0x7ffab405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:41.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 shutdown_connections 2021-10-20T23:28:41.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.768+0000 7ffaba8c0700 1 -- 172.21.15.12:0/895780294 wait complete. 2021-10-20T23:28:41.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:28:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd707901700 1 Processor -- start 2021-10-20T23:28:41.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd707901700 1 -- start start 2021-10-20T23:28:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd707901700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd7001483a0 0x7fd7000b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd707901700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7000a70c0 0x7fd700144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd707901700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000b0350 con 0x7fd7000b1db0 2021-10-20T23:28:41.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd707901700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7000a90c0 con 0x7fd7001483a0 2021-10-20T23:28:41.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd707901700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000b05f0 con 0x7fd7000a70c0 2021-10-20T23:28:41.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd70569d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd7000b1db0 0x7fd7000b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43014/0 (socket says 172.21.15.12:43014) 2021-10-20T23:28:41.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd705e9e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7000a70c0 0x7fd700144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd70569d700 1 -- 172.21.15.12:0/2918806460 learned_addr learned my addr 172.21.15.12:0/2918806460 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:41.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd704e9c700 1 --2- 172.21.15.12:0/2918806460 >> v2:172.21.15.31:3300/0 conn(0x7fd7001483a0 0x7fd7000b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd6f7fff700 1 -- 172.21.15.12:0/2918806460 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625664648 0 0) 0x7fd7000b0350 con 0x7fd7000b1db0 2021-10-20T23:28:41.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd6f7fff700 1 -- 172.21.15.12:0/2918806460 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e4003260 con 0x7fd7000b1db0 2021-10-20T23:28:41.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd705e9e700 1 -- 172.21.15.12:0/2918806460 >> v2:172.21.15.31:3300/0 conn(0x7fd7001483a0 msgr2=0x7fd7000b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:41.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd705e9e700 1 --2- 172.21.15.12:0/2918806460 >> v2:172.21.15.31:3300/0 conn(0x7fd7001483a0 0x7fd7000b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd705e9e700 1 -- 172.21.15.12:0/2918806460 >> v1:172.21.15.12:6789/0 conn(0x7fd7000b1db0 legacy=0x7fd7000b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd705e9e700 1 -- 172.21.15.12:0/2918806460 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000b0890 con 0x7fd7000a70c0 2021-10-20T23:28:41.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd705e9e700 1 --2- 172.21.15.12:0/2918806460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7000a70c0 0x7fd700144720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd700147730 tx=0x7fd6f8006df0).ready entity=mon.2 client_cookie=a8d80f85de68c91e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd6f7fff700 1 -- 172.21.15.12:0/2918806460 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f800d570 con 0x7fd7000a70c0 2021-10-20T23:28:41.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd6f7fff700 1 -- 172.21.15.12:0/2918806460 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f8000e90 con 0x7fd7000a70c0 2021-10-20T23:28:41.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.884+0000 7fd6f7fff700 1 -- 172.21.15.12:0/2918806460 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f800d8c0 con 0x7fd7000a70c0 2021-10-20T23:28:41.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 -- 172.21.15.12:0/2918806460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7000a70c0 msgr2=0x7fd700144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 --2- 172.21.15.12:0/2918806460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7000a70c0 0x7fd700144720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd700147730 tx=0x7fd6f8006df0).stop 2021-10-20T23:28:41.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 -- 172.21.15.12:0/2918806460 shutdown_connections 2021-10-20T23:28:41.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 --2- 172.21.15.12:0/2918806460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7000a70c0 0x7fd700144720 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 --2- 172.21.15.12:0/2918806460 >> v2:172.21.15.31:3300/0 conn(0x7fd7001483a0 0x7fd7000b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 -- 172.21.15.12:0/2918806460 >> 172.21.15.12:0/2918806460 conn(0x7fd70005f6b0 msgr2=0x7fd70005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:41.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 -- 172.21.15.12:0/2918806460 shutdown_connections 2021-10-20T23:28:41.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 -- 172.21.15.12:0/2918806460 wait complete. 2021-10-20T23:28:41.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 Processor -- start 2021-10-20T23:28:41.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 -- start start 2021-10-20T23:28:41.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7000a70c0 0x7fd70014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7000b1db0 0x7fd7000ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7001483a0 0x7fd7000ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70014b610 con 0x7fd7000a70c0 2021-10-20T23:28:41.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70014b8b0 con 0x7fd7000b1db0 2021-10-20T23:28:41.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd707901700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000ab0b0 con 0x7fd7001483a0 2021-10-20T23:28:41.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd70569d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7000a70c0 0x7fd70014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd70569d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7000a70c0 0x7fd70014ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44426/0 (socket says 172.21.15.12:44426) 2021-10-20T23:28:41.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd705e9e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7001483a0 0x7fd7000ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd70569d700 1 -- 172.21.15.12:0/2951831371 learned_addr learned my addr 172.21.15.12:0/2951831371 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:41.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.888+0000 7fd704e9c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7000b1db0 0x7fd7000ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd70569d700 1 -- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7001483a0 msgr2=0x7fd7000ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd70569d700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7001483a0 0x7fd7000ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd70569d700 1 -- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7000b1db0 msgr2=0x7fd7000ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:41.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd70569d700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7000b1db0 0x7fd7000ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:41.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd70569d700 1 -- 172.21.15.12:0/2951831371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f800b180 con 0x7fd7000a70c0 2021-10-20T23:28:41.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd70569d700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7000a70c0 0x7fd70014ab70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7fd6f0001110 tx=0x7fd6f0007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd6f67fc700 1 -- 172.21.15.12:0/2951831371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f00070d0 con 0x7fd7000a70c0 2021-10-20T23:28:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd6f67fc700 1 -- 172.21.15.12:0/2951831371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0007230 con 0x7fd7000a70c0 2021-10-20T23:28:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7000ab350 con 0x7fd7000a70c0 2021-10-20T23:28:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd6f67fc700 1 -- 172.21.15.12:0/2951831371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f0005610 con 0x7fd7000a70c0 2021-10-20T23:28:41.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70014b0d0 con 0x7fd7000a70c0 2021-10-20T23:28:41.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd700057350 con 0x7fd7000a70c0 2021-10-20T23:28:41.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd6f67fc700 1 -- 172.21.15.12:0/2951831371 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd6f0010070 con 0x7fd7000a70c0 2021-10-20T23:28:41.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.892+0000 7fd6f67fc700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd6e8053610 0x7fd6e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.896+0000 7fd6f67fc700 1 -- 172.21.15.12:0/2951831371 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fd6f006ae60 con 0x7fd7000a70c0 2021-10-20T23:28:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.896+0000 7fd704e9c700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd6e8053610 0x7fd6e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.896+0000 7fd704e9c700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd6e8053610 0x7fd6e8055ad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fd6fc00b000 tx=0x7fd6fc0091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:41.900+0000 7fd6f67fc700 1 -- 172.21.15.12:0/2951831371 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd6f0042090 con 0x7fd7000a70c0 2021-10-20T23:28:42.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.028+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd7000ab4e0 con 0x7fd7000a70c0 2021-10-20T23:28:42.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.028+0000 7fd6f67fc700 1 -- 172.21.15.12:0/2951831371 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v138) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd6f00456b0 con 0x7fd7000a70c0 2021-10-20T23:28:42.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:42.041 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:28:42.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:42.042 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:28:42.042 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:28:42.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:42.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:42.043 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:28:42.043 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:28:42.043 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:42.043 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:28:42.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.028+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd6e8053610 msgr2=0x7fd6e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.028+0000 7fd707901700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd6e8053610 0x7fd6e8055ad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fd6fc00b000 tx=0x7fd6fc0091d0).stop 2021-10-20T23:28:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7000a70c0 msgr2=0x7fd70014ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7000a70c0 0x7fd70014ab70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7fd6f0001110 tx=0x7fd6f0007ad0).stop 2021-10-20T23:28:42.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 shutdown_connections 2021-10-20T23:28:42.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd6e8053610 0x7fd6e8055ad0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7001483a0 0x7fd7000ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7000b1db0 0x7fd7000ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 --2- 172.21.15.12:0/2951831371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7000a70c0 0x7fd70014ab70 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 >> 172.21.15.12:0/2951831371 conn(0x7fd70005f6b0 msgr2=0x7fd7000b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:42.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 shutdown_connections 2021-10-20T23:28:42.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.032+0000 7fd707901700 1 -- 172.21.15.12:0/2951831371 wait complete. 2021-10-20T23:28:42.054 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:28:42.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:28:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.152+0000 7f1954a1e700 1 Processor -- start 2021-10-20T23:28:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f1954a1e700 1 -- start start 2021-10-20T23:28:42.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f1954a1e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19500aea40 0x7f19501437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:42.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f1954a1e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19500ad000 0x7f1950143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:42.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f1954a1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 0x7f1950146b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:42.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f1954a1e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19500adc50 con 0x7f19500ad000 2021-10-20T23:28:42.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f1954a1e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19500b0990 con 0x7f19500aea40 2021-10-20T23:28:42.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f1954a1e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1950146700 con 0x7f19500b0480 2021-10-20T23:28:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19500ad000 0x7f1950143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19500ad000 0x7f1950143ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44434/0 (socket says 172.21.15.12:44434) 2021-10-20T23:28:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194e59c700 1 -- 172.21.15.12:0/2287989590 learned_addr learned my addr 172.21.15.12:0/2287989590 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194ed9d700 1 --2- 172.21.15.12:0/2287989590 >> v2:172.21.15.31:3300/0 conn(0x7f19500aea40 0x7f19501437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194f59e700 1 --2- 172.21.15.12:0/2287989590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 0x7f1950146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194e59c700 1 -- 172.21.15.12:0/2287989590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 msgr2=0x7f1950146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194e59c700 1 --2- 172.21.15.12:0/2287989590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 0x7f1950146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194e59c700 1 -- 172.21.15.12:0/2287989590 >> v2:172.21.15.31:3300/0 conn(0x7f19500aea40 msgr2=0x7f19501437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:42.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194e59c700 1 --2- 172.21.15.12:0/2287989590 >> v2:172.21.15.31:3300/0 conn(0x7f19500aea40 0x7f19501437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194e59c700 1 -- 172.21.15.12:0/2287989590 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19500aee20 con 0x7f19500ad000 2021-10-20T23:28:42.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194ed9d700 1 --2- 172.21.15.12:0/2287989590 >> v2:172.21.15.31:3300/0 conn(0x7f19500aea40 0x7f19501437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:42.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194e59c700 1 --2- 172.21.15.12:0/2287989590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500ad000 0x7f1950143ca0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944006eb0).ready entity=mon.0 client_cookie=43bd591f79582db0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:42.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194dd9b700 1 -- 172.21.15.12:0/2287989590 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194400d570 con 0x7f19500ad000 2021-10-20T23:28:42.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194dd9b700 1 -- 172.21.15.12:0/2287989590 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944000e90 con 0x7f19500ad000 2021-10-20T23:28:42.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.156+0000 7f194dd9b700 1 -- 172.21.15.12:0/2287989590 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194400d900 con 0x7f19500ad000 2021-10-20T23:28:42.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 -- 172.21.15.12:0/2287989590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500ad000 msgr2=0x7f1950143ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:42.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 --2- 172.21.15.12:0/2287989590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500ad000 0x7f1950143ca0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944006eb0).stop 2021-10-20T23:28:42.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 -- 172.21.15.12:0/2287989590 shutdown_connections 2021-10-20T23:28:42.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 --2- 172.21.15.12:0/2287989590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 0x7f1950146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 --2- 172.21.15.12:0/2287989590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500ad000 0x7f1950143ca0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 --2- 172.21.15.12:0/2287989590 >> v2:172.21.15.31:3300/0 conn(0x7f19500aea40 0x7f19501437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 -- 172.21.15.12:0/2287989590 >> 172.21.15.12:0/2287989590 conn(0x7f1950061230 msgr2=0x7f1950062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:42.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 -- 172.21.15.12:0/2287989590 shutdown_connections 2021-10-20T23:28:42.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 -- 172.21.15.12:0/2287989590 wait complete. 2021-10-20T23:28:42.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 Processor -- start 2021-10-20T23:28:42.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.160+0000 7f1954a1e700 1 -- start start 2021-10-20T23:28:42.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f1954a1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19500ad000 0x7f195013e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:42.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f1954a1e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500aea40 0x7f195013ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:42.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f1954a1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 0x7f195013b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:42.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f1954a1e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1950140480 con 0x7f19500aea40 2021-10-20T23:28:42.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f1954a1e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1950143160 con 0x7f19500ad000 2021-10-20T23:28:42.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f1954a1e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19501413c0 con 0x7f19500b0480 2021-10-20T23:28:42.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500aea40 0x7f195013ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:42.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500aea40 0x7f195013ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44440/0 (socket says 172.21.15.12:44440) 2021-10-20T23:28:42.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194e59c700 1 -- 172.21.15.12:0/1641599525 learned_addr learned my addr 172.21.15.12:0/1641599525 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:42.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194ed9d700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19500ad000 0x7f195013e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:42.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194f59e700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 0x7f195013b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:42.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194e59c700 1 -- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 msgr2=0x7f195013b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:42.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194e59c700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 0x7f195013b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194e59c700 1 -- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19500ad000 msgr2=0x7f195013e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:42.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194e59c700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19500ad000 0x7f195013e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:42.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194e59c700 1 -- 172.21.15.12:0/1641599525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194400b1e0 con 0x7f19500aea40 2021-10-20T23:28:42.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194f59e700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 0x7f195013b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:42.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f194e59c700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500aea40 0x7f195013ac60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:42.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f193ffff700 1 -- 172.21.15.12:0/1641599525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194400dea0 con 0x7f19500aea40 2021-10-20T23:28:42.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f193ffff700 1 -- 172.21.15.12:0/1641599525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19440068b0 con 0x7f19500aea40 2021-10-20T23:28:42.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1950141660 con 0x7f19500aea40 2021-10-20T23:28:42.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f193ffff700 1 -- 172.21.15.12:0/1641599525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1944011b80 con 0x7f19500aea40 2021-10-20T23:28:42.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.164+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195013b640 con 0x7f19500aea40 2021-10-20T23:28:42.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.168+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1950142f80 con 0x7f19500aea40 2021-10-20T23:28:42.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.168+0000 7f193ffff700 1 -- 172.21.15.12:0/1641599525 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1944025030 con 0x7f19500aea40 2021-10-20T23:28:42.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.168+0000 7f193ffff700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f192c053520 0x7f192c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:42.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.168+0000 7f193ffff700 1 -- 172.21.15.12:0/1641599525 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f194406c780 con 0x7f19500aea40 2021-10-20T23:28:42.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.168+0000 7f194ed9d700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f192c053520 0x7f192c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:42.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.168+0000 7f194ed9d700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f192c053520 0x7f192c0559e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f194000c000 tx=0x7f1940008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:42.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.176+0000 7f193ffff700 1 -- 172.21.15.12:0/1641599525 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f19440439b0 con 0x7f19500aea40 2021-10-20T23:28:42.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:42.304+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f19500b0bc0 con 0x7f19500aea40 2021-10-20T23:28:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.048+0000 7f193ffff700 1 -- 172.21.15.12:0/1641599525 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v139) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1944023020 con 0x7f19500aea40 2021-10-20T23:28:43.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f192c053520 msgr2=0x7f192c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:43.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f192c053520 0x7f192c0559e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f194000c000 tx=0x7f1940008040).stop 2021-10-20T23:28:43.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500aea40 msgr2=0x7f195013ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500aea40 0x7f195013ac60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944015000).stop 2021-10-20T23:28:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 shutdown_connections 2021-10-20T23:28:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f192c053520 0x7f192c0559e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19500b0480 0x7f195013b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19500aea40 0x7f195013ac60 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 --2- 172.21.15.12:0/1641599525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19500ad000 0x7f195013e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 >> 172.21.15.12:0/1641599525 conn(0x7f1950061230 msgr2=0x7f1950067790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 shutdown_connections 2021-10-20T23:28:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.052+0000 7f1954a1e700 1 -- 172.21.15.12:0/1641599525 wait complete. 2021-10-20T23:28:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:28:43.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:28:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 Processor -- start 2021-10-20T23:28:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 -- start start 2021-10-20T23:28:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e600b7370 0x7f7e600b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7e600b3060 0x7f7e6013e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e600b2380 con 0x7f7e6013e710 2021-10-20T23:28:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e60144250 con 0x7f7e600b3060 2021-10-20T23:28:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600b3570 con 0x7f7e600b7370 2021-10-20T23:28:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7e600b3060 0x7f7e6013e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7e600b3060 0x7f7e6013e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44448/0 (socket says 172.21.15.12:44448) 2021-10-20T23:28:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7e6013e710 0x7f7e60064ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43044/0 (socket says 172.21.15.12:43044) 2021-10-20T23:28:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5effd700 1 -- 172.21.15.12:0/701712393 learned_addr learned my addr 172.21.15.12:0/701712393 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5f7fe700 1 --2- 172.21.15.12:0/701712393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e600b7370 0x7f7e600b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5effd700 1 -- 172.21.15.12:0/701712393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e600b7370 msgr2=0x7f7e600b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5effd700 1 --2- 172.21.15.12:0/701712393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e600b7370 0x7f7e600b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5effd700 1 -- 172.21.15.12:0/701712393 >> v1:172.21.15.12:6789/0 conn(0x7f7e6013e710 legacy=0x7f7e60064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5effd700 1 -- 172.21.15.12:0/701712393 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600b25b0 con 0x7f7e600b3060 2021-10-20T23:28:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5effd700 1 --2- 172.21.15.12:0/701712393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b3060 0x7f7e6013e220 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f7e54002f70 tx=0x7f7e54006eb0).ready entity=mon.0 client_cookie=e0057fa291eac466 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5e7fc700 1 -- 172.21.15.12:0/701712393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5400d5c0 con 0x7f7e600b3060 2021-10-20T23:28:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5e7fc700 1 -- 172.21.15.12:0/701712393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e54000e90 con 0x7f7e600b3060 2021-10-20T23:28:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e5e7fc700 1 -- 172.21.15.12:0/701712393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5400d950 con 0x7f7e600b3060 2021-10-20T23:28:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 -- 172.21.15.12:0/701712393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b3060 msgr2=0x7f7e6013e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 --2- 172.21.15.12:0/701712393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b3060 0x7f7e6013e220 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f7e54002f70 tx=0x7f7e54006eb0).stop 2021-10-20T23:28:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 -- 172.21.15.12:0/701712393 shutdown_connections 2021-10-20T23:28:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 --2- 172.21.15.12:0/701712393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b3060 0x7f7e6013e220 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 --2- 172.21.15.12:0/701712393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e600b7370 0x7f7e600b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 -- 172.21.15.12:0/701712393 >> 172.21.15.12:0/701712393 conn(0x7f7e6005f6b0 msgr2=0x7f7e6005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 -- 172.21.15.12:0/701712393 shutdown_connections 2021-10-20T23:28:43.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.180+0000 7f7e64de8700 1 -- 172.21.15.12:0/701712393 wait complete. 2021-10-20T23:28:43.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e64de8700 1 Processor -- start 2021-10-20T23:28:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e64de8700 1 -- start start 2021-10-20T23:28:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e64de8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600b3060 0x7f7e60153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e64de8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b7370 0x7f7e600ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e64de8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e6013e710 0x7f7e600acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e64de8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600b11d0 con 0x7f7e600b7370 2021-10-20T23:28:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e64de8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600ab4b0 con 0x7f7e600b3060 2021-10-20T23:28:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e64de8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600ab750 con 0x7f7e6013e710 2021-10-20T23:28:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b7370 0x7f7e600ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b7370 0x7f7e600ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44454/0 (socket says 172.21.15.12:44454) 2021-10-20T23:28:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5effd700 1 -- 172.21.15.12:0/2196846073 learned_addr learned my addr 172.21.15.12:0/2196846073 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5f7fe700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600b3060 0x7f7e60153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5ffff700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e6013e710 0x7f7e600acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:43.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5effd700 1 -- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e6013e710 msgr2=0x7f7e600acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:43.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5effd700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e6013e710 0x7f7e600acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:43.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5effd700 1 -- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600b3060 msgr2=0x7f7e60153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:43.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5effd700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600b3060 0x7f7e60153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5effd700 1 -- 172.21.15.12:0/2196846073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5400b1e0 con 0x7f7e600b7370 2021-10-20T23:28:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.184+0000 7f7e5effd700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b7370 0x7f7e600ad650 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f7e54002f70 tx=0x7f7e54015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e5cff9700 1 -- 172.21.15.12:0/2196846073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5400d940 con 0x7f7e600b7370 2021-10-20T23:28:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e5cff9700 1 -- 172.21.15.12:0/2196846073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e54011b80 con 0x7f7e600b7370 2021-10-20T23:28:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e60154180 con 0x7f7e600b7370 2021-10-20T23:28:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e5cff9700 1 -- 172.21.15.12:0/2196846073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5401e460 con 0x7f7e600b7370 2021-10-20T23:28:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e600acfe0 con 0x7f7e600b7370 2021-10-20T23:28:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e60057350 con 0x7f7e600b7370 2021-10-20T23:28:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e5cff9700 1 -- 172.21.15.12:0/2196846073 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e5401a040 con 0x7f7e600b7370 2021-10-20T23:28:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e5cff9700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7e40053610 0x7f7e40055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e5cff9700 1 -- 172.21.15.12:0/2196846073 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f7e5406c770 con 0x7f7e600b7370 2021-10-20T23:28:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e5f7fe700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7e40053610 0x7f7e40055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.188+0000 7f7e5f7fe700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7e40053610 0x7f7e40055ad0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f7e5000c000 tx=0x7f7e50008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.196+0000 7f7e5cff9700 1 -- 172.21.15.12:0/2196846073 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e540439a0 con 0x7f7e600b7370 2021-10-20T23:28:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:43.320+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7e600601a0 con 0x7f7e600b7370 2021-10-20T23:28:44.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.048+0000 7f7e5cff9700 1 -- 172.21.15.12:0/2196846073 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v140) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7e54023020 con 0x7f7e600b7370 2021-10-20T23:28:44.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7e40053610 msgr2=0x7f7e40055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7e40053610 0x7f7e40055ad0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f7e5000c000 tx=0x7f7e50008040).stop 2021-10-20T23:28:44.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b7370 msgr2=0x7f7e600ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b7370 0x7f7e600ad650 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f7e54002f70 tx=0x7f7e54015000).stop 2021-10-20T23:28:44.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 shutdown_connections 2021-10-20T23:28:44.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7e40053610 0x7f7e40055ad0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e6013e710 0x7f7e600acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e600b7370 0x7f7e600ad650 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 --2- 172.21.15.12:0/2196846073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600b3060 0x7f7e60153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 >> 172.21.15.12:0/2196846073 conn(0x7f7e6005f6b0 msgr2=0x7f7e6005cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:44.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 shutdown_connections 2021-10-20T23:28:44.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.052+0000 7f7e64de8700 1 -- 172.21.15.12:0/2196846073 wait complete. 2021-10-20T23:28:44.071 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:28:44.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:28:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba759e700 1 Processor -- start 2021-10-20T23:28:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba759e700 1 -- start start 2021-10-20T23:28:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ba80ace70 0x7f4ba8143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba8143920 con 0x7f4ba80b0710 2021-10-20T23:28:44.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba80b0af0 con 0x7f4ba80b30d0 2021-10-20T23:28:44.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba80ae680 con 0x7f4ba80ace70 2021-10-20T23:28:44.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4ba80b0710 0x7f4ba8142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43058/0 (socket says 172.21.15.12:43058) 2021-10-20T23:28:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba659c700 1 -- 172.21.15.12:0/705252418 learned_addr learned my addr 172.21.15.12:0/705252418 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba6d9d700 1 --2- 172.21.15.12:0/705252418 >> v2:172.21.15.31:3300/0 conn(0x7f4ba80ace70 0x7f4ba8143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba559a700 1 -- 172.21.15.12:0/705252418 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916451614 0 0) 0x7f4ba8143920 con 0x7f4ba80b0710 2021-10-20T23:28:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba559a700 1 -- 172.21.15.12:0/705252418 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b8c003260 con 0x7f4ba80b0710 2021-10-20T23:28:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba559a700 1 -- 172.21.15.12:0/705252418 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52121334 0 0) 0x7f4ba80b0af0 con 0x7f4ba80b30d0 2021-10-20T23:28:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba559a700 1 -- 172.21.15.12:0/705252418 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba8143920 con 0x7f4ba80b30d0 2021-10-20T23:28:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba6d9d700 1 -- 172.21.15.12:0/705252418 >> v1:172.21.15.31:6789/0 conn(0x7f4ba80b30d0 legacy=0x7f4ba813f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba6d9d700 1 -- 172.21.15.12:0/705252418 >> v1:172.21.15.12:6789/0 conn(0x7f4ba80b0710 legacy=0x7f4ba8142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba6d9d700 1 -- 172.21.15.12:0/705252418 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba80ae920 con 0x7f4ba80ace70 2021-10-20T23:28:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.180+0000 7f4ba6d9d700 1 --2- 172.21.15.12:0/705252418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba80ace70 0x7f4ba8143430 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f4ba00032f0 tx=0x7f4ba000a370).ready entity=mon.1 client_cookie=9ced4e17cb914773 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba559a700 1 -- 172.21.15.12:0/705252418 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ba0014070 con 0x7f4ba80ace70 2021-10-20T23:28:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba559a700 1 -- 172.21.15.12:0/705252418 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba000cb70 con 0x7f4ba80ace70 2021-10-20T23:28:44.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba559a700 1 -- 172.21.15.12:0/705252418 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ba000ae80 con 0x7f4ba80ace70 2021-10-20T23:28:44.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba759e700 1 -- 172.21.15.12:0/705252418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba80ace70 msgr2=0x7f4ba8143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba759e700 1 --2- 172.21.15.12:0/705252418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba80ace70 0x7f4ba8143430 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f4ba00032f0 tx=0x7f4ba000a370).stop 2021-10-20T23:28:44.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba759e700 1 -- 172.21.15.12:0/705252418 shutdown_connections 2021-10-20T23:28:44.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba759e700 1 --2- 172.21.15.12:0/705252418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba80ace70 0x7f4ba8143430 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba759e700 1 -- 172.21.15.12:0/705252418 >> 172.21.15.12:0/705252418 conn(0x7f4ba8061140 msgr2=0x7f4ba8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:44.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba759e700 1 -- 172.21.15.12:0/705252418 shutdown_connections 2021-10-20T23:28:44.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.184+0000 7f4ba759e700 1 -- 172.21.15.12:0/705252418 wait complete. 2021-10-20T23:28:44.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 Processor -- start 2021-10-20T23:28:44.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 -- start start 2021-10-20T23:28:44.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba80ace70 0x7f4ba8064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba80b0710 0x7f4ba80666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba80b30d0 0x7f4ba8152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba813efc0 con 0x7f4ba80ace70 2021-10-20T23:28:44.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80a3c50 con 0x7f4ba80b30d0 2021-10-20T23:28:44.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80a3ef0 con 0x7f4ba80b0710 2021-10-20T23:28:44.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba80ace70 0x7f4ba8064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba80ace70 0x7f4ba8064b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44470/0 (socket says 172.21.15.12:44470) 2021-10-20T23:28:44.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba659c700 1 -- 172.21.15.12:0/4194554699 learned_addr learned my addr 172.21.15.12:0/4194554699 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:44.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba6d9d700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba80b30d0 0x7f4ba8152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba5d9b700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba80b0710 0x7f4ba80666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba659c700 1 -- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba80b0710 msgr2=0x7f4ba80666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba659c700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba80b0710 0x7f4ba80666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba659c700 1 -- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba80b30d0 msgr2=0x7f4ba8152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba659c700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba80b30d0 0x7f4ba8152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba659c700 1 -- 172.21.15.12:0/4194554699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba000a610 con 0x7f4ba80ace70 2021-10-20T23:28:44.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba659c700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba80ace70 0x7f4ba8064b60 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f4b980011d0 tx=0x7f4b98007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:44.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4b977fe700 1 -- 172.21.15.12:0/4194554699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b980070d0 con 0x7f4ba80ace70 2021-10-20T23:28:44.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4b977fe700 1 -- 172.21.15.12:0/4194554699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98007230 con 0x7f4ba80ace70 2021-10-20T23:28:44.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba80a4190 con 0x7f4ba80ace70 2021-10-20T23:28:44.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4b977fe700 1 -- 172.21.15.12:0/4194554699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b98005610 con 0x7f4ba80ace70 2021-10-20T23:28:44.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.188+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba8065050 con 0x7f4ba80ace70 2021-10-20T23:28:44.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.192+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba8057350 con 0x7f4ba80ace70 2021-10-20T23:28:44.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.192+0000 7f4b977fe700 1 -- 172.21.15.12:0/4194554699 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b9801a060 con 0x7f4ba80ace70 2021-10-20T23:28:44.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.192+0000 7f4b977fe700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b84053640 0x7f4b84055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.192+0000 7f4b977fe700 1 -- 172.21.15.12:0/4194554699 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f4b9806b140 con 0x7f4ba80ace70 2021-10-20T23:28:44.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.192+0000 7f4ba5d9b700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b84053640 0x7f4b84055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.192+0000 7f4ba5d9b700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b84053640 0x7f4b84055b00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f4b9c00d000 tx=0x7f4b9c007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:44.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.200+0000 7f4b977fe700 1 -- 172.21.15.12:0/4194554699 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b98042140 con 0x7f4ba80ace70 2021-10-20T23:28:44.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.364+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4ba80b2c70 con 0x7f4ba80ace70 2021-10-20T23:28:44.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.376+0000 7f4b977fe700 1 -- 172.21.15.12:0/4194554699 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v71) v1 ==== 189+0+0 (secure 0 0 0) 0x7f4b98018020 con 0x7f4ba80ace70 2021-10-20T23:28:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b84053640 msgr2=0x7f4b84055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b84053640 0x7f4b84055b00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f4b9c00d000 tx=0x7f4b9c007a00).stop 2021-10-20T23:28:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba80ace70 msgr2=0x7f4ba8064b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba80ace70 0x7f4ba8064b60 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f4b980011d0 tx=0x7f4b98007b50).stop 2021-10-20T23:28:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 shutdown_connections 2021-10-20T23:28:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4b84053640 0x7f4b84055b00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba80b30d0 0x7f4ba8152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba80b0710 0x7f4ba80666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 --2- 172.21.15.12:0/4194554699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba80ace70 0x7f4ba8064b60 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 >> 172.21.15.12:0/4194554699 conn(0x7f4ba8061140 msgr2=0x7f4ba8142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 shutdown_connections 2021-10-20T23:28:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.380+0000 7f4ba759e700 1 -- 172.21.15.12:0/4194554699 wait complete. 2021-10-20T23:28:44.398 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 25 and data pool 26 2021-10-20T23:28:44.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:28:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da47e1700 1 Processor -- start 2021-10-20T23:28:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da47e1700 1 -- start start 2021-10-20T23:28:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da47e1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 0x7f6d9c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da47e1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d9c143de0 0x7f6d9c14b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da47e1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c0aabb0 con 0x7f6d9c060100 2021-10-20T23:28:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da47e1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c0604e0 con 0x7f6d9c143de0 2021-10-20T23:28:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da47e1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c066ea0 con 0x7f6d9c067300 2021-10-20T23:28:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da2d7e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d9c143de0 0x7f6d9c14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da2d7e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d9c143de0 0x7f6d9c14b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44482/0 (socket says 172.21.15.12:44482) 2021-10-20T23:28:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da2d7e700 1 -- 172.21.15.12:0/3648867660 learned_addr learned my addr 172.21.15.12:0/3648867660 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da1d7c700 1 --2- 172.21.15.12:0/3648867660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 0x7f6d9c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da2d7e700 1 -- 172.21.15.12:0/3648867660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 msgr2=0x7f6d9c1438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da2d7e700 1 --2- 172.21.15.12:0/3648867660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 0x7f6d9c1438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da2d7e700 1 -- 172.21.15.12:0/3648867660 >> v1:172.21.15.31:6789/0 conn(0x7f6d9c060100 legacy=0x7f6d9c0b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da2d7e700 1 -- 172.21.15.12:0/3648867660 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0b33b0 con 0x7f6d9c143de0 2021-10-20T23:28:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da2d7e700 1 --2- 172.21.15.12:0/3648867660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c143de0 0x7f6d9c14b850 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f6d94002f70 tx=0x7f6d94006eb0).ready entity=mon.0 client_cookie=31c4e3a52367f30b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da157b700 1 -- 172.21.15.12:0/3648867660 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d9400d570 con 0x7f6d9c143de0 2021-10-20T23:28:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da157b700 1 -- 172.21.15.12:0/3648867660 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94000e90 con 0x7f6d9c143de0 2021-10-20T23:28:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.488+0000 7f6da157b700 1 -- 172.21.15.12:0/3648867660 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d9400d900 con 0x7f6d9c143de0 2021-10-20T23:28:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 -- 172.21.15.12:0/3648867660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c143de0 msgr2=0x7f6d9c14b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 --2- 172.21.15.12:0/3648867660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c143de0 0x7f6d9c14b850 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f6d94002f70 tx=0x7f6d94006eb0).stop 2021-10-20T23:28:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 -- 172.21.15.12:0/3648867660 shutdown_connections 2021-10-20T23:28:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 --2- 172.21.15.12:0/3648867660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c143de0 0x7f6d9c14b850 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 --2- 172.21.15.12:0/3648867660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 0x7f6d9c1438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 -- 172.21.15.12:0/3648867660 >> 172.21.15.12:0/3648867660 conn(0x7f6d9c05cf30 msgr2=0x7f6d9c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 -- 172.21.15.12:0/3648867660 shutdown_connections 2021-10-20T23:28:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 -- 172.21.15.12:0/3648867660 wait complete. 2021-10-20T23:28:44.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 Processor -- start 2021-10-20T23:28:44.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.492+0000 7f6da47e1700 1 -- start start 2021-10-20T23:28:44.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da47e1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c060100 0x7f6d9c0a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da47e1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 0x7f6d9c0a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da47e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9c143de0 0x7f6d9c0aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da47e1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c09f500 con 0x7f6d9c060100 2021-10-20T23:28:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da47e1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0aeb60 con 0x7f6d9c143de0 2021-10-20T23:28:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da47e1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0aed90 con 0x7f6d9c067300 2021-10-20T23:28:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da257d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c060100 0x7f6d9c0a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da2d7e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9c143de0 0x7f6d9c0aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da1d7c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 0x7f6d9c0a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da257d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c060100 0x7f6d9c0a0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44484/0 (socket says 172.21.15.12:44484) 2021-10-20T23:28:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da257d700 1 -- 172.21.15.12:0/86686940 learned_addr learned my addr 172.21.15.12:0/86686940 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da2d7e700 1 -- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 msgr2=0x7f6d9c0a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da2d7e700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 0x7f6d9c0a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da2d7e700 1 -- 172.21.15.12:0/86686940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c060100 msgr2=0x7f6d9c0a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da2d7e700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c060100 0x7f6d9c0a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da2d7e700 1 -- 172.21.15.12:0/86686940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9400b1e0 con 0x7f6d9c143de0 2021-10-20T23:28:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da2d7e700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9c143de0 0x7f6d9c0aa260 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f6d94002f70 tx=0x7f6d94015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6d8f7fe700 1 -- 172.21.15.12:0/86686940 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d940116e0 con 0x7f6d9c143de0 2021-10-20T23:28:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6d8f7fe700 1 -- 172.21.15.12:0/86686940 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94011840 con 0x7f6d9c143de0 2021-10-20T23:28:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c0af110 con 0x7f6d9c143de0 2021-10-20T23:28:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6d8f7fe700 1 -- 172.21.15.12:0/86686940 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d94011ba0 con 0x7f6d9c143de0 2021-10-20T23:28:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.496+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c0aa750 con 0x7f6d9c143de0 2021-10-20T23:28:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.500+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c0ae900 con 0x7f6d9c143de0 2021-10-20T23:28:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.500+0000 7f6d8f7fe700 1 -- 172.21.15.12:0/86686940 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d9401a040 con 0x7f6d9c143de0 2021-10-20T23:28:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.500+0000 7f6d8f7fe700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d7c053610 0x7f6d7c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.500+0000 7f6d8f7fe700 1 -- 172.21.15.12:0/86686940 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6d9406cbc0 con 0x7f6d9c143de0 2021-10-20T23:28:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.500+0000 7f6da257d700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d7c053610 0x7f6d7c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.500+0000 7f6da257d700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d7c053610 0x7f6d7c055ad0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f6d9000d000 tx=0x7f6d90007c50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.508+0000 7f6d8f7fe700 1 -- 172.21.15.12:0/86686940 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d94043ab0 con 0x7f6d9c143de0 2021-10-20T23:28:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.636+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d9c0af2a0 con 0x7f6d9c143de0 2021-10-20T23:28:44.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.636+0000 7f6d8f7fe700 1 -- 172.21.15.12:0/86686940 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f6d94023070 con 0x7f6d9c143de0 2021-10-20T23:28:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":141,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:28:44.372055+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:28:42.362682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-20T23:28:43.380308+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:28:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d7c053610 msgr2=0x7f6d7c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d7c053610 0x7f6d7c055ad0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f6d9000d000 tx=0x7f6d90007c50).stop 2021-10-20T23:28:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9c143de0 msgr2=0x7f6d9c0aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9c143de0 0x7f6d9c0aa260 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f6d94002f70 tx=0x7f6d94015000).stop 2021-10-20T23:28:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 shutdown_connections 2021-10-20T23:28:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6d7c053610 0x7f6d7c055ad0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9c143de0 0x7f6d9c0aa260 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d9c067300 0x7f6d9c0a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 --2- 172.21.15.12:0/86686940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c060100 0x7f6d9c0a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 >> 172.21.15.12:0/86686940 conn(0x7f6d9c05cf30 msgr2=0x7f6d9c0b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 shutdown_connections 2021-10-20T23:28:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.640+0000 7f6da47e1700 1 -- 172.21.15.12:0/86686940 wait complete. 2021-10-20T23:28:44.665 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:28:44.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 Processor -- start 2021-10-20T23:28:44.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 -- start start 2021-10-20T23:28:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13000b2580 0x7f130014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f13000b0010 0x7f130014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000a70c0 con 0x7f13000afbd0 2021-10-20T23:28:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000a72f0 con 0x7f13000b0010 2021-10-20T23:28:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000a7590 con 0x7f13000b2580 2021-10-20T23:28:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fe7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f13000b0010 0x7f130014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fe7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f13000b0010 0x7f130014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44492/0 (socket says 172.21.15.12:44492) 2021-10-20T23:28:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fe7fc700 1 -- 172.21.15.12:0/2556016355 learned_addr learned my addr 172.21.15.12:0/2556016355 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fe7fc700 1 -- 172.21.15.12:0/2556016355 >> v2:172.21.15.31:3300/0 conn(0x7f13000b2580 msgr2=0x7f130014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12feffd700 1 --2- 172.21.15.12:0/2556016355 >> v2:172.21.15.31:3300/0 conn(0x7f13000b2580 0x7f130014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fe7fc700 1 --2- 172.21.15.12:0/2556016355 >> v2:172.21.15.31:3300/0 conn(0x7f13000b2580 0x7f130014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fe7fc700 1 -- 172.21.15.12:0/2556016355 >> v1:172.21.15.31:6789/0 conn(0x7f13000afbd0 legacy=0x7f13000a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:44.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fe7fc700 1 -- 172.21.15.12:0/2556016355 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000a7830 con 0x7f13000b0010 2021-10-20T23:28:44.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12feffd700 1 --2- 172.21.15.12:0/2556016355 >> v2:172.21.15.31:3300/0 conn(0x7f13000b2580 0x7f130014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:28:44.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fe7fc700 1 --2- 172.21.15.12:0/2556016355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b0010 0x7f130014b330 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f130006b7c0 tx=0x7f12f8009290).ready entity=mon.0 client_cookie=e7cc02486628890 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:44.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fdffb700 1 -- 172.21.15.12:0/2556016355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f800b830 con 0x7f13000b0010 2021-10-20T23:28:44.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fdffb700 1 -- 172.21.15.12:0/2556016355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800b990 con 0x7f13000b0010 2021-10-20T23:28:44.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fdffb700 1 -- 172.21.15.12:0/2556016355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f800bb40 con 0x7f13000b0010 2021-10-20T23:28:44.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 -- 172.21.15.12:0/2556016355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b0010 msgr2=0x7f130014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 --2- 172.21.15.12:0/2556016355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b0010 0x7f130014b330 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f130006b7c0 tx=0x7f12f8009290).stop 2021-10-20T23:28:44.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 -- 172.21.15.12:0/2556016355 shutdown_connections 2021-10-20T23:28:44.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 --2- 172.21.15.12:0/2556016355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b0010 0x7f130014b330 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 --2- 172.21.15.12:0/2556016355 >> v2:172.21.15.31:3300/0 conn(0x7f13000b2580 0x7f130014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 -- 172.21.15.12:0/2556016355 >> 172.21.15.12:0/2556016355 conn(0x7f1300060180 msgr2=0x7f13000b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:44.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 -- 172.21.15.12:0/2556016355 shutdown_connections 2021-10-20T23:28:44.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.756+0000 7f12fffff700 1 -- 172.21.15.12:0/2556016355 wait complete. 2021-10-20T23:28:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.760+0000 7f12fffff700 1 Processor -- start 2021-10-20T23:28:44.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.760+0000 7f12fffff700 1 -- start start 2021-10-20T23:28:44.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.760+0000 7f12fffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13000afbd0 0x7f130005c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.760+0000 7f12fffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13000b0010 0x7f130015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.760+0000 7f12fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b2580 0x7f130015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.760+0000 7f12fffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b45a0 con 0x7f13000b2580 2021-10-20T23:28:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.760+0000 7f12fffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130015abd0 con 0x7f13000b0010 2021-10-20T23:28:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.760+0000 7f12fffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b4bd0 con 0x7f13000afbd0 2021-10-20T23:28:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b2580 0x7f130015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12feffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13000afbd0 0x7f130005c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b2580 0x7f130015a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44500/0 (socket says 172.21.15.12:44500) 2021-10-20T23:28:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12ff7fe700 1 -- 172.21.15.12:0/2552785673 learned_addr learned my addr 172.21.15.12:0/2552785673 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12fe7fc700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13000b0010 0x7f130015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12ff7fe700 1 -- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13000afbd0 msgr2=0x7f130005c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12ff7fe700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13000afbd0 0x7f130005c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12ff7fe700 1 -- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13000b0010 msgr2=0x7f130015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12ff7fe700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13000b0010 0x7f130015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12ff7fe700 1 -- 172.21.15.12:0/2552785673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009530 con 0x7f13000b2580 2021-10-20T23:28:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12ff7fe700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b2580 0x7f130015a6e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f12f0001fa0 tx=0x7f12f0007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12f7fff700 1 -- 172.21.15.12:0/2552785673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f0002da0 con 0x7f13000b2580 2021-10-20T23:28:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12f7fff700 1 -- 172.21.15.12:0/2552785673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0007030 con 0x7f13000b2580 2021-10-20T23:28:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000b4e70 con 0x7f13000b2580 2021-10-20T23:28:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12f7fff700 1 -- 172.21.15.12:0/2552785673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f0007390 con 0x7f13000b2580 2021-10-20T23:28:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13000660e0 con 0x7f13000b2580 2021-10-20T23:28:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1300057350 con 0x7f13000b2580 2021-10-20T23:28:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.764+0000 7f12f7fff700 1 -- 172.21.15.12:0/2552785673 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f12f0010030 con 0x7f13000b2580 2021-10-20T23:28:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.768+0000 7f12f7fff700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e40536a0 0x7f12e4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.768+0000 7f12f7fff700 1 -- 172.21.15.12:0/2552785673 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f12f006b5e0 con 0x7f13000b2580 2021-10-20T23:28:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.768+0000 7f12feffd700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e40536a0 0x7f12e4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.768+0000 7f12feffd700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e40536a0 0x7f12e4055b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f12e800d000 tx=0x7f12e8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.772+0000 7f12f7fff700 1 -- 172.21.15.12:0/2552785673 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f12f00425e0 con 0x7f13000b2580 2021-10-20T23:28:44.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.900+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f130005d1b0 con 0x7f13000b2580 2021-10-20T23:28:44.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12f7fff700 1 -- 172.21.15.12:0/2552785673 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f12f0045c00 con 0x7f13000b2580 2021-10-20T23:28:44.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:44.916 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":141,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:28:44.372055+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:28:42.362682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-20T23:28:43.380308+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:28:44.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e40536a0 msgr2=0x7f12e4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e40536a0 0x7f12e4055b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f12e800d000 tx=0x7f12e8008040).stop 2021-10-20T23:28:44.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b2580 msgr2=0x7f130015a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:44.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b2580 0x7f130015a6e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f12f0001fa0 tx=0x7f12f0007c00).stop 2021-10-20T23:28:44.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 shutdown_connections 2021-10-20T23:28:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12e40536a0 0x7f12e4055b60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13000b2580 0x7f130015a6e0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13000b0010 0x7f130015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 --2- 172.21.15.12:0/2552785673 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13000afbd0 0x7f130005c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:44.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.904+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 >> 172.21.15.12:0/2552785673 conn(0x7f1300060180 msgr2=0x7f1300149b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:44.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.908+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 shutdown_connections 2021-10-20T23:28:44.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:44.908+0000 7f12fffff700 1 -- 172.21.15.12:0/2552785673 wait complete. 2021-10-20T23:28:44.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:28:45.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.036+0000 7fa7aa923700 1 Processor -- start 2021-10-20T23:28:45.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.036+0000 7fa7aa923700 1 -- start start 2021-10-20T23:28:45.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7a40607d0 0x7fa7a41400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7a40ac500 0x7fa7a4140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a405fe80 con 0x7fa7a405faa0 2021-10-20T23:28:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a4143240 con 0x7fa7a40ac500 2021-10-20T23:28:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a40acc60 con 0x7fa7a40607d0 2021-10-20T23:28:45.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a8ec0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7a40ac500 0x7fa7a4140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a3fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa7a405faa0 0x7fa7a41438d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43098/0 (socket says 172.21.15.12:43098) 2021-10-20T23:28:45.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a3fff700 1 -- 172.21.15.12:0/946706536 learned_addr learned my addr 172.21.15.12:0/946706536 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:45.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa79bfff700 1 --2- 172.21.15.12:0/946706536 >> v2:172.21.15.31:3300/0 conn(0x7fa7a40607d0 0x7fa7a41400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a37fe700 1 -- 172.21.15.12:0/946706536 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620291682 0 0) 0x7fa7a405fe80 con 0x7fa7a405faa0 2021-10-20T23:28:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a37fe700 1 -- 172.21.15.12:0/946706536 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa788003260 con 0x7fa7a405faa0 2021-10-20T23:28:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa79bfff700 1 -- 172.21.15.12:0/946706536 >> v2:172.21.15.12:3300/0 conn(0x7fa7a40ac500 msgr2=0x7fa7a4140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa79bfff700 1 --2- 172.21.15.12:0/946706536 >> v2:172.21.15.12:3300/0 conn(0x7fa7a40ac500 0x7fa7a4140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa79bfff700 1 -- 172.21.15.12:0/946706536 >> v1:172.21.15.12:6789/0 conn(0x7fa7a405faa0 legacy=0x7fa7a41438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a37fe700 1 -- 172.21.15.12:0/946706536 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272164023 0 0) 0x7fa788003260 con 0x7fa7a405faa0 2021-10-20T23:28:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa79bfff700 1 -- 172.21.15.12:0/946706536 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a40acf00 con 0x7fa7a40607d0 2021-10-20T23:28:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a8ec0700 1 --2- 172.21.15.12:0/946706536 >> v2:172.21.15.12:3300/0 conn(0x7fa7a40ac500 0x7fa7a4140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa79bfff700 1 --2- 172.21.15.12:0/946706536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40607d0 0x7fa7a41400a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fa794001800 tx=0x7fa78c006df0).ready entity=mon.1 client_cookie=eae235b4a6e2a6be server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a37fe700 1 -- 172.21.15.12:0/946706536 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa794001660 con 0x7fa7a40607d0 2021-10-20T23:28:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a37fe700 1 -- 172.21.15.12:0/946706536 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c000e90 con 0x7fa7a40607d0 2021-10-20T23:28:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7a37fe700 1 -- 172.21.15.12:0/946706536 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa78c012460 con 0x7fa7a40607d0 2021-10-20T23:28:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 -- 172.21.15.12:0/946706536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40607d0 msgr2=0x7fa7a41400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 --2- 172.21.15.12:0/946706536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40607d0 0x7fa7a41400a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fa794001800 tx=0x7fa78c006df0).stop 2021-10-20T23:28:45.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 -- 172.21.15.12:0/946706536 shutdown_connections 2021-10-20T23:28:45.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 --2- 172.21.15.12:0/946706536 >> v2:172.21.15.12:3300/0 conn(0x7fa7a40ac500 0x7fa7a4140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 --2- 172.21.15.12:0/946706536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40607d0 0x7fa7a41400a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 -- 172.21.15.12:0/946706536 >> 172.21.15.12:0/946706536 conn(0x7fa7a40b2970 msgr2=0x7fa7a40b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:45.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 -- 172.21.15.12:0/946706536 shutdown_connections 2021-10-20T23:28:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.040+0000 7fa7aa923700 1 -- 172.21.15.12:0/946706536 wait complete. 2021-10-20T23:28:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7aa923700 1 Processor -- start 2021-10-20T23:28:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7aa923700 1 -- start start 2021-10-20T23:28:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7aa923700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7a405faa0 0x7fa7a4146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7aa923700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7a40607d0 0x7fa7a40b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7aa923700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40ac500 0x7fa7a4152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7aa923700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40af030 con 0x7fa7a405faa0 2021-10-20T23:28:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7aa923700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40b5cc0 con 0x7fa7a40ac500 2021-10-20T23:28:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7aa923700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40b5a20 con 0x7fa7a40607d0 2021-10-20T23:28:45.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7a405faa0 0x7fa7a4146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7a405faa0 0x7fa7a4146400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44510/0 (socket says 172.21.15.12:44510) 2021-10-20T23:28:45.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a3fff700 1 -- 172.21.15.12:0/768747451 learned_addr learned my addr 172.21.15.12:0/768747451 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:45.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa79bfff700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7a40607d0 0x7fa7a40b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a8ec0700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40ac500 0x7fa7a4152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a3fff700 1 -- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7a40607d0 msgr2=0x7fa7a40b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a3fff700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7a40607d0 0x7fa7a40b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a3fff700 1 -- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40ac500 msgr2=0x7fa7a4152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a3fff700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40ac500 0x7fa7a4152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a3fff700 1 -- 172.21.15.12:0/768747451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c009470 con 0x7fa7a405faa0 2021-10-20T23:28:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.044+0000 7fa7a8ec0700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40ac500 0x7fa7a4152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.048+0000 7fa7a3fff700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7a405faa0 0x7fa7a4146400 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fa7940018c0 tx=0x7fa794001230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.048+0000 7fa7a1ffb700 1 -- 172.21.15.12:0/768747451 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79400ce40 con 0x7fa7a405faa0 2021-10-20T23:28:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.048+0000 7fa7a1ffb700 1 -- 172.21.15.12:0/768747451 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794007170 con 0x7fa7a405faa0 2021-10-20T23:28:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.048+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c00b180 con 0x7fa7a405faa0 2021-10-20T23:28:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.048+0000 7fa7a1ffb700 1 -- 172.21.15.12:0/768747451 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa794004730 con 0x7fa7a405faa0 2021-10-20T23:28:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.048+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a41528b0 con 0x7fa7a405faa0 2021-10-20T23:28:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.048+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a41533e0 con 0x7fa7a405faa0 2021-10-20T23:28:45.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.048+0000 7fa7a1ffb700 1 -- 172.21.15.12:0/768747451 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa794004890 con 0x7fa7a405faa0 2021-10-20T23:28:45.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.052+0000 7fa7a1ffb700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa77c053610 0x7fa77c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.052+0000 7fa7a1ffb700 1 -- 172.21.15.12:0/768747451 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa79406b6b0 con 0x7fa7a405faa0 2021-10-20T23:28:45.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.052+0000 7fa79bfff700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa77c053610 0x7fa77c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.052+0000 7fa79bfff700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa77c053610 0x7fa77c055ad0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fa78c01a000 tx=0x7fa78c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:45.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.060+0000 7fa7a1ffb700 1 -- 172.21.15.12:0/768747451 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa794042540 con 0x7fa7a405faa0 2021-10-20T23:28:45.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.224+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa7a4057350 con 0x7fa7a405faa0 2021-10-20T23:28:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.376+0000 7fa7a1ffb700 1 -- 172.21.15.12:0/768747451 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v72) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa794045b60 con 0x7fa7a405faa0 2021-10-20T23:28:45.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa77c053610 msgr2=0x7fa77c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa77c053610 0x7fa77c055ad0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fa78c01a000 tx=0x7fa78c014000).stop 2021-10-20T23:28:45.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7a405faa0 msgr2=0x7fa7a4146400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7a405faa0 0x7fa7a4146400 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fa7940018c0 tx=0x7fa794001230).stop 2021-10-20T23:28:45.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 shutdown_connections 2021-10-20T23:28:45.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa77c053610 0x7fa77c055ad0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a40ac500 0x7fa7a4152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7a40607d0 0x7fa7a40b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 --2- 172.21.15.12:0/768747451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7a405faa0 0x7fa7a4146400 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 >> 172.21.15.12:0/768747451 conn(0x7fa7a40b2970 msgr2=0x7fa7a4141c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:45.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 shutdown_connections 2021-10-20T23:28:45.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.380+0000 7fa7aa923700 1 -- 172.21.15.12:0/768747451 wait complete. 2021-10-20T23:28:45.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:45.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03e738700 1 Processor -- start 2021-10-20T23:28:45.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03e738700 1 -- start start 2021-10-20T23:28:45.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03e738700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff0380b6290 0x7ff038061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03e738700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0380b4060 0x7ff038061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03e738700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0380b5f50 con 0x7ff038061e50 2021-10-20T23:28:45.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03e738700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0380b1f70 con 0x7ff0380b6290 2021-10-20T23:28:45.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03e738700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380b2210 con 0x7ff0380b4060 2021-10-20T23:28:45.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03df37700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff038061e50 0x7ff038146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43114/0 (socket says 172.21.15.12:43114) 2021-10-20T23:28:45.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03df37700 1 -- 172.21.15.12:0/1773167964 learned_addr learned my addr 172.21.15.12:0/1773167964 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:45.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03d736700 1 --2- 172.21.15.12:0/1773167964 >> v2:172.21.15.31:3300/0 conn(0x7ff0380b6290 0x7ff038061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff03cf35700 1 --2- 172.21.15.12:0/1773167964 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0380b4060 0x7ff038061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.504+0000 7ff02ffff700 1 -- 172.21.15.12:0/1773167964 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371304576 0 0) 0x7ff030001110 con 0x7ff038061e50 2021-10-20T23:28:45.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff02ffff700 1 -- 172.21.15.12:0/1773167964 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff01c003260 con 0x7ff038061e50 2021-10-20T23:28:45.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03d736700 1 -- 172.21.15.12:0/1773167964 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0380b4060 msgr2=0x7ff038061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:45.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03d736700 1 --2- 172.21.15.12:0/1773167964 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0380b4060 0x7ff038061960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03d736700 1 -- 172.21.15.12:0/1773167964 >> v1:172.21.15.12:6789/0 conn(0x7ff038061e50 legacy=0x7ff038146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff02ffff700 1 -- 172.21.15.12:0/1773167964 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 45702606 0 0) 0x7ff01c003260 con 0x7ff038061e50 2021-10-20T23:28:45.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03d736700 1 -- 172.21.15.12:0/1773167964 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0380b24b0 con 0x7ff0380b6290 2021-10-20T23:28:45.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03d736700 1 --2- 172.21.15.12:0/1773167964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b6290 0x7ff038061470 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7ff030001990 tx=0x7ff0340091d0).ready entity=mon.1 client_cookie=cd26d53fac5c85c7 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:45.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff02ffff700 1 -- 172.21.15.12:0/1773167964 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0300017f0 con 0x7ff0380b6290 2021-10-20T23:28:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff02ffff700 1 -- 172.21.15.12:0/1773167964 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03400f510 con 0x7ff0380b6290 2021-10-20T23:28:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff02ffff700 1 -- 172.21.15.12:0/1773167964 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff03400f680 con 0x7ff0380b6290 2021-10-20T23:28:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 -- 172.21.15.12:0/1773167964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b6290 msgr2=0x7ff038061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 --2- 172.21.15.12:0/1773167964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b6290 0x7ff038061470 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7ff030001990 tx=0x7ff0340091d0).stop 2021-10-20T23:28:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 -- 172.21.15.12:0/1773167964 shutdown_connections 2021-10-20T23:28:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 --2- 172.21.15.12:0/1773167964 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff0380b4060 0x7ff038061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 --2- 172.21.15.12:0/1773167964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b6290 0x7ff038061470 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 -- 172.21.15.12:0/1773167964 >> 172.21.15.12:0/1773167964 conn(0x7ff03805c490 msgr2=0x7ff03805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 -- 172.21.15.12:0/1773167964 shutdown_connections 2021-10-20T23:28:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 -- 172.21.15.12:0/1773167964 wait complete. 2021-10-20T23:28:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 Processor -- start 2021-10-20T23:28:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.508+0000 7ff03e738700 1 -- start start 2021-10-20T23:28:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03e738700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff038061e50 0x7ff038145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03e738700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b4060 0x7ff038156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03e738700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0380b6290 0x7ff038152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03e738700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff038142470 con 0x7ff0380b6290 2021-10-20T23:28:45.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03e738700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380ada90 con 0x7ff0380b4060 2021-10-20T23:28:45.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03e738700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380b03e0 con 0x7ff038061e50 2021-10-20T23:28:45.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03df37700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0380b6290 0x7ff038152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03cf35700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b4060 0x7ff038156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03d736700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff038061e50 0x7ff038145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03d736700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff038061e50 0x7ff038145f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:50282/0 (socket says 172.21.15.12:50282) 2021-10-20T23:28:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03cf35700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b4060 0x7ff038156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:59500/0 (socket says 172.21.15.12:59500) 2021-10-20T23:28:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03d736700 1 -- 172.21.15.12:0/2599527126 learned_addr learned my addr 172.21.15.12:0/2599527126 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03d736700 1 -- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b4060 msgr2=0x7ff038156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03d736700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b4060 0x7ff038156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03d736700 1 -- 172.21.15.12:0/2599527126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0380b6290 msgr2=0x7ff038152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03d736700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0380b6290 0x7ff038152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03d736700 1 -- 172.21.15.12:0/2599527126 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034009470 con 0x7ff038061e50 2021-10-20T23:28:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03df37700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0380b6290 0x7ff038152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:45.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03d736700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff038061e50 0x7ff038145f80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff0381425b0 tx=0x7ff034016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:45.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff02e7fc700 1 -- 172.21.15.12:0/2599527126 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff03400f680 con 0x7ff038061e50 2021-10-20T23:28:45.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff02e7fc700 1 -- 172.21.15.12:0/2599527126 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0340032f0 con 0x7ff038061e50 2021-10-20T23:28:45.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0380b0680 con 0x7ff038061e50 2021-10-20T23:28:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff02e7fc700 1 -- 172.21.15.12:0/2599527126 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff034021670 con 0x7ff038061e50 2021-10-20T23:28:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.512+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0381526d0 con 0x7ff038061e50 2021-10-20T23:28:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.516+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0380b0b20 con 0x7ff038061e50 2021-10-20T23:28:45.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.516+0000 7ff02e7fc700 1 -- 172.21.15.12:0/2599527126 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff03400f070 con 0x7ff038061e50 2021-10-20T23:28:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.516+0000 7ff02e7fc700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0200536a0 0x7ff020055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.516+0000 7ff02e7fc700 1 -- 172.21.15.12:0/2599527126 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff03406cef0 con 0x7ff038061e50 2021-10-20T23:28:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.516+0000 7ff03cf35700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0200536a0 0x7ff020055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.516+0000 7ff03cf35700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0200536a0 0x7ff020055b60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7ff02800b000 tx=0x7ff028006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.524+0000 7ff02e7fc700 1 -- 172.21.15.12:0/2599527126 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff034043de0 con 0x7ff038061e50 2021-10-20T23:28:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.692+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0380b2750 con 0x7ff038061e50 2021-10-20T23:28:45.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff02e7fc700 1 -- 172.21.15.12:0/2599527126 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2489 (secure 0 0 0) 0x7ff034015070 con 0x7ff038061e50 2021-10-20T23:28:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:45.707 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3304581862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3304581862},{"type":"v1","addr":"172.21.15.12:6835","nonce":3304581862}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/360437153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":360437153},{"type":"v1","addr":"172.21.15.12:6833","nonce":360437153}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:28:44.372426+0000","modified":"2021-10-20T23:28:45.375331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8025":{"gid":8025,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/546930471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":546930471},{"type":"v1","addr":"172.21.15.31:6835","nonce":546930471}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-20T23:28:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0200536a0 msgr2=0x7ff020055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0200536a0 0x7ff020055b60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7ff02800b000 tx=0x7ff028006df0).stop 2021-10-20T23:28:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff038061e50 msgr2=0x7ff038145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff038061e50 0x7ff038145f80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff0381425b0 tx=0x7ff034016000).stop 2021-10-20T23:28:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 shutdown_connections 2021-10-20T23:28:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff0200536a0 0x7ff020055b60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0380b6290 0x7ff038152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0380b4060 0x7ff038156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 --2- 172.21.15.12:0/2599527126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff038061e50 0x7ff038145f80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 >> 172.21.15.12:0/2599527126 conn(0x7ff03805c490 msgr2=0x7ff0380b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 shutdown_connections 2021-10-20T23:28:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.696+0000 7ff03e738700 1 -- 172.21.15.12:0/2599527126 wait complete. 2021-10-20T23:28:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 72 2021-10-20T23:28:45.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:28:45.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.812+0000 7fdc1d938700 1 Processor -- start 2021-10-20T23:28:45.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.812+0000 7fdc1d938700 1 -- start start 2021-10-20T23:28:45.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc180b1db0 0x7fdc180b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc181483a0 0x7fdc180b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc180b0350 con 0x7fdc180a70c0 2021-10-20T23:28:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180a90c0 con 0x7fdc181483a0 2021-10-20T23:28:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180b05f0 con 0x7fdc180b1db0 2021-10-20T23:28:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc167fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc181483a0 0x7fdc180b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc177fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdc180a70c0 0x7fdc18144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43130/0 (socket says 172.21.15.12:43130) 2021-10-20T23:28:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc177fe700 1 -- 172.21.15.12:0/156726141 learned_addr learned my addr 172.21.15.12:0/156726141 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc16ffd700 1 --2- 172.21.15.12:0/156726141 >> v2:172.21.15.31:3300/0 conn(0x7fdc180b1db0 0x7fdc180b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc167fc700 1 -- 172.21.15.12:0/156726141 >> v2:172.21.15.31:3300/0 conn(0x7fdc180b1db0 msgr2=0x7fdc180b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc167fc700 1 --2- 172.21.15.12:0/156726141 >> v2:172.21.15.31:3300/0 conn(0x7fdc180b1db0 0x7fdc180b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc167fc700 1 -- 172.21.15.12:0/156726141 >> v1:172.21.15.12:6789/0 conn(0x7fdc180a70c0 legacy=0x7fdc18144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc167fc700 1 -- 172.21.15.12:0/156726141 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180b0890 con 0x7fdc181483a0 2021-10-20T23:28:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc15ffb700 1 -- 172.21.15.12:0/156726141 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892948438 0 0) 0x7fdc180b0350 con 0x7fdc180a70c0 2021-10-20T23:28:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc167fc700 1 --2- 172.21.15.12:0/156726141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 0x7fdc180b2190 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fdc18147730 tx=0x7fdc00006df0).ready entity=mon.0 client_cookie=7fdf8315d6b1f1c5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc15ffb700 1 -- 172.21.15.12:0/156726141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc0000d5c0 con 0x7fdc181483a0 2021-10-20T23:28:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc15ffb700 1 -- 172.21.15.12:0/156726141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc00000e90 con 0x7fdc181483a0 2021-10-20T23:28:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc15ffb700 1 -- 172.21.15.12:0/156726141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc0000d910 con 0x7fdc181483a0 2021-10-20T23:28:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 -- 172.21.15.12:0/156726141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 msgr2=0x7fdc180b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 --2- 172.21.15.12:0/156726141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 0x7fdc180b2190 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fdc18147730 tx=0x7fdc00006df0).stop 2021-10-20T23:28:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 -- 172.21.15.12:0/156726141 shutdown_connections 2021-10-20T23:28:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 --2- 172.21.15.12:0/156726141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 0x7fdc180b2190 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 --2- 172.21.15.12:0/156726141 >> v2:172.21.15.31:3300/0 conn(0x7fdc180b1db0 0x7fdc180b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 -- 172.21.15.12:0/156726141 >> 172.21.15.12:0/156726141 conn(0x7fdc1805f6b0 msgr2=0x7fdc1805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 -- 172.21.15.12:0/156726141 shutdown_connections 2021-10-20T23:28:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 -- 172.21.15.12:0/156726141 wait complete. 2021-10-20T23:28:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 Processor -- start 2021-10-20T23:28:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.816+0000 7fdc1d938700 1 -- start start 2021-10-20T23:28:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc1d938700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180a70c0 0x7fdc180a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc1d938700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180b1db0 0x7fdc180ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc1d938700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 0x7fdc1814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc1d938700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180ab350 con 0x7fdc181483a0 2021-10-20T23:28:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc1d938700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180ab5f0 con 0x7fdc180b1db0 2021-10-20T23:28:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc1d938700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180ab890 con 0x7fdc180a70c0 2021-10-20T23:28:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 0x7fdc1814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 0x7fdc1814a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44542/0 (socket says 172.21.15.12:44542) 2021-10-20T23:28:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc177fe700 1 -- 172.21.15.12:0/1477929817 learned_addr learned my addr 172.21.15.12:0/1477929817 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc16ffd700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180a70c0 0x7fdc180a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc167fc700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180b1db0 0x7fdc180ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc177fe700 1 -- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180a70c0 msgr2=0x7fdc180a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc177fe700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180a70c0 0x7fdc180a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc177fe700 1 -- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180b1db0 msgr2=0x7fdc180ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc177fe700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180b1db0 0x7fdc180ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc177fe700 1 -- 172.21.15.12:0/1477929817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0000b180 con 0x7fdc181483a0 2021-10-20T23:28:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc177fe700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 0x7fdc1814a300 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fdc10001250 tx=0x7fdc10007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc0ffff700 1 -- 172.21.15.12:0/1477929817 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc10005c70 con 0x7fdc181483a0 2021-10-20T23:28:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc0ffff700 1 -- 172.21.15.12:0/1477929817 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10005dd0 con 0x7fdc181483a0 2021-10-20T23:28:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc0ffff700 1 -- 172.21.15.12:0/1477929817 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc10004a90 con 0x7fdc181483a0 2021-10-20T23:28:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc180aafd0 con 0x7fdc181483a0 2021-10-20T23:28:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.820+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc180abcd0 con 0x7fdc181483a0 2021-10-20T23:28:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.824+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc180aba50 con 0x7fdc181483a0 2021-10-20T23:28:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.824+0000 7fdc0ffff700 1 -- 172.21.15.12:0/1477929817 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc10004bf0 con 0x7fdc181483a0 2021-10-20T23:28:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.824+0000 7fdc0ffff700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc0536a0 0x7fdbfc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.824+0000 7fdc0ffff700 1 -- 172.21.15.12:0/1477929817 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdc1006b6d0 con 0x7fdc181483a0 2021-10-20T23:28:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.824+0000 7fdc16ffd700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc0536a0 0x7fdbfc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.824+0000 7fdc16ffd700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc0536a0 0x7fdbfc055b60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fdc0800b000 tx=0x7fdc08006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.832+0000 7fdc0ffff700 1 -- 172.21.15.12:0/1477929817 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc100426d0 con 0x7fdc181483a0 2021-10-20T23:28:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.956+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc180b0b30 con 0x7fdc181483a0 2021-10-20T23:28:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc0ffff700 1 -- 172.21.15.12:0/1477929817 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fdc10045cf0 con 0x7fdc181483a0 2021-10-20T23:28:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:45.972 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":142,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:28:45.375943+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:28:42.362682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-20T23:28:43.380308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:28:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc0536a0 msgr2=0x7fdbfc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc0536a0 0x7fdbfc055b60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fdc0800b000 tx=0x7fdc08006df0).stop 2021-10-20T23:28:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 msgr2=0x7fdc1814a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 0x7fdc1814a300 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fdc10001250 tx=0x7fdc10007dc0).stop 2021-10-20T23:28:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 shutdown_connections 2021-10-20T23:28:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc0536a0 0x7fdbfc055b60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc181483a0 0x7fdc1814a300 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180b1db0 0x7fdc180ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 --2- 172.21.15.12:0/1477929817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180a70c0 0x7fdc180a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 >> 172.21.15.12:0/1477929817 conn(0x7fdc1805f6b0 msgr2=0x7fdc180b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:45.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 shutdown_connections 2021-10-20T23:28:45.976 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:45.960+0000 7fdc1d938700 1 -- 172.21.15.12:0/1477929817 wait complete. 2021-10-20T23:28:45.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:28:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.104+0000 7ff7c322f700 1 Processor -- start 2021-10-20T23:28:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.104+0000 7ff7c322f700 1 -- start start 2021-10-20T23:28:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c322f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b04a0 0x7ff7bc0add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c322f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7bc0aa120 0x7ff7bc0ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c322f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0b2af0 con 0x7ff7bc0b0880 2021-10-20T23:28:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c322f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc0b2770 con 0x7ff7bc0aa120 2021-10-20T23:28:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c322f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0b2d20 con 0x7ff7bc0b04a0 2021-10-20T23:28:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7bc0aa120 0x7ff7bc0ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c0fcb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b04a0 0x7ff7bc0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c17cc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff7bc0b0880 0x7ff7bc143710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:50208/0 (socket says 172.21.15.12:50208) 2021-10-20T23:28:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c17cc700 1 -- 172.21.15.12:0/654865965 learned_addr learned my addr 172.21.15.12:0/654865965 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bbfff700 1 -- 172.21.15.12:0/654865965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b04a0 msgr2=0x7ff7bc0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bbfff700 1 --2- 172.21.15.12:0/654865965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b04a0 0x7ff7bc0add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bbfff700 1 -- 172.21.15.12:0/654865965 >> v1:172.21.15.31:6789/0 conn(0x7ff7bc0b0880 legacy=0x7ff7bc143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bbfff700 1 -- 172.21.15.12:0/654865965 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0a9b70 con 0x7ff7bc0aa120 2021-10-20T23:28:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bb7fe700 1 -- 172.21.15.12:0/654865965 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756595504 0 0) 0x7ff7bc0b2af0 con 0x7ff7bc0b0880 2021-10-20T23:28:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bbfff700 1 --2- 172.21.15.12:0/654865965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0aa120 0x7ff7bc0ae220 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7ff7a8002f70 tx=0x7ff7a8006df0).ready entity=mon.1 client_cookie=c8a8a9d5cfacb687 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bb7fe700 1 -- 172.21.15.12:0/654865965 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a800d570 con 0x7ff7bc0aa120 2021-10-20T23:28:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bb7fe700 1 -- 172.21.15.12:0/654865965 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a8000e90 con 0x7ff7bc0aa120 2021-10-20T23:28:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7bb7fe700 1 -- 172.21.15.12:0/654865965 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a800d8c0 con 0x7ff7bc0aa120 2021-10-20T23:28:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c322f700 1 -- 172.21.15.12:0/654865965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0aa120 msgr2=0x7ff7bc0ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.108+0000 7ff7c322f700 1 --2- 172.21.15.12:0/654865965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0aa120 0x7ff7bc0ae220 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7ff7a8002f70 tx=0x7ff7a8006df0).stop 2021-10-20T23:28:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 -- 172.21.15.12:0/654865965 shutdown_connections 2021-10-20T23:28:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 --2- 172.21.15.12:0/654865965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0aa120 0x7ff7bc0ae220 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 --2- 172.21.15.12:0/654865965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b04a0 0x7ff7bc0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 -- 172.21.15.12:0/654865965 >> 172.21.15.12:0/654865965 conn(0x7ff7bc0607c0 msgr2=0x7ff7bc060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 -- 172.21.15.12:0/654865965 shutdown_connections 2021-10-20T23:28:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 -- 172.21.15.12:0/654865965 wait complete. 2021-10-20T23:28:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 Processor -- start 2021-10-20T23:28:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 -- start start 2021-10-20T23:28:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7bc0aa120 0x7ff7bc134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0b04a0 0x7ff7bc131880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b0880 0x7ff7bc131d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc133540 con 0x7ff7bc0aa120 2021-10-20T23:28:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc067930 con 0x7ff7bc0b04a0 2021-10-20T23:28:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c322f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc132260 con 0x7ff7bc0b0880 2021-10-20T23:28:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c0fcb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7bc0aa120 0x7ff7bc134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c0fcb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7bc0aa120 0x7ff7bc134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44552/0 (socket says 172.21.15.12:44552) 2021-10-20T23:28:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.112+0000 7ff7c0fcb700 1 -- 172.21.15.12:0/1932545967 learned_addr learned my addr 172.21.15.12:0/1932545967 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c17cc700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b0880 0x7ff7bc131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7bbfff700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0b04a0 0x7ff7bc131880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c0fcb700 1 -- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b0880 msgr2=0x7ff7bc131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c0fcb700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b0880 0x7ff7bc131d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c0fcb700 1 -- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0b04a0 msgr2=0x7ff7bc131880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c0fcb700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0b04a0 0x7ff7bc131880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c0fcb700 1 -- 172.21.15.12:0/1932545967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a800b180 con 0x7ff7bc0aa120 2021-10-20T23:28:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7bbfff700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0b04a0 0x7ff7bc131880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c0fcb700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7bc0aa120 0x7ff7bc134090 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7ff7b000c000 tx=0x7ff7b0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7b9ffb700 1 -- 172.21.15.12:0/1932545967 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b0010780 con 0x7ff7bc0aa120 2021-10-20T23:28:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7b9ffb700 1 -- 172.21.15.12:0/1932545967 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b00108e0 con 0x7ff7bc0aa120 2021-10-20T23:28:46.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc131040 con 0x7ff7bc0aa120 2021-10-20T23:28:46.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7b9ffb700 1 -- 172.21.15.12:0/1932545967 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b0010c40 con 0x7ff7bc0aa120 2021-10-20T23:28:46.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc1399d0 con 0x7ff7bc0aa120 2021-10-20T23:28:46.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc139b90 con 0x7ff7bc0aa120 2021-10-20T23:28:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.116+0000 7ff7b9ffb700 1 -- 172.21.15.12:0/1932545967 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff7b001c460 con 0x7ff7bc0aa120 2021-10-20T23:28:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.120+0000 7ff7b9ffb700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff79c0536d0 0x7ff79c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.120+0000 7ff7b9ffb700 1 -- 172.21.15.12:0/1932545967 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff7b006bf90 con 0x7ff7bc0aa120 2021-10-20T23:28:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.120+0000 7ff7bbfff700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff79c0536d0 0x7ff79c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.120+0000 7ff7bbfff700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff79c0536d0 0x7ff79c055b90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7ff7a8018000 tx=0x7ff7a8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.120+0000 7ff7b9ffb700 1 -- 172.21.15.12:0/1932545967 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff7b0042e90 con 0x7ff7bc0aa120 2021-10-20T23:28:46.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.288+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff7bc057350 con 0x7ff7bc0aa120 2021-10-20T23:28:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.296+0000 7ff7b9ffb700 1 -- 172.21.15.12:0/1932545967 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff7b00464b0 con 0x7ff7bc0aa120 2021-10-20T23:28:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff79c0536d0 msgr2=0x7ff79c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff79c0536d0 0x7ff79c055b90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7ff7a8018000 tx=0x7ff7a8014000).stop 2021-10-20T23:28:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7bc0aa120 msgr2=0x7ff7bc134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7bc0aa120 0x7ff7bc134090 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7ff7b000c000 tx=0x7ff7b0006df0).stop 2021-10-20T23:28:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 shutdown_connections 2021-10-20T23:28:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff79c0536d0 0x7ff79c055b90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7bc0b0880 0x7ff7bc131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7bc0b04a0 0x7ff7bc131880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 --2- 172.21.15.12:0/1932545967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7bc0aa120 0x7ff7bc134090 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 >> 172.21.15.12:0/1932545967 conn(0x7ff7bc0607c0 msgr2=0x7ff7bc0ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 shutdown_connections 2021-10-20T23:28:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.300+0000 7ff7c322f700 1 -- 172.21.15.12:0/1932545967 wait complete. 2021-10-20T23:28:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:28:46.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:28:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6bf2a700 1 Processor -- start 2021-10-20T23:28:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6bf2a700 1 -- start start 2021-10-20T23:28:46.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6bf2a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd640b5b40 0x7fdd640b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6bf2a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd64148040 0x7fdd641446d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6bf2a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd640b6960 con 0x7fdd640b6580 2021-10-20T23:28:46.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6bf2a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd64148480 con 0x7fdd64148040 2021-10-20T23:28:46.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6bf2a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd641474b0 con 0x7fdd640b5b40 2021-10-20T23:28:46.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6a4c7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd64148040 0x7fdd641446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6a4c7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd64148040 0x7fdd641446d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44564/0 (socket says 172.21.15.12:44564) 2021-10-20T23:28:46.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6a4c7700 1 -- 172.21.15.12:0/3938883262 learned_addr learned my addr 172.21.15.12:0/3938883262 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:46.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd694c5700 1 --2- 172.21.15.12:0/3938883262 >> v2:172.21.15.31:3300/0 conn(0x7fdd640b5b40 0x7fdd640b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6a4c7700 1 -- 172.21.15.12:0/3938883262 >> v2:172.21.15.31:3300/0 conn(0x7fdd640b5b40 msgr2=0x7fdd640b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:46.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6a4c7700 1 --2- 172.21.15.12:0/3938883262 >> v2:172.21.15.31:3300/0 conn(0x7fdd640b5b40 0x7fdd640b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6a4c7700 1 -- 172.21.15.12:0/3938883262 >> v1:172.21.15.31:6789/0 conn(0x7fdd640b6580 legacy=0x7fdd640b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6a4c7700 1 -- 172.21.15.12:0/3938883262 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd641476a0 con 0x7fdd64148040 2021-10-20T23:28:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd6a4c7700 1 --2- 172.21.15.12:0/3938883262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 0x7fdd641446d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fdd5c0032f0 tx=0x7fdd5c009290).ready entity=mon.0 client_cookie=eb6eed25d16e80f8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd68cc4700 1 -- 172.21.15.12:0/3938883262 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5c00b870 con 0x7fdd64148040 2021-10-20T23:28:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd68cc4700 1 -- 172.21.15.12:0/3938883262 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00b9d0 con 0x7fdd64148040 2021-10-20T23:28:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.444+0000 7fdd68cc4700 1 -- 172.21.15.12:0/3938883262 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5c00bb40 con 0x7fdd64148040 2021-10-20T23:28:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/3938883262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 msgr2=0x7fdd641446d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 --2- 172.21.15.12:0/3938883262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 0x7fdd641446d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fdd5c0032f0 tx=0x7fdd5c009290).stop 2021-10-20T23:28:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/3938883262 shutdown_connections 2021-10-20T23:28:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 --2- 172.21.15.12:0/3938883262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 0x7fdd641446d0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 --2- 172.21.15.12:0/3938883262 >> v2:172.21.15.31:3300/0 conn(0x7fdd640b5b40 0x7fdd640b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/3938883262 >> 172.21.15.12:0/3938883262 conn(0x7fdd6405c490 msgr2=0x7fdd6405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/3938883262 shutdown_connections 2021-10-20T23:28:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/3938883262 wait complete. 2021-10-20T23:28:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 Processor -- start 2021-10-20T23:28:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.448+0000 7fdd6bf2a700 1 -- start start 2021-10-20T23:28:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6bf2a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd640b5b40 0x7fdd640afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6bf2a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd640b6580 0x7fdd6415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6bf2a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 0x7fdd6415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6bf2a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640b7dd0 con 0x7fdd64148040 2021-10-20T23:28:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6bf2a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640b8070 con 0x7fdd640b5b40 2021-10-20T23:28:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6bf2a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6415a1d0 con 0x7fdd640b6580 2021-10-20T23:28:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6a4c7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 0x7fdd6415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6a4c7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 0x7fdd6415ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44570/0 (socket says 172.21.15.12:44570) 2021-10-20T23:28:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6a4c7700 1 -- 172.21.15.12:0/2062604217 learned_addr learned my addr 172.21.15.12:0/2062604217 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd694c5700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd640b6580 0x7fdd6415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd69cc6700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd640b5b40 0x7fdd640afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6a4c7700 1 -- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd640b6580 msgr2=0x7fdd6415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6a4c7700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd640b6580 0x7fdd6415a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6a4c7700 1 -- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd640b5b40 msgr2=0x7fdd640afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6a4c7700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd640b5b40 0x7fdd640afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6a4c7700 1 -- 172.21.15.12:0/2062604217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c009530 con 0x7fdd64148040 2021-10-20T23:28:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6a4c7700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 0x7fdd6415ab60 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fdd5c0032f0 tx=0x7fdd5c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd5affd700 1 -- 172.21.15.12:0/2062604217 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5c00b870 con 0x7fdd64148040 2021-10-20T23:28:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd5affd700 1 -- 172.21.15.12:0/2062604217 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c021480 con 0x7fdd64148040 2021-10-20T23:28:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd64062770 con 0x7fdd64148040 2021-10-20T23:28:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd5affd700 1 -- 172.21.15.12:0/2062604217 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5c0217e0 con 0x7fdd64148040 2021-10-20T23:28:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.452+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd64156a80 con 0x7fdd64148040 2021-10-20T23:28:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.456+0000 7fdd5affd700 1 -- 172.21.15.12:0/2062604217 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd5c00f070 con 0x7fdd64148040 2021-10-20T23:28:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.456+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd640b8230 con 0x7fdd64148040 2021-10-20T23:28:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.456+0000 7fdd5affd700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd4c053580 0x7fdd4c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.456+0000 7fdd5affd700 1 -- 172.21.15.12:0/2062604217 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdd5c06cf00 con 0x7fdd64148040 2021-10-20T23:28:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.456+0000 7fdd69cc6700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd4c053580 0x7fdd4c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.456+0000 7fdd69cc6700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd4c053580 0x7fdd4c055a40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fdd6000d000 tx=0x7fdd60000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.460+0000 7fdd5affd700 1 -- 172.21.15.12:0/2062604217 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd5c047820 con 0x7fdd64148040 2021-10-20T23:28:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.628+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fdd6415a390 con 0x7fdd64148040 2021-10-20T23:28:46.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd5affd700 1 -- 172.21.15.12:0/2062604217 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdd5c015030 con 0x7fdd64148040 2021-10-20T23:28:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd4c053580 msgr2=0x7fdd4c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd4c053580 0x7fdd4c055a40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fdd6000d000 tx=0x7fdd60000bc0).stop 2021-10-20T23:28:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 msgr2=0x7fdd6415ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 0x7fdd6415ab60 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fdd5c0032f0 tx=0x7fdd5c016000).stop 2021-10-20T23:28:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 shutdown_connections 2021-10-20T23:28:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdd4c053580 0x7fdd4c055a40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd64148040 0x7fdd6415ab60 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd640b6580 0x7fdd6415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 --2- 172.21.15.12:0/2062604217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd640b5b40 0x7fdd640afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 >> 172.21.15.12:0/2062604217 conn(0x7fdd6405c490 msgr2=0x7fdd640ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 shutdown_connections 2021-10-20T23:28:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.636+0000 7fdd6bf2a700 1 -- 172.21.15.12:0/2062604217 wait complete. 2021-10-20T23:28:46.653 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:28:46.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:46.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.756+0000 7f0aa5099700 1 Processor -- start 2021-10-20T23:28:46.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.756+0000 7f0aa5099700 1 -- start start 2021-10-20T23:28:46.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0aa0061320 0x7f0aa0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00aecf0 con 0x7f0aa00ad5c0 2021-10-20T23:28:46.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00b6f20 con 0x7f0aa0140440 2021-10-20T23:28:46.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa00aef20 con 0x7f0aa0061320 2021-10-20T23:28:46.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0aa00ad5c0 0x7f0aa00b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43168/0 (socket says 172.21.15.12:43168) 2021-10-20T23:28:46.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9f7fe700 1 -- 172.21.15.12:0/2503173756 learned_addr learned my addr 172.21.15.12:0/2503173756 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:46.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9ffff700 1 --2- 172.21.15.12:0/2503173756 >> v2:172.21.15.31:3300/0 conn(0x7f0aa0061320 0x7f0aa0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9effd700 1 -- 172.21.15.12:0/2503173756 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993591254 0 0) 0x7f0aa00aecf0 con 0x7f0aa00ad5c0 2021-10-20T23:28:46.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9effd700 1 -- 172.21.15.12:0/2503173756 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a8c003260 con 0x7f0aa00ad5c0 2021-10-20T23:28:46.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9ffff700 1 -- 172.21.15.12:0/2503173756 >> v1:172.21.15.31:6789/0 conn(0x7f0aa0140440 legacy=0x7f0aa0146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9ffff700 1 -- 172.21.15.12:0/2503173756 >> v1:172.21.15.12:6789/0 conn(0x7f0aa00ad5c0 legacy=0x7f0aa00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9ffff700 1 -- 172.21.15.12:0/2503173756 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00af1c0 con 0x7f0aa0061320 2021-10-20T23:28:46.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9ffff700 1 --2- 172.21.15.12:0/2503173756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aa0061320 0x7f0aa0061700 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f0aa00aeba0 tx=0x7f0a90006df0).ready entity=mon.1 client_cookie=7108808c063e88a8 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:46.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9effd700 1 -- 172.21.15.12:0/2503173756 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9000d610 con 0x7f0aa0061320 2021-10-20T23:28:46.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9effd700 1 -- 172.21.15.12:0/2503173756 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90000e90 con 0x7f0aa0061320 2021-10-20T23:28:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0a9effd700 1 -- 172.21.15.12:0/2503173756 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9000d960 con 0x7f0aa0061320 2021-10-20T23:28:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 -- 172.21.15.12:0/2503173756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aa0061320 msgr2=0x7f0aa0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 --2- 172.21.15.12:0/2503173756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aa0061320 0x7f0aa0061700 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f0aa00aeba0 tx=0x7f0a90006df0).stop 2021-10-20T23:28:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 -- 172.21.15.12:0/2503173756 shutdown_connections 2021-10-20T23:28:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 --2- 172.21.15.12:0/2503173756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aa0061320 0x7f0aa0061700 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 -- 172.21.15.12:0/2503173756 >> 172.21.15.12:0/2503173756 conn(0x7f0aa0066de0 msgr2=0x7f0aa00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.760+0000 7f0aa5099700 1 -- 172.21.15.12:0/2503173756 shutdown_connections 2021-10-20T23:28:46.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa5099700 1 -- 172.21.15.12:0/2503173756 wait complete. 2021-10-20T23:28:46.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa5099700 1 Processor -- start 2021-10-20T23:28:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa5099700 1 -- start start 2021-10-20T23:28:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa5099700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa0061320 0x7f0aa00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa5099700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aa00ad5c0 0x7f0aa0156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa5099700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0aa0140440 0x7f0aa0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa5099700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00b3700 con 0x7f0aa0061320 2021-10-20T23:28:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa5099700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00b1340 con 0x7f0aa00ad5c0 2021-10-20T23:28:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa5099700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00b0e40 con 0x7f0aa0140440 2021-10-20T23:28:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa0061320 0x7f0aa00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa0061320 0x7f0aa00b8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44580/0 (socket says 172.21.15.12:44580) 2021-10-20T23:28:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9ffff700 1 -- 172.21.15.12:0/4050849384 learned_addr learned my addr 172.21.15.12:0/4050849384 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9f7fe700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aa00ad5c0 0x7f0aa0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0aa4898700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0aa0140440 0x7f0aa0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9ffff700 1 -- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0aa0140440 msgr2=0x7f0aa0152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9ffff700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0aa0140440 0x7f0aa0152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9ffff700 1 -- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aa00ad5c0 msgr2=0x7f0aa0156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9ffff700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aa00ad5c0 0x7f0aa0156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9ffff700 1 -- 172.21.15.12:0/4050849384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9000b180 con 0x7f0aa0061320 2021-10-20T23:28:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.764+0000 7f0a9ffff700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa0061320 0x7f0aa00b8aa0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f0aa00aeba0 tx=0x7f0a90014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0a9d7fa700 1 -- 172.21.15.12:0/4050849384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90016070 con 0x7f0aa0061320 2021-10-20T23:28:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0a9d7fa700 1 -- 172.21.15.12:0/4050849384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9000de90 con 0x7f0aa0061320 2021-10-20T23:28:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa00afc10 con 0x7f0aa0061320 2021-10-20T23:28:46.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0a9d7fa700 1 -- 172.21.15.12:0/4050849384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90002f70 con 0x7f0aa0061320 2021-10-20T23:28:46.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa00b02b0 con 0x7f0aa0061320 2021-10-20T23:28:46.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa00af460 con 0x7f0aa0061320 2021-10-20T23:28:46.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0a9d7fa700 1 -- 172.21.15.12:0/4050849384 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a90025030 con 0x7f0aa0061320 2021-10-20T23:28:46.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0a9d7fa700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0a80053610 0x7f0a80055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:46.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0a9d7fa700 1 -- 172.21.15.12:0/4050849384 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0a9006ca90 con 0x7f0aa0061320 2021-10-20T23:28:46.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.768+0000 7f0a9f7fe700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0a80053610 0x7f0a80055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.772+0000 7f0a9f7fe700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0a80053610 0x7f0a80055ad0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f0a9400b000 tx=0x7f0a94009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.772+0000 7f0a9d7fa700 1 -- 172.21.15.12:0/4050849384 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a90043a90 con 0x7f0aa0061320 2021-10-20T23:28:46.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0aa00b08f0 con 0x7f0aa0061320 2021-10-20T23:28:46.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0a9d7fa700 1 -- 172.21.15.12:0/4050849384 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f0a90023020 con 0x7f0aa0061320 2021-10-20T23:28:46.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:46.948 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3304581862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3304581862},{"type":"v1","addr":"172.21.15.12:6835","nonce":3304581862}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/360437153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":360437153},{"type":"v1","addr":"172.21.15.12:6833","nonce":360437153}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:28:44.372426+0000","modified":"2021-10-20T23:28:45.375331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8025":{"gid":8025,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/546930471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":546930471},{"type":"v1","addr":"172.21.15.31:6835","nonce":546930471}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-20T23:28:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0a80053610 msgr2=0x7f0a80055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0a80053610 0x7f0a80055ad0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f0a9400b000 tx=0x7f0a94009040).stop 2021-10-20T23:28:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa0061320 msgr2=0x7f0aa00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa0061320 0x7f0aa00b8aa0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f0aa00aeba0 tx=0x7f0a90014000).stop 2021-10-20T23:28:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 shutdown_connections 2021-10-20T23:28:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0a80053610 0x7f0a80055ad0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0aa0140440 0x7f0aa0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aa00ad5c0 0x7f0aa0156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 --2- 172.21.15.12:0/4050849384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa0061320 0x7f0aa00b8aa0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:46.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 >> 172.21.15.12:0/4050849384 conn(0x7f0aa0066de0 msgr2=0x7f0aa00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:46.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 shutdown_connections 2021-10-20T23:28:46.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:46.936+0000 7f0aa5099700 1 -- 172.21.15.12:0/4050849384 wait complete. 2021-10-20T23:28:46.953 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 72 2021-10-20T23:28:47.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:28:44.372426+0000', 'modified': '2021-10-20T23:28:45.375331+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8025}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8025': {'gid': 8025, 'name': 'b', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/546930471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 546930471}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 546930471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:28:47.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:28:47.266 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:28:47.390 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8025,"want_state":"up:active","state":"up:active","rank_uptime":2.9902960080000001,"mdsmap_epoch":72,"osdmap_epoch":142,"osdmap_epoch_barrier":141,"uptime":7.7449455120000001} 2021-10-20T23:28:47.391 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8025, "mdsmap_epoch": 72, "osdmap_epoch": 142, "osdmap_epoch_barrier": 141, "rank_uptime": 2.990296008, "state": "up:active", "uptime": 7.744945512, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:28:47.392 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:28:47.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f188b6ea700 1 Processor -- start 2021-10-20T23:28:47.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f188b6ea700 1 -- start start 2021-10-20T23:28:47.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f188b6ea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b43c0 0x7f18840b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f188b6ea700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f18840b6960 0x7f188412ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f188b6ea700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18841440b0 con 0x7f18840b6580 2021-10-20T23:28:47.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f188b6ea700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1884143b70 con 0x7f18840b6960 2021-10-20T23:28:47.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f188b6ea700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1884143e10 con 0x7f18840b43c0 2021-10-20T23:28:47.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1889486700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f18840b6580 0x7f1884061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43182/0 (socket says 172.21.15.12:43182) 2021-10-20T23:28:47.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1889486700 1 -- 172.21.15.12:0/2591066048 learned_addr learned my addr 172.21.15.12:0/2591066048 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:47.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1888c85700 1 --2- 172.21.15.12:0/2591066048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b43c0 0x7f18840b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1889c87700 1 --2- 172.21.15.12:0/2591066048 >> v2:172.21.15.31:3300/0 conn(0x7f18840b6960 0x7f188412ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f187bfff700 1 -- 172.21.15.12:0/2591066048 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346232 0 0) 0x7f18841440b0 con 0x7f18840b6580 2021-10-20T23:28:47.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f187bfff700 1 -- 172.21.15.12:0/2591066048 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1868003260 con 0x7f18840b6580 2021-10-20T23:28:47.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1889c87700 1 -- 172.21.15.12:0/2591066048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b43c0 msgr2=0x7f18840b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:47.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1889c87700 1 --2- 172.21.15.12:0/2591066048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b43c0 0x7f18840b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1889c87700 1 -- 172.21.15.12:0/2591066048 >> v1:172.21.15.12:6789/0 conn(0x7f18840b6580 legacy=0x7f1884061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1889c87700 1 -- 172.21.15.12:0/2591066048 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840615f0 con 0x7f18840b6960 2021-10-20T23:28:47.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1888c85700 1 --2- 172.21.15.12:0/2591066048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b43c0 0x7f18840b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:47.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f1889c87700 1 --2- 172.21.15.12:0/2591066048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840b6960 0x7f188412ba00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f187c0032f0 tx=0x7f187c0091d0).ready entity=mon.1 client_cookie=f6964bfab05736a1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:47.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f187bfff700 1 -- 172.21.15.12:0/2591066048 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f187c00b600 con 0x7f18840b6960 2021-10-20T23:28:47.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.492+0000 7f187bfff700 1 -- 172.21.15.12:0/2591066048 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c00b760 con 0x7f18840b6960 2021-10-20T23:28:47.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f187bfff700 1 -- 172.21.15.12:0/2591066048 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f187c00b8d0 con 0x7f18840b6960 2021-10-20T23:28:47.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 -- 172.21.15.12:0/2591066048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840b6960 msgr2=0x7f188412ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 --2- 172.21.15.12:0/2591066048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840b6960 0x7f188412ba00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f187c0032f0 tx=0x7f187c0091d0).stop 2021-10-20T23:28:47.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 -- 172.21.15.12:0/2591066048 shutdown_connections 2021-10-20T23:28:47.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 --2- 172.21.15.12:0/2591066048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840b6960 0x7f188412ba00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 --2- 172.21.15.12:0/2591066048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b43c0 0x7f18840b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 -- 172.21.15.12:0/2591066048 >> 172.21.15.12:0/2591066048 conn(0x7f188405c490 msgr2=0x7f188405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:47.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 -- 172.21.15.12:0/2591066048 shutdown_connections 2021-10-20T23:28:47.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 -- 172.21.15.12:0/2591066048 wait complete. 2021-10-20T23:28:47.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 Processor -- start 2021-10-20T23:28:47.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 -- start start 2021-10-20T23:28:47.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840b43c0 0x7f1884147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18840b6580 0x7f18841526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b6960 0x7f1884152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18841475f0 con 0x7f18840b6580 2021-10-20T23:28:47.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1884147890 con 0x7f18840b43c0 2021-10-20T23:28:47.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f188b6ea700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1884152240 con 0x7f18840b6960 2021-10-20T23:28:47.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f1888c85700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18840b6580 0x7f18841526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f1888c85700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18840b6580 0x7f18841526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44596/0 (socket says 172.21.15.12:44596) 2021-10-20T23:28:47.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f1888c85700 1 -- 172.21.15.12:0/3256531798 learned_addr learned my addr 172.21.15.12:0/3256531798 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:47.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.496+0000 7f1889486700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840b43c0 0x7f1884147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f1889c87700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b6960 0x7f1884152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f1888c85700 1 -- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b6960 msgr2=0x7f1884152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f1888c85700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b6960 0x7f1884152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f1888c85700 1 -- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840b43c0 msgr2=0x7f1884147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f1888c85700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840b43c0 0x7f1884147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f1888c85700 1 -- 172.21.15.12:0/3256531798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187400b180 con 0x7f18840b6580 2021-10-20T23:28:47.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f1889c87700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b6960 0x7f1884152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:47.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f1888c85700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18840b6580 0x7f18841526e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f187400c000 tx=0x7f1874006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:47.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f187a7fc700 1 -- 172.21.15.12:0/3256531798 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1874010780 con 0x7f18840b6580 2021-10-20T23:28:47.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f187a7fc700 1 -- 172.21.15.12:0/3256531798 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18740108e0 con 0x7f18840b6580 2021-10-20T23:28:47.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c009470 con 0x7f18840b6580 2021-10-20T23:28:47.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f187a7fc700 1 -- 172.21.15.12:0/3256531798 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1874010c40 con 0x7f18840b6580 2021-10-20T23:28:47.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1884148470 con 0x7f18840b6580 2021-10-20T23:28:47.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1884152400 con 0x7f18840b6580 2021-10-20T23:28:47.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.500+0000 7f187a7fc700 1 -- 172.21.15.12:0/3256531798 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f187401c460 con 0x7f18840b6580 2021-10-20T23:28:47.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.504+0000 7f187a7fc700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f186c053610 0x7f186c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.504+0000 7f187a7fc700 1 -- 172.21.15.12:0/3256531798 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f187406c120 con 0x7f18840b6580 2021-10-20T23:28:47.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.504+0000 7f1889486700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f186c053610 0x7f186c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.504+0000 7f1889486700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f186c053610 0x7f186c055ad0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f188000d000 tx=0x7f1880009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:47.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.508+0000 7f187a7fc700 1 -- 172.21.15.12:0/3256531798 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1874042fb0 con 0x7f18840b6580 2021-10-20T23:28:47.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.636+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1884061890 con 0x7f18840b6580 2021-10-20T23:28:47.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.640+0000 7f187a7fc700 1 -- 172.21.15.12:0/3256531798 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f18740465d0 con 0x7f18840b6580 2021-10-20T23:28:47.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:47.657 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":142,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:28:45.375943+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:28:42.362682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-20T23:28:43.380308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:28:47.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f186c053610 msgr2=0x7f186c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f186c053610 0x7f186c055ad0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f188000d000 tx=0x7f1880009040).stop 2021-10-20T23:28:47.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18840b6580 msgr2=0x7f18841526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18840b6580 0x7f18841526e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f187400c000 tx=0x7f1874006df0).stop 2021-10-20T23:28:47.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 shutdown_connections 2021-10-20T23:28:47.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f186c053610 0x7f186c055ad0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18840b6960 0x7f1884152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18840b6580 0x7f18841526e0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 --2- 172.21.15.12:0/3256531798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840b43c0 0x7f1884147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 >> 172.21.15.12:0/3256531798 conn(0x7f188405c490 msgr2=0x7f1884140f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:47.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 shutdown_connections 2021-10-20T23:28:47.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.644+0000 7f188b6ea700 1 -- 172.21.15.12:0/3256531798 wait complete. 2021-10-20T23:28:47.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:28:42.362682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:28:43.380308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:28:47.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:28:47.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 Processor -- start 2021-10-20T23:28:47.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 -- start start 2021-10-20T23:28:47.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce300b2580 0x7fce3014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce300a8ac0 0x7fce3014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce300a70c0 con 0x7fce300b0010 2021-10-20T23:28:47.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce300a72f0 con 0x7fce300b2580 2021-10-20T23:28:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce300a7590 con 0x7fce300a8ac0 2021-10-20T23:28:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce34c61700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce300b2580 0x7fce3014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce2ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fce300b0010 0x7fce300a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43198/0 (socket says 172.21.15.12:43198) 2021-10-20T23:28:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce2ffff700 1 -- 172.21.15.12:0/387404019 learned_addr learned my addr 172.21.15.12:0/387404019 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:47.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35462700 1 --2- 172.21.15.12:0/387404019 >> v2:172.21.15.31:3300/0 conn(0x7fce300a8ac0 0x7fce3014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce34c61700 1 -- 172.21.15.12:0/387404019 >> v2:172.21.15.31:3300/0 conn(0x7fce300a8ac0 msgr2=0x7fce3014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce34c61700 1 --2- 172.21.15.12:0/387404019 >> v2:172.21.15.31:3300/0 conn(0x7fce300a8ac0 0x7fce3014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce34c61700 1 -- 172.21.15.12:0/387404019 >> v1:172.21.15.12:6789/0 conn(0x7fce300b0010 legacy=0x7fce300a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce34c61700 1 -- 172.21.15.12:0/387404019 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce300a7830 con 0x7fce300b2580 2021-10-20T23:28:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce2f7fe700 1 -- 172.21.15.12:0/387404019 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958471226 0 0) 0x7fce300a70c0 con 0x7fce300b0010 2021-10-20T23:28:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35462700 1 --2- 172.21.15.12:0/387404019 >> v2:172.21.15.31:3300/0 conn(0x7fce300a8ac0 0x7fce3014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:47.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce34c61700 1 --2- 172.21.15.12:0/387404019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300b2580 0x7fce3014ae40 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fce28002f70 tx=0x7fce28006df0).ready entity=mon.0 client_cookie=2f6735f404722874 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:47.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce2f7fe700 1 -- 172.21.15.12:0/387404019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2800d5c0 con 0x7fce300b2580 2021-10-20T23:28:47.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce2f7fe700 1 -- 172.21.15.12:0/387404019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28000e90 con 0x7fce300b2580 2021-10-20T23:28:47.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce2f7fe700 1 -- 172.21.15.12:0/387404019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2800d910 con 0x7fce300b2580 2021-10-20T23:28:47.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 -- 172.21.15.12:0/387404019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300b2580 msgr2=0x7fce3014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 --2- 172.21.15.12:0/387404019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300b2580 0x7fce3014ae40 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fce28002f70 tx=0x7fce28006df0).stop 2021-10-20T23:28:47.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 -- 172.21.15.12:0/387404019 shutdown_connections 2021-10-20T23:28:47.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 --2- 172.21.15.12:0/387404019 >> v2:172.21.15.31:3300/0 conn(0x7fce300a8ac0 0x7fce3014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 --2- 172.21.15.12:0/387404019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300b2580 0x7fce3014ae40 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 -- 172.21.15.12:0/387404019 >> 172.21.15.12:0/387404019 conn(0x7fce30060180 msgr2=0x7fce300b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:47.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 -- 172.21.15.12:0/387404019 shutdown_connections 2021-10-20T23:28:47.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.764+0000 7fce35c63700 1 -- 172.21.15.12:0/387404019 wait complete. 2021-10-20T23:28:47.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 Processor -- start 2021-10-20T23:28:47.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 -- start start 2021-10-20T23:28:47.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300a8ac0 0x7fce300b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce300b0010 0x7fce30140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce300b2580 0x7fce301414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce300b57b0 con 0x7fce300a8ac0 2021-10-20T23:28:47.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce300b4560 con 0x7fce300b2580 2021-10-20T23:28:47.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce300b4800 con 0x7fce300b0010 2021-10-20T23:28:47.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce34c61700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300a8ac0 0x7fce300b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce34c61700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300a8ac0 0x7fce300b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44610/0 (socket says 172.21.15.12:44610) 2021-10-20T23:28:47.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce34c61700 1 -- 172.21.15.12:0/1805046888 learned_addr learned my addr 172.21.15.12:0/1805046888 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:47.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce2ffff700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce300b0010 0x7fce30140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35462700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce300b2580 0x7fce301414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce34c61700 1 -- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce300b0010 msgr2=0x7fce30140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce34c61700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce300b0010 0x7fce30140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce34c61700 1 -- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce300b2580 msgr2=0x7fce301414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce34c61700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce300b2580 0x7fce301414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce34c61700 1 -- 172.21.15.12:0/1805046888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2800b180 con 0x7fce300a8ac0 2021-10-20T23:28:47.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce34c61700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300a8ac0 0x7fce300b4f00 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fce28002f70 tx=0x7fce28014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:47.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce2dffb700 1 -- 172.21.15.12:0/1805046888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce28016070 con 0x7fce300a8ac0 2021-10-20T23:28:47.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce2dffb700 1 -- 172.21.15.12:0/1805046888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2800de40 con 0x7fce300a8ac0 2021-10-20T23:28:47.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce30067380 con 0x7fce300a8ac0 2021-10-20T23:28:47.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce2dffb700 1 -- 172.21.15.12:0/1805046888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce28013de0 con 0x7fce300a8ac0 2021-10-20T23:28:47.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.768+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce300b53f0 con 0x7fce300a8ac0 2021-10-20T23:28:47.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.772+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce300b49c0 con 0x7fce300a8ac0 2021-10-20T23:28:47.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.772+0000 7fce2dffb700 1 -- 172.21.15.12:0/1805046888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce28025030 con 0x7fce300a8ac0 2021-10-20T23:28:47.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.772+0000 7fce2dffb700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce08053610 0x7fce08055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:47.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.772+0000 7fce2dffb700 1 -- 172.21.15.12:0/1805046888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fce2806c9a0 con 0x7fce300a8ac0 2021-10-20T23:28:47.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.772+0000 7fce2ffff700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce08053610 0x7fce08055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:47.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.776+0000 7fce2ffff700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce08053610 0x7fce08055ad0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fce2000d000 tx=0x7fce20001520).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:47.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.780+0000 7fce2dffb700 1 -- 172.21.15.12:0/1805046888 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce280439a0 con 0x7fce300a8ac0 2021-10-20T23:28:47.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.904+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fce30057350 con 0x7fce300a8ac0 2021-10-20T23:28:47.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.904+0000 7fce2dffb700 1 -- 172.21.15.12:0/1805046888 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v142) v1 ==== 110+0+10 (secure 0 0 0) 0x7fce28023020 con 0x7fce300a8ac0 2021-10-20T23:28:47.918 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:28:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce08053610 msgr2=0x7fce08055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce08053610 0x7fce08055ad0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fce2000d000 tx=0x7fce20001520).stop 2021-10-20T23:28:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300a8ac0 msgr2=0x7fce300b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300a8ac0 0x7fce300b4f00 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fce28002f70 tx=0x7fce28014000).stop 2021-10-20T23:28:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 shutdown_connections 2021-10-20T23:28:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fce08053610 0x7fce08055ad0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce300b2580 0x7fce301414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce300b0010 0x7fce30140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 --2- 172.21.15.12:0/1805046888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce300a8ac0 0x7fce300b4f00 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:47.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 >> 172.21.15.12:0/1805046888 conn(0x7fce30060180 msgr2=0x7fce30144b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:47.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 shutdown_connections 2021-10-20T23:28:47.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:47.908+0000 7fce35c63700 1 -- 172.21.15.12:0/1805046888 wait complete. 2021-10-20T23:28:47.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:28:48.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.028+0000 7f0eee47d700 1 Processor -- start 2021-10-20T23:28:48.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.028+0000 7f0eee47d700 1 -- start start 2021-10-20T23:28:48.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eee47d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ee80665f0 0x7f0ee80669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eee47d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80b1a30 0x7f0ee805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eee47d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee805f750 con 0x7f0ee8140cb0 2021-10-20T23:28:48.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eee47d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee80b14a0 con 0x7f0ee80665f0 2021-10-20T23:28:48.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eee47d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee805f980 con 0x7f0ee80b1a30 2021-10-20T23:28:48.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eedc7c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0ee8140cb0 0x7f0ee813e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43214/0 (socket says 172.21.15.12:43214) 2021-10-20T23:28:48.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eedc7c700 1 -- 172.21.15.12:0/1041015892 learned_addr learned my addr 172.21.15.12:0/1041015892 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:48.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eecc7a700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80b1a30 0x7f0ee805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eed47b700 1 --2- 172.21.15.12:0/1041015892 >> v2:172.21.15.31:3300/0 conn(0x7f0ee80665f0 0x7f0ee80669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256399570 0 0) 0x7f0ee805f750 con 0x7f0ee8140cb0 2021-10-20T23:28:48.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ecc003260 con 0x7f0ee8140cb0 2021-10-20T23:28:48.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4139037038 0 0) 0x7f0ecc003260 con 0x7f0ee8140cb0 2021-10-20T23:28:48.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80b1a30 msgr2=0x7f0ee805fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:48.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80b1a30 0x7f0ee805fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 >> v2:172.21.15.31:3300/0 conn(0x7f0ee80665f0 msgr2=0x7f0ee80669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:48.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 --2- 172.21.15.12:0/1041015892 >> v2:172.21.15.31:3300/0 conn(0x7f0ee80665f0 0x7f0ee80669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8060310 con 0x7f0ee8140cb0 2021-10-20T23:28:48.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f0ee00019e0 con 0x7f0ee8140cb0 2021-10-20T23:28:48.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eecc7a700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80b1a30 0x7f0ee805fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:48.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 >> v1:172.21.15.12:6789/0 conn(0x7f0ee8140cb0 legacy=0x7f0ee813e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ecc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80b1a30 0x7f0ecc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ecc0049f0 0x7f0ecc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80b14a0 con 0x7f0ecc003750 2021-10-20T23:28:48.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee805f980 con 0x7f0ecc0049f0 2021-10-20T23:28:48.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc00b750 con 0x7f0ee80b1a30 2021-10-20T23:28:48.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eed47b700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ecc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eedc7c700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ecc0049f0 0x7f0ecc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eecc7a700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80b1a30 0x7f0ecc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eed47b700 1 -- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80b1a30 msgr2=0x7f0ecc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:48.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eed47b700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80b1a30 0x7f0ecc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eed47b700 1 -- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ecc0049f0 msgr2=0x7f0ecc004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:48.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eed47b700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ecc0049f0 0x7f0ecc004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eed47b700 1 -- 172.21.15.12:0/1041015892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee400b180 con 0x7f0ecc003750 2021-10-20T23:28:48.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eed47b700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ecc003b70 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f0edc00c000 tx=0x7f0edc006df0).ready entity=mon.0 client_cookie=5efcf48a6642f791 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0edc00e830 con 0x7f0ecc003750 2021-10-20T23:28:48.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00e990 con 0x7f0ecc003750 2021-10-20T23:28:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0edbfff700 1 -- 172.21.15.12:0/1041015892 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0edc00ecf0 con 0x7f0ecc003750 2021-10-20T23:28:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eee47d700 1 -- 172.21.15.12:0/1041015892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 msgr2=0x7f0ecc003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eee47d700 1 --2- 172.21.15.12:0/1041015892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ecc003b70 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f0edc00c000 tx=0x7f0edc006df0).stop 2021-10-20T23:28:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.032+0000 7f0eedc7c700 1 -- 172.21.15.12:0/1041015892 reap_dead start 2021-10-20T23:28:48.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 -- 172.21.15.12:0/1041015892 shutdown_connections 2021-10-20T23:28:48.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 -- 172.21.15.12:0/1041015892 >> 172.21.15.12:0/1041015892 conn(0x7f0ee80636e0 msgr2=0x7f0ee8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:48.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 -- 172.21.15.12:0/1041015892 shutdown_connections 2021-10-20T23:28:48.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 -- 172.21.15.12:0/1041015892 wait complete. 2021-10-20T23:28:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 Processor -- start 2021-10-20T23:28:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 -- start start 2021-10-20T23:28:48.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ee80ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee80aa5d0 0x7f0ee80ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80ab980 0x7f0ee80abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80aea80 con 0x7f0ecc003750 2021-10-20T23:28:48.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee8150e70 con 0x7f0ee80aa5d0 2021-10-20T23:28:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eee47d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee8150bd0 con 0x7f0ee80ab980 2021-10-20T23:28:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eed47b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ee80ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eed47b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ee80ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44628/0 (socket says 172.21.15.12:44628) 2021-10-20T23:28:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eed47b700 1 -- 172.21.15.12:0/1565954945 learned_addr learned my addr 172.21.15.12:0/1565954945 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:48.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eecc7a700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee80aa5d0 0x7f0ee80ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eedc7c700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80ab980 0x7f0ee80abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eed47b700 1 -- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80ab980 msgr2=0x7f0ee80abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eed47b700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80ab980 0x7f0ee80abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eed47b700 1 -- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee80aa5d0 msgr2=0x7f0ee80ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eed47b700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee80aa5d0 0x7f0ee80ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.036+0000 7f0eed47b700 1 -- 172.21.15.12:0/1565954945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80ab290 con 0x7f0ecc003750 2021-10-20T23:28:48.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eed47b700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ee80ae0a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f0ee80aad50 tx=0x7f0edc019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eda7fc700 1 -- 172.21.15.12:0/1565954945 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0edc01b820 con 0x7f0ecc003750 2021-10-20T23:28:48.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eda7fc700 1 -- 172.21.15.12:0/1565954945 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc000e90 con 0x7f0ecc003750 2021-10-20T23:28:48.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee8150900 con 0x7f0ecc003750 2021-10-20T23:28:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eda7fc700 1 -- 172.21.15.12:0/1565954945 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0edc01bb70 con 0x7f0ecc003750 2021-10-20T23:28:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee8148570 con 0x7f0ecc003750 2021-10-20T23:28:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eda7fc700 1 -- 172.21.15.12:0/1565954945 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0edc01bcd0 con 0x7f0ecc003750 2021-10-20T23:28:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee80b1740 con 0x7f0ecc003750 2021-10-20T23:28:48.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eda7fc700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ed0053580 0x7f0ed0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eda7fc700 1 -- 172.21.15.12:0/1565954945 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0edc06cee0 con 0x7f0ecc003750 2021-10-20T23:28:48.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.040+0000 7f0eecc7a700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ed0053580 0x7f0ed0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.044+0000 7f0eecc7a700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ed0053580 0x7f0ed0055a40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f0ee400b000 tx=0x7f0ee4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.048+0000 7f0eda7fc700 1 -- 172.21.15.12:0/1565954945 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0edc043e10 con 0x7f0ecc003750 2021-10-20T23:28:48.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.176+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0ee80aaf70 con 0x7f0ecc003750 2021-10-20T23:28:48.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eda7fc700 1 -- 172.21.15.12:0/1565954945 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0edc02a030 con 0x7f0ecc003750 2021-10-20T23:28:48.190 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ed0053580 msgr2=0x7f0ed0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ed0053580 0x7f0ed0055a40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f0ee400b000 tx=0x7f0ee4008040).stop 2021-10-20T23:28:48.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 msgr2=0x7f0ee80ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ee80ae0a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f0ee80aad50 tx=0x7f0edc019000).stop 2021-10-20T23:28:48.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 shutdown_connections 2021-10-20T23:28:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0ed0053580 0x7f0ed0055a40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ee80ab980 0x7f0ee80abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee80aa5d0 0x7f0ee80ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 --2- 172.21.15.12:0/1565954945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ecc003750 0x7f0ee80ae0a0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 >> 172.21.15.12:0/1565954945 conn(0x7f0ee80636e0 msgr2=0x7f0ee813fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:48.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 shutdown_connections 2021-10-20T23:28:48.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.180+0000 7f0eee47d700 1 -- 172.21.15.12:0/1565954945 wait complete. 2021-10-20T23:28:48.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:28:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe66236f700 1 Processor -- start 2021-10-20T23:28:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe66236f700 1 -- start start 2021-10-20T23:28:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe66236f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 0x7fe65c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe66236f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c143f60 con 0x7fe65c05fc00 2021-10-20T23:28:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe66236f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c05ffe0 con 0x7fe65c0b5990 2021-10-20T23:28:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe66236f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0ba6b0 con 0x7fe65c0b6560 2021-10-20T23:28:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe65c05fc00 0x7fe65c0b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43230/0 (socket says 172.21.15.12:43230) 2021-10-20T23:28:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65bfff700 1 -- 172.21.15.12:0/1137296588 learned_addr learned my addr 172.21.15.12:0/1137296588 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65b7fe700 1 --2- 172.21.15.12:0/1137296588 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 0x7fe65c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65affd700 1 -- 172.21.15.12:0/1137296588 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807378655 0 0) 0x7fe65c143f60 con 0x7fe65c05fc00 2021-10-20T23:28:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65affd700 1 -- 172.21.15.12:0/1137296588 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe63c003260 con 0x7fe65c05fc00 2021-10-20T23:28:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65affd700 1 -- 172.21.15.12:0/1137296588 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 867429521 0 0) 0x7fe63c003260 con 0x7fe65c05fc00 2021-10-20T23:28:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65b7fe700 1 -- 172.21.15.12:0/1137296588 >> v1:172.21.15.31:6789/0 conn(0x7fe65c0b5990 legacy=0x7fe65c0b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65b7fe700 1 -- 172.21.15.12:0/1137296588 >> v1:172.21.15.12:6789/0 conn(0x7fe65c05fc00 legacy=0x7fe65c0b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65b7fe700 1 -- 172.21.15.12:0/1137296588 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c143a50 con 0x7fe65c0b6560 2021-10-20T23:28:48.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65b7fe700 1 --2- 172.21.15.12:0/1137296588 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 0x7fe65c0b41b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fe64c001b80 tx=0x7fe644006df0).ready entity=mon.2 client_cookie=acd11e13f6d9ac3d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65affd700 1 -- 172.21.15.12:0/1137296588 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c0019e0 con 0x7fe65c0b6560 2021-10-20T23:28:48.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65affd700 1 -- 172.21.15.12:0/1137296588 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe644000e90 con 0x7fe65c0b6560 2021-10-20T23:28:48.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.316+0000 7fe65affd700 1 -- 172.21.15.12:0/1137296588 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64400d4a0 con 0x7fe65c0b6560 2021-10-20T23:28:48.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 -- 172.21.15.12:0/1137296588 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 msgr2=0x7fe65c0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 --2- 172.21.15.12:0/1137296588 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 0x7fe65c0b41b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fe64c001b80 tx=0x7fe644006df0).stop 2021-10-20T23:28:48.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 -- 172.21.15.12:0/1137296588 shutdown_connections 2021-10-20T23:28:48.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 --2- 172.21.15.12:0/1137296588 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 0x7fe65c0b41b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 -- 172.21.15.12:0/1137296588 >> 172.21.15.12:0/1137296588 conn(0x7fe65c0623a0 msgr2=0x7fe65c066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:48.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 -- 172.21.15.12:0/1137296588 shutdown_connections 2021-10-20T23:28:48.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 -- 172.21.15.12:0/1137296588 wait complete. 2021-10-20T23:28:48.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 Processor -- start 2021-10-20T23:28:48.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 -- start start 2021-10-20T23:28:48.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c05fc00 0x7fe65c0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0b5990 0x7fe65c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 0x7fe65c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c155c70 con 0x7fe65c05fc00 2021-10-20T23:28:48.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c1474a0 con 0x7fe65c0b5990 2021-10-20T23:28:48.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66236f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c146f60 con 0x7fe65c0b6560 2021-10-20T23:28:48.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe65bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c05fc00 0x7fe65c0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe65bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c05fc00 0x7fe65c0b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44642/0 (socket says 172.21.15.12:44642) 2021-10-20T23:28:48.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe65bfff700 1 -- 172.21.15.12:0/2209815111 learned_addr learned my addr 172.21.15.12:0/2209815111 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:48.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe65b7fe700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0b5990 0x7fe65c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.320+0000 7fe66090c700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 0x7fe65c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe65bfff700 1 -- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 msgr2=0x7fe65c1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe65bfff700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 0x7fe65c1565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe65bfff700 1 -- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0b5990 msgr2=0x7fe65c1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe65bfff700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0b5990 0x7fe65c1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe65bfff700 1 -- 172.21.15.12:0/2209815111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64400b180 con 0x7fe65c05fc00 2021-10-20T23:28:48.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe65b7fe700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0b5990 0x7fe65c1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:48.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe65bfff700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c05fc00 0x7fe65c0b2bc0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fe64c001bc0 tx=0x7fe64c001a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe6597fa700 1 -- 172.21.15.12:0/2209815111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c004ab0 con 0x7fe65c05fc00 2021-10-20T23:28:48.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe6597fa700 1 -- 172.21.15.12:0/2209815111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c004c10 con 0x7fe65c05fc00 2021-10-20T23:28:48.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c147200 con 0x7fe65c05fc00 2021-10-20T23:28:48.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe6597fa700 1 -- 172.21.15.12:0/2209815111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c007170 con 0x7fe65c05fc00 2021-10-20T23:28:48.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c0b0550 con 0x7fe65c05fc00 2021-10-20T23:28:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c143cc0 con 0x7fe65c05fc00 2021-10-20T23:28:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe6597fa700 1 -- 172.21.15.12:0/2209815111 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe64c01b070 con 0x7fe65c05fc00 2021-10-20T23:28:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe6597fa700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe640053640 0x7fe640055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe6597fa700 1 -- 172.21.15.12:0/2209815111 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe64c06b540 con 0x7fe65c05fc00 2021-10-20T23:28:48.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.324+0000 7fe65b7fe700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe640053640 0x7fe640055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.328+0000 7fe65b7fe700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe640053640 0x7fe640055b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fe644019000 tx=0x7fe65c0b9750).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.328+0000 7fe6597fa700 1 -- 172.21.15.12:0/2209815111 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe64c042350 con 0x7fe65c05fc00 2021-10-20T23:28:48.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.456+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe65c057350 con 0x7fe65c05fc00 2021-10-20T23:28:48.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.456+0000 7fe6597fa700 1 -- 172.21.15.12:0/2209815111 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe64c019030 con 0x7fe65c05fc00 2021-10-20T23:28:48.470 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:48.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe640053640 msgr2=0x7fe640055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe640053640 0x7fe640055b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fe644019000 tx=0x7fe65c0b9750).stop 2021-10-20T23:28:48.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c05fc00 msgr2=0x7fe65c0b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c05fc00 0x7fe65c0b2bc0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fe64c001bc0 tx=0x7fe64c001a20).stop 2021-10-20T23:28:48.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 shutdown_connections 2021-10-20T23:28:48.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe640053640 0x7fe640055b00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c0b6560 0x7fe65c1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0b5990 0x7fe65c1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 --2- 172.21.15.12:0/2209815111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c05fc00 0x7fe65c0b2bc0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 >> 172.21.15.12:0/2209815111 conn(0x7fe65c0623a0 msgr2=0x7fe65c12c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:48.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 shutdown_connections 2021-10-20T23:28:48.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.460+0000 7fe66236f700 1 -- 172.21.15.12:0/2209815111 wait complete. 2021-10-20T23:28:48.488 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:28:48.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa7509700 1 Processor -- start 2021-10-20T23:28:48.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa7509700 1 -- start start 2021-10-20T23:28:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa7509700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4aa00607d0 0x7f4aa01400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa7509700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00ac500 0x7f4aa0140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa7509700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa005fe80 con 0x7f4aa005faa0 2021-10-20T23:28:48.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa7509700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa0143240 con 0x7f4aa00607d0 2021-10-20T23:28:48.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa7509700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00acc60 con 0x7f4aa00ac500 2021-10-20T23:28:48.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa52a5700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4aa005faa0 0x7f4aa01438d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43244/0 (socket says 172.21.15.12:43244) 2021-10-20T23:28:48.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa52a5700 1 -- 172.21.15.12:0/2537455221 learned_addr learned my addr 172.21.15.12:0/2537455221 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:48.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa4aa4700 1 --2- 172.21.15.12:0/2537455221 >> v2:172.21.15.12:3300/0 conn(0x7f4aa00607d0 0x7f4aa01400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa5aa6700 1 --2- 172.21.15.12:0/2537455221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00ac500 0x7f4aa0140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4a97fff700 1 -- 172.21.15.12:0/2537455221 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891640233 0 0) 0x7f4aa005fe80 con 0x7f4aa005faa0 2021-10-20T23:28:48.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4a97fff700 1 -- 172.21.15.12:0/2537455221 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a8c003260 con 0x7f4aa005faa0 2021-10-20T23:28:48.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4a97fff700 1 -- 172.21.15.12:0/2537455221 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703775309 0 0) 0x7f4a8c003260 con 0x7f4aa005faa0 2021-10-20T23:28:48.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa4aa4700 1 -- 172.21.15.12:0/2537455221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00ac500 msgr2=0x7f4aa0140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:48.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa4aa4700 1 --2- 172.21.15.12:0/2537455221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00ac500 0x7f4aa0140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa4aa4700 1 -- 172.21.15.12:0/2537455221 >> v1:172.21.15.12:6789/0 conn(0x7f4aa005faa0 legacy=0x7f4aa01438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa4aa4700 1 -- 172.21.15.12:0/2537455221 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00acf00 con 0x7f4aa00607d0 2021-10-20T23:28:48.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.584+0000 7f4aa4aa4700 1 --2- 172.21.15.12:0/2537455221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00607d0 0x7f4aa01400a0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f4a90001820 tx=0x7f4a9c006df0).ready entity=mon.0 client_cookie=aca69310256a70e9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4a97fff700 1 -- 172.21.15.12:0/2537455221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a90001680 con 0x7f4aa00607d0 2021-10-20T23:28:48.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4a97fff700 1 -- 172.21.15.12:0/2537455221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c000e90 con 0x7f4aa00607d0 2021-10-20T23:28:48.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4a97fff700 1 -- 172.21.15.12:0/2537455221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a9c012460 con 0x7f4aa00607d0 2021-10-20T23:28:48.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 -- 172.21.15.12:0/2537455221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00607d0 msgr2=0x7f4aa01400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 --2- 172.21.15.12:0/2537455221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00607d0 0x7f4aa01400a0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f4a90001820 tx=0x7f4a9c006df0).stop 2021-10-20T23:28:48.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 -- 172.21.15.12:0/2537455221 shutdown_connections 2021-10-20T23:28:48.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 --2- 172.21.15.12:0/2537455221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00ac500 0x7f4aa0140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 --2- 172.21.15.12:0/2537455221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00607d0 0x7f4aa01400a0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 -- 172.21.15.12:0/2537455221 >> 172.21.15.12:0/2537455221 conn(0x7f4aa00b2970 msgr2=0x7f4aa00b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:48.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 -- 172.21.15.12:0/2537455221 shutdown_connections 2021-10-20T23:28:48.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 -- 172.21.15.12:0/2537455221 wait complete. 2021-10-20T23:28:48.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 Processor -- start 2021-10-20T23:28:48.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.588+0000 7f4aa7509700 1 -- start start 2021-10-20T23:28:48.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa7509700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa005faa0 0x7f4aa0146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa7509700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00607d0 0x7f4aa0152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa7509700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00ac500 0x7f4aa013b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa7509700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00b3a90 con 0x7f4aa00ac500 2021-10-20T23:28:48.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa7509700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00b3cc0 con 0x7f4aa005faa0 2021-10-20T23:28:48.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa7509700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0152760 con 0x7f4aa00607d0 2021-10-20T23:28:48.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa5aa6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00ac500 0x7f4aa013b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa5aa6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00ac500 0x7f4aa013b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44660/0 (socket says 172.21.15.12:44660) 2021-10-20T23:28:48.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa5aa6700 1 -- 172.21.15.12:0/1183163863 learned_addr learned my addr 172.21.15.12:0/1183163863 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:48.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa52a5700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa005faa0 0x7f4aa0146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa4aa4700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00607d0 0x7f4aa0152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa5aa6700 1 -- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00607d0 msgr2=0x7f4aa0152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa5aa6700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00607d0 0x7f4aa0152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa5aa6700 1 -- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa005faa0 msgr2=0x7f4aa0146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa5aa6700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa005faa0 0x7f4aa0146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa5aa6700 1 -- 172.21.15.12:0/1183163863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c00b180 con 0x7f4aa00ac500 2021-10-20T23:28:48.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa5aa6700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00ac500 0x7f4aa013b420 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f4a98006e00 tx=0x7f4a980091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4a967fc700 1 -- 172.21.15.12:0/1183163863 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a98012600 con 0x7f4aa00ac500 2021-10-20T23:28:48.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4a967fc700 1 -- 172.21.15.12:0/1183163863 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98012760 con 0x7f4aa00ac500 2021-10-20T23:28:48.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa0152490 con 0x7f4aa00ac500 2021-10-20T23:28:48.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4a967fc700 1 -- 172.21.15.12:0/1183163863 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a98012ac0 con 0x7f4aa00ac500 2021-10-20T23:28:48.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.592+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa013aeb0 con 0x7f4aa00ac500 2021-10-20T23:28:48.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.596+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa0152920 con 0x7f4aa00ac500 2021-10-20T23:28:48.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.596+0000 7f4a967fc700 1 -- 172.21.15.12:0/1183163863 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a98022070 con 0x7f4aa00ac500 2021-10-20T23:28:48.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.596+0000 7f4a967fc700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a800535b0 0x7f4a80055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.596+0000 7f4a967fc700 1 -- 172.21.15.12:0/1183163863 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4a9806c030 con 0x7f4aa00ac500 2021-10-20T23:28:48.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.596+0000 7f4aa52a5700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a800535b0 0x7f4a80055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.596+0000 7f4aa52a5700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a800535b0 0x7f4a80055a70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f4a9000d000 tx=0x7f4a90001de0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.600+0000 7f4a967fc700 1 -- 172.21.15.12:0/1183163863 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a98042f90 con 0x7f4aa00ac500 2021-10-20T23:28:48.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.728+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4aa0057350 con 0x7f4aa00ac500 2021-10-20T23:28:48.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.728+0000 7f4a967fc700 1 -- 172.21.15.12:0/1183163863 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4a98016020 con 0x7f4aa00ac500 2021-10-20T23:28:48.741 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:48.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.728+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a800535b0 msgr2=0x7f4a80055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.728+0000 7f4aa7509700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a800535b0 0x7f4a80055a70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f4a9000d000 tx=0x7f4a90001de0).stop 2021-10-20T23:28:48.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.728+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00ac500 msgr2=0x7f4aa013b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.728+0000 7f4aa7509700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00ac500 0x7f4aa013b420 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f4a98006e00 tx=0x7f4a980091d0).stop 2021-10-20T23:28:48.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.728+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 shutdown_connections 2021-10-20T23:28:48.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.732+0000 7f4aa7509700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4a800535b0 0x7f4a80055a70 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.732+0000 7f4aa7509700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa00ac500 0x7f4aa013b420 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.732+0000 7f4aa7509700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa00607d0 0x7f4aa0152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.732+0000 7f4aa7509700 1 --2- 172.21.15.12:0/1183163863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa005faa0 0x7f4aa0146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.732+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 >> 172.21.15.12:0/1183163863 conn(0x7f4aa00b2970 msgr2=0x7f4aa01437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.732+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 shutdown_connections 2021-10-20T23:28:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.732+0000 7f4aa7509700 1 -- 172.21.15.12:0/1183163863 wait complete. 2021-10-20T23:28:48.764 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:28:48.764 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1c8f6700 1 Processor -- start 2021-10-20T23:28:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1c8f6700 1 -- start start 2021-10-20T23:28:48.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1c8f6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c180b6430 0x7f2c18061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1c8f6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c18147bf0 0x7f2c18144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1c8f6700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c180b1f70 con 0x7f2c180b4060 2021-10-20T23:28:48.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1c8f6700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c180b14a0 con 0x7f2c180b6430 2021-10-20T23:28:48.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1c8f6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c180b6810 con 0x7f2c18147bf0 2021-10-20T23:28:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2c180b4060 0x7f2c181444a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43260/0 (socket says 172.21.15.12:43260) 2021-10-20T23:28:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1659c700 1 -- 172.21.15.12:0/1890666966 learned_addr learned my addr 172.21.15.12:0/1890666966 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c16d9d700 1 --2- 172.21.15.12:0/1890666966 >> v2:172.21.15.12:3300/0 conn(0x7f2c180b6430 0x7f2c18061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c1759e700 1 --2- 172.21.15.12:0/1890666966 >> v2:172.21.15.31:3300/0 conn(0x7f2c18147bf0 0x7f2c18144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c16d9d700 1 -- 172.21.15.12:0/1890666966 >> v2:172.21.15.31:3300/0 conn(0x7f2c18147bf0 msgr2=0x7f2c18144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c16d9d700 1 --2- 172.21.15.12:0/1890666966 >> v2:172.21.15.31:3300/0 conn(0x7f2c18147bf0 0x7f2c18144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c16d9d700 1 -- 172.21.15.12:0/1890666966 >> v1:172.21.15.12:6789/0 conn(0x7f2c180b4060 legacy=0x7f2c181444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c15d9b700 1 -- 172.21.15.12:0/1890666966 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431208875 0 0) 0x7f2c180b1f70 con 0x7f2c180b4060 2021-10-20T23:28:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c16d9d700 1 -- 172.21.15.12:0/1890666966 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c18148110 con 0x7f2c180b6430 2021-10-20T23:28:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c16d9d700 1 --2- 172.21.15.12:0/1890666966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c180b6430 0x7f2c18061470 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f2c080032f0 tx=0x7f2c080091d0).ready entity=mon.0 client_cookie=91a8db1102eb66de server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c15d9b700 1 -- 172.21.15.12:0/1890666966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c08009ea0 con 0x7f2c180b6430 2021-10-20T23:28:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c15d9b700 1 -- 172.21.15.12:0/1890666966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800b870 con 0x7f2c180b6430 2021-10-20T23:28:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.852+0000 7f2c15d9b700 1 -- 172.21.15.12:0/1890666966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c0800b9e0 con 0x7f2c180b6430 2021-10-20T23:28:48.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/1890666966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c180b6430 msgr2=0x7f2c18061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 --2- 172.21.15.12:0/1890666966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c180b6430 0x7f2c18061470 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f2c080032f0 tx=0x7f2c080091d0).stop 2021-10-20T23:28:48.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/1890666966 shutdown_connections 2021-10-20T23:28:48.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 --2- 172.21.15.12:0/1890666966 >> v2:172.21.15.31:3300/0 conn(0x7f2c18147bf0 0x7f2c18144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 --2- 172.21.15.12:0/1890666966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c180b6430 0x7f2c18061470 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/1890666966 >> 172.21.15.12:0/1890666966 conn(0x7f2c1805c490 msgr2=0x7f2c1805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/1890666966 shutdown_connections 2021-10-20T23:28:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/1890666966 wait complete. 2021-10-20T23:28:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 Processor -- start 2021-10-20T23:28:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.856+0000 7f2c1c8f6700 1 -- start start 2021-10-20T23:28:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1c8f6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c180b4060 0x7f2c18156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1c8f6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c180b6430 0x7f2c1814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1c8f6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c18147bf0 0x7f2c180adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1c8f6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180adba0 con 0x7f2c18147bf0 2021-10-20T23:28:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1c8f6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180ae9f0 con 0x7f2c180b4060 2021-10-20T23:28:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1c8f6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180aec40 con 0x7f2c180b6430 2021-10-20T23:28:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c18147bf0 0x7f2c180adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c18147bf0 0x7f2c180adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44674/0 (socket says 172.21.15.12:44674) 2021-10-20T23:28:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1759e700 1 -- 172.21.15.12:0/3739026669 learned_addr learned my addr 172.21.15.12:0/3739026669 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c16d9d700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c180b4060 0x7f2c18156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1659c700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c180b6430 0x7f2c1814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1759e700 1 -- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c180b6430 msgr2=0x7f2c1814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1759e700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c180b6430 0x7f2c1814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1759e700 1 -- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c180b4060 msgr2=0x7f2c18156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1759e700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c180b4060 0x7f2c18156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1759e700 1 -- 172.21.15.12:0/3739026669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c08009470 con 0x7f2c18147bf0 2021-10-20T23:28:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1659c700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c180b6430 0x7f2c1814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1759e700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c18147bf0 0x7f2c180adfd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f2c1000a000 tx=0x7f2c10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c07fff700 1 -- 172.21.15.12:0/3739026669 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c10011780 con 0x7f2c18147bf0 2021-10-20T23:28:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c07fff700 1 -- 172.21.15.12:0/3739026669 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1000de90 con 0x7f2c18147bf0 2021-10-20T23:28:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1814b1d0 con 0x7f2c18147bf0 2021-10-20T23:28:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c07fff700 1 -- 172.21.15.12:0/3739026669 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c10011ad0 con 0x7f2c18147bf0 2021-10-20T23:28:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1814b4f0 con 0x7f2c18147bf0 2021-10-20T23:28:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c07fff700 1 -- 172.21.15.12:0/3739026669 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2c10011c30 con 0x7f2c18147bf0 2021-10-20T23:28:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.860+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c180b21a0 con 0x7f2c18147bf0 2021-10-20T23:28:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.864+0000 7f2c07fff700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2bf4053610 0x7f2bf4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.864+0000 7f2c07fff700 1 -- 172.21.15.12:0/3739026669 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2c1006b840 con 0x7f2c18147bf0 2021-10-20T23:28:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.864+0000 7f2c16d9d700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2bf4053610 0x7f2bf4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.864+0000 7f2c16d9d700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2bf4053610 0x7f2bf4055ad0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f2c0801b000 tx=0x7f2c08016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:48.868+0000 7f2c07fff700 1 -- 172.21.15.12:0/3739026669 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2c100427e0 con 0x7f2c18147bf0 2021-10-20T23:28:49.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.028+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c18057350 con 0x7f2c18147bf0 2021-10-20T23:28:49.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c07fff700 1 -- 172.21.15.12:0/3739026669 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f2c10045e00 con 0x7f2c18147bf0 2021-10-20T23:28:49.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:49.050 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3304581862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3304581862},{"type":"v1","addr":"172.21.15.12:6835","nonce":3304581862}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/360437153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":360437153},{"type":"v1","addr":"172.21.15.12:6833","nonce":360437153}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:28:44.372426+0000","modified":"2021-10-20T23:28:45.375331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8025":{"gid":8025,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/546930471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":546930471},{"type":"v1","addr":"172.21.15.31:6835","nonce":546930471}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-20T23:28:49.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2bf4053610 msgr2=0x7f2bf4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:49.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2bf4053610 0x7f2bf4055ad0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f2c0801b000 tx=0x7f2c08016000).stop 2021-10-20T23:28:49.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c18147bf0 msgr2=0x7f2c180adfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c18147bf0 0x7f2c180adfd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f2c1000a000 tx=0x7f2c10008040).stop 2021-10-20T23:28:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 shutdown_connections 2021-10-20T23:28:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f2bf4053610 0x7f2bf4055ad0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c18147bf0 0x7f2c180adfd0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c180b6430 0x7f2c1814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 --2- 172.21.15.12:0/3739026669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c180b4060 0x7f2c18156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 >> 172.21.15.12:0/3739026669 conn(0x7f2c1805c490 msgr2=0x7f2c18061f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 shutdown_connections 2021-10-20T23:28:49.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:49.032+0000 7f2c1c8f6700 1 -- 172.21.15.12:0/3739026669 wait complete. 2021-10-20T23:28:49.060 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 72 2021-10-20T23:28:49.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:28:44.372426+0000', 'modified': '2021-10-20T23:28:45.375331+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8025}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8025': {'gid': 8025, 'name': 'b', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/546930471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 546930471}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 546930471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:28:49.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:28:49.376 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:28:49.493 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8025,"want_state":"up:active","state":"up:active","rank_uptime":5.1014650169999998,"mdsmap_epoch":72,"osdmap_epoch":142,"osdmap_epoch_barrier":141,"uptime":9.8561142420000003} 2021-10-20T23:28:49.494 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8025, "mdsmap_epoch": 72, "osdmap_epoch": 142, "osdmap_epoch_barrier": 141, "rank_uptime": 5.101465017, "state": "up:active", "uptime": 9.856114242, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:28:49.494 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:28:49.497 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:28:49.497 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:28:49.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:49.498 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:49.508 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:28:49.571 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:49.571 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:49.585 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:49.586 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:49.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:49.588 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:28:49.636 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:28:49.636 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:49.639 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:28:49.657 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:49.657 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:49.667 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:49.668 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:49.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:49.670 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:28:49.715 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:28:49.708+0000 7f2d0e17e080 -1 init, newargv = 0x5592d362ea70 newargc=9ceph-fuse[14928]: starting ceph client 2021-10-20T23:28:49.715 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr: 2021-10-20T23:28:49.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14928]: starting fuse 2021-10-20T23:28:50.830 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:28:50.851 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:50.852 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:50.915 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:50.916 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:50.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:50.917 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:28:50.936 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:28:50.936 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:28:50.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:50.944 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:28:50.945 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:28:50.945 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:28:50.950 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:28:50.951 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:28:50.951 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:28:50.952 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:28:50.952 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:28:50.952 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:28:50.953 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:28:50.954 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:28:50.954 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:28:50.954 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:28:50.955 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:28:50.955 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:28:50.956 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:28:50.956 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:28:50.957 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:28:50.957 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:28:50.957 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:28:50.958 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:28:50.958 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:28:50.959 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:28:51.029 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.14928.asok 2021-10-20T23:28:51.034 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14928.asok 2021-10-20T23:28:51.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:51.035 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14928.asok status 2021-10-20T23:28:51.132 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:28:51.132 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:28:51.132 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:28:51.133 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:28:51.133 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:28:51.133 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:28:51.133 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:28:51.133 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "14928", 2021-10-20T23:28:51.134 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:28:51.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:28:51.134 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:28:51.143 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:28:51.144 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 8155, 2021-10-20T23:28:51.144 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:28:51.144 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:28:51.144 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:28:51.145 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 8155 2021-10-20T23:28:51.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:28:51.145 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:28:51.145 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:28:51.145 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:28:51.146 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 186161383 2021-10-20T23:28:51.146 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:28:51.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:28:51.146 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:28:51.147 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:28:51.147 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:28:51.147 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 186161383 2021-10-20T23:28:51.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:28:51.148 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.8155 172.21.15.119:0/186161383", 2021-10-20T23:28:51.148 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/186161383", 2021-10-20T23:28:51.148 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:28:51.148 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 72, 2021-10-20T23:28:51.149 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 142, 2021-10-20T23:28:51.149 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:28:51.149 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:28:51.149 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:28:51.150 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:28:51.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:51.151 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:51.151 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:51.172 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:28:51.173 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:28:51.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:51.174 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:51.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:28:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4662592700 1 Processor -- start 2021-10-20T23:28:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4662592700 1 -- start start 2021-10-20T23:28:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4662592700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f465c0b1db0 0x7f465c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4662592700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c0a70c0 0x7f465c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4662592700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0b0350 con 0x7f465c1483a0 2021-10-20T23:28:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4662592700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c0a90c0 con 0x7f465c0b1db0 2021-10-20T23:28:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4662592700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0b05f0 con 0x7f465c0a70c0 2021-10-20T23:28:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f465c1483a0 0x7f465c0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43272/0 (socket says 172.21.15.12:43272) 2021-10-20T23:28:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465b7fe700 1 -- 172.21.15.12:0/1480677698 learned_addr learned my addr 172.21.15.12:0/1480677698 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4660b2f700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c0a70c0 0x7f465c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183534615 0 0) 0x7f465c0b0350 con 0x7f465c1483a0 2021-10-20T23:28:51.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465bfff700 1 --2- 172.21.15.12:0/1480677698 >> v2:172.21.15.31:3300/0 conn(0x7f465c0b1db0 0x7f465c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f463c003260 con 0x7f465c1483a0 2021-10-20T23:28:51.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3703976829 0 0) 0x7f463c003260 con 0x7f465c1483a0 2021-10-20T23:28:51.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c0a70c0 msgr2=0x7f465c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:51.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c0a70c0 0x7f465c144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 >> v2:172.21.15.31:3300/0 conn(0x7f465c0b1db0 msgr2=0x7f465c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:51.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 --2- 172.21.15.12:0/1480677698 >> v2:172.21.15.31:3300/0 conn(0x7f465c0b1db0 0x7f465c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0b0890 con 0x7f465c1483a0 2021-10-20T23:28:51.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f464c001660 con 0x7f465c1483a0 2021-10-20T23:28:51.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465bfff700 1 --2- 172.21.15.12:0/1480677698 >> v2:172.21.15.31:3300/0 conn(0x7f465c0b1db0 0x7f465c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:51.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 >> v1:172.21.15.12:6789/0 conn(0x7f465c1483a0 legacy=0x7f465c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f463c003750 0x7f463c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c0a70c0 0x7f463c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f463c0049f0 0x7f463c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0b05f0 con 0x7f463c0049f0 2021-10-20T23:28:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c00b750 con 0x7f463c003750 2021-10-20T23:28:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c00b890 con 0x7f465c0a70c0 2021-10-20T23:28:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4660b2f700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f463c0049f0 0x7f463c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465b7fe700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c0a70c0 0x7f463c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465bfff700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f463c003750 0x7f463c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4660b2f700 1 -- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c0a70c0 msgr2=0x7f463c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4660b2f700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c0a70c0 0x7f463c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4660b2f700 1 -- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f463c003750 msgr2=0x7f463c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4660b2f700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f463c003750 0x7f463c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4660b2f700 1 -- 172.21.15.12:0/1480677698 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c003260 con 0x7f463c0049f0 2021-10-20T23:28:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f4660b2f700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f463c0049f0 0x7f463c004e70 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f465400c000 tx=0x7f46540091d0).ready entity=mon.0 client_cookie=9b952f12d038bfa0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465400e7e0 con 0x7f463c0049f0 2021-10-20T23:28:51.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465400e940 con 0x7f463c0049f0 2021-10-20T23:28:51.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.348+0000 7f465affd700 1 -- 172.21.15.12:0/1480677698 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465400eca0 con 0x7f463c0049f0 2021-10-20T23:28:51.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.352+0000 7f4662592700 1 -- 172.21.15.12:0/1480677698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f463c0049f0 msgr2=0x7f463c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.352+0000 7f4662592700 1 --2- 172.21.15.12:0/1480677698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f463c0049f0 0x7f463c004e70 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f465400c000 tx=0x7f46540091d0).stop 2021-10-20T23:28:51.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.352+0000 7f4660b2f700 1 -- 172.21.15.12:0/1480677698 reap_dead start 2021-10-20T23:28:51.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.352+0000 7f4662592700 1 -- 172.21.15.12:0/1480677698 shutdown_connections 2021-10-20T23:28:51.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.352+0000 7f4662592700 1 -- 172.21.15.12:0/1480677698 >> 172.21.15.12:0/1480677698 conn(0x7f465c05f6b0 msgr2=0x7f465c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:51.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.352+0000 7f4662592700 1 -- 172.21.15.12:0/1480677698 shutdown_connections 2021-10-20T23:28:51.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.352+0000 7f4662592700 1 -- 172.21.15.12:0/1480677698 wait complete. 2021-10-20T23:28:51.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.352+0000 7f4662592700 1 Processor -- start 2021-10-20T23:28:51.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.352+0000 7f4662592700 1 -- start start 2021-10-20T23:28:51.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4662592700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c147910 0x7f465c148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4662592700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465c0abf10 0x7f465c14a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4662592700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f465c14b1c0 0x7f465c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4662592700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c149d90 con 0x7f465c14b1c0 2021-10-20T23:28:51.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4662592700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c1578e0 con 0x7f465c0abf10 2021-10-20T23:28:51.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4662592700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c141f60 con 0x7f465c147910 2021-10-20T23:28:51.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4660b2f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f465c14b1c0 0x7f465c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f465b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465c0abf10 0x7f465c14a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4660b2f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f465c14b1c0 0x7f465c14b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44694/0 (socket says 172.21.15.12:44694) 2021-10-20T23:28:51.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4660b2f700 1 -- 172.21.15.12:0/518447477 learned_addr learned my addr 172.21.15.12:0/518447477 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:51.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f465bfff700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c147910 0x7f465c148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f465b7fe700 1 -- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c147910 msgr2=0x7f465c148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f465b7fe700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c147910 0x7f465c148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f465b7fe700 1 -- 172.21.15.12:0/518447477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f465c14b1c0 msgr2=0x7f465c14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f465b7fe700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f465c14b1c0 0x7f465c14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f465b7fe700 1 -- 172.21.15.12:0/518447477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c142200 con 0x7f465c0abf10 2021-10-20T23:28:51.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f465b7fe700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465c0abf10 0x7f465c14a850 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f465c148c10 tx=0x7f465c0b0a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:51.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f46597fa700 1 -- 172.21.15.12:0/518447477 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c0116b0 con 0x7f465c0abf10 2021-10-20T23:28:51.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f46597fa700 1 -- 172.21.15.12:0/518447477 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c011810 con 0x7f465c0abf10 2021-10-20T23:28:51.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c1424a0 con 0x7f465c0abf10 2021-10-20T23:28:51.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f46597fa700 1 -- 172.21.15.12:0/518447477 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c011b70 con 0x7f465c0abf10 2021-10-20T23:28:51.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c14ad40 con 0x7f465c0abf10 2021-10-20T23:28:51.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.356+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465c057350 con 0x7f465c0abf10 2021-10-20T23:28:51.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.360+0000 7f46597fa700 1 -- 172.21.15.12:0/518447477 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f464c01b030 con 0x7f465c0abf10 2021-10-20T23:28:51.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.360+0000 7f46597fa700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4640053610 0x7f4640055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.360+0000 7f46597fa700 1 -- 172.21.15.12:0/518447477 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f464c06b3d0 con 0x7f465c0abf10 2021-10-20T23:28:51.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.360+0000 7f465bfff700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4640053610 0x7f4640055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.360+0000 7f465bfff700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4640053610 0x7f4640055ad0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f464400c000 tx=0x7f464400b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:51.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.368+0000 7f46597fa700 1 -- 172.21.15.12:0/518447477 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f464c0422c0 con 0x7f465c0abf10 2021-10-20T23:28:51.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.496+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f465c044650 con 0x7f465c0abf10 2021-10-20T23:28:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f46597fa700 1 -- 172.21.15.12:0/518447477 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f464c019030 con 0x7f465c0abf10 2021-10-20T23:28:51.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:51.513 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":142,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:28:45.375943+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:28:42.362682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-20T23:28:43.380308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:28:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4640053610 msgr2=0x7f4640055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4640053610 0x7f4640055ad0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f464400c000 tx=0x7f464400b040).stop 2021-10-20T23:28:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465c0abf10 msgr2=0x7f465c14a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465c0abf10 0x7f465c14a850 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f465c148c10 tx=0x7f465c0b0a20).stop 2021-10-20T23:28:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 shutdown_connections 2021-10-20T23:28:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4640053610 0x7f4640055ad0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f465c14b1c0 0x7f465c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465c0abf10 0x7f465c14a850 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 --2- 172.21.15.12:0/518447477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f465c147910 0x7f465c148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.500+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 >> 172.21.15.12:0/518447477 conn(0x7f465c05f6b0 msgr2=0x7f465c0ac510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.504+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 shutdown_connections 2021-10-20T23:28:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.504+0000 7f4662592700 1 -- 172.21.15.12:0/518447477 wait complete. 2021-10-20T23:28:51.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:28:42.362682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:28:43.380308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:28:51.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:28:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.636+0000 7fd1ee341700 1 Processor -- start 2021-10-20T23:28:51.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.636+0000 7fd1ee341700 1 -- start start 2021-10-20T23:28:51.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b4180 0x7fd1e8140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1e80b4690 0x7fd1e80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e8143b60 con 0x7fd1e8146950 2021-10-20T23:28:51.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e8147510 con 0x7fd1e80b4690 2021-10-20T23:28:51.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8143e00 con 0x7fd1e80b4180 2021-10-20T23:28:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ec8de700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1e80b4690 0x7fd1e80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ec8de700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd1e80b4690 0x7fd1e80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44700/0 (socket says 172.21.15.12:44700) 2021-10-20T23:28:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ec8de700 1 -- 172.21.15.12:0/764128695 learned_addr learned my addr 172.21.15.12:0/764128695 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1e77fe700 1 --2- 172.21.15.12:0/764128695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b4180 0x7fd1e8140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ec8de700 1 -- 172.21.15.12:0/764128695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b4180 msgr2=0x7fd1e8140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ec8de700 1 --2- 172.21.15.12:0/764128695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b4180 0x7fd1e8140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ec8de700 1 -- 172.21.15.12:0/764128695 >> v1:172.21.15.31:6789/0 conn(0x7fd1e8146950 legacy=0x7fd1e8140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ec8de700 1 -- 172.21.15.12:0/764128695 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80b0c90 con 0x7fd1e80b4690 2021-10-20T23:28:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1e77fe700 1 --2- 172.21.15.12:0/764128695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b4180 0x7fd1e8140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:28:51.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ec8de700 1 --2- 172.21.15.12:0/764128695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4690 0x7fd1e80b4ed0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fd1e00032f0 tx=0x7fd1e0009290).ready entity=mon.0 client_cookie=c2425682997520f9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:51.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1e6ffd700 1 -- 172.21.15.12:0/764128695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e000b8a0 con 0x7fd1e80b4690 2021-10-20T23:28:51.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1e6ffd700 1 -- 172.21.15.12:0/764128695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e000ba00 con 0x7fd1e80b4690 2021-10-20T23:28:51.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1e6ffd700 1 -- 172.21.15.12:0/764128695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e000bb70 con 0x7fd1e80b4690 2021-10-20T23:28:51.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 -- 172.21.15.12:0/764128695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4690 msgr2=0x7fd1e80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 --2- 172.21.15.12:0/764128695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4690 0x7fd1e80b4ed0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fd1e00032f0 tx=0x7fd1e0009290).stop 2021-10-20T23:28:51.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 -- 172.21.15.12:0/764128695 shutdown_connections 2021-10-20T23:28:51.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 --2- 172.21.15.12:0/764128695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4690 0x7fd1e80b4ed0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 --2- 172.21.15.12:0/764128695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b4180 0x7fd1e8140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 -- 172.21.15.12:0/764128695 >> 172.21.15.12:0/764128695 conn(0x7fd1e805c490 msgr2=0x7fd1e805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 -- 172.21.15.12:0/764128695 shutdown_connections 2021-10-20T23:28:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 -- 172.21.15.12:0/764128695 wait complete. 2021-10-20T23:28:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 Processor -- start 2021-10-20T23:28:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.640+0000 7fd1ee341700 1 -- start start 2021-10-20T23:28:51.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ee341700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4180 0x7fd1e8141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ee341700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e80b4690 0x7fd1e80b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ee341700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8146950 0x7fd1e8152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ee341700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80b7fb0 con 0x7fd1e80b4180 2021-10-20T23:28:51.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ee341700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80b7d10 con 0x7fd1e80b4690 2021-10-20T23:28:51.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ee341700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8152620 con 0x7fd1e8146950 2021-10-20T23:28:51.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4180 0x7fd1e8141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4180 0x7fd1e8141e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44706/0 (socket says 172.21.15.12:44706) 2021-10-20T23:28:51.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e7fff700 1 -- 172.21.15.12:0/1870474334 learned_addr learned my addr 172.21.15.12:0/1870474334 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:51.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ec8de700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8146950 0x7fd1e8152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e77fe700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e80b4690 0x7fd1e80b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e7fff700 1 -- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8146950 msgr2=0x7fd1e8152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e7fff700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8146950 0x7fd1e8152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e7fff700 1 -- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e80b4690 msgr2=0x7fd1e80b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e7fff700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e80b4690 0x7fd1e80b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e7fff700 1 -- 172.21.15.12:0/1870474334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e0009530 con 0x7fd1e80b4180 2021-10-20T23:28:51.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e7fff700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4180 0x7fd1e8141e70 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7fd1e8060c50 tx=0x7fd1d8007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:51.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e57fa700 1 -- 172.21.15.12:0/1870474334 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d8007e70 con 0x7fd1e80b4180 2021-10-20T23:28:51.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e57fa700 1 -- 172.21.15.12:0/1870474334 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d8007030 con 0x7fd1e80b4180 2021-10-20T23:28:51.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e81528c0 con 0x7fd1e80b4180 2021-10-20T23:28:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1e57fa700 1 -- 172.21.15.12:0/1870474334 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d8007390 con 0x7fd1e80b4180 2021-10-20T23:28:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e80aef00 con 0x7fd1e80b4180 2021-10-20T23:28:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.644+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e8152a50 con 0x7fd1e80b4180 2021-10-20T23:28:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.648+0000 7fd1e57fa700 1 -- 172.21.15.12:0/1870474334 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd1d8010030 con 0x7fd1e80b4180 2021-10-20T23:28:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.648+0000 7fd1e57fa700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1c8053520 0x7fd1c80559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.648+0000 7fd1e57fa700 1 -- 172.21.15.12:0/1870474334 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd1d806b5e0 con 0x7fd1e80b4180 2021-10-20T23:28:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.648+0000 7fd1e77fe700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1c8053520 0x7fd1c80559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.648+0000 7fd1e77fe700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1c8053520 0x7fd1c80559e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fd1dc00d000 tx=0x7fd1dc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:51.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.652+0000 7fd1e57fa700 1 -- 172.21.15.12:0/1870474334 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1d80424d0 con 0x7fd1e80b4180 2021-10-20T23:28:51.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.780+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd1e8057350 con 0x7fd1e80b4180 2021-10-20T23:28:51.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.780+0000 7fd1e57fa700 1 -- 172.21.15.12:0/1870474334 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v142) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd1d8045af0 con 0x7fd1e80b4180 2021-10-20T23:28:51.794 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:28:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1c8053520 msgr2=0x7fd1c80559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1c8053520 0x7fd1c80559e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fd1dc00d000 tx=0x7fd1dc008040).stop 2021-10-20T23:28:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4180 msgr2=0x7fd1e8141e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4180 0x7fd1e8141e70 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7fd1e8060c50 tx=0x7fd1d8007c00).stop 2021-10-20T23:28:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 shutdown_connections 2021-10-20T23:28:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd1c8053520 0x7fd1c80559e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8146950 0x7fd1e8152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e80b4690 0x7fd1e80b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 --2- 172.21.15.12:0/1870474334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e80b4180 0x7fd1e8141e70 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 >> 172.21.15.12:0/1870474334 conn(0x7fd1e805c490 msgr2=0x7fd1e8140000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 shutdown_connections 2021-10-20T23:28:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.784+0000 7fd1ee341700 1 -- 172.21.15.12:0/1870474334 wait complete. 2021-10-20T23:28:51.812 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:28:51.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f150236b700 1 Processor -- start 2021-10-20T23:28:51.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f150236b700 1 -- start start 2021-10-20T23:28:51.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f150236b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14fc0665f0 0x7f14fc0669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f150236b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 0x7f14fc05fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f150236b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14fc05f750 con 0x7f14fc140cb0 2021-10-20T23:28:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f150236b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14fc0b14a0 con 0x7f14fc0665f0 2021-10-20T23:28:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f150236b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc05f980 con 0x7f14fc0b1a30 2021-10-20T23:28:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1501b6a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f14fc140cb0 0x7f14fc13e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43310/0 (socket says 172.21.15.12:43310) 2021-10-20T23:28:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1501b6a700 1 -- 172.21.15.12:0/4143382268 learned_addr learned my addr 172.21.15.12:0/4143382268 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1501369700 1 --2- 172.21.15.12:0/4143382268 >> v2:172.21.15.31:3300/0 conn(0x7f14fc0665f0 0x7f14fc0669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1500b68700 1 --2- 172.21.15.12:0/4143382268 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 0x7f14fc05fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f14effff700 1 -- 172.21.15.12:0/4143382268 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161166905 0 0) 0x7f14fc05f750 con 0x7f14fc140cb0 2021-10-20T23:28:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f14effff700 1 -- 172.21.15.12:0/4143382268 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14e4003260 con 0x7f14fc140cb0 2021-10-20T23:28:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1501369700 1 -- 172.21.15.12:0/4143382268 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 msgr2=0x7f14fc05fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:51.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1501369700 1 --2- 172.21.15.12:0/4143382268 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 0x7f14fc05fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1501369700 1 -- 172.21.15.12:0/4143382268 >> v1:172.21.15.12:6789/0 conn(0x7f14fc140cb0 legacy=0x7f14fc13e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1501369700 1 -- 172.21.15.12:0/4143382268 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc060310 con 0x7f14fc0665f0 2021-10-20T23:28:51.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1500b68700 1 --2- 172.21.15.12:0/4143382268 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 0x7f14fc05fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:51.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.916+0000 7f1501369700 1 --2- 172.21.15.12:0/4143382268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc0665f0 0x7f14fc0669d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f14f8002f70 tx=0x7f14f8006df0).ready entity=mon.1 client_cookie=805f6041e9d5a6a7 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:51.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f14effff700 1 -- 172.21.15.12:0/4143382268 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f800d4a0 con 0x7f14fc0665f0 2021-10-20T23:28:51.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f14effff700 1 -- 172.21.15.12:0/4143382268 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f8000e90 con 0x7f14fc0665f0 2021-10-20T23:28:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f14effff700 1 -- 172.21.15.12:0/4143382268 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f800d7f0 con 0x7f14fc0665f0 2021-10-20T23:28:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 -- 172.21.15.12:0/4143382268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc0665f0 msgr2=0x7f14fc0669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 --2- 172.21.15.12:0/4143382268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc0665f0 0x7f14fc0669d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f14f8002f70 tx=0x7f14f8006df0).stop 2021-10-20T23:28:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 -- 172.21.15.12:0/4143382268 shutdown_connections 2021-10-20T23:28:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 --2- 172.21.15.12:0/4143382268 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 0x7f14fc05fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 --2- 172.21.15.12:0/4143382268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc0665f0 0x7f14fc0669d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 -- 172.21.15.12:0/4143382268 >> 172.21.15.12:0/4143382268 conn(0x7f14fc0636e0 msgr2=0x7f14fc063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:51.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 -- 172.21.15.12:0/4143382268 shutdown_connections 2021-10-20T23:28:51.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 -- 172.21.15.12:0/4143382268 wait complete. 2021-10-20T23:28:51.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 Processor -- start 2021-10-20T23:28:51.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 -- start start 2021-10-20T23:28:51.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc0665f0 0x7f14fc13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 0x7f14fc153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc140cb0 0x7f14fc153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0b3ae0 con 0x7f14fc0665f0 2021-10-20T23:28:51.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc1541e0 con 0x7f14fc140cb0 2021-10-20T23:28:51.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f150236b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0b09b0 con 0x7f14fc0b1a30 2021-10-20T23:28:51.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f1501369700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc0665f0 0x7f14fc13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f1501369700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc0665f0 0x7f14fc13fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44718/0 (socket says 172.21.15.12:44718) 2021-10-20T23:28:51.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f1501369700 1 -- 172.21.15.12:0/1121123143 learned_addr learned my addr 172.21.15.12:0/1121123143 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:51.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f1501b6a700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc140cb0 0x7f14fc153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.920+0000 7f1500b68700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 0x7f14fc153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f1501369700 1 -- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 msgr2=0x7f14fc153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f1501369700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 0x7f14fc153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f1501369700 1 -- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc140cb0 msgr2=0x7f14fc153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:51.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f1501369700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc140cb0 0x7f14fc153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:51.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f1501369700 1 -- 172.21.15.12:0/1121123143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f000b180 con 0x7f14fc0665f0 2021-10-20T23:28:51.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f1501b6a700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc140cb0 0x7f14fc153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:51.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f1501369700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc0665f0 0x7f14fc13fcc0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f14fc0aa880 tx=0x7f14f8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:51.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f14ee7fc700 1 -- 172.21.15.12:0/1121123143 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f8012930 con 0x7f14fc0665f0 2021-10-20T23:28:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f14ee7fc700 1 -- 172.21.15.12:0/1121123143 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f8012a90 con 0x7f14fc0665f0 2021-10-20T23:28:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f800b180 con 0x7f14fc0665f0 2021-10-20T23:28:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f14ee7fc700 1 -- 172.21.15.12:0/1121123143 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f8012df0 con 0x7f14fc0665f0 2021-10-20T23:28:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc142a10 con 0x7f14fc0665f0 2021-10-20T23:28:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14fc153540 con 0x7f14fc0665f0 2021-10-20T23:28:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f14ee7fc700 1 -- 172.21.15.12:0/1121123143 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f14f801c070 con 0x7f14fc0665f0 2021-10-20T23:28:51.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.924+0000 7f14ee7fc700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14dc053640 0x7f14dc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.928+0000 7f14ee7fc700 1 -- 172.21.15.12:0/1121123143 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f14f806c670 con 0x7f14fc0665f0 2021-10-20T23:28:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.928+0000 7f1500b68700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14dc053640 0x7f14dc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.928+0000 7f1500b68700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14dc053640 0x7f14dc055b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f14f000b000 tx=0x7f14f0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:51.932+0000 7f14ee7fc700 1 -- 172.21.15.12:0/1121123143 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14fc153540 con 0x7f14fc0665f0 2021-10-20T23:28:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.060+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14fc153540 con 0x7f14fc0665f0 2021-10-20T23:28:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.060+0000 7f14ee7fc700 1 -- 172.21.15.12:0/1121123143 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14fc153540 con 0x7f14fc0665f0 2021-10-20T23:28:52.076 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14dc053640 msgr2=0x7f14dc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14dc053640 0x7f14dc055b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f14f000b000 tx=0x7f14f0006df0).stop 2021-10-20T23:28:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc0665f0 msgr2=0x7f14fc13fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc0665f0 0x7f14fc13fcc0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f14fc0aa880 tx=0x7f14f8014000).stop 2021-10-20T23:28:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 shutdown_connections 2021-10-20T23:28:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14dc053640 0x7f14dc055b00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc140cb0 0x7f14fc153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc0b1a30 0x7f14fc153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 --2- 172.21.15.12:0/1121123143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc0665f0 0x7f14fc13fcc0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 >> 172.21.15.12:0/1121123143 conn(0x7f14fc0636e0 msgr2=0x7f14fc13ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 shutdown_connections 2021-10-20T23:28:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.064+0000 7f150236b700 1 -- 172.21.15.12:0/1121123143 wait complete. 2021-10-20T23:28:52.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:28:52.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.188+0000 7f9fc5b8d700 1 Processor -- start 2021-10-20T23:28:52.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.188+0000 7f9fc5b8d700 1 -- start start 2021-10-20T23:28:52.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9fc00ad870 0x7f9fc00b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc00ace10 con 0x7f9fc00aca30 2021-10-20T23:28:52.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc00b5160 con 0x7f9fc00b1430 2021-10-20T23:28:52.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc00adee0 con 0x7f9fc00ad870 2021-10-20T23:28:52.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fbffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9fc00ad870 0x7f9fc00b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc4b8b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9fc00aca30 0x7f9fc01434c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43320/0 (socket says 172.21.15.12:43320) 2021-10-20T23:28:52.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc4b8b700 1 -- 172.21.15.12:0/1397600387 learned_addr learned my addr 172.21.15.12:0/1397600387 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:52.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fbffff700 1 -- 172.21.15.12:0/1397600387 >> v1:172.21.15.31:6789/0 conn(0x7f9fc00b1430 legacy=0x7f9fc0067000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fbffff700 1 -- 172.21.15.12:0/1397600387 >> v1:172.21.15.12:6789/0 conn(0x7f9fc00aca30 legacy=0x7f9fc01434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fbffff700 1 -- 172.21.15.12:0/1397600387 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00ae180 con 0x7f9fc00ad870 2021-10-20T23:28:52.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fbffff700 1 --2- 172.21.15.12:0/1397600387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00ad870 0x7f9fc00b55c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f9fac002f70 tx=0x7f9fac006df0).ready entity=mon.0 client_cookie=6fbe57f9b40bd57c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:52.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fbf7fe700 1 -- 172.21.15.12:0/1397600387 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fac00d610 con 0x7f9fc00ad870 2021-10-20T23:28:52.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fbf7fe700 1 -- 172.21.15.12:0/1397600387 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac000e90 con 0x7f9fc00ad870 2021-10-20T23:28:52.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fbf7fe700 1 -- 172.21.15.12:0/1397600387 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fac00d960 con 0x7f9fc00ad870 2021-10-20T23:28:52.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/1397600387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00ad870 msgr2=0x7f9fc00b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 --2- 172.21.15.12:0/1397600387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00ad870 0x7f9fc00b55c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f9fac002f70 tx=0x7f9fac006df0).stop 2021-10-20T23:28:52.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/1397600387 shutdown_connections 2021-10-20T23:28:52.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 --2- 172.21.15.12:0/1397600387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00ad870 0x7f9fc00b55c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.210 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/1397600387 >> 172.21.15.12:0/1397600387 conn(0x7f9fc0062560 msgr2=0x7f9fc0062940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:52.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/1397600387 shutdown_connections 2021-10-20T23:28:52.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.192+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/1397600387 wait complete. 2021-10-20T23:28:52.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 Processor -- start 2021-10-20T23:28:52.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 -- start start 2021-10-20T23:28:52.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00aca30 0x7f9fc00669f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fc00ad870 0x7f9fc00a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00b1430 0x7f9fc01542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0153e70 con 0x7f9fc00aca30 2021-10-20T23:28:52.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0143a10 con 0x7f9fc00b1430 2021-10-20T23:28:52.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00a0f30 con 0x7f9fc00ad870 2021-10-20T23:28:52.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc4b8b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00aca30 0x7f9fc00669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc4b8b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00aca30 0x7f9fc00669f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44732/0 (socket says 172.21.15.12:44732) 2021-10-20T23:28:52.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc4b8b700 1 -- 172.21.15.12:0/398156777 learned_addr learned my addr 172.21.15.12:0/398156777 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:52.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc4b8b700 1 -- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fc00ad870 msgr2=0x7f9fc00a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc538c700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00b1430 0x7f9fc01542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fbffff700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fc00ad870 0x7f9fc00a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc4b8b700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fc00ad870 0x7f9fc00a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc4b8b700 1 -- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00b1430 msgr2=0x7f9fc01542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc4b8b700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00b1430 0x7f9fc01542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc4b8b700 1 -- 172.21.15.12:0/398156777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac00b180 con 0x7f9fc00aca30 2021-10-20T23:28:52.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc538c700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00b1430 0x7f9fc01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:28:52.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fbffff700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fc00ad870 0x7f9fc00a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:28:52.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc4b8b700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00aca30 0x7f9fc00669f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f9fc00af8b0 tx=0x7f9fb4007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fbdffb700 1 -- 172.21.15.12:0/398156777 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fb400ce30 con 0x7f9fc00aca30 2021-10-20T23:28:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fbdffb700 1 -- 172.21.15.12:0/398156777 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb40072e0 con 0x7f9fc00aca30 2021-10-20T23:28:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc00a11d0 con 0x7f9fc00aca30 2021-10-20T23:28:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fbdffb700 1 -- 172.21.15.12:0/398156777 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fb4005800 con 0x7f9fc00aca30 2021-10-20T23:28:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.196+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc0066f60 con 0x7f9fc00aca30 2021-10-20T23:28:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.200+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc00ae420 con 0x7f9fc00aca30 2021-10-20T23:28:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.200+0000 7f9fbdffb700 1 -- 172.21.15.12:0/398156777 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9fb4010070 con 0x7f9fc00aca30 2021-10-20T23:28:52.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.200+0000 7f9fbdffb700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9fa00536a0 0x7f9fa0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.200+0000 7f9fbdffb700 1 -- 172.21.15.12:0/398156777 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9fb406b240 con 0x7f9fc00aca30 2021-10-20T23:28:52.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.200+0000 7f9fbffff700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9fa00536a0 0x7f9fa0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.200+0000 7f9fbffff700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9fa00536a0 0x7f9fa0055b60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f9fac017000 tx=0x7f9fac015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:52.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.208+0000 7f9fbdffb700 1 -- 172.21.15.12:0/398156777 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9fb40420b0 con 0x7f9fc00aca30 2021-10-20T23:28:52.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.332+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9fc0057350 con 0x7f9fc00aca30 2021-10-20T23:28:52.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fbdffb700 1 -- 172.21.15.12:0/398156777 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9fb4018020 con 0x7f9fc00aca30 2021-10-20T23:28:52.347 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:52.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9fa00536a0 msgr2=0x7f9fa0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9fa00536a0 0x7f9fa0055b60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f9fac017000 tx=0x7f9fac015000).stop 2021-10-20T23:28:52.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00aca30 msgr2=0x7f9fc00669f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00aca30 0x7f9fc00669f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f9fc00af8b0 tx=0x7f9fb4007c40).stop 2021-10-20T23:28:52.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 shutdown_connections 2021-10-20T23:28:52.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9fa00536a0 0x7f9fa0055b60 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00b1430 0x7f9fc01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fc00ad870 0x7f9fc00a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 --2- 172.21.15.12:0/398156777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fc00aca30 0x7f9fc00669f0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 >> 172.21.15.12:0/398156777 conn(0x7f9fc0062560 msgr2=0x7f9fc00b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:52.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 shutdown_connections 2021-10-20T23:28:52.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.336+0000 7f9fc5b8d700 1 -- 172.21.15.12:0/398156777 wait complete. 2021-10-20T23:28:52.360 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:28:52.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.460+0000 7f4499810700 1 Processor -- start 2021-10-20T23:28:52.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.460+0000 7f4499810700 1 -- start start 2021-10-20T23:28:52.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.460+0000 7f4499810700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f44940b18f0 0x7f44940b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.460+0000 7f4499810700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44940b33e0 con 0x7f44940b3000 2021-10-20T23:28:52.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f4499810700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44940b0c70 con 0x7f44940a9c10 2021-10-20T23:28:52.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f4499810700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940b27f0 con 0x7f44940b18f0 2021-10-20T23:28:52.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f448bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f44940b18f0 0x7f44940b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f449880e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f44940b3000 0x7f4494065510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43334/0 (socket says 172.21.15.12:43334) 2021-10-20T23:28:52.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f449880e700 1 -- 172.21.15.12:0/3198419883 learned_addr learned my addr 172.21.15.12:0/3198419883 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:52.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f448bfff700 1 -- 172.21.15.12:0/3198419883 >> v1:172.21.15.31:6789/0 conn(0x7f44940a9c10 legacy=0x7f4494147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f448bfff700 1 -- 172.21.15.12:0/3198419883 >> v1:172.21.15.12:6789/0 conn(0x7f44940b3000 legacy=0x7f4494065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f448bfff700 1 -- 172.21.15.12:0/3198419883 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940b0f10 con 0x7f44940b18f0 2021-10-20T23:28:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f448b7fe700 1 -- 172.21.15.12:0/3198419883 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061050127 0 0) 0x7f44940b33e0 con 0x7f44940b3000 2021-10-20T23:28:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f448bfff700 1 --2- 172.21.15.12:0/3198419883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b18f0 0x7f44940b2300 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f4484002f70 tx=0x7f4484006df0).ready entity=mon.0 client_cookie=b887cb2854393dae server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f448b7fe700 1 -- 172.21.15.12:0/3198419883 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f448400d610 con 0x7f44940b18f0 2021-10-20T23:28:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f448b7fe700 1 -- 172.21.15.12:0/3198419883 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484000e90 con 0x7f44940b18f0 2021-10-20T23:28:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f448b7fe700 1 -- 172.21.15.12:0/3198419883 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f448400d960 con 0x7f44940b18f0 2021-10-20T23:28:52.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f4499810700 1 -- 172.21.15.12:0/3198419883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b18f0 msgr2=0x7f44940b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f4499810700 1 --2- 172.21.15.12:0/3198419883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b18f0 0x7f44940b2300 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f4484002f70 tx=0x7f4484006df0).stop 2021-10-20T23:28:52.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f4499810700 1 -- 172.21.15.12:0/3198419883 shutdown_connections 2021-10-20T23:28:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f4499810700 1 --2- 172.21.15.12:0/3198419883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b18f0 0x7f44940b2300 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f4499810700 1 -- 172.21.15.12:0/3198419883 >> 172.21.15.12:0/3198419883 conn(0x7f44940636e0 msgr2=0x7f4494063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f4499810700 1 -- 172.21.15.12:0/3198419883 shutdown_connections 2021-10-20T23:28:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.464+0000 7f4499810700 1 -- 172.21.15.12:0/3198419883 wait complete. 2021-10-20T23:28:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 Processor -- start 2021-10-20T23:28:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 -- start start 2021-10-20T23:28:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44940a9c10 0x7f449415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44940b18f0 0x7f44940ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b3000 0x7f44940b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494159bd0 con 0x7f44940b3000 2021-10-20T23:28:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494159e70 con 0x7f44940b18f0 2021-10-20T23:28:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449415a110 con 0x7f44940a9c10 2021-10-20T23:28:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449900f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b3000 0x7f44940b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449900f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b3000 0x7f44940b4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44750/0 (socket says 172.21.15.12:44750) 2021-10-20T23:28:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449900f700 1 -- 172.21.15.12:0/4054289363 learned_addr learned my addr 172.21.15.12:0/4054289363 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449880e700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44940a9c10 0x7f449415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f448bfff700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44940b18f0 0x7f44940ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449900f700 1 -- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44940a9c10 msgr2=0x7f449415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449900f700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44940a9c10 0x7f449415a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449900f700 1 -- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44940b18f0 msgr2=0x7f44940ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449900f700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44940b18f0 0x7f44940ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449900f700 1 -- 172.21.15.12:0/4054289363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448400b180 con 0x7f44940b3000 2021-10-20T23:28:52.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f448bfff700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44940b18f0 0x7f44940ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:28:52.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f449900f700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b3000 0x7f44940b4590 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f4494067e80 tx=0x7f448c007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:52.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4489ffb700 1 -- 172.21.15.12:0/4054289363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f448c006aa0 con 0x7f44940b3000 2021-10-20T23:28:52.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4489ffb700 1 -- 172.21.15.12:0/4054289363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c006c00 con 0x7f44940b3000 2021-10-20T23:28:52.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940b0780 con 0x7f44940b3000 2021-10-20T23:28:52.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4489ffb700 1 -- 172.21.15.12:0/4054289363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f448c007030 con 0x7f44940b3000 2021-10-20T23:28:52.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.468+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940b4a80 con 0x7f44940b3000 2021-10-20T23:28:52.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.472+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940b0970 con 0x7f44940b3000 2021-10-20T23:28:52.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.472+0000 7f4489ffb700 1 -- 172.21.15.12:0/4054289363 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f448c01b060 con 0x7f44940b3000 2021-10-20T23:28:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.472+0000 7f4489ffb700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4474053610 0x7f4474055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.472+0000 7f4489ffb700 1 -- 172.21.15.12:0/4054289363 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f448c06b790 con 0x7f44940b3000 2021-10-20T23:28:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.472+0000 7f449880e700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4474053610 0x7f4474055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.472+0000 7f449880e700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4474053610 0x7f4474055ad0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f449000d000 tx=0x7f44900011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.476+0000 7f4489ffb700 1 -- 172.21.15.12:0/4054289363 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f44940b0970 con 0x7f44940b3000 2021-10-20T23:28:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.604+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44940b0970 con 0x7f44940b3000 2021-10-20T23:28:52.620 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.604+0000 7f4489ffb700 1 -- 172.21.15.12:0/4054289363 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+10 (secure 0 0 0) 0x7f44940b0970 con 0x7f44940b3000 2021-10-20T23:28:52.621 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4474053610 msgr2=0x7f4474055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4474053610 0x7f4474055ad0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f449000d000 tx=0x7f44900011a0).stop 2021-10-20T23:28:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b3000 msgr2=0x7f44940b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b3000 0x7f44940b4590 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f4494067e80 tx=0x7f448c007f70).stop 2021-10-20T23:28:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 shutdown_connections 2021-10-20T23:28:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4474053610 0x7f4474055ad0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940b3000 0x7f44940b4590 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44940b18f0 0x7f44940ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 --2- 172.21.15.12:0/4054289363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44940a9c10 0x7f449415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 >> 172.21.15.12:0/4054289363 conn(0x7f44940636e0 msgr2=0x7f44940b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 shutdown_connections 2021-10-20T23:28:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.608+0000 7f4499810700 1 -- 172.21.15.12:0/4054289363 wait complete. 2021-10-20T23:28:52.631 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:28:52.632 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8da4818700 1 Processor -- start 2021-10-20T23:28:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8da4818700 1 -- start start 2021-10-20T23:28:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8da4818700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8da0061320 0x7f8da0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8da4818700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da00ad5c0 0x7f8da00b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8da4818700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00aecf0 con 0x7f8da0140440 2021-10-20T23:28:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8da4818700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da00b6f20 con 0x7f8da0061320 2021-10-20T23:28:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8da4818700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00aef20 con 0x7f8da00ad5c0 2021-10-20T23:28:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8d9ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8da0061320 0x7f8da0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8d9f59e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8da0140440 0x7f8da0146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43352/0 (socket says 172.21.15.12:43352) 2021-10-20T23:28:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8d9f59e700 1 -- 172.21.15.12:0/3461795498 learned_addr learned my addr 172.21.15.12:0/3461795498 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.728+0000 7f8d9e59c700 1 --2- 172.21.15.12:0/3461795498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da00ad5c0 0x7f8da00b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8d9ed9d700 1 -- 172.21.15.12:0/3461795498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da00ad5c0 msgr2=0x7f8da00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8d9ed9d700 1 --2- 172.21.15.12:0/3461795498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da00ad5c0 0x7f8da00b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8d9ed9d700 1 -- 172.21.15.12:0/3461795498 >> v1:172.21.15.12:6789/0 conn(0x7f8da0140440 legacy=0x7f8da0146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8d9ed9d700 1 -- 172.21.15.12:0/3461795498 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da00af1c0 con 0x7f8da0061320 2021-10-20T23:28:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8d9ed9d700 1 --2- 172.21.15.12:0/3461795498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 0x7f8da0061700 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f8d94002f70 tx=0x7f8d94006df0).ready entity=mon.0 client_cookie=14487bb4f441b7c7 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8d9dd9b700 1 -- 172.21.15.12:0/3461795498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d9400d570 con 0x7f8da0061320 2021-10-20T23:28:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8d9dd9b700 1 -- 172.21.15.12:0/3461795498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d94000e90 con 0x7f8da0061320 2021-10-20T23:28:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8d9dd9b700 1 -- 172.21.15.12:0/3461795498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d9400d8c0 con 0x7f8da0061320 2021-10-20T23:28:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 -- 172.21.15.12:0/3461795498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 msgr2=0x7f8da0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 --2- 172.21.15.12:0/3461795498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 0x7f8da0061700 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f8d94002f70 tx=0x7f8d94006df0).stop 2021-10-20T23:28:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 -- 172.21.15.12:0/3461795498 shutdown_connections 2021-10-20T23:28:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 --2- 172.21.15.12:0/3461795498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da00ad5c0 0x7f8da00b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 --2- 172.21.15.12:0/3461795498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 0x7f8da0061700 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 -- 172.21.15.12:0/3461795498 >> 172.21.15.12:0/3461795498 conn(0x7f8da0066de0 msgr2=0x7f8da00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 -- 172.21.15.12:0/3461795498 shutdown_connections 2021-10-20T23:28:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 -- 172.21.15.12:0/3461795498 wait complete. 2021-10-20T23:28:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 Processor -- start 2021-10-20T23:28:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.732+0000 7f8da4818700 1 -- start start 2021-10-20T23:28:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8da4818700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 0x7f8da0145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8da4818700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8da00ad5c0 0x7f8da009e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8da4818700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da0140440 0x7f8da00ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8da4818700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00b8df0 con 0x7f8da0061320 2021-10-20T23:28:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8da4818700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da0153010 con 0x7f8da00ad5c0 2021-10-20T23:28:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8da4818700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da0153470 con 0x7f8da0140440 2021-10-20T23:28:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 0x7f8da0145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 0x7f8da0145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44760/0 (socket says 172.21.15.12:44760) 2021-10-20T23:28:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9ed9d700 1 -- 172.21.15.12:0/3376577957 learned_addr learned my addr 172.21.15.12:0/3376577957 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9e59c700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8da00ad5c0 0x7f8da009e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9f59e700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da0140440 0x7f8da00ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9ed9d700 1 -- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da0140440 msgr2=0x7f8da00ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9ed9d700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da0140440 0x7f8da00ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9ed9d700 1 -- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8da00ad5c0 msgr2=0x7f8da009e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9ed9d700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8da00ad5c0 0x7f8da009e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9ed9d700 1 -- 172.21.15.12:0/3376577957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9400b180 con 0x7f8da0061320 2021-10-20T23:28:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d9ed9d700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 0x7f8da0145600 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f8d94002f70 tx=0x7f8d94014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d8ffff700 1 -- 172.21.15.12:0/3376577957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d94016070 con 0x7f8da0061320 2021-10-20T23:28:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d8ffff700 1 -- 172.21.15.12:0/3376577957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9400de30 con 0x7f8da0061320 2021-10-20T23:28:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da00b25b0 con 0x7f8da0061320 2021-10-20T23:28:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d8ffff700 1 -- 172.21.15.12:0/3376577957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d9401e450 con 0x7f8da0061320 2021-10-20T23:28:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da0146180 con 0x7f8da0061320 2021-10-20T23:28:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da00af460 con 0x7f8da0061320 2021-10-20T23:28:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d8ffff700 1 -- 172.21.15.12:0/3376577957 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8d94025030 con 0x7f8da0061320 2021-10-20T23:28:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d8ffff700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8d7c053640 0x7f8d7c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.736+0000 7f8d8ffff700 1 -- 172.21.15.12:0/3376577957 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8d9406cb50 con 0x7f8da0061320 2021-10-20T23:28:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.740+0000 7f8d9e59c700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8d7c053640 0x7f8d7c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.740+0000 7f8d9e59c700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8d7c053640 0x7f8d7c055b00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f8d9000b000 tx=0x7f8d90008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.744+0000 7f8d8ffff700 1 -- 172.21.15.12:0/3376577957 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8d94043b50 con 0x7f8da0061320 2021-10-20T23:28:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.908+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8da0057350 con 0x7f8da0061320 2021-10-20T23:28:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.908+0000 7f8d8ffff700 1 -- 172.21.15.12:0/3376577957 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f8d94023070 con 0x7f8da0061320 2021-10-20T23:28:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:52.923 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3304581862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3304581862},{"type":"v1","addr":"172.21.15.12:6835","nonce":3304581862}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/360437153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":360437153},{"type":"v1","addr":"172.21.15.12:6833","nonce":360437153}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:28:44.372426+0000","modified":"2021-10-20T23:28:45.375331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8025":{"gid":8025,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/546930471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":546930471},{"type":"v1","addr":"172.21.15.31:6835","nonce":546930471}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-20T23:28:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8d7c053640 msgr2=0x7f8d7c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8d7c053640 0x7f8d7c055b00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f8d9000b000 tx=0x7f8d90008040).stop 2021-10-20T23:28:52.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 msgr2=0x7f8da0145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:52.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 0x7f8da0145600 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f8d94002f70 tx=0x7f8d94014000).stop 2021-10-20T23:28:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 shutdown_connections 2021-10-20T23:28:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8d7c053640 0x7f8d7c055b00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8da0140440 0x7f8da00ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8da00ad5c0 0x7f8da009e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 --2- 172.21.15.12:0/3376577957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8da0061320 0x7f8da0145600 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:52.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 >> 172.21.15.12:0/3376577957 conn(0x7f8da0066de0 msgr2=0x7f8da0146780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:52.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 shutdown_connections 2021-10-20T23:28:52.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:52.912+0000 7f8da4818700 1 -- 172.21.15.12:0/3376577957 wait complete. 2021-10-20T23:28:52.933 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 72 2021-10-20T23:28:53.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:28:44.372426+0000', 'modified': '2021-10-20T23:28:45.375331+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8025}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8025': {'gid': 8025, 'name': 'b', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/546930471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 546930471}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 546930471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:28:53.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:28:53.243 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:28:53.360 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8025,"want_state":"up:active","state":"up:active","rank_uptime":8.9675417419999999,"mdsmap_epoch":72,"osdmap_epoch":142,"osdmap_epoch_barrier":141,"uptime":13.722198473000001} 2021-10-20T23:28:53.361 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8025, "mdsmap_epoch": 72, "osdmap_epoch": 142, "osdmap_epoch_barrier": 141, "rank_uptime": 8.967541742, "state": "up:active", "uptime": 13.722198473, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:28:53.361 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:28:53.362 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:28:53.362 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:28:53.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:53.363 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:53.374 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:28:53.389 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:53.390 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:53.447 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:53.448 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:53.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:53.449 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:28:53.468 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:28:53.469 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:53.519 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:28:53.541 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:53.541 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:53.591 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-10-20T23:28:53.588+0000 7faa4f852080 -1 init, newargv = 0x5561a968d510 newargc=9 2021-10-20T23:28:53.592 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14399]: starting ceph client 2021-10-20T23:28:53.596 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:53.597 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:53.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:53.598 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:28:53.599 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14399]: starting fuse 2021-10-20T23:28:53.623 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:28:53.625 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:28:53.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:53.633 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:28:53.647 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:28:53.647 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:28:53.648 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:28:53.648 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:28:53.649 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:53.649 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:28:53.649 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:28:53.650 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:28:53.650 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:53.651 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:28:53.651 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:28:53.651 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:28:53.652 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:28:53.652 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:53.653 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:28:53.653 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:28:53.653 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:28:53.654 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:28:53.669 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:28:53.670 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:53.670 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:28:53.670 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:28:53.737 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.14399.asok 2021-10-20T23:28:53.739 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14399.asok 2021-10-20T23:28:53.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:53.740 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14399.asok status 2021-10-20T23:28:53.876 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:28:53.877 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:28:53.877 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:28:53.877 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:28:53.877 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:28:53.878 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:28:53.878 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:28:53.878 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "14399", 2021-10-20T23:28:53.879 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:28:53.879 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:53.879 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:28:53.879 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:28:53.880 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 8191, 2021-10-20T23:28:53.880 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:28:53.880 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:28:53.880 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:28:53.880 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 8191 2021-10-20T23:28:53.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:53.881 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:28:53.881 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:28:53.881 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:28:53.882 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3491570732 2021-10-20T23:28:53.882 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:28:53.882 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:53.882 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:28:53.882 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:28:53.883 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:28:53.883 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3491570732 2021-10-20T23:28:53.883 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:53.883 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.8191 172.21.15.136:0/3491570732", 2021-10-20T23:28:53.884 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/3491570732", 2021-10-20T23:28:53.884 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:28:53.884 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 72, 2021-10-20T23:28:53.884 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 142, 2021-10-20T23:28:53.884 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:28:53.885 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:28:53.885 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:28:53.885 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:28:53.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:53.888 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:53.891 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:53.898 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:28:53.900 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:53.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:53.903 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:53.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:53.966 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:53.966 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:53.975 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:28:53.976 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:53.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:53.978 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:53.978 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:54.037 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:28:54.038 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:54.038 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:28:54.039 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:28:54.039 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:54.098 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14399]: fuse finished with error 0 and tester_r 0 2021-10-20T23:28:54.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:54.100 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:54.101 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:54.107 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:28:54.108 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:28:54.109 INFO:teuthology.orchestra.run:waiting for 900 2021-10-20T23:28:54.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:28:54.182 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:54.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:28:54.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:28:54.197 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:28:54.200 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:28:54.238 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2021-10-20T23:28:54.238 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2021-10-20T23:28:54.238 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:28:54.239 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2021-10-20T23:28:54.239 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.239 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2021-10-20T23:28:54.239 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.240 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2021-10-20T23:28:54.240 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.240 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2021-10-20T23:28:54.240 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2021-10-20T23:28:54.240 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.241 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2021-10-20T23:28:54.241 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2021-10-20T23:28:54.241 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.241 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:28:54.242 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2021-10-20T23:28:54.242 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.242 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:28:54.243 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:28:54.243 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.243 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2021-10-20T23:28:54.243 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.243 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2021-10-20T23:28:54.244 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2021-10-20T23:28:54.244 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:28:54.244 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:28:54.244 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2021-10-20T23:28:54.245 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:28:54.245 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2021-10-20T23:28:54.245 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:28:54.245 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:28:54.245 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.246 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:28:54.246 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.246 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2021-10-20T23:28:54.246 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.246 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2021-10-20T23:28:54.247 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.247 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2021-10-20T23:28:54.247 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2021-10-20T23:28:54.247 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2021-10-20T23:28:54.247 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:28:54.248 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:28:54.248 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.248 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2021-10-20T23:28:54.249 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2021-10-20T23:28:54.249 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.250 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2021-10-20T23:28:54.250 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2021-10-20T23:28:54.250 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.250 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2021-10-20T23:28:54.251 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2021-10-20T23:28:54.251 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.251 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2021-10-20T23:28:54.251 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2021-10-20T23:28:54.252 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2021-10-20T23:28:54.252 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.252 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2021-10-20T23:28:54.252 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2021-10-20T23:28:54.252 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.253 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:28:54.253 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.253 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2021-10-20T23:28:54.253 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.253 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2021-10-20T23:28:54.254 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.254 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:28:54.254 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2021-10-20T23:28:54.254 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.255 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2021-10-20T23:28:54.255 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2021-10-20T23:28:54.255 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2021-10-20T23:28:54.255 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore compression mode = aggressive 2021-10-20T23:28:54.255 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2021-10-20T23:28:54.256 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 20 2021-10-20T23:28:54.256 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 20 2021-10-20T23:28:54.256 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:28:54.256 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2021-10-20T23:28:54.256 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 10 2021-10-20T23:28:54.257 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:28:54.257 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2021-10-20T23:28:54.257 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:28:54.257 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:28:54.258 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2021-10-20T23:28:54.258 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2021-10-20T23:28:54.258 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.258 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2021-10-20T23:28:54.258 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:28:54.259 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2021-10-20T23:28:54.259 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2021-10-20T23:28:54.259 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2021-10-20T23:28:54.259 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:28:54.259 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:28:54.260 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2021-10-20T23:28:54.260 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.260 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2021-10-20T23:28:54.260 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:28:54.260 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2021-10-20T23:28:54.261 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2021-10-20T23:28:54.261 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2021-10-20T23:28:54.261 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2021-10-20T23:28:54.261 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2021-10-20T23:28:54.262 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:28:54.262 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2021-10-20T23:28:54.262 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2021-10-20T23:28:54.262 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:28:54.262 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.263 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:28:54.263 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:28:54.263 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:28:54.263 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.264 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:28:54.264 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:28:54.264 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:28:54.264 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2021-10-20T23:28:54.264 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:28:54.265 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2021-10-20T23:28:54.265 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2021-10-20T23:28:54.265 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2021-10-20T23:28:54.265 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2021-10-20T23:28:54.265 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:28:54.266 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:28:54.266 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2021-10-20T23:28:54.266 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2021-10-20T23:28:54.266 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:28:54.266 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 15m 2021-10-20T23:28:54.267 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 15m 2021-10-20T23:28:54.267 INFO:teuthology.orchestra.run.smithi119.stdout: client debug getattr caps = true 2021-10-20T23:28:54.267 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2021-10-20T23:28:54.267 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2021-10-20T23:28:54.268 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2021-10-20T23:28:54.268 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2021-10-20T23:28:54.268 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2021-10-20T23:28:54.268 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2021-10-20T23:28:54.269 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2021-10-20T23:28:54.269 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2021-10-20T23:28:54.269 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:28:54.270 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal frag = True 2021-10-20T23:28:54.270 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal fragment size max = 10000 2021-10-20T23:28:54.270 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal merge size = 5 2021-10-20T23:28:54.270 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal split bits = 3 2021-10-20T23:28:54.270 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal split size = 100 2021-10-20T23:28:54.271 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2021-10-20T23:28:54.271 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2021-10-20T23:28:54.271 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2021-10-20T23:28:54.271 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2021-10-20T23:28:54.271 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2021-10-20T23:28:54.272 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 15m 2021-10-20T23:28:54.272 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 15m 2021-10-20T23:28:54.272 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2021-10-20T23:28:54.272 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2021-10-20T23:28:54.273 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:28:54.273 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2021-10-20T23:28:54.273 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.273 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2021-10-20T23:28:54.274 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.274 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2021-10-20T23:28:54.274 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.274 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2021-10-20T23:28:54.274 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2021-10-20T23:28:54.275 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.275 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2021-10-20T23:28:54.275 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2021-10-20T23:28:54.275 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.275 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:28:54.276 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2021-10-20T23:28:54.276 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.276 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:28:54.276 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:28:54.276 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.277 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2021-10-20T23:28:54.277 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.277 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2021-10-20T23:28:54.277 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2021-10-20T23:28:54.278 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:28:54.278 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:28:54.278 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2021-10-20T23:28:54.278 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:28:54.278 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2021-10-20T23:28:54.279 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:28:54.279 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:28:54.279 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.279 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:28:54.279 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.280 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2021-10-20T23:28:54.280 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.280 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2021-10-20T23:28:54.280 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.280 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2021-10-20T23:28:54.281 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2021-10-20T23:28:54.281 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2021-10-20T23:28:54.281 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:28:54.281 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:28:54.282 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.282 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2021-10-20T23:28:54.282 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2021-10-20T23:28:54.282 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.282 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2021-10-20T23:28:54.283 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2021-10-20T23:28:54.283 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.283 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2021-10-20T23:28:54.283 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2021-10-20T23:28:54.283 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.284 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2021-10-20T23:28:54.284 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2021-10-20T23:28:54.284 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2021-10-20T23:28:54.284 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.284 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2021-10-20T23:28:54.285 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2021-10-20T23:28:54.285 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.285 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:28:54.285 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.286 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2021-10-20T23:28:54.286 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.286 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2021-10-20T23:28:54.286 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.287 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:28:54.287 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2021-10-20T23:28:54.287 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.287 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2021-10-20T23:28:54.288 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2021-10-20T23:28:54.288 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2021-10-20T23:28:54.288 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore compression mode = aggressive 2021-10-20T23:28:54.288 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2021-10-20T23:28:54.288 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 20 2021-10-20T23:28:54.289 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 20 2021-10-20T23:28:54.289 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:28:54.289 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2021-10-20T23:28:54.289 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 10 2021-10-20T23:28:54.289 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:28:54.290 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2021-10-20T23:28:54.290 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:28:54.290 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:28:54.290 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2021-10-20T23:28:54.290 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2021-10-20T23:28:54.291 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.291 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2021-10-20T23:28:54.291 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:28:54.291 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2021-10-20T23:28:54.292 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2021-10-20T23:28:54.292 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2021-10-20T23:28:54.292 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:28:54.292 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:28:54.292 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2021-10-20T23:28:54.293 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.293 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2021-10-20T23:28:54.293 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:28:54.293 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2021-10-20T23:28:54.294 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2021-10-20T23:28:54.294 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2021-10-20T23:28:54.294 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2021-10-20T23:28:54.295 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2021-10-20T23:28:54.295 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:28:54.295 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2021-10-20T23:28:54.295 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2021-10-20T23:28:54.295 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:28:54.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.296 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:28:54.296 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:28:54.296 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:28:54.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.297 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:28:54.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:28:54.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:28:54.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2021-10-20T23:28:54.297 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:28:54.298 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2021-10-20T23:28:54.298 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2021-10-20T23:28:54.298 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2021-10-20T23:28:54.298 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2021-10-20T23:28:54.299 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:28:54.299 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:28:54.299 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2021-10-20T23:28:54.299 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2021-10-20T23:28:54.299 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:28:54.300 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 15m 2021-10-20T23:28:54.300 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 15m 2021-10-20T23:28:54.300 INFO:teuthology.orchestra.run.smithi031.stdout: client debug getattr caps = true 2021-10-20T23:28:54.300 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2021-10-20T23:28:54.300 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2021-10-20T23:28:54.301 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2021-10-20T23:28:54.301 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2021-10-20T23:28:54.301 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2021-10-20T23:28:54.301 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2021-10-20T23:28:54.301 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2021-10-20T23:28:54.302 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2021-10-20T23:28:54.302 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:28:54.302 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal frag = True 2021-10-20T23:28:54.302 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal fragment size max = 10000 2021-10-20T23:28:54.302 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal merge size = 5 2021-10-20T23:28:54.303 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split bits = 3 2021-10-20T23:28:54.303 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split size = 100 2021-10-20T23:28:54.303 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2021-10-20T23:28:54.303 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2021-10-20T23:28:54.303 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2021-10-20T23:28:54.304 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2021-10-20T23:28:54.304 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2021-10-20T23:28:54.304 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 15m 2021-10-20T23:28:54.305 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 15m 2021-10-20T23:28:54.305 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2021-10-20T23:28:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2021-10-20T23:28:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:28:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2021-10-20T23:28:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2021-10-20T23:28:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2021-10-20T23:28:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2021-10-20T23:28:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2021-10-20T23:28:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2021-10-20T23:28:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2021-10-20T23:28:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:28:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2021-10-20T23:28:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:28:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:28:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2021-10-20T23:28:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2021-10-20T23:28:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2021-10-20T23:28:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:28:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:28:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2021-10-20T23:28:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:28:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2021-10-20T23:28:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:28:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:28:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:28:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2021-10-20T23:28:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2021-10-20T23:28:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2021-10-20T23:28:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2021-10-20T23:28:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2021-10-20T23:28:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:28:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:28:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.315 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2021-10-20T23:28:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2021-10-20T23:28:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2021-10-20T23:28:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2021-10-20T23:28:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2021-10-20T23:28:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2021-10-20T23:28:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2021-10-20T23:28:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2021-10-20T23:28:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2021-10-20T23:28:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2021-10-20T23:28:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2021-10-20T23:28:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:28:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2021-10-20T23:28:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2021-10-20T23:28:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:28:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2021-10-20T23:28:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2021-10-20T23:28:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2021-10-20T23:28:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2021-10-20T23:28:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore compression mode = aggressive 2021-10-20T23:28:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2021-10-20T23:28:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 20 2021-10-20T23:28:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 20 2021-10-20T23:28:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:28:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2021-10-20T23:28:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 10 2021-10-20T23:28:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:28:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2021-10-20T23:28:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:28:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:28:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2021-10-20T23:28:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2021-10-20T23:28:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.326 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2021-10-20T23:28:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:28:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2021-10-20T23:28:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2021-10-20T23:28:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2021-10-20T23:28:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:28:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:28:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2021-10-20T23:28:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.328 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2021-10-20T23:28:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:28:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2021-10-20T23:28:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2021-10-20T23:28:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2021-10-20T23:28:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2021-10-20T23:28:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2021-10-20T23:28:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:28:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2021-10-20T23:28:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2021-10-20T23:28:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:28:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:28:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:28:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:28:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:28:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:28:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:28:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2021-10-20T23:28:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.333 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2021-10-20T23:28:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2021-10-20T23:28:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2021-10-20T23:28:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2021-10-20T23:28:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:28:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:28:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2021-10-20T23:28:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2021-10-20T23:28:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:28:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 15m 2021-10-20T23:28:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 15m 2021-10-20T23:28:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: client debug getattr caps = true 2021-10-20T23:28:54.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2021-10-20T23:28:54.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2021-10-20T23:28:54.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2021-10-20T23:28:54.345 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2021-10-20T23:28:54.345 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2021-10-20T23:28:54.345 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2021-10-20T23:28:54.345 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2021-10-20T23:28:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2021-10-20T23:28:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:28:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal frag = True 2021-10-20T23:28:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal fragment size max = 10000 2021-10-20T23:28:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal merge size = 5 2021-10-20T23:28:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal split bits = 3 2021-10-20T23:28:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal split size = 100 2021-10-20T23:28:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2021-10-20T23:28:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2021-10-20T23:28:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2021-10-20T23:28:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2021-10-20T23:28:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2021-10-20T23:28:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 15m 2021-10-20T23:28:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 15m 2021-10-20T23:28:54.353 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2021-10-20T23:28:54.353 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2021-10-20T23:28:54.354 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:28:54.354 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2021-10-20T23:28:54.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.354 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2021-10-20T23:28:54.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.355 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2021-10-20T23:28:54.355 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.355 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2021-10-20T23:28:54.355 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2021-10-20T23:28:54.356 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.357 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2021-10-20T23:28:54.357 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2021-10-20T23:28:54.357 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.357 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:28:54.358 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2021-10-20T23:28:54.358 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.358 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:28:54.358 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:28:54.358 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.360 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2021-10-20T23:28:54.360 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.360 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2021-10-20T23:28:54.360 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2021-10-20T23:28:54.360 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:28:54.361 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:28:54.361 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2021-10-20T23:28:54.361 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:28:54.361 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2021-10-20T23:28:54.362 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:28:54.362 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:28:54.362 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.362 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:28:54.362 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.363 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2021-10-20T23:28:54.363 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.363 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2021-10-20T23:28:54.363 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.364 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2021-10-20T23:28:54.364 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2021-10-20T23:28:54.364 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2021-10-20T23:28:54.364 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:28:54.364 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:28:54.365 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.365 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2021-10-20T23:28:54.365 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2021-10-20T23:28:54.365 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.365 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2021-10-20T23:28:54.366 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2021-10-20T23:28:54.366 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.366 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2021-10-20T23:28:54.367 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2021-10-20T23:28:54.367 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.367 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2021-10-20T23:28:54.367 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2021-10-20T23:28:54.367 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2021-10-20T23:28:54.368 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.368 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2021-10-20T23:28:54.368 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2021-10-20T23:28:54.368 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.369 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:28:54.369 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.369 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2021-10-20T23:28:54.370 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.370 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2021-10-20T23:28:54.370 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.370 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:28:54.371 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2021-10-20T23:28:54.371 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.371 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2021-10-20T23:28:54.371 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2021-10-20T23:28:54.371 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2021-10-20T23:28:54.372 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore compression mode = aggressive 2021-10-20T23:28:54.372 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2021-10-20T23:28:54.372 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2021-10-20T23:28:54.372 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2021-10-20T23:28:54.372 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:28:54.373 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2021-10-20T23:28:54.373 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2021-10-20T23:28:54.373 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:28:54.373 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2021-10-20T23:28:54.374 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:28:54.374 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:28:54.374 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2021-10-20T23:28:54.374 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-10-20T23:28:54.375 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.375 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2021-10-20T23:28:54.375 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:28:54.375 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2021-10-20T23:28:54.375 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-10-20T23:28:54.376 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-10-20T23:28:54.376 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:28:54.376 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:28:54.376 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2021-10-20T23:28:54.377 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.377 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2021-10-20T23:28:54.377 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:28:54.377 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-10-20T23:28:54.377 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2021-10-20T23:28:54.378 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-10-20T23:28:54.378 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2021-10-20T23:28:54.378 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2021-10-20T23:28:54.378 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:28:54.379 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2021-10-20T23:28:54.379 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2021-10-20T23:28:54.379 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:28:54.380 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.380 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:28:54.380 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:28:54.380 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:28:54.381 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.381 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:28:54.381 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:28:54.381 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:28:54.382 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2021-10-20T23:28:54.382 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:28:54.382 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2021-10-20T23:28:54.382 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2021-10-20T23:28:54.382 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2021-10-20T23:28:54.383 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2021-10-20T23:28:54.383 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:28:54.383 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:28:54.383 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2021-10-20T23:28:54.384 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2021-10-20T23:28:54.384 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:28:54.384 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 15m 2021-10-20T23:28:54.384 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 15m 2021-10-20T23:28:54.384 INFO:teuthology.orchestra.run.smithi136.stdout: client debug getattr caps = true 2021-10-20T23:28:54.385 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2021-10-20T23:28:54.385 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2021-10-20T23:28:54.385 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2021-10-20T23:28:54.385 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2021-10-20T23:28:54.385 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2021-10-20T23:28:54.386 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2021-10-20T23:28:54.386 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2021-10-20T23:28:54.386 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2021-10-20T23:28:54.392 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:28:54.392 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal frag = True 2021-10-20T23:28:54.392 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal fragment size max = 10000 2021-10-20T23:28:54.393 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal merge size = 5 2021-10-20T23:28:54.393 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split bits = 3 2021-10-20T23:28:54.393 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split size = 100 2021-10-20T23:28:54.393 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2021-10-20T23:28:54.393 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2021-10-20T23:28:54.394 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2021-10-20T23:28:54.394 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2021-10-20T23:28:54.394 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-10-20T23:28:54.394 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 15m 2021-10-20T23:28:54.395 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 15m 2021-10-20T23:28:54.396 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:28:54.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.496+0000 7fc7088c9700 1 Processor -- start 2021-10-20T23:28:54.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.496+0000 7fc7088c9700 1 -- start start 2021-10-20T23:28:54.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc7040b1370 0x7fc704144a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7040b17c0 con 0x7fc7040b0670 2021-10-20T23:28:54.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7040aecd0 con 0x7fc7040ac7a0 2021-10-20T23:28:54.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7040b0a50 con 0x7fc7040b1370 2021-10-20T23:28:54.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc70359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc7040b1370 0x7fc704144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc702d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc7040b0670 0x7fc7040b0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43362/0 (socket says 172.21.15.12:43362) 2021-10-20T23:28:54.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc702d9d700 1 -- 172.21.15.12:0/1110778333 learned_addr learned my addr 172.21.15.12:0/1110778333 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:54.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc70359e700 1 -- 172.21.15.12:0/1110778333 >> v1:172.21.15.31:6789/0 conn(0x7fc7040ac7a0 legacy=0x7fc704144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc70359e700 1 -- 172.21.15.12:0/1110778333 >> v1:172.21.15.12:6789/0 conn(0x7fc7040b0670 legacy=0x7fc7040b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc70359e700 1 -- 172.21.15.12:0/1110778333 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7040ae2f0 con 0x7fc7040b1370 2021-10-20T23:28:54.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc701d9b700 1 -- 172.21.15.12:0/1110778333 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267463587 0 0) 0x7fc7040b17c0 con 0x7fc7040b0670 2021-10-20T23:28:54.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc70359e700 1 --2- 172.21.15.12:0/1110778333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 0x7fc704144a50 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7fc6fc0032f0 tx=0x7fc6fc0091d0).ready entity=mon.0 client_cookie=bb6a38ed87dc201 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:54.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc701d9b700 1 -- 172.21.15.12:0/1110778333 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6fc009ea0 con 0x7fc7040b1370 2021-10-20T23:28:54.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc701d9b700 1 -- 172.21.15.12:0/1110778333 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc00b8a0 con 0x7fc7040b1370 2021-10-20T23:28:54.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc701d9b700 1 -- 172.21.15.12:0/1110778333 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6fc00ba10 con 0x7fc7040b1370 2021-10-20T23:28:54.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 -- 172.21.15.12:0/1110778333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 msgr2=0x7fc704144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 --2- 172.21.15.12:0/1110778333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 0x7fc704144a50 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7fc6fc0032f0 tx=0x7fc6fc0091d0).stop 2021-10-20T23:28:54.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 -- 172.21.15.12:0/1110778333 shutdown_connections 2021-10-20T23:28:54.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 --2- 172.21.15.12:0/1110778333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 0x7fc704144a50 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 -- 172.21.15.12:0/1110778333 >> 172.21.15.12:0/1110778333 conn(0x7fc70405bd40 msgr2=0x7fc704062560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:54.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 -- 172.21.15.12:0/1110778333 shutdown_connections 2021-10-20T23:28:54.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.500+0000 7fc7088c9700 1 -- 172.21.15.12:0/1110778333 wait complete. 2021-10-20T23:28:54.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc7088c9700 1 Processor -- start 2021-10-20T23:28:54.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc7088c9700 1 -- start start 2021-10-20T23:28:54.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc7088c9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7040ac7a0 0x7fc70414d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc7088c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7040b0670 0x7fc704146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc7088c9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 0x7fc704159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc7088c9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7041474b0 con 0x7fc7040b1370 2021-10-20T23:28:54.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc7088c9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc704067170 con 0x7fc7040b0670 2021-10-20T23:28:54.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc7088c9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc704066790 con 0x7fc7040ac7a0 2021-10-20T23:28:54.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc70359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 0x7fc704159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc70259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7040b0670 0x7fc704146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc702d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7040ac7a0 0x7fc70414d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc70359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 0x7fc704159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44778/0 (socket says 172.21.15.12:44778) 2021-10-20T23:28:54.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.504+0000 7fc70359e700 1 -- 172.21.15.12:0/3613176179 learned_addr learned my addr 172.21.15.12:0/3613176179 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:54.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc70359e700 1 -- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7040ac7a0 msgr2=0x7fc70414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc70359e700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7040ac7a0 0x7fc70414d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc70359e700 1 -- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7040b0670 msgr2=0x7fc704146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc70359e700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7040b0670 0x7fc704146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc70359e700 1 -- 172.21.15.12:0/3613176179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc009470 con 0x7fc7040b1370 2021-10-20T23:28:54.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc70359e700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 0x7fc704159ed0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fc6fc0032f0 tx=0x7fc6fc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:54.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc6f3fff700 1 -- 172.21.15.12:0/3613176179 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6fc009ea0 con 0x7fc7040b1370 2021-10-20T23:28:54.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc6f3fff700 1 -- 172.21.15.12:0/3613176179 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc00beb0 con 0x7fc7040b1370 2021-10-20T23:28:54.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc704066a30 con 0x7fc7040b1370 2021-10-20T23:28:54.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc6f3fff700 1 -- 172.21.15.12:0/3613176179 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6fc01f5e0 con 0x7fc7040b1370 2021-10-20T23:28:54.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc704147be0 con 0x7fc7040b1370 2021-10-20T23:28:54.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7040665f0 con 0x7fc7040b1370 2021-10-20T23:28:54.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.508+0000 7fc6f3fff700 1 -- 172.21.15.12:0/3613176179 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc6fc026030 con 0x7fc7040b1370 2021-10-20T23:28:54.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.512+0000 7fc6f3fff700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6e00536a0 0x7fc6e0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.512+0000 7fc6f3fff700 1 -- 172.21.15.12:0/3613176179 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc6fc06c660 con 0x7fc7040b1370 2021-10-20T23:28:54.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.512+0000 7fc702d9d700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6e00536a0 0x7fc6e0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.512+0000 7fc702d9d700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6e00536a0 0x7fc6e0055b60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fc6f400d000 tx=0x7fc6f40011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.520+0000 7fc6f3fff700 1 -- 172.21.15.12:0/3613176179 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc7040665f0 con 0x7fc7040b1370 2021-10-20T23:28:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7040665f0 con 0x7fc7040b1370 2021-10-20T23:28:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc6f3fff700 1 -- 172.21.15.12:0/3613176179 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fc7040665f0 con 0x7fc7040b1370 2021-10-20T23:28:54.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:54.660 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":142,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:28:45.375943+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:28:42.362682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-20T23:28:43.380308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:28:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6e00536a0 msgr2=0x7fc6e0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6e00536a0 0x7fc6e0055b60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fc6f400d000 tx=0x7fc6f40011a0).stop 2021-10-20T23:28:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 msgr2=0x7fc704159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 0x7fc704159ed0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fc6fc0032f0 tx=0x7fc6fc016000).stop 2021-10-20T23:28:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 shutdown_connections 2021-10-20T23:28:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6e00536a0 0x7fc6e0055b60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7040b1370 0x7fc704159ed0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7040b0670 0x7fc704146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 --2- 172.21.15.12:0/3613176179 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7040ac7a0 0x7fc70414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 >> 172.21.15.12:0/3613176179 conn(0x7fc70405bd40 msgr2=0x7fc70414bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 shutdown_connections 2021-10-20T23:28:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.648+0000 7fc7088c9700 1 -- 172.21.15.12:0/3613176179 wait complete. 2021-10-20T23:28:54.689 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:28:42.362682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:28:43.380308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:28:54.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:28:54.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f759e700 1 Processor -- start 2021-10-20T23:28:54.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f759e700 1 -- start start 2021-10-20T23:28:54.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f80b6380 0x7f37f80b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37f8143630 0x7f37f8060210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f8146670 con 0x7f37f805fdd0 2021-10-20T23:28:54.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f8146910 con 0x7f37f8143630 2021-10-20T23:28:54.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f8146bb0 con 0x7f37f80b6380 2021-10-20T23:28:54.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37f8143630 0x7f37f8060210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37f8143630 0x7f37f8060210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44784/0 (socket says 172.21.15.12:44784) 2021-10-20T23:28:54.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f5d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f37f805fdd0 0x7f37f8142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43378/0 (socket says 172.21.15.12:43378) 2021-10-20T23:28:54.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.792+0000 7f37f6d9d700 1 -- 172.21.15.12:0/1287827549 learned_addr learned my addr 172.21.15.12:0/1287827549 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:54.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f659c700 1 --2- 172.21.15.12:0/1287827549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f80b6380 0x7f37f80b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f6d9d700 1 -- 172.21.15.12:0/1287827549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f80b6380 msgr2=0x7f37f80b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:54.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f6d9d700 1 --2- 172.21.15.12:0/1287827549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f80b6380 0x7f37f80b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f6d9d700 1 -- 172.21.15.12:0/1287827549 >> v1:172.21.15.12:6789/0 conn(0x7f37f805fdd0 legacy=0x7f37f8142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f6d9d700 1 -- 172.21.15.12:0/1287827549 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f8146e50 con 0x7f37f8143630 2021-10-20T23:28:54.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f559a700 1 -- 172.21.15.12:0/1287827549 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232992794 0 0) 0x7f37f8146670 con 0x7f37f805fdd0 2021-10-20T23:28:54.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f6d9d700 1 --2- 172.21.15.12:0/1287827549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f8143630 0x7f37f8060210 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f37f00032f0 tx=0x7f37f0009290).ready entity=mon.0 client_cookie=7b2a0c5b1e7c2b88 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:54.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f559a700 1 -- 172.21.15.12:0/1287827549 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f000b8a0 con 0x7f37f8143630 2021-10-20T23:28:54.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f559a700 1 -- 172.21.15.12:0/1287827549 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f000ba00 con 0x7f37f8143630 2021-10-20T23:28:54.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f559a700 1 -- 172.21.15.12:0/1287827549 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f000bb70 con 0x7f37f8143630 2021-10-20T23:28:54.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f759e700 1 -- 172.21.15.12:0/1287827549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f8143630 msgr2=0x7f37f8060210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f759e700 1 --2- 172.21.15.12:0/1287827549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f8143630 0x7f37f8060210 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f37f00032f0 tx=0x7f37f0009290).stop 2021-10-20T23:28:54.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f759e700 1 -- 172.21.15.12:0/1287827549 shutdown_connections 2021-10-20T23:28:54.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f759e700 1 --2- 172.21.15.12:0/1287827549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f8143630 0x7f37f8060210 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f759e700 1 --2- 172.21.15.12:0/1287827549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f80b6380 0x7f37f80b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f759e700 1 -- 172.21.15.12:0/1287827549 >> 172.21.15.12:0/1287827549 conn(0x7f37f805c720 msgr2=0x7f37f805cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:54.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f759e700 1 -- 172.21.15.12:0/1287827549 shutdown_connections 2021-10-20T23:28:54.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.796+0000 7f37f759e700 1 -- 172.21.15.12:0/1287827549 wait complete. 2021-10-20T23:28:54.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f759e700 1 Processor -- start 2021-10-20T23:28:54.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f759e700 1 -- start start 2021-10-20T23:28:54.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f805fdd0 0x7f37f8143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f80b6380 0x7f37f8145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37f8143630 0x7f37f8140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f81403d0 con 0x7f37f80b6380 2021-10-20T23:28:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f8152f70 con 0x7f37f8143630 2021-10-20T23:28:54.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f813ff30 con 0x7f37f805fdd0 2021-10-20T23:28:54.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f80b6380 0x7f37f8145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f80b6380 0x7f37f8145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44790/0 (socket says 172.21.15.12:44790) 2021-10-20T23:28:54.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f5d9b700 1 -- 172.21.15.12:0/3875236649 learned_addr learned my addr 172.21.15.12:0/3875236649 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:54.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f659c700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f805fdd0 0x7f37f8143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f6d9d700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37f8143630 0x7f37f8140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f5d9b700 1 -- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f805fdd0 msgr2=0x7f37f8143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f5d9b700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f805fdd0 0x7f37f8143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f5d9b700 1 -- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37f8143630 msgr2=0x7f37f8140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f5d9b700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37f8143630 0x7f37f8140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f5d9b700 1 -- 172.21.15.12:0/3875236649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0009530 con 0x7f37f80b6380 2021-10-20T23:28:54.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.800+0000 7f37f5d9b700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f80b6380 0x7f37f8145270 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f37e8000ed0 tx=0x7f37e8007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:54.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.804+0000 7f37e77fe700 1 -- 172.21.15.12:0/3875236649 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37e80070d0 con 0x7f37f80b6380 2021-10-20T23:28:54.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.804+0000 7f37e77fe700 1 -- 172.21.15.12:0/3875236649 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e8007230 con 0x7f37f80b6380 2021-10-20T23:28:54.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.804+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f8142360 con 0x7f37f80b6380 2021-10-20T23:28:54.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.804+0000 7f37e77fe700 1 -- 172.21.15.12:0/3875236649 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37e8005740 con 0x7f37f80b6380 2021-10-20T23:28:54.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.804+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f8145760 con 0x7f37f80b6380 2021-10-20T23:28:54.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.804+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f81472f0 con 0x7f37f80b6380 2021-10-20T23:28:54.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.804+0000 7f37e77fe700 1 -- 172.21.15.12:0/3875236649 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f37e801a060 con 0x7f37f80b6380 2021-10-20T23:28:54.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.804+0000 7f37e77fe700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37d40535b0 0x7f37d4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:54.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.804+0000 7f37e77fe700 1 -- 172.21.15.12:0/3875236649 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f37e806aeb0 con 0x7f37f80b6380 2021-10-20T23:28:54.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.808+0000 7f37f659c700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37d40535b0 0x7f37d4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:54.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.808+0000 7f37f659c700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37d40535b0 0x7f37d4055a70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f37ec00c000 tx=0x7f37ec008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:54.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.812+0000 7f37e77fe700 1 -- 172.21.15.12:0/3875236649 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f37e8041da0 con 0x7f37f80b6380 2021-10-20T23:28:54.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.940+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f37f8057350 con 0x7f37f80b6380 2021-10-20T23:28:54.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37e77fe700 1 -- 172.21.15.12:0/3875236649 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v142) v1 ==== 110+0+10 (secure 0 0 0) 0x7f37e8018070 con 0x7f37f80b6380 2021-10-20T23:28:54.955 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:28:54.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37d40535b0 msgr2=0x7f37d4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37d40535b0 0x7f37d4055a70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f37ec00c000 tx=0x7f37ec008040).stop 2021-10-20T23:28:54.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f80b6380 msgr2=0x7f37f8145270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:54.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f80b6380 0x7f37f8145270 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f37e8000ed0 tx=0x7f37e8007ac0).stop 2021-10-20T23:28:54.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 shutdown_connections 2021-10-20T23:28:54.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f37d40535b0 0x7f37d4055a70 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37f8143630 0x7f37f8140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f80b6380 0x7f37f8145270 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 --2- 172.21.15.12:0/3875236649 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37f805fdd0 0x7f37f8143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:54.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 >> 172.21.15.12:0/3875236649 conn(0x7f37f805c720 msgr2=0x7f37f8149860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:54.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 shutdown_connections 2021-10-20T23:28:54.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:54.944+0000 7f37f759e700 1 -- 172.21.15.12:0/3875236649 wait complete. 2021-10-20T23:28:54.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:28:55.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.064+0000 7f9b8f59e700 1 Processor -- start 2021-10-20T23:28:55.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.064+0000 7f9b8f59e700 1 -- start start 2021-10-20T23:28:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9b900b2240 0x7f9b900b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b90140750 0x7f9b90139900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b90140ba0 con 0x7f9b900b6520 2021-10-20T23:28:55.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b900b3440 con 0x7f9b90140750 2021-10-20T23:28:55.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b900b08a0 con 0x7f9b900b2240 2021-10-20T23:28:55.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b90140750 0x7f9b90139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8e59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9b900b6520 0x7f9b900b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43390/0 (socket says 172.21.15.12:43390) 2021-10-20T23:28:55.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8e59c700 1 -- 172.21.15.12:0/1893699838 learned_addr learned my addr 172.21.15.12:0/1893699838 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:55.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8dd9b700 1 --2- 172.21.15.12:0/1893699838 >> v2:172.21.15.31:3300/0 conn(0x7f9b900b2240 0x7f9b900b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8ed9d700 1 -- 172.21.15.12:0/1893699838 >> v2:172.21.15.31:3300/0 conn(0x7f9b900b2240 msgr2=0x7f9b900b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:55.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8ed9d700 1 --2- 172.21.15.12:0/1893699838 >> v2:172.21.15.31:3300/0 conn(0x7f9b900b2240 0x7f9b900b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8ed9d700 1 -- 172.21.15.12:0/1893699838 >> v1:172.21.15.12:6789/0 conn(0x7f9b900b6520 legacy=0x7f9b900b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8d59a700 1 -- 172.21.15.12:0/1893699838 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96519199 0 0) 0x7f9b90140ba0 con 0x7f9b900b6520 2021-10-20T23:28:55.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8ed9d700 1 -- 172.21.15.12:0/1893699838 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900b1d20 con 0x7f9b90140750 2021-10-20T23:28:55.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8ed9d700 1 --2- 172.21.15.12:0/1893699838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b90140750 0x7f9b90139900 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f9b880032f0 tx=0x7f9b880091d0).ready entity=mon.0 client_cookie=bbd22f2158e29208 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8d59a700 1 -- 172.21.15.12:0/1893699838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b8800b680 con 0x7f9b90140750 2021-10-20T23:28:55.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8d59a700 1 -- 172.21.15.12:0/1893699838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8800b7e0 con 0x7f9b90140750 2021-10-20T23:28:55.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8d59a700 1 -- 172.21.15.12:0/1893699838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b8800b950 con 0x7f9b90140750 2021-10-20T23:28:55.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 -- 172.21.15.12:0/1893699838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b90140750 msgr2=0x7f9b90139900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 --2- 172.21.15.12:0/1893699838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b90140750 0x7f9b90139900 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f9b880032f0 tx=0x7f9b880091d0).stop 2021-10-20T23:28:55.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 -- 172.21.15.12:0/1893699838 shutdown_connections 2021-10-20T23:28:55.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 --2- 172.21.15.12:0/1893699838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b90140750 0x7f9b90139900 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 --2- 172.21.15.12:0/1893699838 >> v2:172.21.15.31:3300/0 conn(0x7f9b900b2240 0x7f9b900b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 -- 172.21.15.12:0/1893699838 >> 172.21.15.12:0/1893699838 conn(0x7f9b9005c720 msgr2=0x7f9b9005cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:55.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 -- 172.21.15.12:0/1893699838 shutdown_connections 2021-10-20T23:28:55.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.068+0000 7f9b8f59e700 1 -- 172.21.15.12:0/1893699838 wait complete. 2021-10-20T23:28:55.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.072+0000 7f9b8f59e700 1 Processor -- start 2021-10-20T23:28:55.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.072+0000 7f9b8f59e700 1 -- start start 2021-10-20T23:28:55.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.072+0000 7f9b8f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b900b2240 0x7f9b90137340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.072+0000 7f9b8f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b900b6520 0x7f9b900607e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.072+0000 7f9b8f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b90140750 0x7f9b90135970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.072+0000 7f9b8f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900615b0 con 0x7f9b900b6520 2021-10-20T23:28:55.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.072+0000 7f9b8f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9013cdf0 con 0x7f9b900b2240 2021-10-20T23:28:55.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.072+0000 7f9b8f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9013d090 con 0x7f9b90140750 2021-10-20T23:28:55.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.072+0000 7f9b8dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b900b6520 0x7f9b900607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b900b6520 0x7f9b900607e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44804/0 (socket says 172.21.15.12:44804) 2021-10-20T23:28:55.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8dd9b700 1 -- 172.21.15.12:0/4173494831 learned_addr learned my addr 172.21.15.12:0/4173494831 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:55.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8e59c700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b900b2240 0x7f9b90137340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8ed9d700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b90140750 0x7f9b90135970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8dd9b700 1 -- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b90140750 msgr2=0x7f9b90135970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8dd9b700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b90140750 0x7f9b90135970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8dd9b700 1 -- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b900b2240 msgr2=0x7f9b90137340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8dd9b700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b900b2240 0x7f9b90137340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8dd9b700 1 -- 172.21.15.12:0/4173494831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88009470 con 0x7f9b900b6520 2021-10-20T23:28:55.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8dd9b700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b900b6520 0x7f9b900607e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f9b7800c000 tx=0x7f9b78006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b877fe700 1 -- 172.21.15.12:0/4173494831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b78010780 con 0x7f9b900b6520 2021-10-20T23:28:55.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b877fe700 1 -- 172.21.15.12:0/4173494831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7800b3b0 con 0x7f9b900b6520 2021-10-20T23:28:55.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b901354d0 con 0x7f9b900b6520 2021-10-20T23:28:55.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b877fe700 1 -- 172.21.15.12:0/4173494831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b78010ad0 con 0x7f9b900b6520 2021-10-20T23:28:55.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b90060fb0 con 0x7f9b900b6520 2021-10-20T23:28:55.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b90135660 con 0x7f9b900b6520 2021-10-20T23:28:55.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b877fe700 1 -- 172.21.15.12:0/4173494831 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b78010c30 con 0x7f9b900b6520 2021-10-20T23:28:55.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b877fe700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b740536a0 0x7f9b74055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.076+0000 7f9b877fe700 1 -- 172.21.15.12:0/4173494831 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9b7806bf20 con 0x7f9b900b6520 2021-10-20T23:28:55.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.080+0000 7f9b8e59c700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b740536a0 0x7f9b74055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.080+0000 7f9b8e59c700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b740536a0 0x7f9b74055b60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f9b8000d000 tx=0x7f9b800011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.084+0000 7f9b877fe700 1 -- 172.21.15.12:0/4173494831 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b78042e80 con 0x7f9b900b6520 2021-10-20T23:28:55.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.212+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9b90057350 con 0x7f9b900b6520 2021-10-20T23:28:55.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.212+0000 7f9b877fe700 1 -- 172.21.15.12:0/4173494831 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9b780464a0 con 0x7f9b900b6520 2021-10-20T23:28:55.226 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:55.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b740536a0 msgr2=0x7f9b74055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b740536a0 0x7f9b74055b60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f9b8000d000 tx=0x7f9b800011a0).stop 2021-10-20T23:28:55.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b900b6520 msgr2=0x7f9b900607e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b900b6520 0x7f9b900607e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f9b7800c000 tx=0x7f9b78006df0).stop 2021-10-20T23:28:55.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 shutdown_connections 2021-10-20T23:28:55.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9b740536a0 0x7f9b74055b60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b90140750 0x7f9b90135970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b900b6520 0x7f9b900607e0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 --2- 172.21.15.12:0/4173494831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b900b2240 0x7f9b90137340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 >> 172.21.15.12:0/4173494831 conn(0x7f9b9005c720 msgr2=0x7f9b900b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 shutdown_connections 2021-10-20T23:28:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.216+0000 7f9b8f59e700 1 -- 172.21.15.12:0/4173494831 wait complete. 2021-10-20T23:28:55.239 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:28:55.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.340+0000 7f4b0d4fe700 1 Processor -- start 2021-10-20T23:28:55.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.340+0000 7f4b0d4fe700 1 -- start start 2021-10-20T23:28:55.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b080b66a0 0x7f4b080b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b080b1580 con 0x7f4b080ad7a0 2021-10-20T23:28:55.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b080b6a80 con 0x7f4b080b1840 2021-10-20T23:28:55.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0813fc10 con 0x7f4b080b66a0 2021-10-20T23:28:55.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0ccfd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4b080ad7a0 0x7f4b0813cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43408/0 (socket says 172.21.15.12:43408) 2021-10-20T23:28:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0ccfd700 1 -- 172.21.15.12:0/1206354585 learned_addr learned my addr 172.21.15.12:0/1206354585 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b07fff700 1 --2- 172.21.15.12:0/1206354585 >> v2:172.21.15.31:3300/0 conn(0x7f4b080b66a0 0x7f4b080b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b077fe700 1 -- 172.21.15.12:0/1206354585 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943215699 0 0) 0x7f4b00001490 con 0x7f4b080ad7a0 2021-10-20T23:28:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b077fe700 1 -- 172.21.15.12:0/1206354585 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ae8003260 con 0x7f4b080ad7a0 2021-10-20T23:28:55.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b077fe700 1 -- 172.21.15.12:0/1206354585 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1428429270 0 0) 0x7f4ae8003260 con 0x7f4b080ad7a0 2021-10-20T23:28:55.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b07fff700 1 -- 172.21.15.12:0/1206354585 >> v1:172.21.15.31:6789/0 conn(0x7f4b080b1840 legacy=0x7f4b080ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b07fff700 1 -- 172.21.15.12:0/1206354585 >> v1:172.21.15.12:6789/0 conn(0x7f4b080ad7a0 legacy=0x7f4b0813cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b07fff700 1 -- 172.21.15.12:0/1206354585 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0813fe00 con 0x7f4b080b66a0 2021-10-20T23:28:55.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b07fff700 1 --2- 172.21.15.12:0/1206354585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b080b66a0 0x7f4b080b1090 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4b00001d10 tx=0x7f4af8006df0).ready entity=mon.1 client_cookie=a9182046397fe0df server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b077fe700 1 -- 172.21.15.12:0/1206354585 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b00001b70 con 0x7f4b080b66a0 2021-10-20T23:28:55.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b077fe700 1 -- 172.21.15.12:0/1206354585 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af8000e90 con 0x7f4b080b66a0 2021-10-20T23:28:55.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b077fe700 1 -- 172.21.15.12:0/1206354585 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4af800d4f0 con 0x7f4b080b66a0 2021-10-20T23:28:55.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/1206354585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b080b66a0 msgr2=0x7f4b080b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 --2- 172.21.15.12:0/1206354585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b080b66a0 0x7f4b080b1090 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4b00001d10 tx=0x7f4af8006df0).stop 2021-10-20T23:28:55.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/1206354585 shutdown_connections 2021-10-20T23:28:55.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 --2- 172.21.15.12:0/1206354585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b080b66a0 0x7f4b080b1090 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/1206354585 >> 172.21.15.12:0/1206354585 conn(0x7f4b0805d0a0 msgr2=0x7f4b080b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:55.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/1206354585 shutdown_connections 2021-10-20T23:28:55.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.344+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/1206354585 wait complete. 2021-10-20T23:28:55.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 Processor -- start 2021-10-20T23:28:55.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 -- start start 2021-10-20T23:28:55.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b080ad7a0 0x7f4b0811dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b080b1840 0x7f4b08151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b080b66a0 0x7f4b08151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b081511f0 con 0x7f4b080b66a0 2021-10-20T23:28:55.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0811e760 con 0x7f4b080b1840 2021-10-20T23:28:55.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0813ca50 con 0x7f4b080ad7a0 2021-10-20T23:28:55.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0ccfd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b080b66a0 0x7f4b08151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0ccfd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b080b66a0 0x7f4b08151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44818/0 (socket says 172.21.15.12:44818) 2021-10-20T23:28:55.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0ccfd700 1 -- 172.21.15.12:0/2367287167 learned_addr learned my addr 172.21.15.12:0/2367287167 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:55.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b07fff700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b080ad7a0 0x7f4b0811dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4afffff700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b080b1840 0x7f4b08151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0ccfd700 1 -- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b080ad7a0 msgr2=0x7f4b0811dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0ccfd700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b080ad7a0 0x7f4b0811dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0ccfd700 1 -- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b080b1840 msgr2=0x7f4b08151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0ccfd700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b080b1840 0x7f4b08151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0ccfd700 1 -- 172.21.15.12:0/2367287167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af800b180 con 0x7f4b080b66a0 2021-10-20T23:28:55.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0ccfd700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b080b66a0 0x7f4b08151fa0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f4b00001d50 tx=0x7f4b00001a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b05ffb700 1 -- 172.21.15.12:0/2367287167 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b00004ab0 con 0x7f4b080b66a0 2021-10-20T23:28:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b05ffb700 1 -- 172.21.15.12:0/2367287167 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b00004c10 con 0x7f4b080b66a0 2021-10-20T23:28:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0811e220 con 0x7f4b080b66a0 2021-10-20T23:28:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b05ffb700 1 -- 172.21.15.12:0/2367287167 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b00007170 con 0x7f4b080b66a0 2021-10-20T23:28:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b08150d50 con 0x7f4b080b66a0 2021-10-20T23:28:55.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.348+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b081517a0 con 0x7f4b080b66a0 2021-10-20T23:28:55.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.352+0000 7f4b05ffb700 1 -- 172.21.15.12:0/2367287167 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b000072d0 con 0x7f4b080b66a0 2021-10-20T23:28:55.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.352+0000 7f4b05ffb700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4aec053580 0x7f4aec055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.352+0000 7f4b05ffb700 1 -- 172.21.15.12:0/2367287167 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4b0006b5f0 con 0x7f4b080b66a0 2021-10-20T23:28:55.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.352+0000 7f4b07fff700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4aec053580 0x7f4aec055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.352+0000 7f4b07fff700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4aec053580 0x7f4aec055a40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f4af801a000 tx=0x7f4af8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.356+0000 7f4b05ffb700 1 -- 172.21.15.12:0/2367287167 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b00042550 con 0x7f4b080b66a0 2021-10-20T23:28:55.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.484+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b080b1580 con 0x7f4b080b66a0 2021-10-20T23:28:55.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.484+0000 7f4b05ffb700 1 -- 172.21.15.12:0/2367287167 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4b080b1580 con 0x7f4b080b66a0 2021-10-20T23:28:55.497 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:55.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4aec053580 msgr2=0x7f4aec055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4aec053580 0x7f4aec055a40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f4af801a000 tx=0x7f4af8014000).stop 2021-10-20T23:28:55.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b080b66a0 msgr2=0x7f4b08151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b080b66a0 0x7f4b08151fa0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f4b00001d50 tx=0x7f4b00001a80).stop 2021-10-20T23:28:55.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 shutdown_connections 2021-10-20T23:28:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f4aec053580 0x7f4aec055a40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b080b66a0 0x7f4b08151fa0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b080b1840 0x7f4b08151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 --2- 172.21.15.12:0/2367287167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b080ad7a0 0x7f4b0811dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 >> 172.21.15.12:0/2367287167 conn(0x7f4b0805d0a0 msgr2=0x7f4b0813f440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 shutdown_connections 2021-10-20T23:28:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.488+0000 7f4b0d4fe700 1 -- 172.21.15.12:0/2367287167 wait complete. 2021-10-20T23:28:55.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:28:55.621 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.608+0000 7f8a896ed700 1 Processor -- start 2021-10-20T23:28:55.622 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.608+0000 7f8a896ed700 1 -- start start 2021-10-20T23:28:55.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a84144f80 0x7f8a84141a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8a840a8ca0 0x7f8a8413e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a84145420 con 0x7f8a840b23c0 2021-10-20T23:28:55.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a84141f80 con 0x7f8a840a8ca0 2021-10-20T23:28:55.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a841410b0 con 0x7f8a84144f80 2021-10-20T23:28:55.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a837fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8a840a8ca0 0x7f8a8413e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a82ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8a840b23c0 0x7f8a840b0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:50482/0 (socket says 172.21.15.12:50482) 2021-10-20T23:28:55.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a82ffd700 1 -- 172.21.15.12:0/2113438282 learned_addr learned my addr 172.21.15.12:0/2113438282 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:55.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a827fc700 1 --2- 172.21.15.12:0/2113438282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a84144f80 0x7f8a84141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a81ffb700 1 -- 172.21.15.12:0/2113438282 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178413221 0 0) 0x7f8a84145420 con 0x7f8a840b23c0 2021-10-20T23:28:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a837fe700 1 -- 172.21.15.12:0/2113438282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a84144f80 msgr2=0x7f8a84141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a837fe700 1 --2- 172.21.15.12:0/2113438282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a84144f80 0x7f8a84141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a837fe700 1 -- 172.21.15.12:0/2113438282 >> v1:172.21.15.31:6789/0 conn(0x7f8a840b23c0 legacy=0x7f8a840b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a837fe700 1 -- 172.21.15.12:0/2113438282 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84141350 con 0x7f8a840a8ca0 2021-10-20T23:28:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a837fe700 1 --2- 172.21.15.12:0/2113438282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a840a8ca0 0x7f8a8413e410 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f8a74002f70 tx=0x7f8a74006df0).ready entity=mon.0 client_cookie=bfc943e1eded173e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a81ffb700 1 -- 172.21.15.12:0/2113438282 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a7400d570 con 0x7f8a840a8ca0 2021-10-20T23:28:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a81ffb700 1 -- 172.21.15.12:0/2113438282 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a74000e90 con 0x7f8a840a8ca0 2021-10-20T23:28:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a81ffb700 1 -- 172.21.15.12:0/2113438282 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a7400d8c0 con 0x7f8a840a8ca0 2021-10-20T23:28:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 -- 172.21.15.12:0/2113438282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a840a8ca0 msgr2=0x7f8a8413e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 --2- 172.21.15.12:0/2113438282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a840a8ca0 0x7f8a8413e410 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f8a74002f70 tx=0x7f8a74006df0).stop 2021-10-20T23:28:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 -- 172.21.15.12:0/2113438282 shutdown_connections 2021-10-20T23:28:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 --2- 172.21.15.12:0/2113438282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a840a8ca0 0x7f8a8413e410 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 --2- 172.21.15.12:0/2113438282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a84144f80 0x7f8a84141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 -- 172.21.15.12:0/2113438282 >> 172.21.15.12:0/2113438282 conn(0x7f8a8405ca20 msgr2=0x7f8a8405ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:55.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 -- 172.21.15.12:0/2113438282 shutdown_connections 2021-10-20T23:28:55.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.612+0000 7f8a896ed700 1 -- 172.21.15.12:0/2113438282 wait complete. 2021-10-20T23:28:55.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a896ed700 1 Processor -- start 2021-10-20T23:28:55.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a896ed700 1 -- start start 2021-10-20T23:28:55.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a896ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a840a8ca0 0x7f8a840b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a896ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a840b23c0 0x7f8a840b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a896ed700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a84144f80 0x7f8a8413d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a896ed700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840b3710 con 0x7f8a84144f80 2021-10-20T23:28:55.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a896ed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840a0340 con 0x7f8a840b23c0 2021-10-20T23:28:55.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a896ed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840b4cd0 con 0x7f8a840a8ca0 2021-10-20T23:28:55.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a84144f80 0x7f8a8413d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a84144f80 0x7f8a8413d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44834/0 (socket says 172.21.15.12:44834) 2021-10-20T23:28:55.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a837fe700 1 -- 172.21.15.12:0/974687587 learned_addr learned my addr 172.21.15.12:0/974687587 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:55.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a827fc700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a840b23c0 0x7f8a840b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a82ffd700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a840a8ca0 0x7f8a840b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a837fe700 1 -- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a840a8ca0 msgr2=0x7f8a840b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a837fe700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a840a8ca0 0x7f8a840b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a837fe700 1 -- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a840b23c0 msgr2=0x7f8a840b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a837fe700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a840b23c0 0x7f8a840b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a837fe700 1 -- 172.21.15.12:0/974687587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7400b180 con 0x7f8a84144f80 2021-10-20T23:28:55.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.616+0000 7f8a837fe700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a84144f80 0x7f8a8413d400 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f8a840b4e10 tx=0x7f8a74014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a73fff700 1 -- 172.21.15.12:0/974687587 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a74013ac0 con 0x7f8a84144f80 2021-10-20T23:28:55.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a73fff700 1 -- 172.21.15.12:0/974687587 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a74013c20 con 0x7f8a84144f80 2021-10-20T23:28:55.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a840b52f0 con 0x7f8a84144f80 2021-10-20T23:28:55.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a73fff700 1 -- 172.21.15.12:0/974687587 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a7401e400 con 0x7f8a84144f80 2021-10-20T23:28:55.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8409f370 con 0x7f8a84144f80 2021-10-20T23:28:55.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8409f1e0 con 0x7f8a84144f80 2021-10-20T23:28:55.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a73fff700 1 -- 172.21.15.12:0/974687587 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a74025030 con 0x7f8a84144f80 2021-10-20T23:28:55.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a73fff700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a600534f0 0x7f8a600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a73fff700 1 -- 172.21.15.12:0/974687587 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8a7406c960 con 0x7f8a84144f80 2021-10-20T23:28:55.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a82ffd700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a600534f0 0x7f8a600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.620+0000 7f8a82ffd700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a600534f0 0x7f8a600559b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f8a7c00d000 tx=0x7f8a7c007d80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.624+0000 7f8a73fff700 1 -- 172.21.15.12:0/974687587 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a740439a0 con 0x7f8a84144f80 2021-10-20T23:28:55.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.752+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a8409f530 con 0x7f8a84144f80 2021-10-20T23:28:55.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.752+0000 7f8a73fff700 1 -- 172.21.15.12:0/974687587 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8a740230a0 con 0x7f8a84144f80 2021-10-20T23:28:55.767 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:28:55.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a600534f0 msgr2=0x7f8a600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a600534f0 0x7f8a600559b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f8a7c00d000 tx=0x7f8a7c007d80).stop 2021-10-20T23:28:55.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a84144f80 msgr2=0x7f8a8413d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a84144f80 0x7f8a8413d400 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f8a840b4e10 tx=0x7f8a74014000).stop 2021-10-20T23:28:55.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 shutdown_connections 2021-10-20T23:28:55.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8a600534f0 0x7f8a600559b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a84144f80 0x7f8a8413d400 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a840b23c0 0x7f8a840b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 --2- 172.21.15.12:0/974687587 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a840a8ca0 0x7f8a840b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 >> 172.21.15.12:0/974687587 conn(0x7f8a8405ca20 msgr2=0x7f8a84066b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:55.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 shutdown_connections 2021-10-20T23:28:55.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.756+0000 7f8a896ed700 1 -- 172.21.15.12:0/974687587 wait complete. 2021-10-20T23:28:55.780 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:28:55.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:55.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a9672700 1 Processor -- start 2021-10-20T23:28:55.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a9672700 1 -- start start 2021-10-20T23:28:55.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a9672700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b2560 0x7f74a40a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a9672700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f74a40b1950 0x7f74a41475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a9672700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74a414b2e0 0x7f74a40ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a9672700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40a8cc0 con 0x7f74a414b2e0 2021-10-20T23:28:55.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a9672700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a414ac10 con 0x7f74a40b1950 2021-10-20T23:28:55.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a9672700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40b2940 con 0x7f74a40b2560 2021-10-20T23:28:55.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a27fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f74a40b1950 0x7f74a41475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74a414b2e0 0x7f74a40ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a27fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f74a40b1950 0x7f74a41475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:59812/0 (socket says 172.21.15.12:59812) 2021-10-20T23:28:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a27fc700 1 -- 172.21.15.12:0/4208601352 learned_addr learned my addr 172.21.15.12:0/4208601352 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a2ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b2560 0x7f74a40a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a27fc700 1 -- 172.21.15.12:0/4208601352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b2560 msgr2=0x7f74a40a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:55.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a27fc700 1 --2- 172.21.15.12:0/4208601352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b2560 0x7f74a40a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a27fc700 1 -- 172.21.15.12:0/4208601352 >> v2:172.21.15.12:3300/0 conn(0x7f74a414b2e0 msgr2=0x7f74a40ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:55.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a27fc700 1 --2- 172.21.15.12:0/4208601352 >> v2:172.21.15.12:3300/0 conn(0x7f74a414b2e0 0x7f74a40ab7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a27fc700 1 -- 172.21.15.12:0/4208601352 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40b0910 con 0x7f74a40b1950 2021-10-20T23:28:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a27fc700 1 --2- 172.21.15.12:0/4208601352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a40b1950 0x7f74a41475a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f7494002f70 tx=0x7f7494006eb0).ready entity=mon.1 client_cookie=d4a0bd15373c134f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a1ffb700 1 -- 172.21.15.12:0/4208601352 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f749400d570 con 0x7f74a40b1950 2021-10-20T23:28:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a1ffb700 1 -- 172.21.15.12:0/4208601352 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7494000e90 con 0x7f74a40b1950 2021-10-20T23:28:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.872+0000 7f74a1ffb700 1 -- 172.21.15.12:0/4208601352 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f749400d900 con 0x7f74a40b1950 2021-10-20T23:28:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 -- 172.21.15.12:0/4208601352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a40b1950 msgr2=0x7f74a41475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 --2- 172.21.15.12:0/4208601352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a40b1950 0x7f74a41475a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f7494002f70 tx=0x7f7494006eb0).stop 2021-10-20T23:28:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 -- 172.21.15.12:0/4208601352 shutdown_connections 2021-10-20T23:28:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 --2- 172.21.15.12:0/4208601352 >> v2:172.21.15.12:3300/0 conn(0x7f74a414b2e0 0x7f74a40ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 --2- 172.21.15.12:0/4208601352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a40b1950 0x7f74a41475a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 --2- 172.21.15.12:0/4208601352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b2560 0x7f74a40a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 -- 172.21.15.12:0/4208601352 >> 172.21.15.12:0/4208601352 conn(0x7f74a405ca20 msgr2=0x7f74a405ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 -- 172.21.15.12:0/4208601352 shutdown_connections 2021-10-20T23:28:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 -- 172.21.15.12:0/4208601352 wait complete. 2021-10-20T23:28:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 Processor -- start 2021-10-20T23:28:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.876+0000 7f74a9672700 1 -- start start 2021-10-20T23:28:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a9672700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b1950 0x7f74a40ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a9672700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a40b2560 0x7f74a40b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a9672700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a414b2e0 0x7f74a40ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a9672700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40af060 con 0x7f74a414b2e0 2021-10-20T23:28:55.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a9672700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40aadf0 con 0x7f74a40b2560 2021-10-20T23:28:55.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a9672700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40aa8b0 con 0x7f74a40b1950 2021-10-20T23:28:55.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a414b2e0 0x7f74a40ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a414b2e0 0x7f74a40ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44848/0 (socket says 172.21.15.12:44848) 2021-10-20T23:28:55.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a37fe700 1 -- 172.21.15.12:0/503225467 learned_addr learned my addr 172.21.15.12:0/503225467 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:55.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a2ffd700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b1950 0x7f74a40ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a27fc700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a40b2560 0x7f74a40b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a37fe700 1 -- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b1950 msgr2=0x7f74a40ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a37fe700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b1950 0x7f74a40ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a37fe700 1 -- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a40b2560 msgr2=0x7f74a40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:55.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a37fe700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a40b2560 0x7f74a40b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:55.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a37fe700 1 -- 172.21.15.12:0/503225467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749400b1e0 con 0x7f74a414b2e0 2021-10-20T23:28:55.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a37fe700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a414b2e0 0x7f74a40ae340 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f749c006e00 tx=0x7f749c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f7493fff700 1 -- 172.21.15.12:0/503225467 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f749c00c670 con 0x7f74a414b2e0 2021-10-20T23:28:55.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f7493fff700 1 -- 172.21.15.12:0/503225467 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c00c7d0 con 0x7f74a414b2e0 2021-10-20T23:28:55.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a40aab50 con 0x7f74a414b2e0 2021-10-20T23:28:55.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f7493fff700 1 -- 172.21.15.12:0/503225467 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f749c00cb30 con 0x7f74a414b2e0 2021-10-20T23:28:55.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40ab5a0 con 0x7f74a414b2e0 2021-10-20T23:28:55.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.880+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a414ae40 con 0x7f74a414b2e0 2021-10-20T23:28:55.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.884+0000 7f7493fff700 1 -- 172.21.15.12:0/503225467 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f749c00cc90 con 0x7f74a414b2e0 2021-10-20T23:28:55.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.884+0000 7f7493fff700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f74800535b0 0x7f7480055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:55.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.884+0000 7f7493fff700 1 -- 172.21.15.12:0/503225467 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f749c06bea0 con 0x7f74a414b2e0 2021-10-20T23:28:55.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.884+0000 7f74a2ffd700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f74800535b0 0x7f7480055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:55.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.884+0000 7f74a2ffd700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f74800535b0 0x7f7480055a70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f749800b000 tx=0x7f7498006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:55.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:55.888+0000 7f7493fff700 1 -- 172.21.15.12:0/503225467 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f749c042d10 con 0x7f74a414b2e0 2021-10-20T23:28:56.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74a4057350 con 0x7f74a414b2e0 2021-10-20T23:28:56.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f7493fff700 1 -- 172.21.15.12:0/503225467 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f749c046330 con 0x7f74a414b2e0 2021-10-20T23:28:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:56.064 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3304581862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3304581862},{"type":"v1","addr":"172.21.15.12:6835","nonce":3304581862}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/360437153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":360437153},{"type":"v1","addr":"172.21.15.12:6833","nonce":360437153}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:28:44.372426+0000","modified":"2021-10-20T23:28:45.375331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8025":{"gid":8025,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/546930471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":546930471},{"type":"v1","addr":"172.21.15.31:6835","nonce":546930471}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-20T23:28:56.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f74800535b0 msgr2=0x7f7480055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:56.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f74800535b0 0x7f7480055a70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f749800b000 tx=0x7f7498006df0).stop 2021-10-20T23:28:56.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a414b2e0 msgr2=0x7f74a40ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:56.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a414b2e0 0x7f74a40ae340 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f749c006e00 tx=0x7f749c0091d0).stop 2021-10-20T23:28:56.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 shutdown_connections 2021-10-20T23:28:56.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f74800535b0 0x7f7480055a70 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:56.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a414b2e0 0x7f74a40ae340 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:56.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a40b2560 0x7f74a40b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:56.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 --2- 172.21.15.12:0/503225467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a40b1950 0x7f74a40ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:56.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 >> 172.21.15.12:0/503225467 conn(0x7f74a405ca20 msgr2=0x7f74a414a130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:56.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 shutdown_connections 2021-10-20T23:28:56.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:56.052+0000 7f74a9672700 1 -- 172.21.15.12:0/503225467 wait complete. 2021-10-20T23:28:56.070 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 72 2021-10-20T23:28:56.380 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:28:44.372426+0000', 'modified': '2021-10-20T23:28:45.375331+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8025}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8025': {'gid': 8025, 'name': 'b', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/546930471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 546930471}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 546930471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:28:56.381 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:28:56.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-20T23:28:56.497 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8025,"want_state":"up:active","state":"up:active","rank_uptime":12.105025695,"mdsmap_epoch":72,"osdmap_epoch":142,"osdmap_epoch_barrier":141,"uptime":16.859669924999999} 2021-10-20T23:28:56.497 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8025, "mdsmap_epoch": 72, "osdmap_epoch": 142, "osdmap_epoch_barrier": 141, "rank_uptime": 12.105025695, "state": "up:active", "uptime": 16.859669925, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:28:56.498 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:28:56.499 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:28:56.499 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:28:56.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:56.500 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:56.509 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:28:56.527 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:56.529 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:56.586 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:56.587 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:56.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:56.589 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:28:56.595 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:28:56.595 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:56.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:28:56.614 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:28:56.614 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:28:56.674 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:28:56.675 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:28:56.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:56.676 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:28:56.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-10-20T23:28:56.668+0000 7feed80e9080 -1 init, newargv = 0x560a24593090 newargc=9ceph-fuse[ 2021-10-20T23:28:56.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:14476]: starting ceph client 2021-10-20T23:28:56.681 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14476]: starting fuse 2021-10-20T23:28:56.683 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:28:56.684 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:28:56.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:56.685 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:28:56.686 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:28:56.687 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:28:56.688 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:28:56.690 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:28:56.690 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:56.691 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:28:56.692 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:28:56.693 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:28:56.693 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:56.694 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:28:56.695 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:28:56.696 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:28:56.696 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:28:56.697 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:56.698 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:28:56.699 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:28:56.699 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:28:56.701 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:28:56.701 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:28:56.702 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:28:56.703 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:28:56.704 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:28:56.770 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.14476.asok 2021-10-20T23:28:56.775 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14476.asok 2021-10-20T23:28:56.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:56.776 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14476.asok status 2021-10-20T23:28:56.865 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:28:56.865 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:28:56.865 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:28:56.866 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:28:56.866 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:28:56.866 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:28:56.866 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:28:56.867 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "14476", 2021-10-20T23:28:56.867 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:28:56.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:56.867 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:28:56.867 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:28:56.868 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 8233, 2021-10-20T23:28:56.868 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:28:56.868 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:28:56.868 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:28:56.869 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 8233 2021-10-20T23:28:56.869 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:56.869 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:28:56.869 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:28:56.869 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:28:56.870 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 2481604777 2021-10-20T23:28:56.870 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:28:56.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:56.871 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:28:56.871 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:28:56.871 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:28:56.871 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 2481604777 2021-10-20T23:28:56.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:28:56.872 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.8233 172.21.15.136:0/2481604777", 2021-10-20T23:28:56.872 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/2481604777", 2021-10-20T23:28:56.872 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:28:56.872 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 72, 2021-10-20T23:28:56.873 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 142, 2021-10-20T23:28:56.873 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:28:56.873 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:28:56.873 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:28:56.873 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:28:56.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:56.875 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:56.876 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:56.884 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:28:56.885 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:56.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:56.886 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:56.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:56.949 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:56.950 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:56.961 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:28:56.962 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:28:56.962 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-20T23:28:56.963 DEBUG:teuthology.orchestra.run.smithi119:> import time 2021-10-20T23:28:56.963 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:28:56.963 DEBUG:teuthology.orchestra.run.smithi119:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-10-20T23:28:56.964 DEBUG:teuthology.orchestra.run.smithi119:> f.write('"'"'content'"'"') 2021-10-20T23:28:56.964 DEBUG:teuthology.orchestra.run.smithi119:> f.flush() 2021-10-20T23:28:56.965 DEBUG:teuthology.orchestra.run.smithi119:> f.write('"'"'content2'"'"') 2021-10-20T23:28:56.965 DEBUG:teuthology.orchestra.run.smithi119:> while True: 2021-10-20T23:28:56.965 DEBUG:teuthology.orchestra.run.smithi119:> time.sleep(1) 2021-10-20T23:28:56.966 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:28:57.007 DEBUG:teuthology.orchestra.run.smithi119:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-10-20T23:28:57.030 INFO:teuthology.orchestra.run.smithi119.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-10-20T23:28:57.033 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-10-20T23:28:58.035 DEBUG:teuthology.orchestra.run.smithi119:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-10-20T23:28:58.052 INFO:teuthology.orchestra.run.smithi119.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-10-20T23:28:58.053 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-10-20T23:28:58.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-10-20T23:28:58.100 INFO:teuthology.orchestra.run.smithi136.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-10-20T23:28:58.101 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-10-20T23:28:58.101 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-20T23:28:58.101 DEBUG:teuthology.orchestra.run.smithi136:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-10-20T23:28:58.196 INFO:teuthology.orchestra.run.smithi136.stdout:content 2021-10-20T23:28:58.213 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:28:58.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:58.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:58.257 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:58.280 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:28:58.300 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:28:58.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:58.301 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:58.301 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:58.310 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:28:58.311 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:28:58.311 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:28:58.312 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:28:58.313 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:58.368 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[14928]: fuse finished with error 0 and tester_r 0 2021-10-20T23:28:58.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:58.371 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:58.371 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:58.378 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:28:58.379 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:28:58.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:28:58.497 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:28:58.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:58.505 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:58.505 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:58.514 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:28:58.515 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:28:58.515 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:28:58.516 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:28:58.517 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:58.576 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14476]: fuse finished with error 0 and tester_r 0 2021-10-20T23:28:58.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:28:58.578 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:28:58.579 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:58.587 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:28:58.588 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:28:58.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:28:58.665 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:28:58.674 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:28:58.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.772+0000 7f928a820700 1 Processor -- start 2021-10-20T23:28:58.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.772+0000 7f928a820700 1 -- start start 2021-10-20T23:28:58.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f92840b2560 0x7f92840a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:58.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 0x7f92841475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:58.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928414ac10 con 0x7f928414b2e0 2021-10-20T23:28:58.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92840a8cc0 con 0x7f92840b2560 2021-10-20T23:28:58.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92840b2940 con 0x7f92840b1950 2021-10-20T23:28:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9288dbd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f928414b2e0 0x7f92840ab7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43450/0 (socket says 172.21.15.12:43450) 2021-10-20T23:28:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9288dbd700 1 -- 172.21.15.12:0/2808436101 learned_addr learned my addr 172.21.15.12:0/2808436101 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f92837fe700 1 --2- 172.21.15.12:0/2808436101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 0x7f92841475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9283fff700 1 --2- 172.21.15.12:0/2808436101 >> v2:172.21.15.31:3300/0 conn(0x7f92840b2560 0x7f92840a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9282ffd700 1 -- 172.21.15.12:0/2808436101 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873167134 0 0) 0x7f928414ac10 con 0x7f928414b2e0 2021-10-20T23:28:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9282ffd700 1 -- 172.21.15.12:0/2808436101 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9270003260 con 0x7f928414b2e0 2021-10-20T23:28:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f92837fe700 1 -- 172.21.15.12:0/2808436101 >> v2:172.21.15.31:3300/0 conn(0x7f92840b2560 msgr2=0x7f92840a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f92837fe700 1 --2- 172.21.15.12:0/2808436101 >> v2:172.21.15.31:3300/0 conn(0x7f92840b2560 0x7f92840a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f92837fe700 1 -- 172.21.15.12:0/2808436101 >> v1:172.21.15.12:6789/0 conn(0x7f928414b2e0 legacy=0x7f92840ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9282ffd700 1 -- 172.21.15.12:0/2808436101 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1099116111 0 0) 0x7f9270003260 con 0x7f928414b2e0 2021-10-20T23:28:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f92837fe700 1 -- 172.21.15.12:0/2808436101 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840b0910 con 0x7f92840b1950 2021-10-20T23:28:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9283fff700 1 --2- 172.21.15.12:0/2808436101 >> v2:172.21.15.31:3300/0 conn(0x7f92840b2560 0x7f92840a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f92837fe700 1 --2- 172.21.15.12:0/2808436101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 0x7f92841475a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f927c001b80 tx=0x7f9274006df0).ready entity=mon.2 client_cookie=f8146d69a9e8af3f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9282ffd700 1 -- 172.21.15.12:0/2808436101 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f927c0019e0 con 0x7f92840b1950 2021-10-20T23:28:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9282ffd700 1 -- 172.21.15.12:0/2808436101 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9274000e90 con 0x7f92840b1950 2021-10-20T23:28:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f9282ffd700 1 -- 172.21.15.12:0/2808436101 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9274012460 con 0x7f92840b1950 2021-10-20T23:28:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 -- 172.21.15.12:0/2808436101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 msgr2=0x7f92841475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 --2- 172.21.15.12:0/2808436101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 0x7f92841475a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f927c001b80 tx=0x7f9274006df0).stop 2021-10-20T23:28:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 -- 172.21.15.12:0/2808436101 shutdown_connections 2021-10-20T23:28:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 --2- 172.21.15.12:0/2808436101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 0x7f92841475a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 --2- 172.21.15.12:0/2808436101 >> v2:172.21.15.31:3300/0 conn(0x7f92840b2560 0x7f92840a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 -- 172.21.15.12:0/2808436101 >> 172.21.15.12:0/2808436101 conn(0x7f928405ca20 msgr2=0x7f928405ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 -- 172.21.15.12:0/2808436101 shutdown_connections 2021-10-20T23:28:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.776+0000 7f928a820700 1 -- 172.21.15.12:0/2808436101 wait complete. 2021-10-20T23:28:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 Processor -- start 2021-10-20T23:28:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 -- start start 2021-10-20T23:28:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 0x7f92840ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92840b2560 0x7f92840b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f928414b2e0 0x7f92840b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92840b5d20 con 0x7f92840b2560 2021-10-20T23:28:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928414e680 con 0x7f928414b2e0 2021-10-20T23:28:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928414d3a0 con 0x7f92840b1950 2021-10-20T23:28:58.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92840b2560 0x7f92840b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:58.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92840b2560 0x7f92840b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44860/0 (socket says 172.21.15.12:44860) 2021-10-20T23:28:58.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92837fe700 1 -- 172.21.15.12:0/1392877945 learned_addr learned my addr 172.21.15.12:0/1392877945 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:58.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f9288dbd700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f928414b2e0 0x7f92840b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:58.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f9283fff700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 0x7f92840ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:58.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92837fe700 1 -- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 msgr2=0x7f92840ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:58.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92837fe700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 0x7f92840ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:58.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92837fe700 1 -- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f928414b2e0 msgr2=0x7f92840b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:58.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92837fe700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f928414b2e0 0x7f92840b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:58.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92837fe700 1 -- 172.21.15.12:0/1392877945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927800b180 con 0x7f92840b2560 2021-10-20T23:28:58.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92837fe700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92840b2560 0x7f92840b5170 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f927c001b80 tx=0x7f9274014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:58.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92817fa700 1 -- 172.21.15.12:0/1392877945 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f927400d8a0 con 0x7f92840b2560 2021-10-20T23:28:58.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92817fa700 1 -- 172.21.15.12:0/1392877945 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927400da00 con 0x7f92840b2560 2021-10-20T23:28:58.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927400b180 con 0x7f92840b2560 2021-10-20T23:28:58.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f92817fa700 1 -- 172.21.15.12:0/1392877945 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f927400dd60 con 0x7f92840b2560 2021-10-20T23:28:58.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.780+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9284067950 con 0x7f92840b2560 2021-10-20T23:28:58.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.784+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928414d8f0 con 0x7f92840b2560 2021-10-20T23:28:58.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.784+0000 7f92817fa700 1 -- 172.21.15.12:0/1392877945 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9274025030 con 0x7f92840b2560 2021-10-20T23:28:58.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.784+0000 7f92817fa700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9264053610 0x7f9264055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:58.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.784+0000 7f92817fa700 1 -- 172.21.15.12:0/1392877945 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f927406c710 con 0x7f92840b2560 2021-10-20T23:28:58.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.784+0000 7f9283fff700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9264053610 0x7f9264055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:58.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.784+0000 7f9283fff700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9264053610 0x7f9264055ad0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f927800b000 tx=0x7f9278006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.788+0000 7f92817fa700 1 -- 172.21.15.12:0/1392877945 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9274043710 con 0x7f92840b2560 2021-10-20T23:28:58.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.920+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f928414ae40 con 0x7f92840b2560 2021-10-20T23:28:58.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f92817fa700 1 -- 172.21.15.12:0/1392877945 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v142) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f9274023090 con 0x7f92840b2560 2021-10-20T23:28:58.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:58.942 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:28:58.942 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 142, 2021-10-20T23:28:58.944 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:28:58.944 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:28:58.944 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:28:45.375943+0000", 2021-10-20T23:28:58.944 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:28:58.945 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:28:58.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:28:58.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:28:58.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:28:58.946 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:28:58.946 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:28:58.946 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:28:58.946 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:28:58.946 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:58.947 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:28:58.947 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:28:58.947 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:28:58.947 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:28:58.948 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:28:58.948 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 26, 2021-10-20T23:28:58.948 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:28:58.948 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:28:58.948 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:28:58.949 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:28:58.949 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:28:58.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:58.949 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:28:58.950 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:28:58.950 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:28:58.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:28:58.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:28:58.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:58.951 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:58.951 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:58.951 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:58.951 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:58.952 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:58.952 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:28:58.952 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:28:58.952 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:28:58.953 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:28:58.953 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:28:58.953 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:58.953 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:58.954 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:58.954 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:58.954 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:58.954 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:58.954 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:58.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.955 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:28:58.955 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:58.955 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:58.956 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:58.956 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:58.956 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:58.956 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:58.957 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:58.957 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:58.957 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:58.957 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:58.958 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:58.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:58.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:58.958 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:58.958 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:58.959 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:58.959 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:58.959 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:58.959 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:58.960 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:58.960 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:58.960 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:58.961 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:58.961 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:58.961 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:58.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:58.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.962 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:58.962 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:58.962 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:58.963 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:58.964 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:58.964 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:58.964 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:58.964 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:58.965 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:58.965 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:58.965 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:58.965 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:28:58.965 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:28:58.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.966 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:58.966 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:28:58.966 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:58.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:58.967 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:28:58.967 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:28:58.967 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:28:58.968 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:28:58.968 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:28:58.968 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:58.968 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:58.968 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:58.969 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:58.969 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:58.969 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:58.969 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:28:58.970 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:28:58.970 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:28:58.970 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:28:58.970 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:28:58.970 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:58.971 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:58.971 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:58.971 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:58.971 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:58.972 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:58.972 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:58.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.972 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:28:58.972 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:58.973 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:58.973 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:58.973 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:58.973 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:58.973 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:58.974 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:58.974 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:58.974 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:58.974 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:58.975 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:58.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:58.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:58.975 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:58.975 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:58.976 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:58.976 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:58.976 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:58.976 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:58.977 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:58.977 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:58.977 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:58.977 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:58.977 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:58.978 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:58.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:58.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.978 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:58.979 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:58.979 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:58.979 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:58.979 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:58.979 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:58.980 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:58.980 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:58.980 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:58.980 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:58.980 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:58.981 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:28:58.981 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:58.981 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:28:58.981 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:58.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:58.982 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 25, 2021-10-20T23:28:58.982 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:28:58.982 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:28:42.362682+0000", 2021-10-20T23:28:58.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:28:58.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:28:58.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:58.983 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:58.983 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:58.984 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:58.984 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:58.984 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:58.984 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:28:58.985 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:28:58.985 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:28:58.985 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:28:58.985 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:28:58.985 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:58.986 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:58.986 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:58.986 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:58.986 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:58.986 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:58.987 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:58.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.987 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "141", 2021-10-20T23:28:58.987 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:58.988 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:58.988 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:58.988 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:58.988 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:58.988 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:58.989 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:58.989 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:58.989 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:58.989 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:58.989 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:58.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:58.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:58.990 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:58.990 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:58.991 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:58.991 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:58.991 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:58.991 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:58.991 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:58.992 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:58.992 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:58.992 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:58.992 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:58.992 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:58.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:58.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.993 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:58.993 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:28:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:28:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:28:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:28:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:28:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:28:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 26, 2021-10-20T23:28:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:28:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:28:43.380308+0000", 2021-10-20T23:28:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:28:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:28:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:28:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:28:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:28:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:28:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:28:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:28:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:28:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:28:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:28:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:28:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:28:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:28:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:28:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:28:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:28:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:28:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:28:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:28:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "142", 2021-10-20T23:28:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:28:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:28:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:28:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:28:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:28:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:28:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:28:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:28:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:28:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:28:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:28:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:28:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:28:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:28:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:28:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:28:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:28:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:28:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:28:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:28:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:28:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:28:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:28:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:28:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:28:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:28:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:28:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:28:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:28:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:28:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:28:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:28:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:28:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:28:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:28:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:28:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:28:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:28:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:28:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:28:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:28:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:28:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:28:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:28:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 139, 2021-10-20T23:28:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:28:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:28:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:28:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:28:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:28:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:28:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:28:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:28:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:28:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:28:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:28:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:28:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:28:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:28:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:28:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:28:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:28:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:28:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:28:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:28:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:28:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:28:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:28:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:28:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:28:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:28:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:28:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:28:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:28:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:28:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:28:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:28:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:28:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:28:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:28:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:28:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:28:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:28:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:28:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:28:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:28:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:28:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:28:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:28:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:28:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:28:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:28:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 139, 2021-10-20T23:28:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:28:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:28:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:28:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:28:59.099 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:59.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.100 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.101 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:59.101 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.102 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:28:59.103 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:59.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.104 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:28:59.105 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:59.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.106 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.106 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:59.107 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.107 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.108 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:28:59.108 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:59.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.109 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:28:59.110 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:28:59.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.111 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.111 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:28:59.111 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:28:59.112 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:28:59.112 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:28:59.113 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:59.113 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:59.113 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:59.114 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.114 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:28:59.115 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:28:59.115 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:59.115 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:59.116 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:59.117 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:59.117 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:59.118 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:59.118 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:59.119 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:28:59.119 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:59.119 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:59.120 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:59.120 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.122 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:28:59.123 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:59.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.125 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:28:59.126 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:59.127 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.128 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.129 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:59.129 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.131 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:28:59.131 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:59.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.135 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:28:59.136 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:59.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.143 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.144 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:59.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.156 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:28:59.156 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:59.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.157 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:28:59.157 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:59.157 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.157 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.158 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:59.159 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.159 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:28:59.160 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:59.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.161 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:28:59.161 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:28:59.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.161 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.162 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:28:59.162 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:28:59.162 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:28:59.162 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:28:59.163 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:59.163 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:59.163 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:59.163 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.164 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:28:59.166 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:28:59.166 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:59.166 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:59.166 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:59.167 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:59.167 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:59.168 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:59.168 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:59.169 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:28:59.169 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:59.169 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:59.169 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:59.170 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.170 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:28:59.171 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:59.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.171 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:28:59.172 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:59.172 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.172 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.173 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:59.173 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.174 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:28:59.174 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:59.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.175 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:28:59.176 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:59.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.176 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.176 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:59.177 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.177 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:28:59.178 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:59.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.179 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:28:59.180 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:59.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.180 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.180 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:59.181 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.181 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:28:59.182 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:59.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.182 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:28:59.183 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:28:59.183 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.183 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.184 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:28:59.184 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:28:59.184 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:28:59.184 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:28:59.184 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:59.185 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:59.185 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:59.185 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.186 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:28:59.187 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:28:59.187 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:59.187 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:59.187 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:59.188 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:59.188 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:59.188 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:59.188 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:59.189 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:28:59.189 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:59.189 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:59.190 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:59.190 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.191 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:28:59.191 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:59.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.192 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:28:59.192 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:59.192 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.192 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.193 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:59.193 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.194 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.195 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:28:59.195 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:59.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.197 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:28:59.198 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:59.198 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.199 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.199 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:59.200 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.200 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.201 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:28:59.201 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:59.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.202 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:28:59.203 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:59.203 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.203 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.204 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:59.205 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.206 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:28:59.207 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:59.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.208 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:28:59.209 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:28:59.209 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.209 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.210 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:28:59.211 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:28:59.211 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:28:59.211 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:28:59.212 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:59.212 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:59.212 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:59.213 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.214 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:28:59.214 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:28:59.214 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:28:59.215 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:28:59.215 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:28:59.215 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:28:59.216 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:28:59.216 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:28:59.216 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:28:59.217 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:28:59.218 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:28:59.218 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:28:59.218 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:28:59.219 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.219 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:28:59.219 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:59.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.220 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:28:59.221 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:59.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.221 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.221 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:28:59.222 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.222 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:28:59.223 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:59.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.223 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:28:59.224 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:59.224 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.224 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.225 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:28:59.225 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.225 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:28:59.226 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:59.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.227 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:28:59.227 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:59.227 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.227 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.228 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:28:59.228 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:28:59.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:28:59.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:28:59.229 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:59.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:28:59.230 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:28:59.230 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:28:59.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.231 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.231 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:28:59.231 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:28:59.232 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:28:59.232 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:28:59.232 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:28:59.232 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:28:59.233 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:28:59.233 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:28:59.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.233 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:59.233 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:28:59.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.234 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:28:59.234 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:59.234 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:59.234 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:28:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:28:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:59.237 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:59.237 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:59.237 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:59.237 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:28:59.238 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:59.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.239 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:28:59.239 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:59.239 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:59.239 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:59.240 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:59.240 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:59.240 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:28:59.240 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:59.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.241 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:28:59.241 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:59.241 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:59.242 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:59.242 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:59.242 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:59.242 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:28:59.242 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:59.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.243 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:28:59.243 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:59.243 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:59.244 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:59.244 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:59.244 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:59.244 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:28:59.245 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:59.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.245 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:28:59.245 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:59.246 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:59.246 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:59.246 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:59.246 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:59.246 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:28:59.247 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:59.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.247 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:28:59.248 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:59.248 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:59.248 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:59.248 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:59.248 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:59.249 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:28:59.249 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:59.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:28:59.250 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:28:59.250 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:28:59.250 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:28:59.251 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:28:59.251 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:28:59.251 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:28:59.252 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:28:59.252 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:28:59.252 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.252 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:28:59.252 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:28:59.253 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:28:59.253 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:28:59.253 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:28:59.253 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:28:59.254 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:28:59.254 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:28:59.254 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:28:59.254 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:28:59.254 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:28:59.255 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:28:59.255 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:28:59.255 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:28:59.255 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:28:59.255 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:28:59.256 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:28:59.256 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:28:59.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.256 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:28:59.257 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:28:59.257 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:28:59.257 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:28:59.257 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:28:59.257 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:28:59.258 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:28:59.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:28:59.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:28:59.258 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:28:59.258 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:28:59.259 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:28:59.259 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:28:59.259 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:28:59.259 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:28:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9264053610 msgr2=0x7f9264055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9264053610 0x7f9264055ad0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f927800b000 tx=0x7f9278006df0).stop 2021-10-20T23:28:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92840b2560 msgr2=0x7f92840b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92840b2560 0x7f92840b5170 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f927c001b80 tx=0x7f9274014000).stop 2021-10-20T23:28:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 shutdown_connections 2021-10-20T23:28:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9264053610 0x7f9264055ad0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f928414b2e0 0x7f92840b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92840b2560 0x7f92840b5170 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 --2- 172.21.15.12:0/1392877945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92840b1950 0x7f92840ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 >> 172.21.15.12:0/1392877945 conn(0x7f928405ca20 msgr2=0x7f928414a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:59.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 shutdown_connections 2021-10-20T23:28:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:58.924+0000 7f928a820700 1 -- 172.21.15.12:0/1392877945 wait complete. 2021-10-20T23:28:59.264 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:28:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9f90e700 1 Processor -- start 2021-10-20T23:28:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9f90e700 1 -- start start 2021-10-20T23:28:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9f90e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdf980b2560 0x7fdf980a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9f90e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf981475a0 0x7fdf980ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9f90e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9814ac10 con 0x7fdf980b1950 2021-10-20T23:28:59.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9f90e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980a8cc0 con 0x7fdf980b2560 2021-10-20T23:28:59.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9f90e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98147a10 con 0x7fdf981475a0 2021-10-20T23:28:59.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9cea9700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdf980b1950 0x7fdf9814b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43462/0 (socket says 172.21.15.12:43462) 2021-10-20T23:28:59.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9cea9700 1 -- 172.21.15.12:0/1076545168 learned_addr learned my addr 172.21.15.12:0/1076545168 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:28:59.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9d6aa700 1 --2- 172.21.15.12:0/1076545168 >> v2:172.21.15.31:3300/0 conn(0x7fdf980b2560 0x7fdf980a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9deab700 1 --2- 172.21.15.12:0/1076545168 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf981475a0 0x7fdf980ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf8ffff700 1 -- 172.21.15.12:0/1076545168 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177005196 0 0) 0x7fdf9814ac10 con 0x7fdf980b1950 2021-10-20T23:28:59.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf8ffff700 1 -- 172.21.15.12:0/1076545168 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf84003260 con 0x7fdf980b1950 2021-10-20T23:28:59.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9d6aa700 1 -- 172.21.15.12:0/1076545168 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf981475a0 msgr2=0x7fdf980ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:59.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9d6aa700 1 --2- 172.21.15.12:0/1076545168 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf981475a0 0x7fdf980ab7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9d6aa700 1 -- 172.21.15.12:0/1076545168 >> v1:172.21.15.12:6789/0 conn(0x7fdf980b1950 legacy=0x7fdf9814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9d6aa700 1 -- 172.21.15.12:0/1076545168 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980b2940 con 0x7fdf980b2560 2021-10-20T23:28:59.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf9d6aa700 1 --2- 172.21.15.12:0/1076545168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf980b2560 0x7fdf980a7d00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fdf94002f70 tx=0x7fdf94006df0).ready entity=mon.1 client_cookie=3887cebdd60e3d9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:59.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf8ffff700 1 -- 172.21.15.12:0/1076545168 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf9400d4a0 con 0x7fdf980b2560 2021-10-20T23:28:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf8ffff700 1 -- 172.21.15.12:0/1076545168 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf94000e90 con 0x7fdf980b2560 2021-10-20T23:28:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.368+0000 7fdf8ffff700 1 -- 172.21.15.12:0/1076545168 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf9400d7f0 con 0x7fdf980b2560 2021-10-20T23:28:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 -- 172.21.15.12:0/1076545168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf980b2560 msgr2=0x7fdf980a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 --2- 172.21.15.12:0/1076545168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf980b2560 0x7fdf980a7d00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fdf94002f70 tx=0x7fdf94006df0).stop 2021-10-20T23:28:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 -- 172.21.15.12:0/1076545168 shutdown_connections 2021-10-20T23:28:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 --2- 172.21.15.12:0/1076545168 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf981475a0 0x7fdf980ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 --2- 172.21.15.12:0/1076545168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf980b2560 0x7fdf980a7d00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 -- 172.21.15.12:0/1076545168 >> 172.21.15.12:0/1076545168 conn(0x7fdf9805ca20 msgr2=0x7fdf9805ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:59.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 -- 172.21.15.12:0/1076545168 shutdown_connections 2021-10-20T23:28:59.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 -- 172.21.15.12:0/1076545168 wait complete. 2021-10-20T23:28:59.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 Processor -- start 2021-10-20T23:28:59.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 -- start start 2021-10-20T23:28:59.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf980b1950 0x7fdf980b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf980b2560 0x7fdf980add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf981475a0 0x7fdf98156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980b52f0 con 0x7fdf981475a0 2021-10-20T23:28:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980b5590 con 0x7fdf980b1950 2021-10-20T23:28:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9f90e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98156820 con 0x7fdf980b2560 2021-10-20T23:28:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9deab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf981475a0 0x7fdf98156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9d6aa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf980b1950 0x7fdf980b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9deab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf981475a0 0x7fdf98156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44876/0 (socket says 172.21.15.12:44876) 2021-10-20T23:28:59.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9deab700 1 -- 172.21.15.12:0/3653464522 learned_addr learned my addr 172.21.15.12:0/3653464522 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:59.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9cea9700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf980b2560 0x7fdf980add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9deab700 1 -- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf980b2560 msgr2=0x7fdf980add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9deab700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf980b2560 0x7fdf980add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9deab700 1 -- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf980b1950 msgr2=0x7fdf980b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9deab700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf980b1950 0x7fdf980b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9deab700 1 -- 172.21.15.12:0/3653464522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9400b180 con 0x7fdf981475a0 2021-10-20T23:28:59.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.372+0000 7fdf9deab700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf981475a0 0x7fdf98156cc0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fdf8800c000 tx=0x7fdf88006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf8e7fc700 1 -- 172.21.15.12:0/3653464522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf88011750 con 0x7fdf981475a0 2021-10-20T23:28:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf980aceb0 con 0x7fdf981475a0 2021-10-20T23:28:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf980ae650 con 0x7fdf981475a0 2021-10-20T23:28:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf8e7fc700 1 -- 172.21.15.12:0/3653464522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf880118b0 con 0x7fdf981475a0 2021-10-20T23:28:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf8e7fc700 1 -- 172.21.15.12:0/3653464522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf88011c10 con 0x7fdf981475a0 2021-10-20T23:28:59.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf74003410 con 0x7fdf981475a0 2021-10-20T23:28:59.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf8e7fc700 1 -- 172.21.15.12:0/3653464522 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdf88011d70 con 0x7fdf981475a0 2021-10-20T23:28:59.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf8e7fc700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdf78053580 0x7fdf78055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf8e7fc700 1 -- 172.21.15.12:0/3653464522 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdf8806be70 con 0x7fdf981475a0 2021-10-20T23:28:59.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf9d6aa700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdf78053580 0x7fdf78055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.376+0000 7fdf9d6aa700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdf78053580 0x7fdf78055a40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fdf9401a000 tx=0x7fdf94014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:59.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.384+0000 7fdf8e7fc700 1 -- 172.21.15.12:0/3653464522 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdf88042d70 con 0x7fdf981475a0 2021-10-20T23:28:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.548+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf74003c40 con 0x7fdf981475a0 2021-10-20T23:28:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf8e7fc700 1 -- 172.21.15.12:0/3653464522 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2489 (secure 0 0 0) 0x7fdf88046390 con 0x7fdf981475a0 2021-10-20T23:28:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:28:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3304581862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3304581862},{"type":"v1","addr":"172.21.15.12:6835","nonce":3304581862}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/360437153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":360437153},{"type":"v1","addr":"172.21.15.12:6833","nonce":360437153}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:28:44.372426+0000","modified":"2021-10-20T23:28:45.375331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8025":{"gid":8025,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/546930471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":546930471},{"type":"v1","addr":"172.21.15.31:6835","nonce":546930471}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-20T23:28:59.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdf78053580 msgr2=0x7fdf78055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdf78053580 0x7fdf78055a40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fdf9401a000 tx=0x7fdf94014000).stop 2021-10-20T23:28:59.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf981475a0 msgr2=0x7fdf98156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf981475a0 0x7fdf98156cc0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fdf8800c000 tx=0x7fdf88006df0).stop 2021-10-20T23:28:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 shutdown_connections 2021-10-20T23:28:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdf78053580 0x7fdf78055a40 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf981475a0 0x7fdf98156cc0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf980b2560 0x7fdf980add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 --2- 172.21.15.12:0/3653464522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf980b1950 0x7fdf980b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 >> 172.21.15.12:0/3653464522 conn(0x7fdf9805ca20 msgr2=0x7fdf98148980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 shutdown_connections 2021-10-20T23:28:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.552+0000 7fdf9f90e700 1 -- 172.21.15.12:0/3653464522 wait complete. 2021-10-20T23:28:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 72 2021-10-20T23:28:59.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:28:59.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.668+0000 7f47cbc05700 1 Processor -- start 2021-10-20T23:28:59.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.668+0000 7f47cbc05700 1 -- start start 2021-10-20T23:28:59.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f47c40b0fc0 0x7f47c41434c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 0x7f47c41439b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c40ada60 con 0x7f47c405f9f0 2021-10-20T23:28:59.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c40b3f70 con 0x7f47c40b0fc0 2021-10-20T23:28:59.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c405fdd0 con 0x7f47c40b0750 2021-10-20T23:28:59.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c91a0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f47c40b0fc0 0x7f47c41434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c91a0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f47c40b0fc0 0x7f47c41434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44882/0 (socket says 172.21.15.12:44882) 2021-10-20T23:28:59.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c91a0700 1 -- 172.21.15.12:0/1326790962 learned_addr learned my addr 172.21.15.12:0/1326790962 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:59.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47ca1a2700 1 --2- 172.21.15.12:0/1326790962 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 0x7f47c41439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c91a0700 1 -- 172.21.15.12:0/1326790962 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 msgr2=0x7f47c41439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:28:59.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c91a0700 1 --2- 172.21.15.12:0/1326790962 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 0x7f47c41439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c91a0700 1 -- 172.21.15.12:0/1326790962 >> v1:172.21.15.31:6789/0 conn(0x7f47c405f9f0 legacy=0x7f47c40b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c91a0700 1 -- 172.21.15.12:0/1326790962 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c40a9dc0 con 0x7f47c40b0fc0 2021-10-20T23:28:59.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c91a0700 1 --2- 172.21.15.12:0/1326790962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 0x7f47c41434c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f47b8002f70 tx=0x7f47b8006eb0).ready entity=mon.0 client_cookie=eac85756e29e871d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c899f700 1 -- 172.21.15.12:0/1326790962 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47b800d570 con 0x7f47c40b0fc0 2021-10-20T23:28:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c899f700 1 -- 172.21.15.12:0/1326790962 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b8000e90 con 0x7f47c40b0fc0 2021-10-20T23:28:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47c899f700 1 -- 172.21.15.12:0/1326790962 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47b800d900 con 0x7f47c40b0fc0 2021-10-20T23:28:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 -- 172.21.15.12:0/1326790962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 msgr2=0x7f47c41434c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 --2- 172.21.15.12:0/1326790962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 0x7f47c41434c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f47b8002f70 tx=0x7f47b8006eb0).stop 2021-10-20T23:28:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 -- 172.21.15.12:0/1326790962 shutdown_connections 2021-10-20T23:28:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 --2- 172.21.15.12:0/1326790962 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 0x7f47c41439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 --2- 172.21.15.12:0/1326790962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 0x7f47c41434c0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 -- 172.21.15.12:0/1326790962 >> 172.21.15.12:0/1326790962 conn(0x7f47c40607c0 msgr2=0x7f47c4060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:28:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 -- 172.21.15.12:0/1326790962 shutdown_connections 2021-10-20T23:28:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.672+0000 7f47cbc05700 1 -- 172.21.15.12:0/1326790962 wait complete. 2021-10-20T23:28:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 Processor -- start 2021-10-20T23:28:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 -- start start 2021-10-20T23:28:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c405f9f0 0x7f47c40a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 0x7f47c41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 0x7f47c40ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40a0510 con 0x7f47c40b0fc0 2021-10-20T23:28:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40abd30 con 0x7f47c405f9f0 2021-10-20T23:28:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40abf80 con 0x7f47c40b0750 2021-10-20T23:28:59.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47ca1a2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 0x7f47c40ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47ca1a2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 0x7f47c40ab840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44890/0 (socket says 172.21.15.12:44890) 2021-10-20T23:28:59.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47ca1a2700 1 -- 172.21.15.12:0/1228065946 learned_addr learned my addr 172.21.15.12:0/1228065946 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:28:59.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47c91a0700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 0x7f47c41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47c99a1700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c405f9f0 0x7f47c40a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47ca1a2700 1 -- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 msgr2=0x7f47c41464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47ca1a2700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 0x7f47c41464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47ca1a2700 1 -- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c405f9f0 msgr2=0x7f47c40a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:28:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47ca1a2700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c405f9f0 0x7f47c40a96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:28:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47ca1a2700 1 -- 172.21.15.12:0/1228065946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b800b1e0 con 0x7f47c40b0fc0 2021-10-20T23:28:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47c91a0700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 0x7f47c41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:28:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47ca1a2700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 0x7f47c40ab840 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f47bc00c000 tx=0x7f47bc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47b6ffd700 1 -- 172.21.15.12:0/1228065946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47bc012600 con 0x7f47c40b0fc0 2021-10-20T23:28:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c40a0740 con 0x7f47c40b0fc0 2021-10-20T23:28:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c4152780 con 0x7f47c40b0fc0 2021-10-20T23:28:59.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47b6ffd700 1 -- 172.21.15.12:0/1228065946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc012760 con 0x7f47c40b0fc0 2021-10-20T23:28:59.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.676+0000 7f47b6ffd700 1 -- 172.21.15.12:0/1228065946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47bc012ac0 con 0x7f47c40b0fc0 2021-10-20T23:28:59.701 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.680+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c4057350 con 0x7f47c40b0fc0 2021-10-20T23:28:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.680+0000 7f47b6ffd700 1 -- 172.21.15.12:0/1228065946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f47bc012c20 con 0x7f47c40b0fc0 2021-10-20T23:28:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.680+0000 7f47b6ffd700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47a4053610 0x7f47a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:28:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.680+0000 7f47b6ffd700 1 -- 172.21.15.12:0/1228065946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f47bc06bd90 con 0x7f47c40b0fc0 2021-10-20T23:28:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.680+0000 7f47c99a1700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47a4053610 0x7f47a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:28:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.684+0000 7f47c99a1700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47a4053610 0x7f47a4055ad0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f47c000d000 tx=0x7f47c0000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:28:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.688+0000 7f47b6ffd700 1 -- 172.21.15.12:0/1228065946 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f47bc042cf0 con 0x7f47c40b0fc0 2021-10-20T23:28:59.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:28:59.856+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f47c40605a0 con 0x7f47c40b0fc0 2021-10-20T23:29:00.231 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:29:00.224+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:29:00.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.228+0000 7f47b6ffd700 1 -- 172.21.15.12:0/1228065946 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7f47bc046310 con 0x7f47c40b0fc0 2021-10-20T23:29:00.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47a4053610 msgr2=0x7f47a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47a4053610 0x7f47a4055ad0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f47c000d000 tx=0x7f47c0000bc0).stop 2021-10-20T23:29:00.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 msgr2=0x7f47c40ab840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 0x7f47c40ab840 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f47bc00c000 tx=0x7f47bc0091d0).stop 2021-10-20T23:29:00.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 shutdown_connections 2021-10-20T23:29:00.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f47a4053610 0x7f47a4055ad0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47c40b0fc0 0x7f47c40ab840 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47c40b0750 0x7f47c41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 --2- 172.21.15.12:0/1228065946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c405f9f0 0x7f47c40a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 >> 172.21.15.12:0/1228065946 conn(0x7f47c40607c0 msgr2=0x7f47c413f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:00.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 shutdown_connections 2021-10-20T23:29:00.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.232+0000 7f47cbc05700 1 -- 172.21.15.12:0/1228065946 wait complete. 2021-10-20T23:29:00.246 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:29:00.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:00.273 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:29:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.348+0000 7fead2669700 1 Processor -- start 2021-10-20T23:29:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.348+0000 7fead2669700 1 -- start start 2021-10-20T23:29:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feacc0b2110 0x7feacc143870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feacc0b6130 con 0x7feacc05c450 2021-10-20T23:29:00.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feacc0b24f0 con 0x7feacc0b5c30 2021-10-20T23:29:00.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feacc0b2870 con 0x7feacc0b2110 2021-10-20T23:29:00.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead1e68700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feacc05c450 0x7feacc12bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43492/0 (socket says 172.21.15.12:43492) 2021-10-20T23:29:00.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead1e68700 1 -- 172.21.15.12:0/4142138983 learned_addr learned my addr 172.21.15.12:0/4142138983 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:00.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead1667700 1 --2- 172.21.15.12:0/4142138983 >> v2:172.21.15.31:3300/0 conn(0x7feacc0b2110 0x7feacc143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7feacbfff700 1 -- 172.21.15.12:0/4142138983 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732509443 0 0) 0x7feacc0b6130 con 0x7feacc05c450 2021-10-20T23:29:00.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7feacbfff700 1 -- 172.21.15.12:0/4142138983 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab8003260 con 0x7feacc05c450 2021-10-20T23:29:00.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7feacbfff700 1 -- 172.21.15.12:0/4142138983 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788553967 0 0) 0x7feacc0b24f0 con 0x7feacc0b5c30 2021-10-20T23:29:00.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7feacbfff700 1 -- 172.21.15.12:0/4142138983 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feacc0b6130 con 0x7feacc0b5c30 2021-10-20T23:29:00.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7feacbfff700 1 -- 172.21.15.12:0/4142138983 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2965919867 0 0) 0x7feab8003260 con 0x7feacc05c450 2021-10-20T23:29:00.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead1667700 1 -- 172.21.15.12:0/4142138983 >> v1:172.21.15.31:6789/0 conn(0x7feacc0b5c30 legacy=0x7feacc05bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead1667700 1 -- 172.21.15.12:0/4142138983 >> v1:172.21.15.12:6789/0 conn(0x7feacc05c450 legacy=0x7feacc12bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead1667700 1 -- 172.21.15.12:0/4142138983 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc0b6380 con 0x7feacc0b2110 2021-10-20T23:29:00.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead1667700 1 --2- 172.21.15.12:0/4142138983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feacc0b2110 0x7feacc143870 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7feac4001110 tx=0x7feabc006df0).ready entity=mon.1 client_cookie=cb238ca6e9437e22 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:00.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7feacbfff700 1 -- 172.21.15.12:0/4142138983 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac4001660 con 0x7feacc0b2110 2021-10-20T23:29:00.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7feacbfff700 1 -- 172.21.15.12:0/4142138983 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc000e90 con 0x7feacc0b2110 2021-10-20T23:29:00.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7feacbfff700 1 -- 172.21.15.12:0/4142138983 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feabc012460 con 0x7feacc0b2110 2021-10-20T23:29:00.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 -- 172.21.15.12:0/4142138983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feacc0b2110 msgr2=0x7feacc143870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 --2- 172.21.15.12:0/4142138983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feacc0b2110 0x7feacc143870 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7feac4001110 tx=0x7feabc006df0).stop 2021-10-20T23:29:00.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 -- 172.21.15.12:0/4142138983 shutdown_connections 2021-10-20T23:29:00.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 --2- 172.21.15.12:0/4142138983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feacc0b2110 0x7feacc143870 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 -- 172.21.15.12:0/4142138983 >> 172.21.15.12:0/4142138983 conn(0x7feacc0614b0 msgr2=0x7feacc0618c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:00.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 -- 172.21.15.12:0/4142138983 shutdown_connections 2021-10-20T23:29:00.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.352+0000 7fead2669700 1 -- 172.21.15.12:0/4142138983 wait complete. 2021-10-20T23:29:00.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead2669700 1 Processor -- start 2021-10-20T23:29:00.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead2669700 1 -- start start 2021-10-20T23:29:00.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead2669700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feacc05c450 0x7feacc0ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead2669700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feacc0b2110 0x7feacc149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead2669700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feacc0b5c30 0x7feacc152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead2669700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0ad840 con 0x7feacc0b2110 2021-10-20T23:29:00.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead2669700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0adae0 con 0x7feacc0b5c30 2021-10-20T23:29:00.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead2669700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feacc1520c0 con 0x7feacc05c450 2021-10-20T23:29:00.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead0e66700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feacc0b2110 0x7feacc149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead0e66700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feacc0b2110 0x7feacc149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44902/0 (socket says 172.21.15.12:44902) 2021-10-20T23:29:00.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead0e66700 1 -- 172.21.15.12:0/3252715567 learned_addr learned my addr 172.21.15.12:0/3252715567 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:00.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead1667700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feacc05c450 0x7feacc0ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead1e68700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feacc0b5c30 0x7feacc152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead0e66700 1 -- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feacc05c450 msgr2=0x7feacc0ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead0e66700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feacc05c450 0x7feacc0ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead0e66700 1 -- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feacc0b5c30 msgr2=0x7feacc152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead0e66700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feacc0b5c30 0x7feacc152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead0e66700 1 -- 172.21.15.12:0/3252715567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc00b180 con 0x7feacc0b2110 2021-10-20T23:29:00.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.356+0000 7fead0e66700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feacc0b2110 0x7feacc149cc0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7feac0001490 tx=0x7feac0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:00.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7feaca7fc700 1 -- 172.21.15.12:0/3252715567 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac0002310 con 0x7feacc0b2110 2021-10-20T23:29:00.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7feaca7fc700 1 -- 172.21.15.12:0/3252715567 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac0002470 con 0x7feacc0b2110 2021-10-20T23:29:00.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7feaca7fc700 1 -- 172.21.15.12:0/3252715567 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac0001840 con 0x7feacc0b2110 2021-10-20T23:29:00.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feacc152360 con 0x7feacc0b2110 2021-10-20T23:29:00.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc0ad450 con 0x7feacc0b2110 2021-10-20T23:29:00.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feacc1524f0 con 0x7feacc0b2110 2021-10-20T23:29:00.381 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7feaca7fc700 1 -- 172.21.15.12:0/3252715567 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feac0010030 con 0x7feacc0b2110 2021-10-20T23:29:00.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7feaca7fc700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaac0536a0 0x7feaac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7feaca7fc700 1 -- 172.21.15.12:0/3252715567 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6506+0+0 (secure 0 0 0) 0x7feac006b970 con 0x7feacc0b2110 2021-10-20T23:29:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7fead1667700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaac0536a0 0x7feaac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.360+0000 7fead1667700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaac0536a0 0x7feaac055b60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7feabc01a000 tx=0x7feabc014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.368+0000 7feaca7fc700 1 -- 172.21.15.12:0/3252715567 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feac0042880 con 0x7feacc0b2110 2021-10-20T23:29:00.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.532+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feacc0b6620 con 0x7feacc0b2110 2021-10-20T23:29:00.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.532+0000 7feaca7fc700 1 -- 172.21.15.12:0/3252715567 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+2132 (secure 0 0 0) 0x7feac0045ea0 con 0x7feacc0b2110 2021-10-20T23:29:00.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:00.547 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":73,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3304581862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3304581862},{"type":"v1","addr":"172.21.15.12:6835","nonce":3304581862}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/360437153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":360437153},{"type":"v1","addr":"172.21.15.12:6833","nonce":360437153}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":73,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:28:44.372426+0000","modified":"2021-10-20T23:29:00.224709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":143,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-20T23:29:00.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaac0536a0 msgr2=0x7feaac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaac0536a0 0x7feaac055b60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7feabc01a000 tx=0x7feabc014000).stop 2021-10-20T23:29:00.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feacc0b2110 msgr2=0x7feacc149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feacc0b2110 0x7feacc149cc0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7feac0001490 tx=0x7feac0007e60).stop 2021-10-20T23:29:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 shutdown_connections 2021-10-20T23:29:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7feaac0536a0 0x7feaac055b60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feacc0b5c30 0x7feacc152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feacc0b2110 0x7feacc149cc0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 --2- 172.21.15.12:0/3252715567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feacc05c450 0x7feacc0ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 >> 172.21.15.12:0/3252715567 conn(0x7feacc0614b0 msgr2=0x7feacc144df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:00.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 shutdown_connections 2021-10-20T23:29:00.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.536+0000 7fead2669700 1 -- 172.21.15.12:0/3252715567 wait complete. 2021-10-20T23:29:00.555 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 73 2021-10-20T23:29:00.563 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:29:00.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.660+0000 7f686ded8700 1 Processor -- start 2021-10-20T23:29:00.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.660+0000 7f686ded8700 1 -- start start 2021-10-20T23:29:00.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.660+0000 7f686ded8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68680b9910 0x7f68680b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68680b7160 0x7f68680b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68681468e0 con 0x7f68680b4370 2021-10-20T23:29:00.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68680b4c30 con 0x7f68680b9910 2021-10-20T23:29:00.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68680b4990 con 0x7f68680b7160 2021-10-20T23:29:00.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f6866ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f68680b4370 0x7f6868146fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43502/0 (socket says 172.21.15.12:43502) 2021-10-20T23:29:00.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f6866ffd700 1 -- 172.21.15.12:0/333357846 learned_addr learned my addr 172.21.15.12:0/333357846 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:00.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68677fe700 1 --2- 172.21.15.12:0/333357846 >> v2:172.21.15.12:3300/0 conn(0x7f68680b9910 0x7f68680b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f6867fff700 1 --2- 172.21.15.12:0/333357846 >> v2:172.21.15.31:3300/0 conn(0x7f68680b7160 0x7f68680b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68667fc700 1 -- 172.21.15.12:0/333357846 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533633084 0 0) 0x7f68681468e0 con 0x7f68680b4370 2021-10-20T23:29:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68677fe700 1 -- 172.21.15.12:0/333357846 >> v2:172.21.15.31:3300/0 conn(0x7f68680b7160 msgr2=0x7f68680b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68677fe700 1 --2- 172.21.15.12:0/333357846 >> v2:172.21.15.31:3300/0 conn(0x7f68680b7160 0x7f68680b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68677fe700 1 -- 172.21.15.12:0/333357846 >> v1:172.21.15.12:6789/0 conn(0x7f68680b4370 legacy=0x7f6868146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68677fe700 1 -- 172.21.15.12:0/333357846 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868146b40 con 0x7f68680b9910 2021-10-20T23:29:00.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68677fe700 1 --2- 172.21.15.12:0/333357846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 0x7f68680b9cf0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f6858002f70 tx=0x7f6858006df0).ready entity=mon.0 client_cookie=d0ad7e9099ededcf server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:00.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68667fc700 1 -- 172.21.15.12:0/333357846 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f685800d570 con 0x7f68680b9910 2021-10-20T23:29:00.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68667fc700 1 -- 172.21.15.12:0/333357846 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858000e90 con 0x7f68680b9910 2021-10-20T23:29:00.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f68667fc700 1 -- 172.21.15.12:0/333357846 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f685800d8c0 con 0x7f68680b9910 2021-10-20T23:29:00.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 -- 172.21.15.12:0/333357846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 msgr2=0x7f68680b9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 --2- 172.21.15.12:0/333357846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 0x7f68680b9cf0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f6858002f70 tx=0x7f6858006df0).stop 2021-10-20T23:29:00.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 -- 172.21.15.12:0/333357846 shutdown_connections 2021-10-20T23:29:00.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 --2- 172.21.15.12:0/333357846 >> v2:172.21.15.31:3300/0 conn(0x7f68680b7160 0x7f68680b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 --2- 172.21.15.12:0/333357846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 0x7f68680b9cf0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 -- 172.21.15.12:0/333357846 >> 172.21.15.12:0/333357846 conn(0x7f686805ff60 msgr2=0x7f68680616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:00.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 -- 172.21.15.12:0/333357846 shutdown_connections 2021-10-20T23:29:00.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 -- 172.21.15.12:0/333357846 wait complete. 2021-10-20T23:29:00.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 Processor -- start 2021-10-20T23:29:00.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.664+0000 7f686ded8700 1 -- start start 2021-10-20T23:29:00.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f686ded8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68680b4370 0x7f6868155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f686ded8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68680b7160 0x7f6868155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f686ded8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 0x7f686813be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f686ded8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686814a2b0 con 0x7f68680b9910 2021-10-20T23:29:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f686ded8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868140960 con 0x7f68680b4370 2021-10-20T23:29:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f686ded8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6868140c00 con 0x7f68680b7160 2021-10-20T23:29:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6867fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 0x7f686813be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6867fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 0x7f686813be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44918/0 (socket says 172.21.15.12:44918) 2021-10-20T23:29:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6867fff700 1 -- 172.21.15.12:0/1788047226 learned_addr learned my addr 172.21.15.12:0/1788047226 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f68677fe700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68680b4370 0x7f6868155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6866ffd700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68680b7160 0x7f6868155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6867fff700 1 -- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68680b7160 msgr2=0x7f6868155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6867fff700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68680b7160 0x7f6868155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6867fff700 1 -- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68680b4370 msgr2=0x7f6868155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6867fff700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68680b4370 0x7f6868155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6867fff700 1 -- 172.21.15.12:0/1788047226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685800b180 con 0x7f68680b9910 2021-10-20T23:29:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6866ffd700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68680b7160 0x7f6868155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:00.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6867fff700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 0x7f686813be50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f6860006e00 tx=0x7f68600091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:00.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6864ff9700 1 -- 172.21.15.12:0/1788047226 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f686000c850 con 0x7f68680b9910 2021-10-20T23:29:00.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6864ff9700 1 -- 172.21.15.12:0/1788047226 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000c9b0 con 0x7f68680b9910 2021-10-20T23:29:00.694 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6864ff9700 1 -- 172.21.15.12:0/1788047226 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f686000cd10 con 0x7f68680b9910 2021-10-20T23:29:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6868149d30 con 0x7f68680b9910 2021-10-20T23:29:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686813e7e0 con 0x7f68680b9910 2021-10-20T23:29:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6864ff9700 1 -- 172.21.15.12:0/1788047226 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f68600123f0 con 0x7f68680b9910 2021-10-20T23:29:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6868057350 con 0x7f68680b9910 2021-10-20T23:29:00.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.668+0000 7f6864ff9700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68480535b0 0x7f6848055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:00.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.672+0000 7f6864ff9700 1 -- 172.21.15.12:0/1788047226 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f686006beb0 con 0x7f68680b9910 2021-10-20T23:29:00.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.672+0000 7f68677fe700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68480535b0 0x7f6848055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:00.696 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.672+0000 7f68677fe700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68480535b0 0x7f6848055a70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f6858018000 tx=0x7f6858014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.676+0000 7f6864ff9700 1 -- 172.21.15.12:0/1788047226 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6860042e00 con 0x7f68680b9910 2021-10-20T23:29:00.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:00.836+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6868069a00 con 0x7f68680b9910 2021-10-20T23:29:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.248+0000 7f6864ff9700 1 -- 172.21.15.12:0/1788047226 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6860046420 con 0x7f68680b9910 2021-10-20T23:29:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.248+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68480535b0 msgr2=0x7f6848055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.248+0000 7f686ded8700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68480535b0 0x7f6848055a70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f6858018000 tx=0x7f6858014000).stop 2021-10-20T23:29:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.248+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 msgr2=0x7f686813be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.248+0000 7f686ded8700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 0x7f686813be50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f6860006e00 tx=0x7f68600091d0).stop 2021-10-20T23:29:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.252+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 shutdown_connections 2021-10-20T23:29:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.252+0000 7f686ded8700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f68480535b0 0x7f6848055a70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.252+0000 7f686ded8700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68680b9910 0x7f686813be50 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:01.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.252+0000 7f686ded8700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68680b7160 0x7f6868155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.252+0000 7f686ded8700 1 --2- 172.21.15.12:0/1788047226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68680b4370 0x7f6868155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.252+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 >> 172.21.15.12:0/1788047226 conn(0x7f686805ff60 msgr2=0x7f68680b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.252+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 shutdown_connections 2021-10-20T23:29:01.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.252+0000 7f686ded8700 1 -- 172.21.15.12:0/1788047226 wait complete. 2021-10-20T23:29:01.279 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:29:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.392+0000 7f078e37f700 1 Processor -- start 2021-10-20T23:29:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.392+0000 7f078e37f700 1 -- start start 2021-10-20T23:29:01.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.392+0000 7f078e37f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078805fdc0 0x7f07880601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:01.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.392+0000 7f078e37f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07880b0ab0 0x7f07880afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:01.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.392+0000 7f078e37f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0788143e50 con 0x7f07880b05a0 2021-10-20T23:29:01.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.392+0000 7f078e37f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0788143240 con 0x7f07880b0ab0 2021-10-20T23:29:01.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.392+0000 7f078e37f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07880b2300 con 0x7f078805fdc0 2021-10-20T23:29:01.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078db7e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07880b0ab0 0x7f07880afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:01.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078cb7c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f07880b05a0 0x7f07880b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43520/0 (socket says 172.21.15.12:43520) 2021-10-20T23:29:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078cb7c700 1 -- 172.21.15.12:0/1197627223 learned_addr learned my addr 172.21.15.12:0/1197627223 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078d37d700 1 --2- 172.21.15.12:0/1197627223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078805fdc0 0x7f07880601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078db7e700 1 -- 172.21.15.12:0/1197627223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078805fdc0 msgr2=0x7f07880601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078db7e700 1 --2- 172.21.15.12:0/1197627223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078805fdc0 0x7f07880601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078db7e700 1 -- 172.21.15.12:0/1197627223 >> v1:172.21.15.12:6789/0 conn(0x7f07880b05a0 legacy=0x7f07880b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f0777fff700 1 -- 172.21.15.12:0/1197627223 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43696630 0 0) 0x7f0788143e50 con 0x7f07880b05a0 2021-10-20T23:29:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078db7e700 1 -- 172.21.15.12:0/1197627223 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880b25a0 con 0x7f07880b0ab0 2021-10-20T23:29:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078db7e700 1 --2- 172.21.15.12:0/1197627223 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07880b0ab0 0x7f07880afad0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f07800032f0 tx=0x7f07800091d0).ready entity=mon.0 client_cookie=b92229d67f4ba698 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f0777fff700 1 -- 172.21.15.12:0/1197627223 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f078000b6c0 con 0x7f07880b0ab0 2021-10-20T23:29:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f0777fff700 1 -- 172.21.15.12:0/1197627223 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078000b820 con 0x7f07880b0ab0 2021-10-20T23:29:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f0777fff700 1 -- 172.21.15.12:0/1197627223 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f078000b990 con 0x7f07880b0ab0 2021-10-20T23:29:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 -- 172.21.15.12:0/1197627223 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07880b0ab0 msgr2=0x7f07880afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 --2- 172.21.15.12:0/1197627223 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07880b0ab0 0x7f07880afad0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f07800032f0 tx=0x7f07800091d0).stop 2021-10-20T23:29:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 -- 172.21.15.12:0/1197627223 shutdown_connections 2021-10-20T23:29:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 --2- 172.21.15.12:0/1197627223 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07880b0ab0 0x7f07880afad0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 --2- 172.21.15.12:0/1197627223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f078805fdc0 0x7f07880601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 -- 172.21.15.12:0/1197627223 >> 172.21.15.12:0/1197627223 conn(0x7f078805d010 msgr2=0x7f078805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 -- 172.21.15.12:0/1197627223 shutdown_connections 2021-10-20T23:29:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 -- 172.21.15.12:0/1197627223 wait complete. 2021-10-20T23:29:01.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 Processor -- start 2021-10-20T23:29:01.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.396+0000 7f078e37f700 1 -- start start 2021-10-20T23:29:01.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078e37f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078805fdc0 0x7f07880b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:01.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078e37f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07880b05a0 0x7f0788151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:01.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078e37f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880b0ab0 0x7f0788152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:01.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078e37f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0788142e60 con 0x7f078805fdc0 2021-10-20T23:29:01.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078e37f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0788155430 con 0x7f07880b0ab0 2021-10-20T23:29:01.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078e37f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07880b0330 con 0x7f07880b05a0 2021-10-20T23:29:01.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078d37d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078805fdc0 0x7f07880b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:01.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078d37d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078805fdc0 0x7f07880b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44928/0 (socket says 172.21.15.12:44928) 2021-10-20T23:29:01.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078d37d700 1 -- 172.21.15.12:0/3342697923 learned_addr learned my addr 172.21.15.12:0/3342697923 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:01.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078db7e700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880b0ab0 0x7f0788152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:01.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078cb7c700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07880b05a0 0x7f0788151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:01.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078d37d700 1 -- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07880b05a0 msgr2=0x7f0788151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078d37d700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07880b05a0 0x7f0788151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078d37d700 1 -- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880b0ab0 msgr2=0x7f0788152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078d37d700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880b0ab0 0x7f0788152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078d37d700 1 -- 172.21.15.12:0/3342697923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0780009470 con 0x7f078805fdc0 2021-10-20T23:29:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078db7e700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880b0ab0 0x7f0788152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078d37d700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078805fdc0 0x7f07880b4cc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f077800c000 tx=0x7f0778006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f07767fc700 1 -- 172.21.15.12:0/3342697923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0778010780 con 0x7f078805fdc0 2021-10-20T23:29:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0788155660 con 0x7f078805fdc0 2021-10-20T23:29:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f07767fc700 1 -- 172.21.15.12:0/3342697923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07780108e0 con 0x7f078805fdc0 2021-10-20T23:29:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0788155ba0 con 0x7f078805fdc0 2021-10-20T23:29:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f07767fc700 1 -- 172.21.15.12:0/3342697923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0778010c40 con 0x7f078805fdc0 2021-10-20T23:29:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.400+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0788155d60 con 0x7f078805fdc0 2021-10-20T23:29:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.404+0000 7f07767fc700 1 -- 172.21.15.12:0/3342697923 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f077801c460 con 0x7f078805fdc0 2021-10-20T23:29:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.404+0000 7f07767fc700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07680534f0 0x7f07680559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.404+0000 7f07767fc700 1 -- 172.21.15.12:0/3342697923 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f077806bf50 con 0x7f078805fdc0 2021-10-20T23:29:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.404+0000 7f078cb7c700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07680534f0 0x7f07680559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.404+0000 7f078cb7c700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07680534f0 0x7f07680559b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f078400d000 tx=0x7f0784007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:01.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.412+0000 7f07767fc700 1 -- 172.21.15.12:0/3342697923 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0778042e00 con 0x7f078805fdc0 2021-10-20T23:29:01.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:01.540+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f07880b2840 con 0x7f078805fdc0 2021-10-20T23:29:02.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.252+0000 7f07767fc700 1 -- 172.21.15.12:0/3342697923 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v144) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0778046420 con 0x7f078805fdc0 2021-10-20T23:29:02.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07680534f0 msgr2=0x7f07680559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:02.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07680534f0 0x7f07680559b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f078400d000 tx=0x7f0784007a00).stop 2021-10-20T23:29:02.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078805fdc0 msgr2=0x7f07880b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:02.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078805fdc0 0x7f07880b4cc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f077800c000 tx=0x7f0778006df0).stop 2021-10-20T23:29:02.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 shutdown_connections 2021-10-20T23:29:02.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f07680534f0 0x7f07680559b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:02.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880b0ab0 0x7f0788152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:02.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07880b05a0 0x7f0788151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:02.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 --2- 172.21.15.12:0/3342697923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f078805fdc0 0x7f07880b4cc0 secure :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0x7f077800c000 tx=0x7f0778006df0).stop 2021-10-20T23:29:02.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.256+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 >> 172.21.15.12:0/3342697923 conn(0x7f078805d010 msgr2=0x7f0788141a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:02.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.260+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 shutdown_connections 2021-10-20T23:29:02.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.260+0000 7f078e37f700 1 -- 172.21.15.12:0/3342697923 wait complete. 2021-10-20T23:29:02.275 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:29:02.284 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:29:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.388+0000 7f1d3313a700 1 Processor -- start 2021-10-20T23:29:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.388+0000 7f1d3313a700 1 -- start start 2021-10-20T23:29:02.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d2c0b9910 0x7f1d2c0b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b4370 0x7f1d2c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c1468e0 con 0x7f1d2c0b7160 2021-10-20T23:29:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2c0b4c30 con 0x7f1d2c0b9910 2021-10-20T23:29:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0b4990 con 0x7f1d2c0b4370 2021-10-20T23:29:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d30ed6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d2c0b9910 0x7f1d2c0b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d30ed6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d2c0b9910 0x7f1d2c0b9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44936/0 (socket says 172.21.15.12:44936) 2021-10-20T23:29:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d30ed6700 1 -- 172.21.15.12:0/3670878394 learned_addr learned my addr 172.21.15.12:0/3670878394 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d2bfff700 1 --2- 172.21.15.12:0/3670878394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b4370 0x7f1d2c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d30ed6700 1 -- 172.21.15.12:0/3670878394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b4370 msgr2=0x7f1d2c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d30ed6700 1 --2- 172.21.15.12:0/3670878394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b4370 0x7f1d2c0b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d30ed6700 1 -- 172.21.15.12:0/3670878394 >> v1:172.21.15.31:6789/0 conn(0x7f1d2c0b7160 legacy=0x7f1d2c146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:02.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d30ed6700 1 -- 172.21.15.12:0/3670878394 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c146b40 con 0x7f1d2c0b9910 2021-10-20T23:29:02.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d30ed6700 1 --2- 172.21.15.12:0/3670878394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b9910 0x7f1d2c0b9cf0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f1d1c002f70 tx=0x7f1d1c006eb0).ready entity=mon.0 client_cookie=28908d79b22ebe87 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:02.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d2b7fe700 1 -- 172.21.15.12:0/3670878394 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1c00d570 con 0x7f1d2c0b9910 2021-10-20T23:29:02.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d2b7fe700 1 -- 172.21.15.12:0/3670878394 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c000e90 con 0x7f1d2c0b9910 2021-10-20T23:29:02.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d2b7fe700 1 -- 172.21.15.12:0/3670878394 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1c00d900 con 0x7f1d2c0b9910 2021-10-20T23:29:02.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 -- 172.21.15.12:0/3670878394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b9910 msgr2=0x7f1d2c0b9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:02.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 --2- 172.21.15.12:0/3670878394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b9910 0x7f1d2c0b9cf0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f1d1c002f70 tx=0x7f1d1c006eb0).stop 2021-10-20T23:29:02.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 -- 172.21.15.12:0/3670878394 shutdown_connections 2021-10-20T23:29:02.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 --2- 172.21.15.12:0/3670878394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b4370 0x7f1d2c0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:02.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 --2- 172.21.15.12:0/3670878394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b9910 0x7f1d2c0b9cf0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:02.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 -- 172.21.15.12:0/3670878394 >> 172.21.15.12:0/3670878394 conn(0x7f1d2c05ff60 msgr2=0x7f1d2c0616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:02.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 -- 172.21.15.12:0/3670878394 shutdown_connections 2021-10-20T23:29:02.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.392+0000 7f1d3313a700 1 -- 172.21.15.12:0/3670878394 wait complete. 2021-10-20T23:29:02.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 Processor -- start 2021-10-20T23:29:02.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 -- start start 2021-10-20T23:29:02.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d2c0b4370 0x7f1d2c0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:02.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b7160 0x7f1d2c13cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:02.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b9910 0x7f1d2c13d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:02.415 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c152240 con 0x7f1d2c0b7160 2021-10-20T23:29:02.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c152430 con 0x7f1d2c0b4370 2021-10-20T23:29:02.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c1526d0 con 0x7f1d2c0b9910 2021-10-20T23:29:02.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d2bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b7160 0x7f1d2c13cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:02.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d2bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b7160 0x7f1d2c13cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44944/0 (socket says 172.21.15.12:44944) 2021-10-20T23:29:02.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d2bfff700 1 -- 172.21.15.12:0/2942783097 learned_addr learned my addr 172.21.15.12:0/2942783097 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:02.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d30ed6700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d2c0b4370 0x7f1d2c0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d316d7700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b9910 0x7f1d2c13d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d2bfff700 1 -- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b9910 msgr2=0x7f1d2c13d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d2bfff700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b9910 0x7f1d2c13d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d2bfff700 1 -- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d2c0b4370 msgr2=0x7f1d2c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d2bfff700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d2c0b4370 0x7f1d2c0adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:02.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d2bfff700 1 -- 172.21.15.12:0/2942783097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c00b1e0 con 0x7f1d2c0b7160 2021-10-20T23:29:02.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d2bfff700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b7160 0x7f1d2c13cdb0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f1d1400c000 tx=0x7f1d14006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:02.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d29ffb700 1 -- 172.21.15.12:0/2942783097 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d14010590 con 0x7f1d2c0b7160 2021-10-20T23:29:02.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d29ffb700 1 -- 172.21.15.12:0/2942783097 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d140106f0 con 0x7f1d2c0b7160 2021-10-20T23:29:02.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c152970 con 0x7f1d2c0b7160 2021-10-20T23:29:02.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d29ffb700 1 -- 172.21.15.12:0/2942783097 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d14010a50 con 0x7f1d2c0b7160 2021-10-20T23:29:02.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.396+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c1530b0 con 0x7f1d2c0b7160 2021-10-20T23:29:02.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.400+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c057350 con 0x7f1d2c0b7160 2021-10-20T23:29:02.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.400+0000 7f1d29ffb700 1 -- 172.21.15.12:0/2942783097 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d14010bb0 con 0x7f1d2c0b7160 2021-10-20T23:29:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.400+0000 7f1d29ffb700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d100534f0 0x7f1d100559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.400+0000 7f1d29ffb700 1 -- 172.21.15.12:0/2942783097 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f1d1406b9e0 con 0x7f1d2c0b7160 2021-10-20T23:29:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.400+0000 7f1d30ed6700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d100534f0 0x7f1d100559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:02.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.400+0000 7f1d30ed6700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d100534f0 0x7f1d100559b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1d1c01c000 tx=0x7f1d1c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:02.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.404+0000 7f1d29ffb700 1 -- 172.21.15.12:0/2942783097 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d14042a30 con 0x7f1d2c0b7160 2021-10-20T23:29:02.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:02.536+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1d2c152e10 con 0x7f1d2c0b7160 2021-10-20T23:29:03.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.264+0000 7f1d29ffb700 1 -- 172.21.15.12:0/2942783097 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v145) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1d14046050 con 0x7f1d2c0b7160 2021-10-20T23:29:03.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d100534f0 msgr2=0x7f1d100559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d100534f0 0x7f1d100559b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1d1c01c000 tx=0x7f1d1c015000).stop 2021-10-20T23:29:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b7160 msgr2=0x7f1d2c13cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b7160 0x7f1d2c13cdb0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f1d1400c000 tx=0x7f1d14006df0).stop 2021-10-20T23:29:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 shutdown_connections 2021-10-20T23:29:03.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1d100534f0 0x7f1d100559b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d2c0b9910 0x7f1d2c13d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2c0b7160 0x7f1d2c13cdb0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 --2- 172.21.15.12:0/2942783097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d2c0b4370 0x7f1d2c0adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 >> 172.21.15.12:0/2942783097 conn(0x7f1d2c05ff60 msgr2=0x7f1d2c05ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:03.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 shutdown_connections 2021-10-20T23:29:03.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.272+0000 7f1d3313a700 1 -- 172.21.15.12:0/2942783097 wait complete. 2021-10-20T23:29:03.287 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:29:03.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:29:03.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:29:03.303 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:29:03.306 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-20T23:29:03.323 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2021-10-20T23:29:03.324 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2021-10-20T23:29:03.324 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:29:03.324 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2021-10-20T23:29:03.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.325 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2021-10-20T23:29:03.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.325 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2021-10-20T23:29:03.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.326 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2021-10-20T23:29:03.326 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2021-10-20T23:29:03.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.326 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2021-10-20T23:29:03.327 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2021-10-20T23:29:03.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.327 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:29:03.327 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2021-10-20T23:29:03.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.328 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:29:03.328 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:29:03.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.328 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2021-10-20T23:29:03.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.329 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2021-10-20T23:29:03.329 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2021-10-20T23:29:03.329 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:29:03.329 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:29:03.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2021-10-20T23:29:03.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:29:03.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2021-10-20T23:29:03.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:29:03.330 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:29:03.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.331 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:29:03.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.331 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2021-10-20T23:29:03.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.332 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2021-10-20T23:29:03.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.332 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2021-10-20T23:29:03.332 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2021-10-20T23:29:03.333 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2021-10-20T23:29:03.333 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:29:03.333 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:29:03.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.333 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2021-10-20T23:29:03.334 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2021-10-20T23:29:03.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.334 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2021-10-20T23:29:03.334 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2021-10-20T23:29:03.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.335 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2021-10-20T23:29:03.335 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2021-10-20T23:29:03.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.335 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2021-10-20T23:29:03.336 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2021-10-20T23:29:03.336 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2021-10-20T23:29:03.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.336 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2021-10-20T23:29:03.336 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2021-10-20T23:29:03.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:29:03.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.337 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2021-10-20T23:29:03.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.338 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2021-10-20T23:29:03.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.338 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:29:03.338 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2021-10-20T23:29:03.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.339 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2021-10-20T23:29:03.339 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2021-10-20T23:29:03.339 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2021-10-20T23:29:03.339 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore compression mode = aggressive 2021-10-20T23:29:03.340 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2021-10-20T23:29:03.340 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 20 2021-10-20T23:29:03.340 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 20 2021-10-20T23:29:03.340 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:29:03.340 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2021-10-20T23:29:03.341 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 10 2021-10-20T23:29:03.341 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:29:03.341 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2021-10-20T23:29:03.341 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:29:03.341 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:29:03.342 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2021-10-20T23:29:03.342 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2021-10-20T23:29:03.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.342 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2021-10-20T23:29:03.343 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:29:03.343 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2021-10-20T23:29:03.343 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2021-10-20T23:29:03.343 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2021-10-20T23:29:03.343 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:29:03.344 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:29:03.344 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2021-10-20T23:29:03.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.344 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2021-10-20T23:29:03.344 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:29:03.345 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2021-10-20T23:29:03.345 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2021-10-20T23:29:03.346 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2021-10-20T23:29:03.346 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2021-10-20T23:29:03.346 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2021-10-20T23:29:03.346 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:29:03.347 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2021-10-20T23:29:03.347 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2021-10-20T23:29:03.348 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:29:03.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.348 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:29:03.348 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:29:03.348 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:29:03.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.349 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:29:03.349 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:29:03.349 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:29:03.349 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2021-10-20T23:29:03.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:03.350 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2021-10-20T23:29:03.350 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2021-10-20T23:29:03.350 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2021-10-20T23:29:03.351 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2021-10-20T23:29:03.351 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:29:03.351 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:29:03.351 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2021-10-20T23:29:03.351 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2021-10-20T23:29:03.352 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:29:03.352 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 15m 2021-10-20T23:29:03.352 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 15m 2021-10-20T23:29:03.352 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2021-10-20T23:29:03.352 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2021-10-20T23:29:03.353 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2021-10-20T23:29:03.353 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2021-10-20T23:29:03.353 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2021-10-20T23:29:03.353 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2021-10-20T23:29:03.353 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2021-10-20T23:29:03.354 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2021-10-20T23:29:03.354 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2021-10-20T23:29:03.354 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal frag = True 2021-10-20T23:29:03.354 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal fragment size max = 10000 2021-10-20T23:29:03.355 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal merge size = 5 2021-10-20T23:29:03.355 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal split bits = 3 2021-10-20T23:29:03.355 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal split size = 100 2021-10-20T23:29:03.355 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2021-10-20T23:29:03.355 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2021-10-20T23:29:03.356 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2021-10-20T23:29:03.356 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2021-10-20T23:29:03.356 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2021-10-20T23:29:03.356 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 15m 2021-10-20T23:29:03.356 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 15m 2021-10-20T23:29:03.359 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2021-10-20T23:29:03.360 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2021-10-20T23:29:03.360 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:29:03.360 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2021-10-20T23:29:03.360 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.361 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2021-10-20T23:29:03.361 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.361 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2021-10-20T23:29:03.361 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.362 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2021-10-20T23:29:03.362 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2021-10-20T23:29:03.362 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.362 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2021-10-20T23:29:03.363 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2021-10-20T23:29:03.363 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.363 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:29:03.363 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2021-10-20T23:29:03.363 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.364 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:29:03.364 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:29:03.364 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.364 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2021-10-20T23:29:03.365 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.365 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2021-10-20T23:29:03.365 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2021-10-20T23:29:03.365 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:29:03.365 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:29:03.366 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2021-10-20T23:29:03.366 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:29:03.366 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2021-10-20T23:29:03.366 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:29:03.367 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:29:03.367 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.367 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:29:03.367 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.368 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2021-10-20T23:29:03.368 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.368 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2021-10-20T23:29:03.369 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.369 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2021-10-20T23:29:03.370 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2021-10-20T23:29:03.370 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2021-10-20T23:29:03.370 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:29:03.371 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:29:03.371 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.372 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2021-10-20T23:29:03.372 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2021-10-20T23:29:03.372 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.373 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2021-10-20T23:29:03.373 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2021-10-20T23:29:03.373 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.374 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2021-10-20T23:29:03.374 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2021-10-20T23:29:03.374 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.374 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2021-10-20T23:29:03.375 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2021-10-20T23:29:03.375 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2021-10-20T23:29:03.375 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.375 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2021-10-20T23:29:03.375 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2021-10-20T23:29:03.376 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.376 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:29:03.376 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.376 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2021-10-20T23:29:03.377 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.377 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2021-10-20T23:29:03.377 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.377 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:29:03.378 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2021-10-20T23:29:03.378 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.378 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2021-10-20T23:29:03.378 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2021-10-20T23:29:03.379 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2021-10-20T23:29:03.379 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore compression mode = aggressive 2021-10-20T23:29:03.379 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2021-10-20T23:29:03.379 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2021-10-20T23:29:03.379 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2021-10-20T23:29:03.380 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:29:03.380 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2021-10-20T23:29:03.380 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2021-10-20T23:29:03.380 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:29:03.381 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2021-10-20T23:29:03.381 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:29:03.381 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:29:03.382 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2021-10-20T23:29:03.382 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-10-20T23:29:03.382 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.383 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2021-10-20T23:29:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:29:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2021-10-20T23:29:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-10-20T23:29:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-10-20T23:29:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:29:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:29:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2021-10-20T23:29:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.385 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2021-10-20T23:29:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:29:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-10-20T23:29:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2021-10-20T23:29:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-10-20T23:29:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2021-10-20T23:29:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2021-10-20T23:29:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:29:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2021-10-20T23:29:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2021-10-20T23:29:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:29:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:29:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:29:03.388 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:29:03.388 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.388 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:29:03.388 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:29:03.388 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:29:03.389 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2021-10-20T23:29:03.389 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-10-20T23:29:03.389 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2021-10-20T23:29:03.389 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2021-10-20T23:29:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2021-10-20T23:29:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2021-10-20T23:29:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:29:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:29:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2021-10-20T23:29:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2021-10-20T23:29:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:29:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 15m 2021-10-20T23:29:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 15m 2021-10-20T23:29:03.392 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2021-10-20T23:29:03.393 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2021-10-20T23:29:03.393 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2021-10-20T23:29:03.393 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2021-10-20T23:29:03.394 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2021-10-20T23:29:03.394 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2021-10-20T23:29:03.395 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2021-10-20T23:29:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2021-10-20T23:29:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-10-20T23:29:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal frag = True 2021-10-20T23:29:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal fragment size max = 10000 2021-10-20T23:29:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal merge size = 5 2021-10-20T23:29:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split bits = 3 2021-10-20T23:29:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split size = 100 2021-10-20T23:29:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2021-10-20T23:29:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2021-10-20T23:29:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2021-10-20T23:29:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2021-10-20T23:29:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-10-20T23:29:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 15m 2021-10-20T23:29:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 15m 2021-10-20T23:29:03.398 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2021-10-20T23:29:03.398 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2021-10-20T23:29:03.399 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:29:03.399 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2021-10-20T23:29:03.399 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.399 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2021-10-20T23:29:03.399 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.400 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2021-10-20T23:29:03.400 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.400 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2021-10-20T23:29:03.400 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2021-10-20T23:29:03.400 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.401 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2021-10-20T23:29:03.401 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2021-10-20T23:29:03.401 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.401 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:29:03.402 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2021-10-20T23:29:03.402 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.402 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:29:03.402 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:29:03.403 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.403 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2021-10-20T23:29:03.403 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.403 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2021-10-20T23:29:03.403 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2021-10-20T23:29:03.404 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:29:03.404 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:29:03.404 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2021-10-20T23:29:03.404 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:29:03.404 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2021-10-20T23:29:03.405 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:29:03.405 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:29:03.405 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.405 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:29:03.406 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.406 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2021-10-20T23:29:03.406 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.406 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2021-10-20T23:29:03.406 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.407 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2021-10-20T23:29:03.407 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2021-10-20T23:29:03.407 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2021-10-20T23:29:03.407 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:29:03.407 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:29:03.408 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.408 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2021-10-20T23:29:03.408 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2021-10-20T23:29:03.408 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.408 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2021-10-20T23:29:03.409 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2021-10-20T23:29:03.409 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.409 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2021-10-20T23:29:03.409 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2021-10-20T23:29:03.409 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.410 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2021-10-20T23:29:03.410 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2021-10-20T23:29:03.410 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2021-10-20T23:29:03.410 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.411 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2021-10-20T23:29:03.411 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2021-10-20T23:29:03.411 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.411 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:29:03.412 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.412 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2021-10-20T23:29:03.412 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.412 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2021-10-20T23:29:03.413 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.413 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:29:03.413 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2021-10-20T23:29:03.413 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.413 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2021-10-20T23:29:03.414 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2021-10-20T23:29:03.414 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2021-10-20T23:29:03.414 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore compression mode = aggressive 2021-10-20T23:29:03.414 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2021-10-20T23:29:03.415 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 20 2021-10-20T23:29:03.415 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 20 2021-10-20T23:29:03.415 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:29:03.415 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2021-10-20T23:29:03.415 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 10 2021-10-20T23:29:03.416 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:29:03.416 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2021-10-20T23:29:03.416 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:29:03.416 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:29:03.417 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2021-10-20T23:29:03.417 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2021-10-20T23:29:03.417 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.417 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2021-10-20T23:29:03.418 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:29:03.418 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2021-10-20T23:29:03.418 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2021-10-20T23:29:03.418 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2021-10-20T23:29:03.418 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:29:03.419 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:29:03.419 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2021-10-20T23:29:03.419 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.419 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2021-10-20T23:29:03.420 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:29:03.420 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2021-10-20T23:29:03.420 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2021-10-20T23:29:03.420 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2021-10-20T23:29:03.420 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2021-10-20T23:29:03.421 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2021-10-20T23:29:03.421 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:29:03.421 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2021-10-20T23:29:03.421 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2021-10-20T23:29:03.422 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:29:03.422 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.422 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:29:03.422 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:29:03.423 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:29:03.423 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.423 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:29:03.423 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:29:03.423 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:29:03.424 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2021-10-20T23:29:03.424 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-20T23:29:03.424 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2021-10-20T23:29:03.424 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2021-10-20T23:29:03.425 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2021-10-20T23:29:03.425 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2021-10-20T23:29:03.425 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:29:03.425 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:29:03.426 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2021-10-20T23:29:03.426 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2021-10-20T23:29:03.426 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:29:03.426 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 15m 2021-10-20T23:29:03.426 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 15m 2021-10-20T23:29:03.427 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2021-10-20T23:29:03.427 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2021-10-20T23:29:03.427 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2021-10-20T23:29:03.427 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2021-10-20T23:29:03.428 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2021-10-20T23:29:03.428 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2021-10-20T23:29:03.428 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2021-10-20T23:29:03.428 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2021-10-20T23:29:03.428 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2021-10-20T23:29:03.429 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal frag = True 2021-10-20T23:29:03.429 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal fragment size max = 10000 2021-10-20T23:29:03.429 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal merge size = 5 2021-10-20T23:29:03.429 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal split bits = 3 2021-10-20T23:29:03.429 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal split size = 100 2021-10-20T23:29:03.430 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2021-10-20T23:29:03.430 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2021-10-20T23:29:03.430 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2021-10-20T23:29:03.430 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2021-10-20T23:29:03.430 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2021-10-20T23:29:03.431 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 15m 2021-10-20T23:29:03.431 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 15m 2021-10-20T23:29:03.431 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2021-10-20T23:29:03.431 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2021-10-20T23:29:03.432 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-20T23:29:03.432 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2021-10-20T23:29:03.432 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.432 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2021-10-20T23:29:03.433 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.433 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2021-10-20T23:29:03.433 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.433 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2021-10-20T23:29:03.434 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2021-10-20T23:29:03.434 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.434 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2021-10-20T23:29:03.435 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2021-10-20T23:29:03.435 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.435 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-20T23:29:03.435 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2021-10-20T23:29:03.436 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.436 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2021-10-20T23:29:03.436 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-20T23:29:03.437 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.437 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2021-10-20T23:29:03.437 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.437 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2021-10-20T23:29:03.438 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2021-10-20T23:29:03.438 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2021-10-20T23:29:03.438 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2021-10-20T23:29:03.438 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2021-10-20T23:29:03.438 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2021-10-20T23:29:03.439 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2021-10-20T23:29:03.439 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-20T23:29:03.439 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-20T23:29:03.439 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.440 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-20T23:29:03.440 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.440 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2021-10-20T23:29:03.440 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.440 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2021-10-20T23:29:03.441 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.441 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2021-10-20T23:29:03.441 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2021-10-20T23:29:03.441 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2021-10-20T23:29:03.442 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2021-10-20T23:29:03.442 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e54e6890-5274-4a86-a9de-861e39b4bc51 2021-10-20T23:29:03.442 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.442 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2021-10-20T23:29:03.442 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2021-10-20T23:29:03.443 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.443 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2021-10-20T23:29:03.443 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2021-10-20T23:29:03.443 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.444 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2021-10-20T23:29:03.444 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2021-10-20T23:29:03.444 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.444 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2021-10-20T23:29:03.444 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2021-10-20T23:29:03.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2021-10-20T23:29:03.445 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2021-10-20T23:29:03.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2021-10-20T23:29:03.445 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.446 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2021-10-20T23:29:03.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.446 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2021-10-20T23:29:03.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.446 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2021-10-20T23:29:03.447 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.447 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2021-10-20T23:29:03.447 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2021-10-20T23:29:03.447 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.447 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2021-10-20T23:29:03.448 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2021-10-20T23:29:03.448 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2021-10-20T23:29:03.448 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore compression mode = aggressive 2021-10-20T23:29:03.448 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2021-10-20T23:29:03.448 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 20 2021-10-20T23:29:03.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 20 2021-10-20T23:29:03.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:29:03.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2021-10-20T23:29:03.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 10 2021-10-20T23:29:03.450 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2021-10-20T23:29:03.450 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2021-10-20T23:29:03.450 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2021-10-20T23:29:03.450 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2021-10-20T23:29:03.450 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2021-10-20T23:29:03.451 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2021-10-20T23:29:03.451 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.451 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2021-10-20T23:29:03.451 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:29:03.451 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2021-10-20T23:29:03.452 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2021-10-20T23:29:03.452 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2021-10-20T23:29:03.452 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:29:03.453 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:29:03.453 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2021-10-20T23:29:03.453 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.453 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2021-10-20T23:29:03.454 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:29:03.454 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2021-10-20T23:29:03.454 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2021-10-20T23:29:03.454 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2021-10-20T23:29:03.454 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2021-10-20T23:29:03.455 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2021-10-20T23:29:03.455 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2021-10-20T23:29:03.455 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2021-10-20T23:29:03.455 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2021-10-20T23:29:03.455 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2021-10-20T23:29:03.456 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.456 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-20T23:29:03.456 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2021-10-20T23:29:03.456 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2021-10-20T23:29:03.456 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.457 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2021-10-20T23:29:03.457 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-20T23:29:03.457 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-20T23:29:03.457 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2021-10-20T23:29:03.458 INFO:teuthology.orchestra.run.smithi031.stdout: 2021-10-20T23:29:03.458 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2021-10-20T23:29:03.458 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2021-10-20T23:29:03.458 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2021-10-20T23:29:03.458 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2021-10-20T23:29:03.459 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-20T23:29:03.459 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-20T23:29:03.459 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2021-10-20T23:29:03.459 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2021-10-20T23:29:03.460 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:29:03.460 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 15m 2021-10-20T23:29:03.460 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 15m 2021-10-20T23:29:03.460 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2021-10-20T23:29:03.460 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2021-10-20T23:29:03.461 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2021-10-20T23:29:03.461 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2021-10-20T23:29:03.461 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2021-10-20T23:29:03.461 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2021-10-20T23:29:03.461 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2021-10-20T23:29:03.462 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2021-10-20T23:29:03.462 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2021-10-20T23:29:03.462 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal frag = True 2021-10-20T23:29:03.462 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal fragment size max = 10000 2021-10-20T23:29:03.462 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal merge size = 5 2021-10-20T23:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split bits = 3 2021-10-20T23:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split size = 100 2021-10-20T23:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2021-10-20T23:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2021-10-20T23:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2021-10-20T23:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2021-10-20T23:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2021-10-20T23:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 15m 2021-10-20T23:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 15m 2021-10-20T23:29:03.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:29:03.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.568+0000 7fc05e11c700 1 Processor -- start 2021-10-20T23:29:03.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.568+0000 7fc05e11c700 1 -- start start 2021-10-20T23:29:03.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc058061680 0x7fc0580b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc0580b4710 0x7fc0580ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580b6910 con 0x7fc0581439a0 2021-10-20T23:29:03.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0580b9680 con 0x7fc0580b4710 2021-10-20T23:29:03.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0580b6bb0 con 0x7fc058061680 2021-10-20T23:29:03.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05c919700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc0580b4710 0x7fc0580ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05c919700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc0580b4710 0x7fc0580ba200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44952/0 (socket says 172.21.15.12:44952) 2021-10-20T23:29:03.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05c919700 1 -- 172.21.15.12:0/3899479239 learned_addr learned my addr 172.21.15.12:0/3899479239 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:03.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05d91b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc0581439a0 0x7fc05813fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43548/0 (socket says 172.21.15.12:43548) 2021-10-20T23:29:03.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05d11a700 1 --2- 172.21.15.12:0/3899479239 >> v2:172.21.15.31:3300/0 conn(0x7fc058061680 0x7fc0580b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05c919700 1 -- 172.21.15.12:0/3899479239 >> v2:172.21.15.31:3300/0 conn(0x7fc058061680 msgr2=0x7fc0580b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:03.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05c919700 1 --2- 172.21.15.12:0/3899479239 >> v2:172.21.15.31:3300/0 conn(0x7fc058061680 0x7fc0580b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05c919700 1 -- 172.21.15.12:0/3899479239 >> v1:172.21.15.12:6789/0 conn(0x7fc0581439a0 legacy=0x7fc05813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05c919700 1 -- 172.21.15.12:0/3899479239 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0580b6e50 con 0x7fc0580b4710 2021-10-20T23:29:03.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05c919700 1 --2- 172.21.15.12:0/3899479239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0580b4710 0x7fc0580ba200 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fc048002f70 tx=0x7fc048006eb0).ready entity=mon.0 client_cookie=461469d8b41482c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:03.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc047fff700 1 -- 172.21.15.12:0/3899479239 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc04800d5c0 con 0x7fc0580b4710 2021-10-20T23:29:03.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc047fff700 1 -- 172.21.15.12:0/3899479239 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048000e90 con 0x7fc0580b4710 2021-10-20T23:29:03.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc047fff700 1 -- 172.21.15.12:0/3899479239 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc04800d950 con 0x7fc0580b4710 2021-10-20T23:29:03.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 -- 172.21.15.12:0/3899479239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0580b4710 msgr2=0x7fc0580ba200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 --2- 172.21.15.12:0/3899479239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0580b4710 0x7fc0580ba200 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fc048002f70 tx=0x7fc048006eb0).stop 2021-10-20T23:29:03.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 -- 172.21.15.12:0/3899479239 shutdown_connections 2021-10-20T23:29:03.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 --2- 172.21.15.12:0/3899479239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0580b4710 0x7fc0580ba200 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 --2- 172.21.15.12:0/3899479239 >> v2:172.21.15.31:3300/0 conn(0x7fc058061680 0x7fc0580b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 -- 172.21.15.12:0/3899479239 >> 172.21.15.12:0/3899479239 conn(0x7fc05806adf0 msgr2=0x7fc05805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:03.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 -- 172.21.15.12:0/3899479239 shutdown_connections 2021-10-20T23:29:03.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.572+0000 7fc05e11c700 1 -- 172.21.15.12:0/3899479239 wait complete. 2021-10-20T23:29:03.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 Processor -- start 2021-10-20T23:29:03.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 -- start start 2021-10-20T23:29:03.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc058061680 0x7fc058146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0581439a0 0x7fc05813e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc058112bb0 0x7fc05813e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0580ae110 con 0x7fc0581439a0 2021-10-20T23:29:03.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc058146da0 con 0x7fc058061680 2021-10-20T23:29:03.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0580b06d0 con 0x7fc058112bb0 2021-10-20T23:29:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05c919700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0581439a0 0x7fc05813e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05c919700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0581439a0 0x7fc05813e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44958/0 (socket says 172.21.15.12:44958) 2021-10-20T23:29:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05c919700 1 -- 172.21.15.12:0/1096552430 learned_addr learned my addr 172.21.15.12:0/1096552430 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05d11a700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc058061680 0x7fc058146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05d91b700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc058112bb0 0x7fc05813e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05c919700 1 -- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc058112bb0 msgr2=0x7fc05813e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05c919700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc058112bb0 0x7fc05813e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05c919700 1 -- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc058061680 msgr2=0x7fc058146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05c919700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc058061680 0x7fc058146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05c919700 1 -- 172.21.15.12:0/1096552430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04800b1e0 con 0x7fc0581439a0 2021-10-20T23:29:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05d11a700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc058061680 0x7fc058146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05c919700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0581439a0 0x7fc05813e500 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7fc048002f70 tx=0x7fc048015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc0467fc700 1 -- 172.21.15.12:0/1096552430 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc04800d940 con 0x7fc0581439a0 2021-10-20T23:29:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc0467fc700 1 -- 172.21.15.12:0/1096552430 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048011c30 con 0x7fc0581439a0 2021-10-20T23:29:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0580ade70 con 0x7fc0581439a0 2021-10-20T23:29:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc0467fc700 1 -- 172.21.15.12:0/1096552430 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc04801e460 con 0x7fc0581439a0 2021-10-20T23:29:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.576+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0580ad8c0 con 0x7fc0581439a0 2021-10-20T23:29:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.580+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0580af120 con 0x7fc0581439a0 2021-10-20T23:29:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.580+0000 7fc0467fc700 1 -- 172.21.15.12:0/1096552430 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc04801a040 con 0x7fc0581439a0 2021-10-20T23:29:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.580+0000 7fc0467fc700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0380536a0 0x7fc038055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.580+0000 7fc0467fc700 1 -- 172.21.15.12:0/1096552430 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc04806c6a0 con 0x7fc0581439a0 2021-10-20T23:29:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.580+0000 7fc05d11a700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0380536a0 0x7fc038055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.580+0000 7fc05d11a700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0380536a0 0x7fc038055b60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fc05400b000 tx=0x7fc054006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:03.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.588+0000 7fc0467fc700 1 -- 172.21.15.12:0/1096552430 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0580af120 con 0x7fc0581439a0 2021-10-20T23:29:03.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.712+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc0580af120 con 0x7fc0581439a0 2021-10-20T23:29:03.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.720+0000 7fc0467fc700 1 -- 172.21.15.12:0/1096552430 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc0580af120 con 0x7fc0581439a0 2021-10-20T23:29:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0380536a0 msgr2=0x7fc038055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0380536a0 0x7fc038055b60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fc05400b000 tx=0x7fc054006df0).stop 2021-10-20T23:29:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0581439a0 msgr2=0x7fc05813e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0581439a0 0x7fc05813e500 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7fc048002f70 tx=0x7fc048015000).stop 2021-10-20T23:29:03.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 shutdown_connections 2021-10-20T23:29:03.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc0380536a0 0x7fc038055b60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc058112bb0 0x7fc05813e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0581439a0 0x7fc05813e500 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 --2- 172.21.15.12:0/1096552430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc058061680 0x7fc058146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 >> 172.21.15.12:0/1096552430 conn(0x7fc05806adf0 msgr2=0x7fc05805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 shutdown_connections 2021-10-20T23:29:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.724+0000 7fc05e11c700 1 -- 172.21.15.12:0/1096552430 wait complete. 2021-10-20T23:29:03.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-10-20T23:29:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.840+0000 7f34c0e18700 1 Processor -- start 2021-10-20T23:29:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.840+0000 7f34c0e18700 1 -- start start 2021-10-20T23:29:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34bc0b2ee0 0x7f34bc065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc0b2a90 con 0x7f34bc0b76b0 2021-10-20T23:29:03.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc0b7a90 con 0x7f34bc14aeb0 2021-10-20T23:29:03.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc0616a0 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34bb7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f34bc0b76b0 0x7f34bc060f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43558/0 (socket says 172.21.15.12:43558) 2021-10-20T23:29:03.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34bb7fe700 1 -- 172.21.15.12:0/810822183 learned_addr learned my addr 172.21.15.12:0/810822183 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:03.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34baffd700 1 --2- 172.21.15.12:0/810822183 >> v2:172.21.15.12:3300/0 conn(0x7f34bc0b2ee0 0x7f34bc065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34ba7fc700 1 -- 172.21.15.12:0/810822183 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667248903 0 0) 0x7f34bc0b2a90 con 0x7f34bc0b76b0 2021-10-20T23:29:03.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34ba7fc700 1 -- 172.21.15.12:0/810822183 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a8003260 con 0x7f34bc0b76b0 2021-10-20T23:29:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34ba7fc700 1 -- 172.21.15.12:0/810822183 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286404361 0 0) 0x7f34bc0b7a90 con 0x7f34bc14aeb0 2021-10-20T23:29:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34baffd700 1 -- 172.21.15.12:0/810822183 >> v1:172.21.15.31:6789/0 conn(0x7f34bc14aeb0 legacy=0x7f34bc14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34baffd700 1 -- 172.21.15.12:0/810822183 >> v1:172.21.15.12:6789/0 conn(0x7f34bc0b76b0 legacy=0x7f34bc060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34baffd700 1 -- 172.21.15.12:0/810822183 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0b27f0 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34baffd700 1 --2- 172.21.15.12:0/810822183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 0x7f34bc065590 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f34b4001d00 tx=0x7f34b0006df0).ready entity=mon.0 client_cookie=fb5725e8bf9b044d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:03.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34ba7fc700 1 -- 172.21.15.12:0/810822183 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b4001b60 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34ba7fc700 1 -- 172.21.15.12:0/810822183 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0000e90 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34ba7fc700 1 -- 172.21.15.12:0/810822183 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b0011400 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 -- 172.21.15.12:0/810822183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 msgr2=0x7f34bc065590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 --2- 172.21.15.12:0/810822183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 0x7f34bc065590 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f34b4001d00 tx=0x7f34b0006df0).stop 2021-10-20T23:29:03.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 -- 172.21.15.12:0/810822183 shutdown_connections 2021-10-20T23:29:03.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 --2- 172.21.15.12:0/810822183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 0x7f34bc065590 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 -- 172.21.15.12:0/810822183 >> 172.21.15.12:0/810822183 conn(0x7f34bc05f6b0 msgr2=0x7f34bc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:03.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 -- 172.21.15.12:0/810822183 shutdown_connections 2021-10-20T23:29:03.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.844+0000 7f34c0e18700 1 -- 172.21.15.12:0/810822183 wait complete. 2021-10-20T23:29:03.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 Processor -- start 2021-10-20T23:29:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 -- start start 2021-10-20T23:29:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 0x7f34bc1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34bc0b76b0 0x7f34bc05bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34bc14aeb0 0x7f34bc0ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0acd20 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc156af0 con 0x7f34bc14aeb0 2021-10-20T23:29:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc156d90 con 0x7f34bc0b76b0 2021-10-20T23:29:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 0x7f34bc1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 0x7f34bc1574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44974/0 (socket says 172.21.15.12:44974) 2021-10-20T23:29:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bb7fe700 1 -- 172.21.15.12:0/60445866 learned_addr learned my addr 172.21.15.12:0/60445866 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bbfff700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34bc14aeb0 0x7f34bc0ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34baffd700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34bc0b76b0 0x7f34bc05bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bb7fe700 1 -- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34bc0b76b0 msgr2=0x7f34bc05bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bb7fe700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34bc0b76b0 0x7f34bc05bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bb7fe700 1 -- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34bc14aeb0 msgr2=0x7f34bc0ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bb7fe700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34bc14aeb0 0x7f34bc0ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bb7fe700 1 -- 172.21.15.12:0/60445866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b000b180 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34bb7fe700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 0x7f34bc1574d0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f34b4001d40 tx=0x7f34b4002e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:03.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34b8ff9700 1 -- 172.21.15.12:0/60445866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b4007110 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34b8ff9700 1 -- 172.21.15.12:0/60445866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b4007270 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc157030 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34b8ff9700 1 -- 172.21.15.12:0/60445866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b40075d0 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.848+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc05cf70 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.852+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc1571c0 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.852+0000 7f34b8ff9700 1 -- 172.21.15.12:0/60445866 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f34b4010030 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.852+0000 7f34b8ff9700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f349c053580 0x7f349c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:03.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.852+0000 7f34b8ff9700 1 -- 172.21.15.12:0/60445866 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f34b406bf90 con 0x7f34bc0b2ee0 2021-10-20T23:29:03.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.852+0000 7f34baffd700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f349c053580 0x7f349c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:03.873 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.852+0000 7f34baffd700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f349c053580 0x7f349c055a40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f34b0019000 tx=0x7f34bc061c20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:03.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:03.856+0000 7f34b8ff9700 1 -- 172.21.15.12:0/60445866 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f34b4043320 con 0x7f34bc0b2ee0 2021-10-20T23:29:04.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.020+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f34bc060850 con 0x7f34bc0b2ee0 2021-10-20T23:29:04.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.264+0000 7f34b8ff9700 1 -- 172.21.15.12:0/60445866 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v423) v1 ==== 128+0+0 (secure 0 0 0) 0x7f34b4046940 con 0x7f34bc0b2ee0 2021-10-20T23:29:04.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f349c053580 msgr2=0x7f349c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:04.282 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f349c053580 0x7f349c055a40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f34b0019000 tx=0x7f34bc061c20).stop 2021-10-20T23:29:04.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 msgr2=0x7f34bc1574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:04.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 0x7f34bc1574d0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f34b4001d40 tx=0x7f34b4002e30).stop 2021-10-20T23:29:04.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 shutdown_connections 2021-10-20T23:29:04.283 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f349c053580 0x7f349c055a40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:04.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34bc14aeb0 0x7f34bc0ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:04.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34bc0b76b0 0x7f34bc05bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:04.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 --2- 172.21.15.12:0/60445866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc0b2ee0 0x7f34bc1574d0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:04.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 >> 172.21.15.12:0/60445866 conn(0x7f34bc05f6b0 msgr2=0x7f34bc0b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:04.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 shutdown_connections 2021-10-20T23:29:04.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.268+0000 7f34c0e18700 1 -- 172.21.15.12:0/60445866 wait complete. 2021-10-20T23:29:04.300 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-20T23:29:04.301 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-10-20T23:29:04.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-10-20T23:29:04.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.400+0000 7fe165263700 1 Processor -- start 2021-10-20T23:29:04.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.400+0000 7fe165263700 1 -- start start 2021-10-20T23:29:04.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.400+0000 7fe165263700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1600668c0 0x7fe1600b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:04.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.400+0000 7fe165263700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1600b1570 con 0x7fe16005fc90 2021-10-20T23:29:04.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.400+0000 7fe165263700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe160066ca0 con 0x7fe1600b0cd0 2021-10-20T23:29:04.416 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600b1370 con 0x7fe1600668c0 2021-10-20T23:29:04.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe15ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1600668c0 0x7fe1600b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:04.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe164a62700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe16005fc90 0x7fe1600b68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43574/0 (socket says 172.21.15.12:43574) 2021-10-20T23:29:04.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe164a62700 1 -- 172.21.15.12:0/3461966945 learned_addr learned my addr 172.21.15.12:0/3461966945 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:04.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe15ffff700 1 -- 172.21.15.12:0/3461966945 >> v1:172.21.15.31:6789/0 conn(0x7fe1600b0cd0 legacy=0x7fe1600b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:04.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe15ffff700 1 -- 172.21.15.12:0/3461966945 >> v1:172.21.15.12:6789/0 conn(0x7fe16005fc90 legacy=0x7fe1600b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:04.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe15effd700 1 -- 172.21.15.12:0/3461966945 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719572088 0 0) 0x7fe1600b1570 con 0x7fe16005fc90 2021-10-20T23:29:04.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe15ffff700 1 -- 172.21.15.12:0/3461966945 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16005f830 con 0x7fe1600668c0 2021-10-20T23:29:04.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe15ffff700 1 --2- 172.21.15.12:0/3461966945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 0x7fe1600b21a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7fe1500032f0 tx=0x7fe1500091d0).ready entity=mon.0 client_cookie=e985e17483158ad9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:04.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe15effd700 1 -- 172.21.15.12:0/3461966945 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe150009ea0 con 0x7fe1600668c0 2021-10-20T23:29:04.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe15effd700 1 -- 172.21.15.12:0/3461966945 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15000b8a0 con 0x7fe1600668c0 2021-10-20T23:29:04.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe15effd700 1 -- 172.21.15.12:0/3461966945 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe15000ba10 con 0x7fe1600668c0 2021-10-20T23:29:04.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 -- 172.21.15.12:0/3461966945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 msgr2=0x7fe1600b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:04.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 --2- 172.21.15.12:0/3461966945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 0x7fe1600b21a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7fe1500032f0 tx=0x7fe1500091d0).stop 2021-10-20T23:29:04.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 -- 172.21.15.12:0/3461966945 shutdown_connections 2021-10-20T23:29:04.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 --2- 172.21.15.12:0/3461966945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 0x7fe1600b21a0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:04.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 -- 172.21.15.12:0/3461966945 >> 172.21.15.12:0/3461966945 conn(0x7fe160063670 msgr2=0x7fe160063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:04.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 -- 172.21.15.12:0/3461966945 shutdown_connections 2021-10-20T23:29:04.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 -- 172.21.15.12:0/3461966945 wait complete. 2021-10-20T23:29:04.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 Processor -- start 2021-10-20T23:29:04.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.404+0000 7fe165263700 1 -- start start 2021-10-20T23:29:04.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe165263700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe16005fc90 0x7fe160064c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:04.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe165263700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 0x7fe1601396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:04.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe165263700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1600b0cd0 0x7fe160139b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:04.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe165263700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe160145050 con 0x7fe1600668c0 2021-10-20T23:29:04.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe165263700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe160144bc0 con 0x7fe1600b0cd0 2021-10-20T23:29:04.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe165263700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16013cc40 con 0x7fe16005fc90 2021-10-20T23:29:04.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 0x7fe1601396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:04.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 0x7fe1601396a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44986/0 (socket says 172.21.15.12:44986) 2021-10-20T23:29:04.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15f7fe700 1 -- 172.21.15.12:0/1895924392 learned_addr learned my addr 172.21.15.12:0/1895924392 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:04.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15ffff700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe16005fc90 0x7fe160064c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:04.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe164a62700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1600b0cd0 0x7fe160139b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:04.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15f7fe700 1 -- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe16005fc90 msgr2=0x7fe160064c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:04.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15f7fe700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe16005fc90 0x7fe160064c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:04.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15f7fe700 1 -- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1600b0cd0 msgr2=0x7fe160139b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:04.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15f7fe700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1600b0cd0 0x7fe160139b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:04.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15f7fe700 1 -- 172.21.15.12:0/1895924392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009470 con 0x7fe1600668c0 2021-10-20T23:29:04.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe164a62700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1600b0cd0 0x7fe160139b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:29:04.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15f7fe700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 0x7fe1601396a0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7fe1600632a0 tx=0x7fe148007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:04.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15d7fa700 1 -- 172.21.15.12:0/1895924392 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14800ce30 con 0x7fe1600668c0 2021-10-20T23:29:04.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15d7fa700 1 -- 172.21.15.12:0/1895924392 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe148012400 con 0x7fe1600668c0 2021-10-20T23:29:04.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16013ff80 con 0x7fe1600668c0 2021-10-20T23:29:04.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15d7fa700 1 -- 172.21.15.12:0/1895924392 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe148012760 con 0x7fe1600668c0 2021-10-20T23:29:04.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe160065f70 con 0x7fe1600668c0 2021-10-20T23:29:04.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15d7fa700 1 -- 172.21.15.12:0/1895924392 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe148019030 con 0x7fe1600668c0 2021-10-20T23:29:04.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe160144dc0 con 0x7fe1600668c0 2021-10-20T23:29:04.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15d7fa700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1440534f0 0x7fe1440559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:04.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.408+0000 7fe15d7fa700 1 -- 172.21.15.12:0/1895924392 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe14806ab40 con 0x7fe1600668c0 2021-10-20T23:29:04.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.412+0000 7fe15ffff700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1440534f0 0x7fe1440559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:04.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.412+0000 7fe15ffff700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1440534f0 0x7fe1440559b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fe150019000 tx=0x7fe150016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:04.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.416+0000 7fe15d7fa700 1 -- 172.21.15.12:0/1895924392 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe148041e20 con 0x7fe1600668c0 2021-10-20T23:29:04.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:04.588+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7fe16013ce00 con 0x7fe1600668c0 2021-10-20T23:29:05.281 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.268+0000 7fe15d7fa700 1 -- 172.21.15.12:0/1895924392 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v424) v1 ==== 130+0+0 (secure 0 0 0) 0x7fe148045440 con 0x7fe1600668c0 2021-10-20T23:29:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1440534f0 msgr2=0x7fe1440559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1440534f0 0x7fe1440559b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fe150019000 tx=0x7fe150016000).stop 2021-10-20T23:29:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 msgr2=0x7fe1601396a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 0x7fe1601396a0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7fe1600632a0 tx=0x7fe148007c20).stop 2021-10-20T23:29:05.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 shutdown_connections 2021-10-20T23:29:05.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe1440534f0 0x7fe1440559b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1600b0cd0 0x7fe160139b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1600668c0 0x7fe1601396a0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 --2- 172.21.15.12:0/1895924392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe16005fc90 0x7fe160064c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 >> 172.21.15.12:0/1895924392 conn(0x7fe160063670 msgr2=0x7fe16013b060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 shutdown_connections 2021-10-20T23:29:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.272+0000 7fe165263700 1 -- 172.21.15.12:0/1895924392 wait complete. 2021-10-20T23:29:05.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:29:05.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb8b6f7700 1 Processor -- start 2021-10-20T23:29:05.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb8b6f7700 1 -- start start 2021-10-20T23:29:05.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb8b6f7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcb8405fc00 0x7fcb840b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb8b6f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 0x7fcb840b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb8b6f7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb84143f60 con 0x7fcb840b5990 2021-10-20T23:29:05.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb8b6f7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8405ffe0 con 0x7fcb8405fc00 2021-10-20T23:29:05.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb8b6f7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb84143a50 con 0x7fcb840b6560 2021-10-20T23:29:05.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb89c94700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcb840b5990 0x7fcb840b4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43590/0 (socket says 172.21.15.12:43590) 2021-10-20T23:29:05.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb89c94700 1 -- 172.21.15.12:0/2754735233 learned_addr learned my addr 172.21.15.12:0/2754735233 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:05.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb89493700 1 --2- 172.21.15.12:0/2754735233 >> v2:172.21.15.31:3300/0 conn(0x7fcb8405fc00 0x7fcb840b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb88c92700 1 --2- 172.21.15.12:0/2754735233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 0x7fcb840b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb7bfff700 1 -- 172.21.15.12:0/2754735233 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878360332 0 0) 0x7fcb84143f60 con 0x7fcb840b5990 2021-10-20T23:29:05.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb7bfff700 1 -- 172.21.15.12:0/2754735233 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb68003260 con 0x7fcb840b5990 2021-10-20T23:29:05.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb89493700 1 -- 172.21.15.12:0/2754735233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 msgr2=0x7fcb840b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:05.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb7bfff700 1 -- 172.21.15.12:0/2754735233 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3146858593 0 0) 0x7fcb68003260 con 0x7fcb840b5990 2021-10-20T23:29:05.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb89493700 1 --2- 172.21.15.12:0/2754735233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 0x7fcb840b9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb89493700 1 -- 172.21.15.12:0/2754735233 >> v1:172.21.15.12:6789/0 conn(0x7fcb840b5990 legacy=0x7fcb840b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb89493700 1 -- 172.21.15.12:0/2754735233 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84143cc0 con 0x7fcb8405fc00 2021-10-20T23:29:05.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.408+0000 7fcb89493700 1 --2- 172.21.15.12:0/2754735233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb8405fc00 0x7fcb840b41b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fcb7c001b80 tx=0x7fcb80006df0).ready entity=mon.1 client_cookie=f3d75d59310994a1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:05.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb7bfff700 1 -- 172.21.15.12:0/2754735233 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7c0019e0 con 0x7fcb8405fc00 2021-10-20T23:29:05.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb7bfff700 1 -- 172.21.15.12:0/2754735233 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb80000e90 con 0x7fcb8405fc00 2021-10-20T23:29:05.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb7bfff700 1 -- 172.21.15.12:0/2754735233 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb80012460 con 0x7fcb8405fc00 2021-10-20T23:29:05.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2754735233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb8405fc00 msgr2=0x7fcb840b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 --2- 172.21.15.12:0/2754735233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb8405fc00 0x7fcb840b41b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fcb7c001b80 tx=0x7fcb80006df0).stop 2021-10-20T23:29:05.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2754735233 shutdown_connections 2021-10-20T23:29:05.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 --2- 172.21.15.12:0/2754735233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 0x7fcb840b9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 --2- 172.21.15.12:0/2754735233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb8405fc00 0x7fcb840b41b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2754735233 >> 172.21.15.12:0/2754735233 conn(0x7fcb840623a0 msgr2=0x7fcb84066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:05.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2754735233 shutdown_connections 2021-10-20T23:29:05.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2754735233 wait complete. 2021-10-20T23:29:05.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 Processor -- start 2021-10-20T23:29:05.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.412+0000 7fcb8b6f7700 1 -- start start 2021-10-20T23:29:05.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb8b6f7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb8405fc00 0x7fcb841429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb8b6f7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb840b5990 0x7fcb84141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb8b6f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 0x7fcb84127250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb8b6f7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb84141830 con 0x7fcb840b5990 2021-10-20T23:29:05.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb8b6f7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840adb20 con 0x7fcb8405fc00 2021-10-20T23:29:05.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb8b6f7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840addc0 con 0x7fcb840b6560 2021-10-20T23:29:05.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb88c92700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb840b5990 0x7fcb84141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb88c92700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb840b5990 0x7fcb84141ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45002/0 (socket says 172.21.15.12:45002) 2021-10-20T23:29:05.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb88c92700 1 -- 172.21.15.12:0/2059211543 learned_addr learned my addr 172.21.15.12:0/2059211543 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb89493700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb8405fc00 0x7fcb841429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb89c94700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 0x7fcb84127250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb88c92700 1 -- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 msgr2=0x7fcb84127250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb88c92700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 0x7fcb84127250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb88c92700 1 -- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb8405fc00 msgr2=0x7fcb841429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb88c92700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb8405fc00 0x7fcb841429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb88c92700 1 -- 172.21.15.12:0/2059211543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8000b180 con 0x7fcb840b5990 2021-10-20T23:29:05.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb88c92700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb840b5990 0x7fcb84141ee0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fcb7400c000 tx=0x7fcb74006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:05.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb7a7fc700 1 -- 172.21.15.12:0/2059211543 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb74010780 con 0x7fcb840b5990 2021-10-20T23:29:05.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb7a7fc700 1 -- 172.21.15.12:0/2059211543 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740108e0 con 0x7fcb840b5990 2021-10-20T23:29:05.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb840ae910 con 0x7fcb840b5990 2021-10-20T23:29:05.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb7a7fc700 1 -- 172.21.15.12:0/2059211543 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb74010c40 con 0x7fcb840b5990 2021-10-20T23:29:05.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb840ad620 con 0x7fcb840b5990 2021-10-20T23:29:05.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.416+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb84141d50 con 0x7fcb840b5990 2021-10-20T23:29:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.420+0000 7fcb7a7fc700 1 -- 172.21.15.12:0/2059211543 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcb74026430 con 0x7fcb840b5990 2021-10-20T23:29:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.420+0000 7fcb7a7fc700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb6c053580 0x7fcb6c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.420+0000 7fcb7a7fc700 1 -- 172.21.15.12:0/2059211543 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fcb7406c640 con 0x7fcb840b5990 2021-10-20T23:29:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.420+0000 7fcb89493700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb6c053580 0x7fcb6c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.420+0000 7fcb89493700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb6c053580 0x7fcb6c055a40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fcb8001a000 tx=0x7fcb80014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.424+0000 7fcb7a7fc700 1 -- 172.21.15.12:0/2059211543 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcb740438c0 con 0x7fcb840b5990 2021-10-20T23:29:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.556+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcb840aec90 con 0x7fcb840b5990 2021-10-20T23:29:05.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb7a7fc700 1 -- 172.21.15.12:0/2059211543 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcb74046ee0 con 0x7fcb840b5990 2021-10-20T23:29:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb6c053580 msgr2=0x7fcb6c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb8b6f7700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb6c053580 0x7fcb6c055a40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fcb8001a000 tx=0x7fcb80014000).stop 2021-10-20T23:29:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb840b5990 msgr2=0x7fcb84141ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb8b6f7700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb840b5990 0x7fcb84141ee0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fcb7400c000 tx=0x7fcb74006df0).stop 2021-10-20T23:29:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 shutdown_connections 2021-10-20T23:29:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb8b6f7700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb6c053580 0x7fcb6c055a40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb8b6f7700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb840b6560 0x7fcb84127250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb8b6f7700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb840b5990 0x7fcb84141ee0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.564+0000 7fcb8b6f7700 1 --2- 172.21.15.12:0/2059211543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb8405fc00 0x7fcb841429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.568+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 >> 172.21.15.12:0/2059211543 conn(0x7fcb840623a0 msgr2=0x7fcb840b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:05.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.568+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 shutdown_connections 2021-10-20T23:29:05.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.568+0000 7fcb8b6f7700 1 -- 172.21.15.12:0/2059211543 wait complete. 2021-10-20T23:29:05.596 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:29:05.597 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:05.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:05.631 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:05.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:05.674 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:29:05.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:05.675 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:05.675 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:05.700 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:29:05.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:29:05.701 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:29:05.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:05.702 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:05.703 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:05.710 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:29:05.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:29:05.711 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:29:05.712 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:29:05.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 Processor -- start 2021-10-20T23:29:05.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 -- start start 2021-10-20T23:29:05.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 0x7f06f80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f06f81483a0 0x7f06f80b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f80b0350 con 0x7f06f80a70c0 2021-10-20T23:29:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80a90c0 con 0x7f06f81483a0 2021-10-20T23:29:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80b05f0 con 0x7f06f80b1db0 2021-10-20T23:29:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06f7fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f06f80a70c0 0x7f06f8144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43604/0 (socket says 172.21.15.12:43604) 2021-10-20T23:29:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06eeffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f06f81483a0 0x7f06f80b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06f7fff700 1 -- 172.21.15.12:0/2416999719 learned_addr learned my addr 172.21.15.12:0/2416999719 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:05.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06f77fe700 1 --2- 172.21.15.12:0/2416999719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 0x7f06f80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06f6ffd700 1 -- 172.21.15.12:0/2416999719 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324161289 0 0) 0x7f06f80b0350 con 0x7f06f80a70c0 2021-10-20T23:29:05.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06f6ffd700 1 -- 172.21.15.12:0/2416999719 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d8003260 con 0x7f06f80a70c0 2021-10-20T23:29:05.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06eeffd700 1 -- 172.21.15.12:0/2416999719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 msgr2=0x7f06f80b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:05.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06eeffd700 1 --2- 172.21.15.12:0/2416999719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 0x7f06f80b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06eeffd700 1 -- 172.21.15.12:0/2416999719 >> v1:172.21.15.12:6789/0 conn(0x7f06f80a70c0 legacy=0x7f06f8144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06eeffd700 1 -- 172.21.15.12:0/2416999719 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80b0890 con 0x7f06f81483a0 2021-10-20T23:29:05.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06eeffd700 1 --2- 172.21.15.12:0/2416999719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f81483a0 0x7f06f80b2190 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f06e0002f70 tx=0x7f06e0006df0).ready entity=mon.0 client_cookie=cc99b3744b459de3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06f6ffd700 1 -- 172.21.15.12:0/2416999719 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e000d4a0 con 0x7f06f81483a0 2021-10-20T23:29:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06f6ffd700 1 -- 172.21.15.12:0/2416999719 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0000e90 con 0x7f06f81483a0 2021-10-20T23:29:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06f6ffd700 1 -- 172.21.15.12:0/2416999719 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e000d7f0 con 0x7f06f81483a0 2021-10-20T23:29:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 -- 172.21.15.12:0/2416999719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f81483a0 msgr2=0x7f06f80b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 --2- 172.21.15.12:0/2416999719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f81483a0 0x7f06f80b2190 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f06e0002f70 tx=0x7f06e0006df0).stop 2021-10-20T23:29:05.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 -- 172.21.15.12:0/2416999719 shutdown_connections 2021-10-20T23:29:05.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 --2- 172.21.15.12:0/2416999719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f81483a0 0x7f06f80b2190 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 --2- 172.21.15.12:0/2416999719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 0x7f06f80b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 -- 172.21.15.12:0/2416999719 >> 172.21.15.12:0/2416999719 conn(0x7f06f805f6b0 msgr2=0x7f06f805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 -- 172.21.15.12:0/2416999719 shutdown_connections 2021-10-20T23:29:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.812+0000 7f06fe132700 1 -- 172.21.15.12:0/2416999719 wait complete. 2021-10-20T23:29:05.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.816+0000 7f06fe132700 1 Processor -- start 2021-10-20T23:29:05.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.816+0000 7f06fe132700 1 -- start start 2021-10-20T23:29:05.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.816+0000 7f06fe132700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80a70c0 0x7f06f8064520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.816+0000 7f06fe132700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 0x7f06f8144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.816+0000 7f06fe132700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f81483a0 0x7f06f81567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06fe132700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f8065a90 con 0x7f06f80a70c0 2021-10-20T23:29:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06fe132700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f811d280 con 0x7f06f81483a0 2021-10-20T23:29:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06fe132700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f811d520 con 0x7f06f80b1db0 2021-10-20T23:29:05.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80a70c0 0x7f06f8064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80a70c0 0x7f06f8064520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45012/0 (socket says 172.21.15.12:45012) 2021-10-20T23:29:05.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f77fe700 1 -- 172.21.15.12:0/4051588337 learned_addr learned my addr 172.21.15.12:0/4051588337 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06eeffd700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 0x7f06f8144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f7fff700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f81483a0 0x7f06f81567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f77fe700 1 -- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 msgr2=0x7f06f8144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f77fe700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 0x7f06f8144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f77fe700 1 -- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f81483a0 msgr2=0x7f06f81567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f77fe700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f81483a0 0x7f06f81567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f77fe700 1 -- 172.21.15.12:0/4051588337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e000b180 con 0x7f06f80a70c0 2021-10-20T23:29:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f77fe700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80a70c0 0x7f06f8064520 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f06e800c000 tx=0x7f06e8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f57fa700 1 -- 172.21.15.12:0/4051588337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e8010780 con 0x7f06f80a70c0 2021-10-20T23:29:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f57fa700 1 -- 172.21.15.12:0/4051588337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e80108e0 con 0x7f06f80a70c0 2021-10-20T23:29:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f57fa700 1 -- 172.21.15.12:0/4051588337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e8010c40 con 0x7f06f80a70c0 2021-10-20T23:29:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f811d7c0 con 0x7f06f80a70c0 2021-10-20T23:29:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f8144d90 con 0x7f06f80a70c0 2021-10-20T23:29:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f80b0b30 con 0x7f06f80a70c0 2021-10-20T23:29:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f57fa700 1 -- 172.21.15.12:0/4051588337 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f06e801c460 con 0x7f06f80a70c0 2021-10-20T23:29:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f57fa700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06dc053610 0x7f06dc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06f57fa700 1 -- 172.21.15.12:0/4051588337 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f06e806bd40 con 0x7f06f80a70c0 2021-10-20T23:29:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.820+0000 7f06eeffd700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06dc053610 0x7f06dc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.824+0000 7f06eeffd700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06dc053610 0x7f06dc055ad0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f06e0018000 tx=0x7f06e0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.828+0000 7f06f57fa700 1 -- 172.21.15.12:0/4051588337 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06e8042fc0 con 0x7f06f80a70c0 2021-10-20T23:29:05.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.956+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f06f8057350 con 0x7f06f80a70c0 2021-10-20T23:29:05.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06f57fa700 1 -- 172.21.15.12:0/4051588337 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+29227 (secure 0 0 0) 0x7f06e80465e0 con 0x7f06f80a70c0 2021-10-20T23:29:05.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:05.973 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:29:05.973 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 145, 2021-10-20T23:29:05.973 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:29:05.973 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:29:05.974 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:29:03.253274+0000", 2021-10-20T23:29:05.974 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:29:05.974 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:29:05.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:29:05.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:29:05.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:29:05.975 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:29:05.975 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:29:05.975 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:29:05.976 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:29:05.976 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:05.976 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:29:05.976 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:29:05.976 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:29:05.977 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:29:05.977 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:29:05.977 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 26, 2021-10-20T23:29:05.977 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:29:05.978 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:29:05.978 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:29:05.978 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:29:05.978 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:29:05.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:05.979 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:29:05.979 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:29:05.979 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:29:05.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:05.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:05.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:05.980 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:05.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:05.980 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:05.981 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:05.981 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:05.981 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:29:05.982 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:29:05.982 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:29:05.982 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:29:05.982 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:29:05.983 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:05.983 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:05.983 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:05.983 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:05.984 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:05.984 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:05.984 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:05.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:05.984 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:29:05.985 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:05.985 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:05.985 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:05.985 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:05.985 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:05.986 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:05.986 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:05.986 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:05.986 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:05.987 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:05.987 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:05.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:05.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:05.987 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:05.988 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:05.988 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:05.988 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:05.988 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:05.988 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:05.989 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:05.989 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:05.989 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:05.989 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:05.989 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:05.990 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:05.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:05.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:05.990 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:05.991 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:05.991 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:05.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:05.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:05.991 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:05.992 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:05.992 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:05.992 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:05.992 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:05.992 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:05.993 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:29:05.993 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:29:05.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:05.993 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:05.994 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:29:05.994 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:05.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:05.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:05.994 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:29:05.995 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:29:05.995 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:29:05.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:05.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:05.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:05.996 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:05.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:05.996 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:05.996 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:05.996 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:05.997 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:29:05.997 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:29:05.997 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:29:05.997 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:29:05.997 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:29:05.998 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:05.998 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:05.998 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:05.998 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:05.999 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:05.999 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:05.999 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:05.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:05.999 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:29:06.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:06.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:06.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:06.000 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:06.000 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:06.001 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:06.001 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:06.001 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:06.001 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:06.002 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:06.002 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:06.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:06.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:06.002 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:06.003 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:06.003 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:06.003 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:06.003 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:06.004 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:06.004 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:06.004 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:06.004 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:06.004 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:06.005 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:06.005 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:06.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:06.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.005 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:06.006 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:06.006 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:06.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:06.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:06.007 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:06.007 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:06.007 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:06.007 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:06.007 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:06.008 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:06.008 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:29:06.008 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:06.008 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:29:06.008 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.009 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.009 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:06.009 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:29:06.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.010 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:29:06.010 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:29:06.010 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:06.010 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:06.010 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:06.011 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:06.011 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:06.011 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:06.011 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:06.012 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 139, 2021-10-20T23:29:06.012 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:06.012 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:06.012 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:06.012 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.013 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:29:06.013 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:06.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.014 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:29:06.014 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:06.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.015 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.015 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:06.015 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.016 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:29:06.016 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:06.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.017 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:29:06.017 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:06.017 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.018 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.018 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:06.018 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.019 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:29:06.019 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:06.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.020 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:29:06.020 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:06.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.021 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.021 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:06.021 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.022 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:29:06.022 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:06.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.023 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:29:06.023 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:06.023 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.023 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.024 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:29:06.024 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:29:06.024 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:29:06.025 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:29:06.025 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:06.025 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:06.025 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:06.025 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.026 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:29:06.026 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:29:06.027 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:06.027 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:06.027 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:06.027 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:06.028 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:06.028 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:06.028 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:06.028 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:29:06.028 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:06.029 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:06.029 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:06.029 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.030 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:29:06.030 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:06.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.031 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:29:06.031 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:06.031 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.032 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.032 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:06.032 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.033 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:29:06.033 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:06.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.034 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:29:06.034 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:06.035 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.035 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.035 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:06.035 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.036 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:29:06.036 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:06.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.037 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.037 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:29:06.037 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:06.038 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.038 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.038 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:06.038 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.039 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:29:06.039 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:06.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.040 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:29:06.040 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:06.040 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.041 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.041 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:29:06.041 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:29:06.042 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:29:06.042 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:29:06.042 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:06.042 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:06.042 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:06.043 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.043 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:29:06.044 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:29:06.044 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:06.044 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:06.044 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:06.045 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:06.045 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:06.045 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:06.045 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:06.045 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:29:06.046 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:06.046 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:06.046 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:06.046 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.047 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:29:06.047 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:06.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.048 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:29:06.048 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:06.048 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.048 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.049 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:06.049 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.050 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:29:06.050 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:06.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:29:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.052 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.052 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:06.052 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.053 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:29:06.053 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:06.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.054 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:29:06.054 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:06.055 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.055 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.055 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:06.055 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.056 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:29:06.056 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:06.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.057 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:29:06.057 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:06.058 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.058 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.058 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:29:06.058 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:29:06.059 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:29:06.059 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:29:06.059 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:06.059 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:06.059 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:06.060 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.060 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:29:06.061 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:29:06.061 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:06.061 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:06.061 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:06.061 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:06.062 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:06.062 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:06.062 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:06.062 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 139, 2021-10-20T23:29:06.062 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:06.063 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:06.063 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:06.063 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.064 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:29:06.064 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:06.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.065 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.065 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:29:06.065 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:06.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.065 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.066 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:06.066 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.067 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:29:06.067 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:06.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.067 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.068 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:29:06.068 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:06.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.068 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.069 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:06.069 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.069 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.070 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:29:06.070 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:06.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.071 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:29:06.071 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:06.071 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.071 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.072 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:06.072 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.072 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:29:06.073 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:06.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.073 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:29:06.074 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:06.074 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.074 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.074 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:29:06.075 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:29:06.075 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:29:06.075 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:29:06.075 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:06.076 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:06.076 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:06.076 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.077 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:29:06.077 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:29:06.077 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:06.077 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:06.078 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:06.078 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:06.078 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:06.078 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:06.078 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:06.079 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:29:06.079 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:06.079 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:06.079 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:06.079 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.080 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:29:06.080 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:06.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.081 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:29:06.081 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:06.081 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.082 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.082 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:06.082 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.083 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:29:06.083 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:06.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.084 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:29:06.084 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:06.084 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.085 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.085 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:06.085 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.086 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:29:06.086 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:06.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.087 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:29:06.087 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:06.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.088 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.088 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:06.088 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.089 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:29:06.089 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:06.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.090 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.090 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:29:06.090 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:06.090 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.091 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.091 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:29:06.091 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:29:06.091 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:29:06.092 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:29:06.092 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:06.092 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:06.092 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:06.092 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.093 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:29:06.093 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:29:06.094 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:06.094 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:06.094 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:06.094 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:06.094 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:06.095 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:06.095 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:06.095 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 132, 2021-10-20T23:29:06.095 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:06.095 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:06.096 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:06.096 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.097 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:29:06.097 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:06.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.098 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:29:06.098 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:06.098 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.098 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.099 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:06.099 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.100 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:29:06.100 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:06.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.101 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:29:06.101 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:06.101 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.101 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.102 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:06.102 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.103 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:29:06.103 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:06.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.104 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:29:06.104 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:06.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.104 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.105 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:06.105 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.106 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:29:06.106 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:06.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.107 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:29:06.107 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:06.107 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.107 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.108 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:29:06.108 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:29:06.108 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:29:06.108 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:29:06.109 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:06.109 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:06.109 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:06.109 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.110 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:29:06.110 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:29:06.110 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:06.110 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:06.111 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:06.111 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:06.111 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:06.111 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:06.112 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:06.112 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:29:06.112 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:06.112 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:06.112 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:06.113 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.113 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:29:06.113 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:06.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.114 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:29:06.114 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:06.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.115 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.115 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:06.115 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.116 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:29:06.116 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:06.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.117 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:29:06.117 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:06.117 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.118 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.118 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:06.118 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.119 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:29:06.119 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:06.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.120 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:29:06.120 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:06.120 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.121 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.121 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:06.121 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.122 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:29:06.122 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:06.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.123 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:29:06.123 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:06.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.124 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.124 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:29:06.124 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:29:06.124 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:29:06.125 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:29:06.125 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:06.125 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:06.125 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:06.125 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.126 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:29:06.126 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:29:06.126 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:06.127 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:06.127 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:06.127 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:06.127 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:06.128 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:06.128 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:06.128 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 140, 2021-10-20T23:29:06.128 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:06.128 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:06.129 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:06.129 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.129 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:29:06.130 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:06.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.130 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:29:06.131 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:06.131 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.131 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.132 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:06.132 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.132 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:29:06.133 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:06.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.133 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:29:06.134 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:06.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.134 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.135 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:06.135 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.136 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:29:06.136 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:06.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.137 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:29:06.137 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:06.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.137 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.138 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:06.138 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:06.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:06.139 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:29:06.139 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:06.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:06.140 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:29:06.140 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:06.140 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.140 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.141 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:29:06.141 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:29:06.141 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:29:06.141 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:29:06.141 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:06.142 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:06.142 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:06.142 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:06.142 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.142 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:06.143 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:29:06.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.143 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:29:06.143 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:06.143 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:06.144 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:06.144 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:06.144 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:06.144 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:29:06.145 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:06.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.145 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:29:06.145 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:06.146 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:06.146 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:06.146 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:06.146 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:06.146 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:29:06.147 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:06.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.147 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:29:06.148 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:06.148 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:06.148 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:06.148 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:06.148 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:06.149 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:29:06.149 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:06.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.150 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:29:06.150 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:06.150 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:06.150 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:06.150 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:06.151 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:06.151 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:29:06.151 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:06.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.152 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:29:06.152 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:06.152 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:06.152 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:06.152 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:06.153 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:06.153 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:29:06.153 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:06.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.154 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:29:06.154 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:06.154 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:06.154 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:06.155 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:06.155 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:06.155 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:29:06.155 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:06.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.156 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:29:06.156 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:06.156 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:06.156 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:06.157 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:06.157 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:06.157 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:29:06.157 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:06.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:06.158 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:29:06.158 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:06.158 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:06.159 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:06.159 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:06.159 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:06.159 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:29:06.159 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:06.160 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.160 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:06.160 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:29:06.160 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:29:06.161 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:29:06.161 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:29:06.161 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:29:06.161 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.31:6835/546930471": "2021-10-21T23:28:59.860970+0000", 2021-10-20T23:29:06.162 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.31:6834/546930471": "2021-10-21T23:28:59.860970+0000" 2021-10-20T23:29:06.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.162 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:29:06.162 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:29:06.163 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:29:06.163 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:29:06.163 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:29:06.163 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:29:06.163 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:29:06.164 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:29:06.164 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:29:06.164 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:29:06.164 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:29:06.164 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:29:06.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:29:06.165 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:29:06.165 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:29:06.166 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:29:06.166 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:29:06.166 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:29:06.166 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:29:06.166 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:06.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:06.167 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:29:06.167 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:29:06.167 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:29:06.168 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:29:06.168 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:29:06.168 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:29:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06dc053610 msgr2=0x7f06dc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06dc053610 0x7f06dc055ad0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f06e0018000 tx=0x7f06e0014000).stop 2021-10-20T23:29:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80a70c0 msgr2=0x7f06f8064520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80a70c0 0x7f06f8064520 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f06e800c000 tx=0x7f06e8006df0).stop 2021-10-20T23:29:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 shutdown_connections 2021-10-20T23:29:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f06dc053610 0x7f06dc055ad0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f81483a0 0x7f06f81567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80b1db0 0x7f06f8144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 --2- 172.21.15.12:0/4051588337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80a70c0 0x7f06f8064520 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 >> 172.21.15.12:0/4051588337 conn(0x7f06f805f6b0 msgr2=0x7f06f8147000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 shutdown_connections 2021-10-20T23:29:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:05.960+0000 7f06fe132700 1 -- 172.21.15.12:0/4051588337 wait complete. 2021-10-20T23:29:06.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:06.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57c0f3a700 1 Processor -- start 2021-10-20T23:29:06.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57c0f3a700 1 -- start start 2021-10-20T23:29:06.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57c0f3a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57bc0b6580 0x7f57bc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57c0f3a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc0b43c0 0x7f57bc0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57c0f3a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57bc1440b0 con 0x7f57bc061d30 2021-10-20T23:29:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57c0f3a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57bc0b6e50 con 0x7f57bc0b6580 2021-10-20T23:29:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57c0f3a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc143b70 con 0x7f57bc0b43c0 2021-10-20T23:29:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57bad9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f57bc061d30 0x7f57bc1466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43616/0 (socket says 172.21.15.12:43616) 2021-10-20T23:29:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57bad9d700 1 -- 172.21.15.12:0/3005136417 learned_addr learned my addr 172.21.15.12:0/3005136417 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:06.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57ba59c700 1 --2- 172.21.15.12:0/3005136417 >> v2:172.21.15.31:3300/0 conn(0x7f57bc0b6580 0x7f57bc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57b1d9b700 1 --2- 172.21.15.12:0/3005136417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc0b43c0 0x7f57bc0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57b9d9b700 1 -- 172.21.15.12:0/3005136417 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895314064 0 0) 0x7f57bc1440b0 con 0x7f57bc061d30 2021-10-20T23:29:06.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57b9d9b700 1 -- 172.21.15.12:0/3005136417 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f579c003260 con 0x7f57bc061d30 2021-10-20T23:29:06.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57ba59c700 1 -- 172.21.15.12:0/3005136417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc0b43c0 msgr2=0x7f57bc0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:06.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57ba59c700 1 --2- 172.21.15.12:0/3005136417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc0b43c0 0x7f57bc0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57ba59c700 1 -- 172.21.15.12:0/3005136417 >> v1:172.21.15.12:6789/0 conn(0x7f57bc061d30 legacy=0x7f57bc1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57ba59c700 1 -- 172.21.15.12:0/3005136417 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc143e10 con 0x7f57bc0b6580 2021-10-20T23:29:06.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57ba59c700 1 --2- 172.21.15.12:0/3005136417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b6580 0x7f57bc0b5bf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f57ac002f70 tx=0x7f57ac006df0).ready entity=mon.1 client_cookie=b8a5c14731d43fc3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57b9d9b700 1 -- 172.21.15.12:0/3005136417 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57ac00d4a0 con 0x7f57bc0b6580 2021-10-20T23:29:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57b9d9b700 1 -- 172.21.15.12:0/3005136417 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac000e90 con 0x7f57bc0b6580 2021-10-20T23:29:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.271+0000 7f57b9d9b700 1 -- 172.21.15.12:0/3005136417 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57ac00d7f0 con 0x7f57bc0b6580 2021-10-20T23:29:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 -- 172.21.15.12:0/3005136417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b6580 msgr2=0x7f57bc0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 --2- 172.21.15.12:0/3005136417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b6580 0x7f57bc0b5bf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f57ac002f70 tx=0x7f57ac006df0).stop 2021-10-20T23:29:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 -- 172.21.15.12:0/3005136417 shutdown_connections 2021-10-20T23:29:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 --2- 172.21.15.12:0/3005136417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc0b43c0 0x7f57bc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 --2- 172.21.15.12:0/3005136417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b6580 0x7f57bc0b5bf0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 -- 172.21.15.12:0/3005136417 >> 172.21.15.12:0/3005136417 conn(0x7f57bc05c490 msgr2=0x7f57bc05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:06.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 -- 172.21.15.12:0/3005136417 shutdown_connections 2021-10-20T23:29:06.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 -- 172.21.15.12:0/3005136417 wait complete. 2021-10-20T23:29:06.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 Processor -- start 2021-10-20T23:29:06.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 -- start start 2021-10-20T23:29:06.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc061d30 0x7f57bc147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57bc0b43c0 0x7f57bc0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b6580 0x7f57bc1402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0b26a0 con 0x7f57bc0b43c0 2021-10-20T23:29:06.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0b28d0 con 0x7f57bc0b6580 2021-10-20T23:29:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57c0f3a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0b2b70 con 0x7f57bc061d30 2021-10-20T23:29:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57b1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57bc0b43c0 0x7f57bc0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57ba59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc061d30 0x7f57bc147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57b1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57bc0b43c0 0x7f57bc0b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45028/0 (socket says 172.21.15.12:45028) 2021-10-20T23:29:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57b1d9b700 1 -- 172.21.15.12:0/731211227 learned_addr learned my addr 172.21.15.12:0/731211227 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.275+0000 7f57bad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b6580 0x7f57bc1402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57ba59c700 1 -- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b6580 msgr2=0x7f57bc1402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57ba59c700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b6580 0x7f57bc1402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57ba59c700 1 -- 172.21.15.12:0/731211227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57bc0b43c0 msgr2=0x7f57bc0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57ba59c700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57bc0b43c0 0x7f57bc0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57ba59c700 1 -- 172.21.15.12:0/731211227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac00b180 con 0x7f57bc061d30 2021-10-20T23:29:06.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57ba59c700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc061d30 0x7f57bc147870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f57ac002f70 tx=0x7f57ac014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:06.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57b3fff700 1 -- 172.21.15.12:0/731211227 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57ac012930 con 0x7f57bc061d30 2021-10-20T23:29:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57b3fff700 1 -- 172.21.15.12:0/731211227 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac012a90 con 0x7f57bc061d30 2021-10-20T23:29:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57b3fff700 1 -- 172.21.15.12:0/731211227 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57ac012df0 con 0x7f57bc061d30 2021-10-20T23:29:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57bc0b2e10 con 0x7f57bc061d30 2021-10-20T23:29:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc148230 con 0x7f57bc061d30 2021-10-20T23:29:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57bc155580 con 0x7f57bc061d30 2021-10-20T23:29:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57b3fff700 1 -- 172.21.15.12:0/731211227 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f57ac01c070 con 0x7f57bc061d30 2021-10-20T23:29:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57b3fff700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57a00536a0 0x7f57a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57b3fff700 1 -- 172.21.15.12:0/731211227 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f57ac06c170 con 0x7f57bc061d30 2021-10-20T23:29:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.279+0000 7f57b1d9b700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57a00536a0 0x7f57a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.283+0000 7f57b1d9b700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57a00536a0 0x7f57a0055b60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f57a400b000 tx=0x7f57a4006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.283+0000 7f57b3fff700 1 -- 172.21.15.12:0/731211227 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f57ac043460 con 0x7f57bc061d30 2021-10-20T23:29:06.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.451+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57bc0615f0 con 0x7f57bc061d30 2021-10-20T23:29:06.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.451+0000 7f57b3fff700 1 -- 172.21.15.12:0/731211227 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f57ac019020 con 0x7f57bc061d30 2021-10-20T23:29:06.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:06.467 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3304581862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3304581862},{"type":"v1","addr":"172.21.15.12:6835","nonce":3304581862}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/360437153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":360437153},{"type":"v1","addr":"172.21.15.12:6833","nonce":360437153}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3522361298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3522361298},{"type":"v1","addr":"172.21.15.31:6835","nonce":3522361298}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[]} 2021-10-20T23:29:06.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57a00536a0 msgr2=0x7f57a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57a00536a0 0x7f57a0055b60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f57a400b000 tx=0x7f57a4006df0).stop 2021-10-20T23:29:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc061d30 msgr2=0x7f57bc147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc061d30 0x7f57bc147870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f57ac002f70 tx=0x7f57ac014000).stop 2021-10-20T23:29:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 shutdown_connections 2021-10-20T23:29:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f57a00536a0 0x7f57a0055b60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b6580 0x7f57bc1402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57bc0b43c0 0x7f57bc0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 --2- 172.21.15.12:0/731211227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57bc061d30 0x7f57bc147870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 >> 172.21.15.12:0/731211227 conn(0x7f57bc05c490 msgr2=0x7f57bc145240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 shutdown_connections 2021-10-20T23:29:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.455+0000 7f57c0f3a700 1 -- 172.21.15.12:0/731211227 wait complete. 2021-10-20T23:29:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 74 2021-10-20T23:29:06.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:06.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee54a65700 1 Processor -- start 2021-10-20T23:29:06.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee54a65700 1 -- start start 2021-10-20T23:29:06.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee54a65700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500b0010 0x7fee500a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee54a65700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee500afbd0 0x7fee500a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee54a65700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee500a70c0 con 0x7fee500b2580 2021-10-20T23:29:06.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee54a65700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee500a72f0 con 0x7fee500afbd0 2021-10-20T23:29:06.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee54a65700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500a7590 con 0x7fee500b0010 2021-10-20T23:29:06.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fee500b2580 0x7fee5014ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43628/0 (socket says 172.21.15.12:43628) 2021-10-20T23:29:06.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4f7fe700 1 -- 172.21.15.12:0/2579826902 learned_addr learned my addr 172.21.15.12:0/2579826902 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:06.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4ffff700 1 --2- 172.21.15.12:0/2579826902 >> v2:172.21.15.31:3300/0 conn(0x7fee500afbd0 0x7fee500a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4effd700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500b0010 0x7fee500a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789765922 0 0) 0x7fee500a70c0 con 0x7fee500b2580 2021-10-20T23:29:06.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee3c003260 con 0x7fee500b2580 2021-10-20T23:29:06.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1930666177 0 0) 0x7fee3c003260 con 0x7fee500b2580 2021-10-20T23:29:06.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500b0010 msgr2=0x7fee500a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:06.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500b0010 0x7fee500a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 >> v2:172.21.15.31:3300/0 conn(0x7fee500afbd0 msgr2=0x7fee500a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:06.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 --2- 172.21.15.12:0/2579826902 >> v2:172.21.15.31:3300/0 conn(0x7fee500afbd0 0x7fee500a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500a7830 con 0x7fee500b2580 2021-10-20T23:29:06.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fee44001660 con 0x7fee500b2580 2021-10-20T23:29:06.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 >> v1:172.21.15.12:6789/0 conn(0x7fee500b2580 legacy=0x7fee5014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500b0010 0x7fee3c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee3c003c80 0x7fee3c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3c0049f0 0x7fee3c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee500a72f0 con 0x7fee3c003c80 2021-10-20T23:29:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee500a7590 con 0x7fee3c0049f0 2021-10-20T23:29:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c00b750 con 0x7fee500b0010 2021-10-20T23:29:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4effd700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee3c003c80 0x7fee3c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4f7fe700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500b0010 0x7fee3c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4ffff700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3c0049f0 0x7fee3c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4effd700 1 -- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500b0010 msgr2=0x7fee3c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4effd700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500b0010 0x7fee3c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4effd700 1 -- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3c0049f0 msgr2=0x7fee3c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4effd700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3c0049f0 0x7fee3c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4effd700 1 -- 172.21.15.12:0/2579826902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c003260 con 0x7fee3c003c80 2021-10-20T23:29:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.575+0000 7fee4effd700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee3c003c80 0x7fee3c004500 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fee3c0054d0 tx=0x7fee40006df0).ready entity=mon.0 client_cookie=65a5f3d2cdbee2db server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4000e830 con 0x7fee3c003c80 2021-10-20T23:29:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4000be90 con 0x7fee3c003c80 2021-10-20T23:29:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee4e7fc700 1 -- 172.21.15.12:0/2579826902 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4000eb80 con 0x7fee3c003c80 2021-10-20T23:29:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee54a65700 1 -- 172.21.15.12:0/2579826902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee3c003c80 msgr2=0x7fee3c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee54a65700 1 --2- 172.21.15.12:0/2579826902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee3c003c80 0x7fee3c004500 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fee3c0054d0 tx=0x7fee40006df0).stop 2021-10-20T23:29:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee4ffff700 1 -- 172.21.15.12:0/2579826902 reap_dead start 2021-10-20T23:29:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee54a65700 1 -- 172.21.15.12:0/2579826902 shutdown_connections 2021-10-20T23:29:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee54a65700 1 -- 172.21.15.12:0/2579826902 >> 172.21.15.12:0/2579826902 conn(0x7fee50060180 msgr2=0x7fee500b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:06.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee54a65700 1 -- 172.21.15.12:0/2579826902 shutdown_connections 2021-10-20T23:29:06.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee54a65700 1 -- 172.21.15.12:0/2579826902 wait complete. 2021-10-20T23:29:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee54a65700 1 Processor -- start 2021-10-20T23:29:06.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.579+0000 7fee54a65700 1 -- start start 2021-10-20T23:29:06.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee54a65700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500ae6a0 0x7fee50066d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee54a65700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee500ac240 0x7fee50156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee54a65700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee50156b20 0x7fee500647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee54a65700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee500666b0 con 0x7fee50156b20 2021-10-20T23:29:06.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee54a65700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee500aea80 con 0x7fee500ac240 2021-10-20T23:29:06.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee54a65700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5015a790 con 0x7fee500ae6a0 2021-10-20T23:29:06.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee50156b20 0x7fee500647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee50156b20 0x7fee500647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45048/0 (socket says 172.21.15.12:45048) 2021-10-20T23:29:06.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4ffff700 1 -- 172.21.15.12:0/964362051 learned_addr learned my addr 172.21.15.12:0/964362051 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:06.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4effd700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee500ac240 0x7fee50156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4f7fe700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500ae6a0 0x7fee50066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4ffff700 1 -- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500ae6a0 msgr2=0x7fee50066d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4ffff700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500ae6a0 0x7fee50066d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4ffff700 1 -- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee500ac240 msgr2=0x7fee50156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4ffff700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee500ac240 0x7fee50156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4ffff700 1 -- 172.21.15.12:0/964362051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500668e0 con 0x7fee50156b20 2021-10-20T23:29:06.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4effd700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee500ac240 0x7fee50156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:06.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4ffff700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee50156b20 0x7fee500647a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fee4800b000 tx=0x7fee480091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:06.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4cff9700 1 -- 172.21.15.12:0/964362051 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee48019070 con 0x7fee50156b20 2021-10-20T23:29:06.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4cff9700 1 -- 172.21.15.12:0/964362051 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800f910 con 0x7fee50156b20 2021-10-20T23:29:06.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee4cff9700 1 -- 172.21.15.12:0/964362051 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4800fc70 con 0x7fee50156b20 2021-10-20T23:29:06.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee500abf20 con 0x7fee50156b20 2021-10-20T23:29:06.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee50067310 con 0x7fee50156b20 2021-10-20T23:29:06.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.587+0000 7fee4cff9700 1 -- 172.21.15.12:0/964362051 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee48014440 con 0x7fee50156b20 2021-10-20T23:29:06.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.583+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee50066a70 con 0x7fee50156b20 2021-10-20T23:29:06.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.587+0000 7fee4cff9700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee300536d0 0x7fee30055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.587+0000 7fee4cff9700 1 -- 172.21.15.12:0/964362051 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fee4806c1f0 con 0x7fee50156b20 2021-10-20T23:29:06.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.587+0000 7fee4f7fe700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee300536d0 0x7fee30055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.587+0000 7fee4f7fe700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee300536d0 0x7fee30055b90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fee44005000 tx=0x7fee44009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:06.616 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.595+0000 7fee4cff9700 1 -- 172.21.15.12:0/964362051 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee48043470 con 0x7fee50156b20 2021-10-20T23:29:06.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee50057350 con 0x7fee50156b20 2021-10-20T23:29:06.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee4cff9700 1 -- 172.21.15.12:0/964362051 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+1559 (secure 0 0 0) 0x7fee48046a90 con 0x7fee50156b20 2021-10-20T23:29:06.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:06.774 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3304581862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3304581862},{"type":"v1","addr":"172.21.15.12:6835","nonce":3304581862}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/360437153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":360437153},{"type":"v1","addr":"172.21.15.12:6833","nonce":360437153}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3522361298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3522361298},{"type":"v1","addr":"172.21.15.31:6835","nonce":3522361298}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[]} 2021-10-20T23:29:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee300536d0 msgr2=0x7fee30055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee300536d0 0x7fee30055b90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fee44005000 tx=0x7fee44009040).stop 2021-10-20T23:29:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee50156b20 msgr2=0x7fee500647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee50156b20 0x7fee500647a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fee4800b000 tx=0x7fee480091d0).stop 2021-10-20T23:29:06.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 shutdown_connections 2021-10-20T23:29:06.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fee300536d0 0x7fee30055b90 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee50156b20 0x7fee500647a0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee500ac240 0x7fee50156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 --2- 172.21.15.12:0/964362051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee500ae6a0 0x7fee50066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 >> 172.21.15.12:0/964362051 conn(0x7fee50060180 msgr2=0x7fee50146720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:06.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 shutdown_connections 2021-10-20T23:29:06.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.759+0000 7fee54a65700 1 -- 172.21.15.12:0/964362051 wait complete. 2021-10-20T23:29:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 74 2021-10-20T23:29:06.786 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:29:06.787 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:29:06.787 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:29:06.787 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:29:06.788 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:29:06.788 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:29:06.788 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:29:06.789 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:29:06.789 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:29:06.789 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:29:06.790 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:29:06.790 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:29:06.798 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:29:06.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:29:06.801 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:29:06.801 DEBUG:teuthology.parallel:result is None 2021-10-20T23:29:06.803 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:29:06.803 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:29:06.806 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:29:06.806 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:29:06.807 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:29:06.808 DEBUG:teuthology.parallel:result is None 2021-10-20T23:29:06.810 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:29:06.810 DEBUG:teuthology.parallel:result is None 2021-10-20T23:29:06.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:29:06.865 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:29:06.874 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:29:06.884 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:29:06.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c8e5c700 1 Processor -- start 2021-10-20T23:29:06.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c8e5c700 1 -- start start 2021-10-20T23:29:06.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c8e5c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4c4066ff0 0x7ff4c40ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c8e5c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4c40affd0 0x7ff4c40aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c8e5c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40673d0 con 0x7ff4c40ad1b0 2021-10-20T23:29:06.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c8e5c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c40b1650 con 0x7ff4c40affd0 2021-10-20T23:29:06.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c8e5c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c40b18f0 con 0x7ff4c4066ff0 2021-10-20T23:29:06.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4c40affd0 0x7ff4c40aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4c40affd0 0x7ff4c40aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45082/0 (socket says 172.21.15.12:45082) 2021-10-20T23:29:06.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c2d9d700 1 -- 172.21.15.12:0/1182883061 learned_addr learned my addr 172.21.15.12:0/1182883061 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:06.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c259c700 1 --2- 172.21.15.12:0/1182883061 >> v2:172.21.15.31:3300/0 conn(0x7ff4c4066ff0 0x7ff4c40ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c2d9d700 1 -- 172.21.15.12:0/1182883061 >> v2:172.21.15.31:3300/0 conn(0x7ff4c4066ff0 msgr2=0x7ff4c40ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:06.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c2d9d700 1 --2- 172.21.15.12:0/1182883061 >> v2:172.21.15.31:3300/0 conn(0x7ff4c4066ff0 0x7ff4c40ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c2d9d700 1 -- 172.21.15.12:0/1182883061 >> v1:172.21.15.31:6789/0 conn(0x7ff4c40ad1b0 legacy=0x7ff4c41438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.899+0000 7ff4c2d9d700 1 -- 172.21.15.12:0/1182883061 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40b1b90 con 0x7ff4c40affd0 2021-10-20T23:29:06.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c2d9d700 1 --2- 172.21.15.12:0/1182883061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c40affd0 0x7ff4c40aea10 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7ff4bc0032f0 tx=0x7ff4bc009290).ready entity=mon.0 client_cookie=c35144f38bc9e1b9 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:06.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c159a700 1 -- 172.21.15.12:0/1182883061 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4bc00b870 con 0x7ff4c40affd0 2021-10-20T23:29:06.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c159a700 1 -- 172.21.15.12:0/1182883061 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc00b9d0 con 0x7ff4c40affd0 2021-10-20T23:29:06.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c159a700 1 -- 172.21.15.12:0/1182883061 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4bc00bb40 con 0x7ff4c40affd0 2021-10-20T23:29:06.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/1182883061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c40affd0 msgr2=0x7ff4c40aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 --2- 172.21.15.12:0/1182883061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c40affd0 0x7ff4c40aea10 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7ff4bc0032f0 tx=0x7ff4bc009290).stop 2021-10-20T23:29:06.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/1182883061 shutdown_connections 2021-10-20T23:29:06.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 --2- 172.21.15.12:0/1182883061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c40affd0 0x7ff4c40aea10 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 --2- 172.21.15.12:0/1182883061 >> v2:172.21.15.31:3300/0 conn(0x7ff4c4066ff0 0x7ff4c40ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/1182883061 >> 172.21.15.12:0/1182883061 conn(0x7ff4c40608d0 msgr2=0x7ff4c4060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:06.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/1182883061 shutdown_connections 2021-10-20T23:29:06.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/1182883061 wait complete. 2021-10-20T23:29:06.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 Processor -- start 2021-10-20T23:29:06.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 -- start start 2021-10-20T23:29:06.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4066ff0 0x7ff4c40ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40ad1b0 0x7ff4c4141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c40affd0 0x7ff4c4141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40a1070 con 0x7ff4c4066ff0 2021-10-20T23:29:06.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41428d0 con 0x7ff4c40ad1b0 2021-10-20T23:29:06.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c8e5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4142b70 con 0x7ff4c40affd0 2021-10-20T23:29:06.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4066ff0 0x7ff4c40ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4066ff0 0x7ff4c40ac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45084/0 (socket says 172.21.15.12:45084) 2021-10-20T23:29:06.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c259c700 1 -- 172.21.15.12:0/3538893145 learned_addr learned my addr 172.21.15.12:0/3538893145 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:06.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c2d9d700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c40affd0 0x7ff4c4141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.903+0000 7ff4c1d9b700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40ad1b0 0x7ff4c4141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4c259c700 1 -- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c40affd0 msgr2=0x7ff4c4141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4c259c700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c40affd0 0x7ff4c4141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4c259c700 1 -- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40ad1b0 msgr2=0x7ff4c4141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:06.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4c259c700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40ad1b0 0x7ff4c4141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:06.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4c259c700 1 -- 172.21.15.12:0/3538893145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc009530 con 0x7ff4c4066ff0 2021-10-20T23:29:06.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4c259c700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4066ff0 0x7ff4c40ac0a0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7ff4ac00a000 tx=0x7ff4ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:06.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4bb7fe700 1 -- 172.21.15.12:0/3538893145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ac011780 con 0x7ff4c4066ff0 2021-10-20T23:29:06.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4bb7fe700 1 -- 172.21.15.12:0/3538893145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0118e0 con 0x7ff4c4066ff0 2021-10-20T23:29:06.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c409f0e0 con 0x7ff4c4066ff0 2021-10-20T23:29:06.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4bb7fe700 1 -- 172.21.15.12:0/3538893145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ac011c40 con 0x7ff4c4066ff0 2021-10-20T23:29:06.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c40a8b70 con 0x7ff4c4066ff0 2021-10-20T23:29:06.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c4142d30 con 0x7ff4c4066ff0 2021-10-20T23:29:06.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4bb7fe700 1 -- 172.21.15.12:0/3538893145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff4ac012420 con 0x7ff4c4066ff0 2021-10-20T23:29:06.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.907+0000 7ff4bb7fe700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff4a80536a0 0x7ff4a8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:06.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.911+0000 7ff4bb7fe700 1 -- 172.21.15.12:0/3538893145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff4ac06b590 con 0x7ff4c4066ff0 2021-10-20T23:29:06.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.911+0000 7ff4c1d9b700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff4a80536a0 0x7ff4a8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:06.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.911+0000 7ff4c1d9b700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff4a80536a0 0x7ff4a8055b60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7ff4b400d000 tx=0x7ff4b4000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:06.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:06.911+0000 7ff4bb7fe700 1 -- 172.21.15.12:0/3538893145 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff4ac042810 con 0x7ff4c4066ff0 2021-10-20T23:29:07.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.051+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ff4c40aca70 con 0x7ff4c4066ff0 2021-10-20T23:29:07.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:29:07.588 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:29:07.591 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:29:07.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:29:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.983+0000 7ff4bb7fe700 1 -- 172.21.15.12:0/3538893145 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v147) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff4ac045e30 con 0x7ff4c4066ff0 2021-10-20T23:29:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff4a80536a0 msgr2=0x7ff4a8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff4a80536a0 0x7ff4a8055b60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7ff4b400d000 tx=0x7ff4b4000bc0).stop 2021-10-20T23:29:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4066ff0 msgr2=0x7ff4c40ac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4066ff0 0x7ff4c40ac0a0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7ff4ac00a000 tx=0x7ff4ac008040).stop 2021-10-20T23:29:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 shutdown_connections 2021-10-20T23:29:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff4a80536a0 0x7ff4a8055b60 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c40affd0 0x7ff4c4141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:07.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40ad1b0 0x7ff4c4141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:07.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 --2- 172.21.15.12:0/3538893145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4066ff0 0x7ff4c40ac0a0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:07.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 >> 172.21.15.12:0/3538893145 conn(0x7ff4c40608d0 msgr2=0x7ff4c4060cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:07.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 shutdown_connections 2021-10-20T23:29:07.998 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:07.987+0000 7ff4c8e5c700 1 -- 172.21.15.12:0/3538893145 wait complete. 2021-10-20T23:29:07.999 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:29:08.010 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:29:08.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:29:08.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 Processor -- start 2021-10-20T23:29:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 -- start start 2021-10-20T23:29:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60900b2580 0x7f609014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60900a70c0 con 0x7f60900a8ac0 2021-10-20T23:29:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60900a72f0 con 0x7f60900b0010 2021-10-20T23:29:08.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60900a7590 con 0x7f60900b2580 2021-10-20T23:29:08.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6094f58700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60900b2580 0x7f609014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6094f58700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60900b2580 0x7f609014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45094/0 (socket says 172.21.15.12:45094) 2021-10-20T23:29:08.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6094f58700 1 -- 172.21.15.12:0/4239033072 learned_addr learned my addr 172.21.15.12:0/4239033072 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:08.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6094f58700 1 -- 172.21.15.12:0/4239033072 >> v1:172.21.15.31:6789/0 conn(0x7f60900b0010 legacy=0x7f60900a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6094f58700 1 -- 172.21.15.12:0/4239033072 >> v1:172.21.15.12:6789/0 conn(0x7f60900a8ac0 legacy=0x7f6090151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6094f58700 1 -- 172.21.15.12:0/4239033072 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900a7830 con 0x7f60900b2580 2021-10-20T23:29:08.133 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6094f58700 1 --2- 172.21.15.12:0/4239033072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900b2580 0x7f609014ae40 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f6078002f70 tx=0x7f6078006eb0).ready entity=mon.0 client_cookie=b2a9093ea49a6c04 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:08.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f608f7fe700 1 -- 172.21.15.12:0/4239033072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f607800d660 con 0x7f60900b2580 2021-10-20T23:29:08.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f608f7fe700 1 -- 172.21.15.12:0/4239033072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6078000e90 con 0x7f60900b2580 2021-10-20T23:29:08.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f608f7fe700 1 -- 172.21.15.12:0/4239033072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f607800d9f0 con 0x7f60900b2580 2021-10-20T23:29:08.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 -- 172.21.15.12:0/4239033072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900b2580 msgr2=0x7f609014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 --2- 172.21.15.12:0/4239033072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900b2580 0x7f609014ae40 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f6078002f70 tx=0x7f6078006eb0).stop 2021-10-20T23:29:08.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 -- 172.21.15.12:0/4239033072 shutdown_connections 2021-10-20T23:29:08.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 --2- 172.21.15.12:0/4239033072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900b2580 0x7f609014ae40 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 -- 172.21.15.12:0/4239033072 >> 172.21.15.12:0/4239033072 conn(0x7f6090060180 msgr2=0x7f60900b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:08.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 -- 172.21.15.12:0/4239033072 shutdown_connections 2021-10-20T23:29:08.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.115+0000 7f6095f5a700 1 -- 172.21.15.12:0/4239033072 wait complete. 2021-10-20T23:29:08.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 Processor -- start 2021-10-20T23:29:08.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 -- start start 2021-10-20T23:29:08.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900a8ac0 0x7f60900a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60900b0010 0x7f60900ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60900b2580 0x7f60900b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6090157360 con 0x7f60900a8ac0 2021-10-20T23:29:08.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60900aa050 con 0x7f60900b0010 2021-10-20T23:29:08.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60900aa2f0 con 0x7f60900b2580 2021-10-20T23:29:08.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6094f58700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900a8ac0 0x7f60900a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f608ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60900b0010 0x7f60900ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6094f58700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900a8ac0 0x7f60900a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45104/0 (socket says 172.21.15.12:45104) 2021-10-20T23:29:08.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f608ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60900b0010 0x7f60900ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:60074/0 (socket says 172.21.15.12:60074) 2021-10-20T23:29:08.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6094f58700 1 -- 172.21.15.12:0/4074088979 learned_addr learned my addr 172.21.15.12:0/4074088979 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:08.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095759700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60900b2580 0x7f60900b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6094f58700 1 -- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60900b2580 msgr2=0x7f60900b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6094f58700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60900b2580 0x7f60900b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6094f58700 1 -- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60900b0010 msgr2=0x7f60900ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6094f58700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60900b0010 0x7f60900ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6094f58700 1 -- 172.21.15.12:0/4074088979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607800b1e0 con 0x7f60900a8ac0 2021-10-20T23:29:08.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f608ffff700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60900b0010 0x7f60900ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:08.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6094f58700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900a8ac0 0x7f60900a9850 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f6078002f70 tx=0x7f6078015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:08.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f608dffb700 1 -- 172.21.15.12:0/4074088979 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6078011b40 con 0x7f60900a8ac0 2021-10-20T23:29:08.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f608dffb700 1 -- 172.21.15.12:0/4074088979 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6078011ca0 con 0x7f60900a8ac0 2021-10-20T23:29:08.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60900aa590 con 0x7f60900a8ac0 2021-10-20T23:29:08.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f608dffb700 1 -- 172.21.15.12:0/4074088979 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f607801e460 con 0x7f60900a8ac0 2021-10-20T23:29:08.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.119+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60900b4250 con 0x7f60900a8ac0 2021-10-20T23:29:08.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.123+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60900ab6d0 con 0x7f60900a8ac0 2021-10-20T23:29:08.148 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.123+0000 7f608dffb700 1 -- 172.21.15.12:0/4074088979 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6078025030 con 0x7f60900a8ac0 2021-10-20T23:29:08.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.123+0000 7f608dffb700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60680536d0 0x7f6068055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.149 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.123+0000 7f608dffb700 1 -- 172.21.15.12:0/4074088979 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f607806ca40 con 0x7f60900a8ac0 2021-10-20T23:29:08.150 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.123+0000 7f608ffff700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60680536d0 0x7f6068055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.123+0000 7f608ffff700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60680536d0 0x7f6068055b90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f608800d000 tx=0x7f6088009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:08.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.127+0000 7f608dffb700 1 -- 172.21.15.12:0/4074088979 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6078043d80 con 0x7f60900a8ac0 2021-10-20T23:29:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.299+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6090057350 con 0x7f60900a8ac0 2021-10-20T23:29:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.299+0000 7f608dffb700 1 -- 172.21.15.12:0/4074088979 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f6078023070 con 0x7f60900a8ac0 2021-10-20T23:29:08.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:08.310 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:29:08.310 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:29:08.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.311 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:29:08.311 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:29:08.311 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.311 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:08.312 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.312 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.312 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.312 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.313 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:29:08.313 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:29:08.314 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.314 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:08.314 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.314 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.315 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.315 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.316 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:29:08.316 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:29:08.316 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.316 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:08.317 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.317 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.317 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.317 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.318 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:29:08.319 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:29:08.320 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.320 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.320 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.320 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.321 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.321 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:29:08.322 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:29:08.322 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.322 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.322 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.322 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:29:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:29:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:29:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:29:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:29:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:29:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:29:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:29:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:29:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:29:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:29:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:29:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:29:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:29:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:29:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:29:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:29:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:29:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:29:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:29:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:29:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:29:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:29:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:29:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:29:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:29:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:29:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:29:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:29:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:29:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:29:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:08.345 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:29:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.299+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60680536d0 msgr2=0x7f6068055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.299+0000 7f6095f5a700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60680536d0 0x7f6068055b90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f608800d000 tx=0x7f6088009040).stop 2021-10-20T23:29:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.299+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900a8ac0 msgr2=0x7f60900a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.299+0000 7f6095f5a700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900a8ac0 0x7f60900a9850 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f6078002f70 tx=0x7f6078015000).stop 2021-10-20T23:29:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.303+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 shutdown_connections 2021-10-20T23:29:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.303+0000 7f6095f5a700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f60680536d0 0x7f6068055b90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.303+0000 7f6095f5a700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60900b2580 0x7f60900b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.303+0000 7f6095f5a700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60900b0010 0x7f60900ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.303+0000 7f6095f5a700 1 --2- 172.21.15.12:0/4074088979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60900a8ac0 0x7f60900a9850 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.303+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 >> 172.21.15.12:0/4074088979 conn(0x7f6090060180 msgr2=0x7f609014cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.303+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 shutdown_connections 2021-10-20T23:29:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.303+0000 7f6095f5a700 1 -- 172.21.15.12:0/4074088979 wait complete. 2021-10-20T23:29:08.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:08.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8ff31f700 1 Processor -- start 2021-10-20T23:29:08.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8ff31f700 1 -- start start 2021-10-20T23:29:08.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8ff31f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b5bf0 0x7fc8f80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8ff31f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f81440b0 con 0x7fc8f80b6580 2021-10-20T23:29:08.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8ff31f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f80b6e50 con 0x7fc8f80b43c0 2021-10-20T23:29:08.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8ff31f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8143b70 con 0x7fc8f80b5bf0 2021-10-20T23:29:08.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8fd0bb700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc8f80b6580 0x7fc8f8061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43702/0 (socket says 172.21.15.12:43702) 2021-10-20T23:29:08.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8fd0bb700 1 -- 172.21.15.12:0/3468555097 learned_addr learned my addr 172.21.15.12:0/3468555097 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:08.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8fd8bc700 1 --2- 172.21.15.12:0/3468555097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b5bf0 0x7fc8f80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8e7fff700 1 -- 172.21.15.12:0/3468555097 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595636288 0 0) 0x7fc8f81440b0 con 0x7fc8f80b6580 2021-10-20T23:29:08.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8e7fff700 1 -- 172.21.15.12:0/3468555097 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e0003260 con 0x7fc8f80b6580 2021-10-20T23:29:08.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8e7fff700 1 -- 172.21.15.12:0/3468555097 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670390670 0 0) 0x7fc8f80b6e50 con 0x7fc8f80b43c0 2021-10-20T23:29:08.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8e7fff700 1 -- 172.21.15.12:0/3468555097 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f81440b0 con 0x7fc8f80b43c0 2021-10-20T23:29:08.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8fd8bc700 1 -- 172.21.15.12:0/3468555097 >> v1:172.21.15.31:6789/0 conn(0x7fc8f80b43c0 legacy=0x7fc8f812ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8fd8bc700 1 -- 172.21.15.12:0/3468555097 >> v1:172.21.15.12:6789/0 conn(0x7fc8f80b6580 legacy=0x7fc8f8061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8fd8bc700 1 -- 172.21.15.12:0/3468555097 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f8143e10 con 0x7fc8f80b5bf0 2021-10-20T23:29:08.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.447+0000 7fc8fd8bc700 1 --2- 172.21.15.12:0/3468555097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b5bf0 0x7fc8f80b6960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fc8f00032f0 tx=0x7fc8f00091d0).ready entity=mon.2 client_cookie=599906843493124e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8e7fff700 1 -- 172.21.15.12:0/3468555097 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8f000b640 con 0x7fc8f80b5bf0 2021-10-20T23:29:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8e7fff700 1 -- 172.21.15.12:0/3468555097 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f000b7a0 con 0x7fc8f80b5bf0 2021-10-20T23:29:08.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8e7fff700 1 -- 172.21.15.12:0/3468555097 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8f000b910 con 0x7fc8f80b5bf0 2021-10-20T23:29:08.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8ff31f700 1 -- 172.21.15.12:0/3468555097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b5bf0 msgr2=0x7fc8f80b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8ff31f700 1 --2- 172.21.15.12:0/3468555097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b5bf0 0x7fc8f80b6960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fc8f00032f0 tx=0x7fc8f00091d0).stop 2021-10-20T23:29:08.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8ff31f700 1 -- 172.21.15.12:0/3468555097 shutdown_connections 2021-10-20T23:29:08.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8ff31f700 1 --2- 172.21.15.12:0/3468555097 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b5bf0 0x7fc8f80b6960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8ff31f700 1 -- 172.21.15.12:0/3468555097 >> 172.21.15.12:0/3468555097 conn(0x7fc8f805c490 msgr2=0x7fc8f805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:08.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8ff31f700 1 -- 172.21.15.12:0/3468555097 shutdown_connections 2021-10-20T23:29:08.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8ff31f700 1 -- 172.21.15.12:0/3468555097 wait complete. 2021-10-20T23:29:08.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8ff31f700 1 Processor -- start 2021-10-20T23:29:08.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.451+0000 7fc8ff31f700 1 -- start start 2021-10-20T23:29:08.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8ff31f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b43c0 0x7fc8f8127490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8ff31f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8f80b5bf0 0x7fc8f8152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8ff31f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8f80b6580 0x7fc8f8152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8ff31f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f81481c0 con 0x7fc8f80b5bf0 2021-10-20T23:29:08.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8ff31f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f81522c0 con 0x7fc8f80b6580 2021-10-20T23:29:08.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8ff31f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8147c80 con 0x7fc8f80b43c0 2021-10-20T23:29:08.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fc8ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8f80b5bf0 0x7fc8f8152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fc8ba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8f80b5bf0 0x7fc8f8152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45116/0 (socket says 172.21.15.12:45116) 2021-10-20T23:29:08.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fc8ba700 1 -- 172.21.15.12:0/520307222 learned_addr learned my addr 172.21.15.12:0/520307222 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:08.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fd0bb700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b43c0 0x7fc8f8127490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fd8bc700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8f80b6580 0x7fc8f8152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fd0bb700 1 -- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8f80b6580 msgr2=0x7fc8f8152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fd0bb700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8f80b6580 0x7fc8f8152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fd0bb700 1 -- 172.21.15.12:0/520307222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8f80b5bf0 msgr2=0x7fc8f8152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fd0bb700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8f80b5bf0 0x7fc8f8152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fd0bb700 1 -- 172.21.15.12:0/520307222 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0009470 con 0x7fc8f80b43c0 2021-10-20T23:29:08.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8fd0bb700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b43c0 0x7fc8f8127490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fc8f8128780 tx=0x7fc8f4007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:08.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8e67fc700 1 -- 172.21.15.12:0/520307222 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8f400ce70 con 0x7fc8f80b43c0 2021-10-20T23:29:08.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8e67fc700 1 -- 172.21.15.12:0/520307222 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f40070d0 con 0x7fc8f80b43c0 2021-10-20T23:29:08.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f8147f20 con 0x7fc8f80b43c0 2021-10-20T23:29:08.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8e67fc700 1 -- 172.21.15.12:0/520307222 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8f4007430 con 0x7fc8f80b43c0 2021-10-20T23:29:08.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.455+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f81468d0 con 0x7fc8f80b43c0 2021-10-20T23:29:08.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.459+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f80615f0 con 0x7fc8f80b43c0 2021-10-20T23:29:08.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.459+0000 7fc8e67fc700 1 -- 172.21.15.12:0/520307222 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc8f4010070 con 0x7fc8f80b43c0 2021-10-20T23:29:08.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.459+0000 7fc8e67fc700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8d80536a0 0x7fc8d8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.459+0000 7fc8e67fc700 1 -- 172.21.15.12:0/520307222 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fc8f406ade0 con 0x7fc8f80b43c0 2021-10-20T23:29:08.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.459+0000 7fc8fc8ba700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8d80536a0 0x7fc8d8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.459+0000 7fc8fc8ba700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8d80536a0 0x7fc8d8055b60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fc8e800d000 tx=0x7fc8e8007a60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:08.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.467+0000 7fc8e67fc700 1 -- 172.21.15.12:0/520307222 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc8f4042010 con 0x7fc8f80b43c0 2021-10-20T23:29:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.595+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8f8057350 con 0x7fc8f80b43c0 2021-10-20T23:29:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8e67fc700 1 -- 172.21.15.12:0/520307222 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+13424 (secure 0 0 0) 0x7fc8f4045630 con 0x7fc8f80b43c0 2021-10-20T23:29:08.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:08.608 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":147,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:07.976105+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8d80536a0 msgr2=0x7fc8d8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8d80536a0 0x7fc8d8055b60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fc8e800d000 tx=0x7fc8e8007a60).stop 2021-10-20T23:29:08.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b43c0 msgr2=0x7fc8f8127490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b43c0 0x7fc8f8127490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fc8f8128780 tx=0x7fc8f4007a40).stop 2021-10-20T23:29:08.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 shutdown_connections 2021-10-20T23:29:08.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8d80536a0 0x7fc8d8055b60 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8f80b6580 0x7fc8f8152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8f80b5bf0 0x7fc8f8152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 --2- 172.21.15.12:0/520307222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8f80b43c0 0x7fc8f8127490 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.599+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 >> 172.21.15.12:0/520307222 conn(0x7fc8f805c490 msgr2=0x7fc8f8143160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:08.614 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.603+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 shutdown_connections 2021-10-20T23:29:08.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.603+0000 7fc8ff31f700 1 -- 172.21.15.12:0/520307222 wait complete. 2021-10-20T23:29:08.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:29:08.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:29:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.727+0000 7ff2b82e0700 1 Processor -- start 2021-10-20T23:29:08.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.727+0000 7ff2b82e0700 1 -- start start 2021-10-20T23:29:08.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.727+0000 7ff2b82e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 0x7ff2b0140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.727+0000 7ff2b82e0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2b00b4690 0x7ff2b00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.727+0000 7ff2b82e0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b0143b60 con 0x7ff2b0146950 2021-10-20T23:29:08.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.727+0000 7ff2b82e0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b0147510 con 0x7ff2b00b4690 2021-10-20T23:29:08.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.727+0000 7ff2b82e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0143e00 con 0x7ff2b00b4180 2021-10-20T23:29:08.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.727+0000 7ff2b687d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2b00b4690 0x7ff2b00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b607c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff2b0146950 0x7ff2b0140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43716/0 (socket says 172.21.15.12:43716) 2021-10-20T23:29:08.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b687d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2b00b4690 0x7ff2b00b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45124/0 (socket says 172.21.15.12:45124) 2021-10-20T23:29:08.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b607c700 1 -- 172.21.15.12:0/3183593530 learned_addr learned my addr 172.21.15.12:0/3183593530 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:08.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b587b700 1 --2- 172.21.15.12:0/3183593530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 0x7ff2b0140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b687d700 1 -- 172.21.15.12:0/3183593530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 msgr2=0x7ff2b0140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:08.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b687d700 1 --2- 172.21.15.12:0/3183593530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 0x7ff2b0140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b687d700 1 -- 172.21.15.12:0/3183593530 >> v1:172.21.15.12:6789/0 conn(0x7ff2b0146950 legacy=0x7ff2b0140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b687d700 1 -- 172.21.15.12:0/3183593530 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b00b0c90 con 0x7ff2b00b4690 2021-10-20T23:29:08.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b687d700 1 --2- 172.21.15.12:0/3183593530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b00b4690 0x7ff2b00b4ed0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7ff2a80032f0 tx=0x7ff2a80091d0).ready entity=mon.0 client_cookie=8f01e1a0cd02f9c6 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b507a700 1 -- 172.21.15.12:0/3183593530 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2a800b6c0 con 0x7ff2b00b4690 2021-10-20T23:29:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b507a700 1 -- 172.21.15.12:0/3183593530 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a800b820 con 0x7ff2b00b4690 2021-10-20T23:29:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b507a700 1 -- 172.21.15.12:0/3183593530 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2a800b990 con 0x7ff2b00b4690 2021-10-20T23:29:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3183593530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b00b4690 msgr2=0x7ff2b00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 --2- 172.21.15.12:0/3183593530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b00b4690 0x7ff2b00b4ed0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7ff2a80032f0 tx=0x7ff2a80091d0).stop 2021-10-20T23:29:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3183593530 shutdown_connections 2021-10-20T23:29:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 --2- 172.21.15.12:0/3183593530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b00b4690 0x7ff2b00b4ed0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 --2- 172.21.15.12:0/3183593530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 0x7ff2b0140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3183593530 >> 172.21.15.12:0/3183593530 conn(0x7ff2b005c490 msgr2=0x7ff2b005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3183593530 shutdown_connections 2021-10-20T23:29:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3183593530 wait complete. 2021-10-20T23:29:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 Processor -- start 2021-10-20T23:29:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.731+0000 7ff2b82e0700 1 -- start start 2021-10-20T23:29:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b82e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 0x7ff2b0156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b82e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b00b4690 0x7ff2b00b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b82e0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b0146950 0x7ff2b00adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b82e0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b00b2c30 con 0x7ff2b0146950 2021-10-20T23:29:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b82e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b00b2ec0 con 0x7ff2b00b4690 2021-10-20T23:29:08.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b82e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0155c30 con 0x7ff2b00b4180 2021-10-20T23:29:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b687d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b0146950 0x7ff2b00adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b687d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b0146950 0x7ff2b00adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45130/0 (socket says 172.21.15.12:45130) 2021-10-20T23:29:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b687d700 1 -- 172.21.15.12:0/3140614383 learned_addr learned my addr 172.21.15.12:0/3140614383 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:08.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b607c700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 0x7ff2b0156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b587b700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b00b4690 0x7ff2b00b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b687d700 1 -- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 msgr2=0x7ff2b0156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b687d700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 0x7ff2b0156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b687d700 1 -- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b00b4690 msgr2=0x7ff2b00b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b687d700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b00b4690 0x7ff2b00b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b687d700 1 -- 172.21.15.12:0/3140614383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a8009470 con 0x7ff2b0146950 2021-10-20T23:29:08.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b687d700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b0146950 0x7ff2b00adf90 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7ff2a80032f0 tx=0x7ff2a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:08.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff29f7fe700 1 -- 172.21.15.12:0/3140614383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2a8011e20 con 0x7ff2b0146950 2021-10-20T23:29:08.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff29f7fe700 1 -- 172.21.15.12:0/3140614383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a8021440 con 0x7ff2b0146950 2021-10-20T23:29:08.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b0155ed0 con 0x7ff2b0146950 2021-10-20T23:29:08.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff29f7fe700 1 -- 172.21.15.12:0/3140614383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2a80217a0 con 0x7ff2b0146950 2021-10-20T23:29:08.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.735+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b00ae480 con 0x7ff2b0146950 2021-10-20T23:29:08.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.739+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b0057350 con 0x7ff2b0146950 2021-10-20T23:29:08.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.739+0000 7ff29f7fe700 1 -- 172.21.15.12:0/3140614383 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2a8027020 con 0x7ff2b0146950 2021-10-20T23:29:08.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.739+0000 7ff29f7fe700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff290053640 0x7ff290055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:08.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.739+0000 7ff29f7fe700 1 -- 172.21.15.12:0/3140614383 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ff2a806cd00 con 0x7ff2b0146950 2021-10-20T23:29:08.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.739+0000 7ff2b607c700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff290053640 0x7ff290055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:08.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.739+0000 7ff2b607c700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff290053640 0x7ff290055b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7ff2a000d000 tx=0x7ff2a0007be0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:08.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.743+0000 7ff29f7fe700 1 -- 172.21.15.12:0/3140614383 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2a8043f30 con 0x7ff2b0146950 2021-10-20T23:29:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff2b00b66b0 con 0x7ff2b0146950 2021-10-20T23:29:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff29f7fe700 1 -- 172.21.15.12:0/3140614383 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v147) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff2a8015020 con 0x7ff2b0146950 2021-10-20T23:29:08.885 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:29:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff290053640 msgr2=0x7ff290055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff290053640 0x7ff290055b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7ff2a000d000 tx=0x7ff2a0007be0).stop 2021-10-20T23:29:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b0146950 msgr2=0x7ff2b00adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b0146950 0x7ff2b00adf90 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7ff2a80032f0 tx=0x7ff2a8016000).stop 2021-10-20T23:29:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 shutdown_connections 2021-10-20T23:29:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff290053640 0x7ff290055b00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b0146950 0x7ff2b00adf90 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b00b4690 0x7ff2b00b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 --2- 172.21.15.12:0/3140614383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2b00b4180 0x7ff2b0156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 >> 172.21.15.12:0/3140614383 conn(0x7ff2b005c490 msgr2=0x7ff2b013b300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 shutdown_connections 2021-10-20T23:29:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.875+0000 7ff2b82e0700 1 -- 172.21.15.12:0/3140614383 wait complete. 2021-10-20T23:29:08.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:29:09.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf6d276700 1 Processor -- start 2021-10-20T23:29:09.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf6d276700 1 -- start start 2021-10-20T23:29:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf6d276700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf680b0010 0x7fcf680a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf6d276700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf680a70c0 con 0x7fcf680b2580 2021-10-20T23:29:09.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf6d276700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf680a72f0 con 0x7fcf680afbd0 2021-10-20T23:29:09.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf6d276700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf680a7590 con 0x7fcf680b0010 2021-10-20T23:29:09.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf67fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcf680b2580 0x7fcf6814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43730/0 (socket says 172.21.15.12:43730) 2021-10-20T23:29:09.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf677fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf680b0010 0x7fcf680a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf67fff700 1 -- 172.21.15.12:0/204847716 learned_addr learned my addr 172.21.15.12:0/204847716 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:09.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf66ffd700 1 -- 172.21.15.12:0/204847716 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994287182 0 0) 0x7fcf680a70c0 con 0x7fcf680b2580 2021-10-20T23:29:09.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf66ffd700 1 -- 172.21.15.12:0/204847716 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf54003260 con 0x7fcf680b2580 2021-10-20T23:29:09.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf677fe700 1 -- 172.21.15.12:0/204847716 >> v1:172.21.15.31:6789/0 conn(0x7fcf680afbd0 legacy=0x7fcf68151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf677fe700 1 -- 172.21.15.12:0/204847716 >> v1:172.21.15.12:6789/0 conn(0x7fcf680b2580 legacy=0x7fcf6814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf677fe700 1 -- 172.21.15.12:0/204847716 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf680a7830 con 0x7fcf680b0010 2021-10-20T23:29:09.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf677fe700 1 --2- 172.21.15.12:0/204847716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b0010 0x7fcf680a83b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7fcf5c002f70 tx=0x7fcf5c006df0).ready entity=mon.0 client_cookie=fa8754b6ab7bf504 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:09.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf66ffd700 1 -- 172.21.15.12:0/204847716 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5c00d610 con 0x7fcf680b0010 2021-10-20T23:29:09.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf66ffd700 1 -- 172.21.15.12:0/204847716 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c000e90 con 0x7fcf680b0010 2021-10-20T23:29:09.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.995+0000 7fcf66ffd700 1 -- 172.21.15.12:0/204847716 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5c00d960 con 0x7fcf680b0010 2021-10-20T23:29:09.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.999+0000 7fcf6d276700 1 -- 172.21.15.12:0/204847716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b0010 msgr2=0x7fcf680a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.999+0000 7fcf6d276700 1 --2- 172.21.15.12:0/204847716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b0010 0x7fcf680a83b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7fcf5c002f70 tx=0x7fcf5c006df0).stop 2021-10-20T23:29:09.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.999+0000 7fcf6d276700 1 -- 172.21.15.12:0/204847716 shutdown_connections 2021-10-20T23:29:09.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.999+0000 7fcf6d276700 1 --2- 172.21.15.12:0/204847716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b0010 0x7fcf680a83b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.999+0000 7fcf6d276700 1 -- 172.21.15.12:0/204847716 >> 172.21.15.12:0/204847716 conn(0x7fcf68060180 msgr2=0x7fcf680b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:09.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.999+0000 7fcf6d276700 1 -- 172.21.15.12:0/204847716 shutdown_connections 2021-10-20T23:29:09.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.999+0000 7fcf6d276700 1 -- 172.21.15.12:0/204847716 wait complete. 2021-10-20T23:29:09.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.999+0000 7fcf6d276700 1 Processor -- start 2021-10-20T23:29:09.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:08.999+0000 7fcf6d276700 1 -- start start 2021-10-20T23:29:09.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6d276700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf680afbd0 0x7fcf680b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6d276700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf680b0010 0x7fcf680b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6d276700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b2580 0x7fcf680b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6d276700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680a9ce0 con 0x7fcf680b2580 2021-10-20T23:29:09.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6d276700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680b4820 con 0x7fcf680afbd0 2021-10-20T23:29:09.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6d276700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680b3ec0 con 0x7fcf680b0010 2021-10-20T23:29:09.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6ca75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b2580 0x7fcf680b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf67fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf680afbd0 0x7fcf680b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6ca75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b2580 0x7fcf680b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45144/0 (socket says 172.21.15.12:45144) 2021-10-20T23:29:09.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6ca75700 1 -- 172.21.15.12:0/2490779117 learned_addr learned my addr 172.21.15.12:0/2490779117 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:09.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf677fe700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf680b0010 0x7fcf680b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6ca75700 1 -- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf680b0010 msgr2=0x7fcf680b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6ca75700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf680b0010 0x7fcf680b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6ca75700 1 -- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf680afbd0 msgr2=0x7fcf680b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6ca75700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf680afbd0 0x7fcf680b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6ca75700 1 -- 172.21.15.12:0/2490779117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c00b180 con 0x7fcf680b2580 2021-10-20T23:29:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6ca75700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b2580 0x7fcf680b4b70 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fcf68061a80 tx=0x7fcf60007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:09.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf657fa700 1 -- 172.21.15.12:0/2490779117 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf6000f470 con 0x7fcf680b2580 2021-10-20T23:29:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf657fa700 1 -- 172.21.15.12:0/2490779117 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6000f5d0 con 0x7fcf680b2580 2021-10-20T23:29:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf680a9f10 con 0x7fcf680b2580 2021-10-20T23:29:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf657fa700 1 -- 172.21.15.12:0/2490779117 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf6000f930 con 0x7fcf680b2580 2021-10-20T23:29:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf680aa450 con 0x7fcf680b2580 2021-10-20T23:29:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.003+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf680aa650 con 0x7fcf680b2580 2021-10-20T23:29:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.007+0000 7fcf657fa700 1 -- 172.21.15.12:0/2490779117 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf60019030 con 0x7fcf680b2580 2021-10-20T23:29:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.007+0000 7fcf657fa700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf480536a0 0x7fcf48055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.007+0000 7fcf657fa700 1 -- 172.21.15.12:0/2490779117 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fcf6006af30 con 0x7fcf680b2580 2021-10-20T23:29:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.007+0000 7fcf67fff700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf480536a0 0x7fcf48055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.007+0000 7fcf67fff700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf480536a0 0x7fcf48055b60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fcf5800d000 tx=0x7fcf58009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.015+0000 7fcf657fa700 1 -- 172.21.15.12:0/2490779117 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf680aa650 con 0x7fcf680b2580 2021-10-20T23:29:09.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.143+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcf680aa650 con 0x7fcf680b2580 2021-10-20T23:29:09.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.143+0000 7fcf657fa700 1 -- 172.21.15.12:0/2490779117 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcf680aa650 con 0x7fcf680b2580 2021-10-20T23:29:09.154 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf480536a0 msgr2=0x7fcf48055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf480536a0 0x7fcf48055b60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fcf5800d000 tx=0x7fcf58009040).stop 2021-10-20T23:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b2580 msgr2=0x7fcf680b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b2580 0x7fcf680b4b70 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fcf68061a80 tx=0x7fcf60007f10).stop 2021-10-20T23:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 shutdown_connections 2021-10-20T23:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcf480536a0 0x7fcf48055b60 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf680b2580 0x7fcf680b4b70 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf680b0010 0x7fcf680b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 --2- 172.21.15.12:0/2490779117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf680afbd0 0x7fcf680b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 >> 172.21.15.12:0/2490779117 conn(0x7fcf68060180 msgr2=0x7fcf68149b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 shutdown_connections 2021-10-20T23:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.147+0000 7fcf6d276700 1 -- 172.21.15.12:0/2490779117 wait complete. 2021-10-20T23:29:09.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:29:09.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.263+0000 7f92ab59e700 1 Processor -- start 2021-10-20T23:29:09.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.263+0000 7f92ab59e700 1 -- start start 2021-10-20T23:29:09.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f92ac0b0710 0x7f92ac142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0b30d0 0x7f92ac143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac0b0af0 con 0x7f92ac0ace70 2021-10-20T23:29:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac05cba0 con 0x7f92ac0b0710 2021-10-20T23:29:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0ae680 con 0x7f92ac0b30d0 2021-10-20T23:29:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92aa59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f92ac0b0710 0x7f92ac142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0b30d0 0x7f92ac143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92aad9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f92ac0ace70 0x7f92ac05c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:50812/0 (socket says 172.21.15.12:50812) 2021-10-20T23:29:09.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92aad9d700 1 -- 172.21.15.12:0/1172015219 learned_addr learned my addr 172.21.15.12:0/1172015219 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:09.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a9d9b700 1 -- 172.21.15.12:0/1172015219 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426961473 0 0) 0x7f92ac0b0af0 con 0x7f92ac0ace70 2021-10-20T23:29:09.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a9d9b700 1 -- 172.21.15.12:0/1172015219 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f928c003260 con 0x7f92ac0ace70 2021-10-20T23:29:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a3fff700 1 -- 172.21.15.12:0/1172015219 >> v2:172.21.15.31:3300/0 conn(0x7f92ac0b0710 msgr2=0x7f92ac142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a3fff700 1 --2- 172.21.15.12:0/1172015219 >> v2:172.21.15.31:3300/0 conn(0x7f92ac0b0710 0x7f92ac142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a3fff700 1 -- 172.21.15.12:0/1172015219 >> v1:172.21.15.31:6789/0 conn(0x7f92ac0ace70 legacy=0x7f92ac05c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a3fff700 1 -- 172.21.15.12:0/1172015219 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac0ae920 con 0x7f92ac0b30d0 2021-10-20T23:29:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92aa59c700 1 --2- 172.21.15.12:0/1172015219 >> v2:172.21.15.31:3300/0 conn(0x7f92ac0b0710 0x7f92ac142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:09.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a3fff700 1 --2- 172.21.15.12:0/1172015219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0b30d0 0x7f92ac143210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f9294002f70 tx=0x7f9294006df0).ready entity=mon.2 client_cookie=ad23fe6b779b8e1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:09.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a9d9b700 1 -- 172.21.15.12:0/1172015219 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f929400d4a0 con 0x7f92ac0b30d0 2021-10-20T23:29:09.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a9d9b700 1 -- 172.21.15.12:0/1172015219 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9294000e90 con 0x7f92ac0b30d0 2021-10-20T23:29:09.284 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92a9d9b700 1 -- 172.21.15.12:0/1172015219 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f929400d7f0 con 0x7f92ac0b30d0 2021-10-20T23:29:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 -- 172.21.15.12:0/1172015219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0b30d0 msgr2=0x7f92ac143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 --2- 172.21.15.12:0/1172015219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0b30d0 0x7f92ac143210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f9294002f70 tx=0x7f9294006df0).stop 2021-10-20T23:29:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 -- 172.21.15.12:0/1172015219 shutdown_connections 2021-10-20T23:29:09.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 --2- 172.21.15.12:0/1172015219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0b30d0 0x7f92ac143210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 --2- 172.21.15.12:0/1172015219 >> v2:172.21.15.31:3300/0 conn(0x7f92ac0b0710 0x7f92ac142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 -- 172.21.15.12:0/1172015219 >> 172.21.15.12:0/1172015219 conn(0x7f92ac061140 msgr2=0x7f92ac062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:09.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 -- 172.21.15.12:0/1172015219 shutdown_connections 2021-10-20T23:29:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.267+0000 7f92ab59e700 1 -- 172.21.15.12:0/1172015219 wait complete. 2021-10-20T23:29:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 Processor -- start 2021-10-20T23:29:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 -- start start 2021-10-20T23:29:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0ace70 0x7f92ac0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92ac0b0710 0x7f92ac0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92ac0b30d0 0x7f92ac0aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0abf60 con 0x7f92ac0b30d0 2021-10-20T23:29:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0ac190 con 0x7f92ac0b0710 2021-10-20T23:29:09.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0ac430 con 0x7f92ac0ace70 2021-10-20T23:29:09.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92ac0b30d0 0x7f92ac0aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92ac0b30d0 0x7f92ac0aada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45160/0 (socket says 172.21.15.12:45160) 2021-10-20T23:29:09.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aad9d700 1 -- 172.21.15.12:0/4038858780 learned_addr learned my addr 172.21.15.12:0/4038858780 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:09.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92a3fff700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92ac0b0710 0x7f92ac0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aa59c700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0ace70 0x7f92ac0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aad9d700 1 -- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0ace70 msgr2=0x7f92ac0ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aad9d700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0ace70 0x7f92ac0ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aad9d700 1 -- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92ac0b0710 msgr2=0x7f92ac0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aad9d700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92ac0b0710 0x7f92ac0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aad9d700 1 -- 172.21.15.12:0/4038858780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c00b180 con 0x7f92ac0b30d0 2021-10-20T23:29:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92aad9d700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92ac0b30d0 0x7f92ac0aada0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f92a4001490 tx=0x7f92a4007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92a37fe700 1 -- 172.21.15.12:0/4038858780 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92a4005c70 con 0x7f92ac0b30d0 2021-10-20T23:29:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92a37fe700 1 -- 172.21.15.12:0/4038858780 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a4005dd0 con 0x7f92ac0b30d0 2021-10-20T23:29:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929400b180 con 0x7f92ac0b30d0 2021-10-20T23:29:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92a37fe700 1 -- 172.21.15.12:0/4038858780 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92a40072c0 con 0x7f92ac0b30d0 2021-10-20T23:29:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.271+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac0aa900 con 0x7f92ac0b30d0 2021-10-20T23:29:09.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.275+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac057350 con 0x7f92ac0b30d0 2021-10-20T23:29:09.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.275+0000 7f92a37fe700 1 -- 172.21.15.12:0/4038858780 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f92a401a060 con 0x7f92ac0b30d0 2021-10-20T23:29:09.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.275+0000 7f92a37fe700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9290053580 0x7f9290055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.275+0000 7f92a37fe700 1 -- 172.21.15.12:0/4038858780 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f92a406b1c0 con 0x7f92ac0b30d0 2021-10-20T23:29:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.275+0000 7f92aa59c700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9290053580 0x7f9290055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.275+0000 7f92aa59c700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9290053580 0x7f9290055a40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f929c00b000 tx=0x7f929c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.283+0000 7f92a37fe700 1 -- 172.21.15.12:0/4038858780 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92a4042500 con 0x7f92ac0b30d0 2021-10-20T23:29:09.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f92ac0b2c70 con 0x7f92ac0b30d0 2021-10-20T23:29:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92a37fe700 1 -- 172.21.15.12:0/4038858780 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v147) v1 ==== 84+0+143 (secure 0 0 0) 0x7f92a4018020 con 0x7f92ac0b30d0 2021-10-20T23:29:09.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:09.766 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:29:09.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:09.766 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:29:09.767 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:29:09.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:09.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:09.767 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:29:09.767 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:29:09.768 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:09.768 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:29:09.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9290053580 msgr2=0x7f9290055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9290053580 0x7f9290055a40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f929c00b000 tx=0x7f929c006df0).stop 2021-10-20T23:29:09.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92ac0b30d0 msgr2=0x7f92ac0aada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92ac0b30d0 0x7f92ac0aada0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f92a4001490 tx=0x7f92a4007dc0).stop 2021-10-20T23:29:09.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 shutdown_connections 2021-10-20T23:29:09.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9290053580 0x7f9290055a40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92ac0b30d0 0x7f92ac0aada0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92ac0b0710 0x7f92ac0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 --2- 172.21.15.12:0/4038858780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92ac0ace70 0x7f92ac0ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 >> 172.21.15.12:0/4038858780 conn(0x7f92ac061140 msgr2=0x7f92ac141f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:09.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 shutdown_connections 2021-10-20T23:29:09.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.415+0000 7f92ab59e700 1 -- 172.21.15.12:0/4038858780 wait complete. 2021-10-20T23:29:09.775 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:29:09.776 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:29:09.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 Processor -- start 2021-10-20T23:29:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 -- start start 2021-10-20T23:29:09.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcb401439a0 0x7fcb401404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb400b6910 con 0x7fcb40061680 2021-10-20T23:29:09.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb400b6bb0 con 0x7fcb400b4710 2021-10-20T23:29:09.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb400b9680 con 0x7fcb401439a0 2021-10-20T23:29:09.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb3ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcb40061680 0x7fcb400b9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43758/0 (socket says 172.21.15.12:43758) 2021-10-20T23:29:09.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb3ffff700 1 -- 172.21.15.12:0/1425597853 learned_addr learned my addr 172.21.15.12:0/1425597853 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:09.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb449cd700 1 --2- 172.21.15.12:0/1425597853 >> v2:172.21.15.12:3300/0 conn(0x7fcb401439a0 0x7fcb401404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb449cd700 1 -- 172.21.15.12:0/1425597853 >> v1:172.21.15.31:6789/0 conn(0x7fcb400b4710 legacy=0x7fcb4013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb3effd700 1 -- 172.21.15.12:0/1425597853 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423519329 0 0) 0x7fcb400b6910 con 0x7fcb40061680 2021-10-20T23:29:09.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb449cd700 1 -- 172.21.15.12:0/1425597853 >> v1:172.21.15.12:6789/0 conn(0x7fcb40061680 legacy=0x7fcb400b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb449cd700 1 -- 172.21.15.12:0/1425597853 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb400b6e50 con 0x7fcb401439a0 2021-10-20T23:29:09.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb449cd700 1 --2- 172.21.15.12:0/1425597853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 0x7fcb401404b0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fcb380032f0 tx=0x7fcb380091d0).ready entity=mon.0 client_cookie=c500d7d060b2b6a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:09.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb3effd700 1 -- 172.21.15.12:0/1425597853 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb38009ea0 con 0x7fcb401439a0 2021-10-20T23:29:09.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb3effd700 1 -- 172.21.15.12:0/1425597853 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3800b8a0 con 0x7fcb401439a0 2021-10-20T23:29:09.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb3effd700 1 -- 172.21.15.12:0/1425597853 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3800ba10 con 0x7fcb401439a0 2021-10-20T23:29:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 -- 172.21.15.12:0/1425597853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 msgr2=0x7fcb401404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 --2- 172.21.15.12:0/1425597853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 0x7fcb401404b0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fcb380032f0 tx=0x7fcb380091d0).stop 2021-10-20T23:29:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 -- 172.21.15.12:0/1425597853 shutdown_connections 2021-10-20T23:29:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 --2- 172.21.15.12:0/1425597853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 0x7fcb401404b0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.895+0000 7fcb451ce700 1 -- 172.21.15.12:0/1425597853 >> 172.21.15.12:0/1425597853 conn(0x7fcb4006adf0 msgr2=0x7fcb4005f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 -- 172.21.15.12:0/1425597853 shutdown_connections 2021-10-20T23:29:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 -- 172.21.15.12:0/1425597853 wait complete. 2021-10-20T23:29:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 Processor -- start 2021-10-20T23:29:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 -- start start 2021-10-20T23:29:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb40061680 0x7fcb40146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 0x7fcb4013e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb40113390 0x7fcb4013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb400af300 con 0x7fcb401439a0 2021-10-20T23:29:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb400af550 con 0x7fcb40113390 2021-10-20T23:29:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb451ce700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb400afa80 con 0x7fcb40061680 2021-10-20T23:29:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb3f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 0x7fcb4013e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb3f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 0x7fcb4013e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45174/0 (socket says 172.21.15.12:45174) 2021-10-20T23:29:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb3f7fe700 1 -- 172.21.15.12:0/983844099 learned_addr learned my addr 172.21.15.12:0/983844099 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb449cd700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb40113390 0x7fcb4013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.899+0000 7fcb3ffff700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb40061680 0x7fcb40146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb449cd700 1 -- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb40061680 msgr2=0x7fcb40146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb449cd700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb40061680 0x7fcb40146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb449cd700 1 -- 172.21.15.12:0/983844099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 msgr2=0x7fcb4013e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:09.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb449cd700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 0x7fcb4013e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:09.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb449cd700 1 -- 172.21.15.12:0/983844099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38009470 con 0x7fcb40113390 2021-10-20T23:29:09.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb449cd700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb40113390 0x7fcb4013e520 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fcb380032f0 tx=0x7fcb38016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:09.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb3d7fa700 1 -- 172.21.15.12:0/983844099 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb38009ea0 con 0x7fcb40113390 2021-10-20T23:29:09.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb3d7fa700 1 -- 172.21.15.12:0/983844099 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3801f3f0 con 0x7fcb40113390 2021-10-20T23:29:09.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb400afd20 con 0x7fcb40113390 2021-10-20T23:29:09.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb3d7fa700 1 -- 172.21.15.12:0/983844099 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3801f750 con 0x7fcb40113390 2021-10-20T23:29:09.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb40147210 con 0x7fcb40113390 2021-10-20T23:29:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb400af100 con 0x7fcb40113390 2021-10-20T23:29:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb3d7fa700 1 -- 172.21.15.12:0/983844099 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcb38026030 con 0x7fcb40113390 2021-10-20T23:29:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.903+0000 7fcb3d7fa700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb24053640 0x7fcb24055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.907+0000 7fcb3d7fa700 1 -- 172.21.15.12:0/983844099 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fcb3806c2b0 con 0x7fcb40113390 2021-10-20T23:29:09.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.907+0000 7fcb3ffff700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb24053640 0x7fcb24055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:09.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.907+0000 7fcb3ffff700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb24053640 0x7fcb24055b00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fcb2800d000 tx=0x7fcb280011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:09.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:09.915+0000 7fcb3d7fa700 1 -- 172.21.15.12:0/983844099 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcb380434e0 con 0x7fcb40113390 2021-10-20T23:29:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.043+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fcb400b9870 con 0x7fcb40113390 2021-10-20T23:29:10.606 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.595+0000 7fcb3d7fa700 1 -- 172.21.15.12:0/983844099 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v148) v1 ==== 133+0+0 (secure 0 0 0) 0x7fcb38046b00 con 0x7fcb40113390 2021-10-20T23:29:10.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb24053640 msgr2=0x7fcb24055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:10.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb24053640 0x7fcb24055b00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fcb2800d000 tx=0x7fcb280011a0).stop 2021-10-20T23:29:10.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb40113390 msgr2=0x7fcb4013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb40113390 0x7fcb4013e520 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fcb380032f0 tx=0x7fcb38016000).stop 2021-10-20T23:29:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 shutdown_connections 2021-10-20T23:29:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fcb24053640 0x7fcb24055b00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb40113390 0x7fcb4013e520 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb401439a0 0x7fcb4013e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 --2- 172.21.15.12:0/983844099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb40061680 0x7fcb40146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 >> 172.21.15.12:0/983844099 conn(0x7fcb4006adf0 msgr2=0x7fcb4013f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.599+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 shutdown_connections 2021-10-20T23:29:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.603+0000 7fcb451ce700 1 -- 172.21.15.12:0/983844099 wait complete. 2021-10-20T23:29:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:29:10.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:29:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 Processor -- start 2021-10-20T23:29:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 -- start start 2021-10-20T23:29:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5700b1ec0 0x7fb5700b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb5700b22a0 0x7fb570141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5700b0420 con 0x7fb5700affb0 2021-10-20T23:29:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700a77d0 con 0x7fb5700b1ec0 2021-10-20T23:29:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700b0650 con 0x7fb5700b22a0 2021-10-20T23:29:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb574fd8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5700b1ec0 0x7fb5700b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb574fd8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5700b1ec0 0x7fb5700b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45178/0 (socket says 172.21.15.12:45178) 2021-10-20T23:29:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb574fd8700 1 -- 172.21.15.12:0/4101301799 learned_addr learned my addr 172.21.15.12:0/4101301799 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb5757d9700 1 --2- 172.21.15.12:0/4101301799 >> v2:172.21.15.31:3300/0 conn(0x7fb5700b22a0 0x7fb570141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb574fd8700 1 -- 172.21.15.12:0/4101301799 >> v2:172.21.15.31:3300/0 conn(0x7fb5700b22a0 msgr2=0x7fb570141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb574fd8700 1 --2- 172.21.15.12:0/4101301799 >> v2:172.21.15.31:3300/0 conn(0x7fb5700b22a0 0x7fb570141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb574fd8700 1 -- 172.21.15.12:0/4101301799 >> v1:172.21.15.31:6789/0 conn(0x7fb5700affb0 legacy=0x7fb5700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb574fd8700 1 -- 172.21.15.12:0/4101301799 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700b08f0 con 0x7fb5700b1ec0 2021-10-20T23:29:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb574fd8700 1 --2- 172.21.15.12:0/4101301799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b1ec0 0x7fb5700b12d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fb560002f70 tx=0x7fb560006eb0).ready entity=mon.0 client_cookie=e3cbcac021ac974c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:10.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb56f7fe700 1 -- 172.21.15.12:0/4101301799 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb56000d5c0 con 0x7fb5700b1ec0 2021-10-20T23:29:10.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb56f7fe700 1 -- 172.21.15.12:0/4101301799 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560000e90 con 0x7fb5700b1ec0 2021-10-20T23:29:10.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb56f7fe700 1 -- 172.21.15.12:0/4101301799 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb56000d950 con 0x7fb5700b1ec0 2021-10-20T23:29:10.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 -- 172.21.15.12:0/4101301799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b1ec0 msgr2=0x7fb5700b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:10.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 --2- 172.21.15.12:0/4101301799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b1ec0 0x7fb5700b12d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fb560002f70 tx=0x7fb560006eb0).stop 2021-10-20T23:29:10.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 -- 172.21.15.12:0/4101301799 shutdown_connections 2021-10-20T23:29:10.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 --2- 172.21.15.12:0/4101301799 >> v2:172.21.15.31:3300/0 conn(0x7fb5700b22a0 0x7fb570141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 --2- 172.21.15.12:0/4101301799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b1ec0 0x7fb5700b12d0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 -- 172.21.15.12:0/4101301799 >> 172.21.15.12:0/4101301799 conn(0x7fb57005f6b0 msgr2=0x7fb57005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:10.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 -- 172.21.15.12:0/4101301799 shutdown_connections 2021-10-20T23:29:10.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.731+0000 7fb57723c700 1 -- 172.21.15.12:0/4101301799 wait complete. 2021-10-20T23:29:10.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.735+0000 7fb57723c700 1 Processor -- start 2021-10-20T23:29:10.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.735+0000 7fb57723c700 1 -- start start 2021-10-20T23:29:10.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb57723c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5700affb0 0x7fb570140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:10.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb57723c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5700b1ec0 0x7fb5700aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:10.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb57723c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b22a0 0x7fb57015aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:10.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb57723c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700a9420 con 0x7fb5700b22a0 2021-10-20T23:29:10.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb57723c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57015a3f0 con 0x7fb5700affb0 2021-10-20T23:29:10.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb57723c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700a98f0 con 0x7fb5700b1ec0 2021-10-20T23:29:10.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb574fd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5700affb0 0x7fb570140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:10.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb5757d9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b22a0 0x7fb57015aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:10.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb574fd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5700affb0 0x7fb570140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:60158/0 (socket says 172.21.15.12:60158) 2021-10-20T23:29:10.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb574fd8700 1 -- 172.21.15.12:0/397715127 learned_addr learned my addr 172.21.15.12:0/397715127 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:10.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb56ffff700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5700b1ec0 0x7fb5700aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:10.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb5757d9700 1 -- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5700b1ec0 msgr2=0x7fb5700aa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:10.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb5757d9700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5700b1ec0 0x7fb5700aa3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb5757d9700 1 -- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5700affb0 msgr2=0x7fb570140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:10.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb5757d9700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5700affb0 0x7fb570140290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb5757d9700 1 -- 172.21.15.12:0/397715127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56000b1e0 con 0x7fb5700b22a0 2021-10-20T23:29:10.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb574fd8700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5700affb0 0x7fb570140290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:10.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb5757d9700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b22a0 0x7fb57015aaf0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fb56800c000 tx=0x7fb5680091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:10.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb56dffb700 1 -- 172.21.15.12:0/397715127 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb568012600 con 0x7fb5700b22a0 2021-10-20T23:29:10.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb56dffb700 1 -- 172.21.15.12:0/397715127 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568012760 con 0x7fb5700b22a0 2021-10-20T23:29:10.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5700a9650 con 0x7fb5700b22a0 2021-10-20T23:29:10.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb56dffb700 1 -- 172.21.15.12:0/397715127 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb568012ac0 con 0x7fb5700b22a0 2021-10-20T23:29:10.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb570149d00 con 0x7fb5700b22a0 2021-10-20T23:29:10.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.739+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5700b0b90 con 0x7fb5700b22a0 2021-10-20T23:29:10.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.743+0000 7fb56dffb700 1 -- 172.21.15.12:0/397715127 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb568022070 con 0x7fb5700b22a0 2021-10-20T23:29:10.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.743+0000 7fb56dffb700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5500536d0 0x7fb550055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:10.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.743+0000 7fb56dffb700 1 -- 172.21.15.12:0/397715127 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5954+0+0 (secure 0 0 0) 0x7fb56806c420 con 0x7fb5700b22a0 2021-10-20T23:29:10.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.743+0000 7fb574fd8700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5500536d0 0x7fb550055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:10.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.743+0000 7fb574fd8700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5500536d0 0x7fb550055b90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fb56001c000 tx=0x7fb560015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:10.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.747+0000 7fb56dffb700 1 -- 172.21.15.12:0/397715127 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb568043590 con 0x7fb5700b22a0 2021-10-20T23:29:10.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.875+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fb570057350 con 0x7fb5700b22a0 2021-10-20T23:29:10.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.939+0000 7fb56dffb700 1 -- 172.21.15.12:0/397715127 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v149) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb568046bb0 con 0x7fb5700b22a0 2021-10-20T23:29:10.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5500536d0 msgr2=0x7fb550055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:10.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5500536d0 0x7fb550055b90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fb56001c000 tx=0x7fb560015000).stop 2021-10-20T23:29:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b22a0 msgr2=0x7fb57015aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b22a0 0x7fb57015aaf0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fb56800c000 tx=0x7fb5680091d0).stop 2021-10-20T23:29:10.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 shutdown_connections 2021-10-20T23:29:10.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb5500536d0 0x7fb550055b90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5700b22a0 0x7fb57015aaf0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5700b1ec0 0x7fb5700aa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 --2- 172.21.15.12:0/397715127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5700affb0 0x7fb570140290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 >> 172.21.15.12:0/397715127 conn(0x7fb57005f6b0 msgr2=0x7fb5700af700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 shutdown_connections 2021-10-20T23:29:10.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:10.943+0000 7fb57723c700 1 -- 172.21.15.12:0/397715127 wait complete. 2021-10-20T23:29:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:29:10.972 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:29:11.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.071+0000 7fa8bd6e8700 1 Processor -- start 2021-10-20T23:29:11.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.071+0000 7fa8bd6e8700 1 -- start start 2021-10-20T23:29:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.071+0000 7fa8bd6e8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa8b8060100 0x7fa8b8066480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.071+0000 7fa8bd6e8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8b8066970 0x7fa8b814b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.071+0000 7fa8bd6e8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b80604e0 con 0x7fa8b80b3740 2021-10-20T23:29:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.071+0000 7fa8bd6e8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b8065aa0 con 0x7fa8b8066970 2021-10-20T23:29:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.071+0000 7fa8bd6e8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b8065d40 con 0x7fa8b8060100 2021-10-20T23:29:11.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8b8066970 0x7fa8b814b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b67fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa8b80b3740 0x7fa8b814ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43788/0 (socket says 172.21.15.12:43788) 2021-10-20T23:29:11.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b67fc700 1 -- 172.21.15.12:0/2031283381 learned_addr learned my addr 172.21.15.12:0/2031283381 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:11.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b6ffd700 1 --2- 172.21.15.12:0/2031283381 >> v2:172.21.15.31:3300/0 conn(0x7fa8b8060100 0x7fa8b8066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/2031283381 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981845870 0 0) 0x7fa8b80604e0 con 0x7fa8b80b3740 2021-10-20T23:29:11.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/2031283381 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c003260 con 0x7fa8b80b3740 2021-10-20T23:29:11.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b6ffd700 1 -- 172.21.15.12:0/2031283381 >> v2:172.21.15.12:3300/0 conn(0x7fa8b8066970 msgr2=0x7fa8b814b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:11.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b6ffd700 1 --2- 172.21.15.12:0/2031283381 >> v2:172.21.15.12:3300/0 conn(0x7fa8b8066970 0x7fa8b814b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b6ffd700 1 -- 172.21.15.12:0/2031283381 >> v1:172.21.15.12:6789/0 conn(0x7fa8b80b3740 legacy=0x7fa8b814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b6ffd700 1 -- 172.21.15.12:0/2031283381 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8065fe0 con 0x7fa8b8060100 2021-10-20T23:29:11.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b6ffd700 1 --2- 172.21.15.12:0/2031283381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b8060100 0x7fa8b8066480 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fa8a80032f0 tx=0x7fa8a80091d0).ready entity=mon.1 client_cookie=1beb1fbde335c536 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/2031283381 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8a800b600 con 0x7fa8b8060100 2021-10-20T23:29:11.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/2031283381 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a800b760 con 0x7fa8b8060100 2021-10-20T23:29:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/2031283381 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8a800b8d0 con 0x7fa8b8060100 2021-10-20T23:29:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2031283381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b8060100 msgr2=0x7fa8b8066480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8bd6e8700 1 --2- 172.21.15.12:0/2031283381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b8060100 0x7fa8b8066480 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fa8a80032f0 tx=0x7fa8a80091d0).stop 2021-10-20T23:29:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2031283381 shutdown_connections 2021-10-20T23:29:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8bd6e8700 1 --2- 172.21.15.12:0/2031283381 >> v2:172.21.15.12:3300/0 conn(0x7fa8b8066970 0x7fa8b814b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8bd6e8700 1 --2- 172.21.15.12:0/2031283381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b8060100 0x7fa8b8066480 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2031283381 >> 172.21.15.12:0/2031283381 conn(0x7fa8b805cf30 msgr2=0x7fa8b805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2031283381 shutdown_connections 2021-10-20T23:29:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.075+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2031283381 wait complete. 2021-10-20T23:29:11.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8bd6e8700 1 Processor -- start 2021-10-20T23:29:11.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8bd6e8700 1 -- start start 2021-10-20T23:29:11.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8bd6e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b8060100 0x7fa8b80a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8bd6e8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8b8066970 0x7fa8b80aa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8bd6e8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80b3740 0x7fa8b80aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8bd6e8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80b0b70 con 0x7fa8b8066970 2021-10-20T23:29:11.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8bd6e8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80b18c0 con 0x7fa8b80b3740 2021-10-20T23:29:11.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8bd6e8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80b1620 con 0x7fa8b8060100 2021-10-20T23:29:11.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8b8066970 0x7fa8b80aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8b8066970 0x7fa8b80aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45200/0 (socket says 172.21.15.12:45200) 2021-10-20T23:29:11.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8b67fc700 1 -- 172.21.15.12:0/2653949638 learned_addr learned my addr 172.21.15.12:0/2653949638 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:11.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8b6ffd700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b8060100 0x7fa8b80a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.079+0000 7fa8b77fe700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80b3740 0x7fa8b80aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8b67fc700 1 -- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b8060100 msgr2=0x7fa8b80a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8b67fc700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b8060100 0x7fa8b80a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8b67fc700 1 -- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80b3740 msgr2=0x7fa8b80aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8b67fc700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80b3740 0x7fa8b80aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8b67fc700 1 -- 172.21.15.12:0/2653949638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a8009470 con 0x7fa8b8066970 2021-10-20T23:29:11.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8b67fc700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8b8066970 0x7fa8b80aa160 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7fa8ac001110 tx=0x7fa8ac007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8a7fff700 1 -- 172.21.15.12:0/2653949638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8ac00ce60 con 0x7fa8b8066970 2021-10-20T23:29:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8a7fff700 1 -- 172.21.15.12:0/2653949638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac007110 con 0x7fa8b8066970 2021-10-20T23:29:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b809fcc0 con 0x7fa8b8066970 2021-10-20T23:29:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8a7fff700 1 -- 172.21.15.12:0/2653949638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8ac007470 con 0x7fa8b8066970 2021-10-20T23:29:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b80b0fd0 con 0x7fa8b8066970 2021-10-20T23:29:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b8061c10 con 0x7fa8b8066970 2021-10-20T23:29:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.083+0000 7fa8a7fff700 1 -- 172.21.15.12:0/2653949638 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa8ac01b070 con 0x7fa8b8066970 2021-10-20T23:29:11.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.087+0000 7fa8a7fff700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa894053640 0x7fa894055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.087+0000 7fa8a7fff700 1 -- 172.21.15.12:0/2653949638 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fa8ac06ae10 con 0x7fa8b8066970 2021-10-20T23:29:11.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.087+0000 7fa8b6ffd700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa894053640 0x7fa894055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.087+0000 7fa8b6ffd700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa894053640 0x7fa894055b00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fa8a801b000 tx=0x7fa8a8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.091+0000 7fa8a7fff700 1 -- 172.21.15.12:0/2653949638 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8ac041e90 con 0x7fa8b8066970 2021-10-20T23:29:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.259+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fa8b8057350 con 0x7fa8b8066970 2021-10-20T23:29:11.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.267+0000 7fa8a7fff700 1 -- 172.21.15.12:0/2653949638 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v76) v1 ==== 189+0+0 (secure 0 0 0) 0x7fa8ac0454b0 con 0x7fa8b8066970 2021-10-20T23:29:11.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa894053640 msgr2=0x7fa894055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa894053640 0x7fa894055b00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fa8a801b000 tx=0x7fa8a8016000).stop 2021-10-20T23:29:11.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8b8066970 msgr2=0x7fa8b80aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8b8066970 0x7fa8b80aa160 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7fa8ac001110 tx=0x7fa8ac007a20).stop 2021-10-20T23:29:11.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 shutdown_connections 2021-10-20T23:29:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa894053640 0x7fa894055b00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80b3740 0x7fa8b80aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8b8066970 0x7fa8b80aa160 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 --2- 172.21.15.12:0/2653949638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b8060100 0x7fa8b80a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 >> 172.21.15.12:0/2653949638 conn(0x7fa8b805cf30 msgr2=0x7fa8b80b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 shutdown_connections 2021-10-20T23:29:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.279+0000 7fa8bd6e8700 1 -- 172.21.15.12:0/2653949638 wait complete. 2021-10-20T23:29:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 27 and data pool 28 2021-10-20T23:29:11.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:11.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.387+0000 7f8e87308700 1 Processor -- start 2021-10-20T23:29:11.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.387+0000 7f8e87308700 1 -- start start 2021-10-20T23:29:11.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.387+0000 7f8e87308700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e800b2580 0x7f8e8014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.387+0000 7f8e87308700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 0x7f8e8014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.387+0000 7f8e87308700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e800afbd0 0x7f8e800a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.387+0000 7f8e87308700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e800a70c0 con 0x7f8e800afbd0 2021-10-20T23:29:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.387+0000 7f8e87308700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e800a72f0 con 0x7f8e800b2580 2021-10-20T23:29:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.387+0000 7f8e87308700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800a7590 con 0x7f8e800b0010 2021-10-20T23:29:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.387+0000 7f8e86b07700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e800afbd0 0x7f8e800a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e86b07700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e800afbd0 0x7f8e800a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45220/0 (socket says 172.21.15.12:45220) 2021-10-20T23:29:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e86b07700 1 -- 172.21.15.12:0/1157788784 learned_addr learned my addr 172.21.15.12:0/1157788784 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e86306700 1 --2- 172.21.15.12:0/1157788784 >> v2:172.21.15.31:3300/0 conn(0x7f8e800b2580 0x7f8e8014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e85b05700 1 --2- 172.21.15.12:0/1157788784 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 0x7f8e8014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e86b07700 1 -- 172.21.15.12:0/1157788784 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 msgr2=0x7f8e8014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:11.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e86b07700 1 --2- 172.21.15.12:0/1157788784 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 0x7f8e8014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e86b07700 1 -- 172.21.15.12:0/1157788784 >> v2:172.21.15.31:3300/0 conn(0x7f8e800b2580 msgr2=0x7f8e8014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:11.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e86b07700 1 --2- 172.21.15.12:0/1157788784 >> v2:172.21.15.31:3300/0 conn(0x7f8e800b2580 0x7f8e8014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e86b07700 1 -- 172.21.15.12:0/1157788784 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800a7830 con 0x7f8e800afbd0 2021-10-20T23:29:11.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e85b05700 1 --2- 172.21.15.12:0/1157788784 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 0x7f8e8014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:11.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e86b07700 1 --2- 172.21.15.12:0/1157788784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 0x7f8e800a83b0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f8e70002f70 tx=0x7f8e70006eb0).ready entity=mon.0 client_cookie=b5d5251da19d9abb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e85304700 1 -- 172.21.15.12:0/1157788784 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7000d570 con 0x7f8e800afbd0 2021-10-20T23:29:11.407 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e85304700 1 -- 172.21.15.12:0/1157788784 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70000e90 con 0x7f8e800afbd0 2021-10-20T23:29:11.408 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e85304700 1 -- 172.21.15.12:0/1157788784 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7000d900 con 0x7f8e800afbd0 2021-10-20T23:29:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 -- 172.21.15.12:0/1157788784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 msgr2=0x7f8e800a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 --2- 172.21.15.12:0/1157788784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 0x7f8e800a83b0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f8e70002f70 tx=0x7f8e70006eb0).stop 2021-10-20T23:29:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 -- 172.21.15.12:0/1157788784 shutdown_connections 2021-10-20T23:29:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 --2- 172.21.15.12:0/1157788784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 0x7f8e800a83b0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 --2- 172.21.15.12:0/1157788784 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 0x7f8e8014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 --2- 172.21.15.12:0/1157788784 >> v2:172.21.15.31:3300/0 conn(0x7f8e800b2580 0x7f8e8014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 -- 172.21.15.12:0/1157788784 >> 172.21.15.12:0/1157788784 conn(0x7f8e80060180 msgr2=0x7f8e800b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:11.413 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 -- 172.21.15.12:0/1157788784 shutdown_connections 2021-10-20T23:29:11.414 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 -- 172.21.15.12:0/1157788784 wait complete. 2021-10-20T23:29:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 Processor -- start 2021-10-20T23:29:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.391+0000 7f8e87308700 1 -- start start 2021-10-20T23:29:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e87308700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 0x7f8e80063d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e87308700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 0x7f8e800a9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e87308700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e800b2580 0x7f8e80156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e87308700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800aa200 con 0x7f8e800afbd0 2021-10-20T23:29:11.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e87308700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800aadf0 con 0x7f8e800b2580 2021-10-20T23:29:11.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e87308700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800ab030 con 0x7f8e800b0010 2021-10-20T23:29:11.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86306700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 0x7f8e80063d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86306700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 0x7f8e80063d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45224/0 (socket says 172.21.15.12:45224) 2021-10-20T23:29:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86306700 1 -- 172.21.15.12:0/3461877880 learned_addr learned my addr 172.21.15.12:0/3461877880 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86b07700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e800b2580 0x7f8e80156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e85b05700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 0x7f8e800a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86306700 1 -- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 msgr2=0x7f8e800a9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86306700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 0x7f8e800a9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86306700 1 -- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e800b2580 msgr2=0x7f8e80156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86306700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e800b2580 0x7f8e80156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86306700 1 -- 172.21.15.12:0/3461877880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7000b1e0 con 0x7f8e800afbd0 2021-10-20T23:29:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86b07700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e800b2580 0x7f8e80156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e86306700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 0x7f8e80063d90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f8e7800c000 tx=0x7f8e780091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e7f7fe700 1 -- 172.21.15.12:0/3461877880 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7800c7f0 con 0x7f8e800afbd0 2021-10-20T23:29:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e7f7fe700 1 -- 172.21.15.12:0/3461877880 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7800c950 con 0x7f8e800afbd0 2021-10-20T23:29:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e800ab2d0 con 0x7f8e800afbd0 2021-10-20T23:29:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e7f7fe700 1 -- 172.21.15.12:0/3461877880 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7800ccb0 con 0x7f8e800afbd0 2021-10-20T23:29:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e800638f0 con 0x7f8e800afbd0 2021-10-20T23:29:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e80063ab0 con 0x7f8e800afbd0 2021-10-20T23:29:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.395+0000 7f8e7f7fe700 1 -- 172.21.15.12:0/3461877880 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8e78022070 con 0x7f8e800afbd0 2021-10-20T23:29:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.399+0000 7f8e7f7fe700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e60053580 0x7f8e60055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.399+0000 7f8e7f7fe700 1 -- 172.21.15.12:0/3461877880 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8e7806c1d0 con 0x7f8e800afbd0 2021-10-20T23:29:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.399+0000 7f8e85b05700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e60053580 0x7f8e60055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.399+0000 7f8e85b05700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e60053580 0x7f8e60055a40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f8e7400c000 tx=0x7f8e74008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.403+0000 7f8e7f7fe700 1 -- 172.21.15.12:0/3461877880 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8e780431d0 con 0x7f8e800afbd0 2021-10-20T23:29:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.527+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e80057350 con 0x7f8e800afbd0 2021-10-20T23:29:11.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.527+0000 7f8e7f7fe700 1 -- 172.21.15.12:0/3461877880 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16311 (secure 0 0 0) 0x7f8e780467f0 con 0x7f8e800afbd0 2021-10-20T23:29:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:11.539 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":151,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:11.261903+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:10.102100+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:10.930461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e60053580 msgr2=0x7f8e60055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e60053580 0x7f8e60055a40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f8e7400c000 tx=0x7f8e74008040).stop 2021-10-20T23:29:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 msgr2=0x7f8e80063d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 0x7f8e80063d90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f8e7800c000 tx=0x7f8e780091d0).stop 2021-10-20T23:29:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 shutdown_connections 2021-10-20T23:29:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8e60053580 0x7f8e60055a40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e800b2580 0x7f8e80156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e800b0010 0x7f8e800a9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 --2- 172.21.15.12:0/3461877880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e800afbd0 0x7f8e80063d90 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 >> 172.21.15.12:0/3461877880 conn(0x7f8e80060180 msgr2=0x7f8e800ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:11.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 shutdown_connections 2021-10-20T23:29:11.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.531+0000 7f8e87308700 1 -- 172.21.15.12:0/3461877880 wait complete. 2021-10-20T23:29:11.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:11.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.655+0000 7f88d490d700 1 Processor -- start 2021-10-20T23:29:11.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 -- start start 2021-10-20T23:29:11.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88d00b1db0 0x7f88d00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f88d01483a0 0x7f88d00b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.671 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d00b0350 con 0x7f88d00a70c0 2021-10-20T23:29:11.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d00a90c0 con 0x7f88d00b1db0 2021-10-20T23:29:11.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d00b05f0 con 0x7f88d01483a0 2021-10-20T23:29:11.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88ce59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88d00b1db0 0x7f88d00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.672 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88ce59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88d00b1db0 0x7f88d00b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45234/0 (socket says 172.21.15.12:45234) 2021-10-20T23:29:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88ce59c700 1 -- 172.21.15.12:0/1788247125 learned_addr learned my addr 172.21.15.12:0/1788247125 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88cdd9b700 1 --2- 172.21.15.12:0/1788247125 >> v2:172.21.15.31:3300/0 conn(0x7f88d01483a0 0x7f88d00b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.673 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88ce59c700 1 -- 172.21.15.12:0/1788247125 >> v2:172.21.15.31:3300/0 conn(0x7f88d01483a0 msgr2=0x7f88d00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:11.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88ce59c700 1 --2- 172.21.15.12:0/1788247125 >> v2:172.21.15.31:3300/0 conn(0x7f88d01483a0 0x7f88d00b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88ce59c700 1 -- 172.21.15.12:0/1788247125 >> v1:172.21.15.31:6789/0 conn(0x7f88d00a70c0 legacy=0x7f88d0144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88ce59c700 1 -- 172.21.15.12:0/1788247125 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d00b0890 con 0x7f88d00b1db0 2021-10-20T23:29:11.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88ce59c700 1 --2- 172.21.15.12:0/1788247125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d00b1db0 0x7f88d00b0fd0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f88d0147730 tx=0x7f88c4006eb0).ready entity=mon.0 client_cookie=f51c50dc579402cc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88cd59a700 1 -- 172.21.15.12:0/1788247125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88c400d610 con 0x7f88d00b1db0 2021-10-20T23:29:11.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88cd59a700 1 -- 172.21.15.12:0/1788247125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c4000e90 con 0x7f88d00b1db0 2021-10-20T23:29:11.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88cd59a700 1 -- 172.21.15.12:0/1788247125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88c400d9a0 con 0x7f88d00b1db0 2021-10-20T23:29:11.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 -- 172.21.15.12:0/1788247125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d00b1db0 msgr2=0x7f88d00b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 --2- 172.21.15.12:0/1788247125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d00b1db0 0x7f88d00b0fd0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f88d0147730 tx=0x7f88c4006eb0).stop 2021-10-20T23:29:11.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 -- 172.21.15.12:0/1788247125 shutdown_connections 2021-10-20T23:29:11.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 --2- 172.21.15.12:0/1788247125 >> v2:172.21.15.31:3300/0 conn(0x7f88d01483a0 0x7f88d00b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 --2- 172.21.15.12:0/1788247125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d00b1db0 0x7f88d00b0fd0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 -- 172.21.15.12:0/1788247125 >> 172.21.15.12:0/1788247125 conn(0x7f88d005f6b0 msgr2=0x7f88d005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:11.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 -- 172.21.15.12:0/1788247125 shutdown_connections 2021-10-20T23:29:11.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.659+0000 7f88d490d700 1 -- 172.21.15.12:0/1788247125 wait complete. 2021-10-20T23:29:11.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 Processor -- start 2021-10-20T23:29:11.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 -- start start 2021-10-20T23:29:11.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88d00a70c0 0x7f88d00ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88d00b1db0 0x7f88d00ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d01483a0 0x7f88d00ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d014a5d0 con 0x7f88d01483a0 2021-10-20T23:29:11.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d014b420 con 0x7f88d00a70c0 2021-10-20T23:29:11.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d014a240 con 0x7f88d00b1db0 2021-10-20T23:29:11.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ced9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d01483a0 0x7f88d00ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ced9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d01483a0 0x7f88d00ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45240/0 (socket says 172.21.15.12:45240) 2021-10-20T23:29:11.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ced9d700 1 -- 172.21.15.12:0/3728169996 learned_addr learned my addr 172.21.15.12:0/3728169996 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:11.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ce59c700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88d00a70c0 0x7f88d00ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88cdd9b700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88d00b1db0 0x7f88d00ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ced9d700 1 -- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88d00b1db0 msgr2=0x7f88d00ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ced9d700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88d00b1db0 0x7f88d00ab1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ced9d700 1 -- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88d00a70c0 msgr2=0x7f88d00ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ced9d700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88d00a70c0 0x7f88d00ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ced9d700 1 -- 172.21.15.12:0/3728169996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c400b1e0 con 0x7f88d01483a0 2021-10-20T23:29:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ce59c700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88d00a70c0 0x7f88d00ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88ced9d700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d01483a0 0x7f88d00ab6c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f88d00ace60 tx=0x7f88c8007f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88bf7fe700 1 -- 172.21.15.12:0/3728169996 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88c800e4a0 con 0x7f88d01483a0 2021-10-20T23:29:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d014a800 con 0x7f88d01483a0 2021-10-20T23:29:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88bf7fe700 1 -- 172.21.15.12:0/3728169996 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c800e600 con 0x7f88d01483a0 2021-10-20T23:29:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88bf7fe700 1 -- 172.21.15.12:0/3728169996 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88c800e960 con 0x7f88d01483a0 2021-10-20T23:29:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.663+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d0149100 con 0x7f88d01483a0 2021-10-20T23:29:11.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.667+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d0149e60 con 0x7f88d01483a0 2021-10-20T23:29:11.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.667+0000 7f88bf7fe700 1 -- 172.21.15.12:0/3728169996 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f88c8019030 con 0x7f88d01483a0 2021-10-20T23:29:11.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.667+0000 7f88bf7fe700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88ac053640 0x7f88ac055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.667+0000 7f88bf7fe700 1 -- 172.21.15.12:0/3728169996 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f88c806b320 con 0x7f88d01483a0 2021-10-20T23:29:11.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.667+0000 7f88ce59c700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88ac053640 0x7f88ac055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.667+0000 7f88ce59c700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88ac053640 0x7f88ac055b00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f88c401a000 tx=0x7f88c4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.691 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.675+0000 7f88bf7fe700 1 -- 172.21.15.12:0/3728169996 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88c8042190 con 0x7f88d01483a0 2021-10-20T23:29:11.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.795+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88d00b0b30 con 0x7f88d01483a0 2021-10-20T23:29:11.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88bf7fe700 1 -- 172.21.15.12:0/3728169996 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16311 (secure 0 0 0) 0x7f88c8017020 con 0x7f88d01483a0 2021-10-20T23:29:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:11.815 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":151,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:11.261903+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:10.102100+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:10.930461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88ac053640 msgr2=0x7f88ac055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88ac053640 0x7f88ac055b00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f88c401a000 tx=0x7f88c4015000).stop 2021-10-20T23:29:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d01483a0 msgr2=0x7f88d00ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d01483a0 0x7f88d00ab6c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f88d00ace60 tx=0x7f88c8007f00).stop 2021-10-20T23:29:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 shutdown_connections 2021-10-20T23:29:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f88ac053640 0x7f88ac055b00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88d01483a0 0x7f88d00ab6c0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88d00b1db0 0x7f88d00ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 --2- 172.21.15.12:0/3728169996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88d00a70c0 0x7f88d00ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 >> 172.21.15.12:0/3728169996 conn(0x7f88d005f6b0 msgr2=0x7f88d0144830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:11.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 shutdown_connections 2021-10-20T23:29:11.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.799+0000 7f88d490d700 1 -- 172.21.15.12:0/3728169996 wait complete. 2021-10-20T23:29:11.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:29:11.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.927+0000 7fb6ed62a700 1 Processor -- start 2021-10-20T23:29:11.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.927+0000 7fb6ed62a700 1 -- start start 2021-10-20T23:29:11.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.927+0000 7fb6ed62a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e80b4060 0x7fb6e8061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.927+0000 7fb6ed62a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6e8142e60 0x7fb6e8143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.927+0000 7fb6ed62a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e80b5f50 con 0x7fb6e80b6290 2021-10-20T23:29:11.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.927+0000 7fb6ed62a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e80b1f70 con 0x7fb6e8142e60 2021-10-20T23:29:11.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.927+0000 7fb6ed62a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e80b2210 con 0x7fb6e80b4060 2021-10-20T23:29:11.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.927+0000 7fb6ece29700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6e8142e60 0x7fb6e8143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.927+0000 7fb6e77fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e80b4060 0x7fb6e8061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ece29700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6e8142e60 0x7fb6e8143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45250/0 (socket says 172.21.15.12:45250) 2021-10-20T23:29:11.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ece29700 1 -- 172.21.15.12:0/1425717215 learned_addr learned my addr 172.21.15.12:0/1425717215 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:11.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6e7fff700 1 --1- 172.21.15.12:0/1425717215 >> v1:172.21.15.31:6789/0 conn(0x7fb6e80b6290 0x7fb6e8061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:50904/0 (socket says 172.21.15.12:50904) 2021-10-20T23:29:11.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ece29700 1 -- 172.21.15.12:0/1425717215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e80b4060 msgr2=0x7fb6e8061b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:11.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ece29700 1 --2- 172.21.15.12:0/1425717215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e80b4060 0x7fb6e8061b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ece29700 1 -- 172.21.15.12:0/1425717215 >> v1:172.21.15.31:6789/0 conn(0x7fb6e80b6290 legacy=0x7fb6e8061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ece29700 1 -- 172.21.15.12:0/1425717215 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e80b24b0 con 0x7fb6e8142e60 2021-10-20T23:29:11.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ece29700 1 --2- 172.21.15.12:0/1425717215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e8142e60 0x7fb6e8143310 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7fb6e00032f0 tx=0x7fb6e0009290).ready entity=mon.0 client_cookie=2569dfc87e1ef322 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6e6ffd700 1 -- 172.21.15.12:0/1425717215 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e000b8a0 con 0x7fb6e8142e60 2021-10-20T23:29:11.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6e6ffd700 1 -- 172.21.15.12:0/1425717215 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e000ba00 con 0x7fb6e8142e60 2021-10-20T23:29:11.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6e6ffd700 1 -- 172.21.15.12:0/1425717215 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e000bb70 con 0x7fb6e8142e60 2021-10-20T23:29:11.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ed62a700 1 -- 172.21.15.12:0/1425717215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e8142e60 msgr2=0x7fb6e8143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ed62a700 1 --2- 172.21.15.12:0/1425717215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e8142e60 0x7fb6e8143310 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7fb6e00032f0 tx=0x7fb6e0009290).stop 2021-10-20T23:29:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ed62a700 1 -- 172.21.15.12:0/1425717215 shutdown_connections 2021-10-20T23:29:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ed62a700 1 --2- 172.21.15.12:0/1425717215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e8142e60 0x7fb6e8143310 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ed62a700 1 --2- 172.21.15.12:0/1425717215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e80b4060 0x7fb6e8061b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ed62a700 1 -- 172.21.15.12:0/1425717215 >> 172.21.15.12:0/1425717215 conn(0x7fb6e805c490 msgr2=0x7fb6e805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:11.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ed62a700 1 -- 172.21.15.12:0/1425717215 shutdown_connections 2021-10-20T23:29:11.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.931+0000 7fb6ed62a700 1 -- 172.21.15.12:0/1425717215 wait complete. 2021-10-20T23:29:11.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6ed62a700 1 Processor -- start 2021-10-20T23:29:11.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6ed62a700 1 -- start start 2021-10-20T23:29:11.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6ed62a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e80b4060 0x7fb6e80b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6ed62a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6e80b6290 0x7fb6e812adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6ed62a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8142e60 0x7fb6e812b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6ed62a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e813f720 con 0x7fb6e80b4060 2021-10-20T23:29:11.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6ed62a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e813fca0 con 0x7fb6e80b6290 2021-10-20T23:29:11.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6ed62a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e813ff40 con 0x7fb6e8142e60 2021-10-20T23:29:11.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e80b4060 0x7fb6e80b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e80b4060 0x7fb6e80b98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45252/0 (socket says 172.21.15.12:45252) 2021-10-20T23:29:11.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6e7fff700 1 -- 172.21.15.12:0/617233870 learned_addr learned my addr 172.21.15.12:0/617233870 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:11.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6ece29700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8142e60 0x7fb6e812b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6e77fe700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6e80b6290 0x7fb6e812adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6e7fff700 1 -- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8142e60 msgr2=0x7fb6e812b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6e7fff700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8142e60 0x7fb6e812b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6e7fff700 1 -- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6e80b6290 msgr2=0x7fb6e812adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:11.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6e7fff700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6e80b6290 0x7fb6e812adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:11.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.935+0000 7fb6e7fff700 1 -- 172.21.15.12:0/617233870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e0009530 con 0x7fb6e80b4060 2021-10-20T23:29:11.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.939+0000 7fb6e7fff700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e80b4060 0x7fb6e80b98d0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fb6e806aae0 tx=0x7fb6d8007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.939+0000 7fb6e57fa700 1 -- 172.21.15.12:0/617233870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d80070d0 con 0x7fb6e80b4060 2021-10-20T23:29:11.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.939+0000 7fb6e57fa700 1 -- 172.21.15.12:0/617233870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d8007230 con 0x7fb6e80b4060 2021-10-20T23:29:11.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.939+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e812b7d0 con 0x7fb6e80b4060 2021-10-20T23:29:11.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.939+0000 7fb6e57fa700 1 -- 172.21.15.12:0/617233870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d8005550 con 0x7fb6e80b4060 2021-10-20T23:29:11.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.939+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e813f210 con 0x7fb6e80b4060 2021-10-20T23:29:11.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.939+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e8140100 con 0x7fb6e80b4060 2021-10-20T23:29:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.939+0000 7fb6e57fa700 1 -- 172.21.15.12:0/617233870 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6d8010070 con 0x7fb6e80b4060 2021-10-20T23:29:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.943+0000 7fb6e57fa700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6cc053580 0x7fb6cc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.943+0000 7fb6e57fa700 1 -- 172.21.15.12:0/617233870 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb6d806af60 con 0x7fb6e80b4060 2021-10-20T23:29:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.943+0000 7fb6e77fe700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6cc053580 0x7fb6cc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.943+0000 7fb6e77fe700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6cc053580 0x7fb6cc055a40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fb6d000b000 tx=0x7fb6d0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:11.947+0000 7fb6e57fa700 1 -- 172.21.15.12:0/617233870 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6d8041f60 con 0x7fb6e80b4060 2021-10-20T23:29:12.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.111+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb6e80b5f50 con 0x7fb6e80b4060 2021-10-20T23:29:13.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6e57fa700 1 -- 172.21.15.12:0/617233870 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v78) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb6e80b5f50 con 0x7fb6e80b4060 2021-10-20T23:29:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6cc053580 msgr2=0x7fb6cc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6cc053580 0x7fb6cc055a40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fb6d000b000 tx=0x7fb6d0006df0).stop 2021-10-20T23:29:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e80b4060 msgr2=0x7fb6e80b98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e80b4060 0x7fb6e80b98d0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fb6e806aae0 tx=0x7fb6d8007c40).stop 2021-10-20T23:29:13.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 shutdown_connections 2021-10-20T23:29:13.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6cc053580 0x7fb6cc055a40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8142e60 0x7fb6e812b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6e80b6290 0x7fb6e812adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 --2- 172.21.15.12:0/617233870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e80b4060 0x7fb6e80b98d0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:12.999+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 >> 172.21.15.12:0/617233870 conn(0x7fb6e805c490 msgr2=0x7fb6e80b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.003+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 shutdown_connections 2021-10-20T23:29:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.003+0000 7fb6ed62a700 1 -- 172.21.15.12:0/617233870 wait complete. 2021-10-20T23:29:13.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:13.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973e50e700 1 Processor -- start 2021-10-20T23:29:13.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973e50e700 1 -- start start 2021-10-20T23:29:13.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973e50e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f97380b0710 0x7f9738142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973e50e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 0x7f973813f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973e50e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9738143920 con 0x7f97380b30d0 2021-10-20T23:29:13.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973e50e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97380b0af0 con 0x7f97380b0710 2021-10-20T23:29:13.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973e50e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380ae680 con 0x7f97380ace70 2021-10-20T23:29:13.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973d50c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f97380b0710 0x7f9738142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973cd0b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f97380b30d0 0x7f9738143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43858/0 (socket says 172.21.15.12:43858) 2021-10-20T23:29:13.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973cd0b700 1 -- 172.21.15.12:0/2228391327 learned_addr learned my addr 172.21.15.12:0/2228391327 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:13.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973dd0d700 1 --2- 172.21.15.12:0/2228391327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 0x7f973813f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973d50c700 1 -- 172.21.15.12:0/2228391327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 msgr2=0x7f973813f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:13.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973d50c700 1 --2- 172.21.15.12:0/2228391327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 0x7f973813f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973d50c700 1 -- 172.21.15.12:0/2228391327 >> v1:172.21.15.12:6789/0 conn(0x7f97380b30d0 legacy=0x7f9738143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f9727fff700 1 -- 172.21.15.12:0/2228391327 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340511711 0 0) 0x7f9738143920 con 0x7f97380b30d0 2021-10-20T23:29:13.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973d50c700 1 -- 172.21.15.12:0/2228391327 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380ae920 con 0x7f97380b0710 2021-10-20T23:29:13.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973dd0d700 1 --2- 172.21.15.12:0/2228391327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 0x7f973813f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:13.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.131+0000 7f973d50c700 1 --2- 172.21.15.12:0/2228391327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 0x7f9738142d20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f9734002f70 tx=0x7f9734006df0).ready entity=mon.0 client_cookie=825c2f275ac8e788 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:13.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f9727fff700 1 -- 172.21.15.12:0/2228391327 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f973400d570 con 0x7f97380b0710 2021-10-20T23:29:13.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f9727fff700 1 -- 172.21.15.12:0/2228391327 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9734000e90 con 0x7f97380b0710 2021-10-20T23:29:13.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f9727fff700 1 -- 172.21.15.12:0/2228391327 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f973400d8c0 con 0x7f97380b0710 2021-10-20T23:29:13.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f973e50e700 1 -- 172.21.15.12:0/2228391327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 msgr2=0x7f9738142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f973e50e700 1 --2- 172.21.15.12:0/2228391327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 0x7f9738142d20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f9734002f70 tx=0x7f9734006df0).stop 2021-10-20T23:29:13.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f973e50e700 1 -- 172.21.15.12:0/2228391327 shutdown_connections 2021-10-20T23:29:13.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f973e50e700 1 --2- 172.21.15.12:0/2228391327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 0x7f973813f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f973e50e700 1 --2- 172.21.15.12:0/2228391327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 0x7f9738142d20 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f973e50e700 1 -- 172.21.15.12:0/2228391327 >> 172.21.15.12:0/2228391327 conn(0x7f9738061140 msgr2=0x7f9738062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:13.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f973e50e700 1 -- 172.21.15.12:0/2228391327 shutdown_connections 2021-10-20T23:29:13.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.135+0000 7f973e50e700 1 -- 172.21.15.12:0/2228391327 wait complete. 2021-10-20T23:29:13.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 Processor -- start 2021-10-20T23:29:13.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 -- start start 2021-10-20T23:29:13.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 0x7f97380656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 0x7f97380b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97380b30d0 0x7f97380646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.153 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380ac570 con 0x7f97380b0710 2021-10-20T23:29:13.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9738063a30 con 0x7f97380b30d0 2021-10-20T23:29:13.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9738063cd0 con 0x7f97380ace70 2021-10-20T23:29:13.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973cd0b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 0x7f97380b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973cd0b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 0x7f97380b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45268/0 (socket says 172.21.15.12:45268) 2021-10-20T23:29:13.154 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973cd0b700 1 -- 172.21.15.12:0/2321044821 learned_addr learned my addr 172.21.15.12:0/2321044821 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:13.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973d50c700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 0x7f97380656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973dd0d700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97380b30d0 0x7f97380646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973cd0b700 1 -- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 msgr2=0x7f97380656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973cd0b700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 0x7f97380656b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973cd0b700 1 -- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97380b30d0 msgr2=0x7f97380646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973cd0b700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97380b30d0 0x7f97380646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973cd0b700 1 -- 172.21.15.12:0/2321044821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9730009470 con 0x7f97380b0710 2021-10-20T23:29:13.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973dd0d700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97380b30d0 0x7f97380646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:13.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973cd0b700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 0x7f97380b4ea0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f9728000ed0 tx=0x7f9728007ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:13.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f97267fc700 1 -- 172.21.15.12:0/2321044821 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97280070d0 con 0x7f97380b0710 2021-10-20T23:29:13.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f97267fc700 1 -- 172.21.15.12:0/2321044821 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728007230 con 0x7f97380b0710 2021-10-20T23:29:13.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973400b180 con 0x7f97380b0710 2021-10-20T23:29:13.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f97267fc700 1 -- 172.21.15.12:0/2321044821 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9728005610 con 0x7f97380b0710 2021-10-20T23:29:13.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.139+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9738064210 con 0x7f97380b0710 2021-10-20T23:29:13.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.143+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9738064d40 con 0x7f97380b0710 2021-10-20T23:29:13.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.143+0000 7f97267fc700 1 -- 172.21.15.12:0/2321044821 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f972801a060 con 0x7f97380b0710 2021-10-20T23:29:13.159 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.143+0000 7f97267fc700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9718053580 0x7f9718055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.143+0000 7f97267fc700 1 -- 172.21.15.12:0/2321044821 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f972806b2e0 con 0x7f97380b0710 2021-10-20T23:29:13.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.143+0000 7f973d50c700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9718053580 0x7f9718055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.143+0000 7f973d50c700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9718053580 0x7f9718055a40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f973401a000 tx=0x7f9734014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:13.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.147+0000 7f97267fc700 1 -- 172.21.15.12:0/2321044821 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f97280421d0 con 0x7f97380b0710 2021-10-20T23:29:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.311+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9738057350 con 0x7f97380b0710 2021-10-20T23:29:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f97267fc700 1 -- 172.21.15.12:0/2321044821 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f9728018020 con 0x7f97380b0710 2021-10-20T23:29:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:13.324 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":78,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/4126550791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4126550791},{"type":"v1","addr":"172.21.15.31:6835","nonce":4126550791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/815086520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":815086520},{"type":"v1","addr":"172.21.15.12:6833","nonce":815086520}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:11.262079+0000","modified":"2021-10-20T23:29:12.985920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8427":{"gid":8427,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1414597279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1414597279},{"type":"v1","addr":"172.21.15.12:6835","nonce":1414597279}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-20T23:29:13.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9718053580 msgr2=0x7f9718055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9718053580 0x7f9718055a40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f973401a000 tx=0x7f9734014000).stop 2021-10-20T23:29:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 msgr2=0x7f97380b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 0x7f97380b4ea0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f9728000ed0 tx=0x7f9728007ce0).stop 2021-10-20T23:29:13.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 shutdown_connections 2021-10-20T23:29:13.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9718053580 0x7f9718055a40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97380b30d0 0x7f97380646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97380b0710 0x7f97380b4ea0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 --2- 172.21.15.12:0/2321044821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97380ace70 0x7f97380656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 >> 172.21.15.12:0/2321044821 conn(0x7f9738061140 msgr2=0x7f973813a340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:13.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 shutdown_connections 2021-10-20T23:29:13.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.315+0000 7f973e50e700 1 -- 172.21.15.12:0/2321044821 wait complete. 2021-10-20T23:29:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 78 2021-10-20T23:29:13.341 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.431+0000 7ff99e2c6700 1 Processor -- start 2021-10-20T23:29:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.431+0000 7ff99e2c6700 1 -- start start 2021-10-20T23:29:13.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b0010 0x7ff9980a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9980afbd0 0x7ff9980a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9980a70c0 con 0x7ff9980b2580 2021-10-20T23:29:13.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9980a72f0 con 0x7ff9980afbd0 2021-10-20T23:29:13.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980a7590 con 0x7ff9980b0010 2021-10-20T23:29:13.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99d2c4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff9980b2580 0x7ff99814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:50932/0 (socket says 172.21.15.12:50932) 2021-10-20T23:29:13.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99d2c4700 1 -- 172.21.15.12:0/1947984502 learned_addr learned my addr 172.21.15.12:0/1947984502 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:13.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99cac3700 1 --2- 172.21.15.12:0/1947984502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b0010 0x7ff9980a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99dac5700 1 --2- 172.21.15.12:0/1947984502 >> v2:172.21.15.31:3300/0 conn(0x7ff9980afbd0 0x7ff9980a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff98bfff700 1 -- 172.21.15.12:0/1947984502 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447863108 0 0) 0x7ff9980a70c0 con 0x7ff9980b2580 2021-10-20T23:29:13.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff98bfff700 1 -- 172.21.15.12:0/1947984502 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff97c003260 con 0x7ff9980b2580 2021-10-20T23:29:13.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99cac3700 1 -- 172.21.15.12:0/1947984502 >> v2:172.21.15.31:3300/0 conn(0x7ff9980afbd0 msgr2=0x7ff9980a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:13.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99cac3700 1 --2- 172.21.15.12:0/1947984502 >> v2:172.21.15.31:3300/0 conn(0x7ff9980afbd0 0x7ff9980a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99cac3700 1 -- 172.21.15.12:0/1947984502 >> v1:172.21.15.31:6789/0 conn(0x7ff9980b2580 legacy=0x7ff99814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99cac3700 1 -- 172.21.15.12:0/1947984502 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980a7830 con 0x7ff9980b0010 2021-10-20T23:29:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99cac3700 1 --2- 172.21.15.12:0/1947984502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b0010 0x7ff9980a83b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff98c002f70 tx=0x7ff98c006df0).ready entity=mon.2 client_cookie=5710140164e3ecd6 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff98bfff700 1 -- 172.21.15.12:0/1947984502 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff98c00d4a0 con 0x7ff9980b0010 2021-10-20T23:29:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff98bfff700 1 -- 172.21.15.12:0/1947984502 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c000e90 con 0x7ff9980b0010 2021-10-20T23:29:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff98bfff700 1 -- 172.21.15.12:0/1947984502 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff98c00d7f0 con 0x7ff9980b0010 2021-10-20T23:29:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 -- 172.21.15.12:0/1947984502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b0010 msgr2=0x7ff9980a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 --2- 172.21.15.12:0/1947984502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b0010 0x7ff9980a83b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff98c002f70 tx=0x7ff98c006df0).stop 2021-10-20T23:29:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 -- 172.21.15.12:0/1947984502 shutdown_connections 2021-10-20T23:29:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 --2- 172.21.15.12:0/1947984502 >> v2:172.21.15.31:3300/0 conn(0x7ff9980afbd0 0x7ff9980a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 --2- 172.21.15.12:0/1947984502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b0010 0x7ff9980a83b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 -- 172.21.15.12:0/1947984502 >> 172.21.15.12:0/1947984502 conn(0x7ff998060180 msgr2=0x7ff9980b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 -- 172.21.15.12:0/1947984502 shutdown_connections 2021-10-20T23:29:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.435+0000 7ff99e2c6700 1 -- 172.21.15.12:0/1947984502 wait complete. 2021-10-20T23:29:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 Processor -- start 2021-10-20T23:29:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 -- start start 2021-10-20T23:29:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9980afbd0 0x7ff998144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9980b0010 0x7ff998156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b2580 0x7ff998156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b3150 con 0x7ff9980b0010 2021-10-20T23:29:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b37c0 con 0x7ff9980afbd0 2021-10-20T23:29:13.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b3a60 con 0x7ff9980b2580 2021-10-20T23:29:13.459 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99cac3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9980b0010 0x7ff998156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99dac5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b2580 0x7ff998156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99d2c4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9980afbd0 0x7ff998144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99cac3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9980b0010 0x7ff998156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45282/0 (socket says 172.21.15.12:45282) 2021-10-20T23:29:13.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99cac3700 1 -- 172.21.15.12:0/4242147988 learned_addr learned my addr 172.21.15.12:0/4242147988 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:13.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99cac3700 1 -- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b2580 msgr2=0x7ff998156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99cac3700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b2580 0x7ff998156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99cac3700 1 -- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9980afbd0 msgr2=0x7ff998144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99cac3700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9980afbd0 0x7ff998144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99cac3700 1 -- 172.21.15.12:0/4242147988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c00b180 con 0x7ff9980b0010 2021-10-20T23:29:13.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99cac3700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9980b0010 0x7ff998156680 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7ff98c002f70 tx=0x7ff98c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:13.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff98a7fc700 1 -- 172.21.15.12:0/4242147988 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff98c016070 con 0x7ff9980b0010 2021-10-20T23:29:13.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff98a7fc700 1 -- 172.21.15.12:0/4242147988 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c0138d0 con 0x7ff9980b0010 2021-10-20T23:29:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9980b3d00 con 0x7ff9980b0010 2021-10-20T23:29:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff98a7fc700 1 -- 172.21.15.12:0/4242147988 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff98c013c30 con 0x7ff9980b0010 2021-10-20T23:29:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9980abf10 con 0x7ff9980b0010 2021-10-20T23:29:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.439+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff998057350 con 0x7ff9980b0010 2021-10-20T23:29:13.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.443+0000 7ff98a7fc700 1 -- 172.21.15.12:0/4242147988 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff98c025030 con 0x7ff9980b0010 2021-10-20T23:29:13.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.443+0000 7ff98a7fc700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff980053610 0x7ff980055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.443+0000 7ff98a7fc700 1 -- 172.21.15.12:0/4242147988 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff98c06ca80 con 0x7ff9980b0010 2021-10-20T23:29:13.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.443+0000 7ff99d2c4700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff980053610 0x7ff980055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.443+0000 7ff99d2c4700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff980053610 0x7ff980055ad0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7ff99400d000 tx=0x7ff994009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.447+0000 7ff98a7fc700 1 -- 172.21.15.12:0/4242147988 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff98c043a80 con 0x7ff9980b0010 2021-10-20T23:29:13.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.571+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9981563c0 con 0x7ff9980b0010 2021-10-20T23:29:13.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.571+0000 7ff98a7fc700 1 -- 172.21.15.12:0/4242147988 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16285 (secure 0 0 0) 0x7ff98c0470a0 con 0x7ff9980b0010 2021-10-20T23:29:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:13.582 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":152,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:12.264976+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:10.102100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:10.930461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:13.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff980053610 msgr2=0x7ff980055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff980053610 0x7ff980055ad0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7ff99400d000 tx=0x7ff994009040).stop 2021-10-20T23:29:13.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9980b0010 msgr2=0x7ff998156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9980b0010 0x7ff998156680 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7ff98c002f70 tx=0x7ff98c014000).stop 2021-10-20T23:29:13.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 shutdown_connections 2021-10-20T23:29:13.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff980053610 0x7ff980055ad0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9980b2580 0x7ff998156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9980b0010 0x7ff998156680 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 --2- 172.21.15.12:0/4242147988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9980afbd0 0x7ff998144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 >> 172.21.15.12:0/4242147988 conn(0x7ff998060180 msgr2=0x7ff9980af200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:13.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 shutdown_connections 2021-10-20T23:29:13.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.575+0000 7ff99e2c6700 1 -- 172.21.15.12:0/4242147988 wait complete. 2021-10-20T23:29:13.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:29:13.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0b566700 1 Processor -- start 2021-10-20T23:29:13.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0b566700 1 -- start start 2021-10-20T23:29:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0b566700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04061320 0x7fea04061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0b566700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fea040ad5c0 0x7fea040b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0b566700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fea04140440 0x7fea041408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0b566700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea040aecf0 con 0x7fea040ad5c0 2021-10-20T23:29:13.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0b566700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea040b6f20 con 0x7fea04140440 2021-10-20T23:29:13.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0b566700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea040aef20 con 0x7fea04061320 2021-10-20T23:29:13.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea09d63700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fea040ad5c0 0x7fea040b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea09d63700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fea040ad5c0 0x7fea040b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45290/0 (socket says 172.21.15.12:45290) 2021-10-20T23:29:13.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea09d63700 1 -- 172.21.15.12:0/3684208419 learned_addr learned my addr 172.21.15.12:0/3684208419 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:13.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0ad65700 1 --2- 172.21.15.12:0/3684208419 >> v2:172.21.15.31:3300/0 conn(0x7fea04140440 0x7fea041408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0a564700 1 --2- 172.21.15.12:0/3684208419 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04061320 0x7fea04061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea09d63700 1 -- 172.21.15.12:0/3684208419 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04061320 msgr2=0x7fea04061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:13.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea09d63700 1 --2- 172.21.15.12:0/3684208419 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04061320 0x7fea04061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea09d63700 1 -- 172.21.15.12:0/3684208419 >> v2:172.21.15.31:3300/0 conn(0x7fea04140440 msgr2=0x7fea041408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea09d63700 1 --2- 172.21.15.12:0/3684208419 >> v2:172.21.15.31:3300/0 conn(0x7fea04140440 0x7fea041408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea09d63700 1 -- 172.21.15.12:0/3684208419 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040af1c0 con 0x7fea040ad5c0 2021-10-20T23:29:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea0ad65700 1 --2- 172.21.15.12:0/3684208419 >> v2:172.21.15.31:3300/0 conn(0x7fea04140440 0x7fea041408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:29:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.703+0000 7fea09d63700 1 --2- 172.21.15.12:0/3684208419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea040ad5c0 0x7fea040b9e60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fe9f4002f70 tx=0x7fe9f4006eb0).ready entity=mon.0 client_cookie=e93b24b22ee372d3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea09562700 1 -- 172.21.15.12:0/3684208419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f400d570 con 0x7fea040ad5c0 2021-10-20T23:29:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea09562700 1 -- 172.21.15.12:0/3684208419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f4000e90 con 0x7fea040ad5c0 2021-10-20T23:29:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea09562700 1 -- 172.21.15.12:0/3684208419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f400d900 con 0x7fea040ad5c0 2021-10-20T23:29:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- 172.21.15.12:0/3684208419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea040ad5c0 msgr2=0x7fea040b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 --2- 172.21.15.12:0/3684208419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea040ad5c0 0x7fea040b9e60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fe9f4002f70 tx=0x7fe9f4006eb0).stop 2021-10-20T23:29:13.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- 172.21.15.12:0/3684208419 shutdown_connections 2021-10-20T23:29:13.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 --2- 172.21.15.12:0/3684208419 >> v2:172.21.15.31:3300/0 conn(0x7fea04140440 0x7fea041408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 --2- 172.21.15.12:0/3684208419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea040ad5c0 0x7fea040b9e60 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 --2- 172.21.15.12:0/3684208419 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04061320 0x7fea04061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- 172.21.15.12:0/3684208419 >> 172.21.15.12:0/3684208419 conn(0x7fea04066de0 msgr2=0x7fea040671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:13.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- 172.21.15.12:0/3684208419 shutdown_connections 2021-10-20T23:29:13.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- 172.21.15.12:0/3684208419 wait complete. 2021-10-20T23:29:13.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 Processor -- start 2021-10-20T23:29:13.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- start start 2021-10-20T23:29:13.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea04061320 0x7fea04142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea040ad5c0 0x7fea041446d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04140440 0x7fea04144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0413eaf0 con 0x7fea04061320 2021-10-20T23:29:13.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea04139f80 con 0x7fea040ad5c0 2021-10-20T23:29:13.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0413a220 con 0x7fea04140440 2021-10-20T23:29:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0a564700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea04061320 0x7fea04142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0a564700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea04061320 0x7fea04142280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45294/0 (socket says 172.21.15.12:45294) 2021-10-20T23:29:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0a564700 1 -- 172.21.15.12:0/965782854 learned_addr learned my addr 172.21.15.12:0/965782854 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea09d63700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea040ad5c0 0x7fea041446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0ad65700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04140440 0x7fea04144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0a564700 1 -- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04140440 msgr2=0x7fea04144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0a564700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04140440 0x7fea04144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0a564700 1 -- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea040ad5c0 msgr2=0x7fea041446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0a564700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea040ad5c0 0x7fea041446d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0a564700 1 -- 172.21.15.12:0/965782854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f400b1e0 con 0x7fea04061320 2021-10-20T23:29:13.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0ad65700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04140440 0x7fea04144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:29:13.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0a564700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea04061320 0x7fea04142280 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fea00007000 tx=0x7fea00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:13.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fe9f37fe700 1 -- 172.21.15.12:0/965782854 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea00010580 con 0x7fea04061320 2021-10-20T23:29:13.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fe9f37fe700 1 -- 172.21.15.12:0/965782854 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea000106e0 con 0x7fea04061320 2021-10-20T23:29:13.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0413a4c0 con 0x7fea04061320 2021-10-20T23:29:13.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fe9f37fe700 1 -- 172.21.15.12:0/965782854 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea00010a40 con 0x7fea04061320 2021-10-20T23:29:13.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.707+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea04142be0 con 0x7fea04061320 2021-10-20T23:29:13.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.711+0000 7fe9f37fe700 1 -- 172.21.15.12:0/965782854 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea00010ba0 con 0x7fea04061320 2021-10-20T23:29:13.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.711+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea040af460 con 0x7fea04061320 2021-10-20T23:29:13.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.711+0000 7fe9f37fe700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9e40534f0 0x7fe9e40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:13.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.711+0000 7fe9f37fe700 1 -- 172.21.15.12:0/965782854 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fea0006bbc0 con 0x7fea04061320 2021-10-20T23:29:13.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.711+0000 7fea09d63700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9e40534f0 0x7fe9e40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:13.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.711+0000 7fea09d63700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9e40534f0 0x7fe9e40559b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fe9f401a000 tx=0x7fe9f4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:13.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.719+0000 7fe9f37fe700 1 -- 172.21.15.12:0/965782854 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea00042bc0 con 0x7fea04061320 2021-10-20T23:29:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.891+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fea04057350 con 0x7fea04061320 2021-10-20T23:29:13.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fe9f37fe700 1 -- 172.21.15.12:0/965782854 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7fea000461e0 con 0x7fea04061320 2021-10-20T23:29:13.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9e40534f0 msgr2=0x7fe9e40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9e40534f0 0x7fe9e40559b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fe9f401a000 tx=0x7fe9f4015000).stop 2021-10-20T23:29:13.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea04061320 msgr2=0x7fea04142280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:13.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea04061320 0x7fea04142280 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fea00007000 tx=0x7fea00008040).stop 2021-10-20T23:29:13.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 shutdown_connections 2021-10-20T23:29:13.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe9e40534f0 0x7fe9e40559b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea04140440 0x7fea04144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea040ad5c0 0x7fea041446d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 --2- 172.21.15.12:0/965782854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea04061320 0x7fea04142280 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:13.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 >> 172.21.15.12:0/965782854 conn(0x7fea04066de0 msgr2=0x7fea040b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 shutdown_connections 2021-10-20T23:29:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:13.899+0000 7fea0b566700 1 -- 172.21.15.12:0/965782854 wait complete. 2021-10-20T23:29:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:29:13.922 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:29:14.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f713ad79700 1 Processor -- start 2021-10-20T23:29:14.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f713ad79700 1 -- start start 2021-10-20T23:29:14.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f713ad79700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b0710 0x7f7134142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f713ad79700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71340b30d0 0x7f7134143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f713ad79700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71340b0af0 con 0x7f71340ace70 2021-10-20T23:29:14.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f713ad79700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71340ae680 con 0x7f71340b30d0 2021-10-20T23:29:14.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f713ad79700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71340ae920 con 0x7f71340b0710 2021-10-20T23:29:14.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f713a578700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f71340ace70 0x7f713405f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43900/0 (socket says 172.21.15.12:43900) 2021-10-20T23:29:14.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f713a578700 1 -- 172.21.15.12:0/260984036 learned_addr learned my addr 172.21.15.12:0/260984036 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:14.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f7139d77700 1 --2- 172.21.15.12:0/260984036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b0710 0x7f7134142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f7139576700 1 --2- 172.21.15.12:0/260984036 >> v2:172.21.15.31:3300/0 conn(0x7f71340b30d0 0x7f7134143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f7138d75700 1 -- 172.21.15.12:0/260984036 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021023067 0 0) 0x7f71340b0af0 con 0x7f71340ace70 2021-10-20T23:29:14.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f7138d75700 1 -- 172.21.15.12:0/260984036 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f711c003260 con 0x7f71340ace70 2021-10-20T23:29:14.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f7139d77700 1 -- 172.21.15.12:0/260984036 >> v2:172.21.15.31:3300/0 conn(0x7f71340b30d0 msgr2=0x7f7134143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:14.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f7139d77700 1 --2- 172.21.15.12:0/260984036 >> v2:172.21.15.31:3300/0 conn(0x7f71340b30d0 0x7f7134143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f7139d77700 1 -- 172.21.15.12:0/260984036 >> v1:172.21.15.12:6789/0 conn(0x7f71340ace70 legacy=0x7f713405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f7139d77700 1 -- 172.21.15.12:0/260984036 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71340aebc0 con 0x7f71340b0710 2021-10-20T23:29:14.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.031+0000 7f7139d77700 1 --2- 172.21.15.12:0/260984036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b0710 0x7f7134142d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f7130002f70 tx=0x7f7130006df0).ready entity=mon.2 client_cookie=62feafb3f189522c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:14.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f7138d75700 1 -- 172.21.15.12:0/260984036 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f713000d4a0 con 0x7f71340b0710 2021-10-20T23:29:14.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f7138d75700 1 -- 172.21.15.12:0/260984036 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130000e90 con 0x7f71340b0710 2021-10-20T23:29:14.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f7138d75700 1 -- 172.21.15.12:0/260984036 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f713000d7f0 con 0x7f71340b0710 2021-10-20T23:29:14.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 -- 172.21.15.12:0/260984036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b0710 msgr2=0x7f7134142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 --2- 172.21.15.12:0/260984036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b0710 0x7f7134142d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f7130002f70 tx=0x7f7130006df0).stop 2021-10-20T23:29:14.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 -- 172.21.15.12:0/260984036 shutdown_connections 2021-10-20T23:29:14.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 --2- 172.21.15.12:0/260984036 >> v2:172.21.15.31:3300/0 conn(0x7f71340b30d0 0x7f7134143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 --2- 172.21.15.12:0/260984036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b0710 0x7f7134142d20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 -- 172.21.15.12:0/260984036 >> 172.21.15.12:0/260984036 conn(0x7f7134061140 msgr2=0x7f7134062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:14.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 -- 172.21.15.12:0/260984036 shutdown_connections 2021-10-20T23:29:14.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 -- 172.21.15.12:0/260984036 wait complete. 2021-10-20T23:29:14.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 Processor -- start 2021-10-20T23:29:14.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.035+0000 7f713ad79700 1 -- start start 2021-10-20T23:29:14.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713ad79700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71340ace70 0x7f71340640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713ad79700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71340b0710 0x7f71340b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713ad79700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b30d0 0x7f713414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713ad79700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7134153480 con 0x7f71340ace70 2021-10-20T23:29:14.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713ad79700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713413b030 con 0x7f71340b0710 2021-10-20T23:29:14.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713ad79700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713413b2d0 con 0x7f71340b30d0 2021-10-20T23:29:14.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139d77700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71340ace70 0x7f71340640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139d77700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71340ace70 0x7f71340640b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45308/0 (socket says 172.21.15.12:45308) 2021-10-20T23:29:14.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139d77700 1 -- 172.21.15.12:0/1689363036 learned_addr learned my addr 172.21.15.12:0/1689363036 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:14.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713a578700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b30d0 0x7f713414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139576700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71340b0710 0x7f71340b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139d77700 1 -- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b30d0 msgr2=0x7f713414f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139d77700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b30d0 0x7f713414f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139d77700 1 -- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71340b0710 msgr2=0x7f71340b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139d77700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71340b0710 0x7f71340b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139d77700 1 -- 172.21.15.12:0/1689363036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713000b180 con 0x7f71340ace70 2021-10-20T23:29:14.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139576700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71340b0710 0x7f71340b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:14.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7139d77700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71340ace70 0x7f71340640b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f7130002f70 tx=0x7f7130014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:14.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7122ffd700 1 -- 172.21.15.12:0/1689363036 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7130012860 con 0x7f71340ace70 2021-10-20T23:29:14.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7122ffd700 1 -- 172.21.15.12:0/1689363036 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71300129c0 con 0x7f71340ace70 2021-10-20T23:29:14.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7134153010 con 0x7f71340ace70 2021-10-20T23:29:14.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7122ffd700 1 -- 172.21.15.12:0/1689363036 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7130012d20 con 0x7f71340ace70 2021-10-20T23:29:14.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7134064900 con 0x7f71340ace70 2021-10-20T23:29:14.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713413b4d0 con 0x7f71340ace70 2021-10-20T23:29:14.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.039+0000 7f7122ffd700 1 -- 172.21.15.12:0/1689363036 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f713000f030 con 0x7f71340ace70 2021-10-20T23:29:14.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.043+0000 7f7122ffd700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7114053610 0x7f7114055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.043+0000 7f7122ffd700 1 -- 172.21.15.12:0/1689363036 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f713006efb0 con 0x7f71340ace70 2021-10-20T23:29:14.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.043+0000 7f7139576700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7114053610 0x7f7114055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.043+0000 7f7139576700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7114053610 0x7f7114055ad0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f712400b000 tx=0x7f7124008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:14.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.047+0000 7f7122ffd700 1 -- 172.21.15.12:0/1689363036 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7130045ea0 con 0x7f71340ace70 2021-10-20T23:29:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.215+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7134153200 con 0x7f71340ace70 2021-10-20T23:29:14.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f7122ffd700 1 -- 172.21.15.12:0/1689363036 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7130006980 con 0x7f71340ace70 2021-10-20T23:29:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7114053610 msgr2=0x7f7114055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7114053610 0x7f7114055ad0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f712400b000 tx=0x7f7124008040).stop 2021-10-20T23:29:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71340ace70 msgr2=0x7f71340640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71340ace70 0x7f71340640b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f7130002f70 tx=0x7f7130014000).stop 2021-10-20T23:29:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 shutdown_connections 2021-10-20T23:29:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7114053610 0x7f7114055ad0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71340b30d0 0x7f713414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71340b0710 0x7f71340b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 --2- 172.21.15.12:0/1689363036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71340ace70 0x7f71340640b0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 >> 172.21.15.12:0/1689363036 conn(0x7f7134061140 msgr2=0x7f7134142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 shutdown_connections 2021-10-20T23:29:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.223+0000 7f713ad79700 1 -- 172.21.15.12:0/1689363036 wait complete. 2021-10-20T23:29:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:29:14.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:14.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52bd328700 1 Processor -- start 2021-10-20T23:29:14.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52bd328700 1 -- start start 2021-10-20T23:29:14.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52bd328700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52b80af3c0 0x7f52b80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52bd328700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52b80601a0 0x7f52b8144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52bd328700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b80aa4a0 con 0x7f52b8144940 2021-10-20T23:29:14.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52bd328700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b80b1450 con 0x7f52b80601a0 2021-10-20T23:29:14.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52bd328700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b80af7a0 con 0x7f52b80af3c0 2021-10-20T23:29:14.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52bcb27700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f52b8144940 0x7f52b80a8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43914/0 (socket says 172.21.15.12:43914) 2021-10-20T23:29:14.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52bcb27700 1 -- 172.21.15.12:0/1276421184 learned_addr learned my addr 172.21.15.12:0/1276421184 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:14.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.343+0000 7f52b77fe700 1 --2- 172.21.15.12:0/1276421184 >> v2:172.21.15.12:3300/0 conn(0x7f52b80601a0 0x7f52b8144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b7fff700 1 --2- 172.21.15.12:0/1276421184 >> v2:172.21.15.31:3300/0 conn(0x7f52b80af3c0 0x7f52b80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b6ffd700 1 -- 172.21.15.12:0/1276421184 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126036471 0 0) 0x7f52b80aa4a0 con 0x7f52b8144940 2021-10-20T23:29:14.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b6ffd700 1 -- 172.21.15.12:0/1276421184 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52a4003260 con 0x7f52b8144940 2021-10-20T23:29:14.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b77fe700 1 -- 172.21.15.12:0/1276421184 >> v2:172.21.15.31:3300/0 conn(0x7f52b80af3c0 msgr2=0x7f52b80b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:14.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b77fe700 1 --2- 172.21.15.12:0/1276421184 >> v2:172.21.15.31:3300/0 conn(0x7f52b80af3c0 0x7f52b80b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b77fe700 1 -- 172.21.15.12:0/1276421184 >> v1:172.21.15.12:6789/0 conn(0x7f52b8144940 legacy=0x7f52b80a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b77fe700 1 -- 172.21.15.12:0/1276421184 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b805fb80 con 0x7f52b80601a0 2021-10-20T23:29:14.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b77fe700 1 --2- 172.21.15.12:0/1276421184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80601a0 0x7f52b8144450 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f52ac002f70 tx=0x7f52ac006df0).ready entity=mon.0 client_cookie=2efb177111944d27 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:14.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b6ffd700 1 -- 172.21.15.12:0/1276421184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52ac00d4f0 con 0x7f52b80601a0 2021-10-20T23:29:14.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b6ffd700 1 -- 172.21.15.12:0/1276421184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac000e90 con 0x7f52b80601a0 2021-10-20T23:29:14.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52b6ffd700 1 -- 172.21.15.12:0/1276421184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52ac00d840 con 0x7f52b80601a0 2021-10-20T23:29:14.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52bd328700 1 -- 172.21.15.12:0/1276421184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80601a0 msgr2=0x7f52b8144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52bd328700 1 --2- 172.21.15.12:0/1276421184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80601a0 0x7f52b8144450 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f52ac002f70 tx=0x7f52ac006df0).stop 2021-10-20T23:29:14.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52bd328700 1 -- 172.21.15.12:0/1276421184 shutdown_connections 2021-10-20T23:29:14.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52bd328700 1 --2- 172.21.15.12:0/1276421184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80601a0 0x7f52b8144450 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52bd328700 1 --2- 172.21.15.12:0/1276421184 >> v2:172.21.15.31:3300/0 conn(0x7f52b80af3c0 0x7f52b80b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52bd328700 1 -- 172.21.15.12:0/1276421184 >> 172.21.15.12:0/1276421184 conn(0x7f52b8061140 msgr2=0x7f52b8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:14.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52bd328700 1 -- 172.21.15.12:0/1276421184 shutdown_connections 2021-10-20T23:29:14.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.347+0000 7f52bd328700 1 -- 172.21.15.12:0/1276421184 wait complete. 2021-10-20T23:29:14.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bd328700 1 Processor -- start 2021-10-20T23:29:14.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bd328700 1 -- start start 2021-10-20T23:29:14.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bd328700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80601a0 0x7f52b80ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bd328700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80af3c0 0x7f52b80ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bd328700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b8144940 0x7f52b80a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bd328700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80adaf0 con 0x7f52b8144940 2021-10-20T23:29:14.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bd328700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80b50a0 con 0x7f52b80af3c0 2021-10-20T23:29:14.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bd328700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80b5340 con 0x7f52b80601a0 2021-10-20T23:29:14.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bcb27700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b8144940 0x7f52b80a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bcb27700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b8144940 0x7f52b80a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45326/0 (socket says 172.21.15.12:45326) 2021-10-20T23:29:14.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bcb27700 1 -- 172.21.15.12:0/3181873161 learned_addr learned my addr 172.21.15.12:0/3181873161 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:14.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52b77fe700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80af3c0 0x7f52b80ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52b7fff700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80601a0 0x7f52b80ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bcb27700 1 -- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80601a0 msgr2=0x7f52b80ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bcb27700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80601a0 0x7f52b80ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bcb27700 1 -- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80af3c0 msgr2=0x7f52b80ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.351+0000 7f52bcb27700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80af3c0 0x7f52b80ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52bcb27700 1 -- 172.21.15.12:0/3181873161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac00b180 con 0x7f52b8144940 2021-10-20T23:29:14.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52bcb27700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b8144940 0x7f52b80a0e60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f52b0001490 tx=0x7f52b0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:14.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52b57fa700 1 -- 172.21.15.12:0/3181873161 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52b0005ba0 con 0x7f52b8144940 2021-10-20T23:29:14.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52b57fa700 1 -- 172.21.15.12:0/3181873161 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0005d00 con 0x7f52b8144940 2021-10-20T23:29:14.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52b57fa700 1 -- 172.21.15.12:0/3181873161 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52b00072c0 con 0x7f52b8144940 2021-10-20T23:29:14.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b805f6b0 con 0x7f52b8144940 2021-10-20T23:29:14.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b8155620 con 0x7f52b8144940 2021-10-20T23:29:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b809ebf0 con 0x7f52b8144940 2021-10-20T23:29:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52b57fa700 1 -- 172.21.15.12:0/3181873161 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52b0010070 con 0x7f52b8144940 2021-10-20T23:29:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52b57fa700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52980536a0 0x7f5298055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52b57fa700 1 -- 172.21.15.12:0/3181873161 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f52b006b460 con 0x7f52b8144940 2021-10-20T23:29:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52b7fff700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52980536a0 0x7f5298055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:14.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.355+0000 7f52b7fff700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52980536a0 0x7f5298055b60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f52a800b000 tx=0x7f52a8006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:14.377 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.363+0000 7f52b57fa700 1 -- 172.21.15.12:0/3181873161 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52b809ebf0 con 0x7f52b8144940 2021-10-20T23:29:14.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.527+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52b809ebf0 con 0x7f52b8144940 2021-10-20T23:29:14.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.527+0000 7f52b57fa700 1 -- 172.21.15.12:0/3181873161 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f52b809ebf0 con 0x7f52b8144940 2021-10-20T23:29:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:14.539 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":78,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/4126550791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4126550791},{"type":"v1","addr":"172.21.15.31:6835","nonce":4126550791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/815086520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":815086520},{"type":"v1","addr":"172.21.15.12:6833","nonce":815086520}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:11.262079+0000","modified":"2021-10-20T23:29:12.985920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8427":{"gid":8427,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1414597279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1414597279},{"type":"v1","addr":"172.21.15.12:6835","nonce":1414597279}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-20T23:29:14.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52980536a0 msgr2=0x7f5298055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52980536a0 0x7f5298055b60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f52a800b000 tx=0x7f52a8006df0).stop 2021-10-20T23:29:14.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b8144940 msgr2=0x7f52b80a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:14.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b8144940 0x7f52b80a0e60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f52b0001490 tx=0x7f52b0007e00).stop 2021-10-20T23:29:14.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 shutdown_connections 2021-10-20T23:29:14.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f52980536a0 0x7f5298055b60 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b8144940 0x7f52b80a0e60 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80af3c0 0x7f52b80ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 --2- 172.21.15.12:0/3181873161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80601a0 0x7f52b80ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:14.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 >> 172.21.15.12:0/3181873161 conn(0x7f52b8061140 msgr2=0x7f52b813eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:14.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 shutdown_connections 2021-10-20T23:29:14.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:14.531+0000 7f52bd328700 1 -- 172.21.15.12:0/3181873161 wait complete. 2021-10-20T23:29:14.545 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 78 2021-10-20T23:29:14.855 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:29:11.262079+0000', 'modified': '2021-10-20T23:29:12.985920+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8427}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8427': {'gid': 8427, 'name': 'c', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1414597279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1414597279}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1414597279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:29:14.856 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:29:14.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:29:15.002 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8427,"want_state":"up:active","state":"up:active","rank_uptime":3.7119772019999999,"mdsmap_epoch":78,"osdmap_epoch":152,"osdmap_epoch_barrier":152,"uptime":8.1084130479999992} 2021-10-20T23:29:15.003 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8427, "mdsmap_epoch": 78, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "rank_uptime": 3.711977202, "state": "up:active", "uptime": 8.108413048, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:29:15.007 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5ffff700 1 Processor -- start 2021-10-20T23:29:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5ffff700 1 -- start start 2021-10-20T23:29:15.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fed600ad5c0 0x7fed60061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed601408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5ffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed600aecf0 con 0x7fed60061320 2021-10-20T23:29:15.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed600b6f20 con 0x7fed600ad5c0 2021-10-20T23:29:15.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600aef20 con 0x7fed60140440 2021-10-20T23:29:15.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fed600ad5c0 0x7fed60061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fed600ad5c0 0x7fed60061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45332/0 (socket says 172.21.15.12:45332) 2021-10-20T23:29:15.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5e7fc700 1 -- 172.21.15.12:0/3917310665 learned_addr learned my addr 172.21.15.12:0/3917310665 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:15.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5f7fe700 1 --2- 172.21.15.12:0/3917310665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed601408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5e7fc700 1 -- 172.21.15.12:0/3917310665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 msgr2=0x7fed601408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:15.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5e7fc700 1 --2- 172.21.15.12:0/3917310665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed601408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5e7fc700 1 -- 172.21.15.12:0/3917310665 >> v1:172.21.15.31:6789/0 conn(0x7fed60061320 legacy=0x7fed600b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5e7fc700 1 -- 172.21.15.12:0/3917310665 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600af1c0 con 0x7fed600ad5c0 2021-10-20T23:29:15.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5f7fe700 1 --2- 172.21.15.12:0/3917310665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed601408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:15.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.115+0000 7fed5e7fc700 1 --2- 172.21.15.12:0/3917310665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed600ad5c0 0x7fed60061700 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fed50002f70 tx=0x7fed50006eb0).ready entity=mon.0 client_cookie=7e742ead817a109b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5dffb700 1 -- 172.21.15.12:0/3917310665 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed5000d5c0 con 0x7fed600ad5c0 2021-10-20T23:29:15.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5dffb700 1 -- 172.21.15.12:0/3917310665 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed50000e90 con 0x7fed600ad5c0 2021-10-20T23:29:15.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5dffb700 1 -- 172.21.15.12:0/3917310665 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed5000d950 con 0x7fed600ad5c0 2021-10-20T23:29:15.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5ffff700 1 -- 172.21.15.12:0/3917310665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed600ad5c0 msgr2=0x7fed60061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.146 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5ffff700 1 --2- 172.21.15.12:0/3917310665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed600ad5c0 0x7fed60061700 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fed50002f70 tx=0x7fed50006eb0).stop 2021-10-20T23:29:15.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5ffff700 1 -- 172.21.15.12:0/3917310665 shutdown_connections 2021-10-20T23:29:15.147 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5ffff700 1 --2- 172.21.15.12:0/3917310665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed601408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.151 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5ffff700 1 --2- 172.21.15.12:0/3917310665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed600ad5c0 0x7fed60061700 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.155 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5ffff700 1 -- 172.21.15.12:0/3917310665 >> 172.21.15.12:0/3917310665 conn(0x7fed60066de0 msgr2=0x7fed600671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:15.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5ffff700 1 -- 172.21.15.12:0/3917310665 shutdown_connections 2021-10-20T23:29:15.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.119+0000 7fed5ffff700 1 -- 172.21.15.12:0/3917310665 wait complete. 2021-10-20T23:29:15.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 Processor -- start 2021-10-20T23:29:15.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 -- start start 2021-10-20T23:29:15.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60061320 0x7fed600b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed600ad5c0 0x7fed60152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed6009ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600b3a80 con 0x7fed60061320 2021-10-20T23:29:15.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600b2f50 con 0x7fed600ad5c0 2021-10-20T23:29:15.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed60152c50 con 0x7fed60140440 2021-10-20T23:29:15.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60061320 0x7fed600b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed6009ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed600ad5c0 0x7fed60152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed6009ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51098/0 (socket says 172.21.15.12:51098) 2021-10-20T23:29:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5f7fe700 1 -- 172.21.15.12:0/1929619080 learned_addr learned my addr 172.21.15.12:0/1929619080 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:15.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60061320 0x7fed600b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45336/0 (socket says 172.21.15.12:45336) 2021-10-20T23:29:15.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5f7fe700 1 -- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed600ad5c0 msgr2=0x7fed60152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5f7fe700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed600ad5c0 0x7fed60152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5f7fe700 1 -- 172.21.15.12:0/1929619080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60061320 msgr2=0x7fed600b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5f7fe700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60061320 0x7fed600b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5f7fe700 1 -- 172.21.15.12:0/1929619080 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5000b1e0 con 0x7fed60140440 2021-10-20T23:29:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5f7fe700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed6009ed10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fed600b3090 tx=0x7fed58008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed4ffff700 1 -- 172.21.15.12:0/1929619080 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed5800f710 con 0x7fed60140440 2021-10-20T23:29:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed4ffff700 1 -- 172.21.15.12:0/1929619080 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5800f870 con 0x7fed60140440 2021-10-20T23:29:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed60152ee0 con 0x7fed60140440 2021-10-20T23:29:15.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed4ffff700 1 -- 172.21.15.12:0/1929619080 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed5800fbd0 con 0x7fed60140440 2021-10-20T23:29:15.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.123+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed60153420 con 0x7fed60140440 2021-10-20T23:29:15.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.127+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed600acfb0 con 0x7fed60140440 2021-10-20T23:29:15.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.127+0000 7fed4ffff700 1 -- 172.21.15.12:0/1929619080 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fed5801a030 con 0x7fed60140440 2021-10-20T23:29:15.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.127+0000 7fed4ffff700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fed3c0535b0 0x7fed3c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.127+0000 7fed4ffff700 1 -- 172.21.15.12:0/1929619080 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fed5806ba90 con 0x7fed60140440 2021-10-20T23:29:15.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.127+0000 7fed5effd700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fed3c0535b0 0x7fed3c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.131+0000 7fed5effd700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fed3c0535b0 0x7fed3c055a70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fed5400d000 tx=0x7fed54007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.139+0000 7fed4ffff700 1 -- 172.21.15.12:0/1929619080 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fed600acfb0 con 0x7fed60140440 2021-10-20T23:29:15.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.267+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed600acfb0 con 0x7fed60140440 2021-10-20T23:29:15.280 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.267+0000 7fed4ffff700 1 -- 172.21.15.12:0/1929619080 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fed600acfb0 con 0x7fed60140440 2021-10-20T23:29:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:15.281 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":152,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:12.264976+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:10.102100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:10.930461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:15.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fed3c0535b0 msgr2=0x7fed3c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fed3c0535b0 0x7fed3c055a70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fed5400d000 tx=0x7fed54007b90).stop 2021-10-20T23:29:15.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 msgr2=0x7fed6009ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed6009ed10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fed600b3090 tx=0x7fed58008040).stop 2021-10-20T23:29:15.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 shutdown_connections 2021-10-20T23:29:15.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fed3c0535b0 0x7fed3c055a70 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed60140440 0x7fed6009ed10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.288 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed600ad5c0 0x7fed60152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 --2- 172.21.15.12:0/1929619080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60061320 0x7fed600b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 >> 172.21.15.12:0/1929619080 conn(0x7fed60066de0 msgr2=0x7fed6005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:15.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 shutdown_connections 2021-10-20T23:29:15.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.271+0000 7fed5ffff700 1 -- 172.21.15.12:0/1929619080 wait complete. 2021-10-20T23:29:15.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:29:10.102100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:29:10.930461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:29:15.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:29:15.410 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.399+0000 7fa8a0f93700 1 Processor -- start 2021-10-20T23:29:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.399+0000 7fa8a0f93700 1 -- start start 2021-10-20T23:29:15.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.399+0000 7fa8a0f93700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b6290 0x7fa89c061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c0b5f50 con 0x7fa89c142e60 2021-10-20T23:29:15.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c0b1f70 con 0x7fa89c0b4060 2021-10-20T23:29:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0b2210 con 0x7fa89c0b6290 2021-10-20T23:29:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa89c142e60 0x7fa89c143310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43942/0 (socket says 172.21.15.12:43942) 2021-10-20T23:29:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89bfff700 1 -- 172.21.15.12:0/2256773135 learned_addr learned my addr 172.21.15.12:0/2256773135 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89b7fe700 1 --2- 172.21.15.12:0/2256773135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b6290 0x7fa89c061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89a7fc700 1 -- 172.21.15.12:0/2256773135 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109086185 0 0) 0x7fa894001110 con 0x7fa89c142e60 2021-10-20T23:29:15.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89a7fc700 1 -- 172.21.15.12:0/2256773135 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa87c003260 con 0x7fa89c142e60 2021-10-20T23:29:15.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89a7fc700 1 -- 172.21.15.12:0/2256773135 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160470142 0 0) 0x7fa89c0b1f70 con 0x7fa89c0b4060 2021-10-20T23:29:15.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89a7fc700 1 -- 172.21.15.12:0/2256773135 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa894001110 con 0x7fa89c0b4060 2021-10-20T23:29:15.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89b7fe700 1 -- 172.21.15.12:0/2256773135 >> v1:172.21.15.31:6789/0 conn(0x7fa89c0b4060 legacy=0x7fa89c061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89a7fc700 1 -- 172.21.15.12:0/2256773135 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 179363327 0 0) 0x7fa87c003260 con 0x7fa89c142e60 2021-10-20T23:29:15.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89b7fe700 1 -- 172.21.15.12:0/2256773135 >> v1:172.21.15.12:6789/0 conn(0x7fa89c142e60 legacy=0x7fa89c143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89b7fe700 1 -- 172.21.15.12:0/2256773135 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0b24b0 con 0x7fa89c0b6290 2021-10-20T23:29:15.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89b7fe700 1 --2- 172.21.15.12:0/2256773135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b6290 0x7fa89c061470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fa8940012a0 tx=0x7fa88c006df0).ready entity=mon.2 client_cookie=5d46c1382b552a1c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89a7fc700 1 -- 172.21.15.12:0/2256773135 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8940017f0 con 0x7fa89c0b6290 2021-10-20T23:29:15.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89a7fc700 1 -- 172.21.15.12:0/2256773135 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c000e90 con 0x7fa89c0b6290 2021-10-20T23:29:15.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa89a7fc700 1 -- 172.21.15.12:0/2256773135 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa88c012460 con 0x7fa89c0b6290 2021-10-20T23:29:15.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 -- 172.21.15.12:0/2256773135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b6290 msgr2=0x7fa89c061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 --2- 172.21.15.12:0/2256773135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b6290 0x7fa89c061470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fa8940012a0 tx=0x7fa88c006df0).stop 2021-10-20T23:29:15.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 -- 172.21.15.12:0/2256773135 shutdown_connections 2021-10-20T23:29:15.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 --2- 172.21.15.12:0/2256773135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b6290 0x7fa89c061470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 -- 172.21.15.12:0/2256773135 >> 172.21.15.12:0/2256773135 conn(0x7fa89c05c490 msgr2=0x7fa89c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:15.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 -- 172.21.15.12:0/2256773135 shutdown_connections 2021-10-20T23:29:15.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.403+0000 7fa8a0f93700 1 -- 172.21.15.12:0/2256773135 wait complete. 2021-10-20T23:29:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 Processor -- start 2021-10-20T23:29:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 -- start start 2021-10-20T23:29:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b4060 0x7fa89c13fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa89c0b6290 0x7fa89c155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c142e60 0x7fa89c156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c152650 con 0x7fa89c142e60 2021-10-20T23:29:15.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0b0390 con 0x7fa89c0b6290 2021-10-20T23:29:15.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0b0630 con 0x7fa89c0b4060 2021-10-20T23:29:15.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c142e60 0x7fa89c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c142e60 0x7fa89c156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45352/0 (socket says 172.21.15.12:45352) 2021-10-20T23:29:15.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89bfff700 1 -- 172.21.15.12:0/303244226 learned_addr learned my addr 172.21.15.12:0/303244226 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:15.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89b7fe700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b4060 0x7fa89c13fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89affd700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa89c0b6290 0x7fa89c155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89bfff700 1 -- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b4060 msgr2=0x7fa89c13fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89bfff700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b4060 0x7fa89c13fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89bfff700 1 -- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa89c0b6290 msgr2=0x7fa89c155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89bfff700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa89c0b6290 0x7fa89c155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89bfff700 1 -- 172.21.15.12:0/303244226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c00b180 con 0x7fa89c142e60 2021-10-20T23:29:15.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89affd700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa89c0b6290 0x7fa89c155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:29:15.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89b7fe700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b4060 0x7fa89c13fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:15.474 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa89bfff700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c142e60 0x7fa89c156490 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fa8940019d0 tx=0x7fa8940013c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa898ff9700 1 -- 172.21.15.12:0/303244226 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa894007170 con 0x7fa89c142e60 2021-10-20T23:29:15.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa898ff9700 1 -- 172.21.15.12:0/303244226 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8940072d0 con 0x7fa89c142e60 2021-10-20T23:29:15.476 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c0b08d0 con 0x7fa89c142e60 2021-10-20T23:29:15.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa898ff9700 1 -- 172.21.15.12:0/303244226 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa894004920 con 0x7fa89c142e60 2021-10-20T23:29:15.477 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.407+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c156980 con 0x7fa89c142e60 2021-10-20T23:29:15.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.411+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c0b2750 con 0x7fa89c142e60 2021-10-20T23:29:15.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.411+0000 7fa898ff9700 1 -- 172.21.15.12:0/303244226 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa894004a80 con 0x7fa89c142e60 2021-10-20T23:29:15.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.411+0000 7fa898ff9700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8800536a0 0x7fa880055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.411+0000 7fa898ff9700 1 -- 172.21.15.12:0/303244226 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa89406b560 con 0x7fa89c142e60 2021-10-20T23:29:15.479 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.411+0000 7fa89b7fe700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8800536a0 0x7fa880055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.411+0000 7fa89b7fe700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8800536a0 0x7fa880055b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fa88c018000 tx=0x7fa88c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.419+0000 7fa898ff9700 1 -- 172.21.15.12:0/303244226 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa894042500 con 0x7fa89c142e60 2021-10-20T23:29:15.557 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.547+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa89c0b5f50 con 0x7fa89c142e60 2021-10-20T23:29:15.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.547+0000 7fa898ff9700 1 -- 172.21.15.12:0/303244226 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa89c0b5f50 con 0x7fa89c142e60 2021-10-20T23:29:15.559 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:29:15.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8800536a0 msgr2=0x7fa880055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8800536a0 0x7fa880055b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fa88c018000 tx=0x7fa88c014000).stop 2021-10-20T23:29:15.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c142e60 msgr2=0x7fa89c156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c142e60 0x7fa89c156490 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fa8940019d0 tx=0x7fa8940013c0).stop 2021-10-20T23:29:15.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 shutdown_connections 2021-10-20T23:29:15.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8800536a0 0x7fa880055b60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c142e60 0x7fa89c156490 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa89c0b6290 0x7fa89c155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 --2- 172.21.15.12:0/303244226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa89c0b4060 0x7fa89c13fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 >> 172.21.15.12:0/303244226 conn(0x7fa89c05c490 msgr2=0x7fa89c0b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:15.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 shutdown_connections 2021-10-20T23:29:15.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.551+0000 7fa8a0f93700 1 -- 172.21.15.12:0/303244226 wait complete. 2021-10-20T23:29:15.572 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:29:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41b2d2700 1 Processor -- start 2021-10-20T23:29:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41b2d2700 1 -- start start 2021-10-20T23:29:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41b2d2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4140b4180 0x7fb414140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41b2d2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4140b4690 0x7fb4140b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41b2d2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb414143b60 con 0x7fb414146950 2021-10-20T23:29:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41b2d2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb414147510 con 0x7fb4140b4180 2021-10-20T23:29:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41b2d2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb414143e00 con 0x7fb4140b4690 2021-10-20T23:29:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41886d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4140b4180 0x7fb414140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41886d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4140b4180 0x7fb414140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45360/0 (socket says 172.21.15.12:45360) 2021-10-20T23:29:15.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.667+0000 7fb41886d700 1 -- 172.21.15.12:0/38833515 learned_addr learned my addr 172.21.15.12:0/38833515 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41986f700 1 --2- 172.21.15.12:0/38833515 >> v2:172.21.15.31:3300/0 conn(0x7fb4140b4690 0x7fb4140b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41886d700 1 -- 172.21.15.12:0/38833515 >> v2:172.21.15.31:3300/0 conn(0x7fb4140b4690 msgr2=0x7fb4140b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:15.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41886d700 1 --2- 172.21.15.12:0/38833515 >> v2:172.21.15.31:3300/0 conn(0x7fb4140b4690 0x7fb4140b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41886d700 1 -- 172.21.15.12:0/38833515 >> v1:172.21.15.31:6789/0 conn(0x7fb414146950 legacy=0x7fb414140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41886d700 1 -- 172.21.15.12:0/38833515 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140b0c90 con 0x7fb4140b4180 2021-10-20T23:29:15.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41886d700 1 --2- 172.21.15.12:0/38833515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 0x7fb414140940 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fb410002f70 tx=0x7fb410006eb0).ready entity=mon.0 client_cookie=a564a132cd9626f0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb40bfff700 1 -- 172.21.15.12:0/38833515 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb41000d5c0 con 0x7fb4140b4180 2021-10-20T23:29:15.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb40bfff700 1 -- 172.21.15.12:0/38833515 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb410000e90 con 0x7fb4140b4180 2021-10-20T23:29:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb40bfff700 1 -- 172.21.15.12:0/38833515 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb41000d950 con 0x7fb4140b4180 2021-10-20T23:29:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41b2d2700 1 -- 172.21.15.12:0/38833515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 msgr2=0x7fb414140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41b2d2700 1 --2- 172.21.15.12:0/38833515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 0x7fb414140940 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fb410002f70 tx=0x7fb410006eb0).stop 2021-10-20T23:29:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41b2d2700 1 -- 172.21.15.12:0/38833515 shutdown_connections 2021-10-20T23:29:15.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41b2d2700 1 --2- 172.21.15.12:0/38833515 >> v2:172.21.15.31:3300/0 conn(0x7fb4140b4690 0x7fb4140b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41b2d2700 1 --2- 172.21.15.12:0/38833515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 0x7fb414140940 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41b2d2700 1 -- 172.21.15.12:0/38833515 >> 172.21.15.12:0/38833515 conn(0x7fb41405c490 msgr2=0x7fb41405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:15.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41b2d2700 1 -- 172.21.15.12:0/38833515 shutdown_connections 2021-10-20T23:29:15.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.671+0000 7fb41b2d2700 1 -- 172.21.15.12:0/38833515 wait complete. 2021-10-20T23:29:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 Processor -- start 2021-10-20T23:29:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 -- start start 2021-10-20T23:29:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 0x7fb414145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140b4690 0x7fb414145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb414146950 0x7fb4141558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb414145c00 con 0x7fb4140b4180 2021-10-20T23:29:15.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4141531a0 con 0x7fb4140b4690 2021-10-20T23:29:15.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140ae050 con 0x7fb414146950 2021-10-20T23:29:15.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41906e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 0x7fb414145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41906e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 0x7fb414145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45364/0 (socket says 172.21.15.12:45364) 2021-10-20T23:29:15.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41906e700 1 -- 172.21.15.12:0/944934822 learned_addr learned my addr 172.21.15.12:0/944934822 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:15.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41886d700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140b4690 0x7fb414145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.737 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41986f700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb414146950 0x7fb4141558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41906e700 1 -- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb414146950 msgr2=0x7fb4141558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41906e700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb414146950 0x7fb4141558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41906e700 1 -- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140b4690 msgr2=0x7fb414145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41906e700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140b4690 0x7fb414145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41906e700 1 -- 172.21.15.12:0/944934822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41000b1e0 con 0x7fb4140b4180 2021-10-20T23:29:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41906e700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 0x7fb414145220 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fb414060c50 tx=0x7fb404007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb40a7fc700 1 -- 172.21.15.12:0/944934822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb40400ce30 con 0x7fb4140b4180 2021-10-20T23:29:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb40a7fc700 1 -- 172.21.15.12:0/944934822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb404007240 con 0x7fb4140b4180 2021-10-20T23:29:15.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4140ae2f0 con 0x7fb4140b4180 2021-10-20T23:29:15.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb40a7fc700 1 -- 172.21.15.12:0/944934822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb404006700 con 0x7fb4140b4180 2021-10-20T23:29:15.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.675+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4140aea30 con 0x7fb4140b4180 2021-10-20T23:29:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.679+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4140ae790 con 0x7fb4140b4180 2021-10-20T23:29:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.679+0000 7fb40a7fc700 1 -- 172.21.15.12:0/944934822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb404010030 con 0x7fb4140b4180 2021-10-20T23:29:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.679+0000 7fb40a7fc700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3fc053610 0x7fb3fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.679+0000 7fb40a7fc700 1 -- 172.21.15.12:0/944934822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb40406b8a0 con 0x7fb4140b4180 2021-10-20T23:29:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.679+0000 7fb41886d700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3fc053610 0x7fb3fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.679+0000 7fb41886d700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3fc053610 0x7fb3fc055ad0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fb41001a000 tx=0x7fb410015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.687+0000 7fb40a7fc700 1 -- 172.21.15.12:0/944934822 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb4140ae790 con 0x7fb4140b4180 2021-10-20T23:29:15.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.811+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb4140ae790 con 0x7fb4140b4180 2021-10-20T23:29:15.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb40a7fc700 1 -- 172.21.15.12:0/944934822 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb4140ae790 con 0x7fb4140b4180 2021-10-20T23:29:15.824 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:15.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3fc053610 msgr2=0x7fb3fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3fc053610 0x7fb3fc055ad0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fb41001a000 tx=0x7fb410015000).stop 2021-10-20T23:29:15.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 msgr2=0x7fb414145220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 0x7fb414145220 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fb414060c50 tx=0x7fb404007c10).stop 2021-10-20T23:29:15.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 shutdown_connections 2021-10-20T23:29:15.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb3fc053610 0x7fb3fc055ad0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb414146950 0x7fb4141558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140b4690 0x7fb414145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 --2- 172.21.15.12:0/944934822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4140b4180 0x7fb414145220 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 >> 172.21.15.12:0/944934822 conn(0x7fb41405c490 msgr2=0x7fb41413b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 shutdown_connections 2021-10-20T23:29:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.815+0000 7fb41b2d2700 1 -- 172.21.15.12:0/944934822 wait complete. 2021-10-20T23:29:15.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:29:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ec68700 1 Processor -- start 2021-10-20T23:29:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ec68700 1 -- start start 2021-10-20T23:29:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ec68700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 0x7f1e680b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ec68700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e680b5990 0x7f1e680b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ec68700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e68143f60 con 0x7f1e680b6560 2021-10-20T23:29:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ec68700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e680ba6b0 con 0x7f1e680b5990 2021-10-20T23:29:15.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ec68700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6805ffe0 con 0x7f1e6805fc00 2021-10-20T23:29:15.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6d205700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e680b5990 0x7f1e680b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e67fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1e680b6560 0x7f1e680b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43968/0 (socket says 172.21.15.12:43968) 2021-10-20T23:29:15.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e67fff700 1 -- 172.21.15.12:0/3114528215 learned_addr learned my addr 172.21.15.12:0/3114528215 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:15.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ca04700 1 --2- 172.21.15.12:0/3114528215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 0x7f1e680b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e677fe700 1 -- 172.21.15.12:0/3114528215 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159038940 0 0) 0x7f1e68143f60 con 0x7f1e680b6560 2021-10-20T23:29:15.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e677fe700 1 -- 172.21.15.12:0/3114528215 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e54003260 con 0x7f1e680b6560 2021-10-20T23:29:15.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ca04700 1 -- 172.21.15.12:0/3114528215 >> v2:172.21.15.12:3300/0 conn(0x7f1e680b5990 msgr2=0x7f1e680b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:15.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ca04700 1 --2- 172.21.15.12:0/3114528215 >> v2:172.21.15.12:3300/0 conn(0x7f1e680b5990 0x7f1e680b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ca04700 1 -- 172.21.15.12:0/3114528215 >> v1:172.21.15.12:6789/0 conn(0x7f1e680b6560 legacy=0x7f1e680b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ca04700 1 -- 172.21.15.12:0/3114528215 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68143a50 con 0x7f1e6805fc00 2021-10-20T23:29:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6d205700 1 --2- 172.21.15.12:0/3114528215 >> v2:172.21.15.12:3300/0 conn(0x7f1e680b5990 0x7f1e680b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e6ca04700 1 --2- 172.21.15.12:0/3114528215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 0x7f1e680b41b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f1e58002f70 tx=0x7f1e58006df0).ready entity=mon.2 client_cookie=bbac927e8edbe1c3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e677fe700 1 -- 172.21.15.12:0/3114528215 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e5800d4a0 con 0x7f1e6805fc00 2021-10-20T23:29:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e677fe700 1 -- 172.21.15.12:0/3114528215 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e58000e90 con 0x7f1e6805fc00 2021-10-20T23:29:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.939+0000 7f1e677fe700 1 -- 172.21.15.12:0/3114528215 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e5800d7f0 con 0x7f1e6805fc00 2021-10-20T23:29:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3114528215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 msgr2=0x7f1e680b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 --2- 172.21.15.12:0/3114528215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 0x7f1e680b41b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f1e58002f70 tx=0x7f1e58006df0).stop 2021-10-20T23:29:15.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3114528215 shutdown_connections 2021-10-20T23:29:15.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 --2- 172.21.15.12:0/3114528215 >> v2:172.21.15.12:3300/0 conn(0x7f1e680b5990 0x7f1e680b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.962 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 --2- 172.21.15.12:0/3114528215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 0x7f1e680b41b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3114528215 >> 172.21.15.12:0/3114528215 conn(0x7f1e680623a0 msgr2=0x7f1e68066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:15.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3114528215 shutdown_connections 2021-10-20T23:29:15.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3114528215 wait complete. 2021-10-20T23:29:15.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 Processor -- start 2021-10-20T23:29:15.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- start start 2021-10-20T23:29:15.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 0x7f1e6813ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e680b5990 0x7f1e6813f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e680b6560 0x7f1e6813feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e68149150 con 0x7f1e680b6560 2021-10-20T23:29:15.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680b0060 con 0x7f1e680b5990 2021-10-20T23:29:15.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680af680 con 0x7f1e6805fc00 2021-10-20T23:29:15.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6d205700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e680b6560 0x7f1e6813feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6d205700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e680b6560 0x7f1e6813feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45382/0 (socket says 172.21.15.12:45382) 2021-10-20T23:29:15.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6d205700 1 -- 172.21.15.12:0/3870027984 learned_addr learned my addr 172.21.15.12:0/3870027984 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:15.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ca04700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 0x7f1e6813ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e67fff700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e680b5990 0x7f1e6813f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6d205700 1 -- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 msgr2=0x7f1e6813ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6d205700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 0x7f1e6813ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6d205700 1 -- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e680b5990 msgr2=0x7f1e6813f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:15.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6d205700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e680b5990 0x7f1e6813f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:15.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6d205700 1 -- 172.21.15.12:0/3870027984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60009470 con 0x7f1e680b6560 2021-10-20T23:29:15.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6d205700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e680b6560 0x7f1e6813feb0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f1e6000c000 tx=0x7f1e600091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e65ffb700 1 -- 172.21.15.12:0/3870027984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e6000c850 con 0x7f1e680b6560 2021-10-20T23:29:15.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e65ffb700 1 -- 172.21.15.12:0/3870027984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6000c9b0 con 0x7f1e680b6560 2021-10-20T23:29:15.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5800b180 con 0x7f1e680b6560 2021-10-20T23:29:15.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e65ffb700 1 -- 172.21.15.12:0/3870027984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e6000cd10 con 0x7f1e680b6560 2021-10-20T23:29:15.971 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.943+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e68149620 con 0x7f1e680b6560 2021-10-20T23:29:15.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.947+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e68143cc0 con 0x7f1e680b6560 2021-10-20T23:29:15.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.947+0000 7f1e65ffb700 1 -- 172.21.15.12:0/3870027984 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1e60022070 con 0x7f1e680b6560 2021-10-20T23:29:15.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.947+0000 7f1e65ffb700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e48053610 0x7f1e48055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:15.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.947+0000 7f1e65ffb700 1 -- 172.21.15.12:0/3870027984 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1e6006c230 con 0x7f1e680b6560 2021-10-20T23:29:15.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.947+0000 7f1e6ca04700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e48053610 0x7f1e48055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:15.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.947+0000 7f1e6ca04700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e48053610 0x7f1e48055ad0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f1e5801a000 tx=0x7f1e58014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:15.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:15.955+0000 7f1e65ffb700 1 -- 172.21.15.12:0/3870027984 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1e60043230 con 0x7f1e680b6560 2021-10-20T23:29:16.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.087+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e68140540 con 0x7f1e680b6560 2021-10-20T23:29:16.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.087+0000 7f1e65ffb700 1 -- 172.21.15.12:0/3870027984 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1e60046850 con 0x7f1e680b6560 2021-10-20T23:29:16.100 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:16.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.087+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e48053610 msgr2=0x7f1e48055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.087+0000 7f1e6ec68700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e48053610 0x7f1e48055ad0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f1e5801a000 tx=0x7f1e58014000).stop 2021-10-20T23:29:16.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.087+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e680b6560 msgr2=0x7f1e6813feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.087+0000 7f1e6ec68700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e680b6560 0x7f1e6813feb0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f1e6000c000 tx=0x7f1e600091d0).stop 2021-10-20T23:29:16.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.091+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 shutdown_connections 2021-10-20T23:29:16.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.091+0000 7f1e6ec68700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1e48053610 0x7f1e48055ad0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.091+0000 7f1e6ec68700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e680b6560 0x7f1e6813feb0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.091+0000 7f1e6ec68700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e680b5990 0x7f1e6813f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.091+0000 7f1e6ec68700 1 --2- 172.21.15.12:0/3870027984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e6805fc00 0x7f1e6813ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.091+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 >> 172.21.15.12:0/3870027984 conn(0x7f1e680623a0 msgr2=0x7f1e680b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:16.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.091+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 shutdown_connections 2021-10-20T23:29:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.091+0000 7f1e6ec68700 1 -- 172.21.15.12:0/3870027984 wait complete. 2021-10-20T23:29:16.114 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:29:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.215+0000 7f73e9163700 1 Processor -- start 2021-10-20T23:29:16.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.215+0000 7f73e9163700 1 -- start start 2021-10-20T23:29:16.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f73e40af3c0 0x7f73e40b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e40aa4a0 con 0x7f73e40601a0 2021-10-20T23:29:16.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e405fb80 con 0x7f73e405c560 2021-10-20T23:29:16.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e40b1450 con 0x7f73e40af3c0 2021-10-20T23:29:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f73e40af3c0 0x7f73e40b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e37fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f73e40601a0 0x7f73e4144450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43980/0 (socket says 172.21.15.12:43980) 2021-10-20T23:29:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e37fe700 1 -- 172.21.15.12:0/3269783243 learned_addr learned my addr 172.21.15.12:0/3269783243 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e3fff700 1 -- 172.21.15.12:0/3269783243 >> v1:172.21.15.31:6789/0 conn(0x7f73e405c560 legacy=0x7f73e40a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e3fff700 1 -- 172.21.15.12:0/3269783243 >> v1:172.21.15.12:6789/0 conn(0x7f73e40601a0 legacy=0x7f73e4144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e2ffd700 1 -- 172.21.15.12:0/3269783243 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509164282 0 0) 0x7f73e40aa4a0 con 0x7f73e40601a0 2021-10-20T23:29:16.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e3fff700 1 -- 172.21.15.12:0/3269783243 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e405f6b0 con 0x7f73e40af3c0 2021-10-20T23:29:16.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e3fff700 1 --2- 172.21.15.12:0/3269783243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e40af3c0 0x7f73e40b0cb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f73d4002f70 tx=0x7f73d4006df0).ready entity=mon.0 client_cookie=8f79ff91e70df4eb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:16.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e2ffd700 1 -- 172.21.15.12:0/3269783243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d400d610 con 0x7f73e40af3c0 2021-10-20T23:29:16.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e2ffd700 1 -- 172.21.15.12:0/3269783243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4000e90 con 0x7f73e40af3c0 2021-10-20T23:29:16.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e2ffd700 1 -- 172.21.15.12:0/3269783243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d400d960 con 0x7f73e40af3c0 2021-10-20T23:29:16.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 -- 172.21.15.12:0/3269783243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e40af3c0 msgr2=0x7f73e40b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 --2- 172.21.15.12:0/3269783243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e40af3c0 0x7f73e40b0cb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f73d4002f70 tx=0x7f73d4006df0).stop 2021-10-20T23:29:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 -- 172.21.15.12:0/3269783243 shutdown_connections 2021-10-20T23:29:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 --2- 172.21.15.12:0/3269783243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e40af3c0 0x7f73e40b0cb0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 -- 172.21.15.12:0/3269783243 >> 172.21.15.12:0/3269783243 conn(0x7f73e4061140 msgr2=0x7f73e4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 -- 172.21.15.12:0/3269783243 shutdown_connections 2021-10-20T23:29:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.219+0000 7f73e9163700 1 -- 172.21.15.12:0/3269783243 wait complete. 2021-10-20T23:29:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 Processor -- start 2021-10-20T23:29:16.243 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 -- start start 2021-10-20T23:29:16.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e405c560 0x7f73e4145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40601a0 0x7f73e4145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73e40af3c0 0x7f73e4145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4067830 con 0x7f73e405c560 2021-10-20T23:29:16.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4066bb0 con 0x7f73e40601a0 2021-10-20T23:29:16.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4066e50 con 0x7f73e40af3c0 2021-10-20T23:29:16.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e405c560 0x7f73e4145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e405c560 0x7f73e4145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45392/0 (socket says 172.21.15.12:45392) 2021-10-20T23:29:16.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e3fff700 1 -- 172.21.15.12:0/2842677749 learned_addr learned my addr 172.21.15.12:0/2842677749 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:16.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e37fe700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40601a0 0x7f73e4145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e8962700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73e40af3c0 0x7f73e4145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e3fff700 1 -- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73e40af3c0 msgr2=0x7f73e4145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e3fff700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73e40af3c0 0x7f73e4145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e3fff700 1 -- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40601a0 msgr2=0x7f73e4145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e3fff700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40601a0 0x7f73e4145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e3fff700 1 -- 172.21.15.12:0/2842677749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d400b180 con 0x7f73e405c560 2021-10-20T23:29:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e3fff700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e405c560 0x7f73e4145110 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f73d4002f70 tx=0x7f73d4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e17fa700 1 -- 172.21.15.12:0/2842677749 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d4016070 con 0x7f73e405c560 2021-10-20T23:29:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e17fa700 1 -- 172.21.15.12:0/2842677749 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d400de90 con 0x7f73e405c560 2021-10-20T23:29:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e40670f0 con 0x7f73e405c560 2021-10-20T23:29:16.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e17fa700 1 -- 172.21.15.12:0/2842677749 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d4013e10 con 0x7f73e405c560 2021-10-20T23:29:16.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.223+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e41464b0 con 0x7f73e405c560 2021-10-20T23:29:16.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.227+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e4057350 con 0x7f73e405c560 2021-10-20T23:29:16.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.227+0000 7f73e17fa700 1 -- 172.21.15.12:0/2842677749 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f73d4025030 con 0x7f73e405c560 2021-10-20T23:29:16.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.227+0000 7f73e17fa700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73c40536a0 0x7f73c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.227+0000 7f73e17fa700 1 -- 172.21.15.12:0/2842677749 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f73d406ccb0 con 0x7f73e405c560 2021-10-20T23:29:16.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.227+0000 7f73e37fe700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73c40536a0 0x7f73c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.231+0000 7f73e37fe700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73c40536a0 0x7f73c4055b60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f73d800d000 tx=0x7f73d80011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:16.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.235+0000 7f73e17fa700 1 -- 172.21.15.12:0/2842677749 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73d4043cb0 con 0x7f73e405c560 2021-10-20T23:29:16.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.363+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73e40698e0 con 0x7f73e405c560 2021-10-20T23:29:16.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.363+0000 7f73e17fa700 1 -- 172.21.15.12:0/2842677749 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7f73d4023020 con 0x7f73e405c560 2021-10-20T23:29:16.374 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:16.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73c40536a0 msgr2=0x7f73c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73c40536a0 0x7f73c4055b60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f73d800d000 tx=0x7f73d80011a0).stop 2021-10-20T23:29:16.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e405c560 msgr2=0x7f73e4145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e405c560 0x7f73e4145110 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f73d4002f70 tx=0x7f73d4014000).stop 2021-10-20T23:29:16.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 shutdown_connections 2021-10-20T23:29:16.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73c40536a0 0x7f73c4055b60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.382 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73e40af3c0 0x7f73e4145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40601a0 0x7f73e4145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 --2- 172.21.15.12:0/2842677749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73e405c560 0x7f73e4145110 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 >> 172.21.15.12:0/2842677749 conn(0x7f73e4061140 msgr2=0x7f73e41419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 shutdown_connections 2021-10-20T23:29:16.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.367+0000 7f73e9163700 1 -- 172.21.15.12:0/2842677749 wait complete. 2021-10-20T23:29:16.388 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:29:16.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323aa7e700 1 Processor -- start 2021-10-20T23:29:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323aa7e700 1 -- start start 2021-10-20T23:29:16.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323aa7e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32340b3040 0x7f3234065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323aa7e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32340a9c10 0x7f32340607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323aa7e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3234066ea0 con 0x7f3234143320 2021-10-20T23:29:16.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323aa7e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32340648e0 con 0x7f32340b3040 2021-10-20T23:29:16.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323aa7e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3234061dd0 con 0x7f32340a9c10 2021-10-20T23:29:16.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f3239a7c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32340b3040 0x7f3234065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323a27d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3234143320 0x7f32341437b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43996/0 (socket says 172.21.15.12:43996) 2021-10-20T23:29:16.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323a27d700 1 -- 172.21.15.12:0/2876299636 learned_addr learned my addr 172.21.15.12:0/2876299636 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:16.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f323927b700 1 --2- 172.21.15.12:0/2876299636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32340a9c10 0x7f32340607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f3238a7a700 1 -- 172.21.15.12:0/2876299636 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074431349 0 0) 0x7f3234066ea0 con 0x7f3234143320 2021-10-20T23:29:16.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f3238a7a700 1 -- 172.21.15.12:0/2876299636 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f321c003260 con 0x7f3234143320 2021-10-20T23:29:16.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f3239a7c700 1 -- 172.21.15.12:0/2876299636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32340a9c10 msgr2=0x7f32340607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:16.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f3239a7c700 1 --2- 172.21.15.12:0/2876299636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32340a9c10 0x7f32340607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f3239a7c700 1 -- 172.21.15.12:0/2876299636 >> v1:172.21.15.12:6789/0 conn(0x7f3234143320 legacy=0x7f32341437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f3239a7c700 1 -- 172.21.15.12:0/2876299636 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340b3420 con 0x7f32340b3040 2021-10-20T23:29:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.483+0000 7f3239a7c700 1 --2- 172.21.15.12:0/2876299636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 0x7f3234065e90 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f3230002f70 tx=0x7f3230006df0).ready entity=mon.0 client_cookie=c495090a16b81506 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f3238a7a700 1 -- 172.21.15.12:0/2876299636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f323000d4a0 con 0x7f32340b3040 2021-10-20T23:29:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f3238a7a700 1 -- 172.21.15.12:0/2876299636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230000e90 con 0x7f32340b3040 2021-10-20T23:29:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f3238a7a700 1 -- 172.21.15.12:0/2876299636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f323000d830 con 0x7f32340b3040 2021-10-20T23:29:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 -- 172.21.15.12:0/2876299636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 msgr2=0x7f3234065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 --2- 172.21.15.12:0/2876299636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 0x7f3234065e90 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f3230002f70 tx=0x7f3230006df0).stop 2021-10-20T23:29:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 -- 172.21.15.12:0/2876299636 shutdown_connections 2021-10-20T23:29:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 --2- 172.21.15.12:0/2876299636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32340a9c10 0x7f32340607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 --2- 172.21.15.12:0/2876299636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 0x7f3234065e90 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 -- 172.21.15.12:0/2876299636 >> 172.21.15.12:0/2876299636 conn(0x7f32340636e0 msgr2=0x7f3234063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 -- 172.21.15.12:0/2876299636 shutdown_connections 2021-10-20T23:29:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 -- 172.21.15.12:0/2876299636 wait complete. 2021-10-20T23:29:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 Processor -- start 2021-10-20T23:29:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 -- start start 2021-10-20T23:29:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32340a9c10 0x7f32340acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 0x7f32340ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3234143320 0x7f323414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340abd30 con 0x7f32340b3040 2021-10-20T23:29:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340aed50 con 0x7f32340a9c10 2021-10-20T23:29:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.487+0000 7f323aa7e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32340aefe0 con 0x7f3234143320 2021-10-20T23:29:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323927b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 0x7f32340ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f3239a7c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32340a9c10 0x7f32340acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323927b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 0x7f32340ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45408/0 (socket says 172.21.15.12:45408) 2021-10-20T23:29:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323927b700 1 -- 172.21.15.12:0/1407900724 learned_addr learned my addr 172.21.15.12:0/1407900724 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323a27d700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3234143320 0x7f323414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323927b700 1 -- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3234143320 msgr2=0x7f323414dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323927b700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3234143320 0x7f323414dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323927b700 1 -- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32340a9c10 msgr2=0x7f32340acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323927b700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32340a9c10 0x7f32340acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323927b700 1 -- 172.21.15.12:0/1407900724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323000b180 con 0x7f32340b3040 2021-10-20T23:29:16.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f3239a7c700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32340a9c10 0x7f32340acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:16.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323927b700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 0x7f32340ae860 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f322400e000 tx=0x7f3224006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:16.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f3222ffd700 1 -- 172.21.15.12:0/1407900724 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f322400ed20 con 0x7f32340b3040 2021-10-20T23:29:16.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f3222ffd700 1 -- 172.21.15.12:0/1407900724 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322400ee80 con 0x7f32340b3040 2021-10-20T23:29:16.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f3222ffd700 1 -- 172.21.15.12:0/1407900724 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f322401a660 con 0x7f32340b3040 2021-10-20T23:29:16.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323409ebc0 con 0x7f32340b3040 2021-10-20T23:29:16.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323409f100 con 0x7f32340b3040 2021-10-20T23:29:16.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3234066960 con 0x7f32340b3040 2021-10-20T23:29:16.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f3222ffd700 1 -- 172.21.15.12:0/1407900724 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f322401a7c0 con 0x7f32340b3040 2021-10-20T23:29:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.491+0000 7f3222ffd700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3214053610 0x7f3214055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.495+0000 7f3222ffd700 1 -- 172.21.15.12:0/1407900724 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f322406ec00 con 0x7f32340b3040 2021-10-20T23:29:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.495+0000 7f3239a7c700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3214053610 0x7f3214055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.495+0000 7f3239a7c700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3214053610 0x7f3214055ad0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f323001a000 tx=0x7f3230014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.503+0000 7f3222ffd700 1 -- 172.21.15.12:0/1407900724 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3224074020 con 0x7f32340b3040 2021-10-20T23:29:16.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.667+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32340af150 con 0x7f32340b3040 2021-10-20T23:29:16.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.667+0000 7f3222ffd700 1 -- 172.21.15.12:0/1407900724 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f3224045c00 con 0x7f32340b3040 2021-10-20T23:29:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:16.678 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":78,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/4126550791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4126550791},{"type":"v1","addr":"172.21.15.31:6835","nonce":4126550791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/815086520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":815086520},{"type":"v1","addr":"172.21.15.12:6833","nonce":815086520}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:11.262079+0000","modified":"2021-10-20T23:29:12.985920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8427":{"gid":8427,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1414597279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1414597279},{"type":"v1","addr":"172.21.15.12:6835","nonce":1414597279}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-20T23:29:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3214053610 msgr2=0x7f3214055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3214053610 0x7f3214055ad0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f323001a000 tx=0x7f3230014000).stop 2021-10-20T23:29:16.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 msgr2=0x7f32340ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:16.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 0x7f32340ae860 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f322400e000 tx=0x7f3224006e80).stop 2021-10-20T23:29:16.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 shutdown_connections 2021-10-20T23:29:16.681 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3214053610 0x7f3214055ad0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3234143320 0x7f323414dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.682 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32340b3040 0x7f32340ae860 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 --2- 172.21.15.12:0/1407900724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32340a9c10 0x7f32340acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:16.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 >> 172.21.15.12:0/1407900724 conn(0x7f32340636e0 msgr2=0x7f32340b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:16.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 shutdown_connections 2021-10-20T23:29:16.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:16.671+0000 7f323aa7e700 1 -- 172.21.15.12:0/1407900724 wait complete. 2021-10-20T23:29:16.685 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 78 2021-10-20T23:29:16.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:29:11.262079+0000', 'modified': '2021-10-20T23:29:12.985920+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8427}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8427': {'gid': 8427, 'name': 'c', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1414597279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1414597279}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1414597279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:29:16.993 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:29:16.994 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:29:17.111 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8427,"want_state":"up:active","state":"up:active","rank_uptime":5.8290541649999996,"mdsmap_epoch":78,"osdmap_epoch":152,"osdmap_epoch_barrier":152,"uptime":10.225488237} 2021-10-20T23:29:17.112 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8427, "mdsmap_epoch": 78, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "rank_uptime": 5.829054165, "state": "up:active", "uptime": 10.225488237, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:29:17.113 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:29:17.114 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:29:17.115 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:29:17.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:17.117 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:17.134 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:29:17.194 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:17.195 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:17.205 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:17.206 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:17.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:17.207 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:29:17.212 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:29:17.213 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:17.220 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:29:17.239 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:17.240 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:17.295 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2021-10-20T23:29:17.292+0000 7f5855b53080 -1 init, newargv = 0x55ba86325d20 newargc=9ceph-fuse[15041]: starting ceph client 2021-10-20T23:29:17.295 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr: 2021-10-20T23:29:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:17.298 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:17.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:17.300 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:29:17.304 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[15041]: starting fuse 2021-10-20T23:29:17.309 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:29:17.309 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:29:17.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:17.310 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:29:17.311 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:29:17.311 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:29:17.312 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:29:17.313 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:29:17.313 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:29:17.314 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:29:17.314 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:29:17.314 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:29:17.315 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:29:17.315 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:29:17.316 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:29:17.316 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:29:17.317 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:29:17.317 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:29:17.317 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:29:17.318 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:29:17.318 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:29:17.319 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:29:17.319 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:29:17.319 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:29:17.320 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:29:17.320 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:29:17.362 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.15041.asok 2021-10-20T23:29:17.367 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15041.asok 2021-10-20T23:29:17.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:17.368 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15041.asok status 2021-10-20T23:29:17.501 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:29:17.501 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:29:17.502 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:29:17.502 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:29:17.502 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:29:17.502 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:29:17.503 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:29:17.504 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "15041", 2021-10-20T23:29:17.504 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:29:17.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:29:17.504 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:29:17.505 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:29:17.505 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 7391, 2021-10-20T23:29:17.505 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:29:17.505 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:29:17.505 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:29:17.506 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 7391 2021-10-20T23:29:17.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:29:17.506 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:29:17.507 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:29:17.507 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:29:17.507 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2831517151 2021-10-20T23:29:17.507 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:29:17.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:29:17.508 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:29:17.508 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:29:17.508 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:29:17.508 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2831517151 2021-10-20T23:29:17.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:29:17.509 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.7391 172.21.15.119:0/2831517151", 2021-10-20T23:29:17.509 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/2831517151", 2021-10-20T23:29:17.510 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:29:17.510 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 78, 2021-10-20T23:29:17.510 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 152, 2021-10-20T23:29:17.510 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:29:17.511 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:29:17.512 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:29:17.512 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:29:17.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:17.514 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:17.515 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:17.522 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:29:17.523 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:29:17.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:17.524 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:17.584 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.687+0000 7fa30537f700 1 Processor -- start 2021-10-20T23:29:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.687+0000 7fa30537f700 1 -- start start 2021-10-20T23:29:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.687+0000 7fa30537f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3000a9c10 0x7fa3000607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.687+0000 7fa30537f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa300140140 0x7fa3001405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.687+0000 7fa30537f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa300066ea0 con 0x7fa3000b3040 2021-10-20T23:29:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000648e0 con 0x7fa3000a9c10 2021-10-20T23:29:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa300061dd0 con 0x7fa300140140 2021-10-20T23:29:17.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa2ff7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3000a9c10 0x7fa3000607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa2fffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa3000b3040 0x7fa300065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:51072/0 (socket says 172.21.15.12:51072) 2021-10-20T23:29:17.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa2fffff700 1 -- 172.21.15.12:0/3027450441 learned_addr learned my addr 172.21.15.12:0/3027450441 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa304b7e700 1 --2- 172.21.15.12:0/3027450441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa300140140 0x7fa3001405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa2feffd700 1 -- 172.21.15.12:0/3027450441 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814816100 0 0) 0x7fa300066ea0 con 0x7fa3000b3040 2021-10-20T23:29:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa2feffd700 1 -- 172.21.15.12:0/3027450441 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e0003260 con 0x7fa3000b3040 2021-10-20T23:29:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa304b7e700 1 -- 172.21.15.12:0/3027450441 >> v2:172.21.15.12:3300/0 conn(0x7fa3000a9c10 msgr2=0x7fa3000607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa304b7e700 1 --2- 172.21.15.12:0/3027450441 >> v2:172.21.15.12:3300/0 conn(0x7fa3000a9c10 0x7fa3000607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa304b7e700 1 -- 172.21.15.12:0/3027450441 >> v1:172.21.15.31:6789/0 conn(0x7fa3000b3040 legacy=0x7fa300065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa304b7e700 1 -- 172.21.15.12:0/3027450441 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000b3420 con 0x7fa300140140 2021-10-20T23:29:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa2ff7fe700 1 --2- 172.21.15.12:0/3027450441 >> v2:172.21.15.12:3300/0 conn(0x7fa3000a9c10 0x7fa3000607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa304b7e700 1 --2- 172.21.15.12:0/3027450441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa300140140 0x7fa3001405d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fa2f0002f70 tx=0x7fa2f0006df0).ready entity=mon.2 client_cookie=9f83562e511637f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa2feffd700 1 -- 172.21.15.12:0/3027450441 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2f000d4a0 con 0x7fa300140140 2021-10-20T23:29:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa2feffd700 1 -- 172.21.15.12:0/3027450441 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f0000e90 con 0x7fa300140140 2021-10-20T23:29:17.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa2feffd700 1 -- 172.21.15.12:0/3027450441 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2f000d7f0 con 0x7fa300140140 2021-10-20T23:29:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 -- 172.21.15.12:0/3027450441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa300140140 msgr2=0x7fa3001405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 --2- 172.21.15.12:0/3027450441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa300140140 0x7fa3001405d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fa2f0002f70 tx=0x7fa2f0006df0).stop 2021-10-20T23:29:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 -- 172.21.15.12:0/3027450441 shutdown_connections 2021-10-20T23:29:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 --2- 172.21.15.12:0/3027450441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa300140140 0x7fa3001405d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 --2- 172.21.15.12:0/3027450441 >> v2:172.21.15.12:3300/0 conn(0x7fa3000a9c10 0x7fa3000607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 -- 172.21.15.12:0/3027450441 >> 172.21.15.12:0/3027450441 conn(0x7fa3000636e0 msgr2=0x7fa300063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 -- 172.21.15.12:0/3027450441 shutdown_connections 2021-10-20T23:29:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.691+0000 7fa30537f700 1 -- 172.21.15.12:0/3027450441 wait complete. 2021-10-20T23:29:17.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 Processor -- start 2021-10-20T23:29:17.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 -- start start 2021-10-20T23:29:17.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3000a9c10 0x7fa3000604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3000b3040 0x7fa3000ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300140140 0x7fa3000aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000af280 con 0x7fa300140140 2021-10-20T23:29:17.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300133130 con 0x7fa3000a9c10 2021-10-20T23:29:17.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000ab6e0 con 0x7fa3000b3040 2021-10-20T23:29:17.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa304b7e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300140140 0x7fa3000aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa304b7e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300140140 0x7fa3000aca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45424/0 (socket says 172.21.15.12:45424) 2021-10-20T23:29:17.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa304b7e700 1 -- 172.21.15.12:0/2937045749 learned_addr learned my addr 172.21.15.12:0/2937045749 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:17.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa2fffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3000a9c10 0x7fa3000604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa2ff7fe700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3000b3040 0x7fa3000ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa304b7e700 1 -- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3000b3040 msgr2=0x7fa3000ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa304b7e700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3000b3040 0x7fa3000ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa304b7e700 1 -- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3000a9c10 msgr2=0x7fa3000604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa304b7e700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3000a9c10 0x7fa3000604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa304b7e700 1 -- 172.21.15.12:0/2937045749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e800b180 con 0x7fa300140140 2021-10-20T23:29:17.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa304b7e700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300140140 0x7fa3000aca80 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fa2f0002f70 tx=0x7fa2f0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:17.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa2fd7fa700 1 -- 172.21.15.12:0/2937045749 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2f0016070 con 0x7fa300140140 2021-10-20T23:29:17.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa2fd7fa700 1 -- 172.21.15.12:0/2937045749 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f00137d0 con 0x7fa300140140 2021-10-20T23:29:17.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f000b180 con 0x7fa300140140 2021-10-20T23:29:17.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa2fd7fa700 1 -- 172.21.15.12:0/2937045749 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2f0013b30 con 0x7fa300140140 2021-10-20T23:29:17.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.695+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3000abc20 con 0x7fa300140140 2021-10-20T23:29:17.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.699+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa300066960 con 0x7fa300140140 2021-10-20T23:29:17.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.699+0000 7fa2fd7fa700 1 -- 172.21.15.12:0/2937045749 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa2f0025030 con 0x7fa300140140 2021-10-20T23:29:17.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.699+0000 7fa2fd7fa700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2e4053610 0x7fa2e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.699+0000 7fa2fd7fa700 1 -- 172.21.15.12:0/2937045749 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa2f006c9e0 con 0x7fa300140140 2021-10-20T23:29:17.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.699+0000 7fa2fffff700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2e4053610 0x7fa2e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.699+0000 7fa2fffff700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2e4053610 0x7fa2e4055ad0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fa2f800d000 tx=0x7fa2f8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:17.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.703+0000 7fa2fd7fa700 1 -- 172.21.15.12:0/2937045749 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2f0043940 con 0x7fa300140140 2021-10-20T23:29:17.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.831+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa300057350 con 0x7fa300140140 2021-10-20T23:29:17.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.831+0000 7fa2fd7fa700 1 -- 172.21.15.12:0/2937045749 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fa2f0023020 con 0x7fa300140140 2021-10-20T23:29:17.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:17.843 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":152,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:12.264976+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:10.102100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:10.930461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:17.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2e4053610 msgr2=0x7fa2e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2e4053610 0x7fa2e4055ad0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fa2f800d000 tx=0x7fa2f8009040).stop 2021-10-20T23:29:17.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300140140 msgr2=0x7fa3000aca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300140140 0x7fa3000aca80 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fa2f0002f70 tx=0x7fa2f0014000).stop 2021-10-20T23:29:17.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 shutdown_connections 2021-10-20T23:29:17.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2e4053610 0x7fa2e4055ad0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300140140 0x7fa3000aca80 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3000b3040 0x7fa3000ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.846 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 --2- 172.21.15.12:0/2937045749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3000a9c10 0x7fa3000604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 >> 172.21.15.12:0/2937045749 conn(0x7fa3000636e0 msgr2=0x7fa3000b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:17.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 shutdown_connections 2021-10-20T23:29:17.847 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.835+0000 7fa30537f700 1 -- 172.21.15.12:0/2937045749 wait complete. 2021-10-20T23:29:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:29:10.102100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:29:10.930461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:29:17.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:29:17.969 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.959+0000 7f76a7226700 1 Processor -- start 2021-10-20T23:29:17.970 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.959+0000 7f76a7226700 1 -- start start 2021-10-20T23:29:17.972 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76a00b4690 0x7f76a0140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a0143b60 con 0x7f76a0146950 2021-10-20T23:29:17.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a0143e00 con 0x7f76a00b4180 2021-10-20T23:29:17.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a0147510 con 0x7f76a00b4690 2021-10-20T23:29:17.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a57c3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76a00b4690 0x7f76a0140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.973 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a4fc2700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f76a0146950 0x7f76a0140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44022/0 (socket says 172.21.15.12:44022) 2021-10-20T23:29:17.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a4fc2700 1 -- 172.21.15.12:0/2391313034 learned_addr learned my addr 172.21.15.12:0/2391313034 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:17.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a57c3700 1 -- 172.21.15.12:0/2391313034 >> v1:172.21.15.31:6789/0 conn(0x7f76a00b4180 legacy=0x7f76a00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a57c3700 1 -- 172.21.15.12:0/2391313034 >> v1:172.21.15.12:6789/0 conn(0x7f76a0146950 legacy=0x7f76a0140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.974 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f769f7fe700 1 -- 172.21.15.12:0/2391313034 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788108422 0 0) 0x7f76a0143e00 con 0x7f76a00b4180 2021-10-20T23:29:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a57c3700 1 -- 172.21.15.12:0/2391313034 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a00b0c90 con 0x7f76a00b4690 2021-10-20T23:29:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a57c3700 1 --2- 172.21.15.12:0/2391313034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a00b4690 0x7f76a0140940 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f7690001110 tx=0x7f76980091d0).ready entity=mon.0 client_cookie=1e58068ed0cd731d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f769f7fe700 1 -- 172.21.15.12:0/2391313034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7698009ea0 con 0x7f76a00b4690 2021-10-20T23:29:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f769f7fe700 1 -- 172.21.15.12:0/2391313034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769800b760 con 0x7f76a00b4690 2021-10-20T23:29:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f769f7fe700 1 -- 172.21.15.12:0/2391313034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f769800b8d0 con 0x7f76a00b4690 2021-10-20T23:29:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 -- 172.21.15.12:0/2391313034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a00b4690 msgr2=0x7f76a0140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 --2- 172.21.15.12:0/2391313034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a00b4690 0x7f76a0140940 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f7690001110 tx=0x7f76980091d0).stop 2021-10-20T23:29:17.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 -- 172.21.15.12:0/2391313034 shutdown_connections 2021-10-20T23:29:17.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 --2- 172.21.15.12:0/2391313034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a00b4690 0x7f76a0140940 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 -- 172.21.15.12:0/2391313034 >> 172.21.15.12:0/2391313034 conn(0x7f76a005c490 msgr2=0x7f76a005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:17.980 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 -- 172.21.15.12:0/2391313034 shutdown_connections 2021-10-20T23:29:17.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.963+0000 7f76a7226700 1 -- 172.21.15.12:0/2391313034 wait complete. 2021-10-20T23:29:17.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 Processor -- start 2021-10-20T23:29:17.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 -- start start 2021-10-20T23:29:17.981 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a00b4180 0x7f76a0141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a00b4690 0x7f76a013ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a0146950 0x7f76a0152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.982 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00ad650 con 0x7f76a0146950 2021-10-20T23:29:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00b0330 con 0x7f76a00b4180 2021-10-20T23:29:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00ad830 con 0x7f76a00b4690 2021-10-20T23:29:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a57c3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a0146950 0x7f76a0152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a57c3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a0146950 0x7f76a0152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45438/0 (socket says 172.21.15.12:45438) 2021-10-20T23:29:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a57c3700 1 -- 172.21.15.12:0/2556949981 learned_addr learned my addr 172.21.15.12:0/2556949981 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a4fc2700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a00b4180 0x7f76a0141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f769ffff700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a00b4690 0x7f76a013ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a57c3700 1 -- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a00b4690 msgr2=0x7f76a013ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a57c3700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a00b4690 0x7f76a013ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a57c3700 1 -- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a00b4180 msgr2=0x7f76a0141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a57c3700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a00b4180 0x7f76a0141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a57c3700 1 -- 172.21.15.12:0/2556949981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7698009470 con 0x7f76a0146950 2021-10-20T23:29:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a57c3700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a0146950 0x7f76a0152490 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f7690001110 tx=0x7f7698016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f769dffb700 1 -- 172.21.15.12:0/2556949981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f769800b8d0 con 0x7f76a0146950 2021-10-20T23:29:17.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f769dffb700 1 -- 172.21.15.12:0/2556949981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7698011e90 con 0x7f76a0146950 2021-10-20T23:29:17.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f769dffb700 1 -- 172.21.15.12:0/2556949981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7698009ea0 con 0x7f76a0146950 2021-10-20T23:29:17.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a00adad0 con 0x7f76a0146950 2021-10-20T23:29:17.986 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.967+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a013e670 con 0x7f76a0146950 2021-10-20T23:29:17.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.971+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a0057350 con 0x7f76a0146950 2021-10-20T23:29:17.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.971+0000 7f769dffb700 1 -- 172.21.15.12:0/2556949981 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7698026030 con 0x7f76a0146950 2021-10-20T23:29:17.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.971+0000 7f769dffb700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7684053610 0x7f7684055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:17.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.971+0000 7f769dffb700 1 -- 172.21.15.12:0/2556949981 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f769806c5c0 con 0x7f76a0146950 2021-10-20T23:29:17.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.971+0000 7f76a4fc2700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7684053610 0x7f7684055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:17.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.971+0000 7f76a4fc2700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7684053610 0x7f7684055ad0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f769000d000 tx=0x7f7690009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:17.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:17.979+0000 7f769dffb700 1 -- 172.21.15.12:0/2556949981 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7698046ff0 con 0x7f76a0146950 2021-10-20T23:29:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.107+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f76a00698e0 con 0x7f76a0146950 2021-10-20T23:29:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.107+0000 7f769dffb700 1 -- 172.21.15.12:0/2556949981 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7f76980240b0 con 0x7f76a0146950 2021-10-20T23:29:18.117 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:29:18.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7684053610 msgr2=0x7f7684055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7684053610 0x7f7684055ad0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f769000d000 tx=0x7f7690009040).stop 2021-10-20T23:29:18.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a0146950 msgr2=0x7f76a0152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a0146950 0x7f76a0152490 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f7690001110 tx=0x7f7698016000).stop 2021-10-20T23:29:18.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 shutdown_connections 2021-10-20T23:29:18.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7684053610 0x7f7684055ad0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a0146950 0x7f76a0152490 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76a00b4690 0x7f76a013ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 --2- 172.21.15.12:0/2556949981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76a00b4180 0x7f76a0141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 >> 172.21.15.12:0/2556949981 conn(0x7f76a005c490 msgr2=0x7f76a0061d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:18.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 shutdown_connections 2021-10-20T23:29:18.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.111+0000 7f76a7226700 1 -- 172.21.15.12:0/2556949981 wait complete. 2021-10-20T23:29:18.130 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:29:18.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 Processor -- start 2021-10-20T23:29:18.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 -- start start 2021-10-20T23:29:18.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcd80a8ac0 0x7fbcd8152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd80a70c0 con 0x7fbcd80b2580 2021-10-20T23:29:18.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd80a72f0 con 0x7fbcd80b0010 2021-10-20T23:29:18.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd80a7590 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcdd8e7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcd80a8ac0 0x7fbcd8152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcdd0e6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbcd80b2580 0x7fbcd814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44036/0 (socket says 172.21.15.12:44036) 2021-10-20T23:29:18.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcdd0e6700 1 -- 172.21.15.12:0/2459007940 learned_addr learned my addr 172.21.15.12:0/2459007940 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:18.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcdd8e7700 1 -- 172.21.15.12:0/2459007940 >> v1:172.21.15.31:6789/0 conn(0x7fbcd80b0010 legacy=0x7fbcd80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcdd8e7700 1 -- 172.21.15.12:0/2459007940 >> v1:172.21.15.12:6789/0 conn(0x7fbcd80b2580 legacy=0x7fbcd814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcd7fff700 1 -- 172.21.15.12:0/2459007940 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683643599 0 0) 0x7fbcd80a70c0 con 0x7fbcd80b2580 2021-10-20T23:29:18.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcdd8e7700 1 -- 172.21.15.12:0/2459007940 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80a7830 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcdd8e7700 1 --2- 172.21.15.12:0/2459007940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 0x7fbcd8152be0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7fbcd0002f70 tx=0x7fbcd0006df0).ready entity=mon.0 client_cookie=389c63e16452010d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:18.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcd7fff700 1 -- 172.21.15.12:0/2459007940 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd000d610 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcd7fff700 1 -- 172.21.15.12:0/2459007940 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd0000e90 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcd7fff700 1 -- 172.21.15.12:0/2459007940 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd000d960 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2459007940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 msgr2=0x7fbcd8152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 --2- 172.21.15.12:0/2459007940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 0x7fbcd8152be0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7fbcd0002f70 tx=0x7fbcd0006df0).stop 2021-10-20T23:29:18.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2459007940 shutdown_connections 2021-10-20T23:29:18.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 --2- 172.21.15.12:0/2459007940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 0x7fbcd8152be0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2459007940 >> 172.21.15.12:0/2459007940 conn(0x7fbcd8060180 msgr2=0x7fbcd80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:18.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.235+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2459007940 shutdown_connections 2021-10-20T23:29:18.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2459007940 wait complete. 2021-10-20T23:29:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 Processor -- start 2021-10-20T23:29:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 -- start start 2021-10-20T23:29:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 0x7fbcd8066030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcd80b0010 0x7fbcd8153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcd80b2580 0x7fbcd8153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8145ff0 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8067900 con 0x7fbcd80b0010 2021-10-20T23:29:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd811f7b0 con 0x7fbcd80b2580 2021-10-20T23:29:18.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd0e6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 0x7fbcd8066030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd0e6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 0x7fbcd8066030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45448/0 (socket says 172.21.15.12:45448) 2021-10-20T23:29:18.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd0e6700 1 -- 172.21.15.12:0/2732961336 learned_addr learned my addr 172.21.15.12:0/2732961336 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:18.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdc8e5700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcd80b0010 0x7fbcd8153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd8e7700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcd80b2580 0x7fbcd8153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd0e6700 1 -- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcd80b2580 msgr2=0x7fbcd8153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd0e6700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcd80b2580 0x7fbcd8153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd0e6700 1 -- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcd80b0010 msgr2=0x7fbcd8153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd0e6700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcd80b0010 0x7fbcd8153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd0e6700 1 -- 172.21.15.12:0/2732961336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd000b180 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcdd0e6700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 0x7fbcd8066030 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fbcc8000bc0 tx=0x7fbcc8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:18.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcd67fc700 1 -- 172.21.15.12:0/2732961336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc80070d0 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcd67fc700 1 -- 172.21.15.12:0/2732961336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc8007230 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd811d910 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcd67fc700 1 -- 172.21.15.12:0/2732961336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc8005610 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.239+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd811f070 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.243+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd8057350 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.243+0000 7fbcd67fc700 1 -- 172.21.15.12:0/2732961336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbcc801a060 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.243+0000 7fbcd67fc700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcbc053580 0x7fbcbc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.243+0000 7fbcd67fc700 1 -- 172.21.15.12:0/2732961336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbcc806ae20 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.243+0000 7fbcdc8e5700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcbc053580 0x7fbcbc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.243+0000 7fbcdc8e5700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcbc053580 0x7fbcbc055a40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fbcc000b000 tx=0x7fbcc0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:18.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.247+0000 7fbcd67fc700 1 -- 172.21.15.12:0/2732961336 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbcc8041e20 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.375+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbcd80698e0 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.375+0000 7fbcd67fc700 1 -- 172.21.15.12:0/2732961336 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbcc8018070 con 0x7fbcd80a8ac0 2021-10-20T23:29:18.387 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcbc053580 msgr2=0x7fbcbc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcbc053580 0x7fbcbc055a40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fbcc000b000 tx=0x7fbcc0009040).stop 2021-10-20T23:29:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 msgr2=0x7fbcd8066030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 0x7fbcd8066030 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fbcc8000bc0 tx=0x7fbcc8007c90).stop 2021-10-20T23:29:18.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 shutdown_connections 2021-10-20T23:29:18.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbcbc053580 0x7fbcbc055a40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcd80b2580 0x7fbcd8153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcd80b0010 0x7fbcd8153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 --2- 172.21.15.12:0/2732961336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd80a8ac0 0x7fbcd8066030 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 >> 172.21.15.12:0/2732961336 conn(0x7fbcd8060180 msgr2=0x7fbcd8146920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:18.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 shutdown_connections 2021-10-20T23:29:18.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.379+0000 7fbcde0e8700 1 -- 172.21.15.12:0/2732961336 wait complete. 2021-10-20T23:29:18.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:29:18.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.519+0000 7f3ba10a9700 1 Processor -- start 2021-10-20T23:29:18.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.519+0000 7f3ba10a9700 1 -- start start 2021-10-20T23:29:18.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.519+0000 7f3ba10a9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c143d50 0x7f3b9c140980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.519+0000 7f3ba10a9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c063cb0 con 0x7f3b9c0638d0 2021-10-20T23:29:18.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.519+0000 7f3ba10a9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c061ff0 con 0x7f3b9c061920 2021-10-20T23:29:18.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.519+0000 7f3ba10a9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c13fdb0 con 0x7f3b9c143d50 2021-10-20T23:29:18.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.519+0000 7f3b9bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3b9c0638d0 0x7f3b9c0b12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44052/0 (socket says 172.21.15.12:44052) 2021-10-20T23:29:18.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3b9bfff700 1 -- 172.21.15.12:0/232447752 learned_addr learned my addr 172.21.15.12:0/232447752 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:18.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba08a8700 1 --2- 172.21.15.12:0/232447752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c143d50 0x7f3b9c140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3b9affd700 1 -- 172.21.15.12:0/232447752 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064062019 0 0) 0x7f3b9c063cb0 con 0x7f3b9c0638d0 2021-10-20T23:29:18.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3b9affd700 1 -- 172.21.15.12:0/232447752 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b80003260 con 0x7f3b9c0638d0 2021-10-20T23:29:18.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba08a8700 1 -- 172.21.15.12:0/232447752 >> v1:172.21.15.31:6789/0 conn(0x7f3b9c061920 legacy=0x7f3b9c128c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba08a8700 1 -- 172.21.15.12:0/232447752 >> v1:172.21.15.12:6789/0 conn(0x7f3b9c0638d0 legacy=0x7f3b9c0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba08a8700 1 -- 172.21.15.12:0/232447752 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c13ffa0 con 0x7f3b9c143d50 2021-10-20T23:29:18.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba08a8700 1 --2- 172.21.15.12:0/232447752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c143d50 0x7f3b9c140980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f3b940032f0 tx=0x7f3b940091d0).ready entity=mon.2 client_cookie=c6c31964ca6720eb server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3b9affd700 1 -- 172.21.15.12:0/232447752 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b9400b6c0 con 0x7f3b9c143d50 2021-10-20T23:29:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3b9affd700 1 -- 172.21.15.12:0/232447752 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9400b820 con 0x7f3b9c143d50 2021-10-20T23:29:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3b9affd700 1 -- 172.21.15.12:0/232447752 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b9400b990 con 0x7f3b9c143d50 2021-10-20T23:29:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba10a9700 1 -- 172.21.15.12:0/232447752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c143d50 msgr2=0x7f3b9c140980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba10a9700 1 --2- 172.21.15.12:0/232447752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c143d50 0x7f3b9c140980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f3b940032f0 tx=0x7f3b940091d0).stop 2021-10-20T23:29:18.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba10a9700 1 -- 172.21.15.12:0/232447752 shutdown_connections 2021-10-20T23:29:18.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba10a9700 1 --2- 172.21.15.12:0/232447752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c143d50 0x7f3b9c140980 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba10a9700 1 -- 172.21.15.12:0/232447752 >> 172.21.15.12:0/232447752 conn(0x7f3b9c05c490 msgr2=0x7f3b9c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:18.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba10a9700 1 -- 172.21.15.12:0/232447752 shutdown_connections 2021-10-20T23:29:18.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.523+0000 7f3ba10a9700 1 -- 172.21.15.12:0/232447752 wait complete. 2021-10-20T23:29:18.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 Processor -- start 2021-10-20T23:29:18.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 -- start start 2021-10-20T23:29:18.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b9c061920 0x7f3b9c066880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c0638d0 0x7f3b9c153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c143d50 0x7f3b9c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c153880 con 0x7f3b9c061920 2021-10-20T23:29:18.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0b0350 con 0x7f3b9c143d50 2021-10-20T23:29:18.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0b05f0 con 0x7f3b9c0638d0 2021-10-20T23:29:18.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b9c061920 0x7f3b9c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b9c061920 0x7f3b9c066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45462/0 (socket says 172.21.15.12:45462) 2021-10-20T23:29:18.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9bfff700 1 -- 172.21.15.12:0/3694964642 learned_addr learned my addr 172.21.15.12:0/3694964642 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:18.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba08a8700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c143d50 0x7f3b9c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9b7fe700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c0638d0 0x7f3b9c153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9bfff700 1 -- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c0638d0 msgr2=0x7f3b9c153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9bfff700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c0638d0 0x7f3b9c153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9bfff700 1 -- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c143d50 msgr2=0x7f3b9c05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9bfff700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c143d50 0x7f3b9c05f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9bfff700 1 -- 172.21.15.12:0/3694964642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94009470 con 0x7f3b9c061920 2021-10-20T23:29:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b9bfff700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b9c061920 0x7f3b9c066880 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f3b8c001110 tx=0x7f3b8c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b997fa700 1 -- 172.21.15.12:0/3694964642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b8c0070d0 con 0x7f3b9c061920 2021-10-20T23:29:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b997fa700 1 -- 172.21.15.12:0/3694964642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c007230 con 0x7f3b9c061920 2021-10-20T23:29:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c0b0890 con 0x7f3b9c061920 2021-10-20T23:29:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3b997fa700 1 -- 172.21.15.12:0/3694964642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b8c005610 con 0x7f3b9c061920 2021-10-20T23:29:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.527+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c067040 con 0x7f3b9c061920 2021-10-20T23:29:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.531+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c153c70 con 0x7f3b9c061920 2021-10-20T23:29:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.531+0000 7f3b997fa700 1 -- 172.21.15.12:0/3694964642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3b8c01a060 con 0x7f3b9c061920 2021-10-20T23:29:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.531+0000 7f3b997fa700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3b74053610 0x7f3b74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.531+0000 7f3b997fa700 1 -- 172.21.15.12:0/3694964642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3b8c06aeb0 con 0x7f3b9c061920 2021-10-20T23:29:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.531+0000 7f3b9b7fe700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3b74053610 0x7f3b74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.531+0000 7f3b9b7fe700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3b74053610 0x7f3b74055ad0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f3b8400d000 tx=0x7f3b84007b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.535+0000 7f3b997fa700 1 -- 172.21.15.12:0/3694964642 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3b9c153c70 con 0x7f3b9c061920 2021-10-20T23:29:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.663+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b9c153c70 con 0x7f3b9c061920 2021-10-20T23:29:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3b997fa700 1 -- 172.21.15.12:0/3694964642 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3b9c153c70 con 0x7f3b9c061920 2021-10-20T23:29:18.676 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:18.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3b74053610 msgr2=0x7f3b74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3b74053610 0x7f3b74055ad0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f3b8400d000 tx=0x7f3b84007b50).stop 2021-10-20T23:29:18.678 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b9c061920 msgr2=0x7f3b9c066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b9c061920 0x7f3b9c066880 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f3b8c001110 tx=0x7f3b8c007aa0).stop 2021-10-20T23:29:18.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 shutdown_connections 2021-10-20T23:29:18.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3b74053610 0x7f3b74055ad0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c143d50 0x7f3b9c05f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b9c0638d0 0x7f3b9c153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 --2- 172.21.15.12:0/3694964642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b9c061920 0x7f3b9c066880 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 >> 172.21.15.12:0/3694964642 conn(0x7f3b9c05c490 msgr2=0x7f3b9c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:18.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 shutdown_connections 2021-10-20T23:29:18.680 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.667+0000 7f3ba10a9700 1 -- 172.21.15.12:0/3694964642 wait complete. 2021-10-20T23:29:18.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:29:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa73939c700 1 Processor -- start 2021-10-20T23:29:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa73939c700 1 -- start start 2021-10-20T23:29:18.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa73939c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7340a9ec0 0x7fa7340aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa73939c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7340603d0 0x7fa73413ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa73939c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa734061990 con 0x7fa73413d1c0 2021-10-20T23:29:18.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa73939c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa734061c30 con 0x7fa7340a9ec0 2021-10-20T23:29:18.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa73939c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa734060b90 con 0x7fa7340603d0 2021-10-20T23:29:18.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7337fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa73413d1c0 0x7fa73413f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44066/0 (socket says 172.21.15.12:44066) 2021-10-20T23:29:18.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7337fe700 1 -- 172.21.15.12:0/4287328714 learned_addr learned my addr 172.21.15.12:0/4287328714 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:18.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa72a7fc700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7340603d0 0x7fa73413ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa732ffd700 1 --2- 172.21.15.12:0/4287328714 >> v2:172.21.15.31:3300/0 conn(0x7fa7340a9ec0 0x7fa7340aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893641390 0 0) 0x7fa734061990 con 0x7fa73413d1c0 2021-10-20T23:29:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa718003260 con 0x7fa73413d1c0 2021-10-20T23:29:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564066974 0 0) 0x7fa718003260 con 0x7fa73413d1c0 2021-10-20T23:29:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7340603d0 msgr2=0x7fa73413ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:18.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7340603d0 0x7fa73413ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 >> v2:172.21.15.31:3300/0 conn(0x7fa7340a9ec0 msgr2=0x7fa7340aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:18.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 --2- 172.21.15.12:0/4287328714 >> v2:172.21.15.31:3300/0 conn(0x7fa7340a9ec0 0x7fa7340aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734060e30 con 0x7fa73413d1c0 2021-10-20T23:29:18.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fa72c0019e0 con 0x7fa73413d1c0 2021-10-20T23:29:18.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 >> v1:172.21.15.12:6789/0 conn(0x7fa73413d1c0 legacy=0x7fa73413f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa718003750 0x7fa718003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7340603d0 0x7fa718004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7180049f0 0x7fa718004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa734061c30 con 0x7fa7180049f0 2021-10-20T23:29:18.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa734060b90 con 0x7fa718003750 2021-10-20T23:29:18.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71800d960 con 0x7fa7340603d0 2021-10-20T23:29:18.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7337fe700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7180049f0 0x7fa718004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa732ffd700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa718003750 0x7fa718003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa72a7fc700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7340603d0 0x7fa718004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7337fe700 1 -- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7340603d0 msgr2=0x7fa718004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:18.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7337fe700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7340603d0 0x7fa718004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7337fe700 1 -- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa718003750 msgr2=0x7fa718003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:18.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7337fe700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa718003750 0x7fa718003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.795+0000 7fa7337fe700 1 -- 172.21.15.12:0/4287328714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718003260 con 0x7fa7180049f0 2021-10-20T23:29:18.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa7337fe700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7180049f0 0x7fa718004e70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fa73405f870 tx=0x7fa734060fc0).ready entity=mon.0 client_cookie=f9b7bdf735566254 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:18.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa72c00cc40 con 0x7fa7180049f0 2021-10-20T23:29:18.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00cda0 con 0x7fa7180049f0 2021-10-20T23:29:18.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa7327fc700 1 -- 172.21.15.12:0/4287328714 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa72c005b80 con 0x7fa7180049f0 2021-10-20T23:29:18.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa73939c700 1 -- 172.21.15.12:0/4287328714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7180049f0 msgr2=0x7fa718004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa73939c700 1 --2- 172.21.15.12:0/4287328714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7180049f0 0x7fa718004e70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fa73405f870 tx=0x7fa734060fc0).stop 2021-10-20T23:29:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa7337fe700 1 -- 172.21.15.12:0/4287328714 reap_dead start 2021-10-20T23:29:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa73939c700 1 -- 172.21.15.12:0/4287328714 shutdown_connections 2021-10-20T23:29:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa73939c700 1 -- 172.21.15.12:0/4287328714 >> 172.21.15.12:0/4287328714 conn(0x7fa7340b2970 msgr2=0x7fa7340b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa73939c700 1 -- 172.21.15.12:0/4287328714 shutdown_connections 2021-10-20T23:29:18.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa73939c700 1 -- 172.21.15.12:0/4287328714 wait complete. 2021-10-20T23:29:18.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa73939c700 1 Processor -- start 2021-10-20T23:29:18.832 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.799+0000 7fa73939c700 1 -- start start 2021-10-20T23:29:18.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa73939c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7180049f0 0x7fa734143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa73939c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7340af220 0x7fa7340afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa73939c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa734155ee0 0x7fa734138370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.833 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa73939c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73413e980 con 0x7fa7340af220 2021-10-20T23:29:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa73939c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7341400f0 con 0x7fa734155ee0 2021-10-20T23:29:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa73939c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa734140390 con 0x7fa7180049f0 2021-10-20T23:29:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa72a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7340af220 0x7fa7340afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa72a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7340af220 0x7fa7340afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45484/0 (socket says 172.21.15.12:45484) 2021-10-20T23:29:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa732ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7180049f0 0x7fa734143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa72a7fc700 1 -- 172.21.15.12:0/2642958812 learned_addr learned my addr 172.21.15.12:0/2642958812 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa7337fe700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa734155ee0 0x7fa734138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa72a7fc700 1 -- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7180049f0 msgr2=0x7fa734143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa72a7fc700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7180049f0 0x7fa734143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa72a7fc700 1 -- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa734155ee0 msgr2=0x7fa734138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa72a7fc700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa734155ee0 0x7fa734138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa72a7fc700 1 -- 172.21.15.12:0/2642958812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7340aff10 con 0x7fa7340af220 2021-10-20T23:29:18.836 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa72a7fc700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7340af220 0x7fa7340afa20 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7fa71c00b000 tx=0x7fa71c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa730ff9700 1 -- 172.21.15.12:0/2642958812 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71c00f760 con 0x7fa7340af220 2021-10-20T23:29:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa730ff9700 1 -- 172.21.15.12:0/2642958812 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c00f8c0 con 0x7fa7340af220 2021-10-20T23:29:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa734156360 con 0x7fa7340af220 2021-10-20T23:29:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa730ff9700 1 -- 172.21.15.12:0/2642958812 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71c00fc60 con 0x7fa7340af220 2021-10-20T23:29:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7340aee20 con 0x7fa7340af220 2021-10-20T23:29:18.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa734140550 con 0x7fa7340af220 2021-10-20T23:29:18.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.803+0000 7fa730ff9700 1 -- 172.21.15.12:0/2642958812 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa71c014440 con 0x7fa7340af220 2021-10-20T23:29:18.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.807+0000 7fa730ff9700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa70c0534f0 0x7fa70c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:18.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.807+0000 7fa730ff9700 1 -- 172.21.15.12:0/2642958812 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa71c06c3f0 con 0x7fa7340af220 2021-10-20T23:29:18.839 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.807+0000 7fa732ffd700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa70c0534f0 0x7fa70c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.807+0000 7fa732ffd700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa70c0534f0 0x7fa70c0559b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fa72400b000 tx=0x7fa724006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.815+0000 7fa730ff9700 1 -- 172.21.15.12:0/2642958812 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa71c043390 con 0x7fa7340af220 2021-10-20T23:29:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.935+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa73413eac0 con 0x7fa7340af220 2021-10-20T23:29:18.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.935+0000 7fa730ff9700 1 -- 172.21.15.12:0/2642958812 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa71c018020 con 0x7fa7340af220 2021-10-20T23:29:18.947 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:18.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa70c0534f0 msgr2=0x7fa70c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa70c0534f0 0x7fa70c0559b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fa72400b000 tx=0x7fa724006df0).stop 2021-10-20T23:29:18.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7340af220 msgr2=0x7fa7340afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:18.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7340af220 0x7fa7340afa20 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7fa71c00b000 tx=0x7fa71c006df0).stop 2021-10-20T23:29:18.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 shutdown_connections 2021-10-20T23:29:18.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa70c0534f0 0x7fa70c0559b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa734155ee0 0x7fa734138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7340af220 0x7fa7340afa20 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 --2- 172.21.15.12:0/2642958812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7180049f0 0x7fa734143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:18.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 >> 172.21.15.12:0/2642958812 conn(0x7fa7340b2970 msgr2=0x7fa7340b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:18.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 shutdown_connections 2021-10-20T23:29:18.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:18.939+0000 7fa73939c700 1 -- 172.21.15.12:0/2642958812 wait complete. 2021-10-20T23:29:18.965 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:29:18.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.055+0000 7fa950370700 1 Processor -- start 2021-10-20T23:29:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.055+0000 7fa950370700 1 -- start start 2021-10-20T23:29:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa9481483a0 0x7fa9480b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa9480a70c0 0x7fa948144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9480b0350 con 0x7fa9480b1db0 2021-10-20T23:29:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9480a90c0 con 0x7fa9481483a0 2021-10-20T23:29:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9480b05f0 con 0x7fa9480a70c0 2021-10-20T23:29:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d90b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa9481483a0 0x7fa9480b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d90b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa9481483a0 0x7fa9480b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45490/0 (socket says 172.21.15.12:45490) 2021-10-20T23:29:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d90b700 1 -- 172.21.15.12:0/2924680224 learned_addr learned my addr 172.21.15.12:0/2924680224 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94e90d700 1 --2- 172.21.15.12:0/2924680224 >> v2:172.21.15.31:3300/0 conn(0x7fa9480a70c0 0x7fa948144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d90b700 1 -- 172.21.15.12:0/2924680224 >> v2:172.21.15.31:3300/0 conn(0x7fa9480a70c0 msgr2=0x7fa948144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d90b700 1 --2- 172.21.15.12:0/2924680224 >> v2:172.21.15.31:3300/0 conn(0x7fa9480a70c0 0x7fa948144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d90b700 1 -- 172.21.15.12:0/2924680224 >> v1:172.21.15.31:6789/0 conn(0x7fa9480b1db0 legacy=0x7fa9480b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d90b700 1 -- 172.21.15.12:0/2924680224 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9480b0890 con 0x7fa9481483a0 2021-10-20T23:29:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94e90d700 1 --2- 172.21.15.12:0/2924680224 >> v2:172.21.15.31:3300/0 conn(0x7fa9480a70c0 0x7fa948144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d90b700 1 --2- 172.21.15.12:0/2924680224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9481483a0 0x7fa9480b0fd0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fa948147730 tx=0x7fa944006eb0).ready entity=mon.0 client_cookie=8df62211fc976c5d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d10a700 1 -- 172.21.15.12:0/2924680224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa94400d610 con 0x7fa9481483a0 2021-10-20T23:29:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d10a700 1 -- 172.21.15.12:0/2924680224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944000e90 con 0x7fa9481483a0 2021-10-20T23:29:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa94d10a700 1 -- 172.21.15.12:0/2924680224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa94400d960 con 0x7fa9481483a0 2021-10-20T23:29:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 -- 172.21.15.12:0/2924680224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9481483a0 msgr2=0x7fa9480b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 --2- 172.21.15.12:0/2924680224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9481483a0 0x7fa9480b0fd0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fa948147730 tx=0x7fa944006eb0).stop 2021-10-20T23:29:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 -- 172.21.15.12:0/2924680224 shutdown_connections 2021-10-20T23:29:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 --2- 172.21.15.12:0/2924680224 >> v2:172.21.15.31:3300/0 conn(0x7fa9480a70c0 0x7fa948144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 --2- 172.21.15.12:0/2924680224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9481483a0 0x7fa9480b0fd0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 -- 172.21.15.12:0/2924680224 >> 172.21.15.12:0/2924680224 conn(0x7fa94805f6b0 msgr2=0x7fa94805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 -- 172.21.15.12:0/2924680224 shutdown_connections 2021-10-20T23:29:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.059+0000 7fa950370700 1 -- 172.21.15.12:0/2924680224 wait complete. 2021-10-20T23:29:19.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 Processor -- start 2021-10-20T23:29:19.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 -- start start 2021-10-20T23:29:19.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9480a70c0 0x7fa9480ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:19.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9480b1db0 0x7fa9480abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:19.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9481483a0 0x7fa94814b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:19.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480ab1d0 con 0x7fa9480b1db0 2021-10-20T23:29:19.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94814ba40 con 0x7fa9480a70c0 2021-10-20T23:29:19.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948149d10 con 0x7fa9481483a0 2021-10-20T23:29:19.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94d90b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9480b1db0 0x7fa9480abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:19.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94d90b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9480b1db0 0x7fa9480abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45498/0 (socket says 172.21.15.12:45498) 2021-10-20T23:29:19.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94d90b700 1 -- 172.21.15.12:0/1944971831 learned_addr learned my addr 172.21.15.12:0/1944971831 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:19.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94e10c700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9480a70c0 0x7fa9480ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:19.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94e90d700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9481483a0 0x7fa94814b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:19.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94d90b700 1 -- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9481483a0 msgr2=0x7fa94814b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:19.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94d90b700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9481483a0 0x7fa94814b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:19.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94d90b700 1 -- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9480a70c0 msgr2=0x7fa9480ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:19.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94d90b700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9480a70c0 0x7fa9480ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:19.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94d90b700 1 -- 172.21.15.12:0/1944971831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94400b1e0 con 0x7fa9480b1db0 2021-10-20T23:29:19.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa94d90b700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9480b1db0 0x7fa9480abed0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fa948147730 tx=0x7fa944015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:19.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa9377fe700 1 -- 172.21.15.12:0/1944971831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa94400d990 con 0x7fa9480b1db0 2021-10-20T23:29:19.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa9377fe700 1 -- 172.21.15.12:0/1944971831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94400bec0 con 0x7fa9480b1db0 2021-10-20T23:29:19.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa948149fb0 con 0x7fa9480b1db0 2021-10-20T23:29:19.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa9377fe700 1 -- 172.21.15.12:0/1944971831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa944011d70 con 0x7fa9480b1db0 2021-10-20T23:29:19.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.063+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94814a620 con 0x7fa9480b1db0 2021-10-20T23:29:19.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.067+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9480b0b30 con 0x7fa9480b1db0 2021-10-20T23:29:19.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.067+0000 7fa9377fe700 1 -- 172.21.15.12:0/1944971831 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa944025030 con 0x7fa9480b1db0 2021-10-20T23:29:19.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.067+0000 7fa9377fe700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa928053610 0x7fa928055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:19.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.067+0000 7fa9377fe700 1 -- 172.21.15.12:0/1944971831 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa94406cac0 con 0x7fa9480b1db0 2021-10-20T23:29:19.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.067+0000 7fa94e10c700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa928053610 0x7fa928055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:19.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.067+0000 7fa94e10c700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa928053610 0x7fa928055ad0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fa93800d000 tx=0x7fa938000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:19.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.075+0000 7fa9377fe700 1 -- 172.21.15.12:0/1944971831 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa944043ac0 con 0x7fa9480b1db0 2021-10-20T23:29:19.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.239+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa948057350 con 0x7fa9480b1db0 2021-10-20T23:29:19.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa9377fe700 1 -- 172.21.15.12:0/1944971831 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fa944023020 con 0x7fa9480b1db0 2021-10-20T23:29:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:19.252 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":78,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/4126550791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4126550791},{"type":"v1","addr":"172.21.15.31:6835","nonce":4126550791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/815086520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":815086520},{"type":"v1","addr":"172.21.15.12:6833","nonce":815086520}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:11.262079+0000","modified":"2021-10-20T23:29:12.985920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8427":{"gid":8427,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1414597279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1414597279},{"type":"v1","addr":"172.21.15.12:6835","nonce":1414597279}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-20T23:29:19.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa928053610 msgr2=0x7fa928055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:19.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa928053610 0x7fa928055ad0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fa93800d000 tx=0x7fa938000bc0).stop 2021-10-20T23:29:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9480b1db0 msgr2=0x7fa9480abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9480b1db0 0x7fa9480abed0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fa948147730 tx=0x7fa944015000).stop 2021-10-20T23:29:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 shutdown_connections 2021-10-20T23:29:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa928053610 0x7fa928055ad0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9481483a0 0x7fa94814b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9480b1db0 0x7fa9480abed0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 --2- 172.21.15.12:0/1944971831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9480a70c0 0x7fa9480ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 >> 172.21.15.12:0/1944971831 conn(0x7fa94805f6b0 msgr2=0x7fa948147b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 shutdown_connections 2021-10-20T23:29:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:19.243+0000 7fa950370700 1 -- 172.21.15.12:0/1944971831 wait complete. 2021-10-20T23:29:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 78 2021-10-20T23:29:19.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:29:11.262079+0000', 'modified': '2021-10-20T23:29:12.985920+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8427}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8427': {'gid': 8427, 'name': 'c', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1414597279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1414597279}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1414597279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:29:19.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:29:19.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:29:19.686 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8427,"want_state":"up:active","state":"up:active","rank_uptime":8.4045126250000006,"mdsmap_epoch":78,"osdmap_epoch":152,"osdmap_epoch_barrier":152,"uptime":12.800948244000001} 2021-10-20T23:29:19.687 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8427, "mdsmap_epoch": 78, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "rank_uptime": 8.404512625, "state": "up:active", "uptime": 12.800948244, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:29:19.688 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:29:19.688 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:29:19.689 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:29:19.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:19.690 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:19.699 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:29:19.716 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:19.717 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:19.778 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:19.779 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:19.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:19.781 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:29:19.788 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:29:19.788 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:19.791 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:29:19.808 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:19.809 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:19.866 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:19.867 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-10-20T23:29:19.863+0000 7f570e546080 -1 init, newargv = 0x5651bce47e70 newargc=9 2021-10-20T23:29:19.868 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14569]: starting ceph client 2021-10-20T23:29:19.868 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:19.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:19.870 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:29:19.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14569]: starting fuse 2021-10-20T23:29:20.977 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:29:20.996 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:20.997 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:21.013 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:21.014 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:21.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:21.015 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:29:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:29:21.025 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:29:21.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:21.026 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:29:21.027 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:29:21.027 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:29:21.028 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:29:21.029 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:29:21.029 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:29:21.030 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:29:21.031 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:29:21.031 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:29:21.033 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:29:21.035 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:29:21.036 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:29:21.037 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:29:21.037 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:29:21.038 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:29:21.038 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:29:21.039 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:29:21.041 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:29:21.041 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:29:21.042 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:29:21.042 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:29:21.043 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:29:21.043 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:29:21.113 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.14569.asok 2021-10-20T23:29:21.124 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14569.asok 2021-10-20T23:29:21.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:21.126 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14569.asok status 2021-10-20T23:29:21.218 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:29:21.219 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:29:21.219 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:29:21.219 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:29:21.219 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:29:21.220 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:29:21.220 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:29:21.220 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "14569", 2021-10-20T23:29:21.221 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:29:21.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:29:21.222 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:29:21.223 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:29:21.223 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 8518, 2021-10-20T23:29:21.223 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:29:21.223 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:29:21.224 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:29:21.224 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 8518 2021-10-20T23:29:21.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:29:21.226 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:29:21.226 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:29:21.226 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:29:21.226 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3436453063 2021-10-20T23:29:21.227 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:29:21.227 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:29:21.227 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:29:21.227 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:29:21.227 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:29:21.228 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3436453063 2021-10-20T23:29:21.230 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:29:21.230 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.8518 172.21.15.136:0/3436453063", 2021-10-20T23:29:21.231 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/3436453063", 2021-10-20T23:29:21.231 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:29:21.232 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 78, 2021-10-20T23:29:21.232 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 152, 2021-10-20T23:29:21.232 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:29:21.232 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:29:21.233 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:29:21.233 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:29:21.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:21.235 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:21.236 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:21.243 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:29:21.246 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:29:21.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:21.247 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:21.322 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-20T23:29:21.323 DEBUG:teuthology.orchestra.run.smithi119:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-10-20T23:29:21.369 INFO:teuthology.orchestra.run.smithi119.stdout:1634772561.302790150 2021-10-20T23:29:21.369 INFO:tasks.cephfs.test_misc:rctime = 1634772561.302790150 2021-10-20T23:29:21.370 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:29:21.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:21.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:21.427 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:21.454 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:21.483 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:29:21.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:21.484 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:21.485 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:21.493 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:29:21.494 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:29:21.495 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2021-10-20T23:29:21.495 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:29:21.495 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:21.554 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[15041]: fuse finished with error 0 and tester_r 0 2021-10-20T23:29:21.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:21.556 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:21.557 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:21.564 INFO:teuthology.orchestra.run.smithi119.stdout:ext2/ext3 2021-10-20T23:29:21.564 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:29:21.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:29:21.682 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:21.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:21.691 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:21.692 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:21.701 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:29:21.702 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:29:21.703 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:29:21.703 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:29:21.704 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:21.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14569]: fuse finished with error 0 and tester_r 0 2021-10-20T23:29:21.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:21.761 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:21.761 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:21.769 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:29:21.771 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:29:21.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:29:21.863 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:21.872 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:29:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc911cb3700 1 Processor -- start 2021-10-20T23:29:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc911cb3700 1 -- start start 2021-10-20T23:29:21.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc911cb3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc90c0b4060 0x7fc90c061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:21.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc911cb3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 0x7fc90c143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:21.999 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc911cb3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c0b5f50 con 0x7fc90c0b6290 2021-10-20T23:29:22.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc911cb3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90c0b1f70 con 0x7fc90c0b4060 2021-10-20T23:29:22.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc911cb3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0b2210 con 0x7fc90c142e60 2021-10-20T23:29:22.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc90bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc90c0b4060 0x7fc90c061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc90bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc90c0b4060 0x7fc90c061b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45506/0 (socket says 172.21.15.12:45506) 2021-10-20T23:29:22.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc90bfff700 1 -- 172.21.15.12:0/2977847244 learned_addr learned my addr 172.21.15.12:0/2977847244 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:22.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc9114b2700 1 --2- 172.21.15.12:0/2977847244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 0x7fc90c143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc90bfff700 1 -- 172.21.15.12:0/2977847244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 msgr2=0x7fc90c143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:22.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc90bfff700 1 --2- 172.21.15.12:0/2977847244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 0x7fc90c143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc90bfff700 1 -- 172.21.15.12:0/2977847244 >> v1:172.21.15.31:6789/0 conn(0x7fc90c0b6290 legacy=0x7fc90c061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.987+0000 7fc90bfff700 1 -- 172.21.15.12:0/2977847244 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0b24b0 con 0x7fc90c0b4060 2021-10-20T23:29:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc90bfff700 1 --2- 172.21.15.12:0/2977847244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 0x7fc90c061b80 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fc8f4002f70 tx=0x7fc8f4006eb0).ready entity=mon.0 client_cookie=96fcca7580af0ce2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc90b7fe700 1 -- 172.21.15.12:0/2977847244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8f400d570 con 0x7fc90c0b4060 2021-10-20T23:29:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc90b7fe700 1 -- 172.21.15.12:0/2977847244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f4000e90 con 0x7fc90c0b4060 2021-10-20T23:29:22.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc90b7fe700 1 -- 172.21.15.12:0/2977847244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8f400d900 con 0x7fc90c0b4060 2021-10-20T23:29:22.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 -- 172.21.15.12:0/2977847244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 msgr2=0x7fc90c061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 --2- 172.21.15.12:0/2977847244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 0x7fc90c061b80 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fc8f4002f70 tx=0x7fc8f4006eb0).stop 2021-10-20T23:29:22.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 -- 172.21.15.12:0/2977847244 shutdown_connections 2021-10-20T23:29:22.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 --2- 172.21.15.12:0/2977847244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 0x7fc90c143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 --2- 172.21.15.12:0/2977847244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 0x7fc90c061b80 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 -- 172.21.15.12:0/2977847244 >> 172.21.15.12:0/2977847244 conn(0x7fc90c05c490 msgr2=0x7fc90c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:22.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 -- 172.21.15.12:0/2977847244 shutdown_connections 2021-10-20T23:29:22.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 -- 172.21.15.12:0/2977847244 wait complete. 2021-10-20T23:29:22.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 Processor -- start 2021-10-20T23:29:22.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 -- start start 2021-10-20T23:29:22.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 0x7fc90c0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.008 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc90c0b6290 0x7fc90c13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 0x7fc90c155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0ba150 con 0x7fc90c0b4060 2021-10-20T23:29:22.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0afab0 con 0x7fc90c0b6290 2021-10-20T23:29:22.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc911cb3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c140350 con 0x7fc90c142e60 2021-10-20T23:29:22.009 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.991+0000 7fc910cb1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 0x7fc90c0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc9114b2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 0x7fc90c155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc910cb1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 0x7fc90c0af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45510/0 (socket says 172.21.15.12:45510) 2021-10-20T23:29:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc910cb1700 1 -- 172.21.15.12:0/2015527613 learned_addr learned my addr 172.21.15.12:0/2015527613 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc90bfff700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc90c0b6290 0x7fc90c13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc910cb1700 1 -- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 msgr2=0x7fc90c155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc910cb1700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 0x7fc90c155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc910cb1700 1 -- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc90c0b6290 msgr2=0x7fc90c13d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc910cb1700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc90c0b6290 0x7fc90c13d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc910cb1700 1 -- 172.21.15.12:0/2015527613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f400b1e0 con 0x7fc90c0b4060 2021-10-20T23:29:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc90bfff700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc90c0b6290 0x7fc90c13d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc910cb1700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 0x7fc90c0af5c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fc90c13e940 tx=0x7fc8fc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc909ffb700 1 -- 172.21.15.12:0/2015527613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8fc012400 con 0x7fc90c0b4060 2021-10-20T23:29:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc909ffb700 1 -- 172.21.15.12:0/2015527613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc012560 con 0x7fc90c0b4060 2021-10-20T23:29:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc909ffb700 1 -- 172.21.15.12:0/2015527613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8fc0128c0 con 0x7fc90c0b4060 2021-10-20T23:29:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c140610 con 0x7fc90c0b4060 2021-10-20T23:29:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90c13d8d0 con 0x7fc90c0b4060 2021-10-20T23:29:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90c0af3c0 con 0x7fc90c0b4060 2021-10-20T23:29:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc909ffb700 1 -- 172.21.15.12:0/2015527613 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc8fc019030 con 0x7fc90c0b4060 2021-10-20T23:29:22.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc909ffb700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8f0053610 0x7fc8f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc909ffb700 1 -- 172.21.15.12:0/2015527613 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc8fc06aad0 con 0x7fc90c0b4060 2021-10-20T23:29:22.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.995+0000 7fc90bfff700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8f0053610 0x7fc8f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:21.999+0000 7fc90bfff700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8f0053610 0x7fc8f0055ad0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fc8f401a000 tx=0x7fc8f4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:22.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.003+0000 7fc909ffb700 1 -- 172.21.15.12:0/2015527613 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc8fc041a70 con 0x7fc90c0b4060 2021-10-20T23:29:22.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.131+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc90c0b5f50 con 0x7fc90c0b4060 2021-10-20T23:29:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc909ffb700 1 -- 172.21.15.12:0/2015527613 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v152) v1 ==== 81+0+34051 (secure 0 0 0) 0x7fc90c0b5f50 con 0x7fc90c0b4060 2021-10-20T23:29:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:22.145 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:29:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 152, 2021-10-20T23:29:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:29:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:29:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:29:12.264976+0000", 2021-10-20T23:29:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:29:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:29:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:29:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:29:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:29:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:29:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:29:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:29:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:29:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:29:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:29:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:29:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:29:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:29:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 28, 2021-10-20T23:29:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:29:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:29:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:29:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:29:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:29:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:29:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:29:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:29:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:29:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:29:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:29:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:29:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:29:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:29:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:29:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:29:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:29:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:29:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:29:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:29:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:29:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:29:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:29:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:29:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:29:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:29:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:29:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:29:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 27, 2021-10-20T23:29:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:29:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:29:10.102100+0000", 2021-10-20T23:29:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:29:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:29:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:29:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:29:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:29:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "152", 2021-10-20T23:29:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:29:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:29:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:29:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:29:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:29:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:29:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 28, 2021-10-20T23:29:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:29:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:29:10.930461+0000", 2021-10-20T23:29:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:29:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:29:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:29:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:29:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:29:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "152", 2021-10-20T23:29:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:29:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:29:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:29:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:29:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:29:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:29:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:29:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:29:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:29:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:29:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:29:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:29:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:29:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:29:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:29:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:29:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:29:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:29:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:29:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:29:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:29:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:29:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:29:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:29:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:29:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:29:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:29:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:29:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:29:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:29:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:29:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:29:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:29:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:29:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:29:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:29:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:29:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:29:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:29:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:29:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:29:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:29:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:29:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:29:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:29:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:29:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:29:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:29:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 139, 2021-10-20T23:29:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:29:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:29:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:29:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:29:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:29:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:29:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:29:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:29:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:29:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:29:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:29:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:29:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:29:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:29:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 148, 2021-10-20T23:29:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:29:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:29:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:29:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:29:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:29:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:29:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:29:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:29:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:29:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:29:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:29:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:29:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:29:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:29:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:29:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:29:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:29:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:29:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:29:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:29:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:29:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:29:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:29:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:29:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:29:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:29:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:29:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:29:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:29:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:29:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:29:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:29:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:29:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:29:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:29:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:29:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:29:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:29:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:29:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:29:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:29:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:29:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:29:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:29:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:29:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:29:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:29:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:29:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:29:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:29:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:29:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:29:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:29:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:29:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:29:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:29:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:29:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:29:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:29:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:29:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:29:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:29:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:29:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:29:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:29:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:29:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:29:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:29:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:29:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:29:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:29:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:29:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:29:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:29:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:29:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:29:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:29:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:29:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:29:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:29:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:29:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:29:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:29:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:29:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:29:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:29:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:29:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:29:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:29:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:29:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:29:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:29:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:29:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:29:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:29:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:29:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:29:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:29:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:29:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:29:22.391 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:29:22.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8f0053610 msgr2=0x7fc8f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8f0053610 0x7fc8f0055ad0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fc8f401a000 tx=0x7fc8f4015000).stop 2021-10-20T23:29:22.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 msgr2=0x7fc90c0af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 0x7fc90c0af5c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fc90c13e940 tx=0x7fc8fc007c50).stop 2021-10-20T23:29:22.394 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 shutdown_connections 2021-10-20T23:29:22.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8f0053610 0x7fc8f0055ad0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc90c142e60 0x7fc90c155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc90c0b6290 0x7fc90c13d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 --2- 172.21.15.12:0/2015527613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90c0b4060 0x7fc90c0af5c0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 >> 172.21.15.12:0/2015527613 conn(0x7fc90c05c490 msgr2=0x7fc90c1423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:22.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 shutdown_connections 2021-10-20T23:29:22.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.135+0000 7fc911cb3700 1 -- 172.21.15.12:0/2015527613 wait complete. 2021-10-20T23:29:22.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:22.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.495+0000 7f14e8996700 1 Processor -- start 2021-10-20T23:29:22.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.495+0000 7f14e8996700 1 -- start start 2021-10-20T23:29:22.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14e40b43c0 0x7f14e40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 0x7f14e412ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e41440b0 con 0x7f14e40b6580 2021-10-20T23:29:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e4143b70 con 0x7f14e40b43c0 2021-10-20T23:29:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e4143e10 con 0x7f14e40b6960 2021-10-20T23:29:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e1d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14e40b43c0 0x7f14e40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e1d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14e40b43c0 0x7f14e40b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45520/0 (socket says 172.21.15.12:45520) 2021-10-20T23:29:22.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f14e40b6580 0x7f14e4061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44112/0 (socket says 172.21.15.12:44112) 2021-10-20T23:29:22.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e1d9b700 1 -- 172.21.15.12:0/2764526817 learned_addr learned my addr 172.21.15.12:0/2764526817 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:22.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e2d9d700 1 --2- 172.21.15.12:0/2764526817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 0x7f14e412ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e1d9b700 1 -- 172.21.15.12:0/2764526817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 msgr2=0x7f14e412ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:22.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e1d9b700 1 --2- 172.21.15.12:0/2764526817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 0x7f14e412ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e1d9b700 1 -- 172.21.15.12:0/2764526817 >> v1:172.21.15.12:6789/0 conn(0x7f14e40b6580 legacy=0x7f14e4061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e1d9b700 1 -- 172.21.15.12:0/2764526817 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e40615f0 con 0x7f14e40b43c0 2021-10-20T23:29:22.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e159a700 1 -- 172.21.15.12:0/2764526817 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682819852 0 0) 0x7f14e41440b0 con 0x7f14e40b6580 2021-10-20T23:29:22.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e1d9b700 1 --2- 172.21.15.12:0/2764526817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b43c0 0x7f14e40b5bf0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f14e4143120 tx=0x7f14cc006eb0).ready entity=mon.0 client_cookie=8e8da2bfaf3b679f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:22.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e159a700 1 -- 172.21.15.12:0/2764526817 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14cc00d5c0 con 0x7f14e40b43c0 2021-10-20T23:29:22.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e159a700 1 -- 172.21.15.12:0/2764526817 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc000e90 con 0x7f14e40b43c0 2021-10-20T23:29:22.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e159a700 1 -- 172.21.15.12:0/2764526817 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14cc00d910 con 0x7f14e40b43c0 2021-10-20T23:29:22.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 -- 172.21.15.12:0/2764526817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b43c0 msgr2=0x7f14e40b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 --2- 172.21.15.12:0/2764526817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b43c0 0x7f14e40b5bf0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f14e4143120 tx=0x7f14cc006eb0).stop 2021-10-20T23:29:22.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 -- 172.21.15.12:0/2764526817 shutdown_connections 2021-10-20T23:29:22.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 --2- 172.21.15.12:0/2764526817 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 0x7f14e412ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 --2- 172.21.15.12:0/2764526817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b43c0 0x7f14e40b5bf0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 -- 172.21.15.12:0/2764526817 >> 172.21.15.12:0/2764526817 conn(0x7f14e405c490 msgr2=0x7f14e405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:22.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 -- 172.21.15.12:0/2764526817 shutdown_connections 2021-10-20T23:29:22.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.499+0000 7f14e8996700 1 -- 172.21.15.12:0/2764526817 wait complete. 2021-10-20T23:29:22.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 Processor -- start 2021-10-20T23:29:22.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 -- start start 2021-10-20T23:29:22.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b43c0 0x7f14e4127430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b6580 0x7f14e40af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.524 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 0x7f14e4147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e41469d0 con 0x7f14e40b6580 2021-10-20T23:29:22.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40b3ce0 con 0x7f14e40b43c0 2021-10-20T23:29:22.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40aec30 con 0x7f14e40b6960 2021-10-20T23:29:22.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b6580 0x7f14e40af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b6580 0x7f14e40af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45526/0 (socket says 172.21.15.12:45526) 2021-10-20T23:29:22.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e1d9b700 1 -- 172.21.15.12:0/2022961449 learned_addr learned my addr 172.21.15.12:0/2022961449 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:22.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e259c700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b43c0 0x7f14e4127430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e2d9d700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 0x7f14e4147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e1d9b700 1 -- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 msgr2=0x7f14e4147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e1d9b700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 0x7f14e4147650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e1d9b700 1 -- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b43c0 msgr2=0x7f14e4127430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e1d9b700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b43c0 0x7f14e4127430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e1d9b700 1 -- 172.21.15.12:0/2022961449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc00b1e0 con 0x7f14e40b6580 2021-10-20T23:29:22.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e1d9b700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b6580 0x7f14e40af090 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f14e40adb50 tx=0x7f14cc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:22.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14db7fe700 1 -- 172.21.15.12:0/2022961449 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14cc0116e0 con 0x7f14e40b6580 2021-10-20T23:29:22.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14db7fe700 1 -- 172.21.15.12:0/2022961449 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc011840 con 0x7f14e40b6580 2021-10-20T23:29:22.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e4146490 con 0x7f14e40b6580 2021-10-20T23:29:22.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14db7fe700 1 -- 172.21.15.12:0/2022961449 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14cc011ba0 con 0x7f14e40b6580 2021-10-20T23:29:22.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.503+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e40af580 con 0x7f14e40b6580 2021-10-20T23:29:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.507+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e4061890 con 0x7f14e40b6580 2021-10-20T23:29:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.507+0000 7f14db7fe700 1 -- 172.21.15.12:0/2022961449 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f14cc00f070 con 0x7f14e40b6580 2021-10-20T23:29:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.507+0000 7f14db7fe700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14c80536a0 0x7f14c8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.507+0000 7f14db7fe700 1 -- 172.21.15.12:0/2022961449 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f14cc06d260 con 0x7f14e40b6580 2021-10-20T23:29:22.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.507+0000 7f14e259c700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14c80536a0 0x7f14c8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.507+0000 7f14e259c700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14c80536a0 0x7f14c8055b60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f14d400d000 tx=0x7f14d4007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:22.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.511+0000 7f14db7fe700 1 -- 172.21.15.12:0/2022961449 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14cc044260 con 0x7f14e40b6580 2021-10-20T23:29:22.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14e4057350 con 0x7f14e40b6580 2021-10-20T23:29:22.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14db7fe700 1 -- 172.21.15.12:0/2022961449 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f14cc047880 con 0x7f14e40b6580 2021-10-20T23:29:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:22.685 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":78,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/4126550791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4126550791},{"type":"v1","addr":"172.21.15.31:6835","nonce":4126550791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/815086520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":815086520},{"type":"v1","addr":"172.21.15.12:6833","nonce":815086520}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:11.262079+0000","modified":"2021-10-20T23:29:12.985920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8427":{"gid":8427,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1414597279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1414597279},{"type":"v1","addr":"172.21.15.12:6835","nonce":1414597279}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-20T23:29:22.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14c80536a0 msgr2=0x7f14c8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14c80536a0 0x7f14c8055b60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f14d400d000 tx=0x7f14d4007a00).stop 2021-10-20T23:29:22.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b6580 msgr2=0x7f14e40af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b6580 0x7f14e40af090 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f14e40adb50 tx=0x7f14cc015000).stop 2021-10-20T23:29:22.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 shutdown_connections 2021-10-20T23:29:22.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f14c80536a0 0x7f14c8055b60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14e40b6960 0x7f14e4147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14e40b6580 0x7f14e40af090 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 --2- 172.21.15.12:0/2022961449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b43c0 0x7f14e4127430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 >> 172.21.15.12:0/2022961449 conn(0x7f14e405c490 msgr2=0x7f14e4128870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:22.689 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 shutdown_connections 2021-10-20T23:29:22.690 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.675+0000 7f14e8996700 1 -- 172.21.15.12:0/2022961449 wait complete. 2021-10-20T23:29:22.690 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 78 2021-10-20T23:29:22.698 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:29:22.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb320159700 1 Processor -- start 2021-10-20T23:29:22.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb320159700 1 -- start start 2021-10-20T23:29:22.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb320159700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb318060100 0x7fb3180b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb320159700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb318067300 0x7fb3181438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb320159700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3180aabb0 con 0x7fb3180b4c40 2021-10-20T23:29:22.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb320159700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3180604e0 con 0x7fb318060100 2021-10-20T23:29:22.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb320159700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb318066ea0 con 0x7fb318067300 2021-10-20T23:29:22.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31d6f4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb318067300 0x7fb3181438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31d6f4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb318067300 0x7fb3181438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51292/0 (socket says 172.21.15.12:51292) 2021-10-20T23:29:22.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31def5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb318060100 0x7fb3180b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31d6f4700 1 -- 172.21.15.12:0/3543377753 learned_addr learned my addr 172.21.15.12:0/3543377753 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:22.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31e6f6700 1 --1- 172.21.15.12:0/3543377753 >> v1:172.21.15.31:6789/0 conn(0x7fb3180b4c40 0x7fb318144510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:51194/0 (socket says 172.21.15.12:51194) 2021-10-20T23:29:22.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31d6f4700 1 -- 172.21.15.12:0/3543377753 >> v2:172.21.15.31:3300/0 conn(0x7fb318060100 msgr2=0x7fb3180b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:22.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31d6f4700 1 --2- 172.21.15.12:0/3543377753 >> v2:172.21.15.31:3300/0 conn(0x7fb318060100 0x7fb3180b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31d6f4700 1 -- 172.21.15.12:0/3543377753 >> v1:172.21.15.31:6789/0 conn(0x7fb3180b4c40 legacy=0x7fb318144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31d6f4700 1 -- 172.21.15.12:0/3543377753 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3180b33b0 con 0x7fb318067300 2021-10-20T23:29:22.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31def5700 1 --2- 172.21.15.12:0/3543377753 >> v2:172.21.15.31:3300/0 conn(0x7fb318060100 0x7fb3180b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:22.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31d6f4700 1 --2- 172.21.15.12:0/3543377753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb318067300 0x7fb3181438f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb30c002f70 tx=0x7fb30c006eb0).ready entity=mon.2 client_cookie=983d67146d81b121 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:22.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31cef3700 1 -- 172.21.15.12:0/3543377753 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb30c00d570 con 0x7fb318067300 2021-10-20T23:29:22.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31cef3700 1 -- 172.21.15.12:0/3543377753 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c000e90 con 0x7fb318067300 2021-10-20T23:29:22.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.791+0000 7fb31cef3700 1 -- 172.21.15.12:0/3543377753 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb30c00d900 con 0x7fb318067300 2021-10-20T23:29:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 -- 172.21.15.12:0/3543377753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb318067300 msgr2=0x7fb3181438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 --2- 172.21.15.12:0/3543377753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb318067300 0x7fb3181438f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb30c002f70 tx=0x7fb30c006eb0).stop 2021-10-20T23:29:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 -- 172.21.15.12:0/3543377753 shutdown_connections 2021-10-20T23:29:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 --2- 172.21.15.12:0/3543377753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb318067300 0x7fb3181438f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 --2- 172.21.15.12:0/3543377753 >> v2:172.21.15.31:3300/0 conn(0x7fb318060100 0x7fb3180b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 -- 172.21.15.12:0/3543377753 >> 172.21.15.12:0/3543377753 conn(0x7fb31805cf30 msgr2=0x7fb31805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:22.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 -- 172.21.15.12:0/3543377753 shutdown_connections 2021-10-20T23:29:22.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 -- 172.21.15.12:0/3543377753 wait complete. 2021-10-20T23:29:22.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 Processor -- start 2021-10-20T23:29:22.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 -- start start 2021-10-20T23:29:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb318060100 0x7fb3180ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb318067300 0x7fb318152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3180b4c40 0x7fb3181532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3181537b0 con 0x7fb318067300 2021-10-20T23:29:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180a1350 con 0x7fb318060100 2021-10-20T23:29:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.795+0000 7fb320159700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180a10b0 con 0x7fb3180b4c40 2021-10-20T23:29:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31d6f4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb318067300 0x7fb318152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31d6f4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb318067300 0x7fb318152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45540/0 (socket says 172.21.15.12:45540) 2021-10-20T23:29:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31d6f4700 1 -- 172.21.15.12:0/2487268481 learned_addr learned my addr 172.21.15.12:0/2487268481 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31def5700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb318060100 0x7fb3180ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31e6f6700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3180b4c40 0x7fb3181532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31d6f4700 1 -- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3180b4c40 msgr2=0x7fb3181532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31d6f4700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3180b4c40 0x7fb3181532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31d6f4700 1 -- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb318060100 msgr2=0x7fb3180ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31d6f4700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb318060100 0x7fb3180ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31d6f4700 1 -- 172.21.15.12:0/2487268481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31400b180 con 0x7fb318067300 2021-10-20T23:29:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31e6f6700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3180b4c40 0x7fb3181532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb31d6f4700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb318067300 0x7fb318152dd0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fb3180a26e0 tx=0x7fb30c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb30affd700 1 -- 172.21.15.12:0/2487268481 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb30c0117e0 con 0x7fb318067300 2021-10-20T23:29:22.828 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb30affd700 1 -- 172.21.15.12:0/2487268481 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c011940 con 0x7fb318067300 2021-10-20T23:29:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c00b1e0 con 0x7fb318067300 2021-10-20T23:29:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb30affd700 1 -- 172.21.15.12:0/2487268481 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb30c011ca0 con 0x7fb318067300 2021-10-20T23:29:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3180adbb0 con 0x7fb318067300 2021-10-20T23:29:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb318057350 con 0x7fb318067300 2021-10-20T23:29:22.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.799+0000 7fb30affd700 1 -- 172.21.15.12:0/2487268481 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb30c025030 con 0x7fb318067300 2021-10-20T23:29:22.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.803+0000 7fb30affd700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb2f8053610 0x7fb2f8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:22.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.803+0000 7fb30affd700 1 -- 172.21.15.12:0/2487268481 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb30c06cd30 con 0x7fb318067300 2021-10-20T23:29:22.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.803+0000 7fb31def5700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb2f8053610 0x7fb2f8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:22.830 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.803+0000 7fb31def5700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb2f8053610 0x7fb2f8055ad0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fb31400b000 tx=0x7fb314006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:22.831 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.807+0000 7fb30affd700 1 -- 172.21.15.12:0/2487268481 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb30c043c90 con 0x7fb318067300 2021-10-20T23:29:22.984 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.975+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb3180698e0 con 0x7fb318067300 2021-10-20T23:29:22.993 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:29:22.983+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:29:23.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.995+0000 7fb30affd700 1 -- 172.21.15.12:0/2487268481 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb30c023020 con 0x7fb318067300 2021-10-20T23:29:23.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb2f8053610 msgr2=0x7fb2f8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb2f8053610 0x7fb2f8055ad0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fb31400b000 tx=0x7fb314006df0).stop 2021-10-20T23:29:23.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb318067300 msgr2=0x7fb318152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb318067300 0x7fb318152dd0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fb3180a26e0 tx=0x7fb30c015000).stop 2021-10-20T23:29:23.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 shutdown_connections 2021-10-20T23:29:23.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb2f8053610 0x7fb2f8055ad0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3180b4c40 0x7fb3181532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb318067300 0x7fb318152dd0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 --2- 172.21.15.12:0/2487268481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb318060100 0x7fb3180ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 >> 172.21.15.12:0/2487268481 conn(0x7fb31805cf30 msgr2=0x7fb318144040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:23.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 shutdown_connections 2021-10-20T23:29:23.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:22.999+0000 7fb320159700 1 -- 172.21.15.12:0/2487268481 wait complete. 2021-10-20T23:29:23.013 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:29:23.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:23.032 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:29:23.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c2b5c700 1 Processor -- start 2021-10-20T23:29:23.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c2b5c700 1 -- start start 2021-10-20T23:29:23.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c2b5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0ace70 0x7fa3bc143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c2b5c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc143920 con 0x7fa3bc0b30d0 2021-10-20T23:29:23.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c2b5c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc0b0af0 con 0x7fa3bc0b0710 2021-10-20T23:29:23.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c2b5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0ae680 con 0x7fa3bc0ace70 2021-10-20T23:29:23.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c1359700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa3bc0b30d0 0x7fa3bc13f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44154/0 (socket says 172.21.15.12:44154) 2021-10-20T23:29:23.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c1359700 1 -- 172.21.15.12:0/1313441310 learned_addr learned my addr 172.21.15.12:0/1313441310 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:23.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c235b700 1 --2- 172.21.15.12:0/1313441310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0ace70 0x7fa3bc143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c0b58700 1 -- 172.21.15.12:0/1313441310 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188172262 0 0) 0x7fa3bc143920 con 0x7fa3bc0b30d0 2021-10-20T23:29:23.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c0b58700 1 -- 172.21.15.12:0/1313441310 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a4004370 con 0x7fa3bc0b30d0 2021-10-20T23:29:23.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c0b58700 1 -- 172.21.15.12:0/1313441310 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958155519 0 0) 0x7fa3bc0b0af0 con 0x7fa3bc0b0710 2021-10-20T23:29:23.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.115+0000 7fa3c0b58700 1 -- 172.21.15.12:0/1313441310 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3bc143920 con 0x7fa3bc0b0710 2021-10-20T23:29:23.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c235b700 1 -- 172.21.15.12:0/1313441310 >> v1:172.21.15.31:6789/0 conn(0x7fa3bc0b0710 legacy=0x7fa3bc142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c235b700 1 -- 172.21.15.12:0/1313441310 >> v1:172.21.15.12:6789/0 conn(0x7fa3bc0b30d0 legacy=0x7fa3bc13f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c235b700 1 -- 172.21.15.12:0/1313441310 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc0ae920 con 0x7fa3bc0ace70 2021-10-20T23:29:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c235b700 1 --2- 172.21.15.12:0/1313441310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0ace70 0x7fa3bc143430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa3b40032f0 tx=0x7fa3b40091d0).ready entity=mon.2 client_cookie=b3448a04e4733985 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:23.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c0b58700 1 -- 172.21.15.12:0/1313441310 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3b400b600 con 0x7fa3bc0ace70 2021-10-20T23:29:23.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c0b58700 1 -- 172.21.15.12:0/1313441310 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b400b760 con 0x7fa3bc0ace70 2021-10-20T23:29:23.134 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c0b58700 1 -- 172.21.15.12:0/1313441310 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3b400b8d0 con 0x7fa3bc0ace70 2021-10-20T23:29:23.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/1313441310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0ace70 msgr2=0x7fa3bc143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c2b5c700 1 --2- 172.21.15.12:0/1313441310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0ace70 0x7fa3bc143430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa3b40032f0 tx=0x7fa3b40091d0).stop 2021-10-20T23:29:23.135 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/1313441310 shutdown_connections 2021-10-20T23:29:23.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c2b5c700 1 --2- 172.21.15.12:0/1313441310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0ace70 0x7fa3bc143430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/1313441310 >> 172.21.15.12:0/1313441310 conn(0x7fa3bc061140 msgr2=0x7fa3bc062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:23.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/1313441310 shutdown_connections 2021-10-20T23:29:23.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/1313441310 wait complete. 2021-10-20T23:29:23.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c2b5c700 1 Processor -- start 2021-10-20T23:29:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.119+0000 7fa3c2b5c700 1 -- start start 2021-10-20T23:29:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c2b5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3bc0ace70 0x7fa3bc0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c2b5c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3bc0b0710 0x7fa3bc14e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c2b5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0b30d0 0x7fa3bc14ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c2b5c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc14dff0 con 0x7fa3bc0b0710 2021-10-20T23:29:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c2b5c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0abef0 con 0x7fa3bc0ace70 2021-10-20T23:29:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c2b5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0ac190 con 0x7fa3bc0b30d0 2021-10-20T23:29:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1359700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3bc0b0710 0x7fa3bc14e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1359700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3bc0b0710 0x7fa3bc14e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45564/0 (socket says 172.21.15.12:45564) 2021-10-20T23:29:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1359700 1 -- 172.21.15.12:0/2410426546 learned_addr learned my addr 172.21.15.12:0/2410426546 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c235b700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0b30d0 0x7fa3bc14ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1b5a700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3bc0ace70 0x7fa3bc0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1359700 1 -- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0b30d0 msgr2=0x7fa3bc14ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1359700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0b30d0 0x7fa3bc14ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1359700 1 -- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3bc0ace70 msgr2=0x7fa3bc0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1359700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3bc0ace70 0x7fa3bc0b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1359700 1 -- 172.21.15.12:0/2410426546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b4009470 con 0x7fa3bc0b0710 2021-10-20T23:29:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c1359700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3bc0b0710 0x7fa3bc14e6f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7fa3ac0011d0 tx=0x7fa3ac007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3aaffd700 1 -- 172.21.15.12:0/2410426546 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3ac0070d0 con 0x7fa3bc0b0710 2021-10-20T23:29:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3aaffd700 1 -- 172.21.15.12:0/2410426546 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac007230 con 0x7fa3bc0b0710 2021-10-20T23:29:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc0ac430 con 0x7fa3bc0b0710 2021-10-20T23:29:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3aaffd700 1 -- 172.21.15.12:0/2410426546 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3ac005610 con 0x7fa3bc0b0710 2021-10-20T23:29:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc067780 con 0x7fa3bc0b0710 2021-10-20T23:29:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.123+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc0ac5c0 con 0x7fa3bc0b0710 2021-10-20T23:29:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.127+0000 7fa3aaffd700 1 -- 172.21.15.12:0/2410426546 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa3ac01a060 con 0x7fa3bc0b0710 2021-10-20T23:29:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.127+0000 7fa3aaffd700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa39c053610 0x7fa39c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.127+0000 7fa3aaffd700 1 -- 172.21.15.12:0/2410426546 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fa3ac06b220 con 0x7fa3bc0b0710 2021-10-20T23:29:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.127+0000 7fa3c1b5a700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa39c053610 0x7fa39c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.127+0000 7fa3c1b5a700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa39c053610 0x7fa39c055ad0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fa3b800d000 tx=0x7fa3b8007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.131+0000 7fa3aaffd700 1 -- 172.21.15.12:0/2410426546 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3ac0421d0 con 0x7fa3bc0b0710 2021-10-20T23:29:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3bc057350 con 0x7fa3bc0b0710 2021-10-20T23:29:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3aaffd700 1 -- 172.21.15.12:0/2410426546 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fa3ac018020 con 0x7fa3bc0b0710 2021-10-20T23:29:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:23.310 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":79,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/4126550791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4126550791},{"type":"v1","addr":"172.21.15.31:6835","nonce":4126550791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/815086520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":815086520},{"type":"v1","addr":"172.21.15.12:6833","nonce":815086520}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[{"mdsmap":{"epoch":79,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:11.262079+0000","modified":"2021-10-20T23:29:22.986693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":153,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-20T23:29:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa39c053610 msgr2=0x7fa39c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa39c053610 0x7fa39c055ad0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fa3b800d000 tx=0x7fa3b8007a20).stop 2021-10-20T23:29:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3bc0b0710 msgr2=0x7fa3bc14e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3bc0b0710 0x7fa3bc14e6f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7fa3ac0011d0 tx=0x7fa3ac007b50).stop 2021-10-20T23:29:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 shutdown_connections 2021-10-20T23:29:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa39c053610 0x7fa39c055ad0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3bc0b30d0 0x7fa3bc14ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3bc0b0710 0x7fa3bc14e6f0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 --2- 172.21.15.12:0/2410426546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3bc0ace70 0x7fa3bc0b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 >> 172.21.15.12:0/2410426546 conn(0x7fa3bc061140 msgr2=0x7fa3bc0a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 shutdown_connections 2021-10-20T23:29:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.299+0000 7fa3c2b5c700 1 -- 172.21.15.12:0/2410426546 wait complete. 2021-10-20T23:29:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 79 2021-10-20T23:29:23.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:29:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fdddf59e700 1 Processor -- start 2021-10-20T23:29:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fdddf59e700 1 -- start start 2021-10-20T23:29:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fdddf59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdde005d0b0 0x7fdde00b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fdddf59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdde013f390 0x7fdde00aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fdddf59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde005cbb0 con 0x7fdde005c7d0 2021-10-20T23:29:23.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fdddf59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde00ad540 con 0x7fdde005d0b0 2021-10-20T23:29:23.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fdddf59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde0067d70 con 0x7fdde013f390 2021-10-20T23:29:23.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fddddd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdde005d0b0 0x7fdde00b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fddde59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdde005c7d0 0x7fdde00ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44166/0 (socket says 172.21.15.12:44166) 2021-10-20T23:29:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fddde59c700 1 -- 172.21.15.12:0/357394229 learned_addr learned my addr 172.21.15.12:0/357394229 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.467+0000 7fddded9d700 1 --2- 172.21.15.12:0/357394229 >> v2:172.21.15.31:3300/0 conn(0x7fdde013f390 0x7fdde00aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddd59a700 1 -- 172.21.15.12:0/357394229 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668237425 0 0) 0x7fdde005cbb0 con 0x7fdde005c7d0 2021-10-20T23:29:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddd59a700 1 -- 172.21.15.12:0/357394229 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc4003260 con 0x7fdde005c7d0 2021-10-20T23:29:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fddddd9b700 1 -- 172.21.15.12:0/357394229 >> v2:172.21.15.31:3300/0 conn(0x7fdde013f390 msgr2=0x7fdde00aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:23.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fddddd9b700 1 --2- 172.21.15.12:0/357394229 >> v2:172.21.15.31:3300/0 conn(0x7fdde013f390 0x7fdde00aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fddddd9b700 1 -- 172.21.15.12:0/357394229 >> v1:172.21.15.12:6789/0 conn(0x7fdde005c7d0 legacy=0x7fdde00ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fddddd9b700 1 -- 172.21.15.12:0/357394229 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde00b1790 con 0x7fdde005d0b0 2021-10-20T23:29:23.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fddddd9b700 1 --2- 172.21.15.12:0/357394229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005d0b0 0x7fdde00b10f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7fddd0002f70 tx=0x7fddd0006df0).ready entity=mon.0 client_cookie=8d45f6372339ad5a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:23.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddd59a700 1 -- 172.21.15.12:0/357394229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd000d4f0 con 0x7fdde005d0b0 2021-10-20T23:29:23.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddd59a700 1 -- 172.21.15.12:0/357394229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0000e90 con 0x7fdde005d0b0 2021-10-20T23:29:23.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddd59a700 1 -- 172.21.15.12:0/357394229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd000d840 con 0x7fdde005d0b0 2021-10-20T23:29:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 -- 172.21.15.12:0/357394229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005d0b0 msgr2=0x7fdde00b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 --2- 172.21.15.12:0/357394229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005d0b0 0x7fdde00b10f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7fddd0002f70 tx=0x7fddd0006df0).stop 2021-10-20T23:29:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 -- 172.21.15.12:0/357394229 shutdown_connections 2021-10-20T23:29:23.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 --2- 172.21.15.12:0/357394229 >> v2:172.21.15.31:3300/0 conn(0x7fdde013f390 0x7fdde00aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 --2- 172.21.15.12:0/357394229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005d0b0 0x7fdde00b10f0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 -- 172.21.15.12:0/357394229 >> 172.21.15.12:0/357394229 conn(0x7fdde0060180 msgr2=0x7fdde00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:23.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 -- 172.21.15.12:0/357394229 shutdown_connections 2021-10-20T23:29:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 -- 172.21.15.12:0/357394229 wait complete. 2021-10-20T23:29:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 Processor -- start 2021-10-20T23:29:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.471+0000 7fdddf59e700 1 -- start start 2021-10-20T23:29:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fdddf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005c7d0 0x7fdde0064570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fdddf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde005d0b0 0x7fdde00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fdddf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde013f390 0x7fdde0066410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fdddf59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde0065d40 con 0x7fdde005c7d0 2021-10-20T23:29:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fdddf59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00670e0 con 0x7fdde005d0b0 2021-10-20T23:29:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fdddf59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde0067380 con 0x7fdde013f390 2021-10-20T23:29:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddde59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005c7d0 0x7fdde0064570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddde59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005c7d0 0x7fdde0064570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45576/0 (socket says 172.21.15.12:45576) 2021-10-20T23:29:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddde59c700 1 -- 172.21.15.12:0/3814282896 learned_addr learned my addr 172.21.15.12:0/3814282896 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddded9d700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde013f390 0x7fdde0066410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddddd9b700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde005d0b0 0x7fdde00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddde59c700 1 -- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde013f390 msgr2=0x7fdde0066410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddde59c700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde013f390 0x7fdde0066410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddde59c700 1 -- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde005d0b0 msgr2=0x7fdde00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddde59c700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde005d0b0 0x7fdde00b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddde59c700 1 -- 172.21.15.12:0/3814282896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd000b180 con 0x7fdde005c7d0 2021-10-20T23:29:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddde59c700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005c7d0 0x7fdde0064570 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fddd4001110 tx=0x7fddd4007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:23.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddcf7fe700 1 -- 172.21.15.12:0/3814282896 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd40070d0 con 0x7fdde005c7d0 2021-10-20T23:29:23.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddcf7fe700 1 -- 172.21.15.12:0/3814282896 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4007230 con 0x7fdde005c7d0 2021-10-20T23:29:23.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde0065f70 con 0x7fdde005c7d0 2021-10-20T23:29:23.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fddcf7fe700 1 -- 172.21.15.12:0/3814282896 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd4005610 con 0x7fdde005c7d0 2021-10-20T23:29:23.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.475+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde0066c60 con 0x7fdde005c7d0 2021-10-20T23:29:23.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.479+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde0066100 con 0x7fdde005c7d0 2021-10-20T23:29:23.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.479+0000 7fddcf7fe700 1 -- 172.21.15.12:0/3814282896 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fddd4010070 con 0x7fdde005c7d0 2021-10-20T23:29:23.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.479+0000 7fddcf7fe700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddbc0534f0 0x7fddbc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:23.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.479+0000 7fddcf7fe700 1 -- 172.21.15.12:0/3814282896 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fddd406b0c0 con 0x7fdde005c7d0 2021-10-20T23:29:23.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.479+0000 7fddddd9b700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddbc0534f0 0x7fddbc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:23.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.479+0000 7fddddd9b700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddbc0534f0 0x7fddbc0559b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fddd001a000 tx=0x7fddd0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.483+0000 7fddcf7fe700 1 -- 172.21.15.12:0/3814282896 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fddd4042070 con 0x7fdde005c7d0 2021-10-20T23:29:23.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:23.647+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdde00b1a30 con 0x7fdde005c7d0 2021-10-20T23:29:24.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.007+0000 7fddcf7fe700 1 -- 172.21.15.12:0/3814282896 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7fddd4045690 con 0x7fdde005c7d0 2021-10-20T23:29:24.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddbc0534f0 msgr2=0x7fddbc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:24.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddbc0534f0 0x7fddbc0559b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fddd001a000 tx=0x7fddd0014000).stop 2021-10-20T23:29:24.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005c7d0 msgr2=0x7fdde0064570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:24.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005c7d0 0x7fdde0064570 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fddd4001110 tx=0x7fddd4007ad0).stop 2021-10-20T23:29:24.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 shutdown_connections 2021-10-20T23:29:24.021 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddbc0534f0 0x7fddbc0559b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde013f390 0x7fdde0066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde005d0b0 0x7fdde00b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 --2- 172.21.15.12:0/3814282896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde005c7d0 0x7fdde0064570 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 >> 172.21.15.12:0/3814282896 conn(0x7fdde0060180 msgr2=0x7fdde00b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 shutdown_connections 2021-10-20T23:29:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.011+0000 7fdddf59e700 1 -- 172.21.15.12:0/3814282896 wait complete. 2021-10-20T23:29:24.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:29:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88f1b6700 1 Processor -- start 2021-10-20T23:29:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88f1b6700 1 -- start start 2021-10-20T23:29:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88f1b6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc888060910 0x7fc8880acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88f1b6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc8880aa5d0 0x7fc88813c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:24.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88f1b6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880b6ce0 con 0x7fc8880b6900 2021-10-20T23:29:24.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88f1b6700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880611e0 con 0x7fc888060910 2021-10-20T23:29:24.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88f1b6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc888061480 con 0x7fc8880aa5d0 2021-10-20T23:29:24.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc887fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc888060910 0x7fc8880acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:24.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88cf52700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc8880b6900 0x7fc8880a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:51242/0 (socket says 172.21.15.12:51242) 2021-10-20T23:29:24.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88cf52700 1 -- 172.21.15.12:0/3152670021 learned_addr learned my addr 172.21.15.12:0/3152670021 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:24.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc88d753700 1 --2- 172.21.15.12:0/3152670021 >> v2:172.21.15.31:3300/0 conn(0x7fc8880aa5d0 0x7fc88813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc887fff700 1 -- 172.21.15.12:0/3152670021 >> v2:172.21.15.31:3300/0 conn(0x7fc8880aa5d0 msgr2=0x7fc88813c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc887fff700 1 --2- 172.21.15.12:0/3152670021 >> v2:172.21.15.31:3300/0 conn(0x7fc8880aa5d0 0x7fc88813c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc887fff700 1 -- 172.21.15.12:0/3152670021 >> v1:172.21.15.31:6789/0 conn(0x7fc8880b6900 legacy=0x7fc8880a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.143+0000 7fc887fff700 1 -- 172.21.15.12:0/3152670021 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888061720 con 0x7fc888060910 2021-10-20T23:29:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc887fff700 1 --2- 172.21.15.12:0/3152670021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 0x7fc8880acd50 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fc87c002f70 tx=0x7fc87c006df0).ready entity=mon.0 client_cookie=806eb9c849155b18 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc8877fe700 1 -- 172.21.15.12:0/3152670021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc87c00d570 con 0x7fc888060910 2021-10-20T23:29:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc8877fe700 1 -- 172.21.15.12:0/3152670021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c000e90 con 0x7fc888060910 2021-10-20T23:29:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc8877fe700 1 -- 172.21.15.12:0/3152670021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc87c00d8c0 con 0x7fc888060910 2021-10-20T23:29:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3152670021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 msgr2=0x7fc8880acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc88f1b6700 1 --2- 172.21.15.12:0/3152670021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 0x7fc8880acd50 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fc87c002f70 tx=0x7fc87c006df0).stop 2021-10-20T23:29:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3152670021 shutdown_connections 2021-10-20T23:29:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc88f1b6700 1 --2- 172.21.15.12:0/3152670021 >> v2:172.21.15.31:3300/0 conn(0x7fc8880aa5d0 0x7fc88813c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc88f1b6700 1 --2- 172.21.15.12:0/3152670021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 0x7fc8880acd50 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3152670021 >> 172.21.15.12:0/3152670021 conn(0x7fc8880b3480 msgr2=0x7fc8880b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3152670021 shutdown_connections 2021-10-20T23:29:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.147+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3152670021 wait complete. 2021-10-20T23:29:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 Processor -- start 2021-10-20T23:29:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 -- start start 2021-10-20T23:29:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 0x7fc88812f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8880aa5d0 0x7fc8880b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8880b6900 0x7fc8880b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88813eee0 con 0x7fc888060910 2021-10-20T23:29:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88813e020 con 0x7fc8880b6900 2021-10-20T23:29:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88813f110 con 0x7fc8880aa5d0 2021-10-20T23:29:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88cf52700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 0x7fc88812f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88cf52700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 0x7fc88812f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45590/0 (socket says 172.21.15.12:45590) 2021-10-20T23:29:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88cf52700 1 -- 172.21.15.12:0/3650498685 learned_addr learned my addr 172.21.15.12:0/3650498685 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88d753700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8880b6900 0x7fc8880b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc887fff700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8880aa5d0 0x7fc8880b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88cf52700 1 -- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8880aa5d0 msgr2=0x7fc8880b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88cf52700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8880aa5d0 0x7fc8880b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88cf52700 1 -- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8880b6900 msgr2=0x7fc8880b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88cf52700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8880b6900 0x7fc8880b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88cf52700 1 -- 172.21.15.12:0/3650498685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c00b180 con 0x7fc888060910 2021-10-20T23:29:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc887fff700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8880aa5d0 0x7fc8880b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88d753700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8880b6900 0x7fc8880b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88cf52700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 0x7fc88812f190 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fc888060300 tx=0x7fc878007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc885ffb700 1 -- 172.21.15.12:0/3650498685 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc87800ce30 con 0x7fc888060910 2021-10-20T23:29:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc885ffb700 1 -- 172.21.15.12:0/3650498685 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8780072e0 con 0x7fc888060910 2021-10-20T23:29:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc885ffb700 1 -- 172.21.15.12:0/3650498685 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8780057c0 con 0x7fc888060910 2021-10-20T23:29:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88813f3b0 con 0x7fc888060910 2021-10-20T23:29:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.151+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8880b07a0 con 0x7fc888060910 2021-10-20T23:29:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.155+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8880619c0 con 0x7fc888060910 2021-10-20T23:29:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.155+0000 7fc885ffb700 1 -- 172.21.15.12:0/3650498685 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc878010070 con 0x7fc888060910 2021-10-20T23:29:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.155+0000 7fc885ffb700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8680536a0 0x7fc868055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:24.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.155+0000 7fc885ffb700 1 -- 172.21.15.12:0/3650498685 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fc87806b2e0 con 0x7fc888060910 2021-10-20T23:29:24.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.155+0000 7fc887fff700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8680536a0 0x7fc868055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:24.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.155+0000 7fc887fff700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8680536a0 0x7fc868055b60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fc87c018000 tx=0x7fc87c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:24.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.163+0000 7fc885ffb700 1 -- 172.21.15.12:0/3650498685 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc878042100 con 0x7fc888060910 2021-10-20T23:29:24.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:24.295+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc888057350 con 0x7fc888060910 2021-10-20T23:29:25.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.023+0000 7fc885ffb700 1 -- 172.21.15.12:0/3650498685 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v154) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc878018070 con 0x7fc888060910 2021-10-20T23:29:25.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.027+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8680536a0 msgr2=0x7fc868055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:25.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.027+0000 7fc88f1b6700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8680536a0 0x7fc868055b60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fc87c018000 tx=0x7fc87c014000).stop 2021-10-20T23:29:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.027+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 msgr2=0x7fc88812f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.027+0000 7fc88f1b6700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 0x7fc88812f190 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fc888060300 tx=0x7fc878007c30).stop 2021-10-20T23:29:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.031+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 shutdown_connections 2021-10-20T23:29:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.031+0000 7fc88f1b6700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc8680536a0 0x7fc868055b60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.031+0000 7fc88f1b6700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8880b6900 0x7fc8880b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:25.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.031+0000 7fc88f1b6700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8880aa5d0 0x7fc8880b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:25.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.031+0000 7fc88f1b6700 1 --2- 172.21.15.12:0/3650498685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc888060910 0x7fc88812f190 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:25.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.031+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 >> 172.21.15.12:0/3650498685 conn(0x7fc8880b3480 msgr2=0x7fc888133350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:25.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.031+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 shutdown_connections 2021-10-20T23:29:25.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.031+0000 7fc88f1b6700 1 -- 172.21.15.12:0/3650498685 wait complete. 2021-10-20T23:29:25.043 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:29:25.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:29:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f5724d59700 1 Processor -- start 2021-10-20T23:29:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f5724d59700 1 -- start start 2021-10-20T23:29:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f5724d59700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200b2580 0x7f572014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f5724d59700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57200b0010 0x7f572014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f5724d59700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200a70c0 con 0x7f57200afbd0 2021-10-20T23:29:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f5724d59700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200a72f0 con 0x7f57200b0010 2021-10-20T23:29:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f5724d59700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200a7590 con 0x7f57200b2580 2021-10-20T23:29:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57200b0010 0x7f572014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57200b0010 0x7f572014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45600/0 (socket says 172.21.15.12:45600) 2021-10-20T23:29:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f57200afbd0 0x7f57200a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44194/0 (socket says 172.21.15.12:44194) 2021-10-20T23:29:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571effd700 1 -- 172.21.15.12:0/795110041 learned_addr learned my addr 172.21.15.12:0/795110041 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571f7fe700 1 --2- 172.21.15.12:0/795110041 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200b2580 0x7f572014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571effd700 1 -- 172.21.15.12:0/795110041 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200b2580 msgr2=0x7f572014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571effd700 1 --2- 172.21.15.12:0/795110041 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200b2580 0x7f572014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571effd700 1 -- 172.21.15.12:0/795110041 >> v1:172.21.15.12:6789/0 conn(0x7f57200afbd0 legacy=0x7f57200a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571e7fc700 1 -- 172.21.15.12:0/795110041 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639456388 0 0) 0x7f57200a70c0 con 0x7f57200afbd0 2021-10-20T23:29:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571effd700 1 -- 172.21.15.12:0/795110041 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200a7830 con 0x7f57200b0010 2021-10-20T23:29:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571effd700 1 --2- 172.21.15.12:0/795110041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 0x7f572014b330 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f5710002f70 tx=0x7f5710006eb0).ready entity=mon.0 client_cookie=83090c7301fec432 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571e7fc700 1 -- 172.21.15.12:0/795110041 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571000d570 con 0x7f57200b0010 2021-10-20T23:29:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571e7fc700 1 -- 172.21.15.12:0/795110041 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710000e90 con 0x7f57200b0010 2021-10-20T23:29:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.163+0000 7f571e7fc700 1 -- 172.21.15.12:0/795110041 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571000d8c0 con 0x7f57200b0010 2021-10-20T23:29:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 -- 172.21.15.12:0/795110041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 msgr2=0x7f572014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 --2- 172.21.15.12:0/795110041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 0x7f572014b330 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f5710002f70 tx=0x7f5710006eb0).stop 2021-10-20T23:29:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 -- 172.21.15.12:0/795110041 shutdown_connections 2021-10-20T23:29:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 --2- 172.21.15.12:0/795110041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 0x7f572014b330 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 --2- 172.21.15.12:0/795110041 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200b2580 0x7f572014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 -- 172.21.15.12:0/795110041 >> 172.21.15.12:0/795110041 conn(0x7f5720060180 msgr2=0x7f57200b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 -- 172.21.15.12:0/795110041 shutdown_connections 2021-10-20T23:29:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 -- 172.21.15.12:0/795110041 wait complete. 2021-10-20T23:29:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 Processor -- start 2021-10-20T23:29:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 -- start start 2021-10-20T23:29:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200afbd0 0x7f572014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 0x7f5720148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200b2580 0x7f5720156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200aba40 con 0x7f57200b0010 2021-10-20T23:29:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200abca0 con 0x7f57200b2580 2021-10-20T23:29:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f5724d59700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200abf40 con 0x7f57200afbd0 2021-10-20T23:29:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f571effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 0x7f5720148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f571effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 0x7f5720148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45606/0 (socket says 172.21.15.12:45606) 2021-10-20T23:29:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f571effd700 1 -- 172.21.15.12:0/4149549313 learned_addr learned my addr 172.21.15.12:0/4149549313 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f571f7fe700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200afbd0 0x7f572014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.167+0000 7f571ffff700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200b2580 0x7f5720156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571effd700 1 -- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200afbd0 msgr2=0x7f572014d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571effd700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200afbd0 0x7f572014d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571effd700 1 -- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200b2580 msgr2=0x7f5720156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571effd700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200b2580 0x7f5720156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571effd700 1 -- 172.21.15.12:0/4149549313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571000b1e0 con 0x7f57200b0010 2021-10-20T23:29:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571ffff700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200b2580 0x7f5720156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571effd700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 0x7f5720148a00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f5710002f70 tx=0x7f5710015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571cff9700 1 -- 172.21.15.12:0/4149549313 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57100068b0 con 0x7f57200b0010 2021-10-20T23:29:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571cff9700 1 -- 172.21.15.12:0/4149549313 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000d8f0 con 0x7f57200b0010 2021-10-20T23:29:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572015a710 con 0x7f57200b0010 2021-10-20T23:29:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571cff9700 1 -- 172.21.15.12:0/4149549313 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571001e460 con 0x7f57200b0010 2021-10-20T23:29:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572015a2e0 con 0x7f57200b0010 2021-10-20T23:29:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5720057350 con 0x7f57200b0010 2021-10-20T23:29:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571cff9700 1 -- 172.21.15.12:0/4149549313 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5710025030 con 0x7f57200b0010 2021-10-20T23:29:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571cff9700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5700053660 0x7f5700055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571cff9700 1 -- 172.21.15.12:0/4149549313 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f571006cc30 con 0x7f57200b0010 2021-10-20T23:29:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.171+0000 7f571f7fe700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5700053660 0x7f5700055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:25.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.175+0000 7f571f7fe700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5700053660 0x7f5700055b20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f571400b000 tx=0x7f5714006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:25.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.175+0000 7f571cff9700 1 -- 172.21.15.12:0/4149549313 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5710073080 con 0x7f57200b0010 2021-10-20T23:29:25.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:25.307+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f57200698e0 con 0x7f57200b0010 2021-10-20T23:29:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.039+0000 7f571cff9700 1 -- 172.21.15.12:0/4149549313 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v155) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5710043e10 con 0x7f57200b0010 2021-10-20T23:29:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5700053660 msgr2=0x7f5700055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5700053660 0x7f5700055b20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f571400b000 tx=0x7f5714006df0).stop 2021-10-20T23:29:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 msgr2=0x7f5720148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 0x7f5720148a00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f5710002f70 tx=0x7f5710015000).stop 2021-10-20T23:29:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 shutdown_connections 2021-10-20T23:29:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5700053660 0x7f5700055b20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57200b2580 0x7f5720156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57200b0010 0x7f5720148a00 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 --2- 172.21.15.12:0/4149549313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57200afbd0 0x7f572014d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 >> 172.21.15.12:0/4149549313 conn(0x7f5720060180 msgr2=0x7f5720149890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 shutdown_connections 2021-10-20T23:29:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.043+0000 7f5724d59700 1 -- 172.21.15.12:0/4149549313 wait complete. 2021-10-20T23:29:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:29:26.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-20T23:29:26.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9ca0bd4700 1 Processor -- start 2021-10-20T23:29:26.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9ca0bd4700 1 -- start start 2021-10-20T23:29:26.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9ca0bd4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c9c0b6560 0x7f9c9c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9ca0bd4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c9c0b5990 0x7f9c9c0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9ca0bd4700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c143f60 con 0x7f9c9c05fc00 2021-10-20T23:29:26.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9ca0bd4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0ba6b0 con 0x7f9c9c0b5990 2021-10-20T23:29:26.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9ca0bd4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c05ffe0 con 0x7f9c9c0b6560 2021-10-20T23:29:26.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9c9a59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9c9c05fc00 0x7f9c9c0b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44206/0 (socket says 172.21.15.12:44206) 2021-10-20T23:29:26.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9c9a59c700 1 -- 172.21.15.12:0/3251135159 learned_addr learned my addr 172.21.15.12:0/3251135159 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:26.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.171+0000 7f9c9ad9d700 1 --2- 172.21.15.12:0/3251135159 >> v2:172.21.15.12:3300/0 conn(0x7f9c9c0b5990 0x7f9c9c0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c99d9b700 1 --2- 172.21.15.12:0/3251135159 >> v2:172.21.15.31:3300/0 conn(0x7f9c9c0b6560 0x7f9c9c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9959a700 1 -- 172.21.15.12:0/3251135159 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502415194 0 0) 0x7f9c9c143f60 con 0x7f9c9c05fc00 2021-10-20T23:29:26.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9959a700 1 -- 172.21.15.12:0/3251135159 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c80003260 con 0x7f9c9c05fc00 2021-10-20T23:29:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9959a700 1 -- 172.21.15.12:0/3251135159 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2144848840 0 0) 0x7f9c80003260 con 0x7f9c9c05fc00 2021-10-20T23:29:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9ad9d700 1 -- 172.21.15.12:0/3251135159 >> v2:172.21.15.31:3300/0 conn(0x7f9c9c0b6560 msgr2=0x7f9c9c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9ad9d700 1 --2- 172.21.15.12:0/3251135159 >> v2:172.21.15.31:3300/0 conn(0x7f9c9c0b6560 0x7f9c9c0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9ad9d700 1 -- 172.21.15.12:0/3251135159 >> v1:172.21.15.12:6789/0 conn(0x7f9c9c05fc00 legacy=0x7f9c9c0b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9ad9d700 1 -- 172.21.15.12:0/3251135159 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c143a50 con 0x7f9c9c0b5990 2021-10-20T23:29:26.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c99d9b700 1 --2- 172.21.15.12:0/3251135159 >> v2:172.21.15.31:3300/0 conn(0x7f9c9c0b6560 0x7f9c9c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:26.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9ad9d700 1 --2- 172.21.15.12:0/3251135159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b5990 0x7f9c9c0b4a00 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f9c90001800 tx=0x7f9c940091d0).ready entity=mon.0 client_cookie=13ee092b117ffd86 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:26.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9959a700 1 -- 172.21.15.12:0/3251135159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c90001660 con 0x7f9c9c0b5990 2021-10-20T23:29:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9959a700 1 -- 172.21.15.12:0/3251135159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9400f510 con 0x7f9c9c0b5990 2021-10-20T23:29:26.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9c9959a700 1 -- 172.21.15.12:0/3251135159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c9400f680 con 0x7f9c9c0b5990 2021-10-20T23:29:26.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/3251135159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b5990 msgr2=0x7f9c9c0b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 --2- 172.21.15.12:0/3251135159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b5990 0x7f9c9c0b4a00 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f9c90001800 tx=0x7f9c940091d0).stop 2021-10-20T23:29:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/3251135159 shutdown_connections 2021-10-20T23:29:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 --2- 172.21.15.12:0/3251135159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b5990 0x7f9c9c0b4a00 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 --2- 172.21.15.12:0/3251135159 >> v2:172.21.15.31:3300/0 conn(0x7f9c9c0b6560 0x7f9c9c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/3251135159 >> 172.21.15.12:0/3251135159 conn(0x7f9c9c0623a0 msgr2=0x7f9c9c066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/3251135159 shutdown_connections 2021-10-20T23:29:26.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/3251135159 wait complete. 2021-10-20T23:29:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 Processor -- start 2021-10-20T23:29:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 -- start start 2021-10-20T23:29:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c9c05fc00 0x7f9c9c0b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c9c0b5990 0x7f9c9c1406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b6560 0x7f9c9c1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c13f0a0 con 0x7f9c9c0b6560 2021-10-20T23:29:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c13ff70 con 0x7f9c9c05fc00 2021-10-20T23:29:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.175+0000 7f9ca0bd4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c140210 con 0x7f9c9c0b5990 2021-10-20T23:29:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b6560 0x7f9c9c1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b6560 0x7f9c9c1521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45622/0 (socket says 172.21.15.12:45622) 2021-10-20T23:29:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9ad9d700 1 -- 172.21.15.12:0/1679683644 learned_addr learned my addr 172.21.15.12:0/1679683644 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c99d9b700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c9c0b5990 0x7f9c9c1406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9a59c700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c9c05fc00 0x7f9c9c0b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9ad9d700 1 -- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c9c0b5990 msgr2=0x7f9c9c1406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9ad9d700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c9c0b5990 0x7f9c9c1406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9ad9d700 1 -- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c9c05fc00 msgr2=0x7f9c9c0b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9ad9d700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c9c05fc00 0x7f9c9c0b8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9ad9d700 1 -- 172.21.15.12:0/1679683644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c00b180 con 0x7f9c9c0b6560 2021-10-20T23:29:26.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9ad9d700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b6560 0x7f9c9c1521e0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f9c90001800 tx=0x7f9c94016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c8b7fe700 1 -- 172.21.15.12:0/1679683644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c940032d0 con 0x7f9c9c0b6560 2021-10-20T23:29:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c8b7fe700 1 -- 172.21.15.12:0/1679683644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c94011970 con 0x7f9c9c0b6560 2021-10-20T23:29:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c8b7fe700 1 -- 172.21.15.12:0/1679683644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c94011cd0 con 0x7f9c9c0b6560 2021-10-20T23:29:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c94009470 con 0x7f9c9c0b6560 2021-10-20T23:29:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c0b0530 con 0x7f9c9c0b6560 2021-10-20T23:29:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c8b7fe700 1 -- 172.21.15.12:0/1679683644 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9c94026030 con 0x7f9c9c0b6560 2021-10-20T23:29:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c8b7fe700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c78053610 0x7f9c78055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c8b7fe700 1 -- 172.21.15.12:0/1679683644 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f9c9406bff0 con 0x7f9c9c0b6560 2021-10-20T23:29:26.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c1403d0 con 0x7f9c9c0b6560 2021-10-20T23:29:26.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.179+0000 7f9c9a59c700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c78053610 0x7f9c78055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.183+0000 7f9c9a59c700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c78053610 0x7f9c78055ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f9c9000d000 tx=0x7f9c900019f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:26.207 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.183+0000 7f9c8b7fe700 1 -- 172.21.15.12:0/1679683644 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9c94024080 con 0x7f9c9c0b6560 2021-10-20T23:29:26.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.315+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9c9c13f1e0 con 0x7f9c9c0b6560 2021-10-20T23:29:26.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.323+0000 7f9c8b7fe700 1 -- 172.21.15.12:0/1679683644 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9c94015020 con 0x7f9c9c0b6560 2021-10-20T23:29:26.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c78053610 msgr2=0x7f9c78055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c78053610 0x7f9c78055ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f9c9000d000 tx=0x7f9c900019f0).stop 2021-10-20T23:29:26.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b6560 msgr2=0x7f9c9c1521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b6560 0x7f9c9c1521e0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f9c90001800 tx=0x7f9c94016000).stop 2021-10-20T23:29:26.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 shutdown_connections 2021-10-20T23:29:26.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9c78053610 0x7f9c78055ad0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c9c0b6560 0x7f9c9c1521e0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c9c0b5990 0x7f9c9c1406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 --2- 172.21.15.12:0/1679683644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c9c05fc00 0x7f9c9c0b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 >> 172.21.15.12:0/1679683644 conn(0x7f9c9c0623a0 msgr2=0x7f9c9c12b480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:26.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 shutdown_connections 2021-10-20T23:29:26.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.327+0000 7f9ca0bd4700 1 -- 172.21.15.12:0/1679683644 wait complete. 2021-10-20T23:29:26.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-10-20T23:29:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.439+0000 7f59a0e9c700 1 Processor -- start 2021-10-20T23:29:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.439+0000 7f59a0e9c700 1 -- start start 2021-10-20T23:29:26.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f599c0b0ff0 0x7f599c141790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c0aaa90 con 0x7f599c0b2720 2021-10-20T23:29:26.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c0b2b00 con 0x7f599c13e740 2021-10-20T23:29:26.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c140c90 con 0x7f599c0b0ff0 2021-10-20T23:29:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f599c0b2720 0x7f599c13e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44222/0 (socket says 172.21.15.12:44222) 2021-10-20T23:29:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599b7fe700 1 -- 172.21.15.12:0/4044384043 learned_addr learned my addr 172.21.15.12:0/4044384043 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599bfff700 1 --2- 172.21.15.12:0/4044384043 >> v2:172.21.15.31:3300/0 conn(0x7f599c0b0ff0 0x7f599c141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599affd700 1 -- 172.21.15.12:0/4044384043 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732572073 0 0) 0x7f5984001110 con 0x7f599c0b2720 2021-10-20T23:29:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599affd700 1 -- 172.21.15.12:0/4044384043 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f597c003260 con 0x7f599c0b2720 2021-10-20T23:29:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599affd700 1 -- 172.21.15.12:0/4044384043 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731448333 0 0) 0x7f599c0b2b00 con 0x7f599c13e740 2021-10-20T23:29:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599affd700 1 -- 172.21.15.12:0/4044384043 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5984001110 con 0x7f599c13e740 2021-10-20T23:29:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599bfff700 1 -- 172.21.15.12:0/4044384043 >> v1:172.21.15.31:6789/0 conn(0x7f599c13e740 legacy=0x7f599c141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599bfff700 1 -- 172.21.15.12:0/4044384043 >> v1:172.21.15.12:6789/0 conn(0x7f599c0b2720 legacy=0x7f599c13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599bfff700 1 -- 172.21.15.12:0/4044384043 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c0aa2b0 con 0x7f599c0b0ff0 2021-10-20T23:29:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599bfff700 1 --2- 172.21.15.12:0/4044384043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599c0b0ff0 0x7f599c141790 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f59940032f0 tx=0x7f59940091d0).ready entity=mon.1 client_cookie=6f146be38f1e5472 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:26.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599affd700 1 -- 172.21.15.12:0/4044384043 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f599400b600 con 0x7f599c0b0ff0 2021-10-20T23:29:26.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599affd700 1 -- 172.21.15.12:0/4044384043 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400b760 con 0x7f599c0b0ff0 2021-10-20T23:29:26.458 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f599affd700 1 -- 172.21.15.12:0/4044384043 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f599400b8d0 con 0x7f599c0b0ff0 2021-10-20T23:29:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 -- 172.21.15.12:0/4044384043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599c0b0ff0 msgr2=0x7f599c141790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 --2- 172.21.15.12:0/4044384043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599c0b0ff0 0x7f599c141790 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f59940032f0 tx=0x7f59940091d0).stop 2021-10-20T23:29:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 -- 172.21.15.12:0/4044384043 shutdown_connections 2021-10-20T23:29:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 --2- 172.21.15.12:0/4044384043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599c0b0ff0 0x7f599c141790 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 -- 172.21.15.12:0/4044384043 >> 172.21.15.12:0/4044384043 conn(0x7f599c060180 msgr2=0x7f599c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 -- 172.21.15.12:0/4044384043 shutdown_connections 2021-10-20T23:29:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.443+0000 7f59a0e9c700 1 -- 172.21.15.12:0/4044384043 wait complete. 2021-10-20T23:29:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.447+0000 7f59a0e9c700 1 Processor -- start 2021-10-20T23:29:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.447+0000 7f59a0e9c700 1 -- start start 2021-10-20T23:29:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59a0e9c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f599c0b0ff0 0x7f599c1431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59a0e9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c0b2720 0x7f599c13c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59a0e9c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599c140260 0x7f599c13c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59a0e9c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c0b4a10 con 0x7f599c0b2720 2021-10-20T23:29:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59a0e9c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c13cc10 con 0x7f599c140260 2021-10-20T23:29:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59a0e9c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c150a60 con 0x7f599c0b0ff0 2021-10-20T23:29:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f5993fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c0b2720 0x7f599c13c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f5993fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c0b2720 0x7f599c13c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45634/0 (socket says 172.21.15.12:45634) 2021-10-20T23:29:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f5993fff700 1 -- 172.21.15.12:0/3917444518 learned_addr learned my addr 172.21.15.12:0/3917444518 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f599bfff700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599c140260 0x7f599c13c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f599b7fe700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f599c0b0ff0 0x7f599c1431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f5993fff700 1 -- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f599c0b0ff0 msgr2=0x7f599c1431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f5993fff700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f599c0b0ff0 0x7f599c1431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f5993fff700 1 -- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599c140260 msgr2=0x7f599c13c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f5993fff700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599c140260 0x7f599c13c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f5993fff700 1 -- 172.21.15.12:0/3917444518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994009470 con 0x7f599c0b2720 2021-10-20T23:29:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f5993fff700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c0b2720 0x7f599c13c230 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f598c001110 tx=0x7f598c007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59997fa700 1 -- 172.21.15.12:0/3917444518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f598c00cde0 con 0x7f599c0b2720 2021-10-20T23:29:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59997fa700 1 -- 172.21.15.12:0/3917444518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c012400 con 0x7f599c0b2720 2021-10-20T23:29:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59997fa700 1 -- 172.21.15.12:0/3917444518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f598c012760 con 0x7f599c0b2720 2021-10-20T23:29:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c150d00 con 0x7f599c0b2720 2021-10-20T23:29:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c1436b0 con 0x7f599c0b2720 2021-10-20T23:29:26.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.451+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c150e90 con 0x7f599c0b2720 2021-10-20T23:29:26.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.455+0000 7f59997fa700 1 -- 172.21.15.12:0/3917444518 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f598c019030 con 0x7f599c0b2720 2021-10-20T23:29:26.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.455+0000 7f59997fa700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5980053610 0x7f5980055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:26.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.455+0000 7f59997fa700 1 -- 172.21.15.12:0/3917444518 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f598c06aa30 con 0x7f599c0b2720 2021-10-20T23:29:26.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.455+0000 7f599b7fe700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5980053610 0x7f5980055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:26.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.455+0000 7f599b7fe700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5980053610 0x7f5980055ad0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f598400d000 tx=0x7f5984009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:26.473 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.459+0000 7f59997fa700 1 -- 172.21.15.12:0/3917444518 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f598c041d10 con 0x7f599c0b2720 2021-10-20T23:29:26.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:26.627+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f599c057350 con 0x7f599c0b2720 2021-10-20T23:29:27.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.043+0000 7f59997fa700 1 -- 172.21.15.12:0/3917444518 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v444) v1 ==== 127+0+0 (secure 0 0 0) 0x7f598c045330 con 0x7f599c0b2720 2021-10-20T23:29:27.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5980053610 msgr2=0x7f5980055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:27.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5980053610 0x7f5980055ad0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f598400d000 tx=0x7f5984009040).stop 2021-10-20T23:29:27.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c0b2720 msgr2=0x7f599c13c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:27.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c0b2720 0x7f599c13c230 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f598c001110 tx=0x7f598c007a90).stop 2021-10-20T23:29:27.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 shutdown_connections 2021-10-20T23:29:27.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5980053610 0x7f5980055ad0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599c140260 0x7f599c13c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c0b2720 0x7f599c13c230 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 --2- 172.21.15.12:0/3917444518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f599c0b0ff0 0x7f599c1431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 >> 172.21.15.12:0/3917444518 conn(0x7f599c060180 msgr2=0x7f599c13d690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:27.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 shutdown_connections 2021-10-20T23:29:27.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.047+0000 7f59a0e9c700 1 -- 172.21.15.12:0/3917444518 wait complete. 2021-10-20T23:29:27.073 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-20T23:29:27.073 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-20T23:29:27.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2021-10-20T23:29:27.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 Processor -- start 2021-10-20T23:29:27.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 -- start start 2021-10-20T23:29:27.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc180b04a0 0x7fdc180add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:27.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180aa120 0x7fdc180ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:27.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc180b2af0 con 0x7fdc180b0880 2021-10-20T23:29:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180b2770 con 0x7fdc180b04a0 2021-10-20T23:29:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180b2d20 con 0x7fdc180aa120 2021-10-20T23:29:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc16ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180aa120 0x7fdc180ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc16ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180aa120 0x7fdc180ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51400/0 (socket says 172.21.15.12:51400) 2021-10-20T23:29:27.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc16ffd700 1 -- 172.21.15.12:0/147957566 learned_addr learned my addr 172.21.15.12:0/147957566 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:27.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc177fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc180b04a0 0x7fdc180add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:27.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc16ffd700 1 -- 172.21.15.12:0/147957566 >> v2:172.21.15.31:3300/0 conn(0x7fdc180b04a0 msgr2=0x7fdc180add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:27.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc16ffd700 1 --2- 172.21.15.12:0/147957566 >> v2:172.21.15.31:3300/0 conn(0x7fdc180b04a0 0x7fdc180add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:27.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc16ffd700 1 -- 172.21.15.12:0/147957566 >> v1:172.21.15.31:6789/0 conn(0x7fdc180b0880 legacy=0x7fdc18143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:27.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc16ffd700 1 -- 172.21.15.12:0/147957566 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180a9b70 con 0x7fdc180aa120 2021-10-20T23:29:27.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc16ffd700 1 --2- 172.21.15.12:0/147957566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180aa120 0x7fdc180ae220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fdc100032f0 tx=0x7fdc1000b530).ready entity=mon.2 client_cookie=82273e90b45e5851 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:27.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc167fc700 1 -- 172.21.15.12:0/147957566 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc1000de20 con 0x7fdc180aa120 2021-10-20T23:29:27.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc167fc700 1 -- 172.21.15.12:0/147957566 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10010470 con 0x7fdc180aa120 2021-10-20T23:29:27.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc167fc700 1 -- 172.21.15.12:0/147957566 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc100107d0 con 0x7fdc180aa120 2021-10-20T23:29:27.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/147957566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180aa120 msgr2=0x7fdc180ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:27.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 --2- 172.21.15.12:0/147957566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180aa120 0x7fdc180ae220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fdc100032f0 tx=0x7fdc1000b530).stop 2021-10-20T23:29:27.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/147957566 shutdown_connections 2021-10-20T23:29:27.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 --2- 172.21.15.12:0/147957566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180aa120 0x7fdc180ae220 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:27.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 --2- 172.21.15.12:0/147957566 >> v2:172.21.15.31:3300/0 conn(0x7fdc180b04a0 0x7fdc180add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:27.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.171+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/147957566 >> 172.21.15.12:0/147957566 conn(0x7fdc180607c0 msgr2=0x7fdc18060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:27.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/147957566 shutdown_connections 2021-10-20T23:29:27.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/147957566 wait complete. 2021-10-20T23:29:27.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 Processor -- start 2021-10-20T23:29:27.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 -- start start 2021-10-20T23:29:27.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180aa120 0x7fdc18144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:27.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180b04a0 0x7fdc18151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:27.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc180b0880 0x7fdc181523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:27.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc18151ae0 con 0x7fdc180b0880 2021-10-20T23:29:27.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180638d0 con 0x7fdc180aa120 2021-10-20T23:29:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc1dc5a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc18065270 con 0x7fdc180b04a0 2021-10-20T23:29:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc16ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180b04a0 0x7fdc18151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc17fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc180b0880 0x7fdc181523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc16ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180b04a0 0x7fdc18151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51406/0 (socket says 172.21.15.12:51406) 2021-10-20T23:29:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc16ffd700 1 -- 172.21.15.12:0/1230545870 learned_addr learned my addr 172.21.15.12:0/1230545870 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.175+0000 7fdc177fe700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180aa120 0x7fdc18144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc16ffd700 1 -- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180aa120 msgr2=0x7fdc18144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc16ffd700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180aa120 0x7fdc18144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc16ffd700 1 -- 172.21.15.12:0/1230545870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc180b0880 msgr2=0x7fdc181523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc16ffd700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc180b0880 0x7fdc181523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc16ffd700 1 -- 172.21.15.12:0/1230545870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1000b7d0 con 0x7fdc180b04a0 2021-10-20T23:29:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc16ffd700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180b04a0 0x7fdc18151ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fdc18064b10 tx=0x7fdc1000b530).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc14ff9700 1 -- 172.21.15.12:0/1230545870 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc100186e0 con 0x7fdc180b04a0 2021-10-20T23:29:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc14ff9700 1 -- 172.21.15.12:0/1230545870 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10018840 con 0x7fdc180b04a0 2021-10-20T23:29:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc18065510 con 0x7fdc180b04a0 2021-10-20T23:29:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc14ff9700 1 -- 172.21.15.12:0/1230545870 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc10018ba0 con 0x7fdc180b04a0 2021-10-20T23:29:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc180a09c0 con 0x7fdc180b04a0 2021-10-20T23:29:27.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc18057350 con 0x7fdc180b04a0 2021-10-20T23:29:27.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc14ff9700 1 -- 172.21.15.12:0/1230545870 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc10021020 con 0x7fdc180b04a0 2021-10-20T23:29:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc14ff9700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc053610 0x7fdbfc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc14ff9700 1 -- 172.21.15.12:0/1230545870 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fdc1006f8c0 con 0x7fdc180b04a0 2021-10-20T23:29:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.179+0000 7fdc177fe700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc053610 0x7fdbfc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.183+0000 7fdc177fe700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc053610 0x7fdbfc055ad0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fdc0000b000 tx=0x7fdc00006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:27.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.187+0000 7fdc14ff9700 1 -- 172.21.15.12:0/1230545870 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc10046b00 con 0x7fdc180b04a0 2021-10-20T23:29:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:27.359+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7fdc180b3730 con 0x7fdc180b04a0 2021-10-20T23:29:28.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.051+0000 7fdc14ff9700 1 -- 172.21.15.12:0/1230545870 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v445) v1 ==== 139+0+0 (secure 0 0 0) 0x7fdc1004a120 con 0x7fdc180b04a0 2021-10-20T23:29:28.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc053610 msgr2=0x7fdbfc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc053610 0x7fdbfc055ad0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fdc0000b000 tx=0x7fdc00006df0).stop 2021-10-20T23:29:28.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180b04a0 msgr2=0x7fdc18151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180b04a0 0x7fdc18151ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fdc18064b10 tx=0x7fdc1000b530).stop 2021-10-20T23:29:28.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 shutdown_connections 2021-10-20T23:29:28.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdbfc053610 0x7fdbfc055ad0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc180b0880 0x7fdc181523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc180b04a0 0x7fdc18151ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 --2- 172.21.15.12:0/1230545870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc180aa120 0x7fdc18144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 >> 172.21.15.12:0/1230545870 conn(0x7fdc180607c0 msgr2=0x7fdc180b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:28.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 shutdown_connections 2021-10-20T23:29:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.055+0000 7fdc1dc5a700 1 -- 172.21.15.12:0/1230545870 wait complete. 2021-10-20T23:29:28.082 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-20T23:29:28.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaf59e700 1 Processor -- start 2021-10-20T23:29:28.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaf59e700 1 -- start start 2021-10-20T23:29:28.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaf59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbdb013c6e0 0x7fbdb013cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.202 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaf59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbdb00acf20 0x7fbdb00ad340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaf59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb00b2c30 con 0x7fbdb00b2850 2021-10-20T23:29:28.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaf59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb00b11b0 con 0x7fbdb00acf20 2021-10-20T23:29:28.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaf59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb00b1660 con 0x7fbdb013c6e0 2021-10-20T23:29:28.203 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbdb00acf20 0x7fbdb00ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdae59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbdb00b2850 0x7fbdb00b0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44250/0 (socket says 172.21.15.12:44250) 2021-10-20T23:29:28.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdae59c700 1 -- 172.21.15.12:0/4119390247 learned_addr learned my addr 172.21.15.12:0/4119390247 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:28.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdadd9b700 1 --2- 172.21.15.12:0/4119390247 >> v2:172.21.15.31:3300/0 conn(0x7fbdb013c6e0 0x7fbdb013cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.204 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaed9d700 1 -- 172.21.15.12:0/4119390247 >> v2:172.21.15.31:3300/0 conn(0x7fbdb013c6e0 msgr2=0x7fbdb013cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaed9d700 1 --2- 172.21.15.12:0/4119390247 >> v2:172.21.15.31:3300/0 conn(0x7fbdb013c6e0 0x7fbdb013cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaed9d700 1 -- 172.21.15.12:0/4119390247 >> v1:172.21.15.12:6789/0 conn(0x7fbdb00b2850 legacy=0x7fbdb00b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaed9d700 1 -- 172.21.15.12:0/4119390247 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb00b1900 con 0x7fbdb00acf20 2021-10-20T23:29:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdaed9d700 1 --2- 172.21.15.12:0/4119390247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 0x7fbdb00ad340 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fbda8002f70 tx=0x7fbda8006df0).ready entity=mon.0 client_cookie=96bdfe9ecc3c2f5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdad59a700 1 -- 172.21.15.12:0/4119390247 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda800d570 con 0x7fbdb00acf20 2021-10-20T23:29:28.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdad59a700 1 -- 172.21.15.12:0/4119390247 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8000e90 con 0x7fbdb00acf20 2021-10-20T23:29:28.206 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.191+0000 7fbdad59a700 1 -- 172.21.15.12:0/4119390247 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda800d8c0 con 0x7fbdb00acf20 2021-10-20T23:29:28.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 -- 172.21.15.12:0/4119390247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 msgr2=0x7fbdb00ad340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 --2- 172.21.15.12:0/4119390247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 0x7fbdb00ad340 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fbda8002f70 tx=0x7fbda8006df0).stop 2021-10-20T23:29:28.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 -- 172.21.15.12:0/4119390247 shutdown_connections 2021-10-20T23:29:28.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 --2- 172.21.15.12:0/4119390247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 0x7fbdb00ad340 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 --2- 172.21.15.12:0/4119390247 >> v2:172.21.15.31:3300/0 conn(0x7fbdb013c6e0 0x7fbdb013cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 -- 172.21.15.12:0/4119390247 >> 172.21.15.12:0/4119390247 conn(0x7fbdb0061230 msgr2=0x7fbdb0062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:28.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 -- 172.21.15.12:0/4119390247 shutdown_connections 2021-10-20T23:29:28.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 -- 172.21.15.12:0/4119390247 wait complete. 2021-10-20T23:29:28.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 Processor -- start 2021-10-20T23:29:28.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 -- start start 2021-10-20T23:29:28.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 0x7fbdb0142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdb00b2850 0x7fbdb0063f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdb013c6e0 0x7fbdb0064410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0065a60 con 0x7fbdb00acf20 2021-10-20T23:29:28.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0067d70 con 0x7fbdb013c6e0 2021-10-20T23:29:28.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaf59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb00670f0 con 0x7fbdb00b2850 2021-10-20T23:29:28.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 0x7fbdb0142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 0x7fbdb0142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45662/0 (socket says 172.21.15.12:45662) 2021-10-20T23:29:28.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdae59c700 1 -- 172.21.15.12:0/591544326 learned_addr learned my addr 172.21.15.12:0/591544326 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:28.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdaed9d700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdb013c6e0 0x7fbdb0064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdadd9b700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdb00b2850 0x7fbdb0063f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdae59c700 1 -- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdb00b2850 msgr2=0x7fbdb0063f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdae59c700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdb00b2850 0x7fbdb0063f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdae59c700 1 -- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdb013c6e0 msgr2=0x7fbdb0064410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdae59c700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdb013c6e0 0x7fbdb0064410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.195+0000 7fbdae59c700 1 -- 172.21.15.12:0/591544326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda800b180 con 0x7fbdb00acf20 2021-10-20T23:29:28.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbdae59c700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 0x7fbdb0142f40 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fbdb0062090 tx=0x7fbda4007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:28.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbd9f7fe700 1 -- 172.21.15.12:0/591544326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda40070d0 con 0x7fbdb00acf20 2021-10-20T23:29:28.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbd9f7fe700 1 -- 172.21.15.12:0/591544326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4007230 con 0x7fbdb00acf20 2021-10-20T23:29:28.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb0067390 con 0x7fbdb00acf20 2021-10-20T23:29:28.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbd9f7fe700 1 -- 172.21.15.12:0/591544326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda40055d0 con 0x7fbdb00acf20 2021-10-20T23:29:28.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb0141cb0 con 0x7fbdb00acf20 2021-10-20T23:29:28.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb0066d60 con 0x7fbdb00acf20 2021-10-20T23:29:28.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbd9f7fe700 1 -- 172.21.15.12:0/591544326 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbda4010070 con 0x7fbdb00acf20 2021-10-20T23:29:28.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbd9f7fe700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd8c053520 0x7fbd8c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbd9f7fe700 1 -- 172.21.15.12:0/591544326 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fbda406ad60 con 0x7fbdb00acf20 2021-10-20T23:29:28.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.199+0000 7fbdadd9b700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd8c053520 0x7fbd8c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.203+0000 7fbdadd9b700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd8c053520 0x7fbd8c0559e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fbda000b000 tx=0x7fbda00091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:28.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.207+0000 7fbd9f7fe700 1 -- 172.21.15.12:0/591544326 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbda4041f30 con 0x7fbdb00acf20 2021-10-20T23:29:28.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.335+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbdb0064aa0 con 0x7fbdb00acf20 2021-10-20T23:29:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.343+0000 7fbd9f7fe700 1 -- 172.21.15.12:0/591544326 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbdb0064aa0 con 0x7fbdb00acf20 2021-10-20T23:29:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd8c053520 msgr2=0x7fbd8c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd8c053520 0x7fbd8c0559e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fbda000b000 tx=0x7fbda00091d0).stop 2021-10-20T23:29:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 msgr2=0x7fbdb0142f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 0x7fbdb0142f40 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fbdb0062090 tx=0x7fbda4007c30).stop 2021-10-20T23:29:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 shutdown_connections 2021-10-20T23:29:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbd8c053520 0x7fbd8c0559e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdb013c6e0 0x7fbdb0064410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdb00b2850 0x7fbdb0063f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 --2- 172.21.15.12:0/591544326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb00acf20 0x7fbdb0142f40 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 >> 172.21.15.12:0/591544326 conn(0x7fbdb0061230 msgr2=0x7fbdb0139900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 shutdown_connections 2021-10-20T23:29:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.347+0000 7fbdaf59e700 1 -- 172.21.15.12:0/591544326 wait complete. 2021-10-20T23:29:28.371 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:29:28.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:28.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:28.411 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:28.434 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:29:28.457 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:29:28.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:28.458 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:28.458 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:28.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:29:28.488 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-20T23:29:28.489 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-20T23:29:28.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:28.491 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:28.491 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:28.505 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-20T23:29:28.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:29:28.507 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-20T23:29:28.508 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:29:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.607+0000 7fb9c0922700 1 Processor -- start 2021-10-20T23:29:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.607+0000 7fb9c0922700 1 -- start start 2021-10-20T23:29:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9bc0b02e0 0x7fb9bc14b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9bc0add80 con 0x7fb9bc0b2580 2021-10-20T23:29:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9bc0ae020 con 0x7fb9bc0b1260 2021-10-20T23:29:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9bc0a9390 con 0x7fb9bc0b02e0 2021-10-20T23:29:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9bad9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb9bc0b2580 0x7fb9bc0abb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44266/0 (socket says 172.21.15.12:44266) 2021-10-20T23:29:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9bad9d700 1 -- 172.21.15.12:0/2485101152 learned_addr learned my addr 172.21.15.12:0/2485101152 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9bb59e700 1 --2- 172.21.15.12:0/2485101152 >> v2:172.21.15.12:3300/0 conn(0x7fb9bc0b02e0 0x7fb9bc14b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9ba59c700 1 -- 172.21.15.12:0/2485101152 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556880400 0 0) 0x7fb9bc0add80 con 0x7fb9bc0b2580 2021-10-20T23:29:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9ba59c700 1 -- 172.21.15.12:0/2485101152 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb99c003260 con 0x7fb9bc0b2580 2021-10-20T23:29:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9bb59e700 1 -- 172.21.15.12:0/2485101152 >> v1:172.21.15.31:6789/0 conn(0x7fb9bc0b1260 legacy=0x7fb9bc0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9ba59c700 1 -- 172.21.15.12:0/2485101152 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244852064 0 0) 0x7fb9bc0ae020 con 0x7fb9bc0b1260 2021-10-20T23:29:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9bb59e700 1 -- 172.21.15.12:0/2485101152 >> v1:172.21.15.12:6789/0 conn(0x7fb9bc0b2580 legacy=0x7fb9bc0abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9bb59e700 1 -- 172.21.15.12:0/2485101152 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc0a9830 con 0x7fb9bc0b02e0 2021-10-20T23:29:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9bb59e700 1 --2- 172.21.15.12:0/2485101152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b02e0 0x7fb9bc14b4b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fb9b40032f0 tx=0x7fb9b40091d0).ready entity=mon.0 client_cookie=87a5a093770e3bd2 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:28.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9ba59c700 1 -- 172.21.15.12:0/2485101152 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b400b6c0 con 0x7fb9bc0b02e0 2021-10-20T23:29:28.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9ba59c700 1 -- 172.21.15.12:0/2485101152 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b400b820 con 0x7fb9bc0b02e0 2021-10-20T23:29:28.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9ba59c700 1 -- 172.21.15.12:0/2485101152 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b400b990 con 0x7fb9bc0b02e0 2021-10-20T23:29:28.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 -- 172.21.15.12:0/2485101152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b02e0 msgr2=0x7fb9bc14b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 --2- 172.21.15.12:0/2485101152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b02e0 0x7fb9bc14b4b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fb9b40032f0 tx=0x7fb9b40091d0).stop 2021-10-20T23:29:28.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 -- 172.21.15.12:0/2485101152 shutdown_connections 2021-10-20T23:29:28.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 --2- 172.21.15.12:0/2485101152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b02e0 0x7fb9bc14b4b0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 -- 172.21.15.12:0/2485101152 >> 172.21.15.12:0/2485101152 conn(0x7fb9bc060180 msgr2=0x7fb9bc0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 -- 172.21.15.12:0/2485101152 shutdown_connections 2021-10-20T23:29:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.611+0000 7fb9c0922700 1 -- 172.21.15.12:0/2485101152 wait complete. 2021-10-20T23:29:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 Processor -- start 2021-10-20T23:29:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 -- start start 2021-10-20T23:29:28.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9bc0b02e0 0x7fb9bc09e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9bc0b1260 0x7fb9bc144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b2580 0x7fb9bc150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc09f5c0 con 0x7fb9bc0b2580 2021-10-20T23:29:28.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc150080 con 0x7fb9bc0b1260 2021-10-20T23:29:28.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc150320 con 0x7fb9bc0b02e0 2021-10-20T23:29:28.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b2580 0x7fb9bc150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b2580 0x7fb9bc150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45680/0 (socket says 172.21.15.12:45680) 2021-10-20T23:29:28.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bb59e700 1 -- 172.21.15.12:0/2671976058 learned_addr learned my addr 172.21.15.12:0/2671976058 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:28.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bad9d700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9bc0b02e0 0x7fb9bc09e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9b3fff700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9bc0b1260 0x7fb9bc144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bb59e700 1 -- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9bc0b02e0 msgr2=0x7fb9bc09e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bb59e700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9bc0b02e0 0x7fb9bc09e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bb59e700 1 -- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9bc0b1260 msgr2=0x7fb9bc144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bb59e700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9bc0b1260 0x7fb9bc144fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bb59e700 1 -- 172.21.15.12:0/2671976058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4009470 con 0x7fb9bc0b2580 2021-10-20T23:29:28.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9bb59e700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b2580 0x7fb9bc150a60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fb9b40032f0 tx=0x7fb9b4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:28.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9b8d99700 1 -- 172.21.15.12:0/2671976058 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b400b6c0 con 0x7fb9bc0b2580 2021-10-20T23:29:28.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9b8d99700 1 -- 172.21.15.12:0/2671976058 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b4021630 con 0x7fb9bc0b2580 2021-10-20T23:29:28.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc1505c0 con 0x7fb9bc0b2580 2021-10-20T23:29:28.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9b8d99700 1 -- 172.21.15.12:0/2671976058 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b400bee0 con 0x7fb9bc0b2580 2021-10-20T23:29:28.639 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.615+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9bc0a2c70 con 0x7fb9bc0b2580 2021-10-20T23:29:28.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.619+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9bc09f780 con 0x7fb9bc0b2580 2021-10-20T23:29:28.640 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.619+0000 7fb9b8d99700 1 -- 172.21.15.12:0/2671976058 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb9b400f070 con 0x7fb9bc0b2580 2021-10-20T23:29:28.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.619+0000 7fb9b8d99700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb9a00534f0 0x7fb9a00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:28.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.619+0000 7fb9b8d99700 1 -- 172.21.15.12:0/2671976058 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb9b406c860 con 0x7fb9bc0b2580 2021-10-20T23:29:28.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.619+0000 7fb9bad9d700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb9a00534f0 0x7fb9a00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:28.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.619+0000 7fb9bad9d700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb9a00534f0 0x7fb9a00559b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fb9ac00d000 tx=0x7fb9ac009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:28.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.627+0000 7fb9b8d99700 1 -- 172.21.15.12:0/2671976058 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb9b4043b40 con 0x7fb9bc0b2580 2021-10-20T23:29:28.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.751+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb9bc150750 con 0x7fb9bc0b2580 2021-10-20T23:29:28.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.751+0000 7fb9b8d99700 1 -- 172.21.15.12:0/2671976058 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v155) v1 ==== 81+0+29229 (secure 0 0 0) 0x7fb9b4015070 con 0x7fb9bc0b2580 2021-10-20T23:29:28.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:28.763 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:29:28.764 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 155, 2021-10-20T23:29:28.764 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:29:28.764 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:29:28.764 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:29:26.022485+0000", 2021-10-20T23:29:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:29:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:29:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:29:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:29:28.765 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:29:28.766 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:29:28.766 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:29:28.766 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:29:28.766 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:29:28.767 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:28.767 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:29:28.767 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:29:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:29:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:29:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:29:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 28, 2021-10-20T23:29:28.768 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:29:28.769 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:29:28.769 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:29:28.770 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:29:28.770 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:29:28.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.770 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:29:28.771 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:29:28.771 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:29:28.771 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:28.772 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:28.772 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:28.772 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:28.772 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:28.773 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:28.773 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:28.773 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:28.773 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:29:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:29:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:29:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:29:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:29:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:28.775 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:28.775 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:28.776 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:28.777 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:28.777 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:28.778 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:28.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.778 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:29:28.779 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:28.779 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:28.779 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:28.780 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:28.780 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:28.780 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:28.782 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:28.782 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:28.782 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:28.783 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:28.783 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:28.783 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:28.783 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:28.784 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:28.785 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:28.785 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:28.785 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:28.786 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:28.786 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:28.787 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:28.787 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:28.787 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:28.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.788 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:28.788 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:28.789 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:28.790 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:28.790 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:28.791 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:28.791 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:28.792 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:28.792 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:28.792 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:28.792 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:28.793 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:29:28.793 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:29:28.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.794 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:28.794 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:29:28.794 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:29:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:29:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:29:28.795 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:28.796 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:28.796 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:28.796 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:28.796 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:29:28.797 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:29:28.798 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:29:28.798 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:29:28.798 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:29:28.798 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:28.800 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:28.800 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:28.800 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:28.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.801 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:29:28.801 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:28.802 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:28.802 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:28.802 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:28.803 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:28.804 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:28.804 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:28.804 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:28.805 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:28.805 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:28.805 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:28.805 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:28.805 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:28.806 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:28.806 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:28.806 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:28.806 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:28.807 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:28.808 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:28.808 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:28.808 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:28.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:28.809 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:28.810 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:28.810 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:28.810 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:28.810 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:29:28.811 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:28.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:29:28.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.812 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:28.813 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:29:28.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.813 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:29:28.813 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:29:28.813 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:28.814 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:28.814 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:28.814 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:28.815 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:28.816 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:28.816 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:28.816 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.817 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:29:28.817 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:28.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:29:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:28.818 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.819 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.819 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:28.819 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:29:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:29:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:28.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.822 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.822 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:28.822 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.823 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.823 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:29:28.823 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:28.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.824 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:29:28.824 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:28.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.825 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.826 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:28.826 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.826 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.827 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:29:28.827 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:28.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.828 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:29:28.828 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:28.828 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.829 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.829 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:29:28.829 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:29:28.829 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:29:28.830 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:29:28.830 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:28.830 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:28.830 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:28.830 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.831 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:29:28.832 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:29:28.832 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:28.832 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:28.832 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:28.833 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:28.833 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:28.833 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:28.833 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:28.834 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:28.834 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:28.834 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:28.834 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:28.834 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.835 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:29:28.836 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:28.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.837 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:29:28.837 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:28.837 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.837 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.838 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:28.838 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.839 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:29:28.839 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:28.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.840 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.840 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:29:28.840 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:28.840 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.840 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.841 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:28.841 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.842 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:29:28.842 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:28.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.843 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:29:28.843 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:28.844 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.844 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.844 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:28.844 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:29:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:29:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.848 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.849 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:29:28.849 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:29:28.849 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:29:28.850 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:29:28.850 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:28.851 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:28.852 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:28.852 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.853 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:29:28.854 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:29:28.854 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:28.855 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:28.855 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:28.856 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:28.856 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:28.856 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:28.857 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:28.857 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:28.857 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:28.858 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:28.858 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:28.859 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.859 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.860 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:29:28.860 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:28.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.861 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:29:28.861 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:28.862 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.862 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.863 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:28.863 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.864 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:29:28.865 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:28.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.865 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.866 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:29:28.867 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:28.867 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.867 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.868 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:28.869 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.870 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:29:28.870 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:28.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.871 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:29:28.871 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:28.871 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.872 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.872 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:28.872 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.873 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:29:28.873 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:28.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.874 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:29:28.874 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:28.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.875 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.875 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:29:28.875 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:29:28.876 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:29:28.876 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:29:28.876 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:28.876 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:28.877 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:28.877 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.877 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:29:28.878 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:29:28.878 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:28.878 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:28.878 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:28.878 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:28.879 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:28.879 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:28.879 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:28.879 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 139, 2021-10-20T23:29:28.880 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:28.880 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:28.880 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:28.880 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.881 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:29:28.881 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:28.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.882 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:29:28.882 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:28.882 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.883 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.883 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:28.883 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.884 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:29:28.884 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:28.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.885 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:29:28.885 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:28.885 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.886 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.886 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:28.886 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.887 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:29:28.887 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:28.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.888 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:29:28.888 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:28.889 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.889 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.889 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:28.890 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.890 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:29:28.890 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:28.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.891 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:29:28.892 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:28.892 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.892 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.892 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:29:28.893 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:29:28.893 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:29:28.893 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:29:28.893 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:28.894 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:28.894 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:28.894 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.895 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:29:28.895 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:29:28.895 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:28.895 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:28.896 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:28.896 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:28.896 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:28.896 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:28.896 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:28.897 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 148, 2021-10-20T23:29:28.897 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:28.897 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:28.897 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:28.897 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.898 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.898 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:29:28.898 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:28.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.899 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:29:28.899 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:28.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.900 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.900 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:28.901 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.901 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:29:28.902 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:28.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.903 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:29:28.903 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:28.903 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.903 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.904 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:28.904 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.905 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:29:28.905 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:28.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.906 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:29:28.906 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:28.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.906 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.907 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:28.907 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.908 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:29:28.908 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:28.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.909 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.909 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:29:28.909 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:28.909 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.909 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.910 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:29:28.910 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:29:28.910 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:29:28.910 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:29:28.911 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:28.911 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:28.911 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:28.911 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.912 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:29:28.912 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:29:28.912 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:28.913 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:28.913 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:28.913 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:28.913 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:28.913 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:28.914 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:28.914 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:28.914 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:28.914 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:28.915 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:28.915 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.916 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:29:28.916 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:28.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.917 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:29:28.917 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:28.917 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.917 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.918 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:28.918 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.919 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:29:28.919 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:28.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.920 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:29:28.920 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:28.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.920 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.921 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:28.921 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.922 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:29:28.922 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:28.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.923 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:29:28.923 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:28.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.924 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.924 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:28.924 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.925 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:29:28.925 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:28.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.926 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:29:28.926 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:28.926 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.927 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.927 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:29:28.927 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:29:28.927 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:29:28.928 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:29:28.928 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:28.928 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:28.928 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:28.929 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.929 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:29:28.929 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:29:28.930 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:28.930 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:28.930 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:28.930 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:28.931 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:28.931 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:28.931 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:28.932 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:28.932 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:28.932 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:28.932 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:28.932 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:29:28.933 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:28.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:29:28.934 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:28.935 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.935 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.935 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:28.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:29:28.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:28.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.937 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:29:28.937 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:28.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.938 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.938 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:28.939 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.939 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:29:28.939 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:28.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.940 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:29:28.940 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:28.941 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.941 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.941 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:28.942 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.942 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:29:28.942 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:28.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.943 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:29:28.944 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:28.944 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.944 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.944 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:29:28.945 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:29:28.945 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:29:28.945 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:29:28.945 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:28.946 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:28.946 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:28.946 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.947 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:29:28.947 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:29:28.947 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:28.947 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:28.948 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:28.948 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:28.948 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:28.948 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:28.948 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:28.949 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 149, 2021-10-20T23:29:28.949 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:28.949 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:28.949 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:28.950 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.950 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:29:28.950 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:28.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.952 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:29:28.952 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:28.952 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.952 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.953 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:28.953 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.954 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:29:28.954 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:28.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.955 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:29:28.955 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:28.955 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.955 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.956 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:28.956 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.957 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:29:28.957 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:28.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.958 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:29:28.958 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:28.958 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.958 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.959 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:28.959 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:28.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:28.960 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:29:28.960 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:28.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:28.961 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:29:28.961 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:28.961 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.961 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.962 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:29:28.962 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:29:28.962 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:29:28.963 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:29:28.963 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:28.963 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:28.963 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:28.963 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:28.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.964 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:28.964 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:29:28.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.965 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:29:28.965 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:28.965 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:28.965 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:28.965 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:28.966 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:28.966 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:29:28.966 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:28.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.967 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:29:28.967 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:28.967 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:28.967 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:28.968 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:28.968 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:28.968 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:29:28.968 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:28.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.969 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:29:28.969 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:28.969 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:28.970 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:28.970 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:28.970 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:28.970 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:29:28.970 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:28.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.971 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:29:28.971 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:28.972 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:28.972 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:28.972 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:28.972 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:28.972 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:29:28.973 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:28.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.973 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:29:28.973 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:28.974 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:28.974 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:28.974 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:28.974 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:28.975 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:29:28.975 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:28.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.975 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:29:28.976 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:28.976 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:28.976 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:28.976 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:28.976 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:28.977 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:29:28.977 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:28.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.978 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:29:28.978 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:28.978 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:28.979 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:28.979 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:28.980 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:28.980 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:29:28.980 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:28.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:28.981 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:29:28.981 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:28.981 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:28.982 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:28.982 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:28.982 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:28.982 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:29:28.983 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:28.983 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.983 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:28.983 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:29:28.984 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:29:28.984 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:29:28.984 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:29:28.984 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": { 2021-10-20T23:29:28.985 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6835/1414597279": "2021-10-21T23:29:22.977606+0000", 2021-10-20T23:29:28.985 INFO:teuthology.orchestra.run.smithi012.stdout: "172.21.15.12:6834/1414597279": "2021-10-21T23:29:22.977606+0000" 2021-10-20T23:29:28.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.986 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:29:28.986 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:29:28.986 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:29:28.986 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:29:28.987 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:29:28.987 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:29:28.987 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:29:28.987 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:29:28.988 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:29:28.988 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:29:28.988 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:29:28.988 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:29:28.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.989 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:29:28.989 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:29:28.990 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:29:28.990 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:29:28.990 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:29:28.990 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:29:28.991 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:29:28.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:28.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:28.991 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:29:28.991 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:29:28.992 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:29:28.992 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:29:28.992 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:29:28.992 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:29:28.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb9a00534f0 msgr2=0x7fb9a00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb9a00534f0 0x7fb9a00559b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fb9ac00d000 tx=0x7fb9ac009040).stop 2021-10-20T23:29:28.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b2580 msgr2=0x7fb9bc150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:28.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b2580 0x7fb9bc150a60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fb9b40032f0 tx=0x7fb9b4016000).stop 2021-10-20T23:29:28.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 shutdown_connections 2021-10-20T23:29:28.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb9a00534f0 0x7fb9a00559b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc0b2580 0x7fb9bc150a60 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9bc0b1260 0x7fb9bc144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 --2- 172.21.15.12:0/2671976058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9bc0b02e0 0x7fb9bc09e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:28.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 >> 172.21.15.12:0/2671976058 conn(0x7fb9bc060180 msgr2=0x7fb9bc067250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:28.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 shutdown_connections 2021-10-20T23:29:28.997 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:28.755+0000 7fb9c0922700 1 -- 172.21.15.12:0/2671976058 wait complete. 2021-10-20T23:29:28.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:29.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86db59e700 1 Processor -- start 2021-10-20T23:29:29.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86db59e700 1 -- start start 2021-10-20T23:29:29.118 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86db59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f86dc0b7370 0x7f86dc0b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86db59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86dc0aac20 0x7f86dc064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.119 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86db59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc0b2380 con 0x7f86dc0b3060 2021-10-20T23:29:29.120 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86db59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc144250 con 0x7f86dc0b7370 2021-10-20T23:29:29.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86db59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc0b3570 con 0x7f86dc0aac20 2021-10-20T23:29:29.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86da59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f86dc0b7370 0x7f86dc0b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.121 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86da59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f86dc0b7370 0x7f86dc0b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45684/0 (socket says 172.21.15.12:45684) 2021-10-20T23:29:29.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86da59c700 1 -- 172.21.15.12:0/319385388 learned_addr learned my addr 172.21.15.12:0/319385388 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:29.122 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.103+0000 7f86dad9d700 1 --2- 172.21.15.12:0/319385388 >> v2:172.21.15.31:3300/0 conn(0x7f86dc0aac20 0x7f86dc064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86da59c700 1 -- 172.21.15.12:0/319385388 >> v2:172.21.15.31:3300/0 conn(0x7f86dc0aac20 msgr2=0x7f86dc064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:29.123 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86da59c700 1 --2- 172.21.15.12:0/319385388 >> v2:172.21.15.31:3300/0 conn(0x7f86dc0aac20 0x7f86dc064ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86da59c700 1 -- 172.21.15.12:0/319385388 >> v1:172.21.15.31:6789/0 conn(0x7f86dc0b3060 legacy=0x7f86dc13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86da59c700 1 -- 172.21.15.12:0/319385388 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0b25b0 con 0x7f86dc0b7370 2021-10-20T23:29:29.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86da59c700 1 --2- 172.21.15.12:0/319385388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0b7370 0x7f86dc0b7750 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f86cc002f70 tx=0x7f86cc006e50).ready entity=mon.0 client_cookie=4c192654dde3e83a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:29.126 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86d959a700 1 -- 172.21.15.12:0/319385388 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86cc00d610 con 0x7f86dc0b7370 2021-10-20T23:29:29.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86d959a700 1 -- 172.21.15.12:0/319385388 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc000e90 con 0x7f86dc0b7370 2021-10-20T23:29:29.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86d959a700 1 -- 172.21.15.12:0/319385388 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86cc00d9a0 con 0x7f86dc0b7370 2021-10-20T23:29:29.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86db59e700 1 -- 172.21.15.12:0/319385388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0b7370 msgr2=0x7f86dc0b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86db59e700 1 --2- 172.21.15.12:0/319385388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0b7370 0x7f86dc0b7750 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f86cc002f70 tx=0x7f86cc006e50).stop 2021-10-20T23:29:29.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86db59e700 1 -- 172.21.15.12:0/319385388 shutdown_connections 2021-10-20T23:29:29.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86db59e700 1 --2- 172.21.15.12:0/319385388 >> v2:172.21.15.31:3300/0 conn(0x7f86dc0aac20 0x7f86dc064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86db59e700 1 --2- 172.21.15.12:0/319385388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0b7370 0x7f86dc0b7750 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86db59e700 1 -- 172.21.15.12:0/319385388 >> 172.21.15.12:0/319385388 conn(0x7f86dc05f6b0 msgr2=0x7f86dc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:29.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86db59e700 1 -- 172.21.15.12:0/319385388 shutdown_connections 2021-10-20T23:29:29.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.107+0000 7f86db59e700 1 -- 172.21.15.12:0/319385388 wait complete. 2021-10-20T23:29:29.136 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86db59e700 1 Processor -- start 2021-10-20T23:29:29.138 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86db59e700 1 -- start start 2021-10-20T23:29:29.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86db59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0aac20 0x7f86dc140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86db59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86dc0b3060 0x7f86dc0ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86db59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86dc0b7370 0x7f86dc0aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.139 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86db59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc151170 con 0x7f86dc0aac20 2021-10-20T23:29:29.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86db59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0acf50 con 0x7f86dc0b3060 2021-10-20T23:29:29.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86db59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0ab3d0 con 0x7f86dc0b7370 2021-10-20T23:29:29.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86da59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0aac20 0x7f86dc140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86da59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0aac20 0x7f86dc140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45690/0 (socket says 172.21.15.12:45690) 2021-10-20T23:29:29.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86da59c700 1 -- 172.21.15.12:0/2536729050 learned_addr learned my addr 172.21.15.12:0/2536729050 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:29.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86d9d9b700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86dc0b3060 0x7f86dc0ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86dad9d700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86dc0b7370 0x7f86dc0aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86da59c700 1 -- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86dc0b7370 msgr2=0x7f86dc0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86da59c700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86dc0b7370 0x7f86dc0aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86da59c700 1 -- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86dc0b3060 msgr2=0x7f86dc0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86da59c700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86dc0b3060 0x7f86dc0ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.111+0000 7f86da59c700 1 -- 172.21.15.12:0/2536729050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc00b1e0 con 0x7f86dc0aac20 2021-10-20T23:29:29.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.115+0000 7f86da59c700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0aac20 0x7f86dc140300 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f86dc143250 tx=0x7f86cc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:29.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.115+0000 7f86cb7fe700 1 -- 172.21.15.12:0/2536729050 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86cc013da0 con 0x7f86dc0aac20 2021-10-20T23:29:29.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.115+0000 7f86cb7fe700 1 -- 172.21.15.12:0/2536729050 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc00d290 con 0x7f86dc0aac20 2021-10-20T23:29:29.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.115+0000 7f86cb7fe700 1 -- 172.21.15.12:0/2536729050 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86cc01e5f0 con 0x7f86dc0aac20 2021-10-20T23:29:29.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.115+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc0af300 con 0x7f86dc0aac20 2021-10-20T23:29:29.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.115+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc0ab8a0 con 0x7f86dc0aac20 2021-10-20T23:29:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.115+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc0aba60 con 0x7f86dc0aac20 2021-10-20T23:29:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.115+0000 7f86cb7fe700 1 -- 172.21.15.12:0/2536729050 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f86cc025030 con 0x7f86dc0aac20 2021-10-20T23:29:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.115+0000 7f86cb7fe700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f86b8053580 0x7f86b8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.119+0000 7f86cb7fe700 1 -- 172.21.15.12:0/2536729050 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f86cc06c990 con 0x7f86dc0aac20 2021-10-20T23:29:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.119+0000 7f86d9d9b700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f86b8053580 0x7f86b8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.119+0000 7f86d9d9b700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f86b8053580 0x7f86b8055a40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f86d000d000 tx=0x7f86d0007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.123+0000 7f86cb7fe700 1 -- 172.21.15.12:0/2536729050 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f86cc043c70 con 0x7f86dc0aac20 2021-10-20T23:29:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.287+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86dc057350 con 0x7f86dc0aac20 2021-10-20T23:29:29.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.287+0000 7f86cb7fe700 1 -- 172.21.15.12:0/2536729050 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f86cc023070 con 0x7f86dc0aac20 2021-10-20T23:29:29.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:29.299 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/4126550791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4126550791},{"type":"v1","addr":"172.21.15.31:6835","nonce":4126550791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/815086520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":815086520},{"type":"v1","addr":"172.21.15.12:6833","nonce":815086520}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3850761072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3850761072},{"type":"v1","addr":"172.21.15.12:6835","nonce":3850761072}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":81}],"filesystems":[]} 2021-10-20T23:29:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f86b8053580 msgr2=0x7f86b8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f86b8053580 0x7f86b8055a40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f86d000d000 tx=0x7f86d0007b90).stop 2021-10-20T23:29:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0aac20 msgr2=0x7f86dc140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0aac20 0x7f86dc140300 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f86dc143250 tx=0x7f86cc014000).stop 2021-10-20T23:29:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 shutdown_connections 2021-10-20T23:29:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f86b8053580 0x7f86b8055a40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86dc0b7370 0x7f86dc0aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86dc0b3060 0x7f86dc0ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 --2- 172.21.15.12:0/2536729050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86dc0aac20 0x7f86dc140300 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 >> 172.21.15.12:0/2536729050 conn(0x7f86dc05f6b0 msgr2=0x7f86dc0b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 shutdown_connections 2021-10-20T23:29:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.291+0000 7f86db59e700 1 -- 172.21.15.12:0/2536729050 wait complete. 2021-10-20T23:29:29.304 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 81 2021-10-20T23:29:29.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.403+0000 7ffb5fd53700 1 Processor -- start 2021-10-20T23:29:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.403+0000 7ffb5fd53700 1 -- start start 2021-10-20T23:29:29.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb580b0fd0 0x7ffb58144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb580b0350 con 0x7ffb580b1db0 2021-10-20T23:29:29.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb580b05f0 con 0x7ffb581483a0 2021-10-20T23:29:29.418 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580a90c0 con 0x7ffb580b0fd0 2021-10-20T23:29:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5daef700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffb580b1db0 0x7ffb580b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44292/0 (socket says 172.21.15.12:44292) 2021-10-20T23:29:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5daef700 1 -- 172.21.15.12:0/1155333080 learned_addr learned my addr 172.21.15.12:0/1155333080 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5e2f0700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb580b0fd0 0x7ffb58144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537812362 0 0) 0x7ffb580b0350 con 0x7ffb580b1db0 2021-10-20T23:29:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb40003260 con 0x7ffb580b1db0 2021-10-20T23:29:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459542710 0 0) 0x7ffb580b05f0 con 0x7ffb581483a0 2021-10-20T23:29:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb580b0350 con 0x7ffb581483a0 2021-10-20T23:29:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2746064958 0 0) 0x7ffb40003260 con 0x7ffb580b1db0 2021-10-20T23:29:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb580b0fd0 msgr2=0x7ffb58144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb580b0fd0 0x7ffb58144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 >> v1:172.21.15.31:6789/0 conn(0x7ffb581483a0 legacy=0x7ffb580a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb580b0890 con 0x7ffb580b1db0 2021-10-20T23:29:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7ffb500019e0 con 0x7ffb580b1db0 2021-10-20T23:29:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 >> v1:172.21.15.12:6789/0 conn(0x7ffb580b1db0 legacy=0x7ffb580b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb40003910 0x7ffb40003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb580b0fd0 0x7ffb40004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb400049f0 0x7ffb40004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4000b750 con 0x7ffb400049f0 2021-10-20T23:29:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4000b8c0 con 0x7ffb40003910 2021-10-20T23:29:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4000ba80 con 0x7ffb580b0fd0 2021-10-20T23:29:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5daef700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb40003910 0x7ffb40003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5d2ee700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb580b0fd0 0x7ffb40004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5e2f0700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb400049f0 0x7ffb40004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5e2f0700 1 -- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb580b0fd0 msgr2=0x7ffb40004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5e2f0700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb580b0fd0 0x7ffb40004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5e2f0700 1 -- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb40003910 msgr2=0x7ffb40003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5e2f0700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb40003910 0x7ffb40003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5e2f0700 1 -- 172.21.15.12:0/1155333080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb40003260 con 0x7ffb400049f0 2021-10-20T23:29:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5daef700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb40003910 0x7ffb40003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5e2f0700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb400049f0 0x7ffb40004e70 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7ffb5400c000 tx=0x7ffb54006df0).ready entity=mon.0 client_cookie=ff8ba0ac51988fa0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5400e830 con 0x7ffb400049f0 2021-10-20T23:29:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5400e990 con 0x7ffb400049f0 2021-10-20T23:29:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5caed700 1 -- 172.21.15.12:0/1155333080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5400ecf0 con 0x7ffb400049f0 2021-10-20T23:29:29.430 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 -- 172.21.15.12:0/1155333080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb400049f0 msgr2=0x7ffb40004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 --2- 172.21.15.12:0/1155333080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb400049f0 0x7ffb40004e70 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7ffb5400c000 tx=0x7ffb54006df0).stop 2021-10-20T23:29:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5e2f0700 1 -- 172.21.15.12:0/1155333080 reap_dead start 2021-10-20T23:29:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 -- 172.21.15.12:0/1155333080 shutdown_connections 2021-10-20T23:29:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 -- 172.21.15.12:0/1155333080 >> 172.21.15.12:0/1155333080 conn(0x7ffb5805f6b0 msgr2=0x7ffb5805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 -- 172.21.15.12:0/1155333080 shutdown_connections 2021-10-20T23:29:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.407+0000 7ffb5fd53700 1 -- 172.21.15.12:0/1155333080 wait complete. 2021-10-20T23:29:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 Processor -- start 2021-10-20T23:29:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 -- start start 2021-10-20T23:29:29.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb400049f0 0x7ffb58141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5814b2f0 0x7ffb580b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb580b5980 0x7ffb5813f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5814a3a0 con 0x7ffb580b5980 2021-10-20T23:29:29.433 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5814a140 con 0x7ffb5814b2f0 2021-10-20T23:29:29.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5814ab60 con 0x7ffb400049f0 2021-10-20T23:29:29.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5e2f0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb580b5980 0x7ffb5813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.434 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5e2f0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb580b5980 0x7ffb5813f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45714/0 (socket says 172.21.15.12:45714) 2021-10-20T23:29:29.435 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5e2f0700 1 -- 172.21.15.12:0/715350234 learned_addr learned my addr 172.21.15.12:0/715350234 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:29.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5daef700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb400049f0 0x7ffb58141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5d2ee700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5814b2f0 0x7ffb580b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5e2f0700 1 -- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb400049f0 msgr2=0x7ffb58141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.436 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5e2f0700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb400049f0 0x7ffb58141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5e2f0700 1 -- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5814b2f0 msgr2=0x7ffb580b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5e2f0700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5814b2f0 0x7ffb580b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5e2f0700 1 -- 172.21.15.12:0/715350234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb580b40d0 con 0x7ffb580b5980 2021-10-20T23:29:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5e2f0700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb580b5980 0x7ffb5813f890 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7ffb580b0eb0 tx=0x7ffb54019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb46ffd700 1 -- 172.21.15.12:0/715350234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5401b820 con 0x7ffb580b5980 2021-10-20T23:29:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb46ffd700 1 -- 172.21.15.12:0/715350234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb54000e90 con 0x7ffb580b5980 2021-10-20T23:29:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5814a6c0 con 0x7ffb580b5980 2021-10-20T23:29:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb46ffd700 1 -- 172.21.15.12:0/715350234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5401bb70 con 0x7ffb580b5980 2021-10-20T23:29:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.411+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb580b3d50 con 0x7ffb580b5980 2021-10-20T23:29:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.415+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5814a850 con 0x7ffb580b5980 2021-10-20T23:29:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.415+0000 7ffb46ffd700 1 -- 172.21.15.12:0/715350234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb5401bcd0 con 0x7ffb580b5980 2021-10-20T23:29:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.415+0000 7ffb46ffd700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb38053640 0x7ffb38055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.415+0000 7ffb46ffd700 1 -- 172.21.15.12:0/715350234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ffb5406c430 con 0x7ffb580b5980 2021-10-20T23:29:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.415+0000 7ffb5daef700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb38053640 0x7ffb38055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.419+0000 7ffb5daef700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb38053640 0x7ffb38055b00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7ffb50005000 tx=0x7ffb50009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.419+0000 7ffb46ffd700 1 -- 172.21.15.12:0/715350234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb54043c60 con 0x7ffb580b5980 2021-10-20T23:29:29.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb58057350 con 0x7ffb580b5980 2021-10-20T23:29:29.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb46ffd700 1 -- 172.21.15.12:0/715350234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+1559 (secure 0 0 0) 0x7ffb54046cd0 con 0x7ffb580b5980 2021-10-20T23:29:29.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/4126550791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4126550791},{"type":"v1","addr":"172.21.15.31:6835","nonce":4126550791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/815086520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":815086520},{"type":"v1","addr":"172.21.15.12:6833","nonce":815086520}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6835/3850761072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3850761072},{"type":"v1","addr":"172.21.15.12:6835","nonce":3850761072}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":81}],"filesystems":[]} 2021-10-20T23:29:29.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb38053640 msgr2=0x7ffb38055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb38053640 0x7ffb38055b00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7ffb50005000 tx=0x7ffb50009040).stop 2021-10-20T23:29:29.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb580b5980 msgr2=0x7ffb5813f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb580b5980 0x7ffb5813f890 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7ffb580b0eb0 tx=0x7ffb54019000).stop 2021-10-20T23:29:29.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 shutdown_connections 2021-10-20T23:29:29.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb38053640 0x7ffb38055b00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb580b5980 0x7ffb5813f890 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5814b2f0 0x7ffb580b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 --2- 172.21.15.12:0/715350234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb400049f0 0x7ffb58141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 >> 172.21.15.12:0/715350234 conn(0x7ffb5805f6b0 msgr2=0x7ffb580ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:29.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 shutdown_connections 2021-10-20T23:29:29.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.587+0000 7ffb5fd53700 1 -- 172.21.15.12:0/715350234 wait complete. 2021-10-20T23:29:29.601 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 81 2021-10-20T23:29:29.609 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-20T23:29:29.610 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-20T23:29:29.610 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-20T23:29:29.610 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:29:29.611 INFO:tasks.ceph.mds.c:Restarting daemon 2021-10-20T23:29:29.611 INFO:tasks.ceph.mds.c:Stopping old one... 2021-10-20T23:29:29.611 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-20T23:29:29.612 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:29:29.612 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-20T23:29:29.612 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-20T23:29:29.613 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-20T23:29:29.613 INFO:teuthology.orchestra.run:waiting for 300 2021-10-20T23:29:29.620 INFO:tasks.ceph.mds.a:Stopped 2021-10-20T23:29:29.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-20T23:29:29.627 INFO:tasks.ceph.mds.c:Stopped 2021-10-20T23:29:29.628 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-10-20T23:29:29.630 INFO:tasks.ceph.mds.b:Stopped 2021-10-20T23:29:29.630 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-20T23:29:29.673 INFO:tasks.ceph.mds.a:Started 2021-10-20T23:29:29.674 DEBUG:teuthology.parallel:result is None 2021-10-20T23:29:29.675 INFO:tasks.ceph.mds.b:Started 2021-10-20T23:29:29.675 DEBUG:teuthology.parallel:result is None 2021-10-20T23:29:29.676 INFO:tasks.ceph.mds.c:Started 2021-10-20T23:29:29.676 DEBUG:teuthology.parallel:result is None 2021-10-20T23:29:29.677 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-20T23:29:29.743 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2021-10-20T23:29:29.746 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:29:29.748 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2021-10-20T23:29:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8a910700 1 Processor -- start 2021-10-20T23:29:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8a910700 1 -- start start 2021-10-20T23:29:29.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8a910700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef840b30d0 0x7fef84143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8a910700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 0x7fef8413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8a910700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef84143920 con 0x7fef840b0710 2021-10-20T23:29:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8a910700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef840b0af0 con 0x7fef840b30d0 2021-10-20T23:29:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8a910700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef840ae680 con 0x7fef840ace70 2021-10-20T23:29:29.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8910d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef840b30d0 0x7fef84143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8910d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef840b30d0 0x7fef84143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45744/0 (socket says 172.21.15.12:45744) 2021-10-20T23:29:29.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8910d700 1 -- 172.21.15.12:0/877915697 learned_addr learned my addr 172.21.15.12:0/877915697 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:29.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8a10f700 1 --2- 172.21.15.12:0/877915697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 0x7fef8413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8910d700 1 -- 172.21.15.12:0/877915697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 msgr2=0x7fef8413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8910d700 1 --2- 172.21.15.12:0/877915697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 0x7fef8413f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8910d700 1 -- 172.21.15.12:0/877915697 >> v1:172.21.15.31:6789/0 conn(0x7fef840b0710 legacy=0x7fef84142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8910d700 1 -- 172.21.15.12:0/877915697 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef840ae920 con 0x7fef840b30d0 2021-10-20T23:29:29.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8890c700 1 -- 172.21.15.12:0/877915697 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292847419 0 0) 0x7fef84143920 con 0x7fef840b0710 2021-10-20T23:29:29.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8a10f700 1 --2- 172.21.15.12:0/877915697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 0x7fef8413f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:29.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.775+0000 7fef8910d700 1 --2- 172.21.15.12:0/877915697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b30d0 0x7fef84143430 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fef74002f70 tx=0x7fef74006e40).ready entity=mon.0 client_cookie=6d2aeceb85a6b6cc server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8890c700 1 -- 172.21.15.12:0/877915697 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7400bd20 con 0x7fef840b30d0 2021-10-20T23:29:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8890c700 1 -- 172.21.15.12:0/877915697 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74000e90 con 0x7fef840b30d0 2021-10-20T23:29:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8890c700 1 -- 172.21.15.12:0/877915697 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef740155e0 con 0x7fef840b30d0 2021-10-20T23:29:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 -- 172.21.15.12:0/877915697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b30d0 msgr2=0x7fef84143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 --2- 172.21.15.12:0/877915697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b30d0 0x7fef84143430 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fef74002f70 tx=0x7fef74006e40).stop 2021-10-20T23:29:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 -- 172.21.15.12:0/877915697 shutdown_connections 2021-10-20T23:29:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 --2- 172.21.15.12:0/877915697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 0x7fef8413f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 --2- 172.21.15.12:0/877915697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b30d0 0x7fef84143430 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 -- 172.21.15.12:0/877915697 >> 172.21.15.12:0/877915697 conn(0x7fef84061140 msgr2=0x7fef84062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 -- 172.21.15.12:0/877915697 shutdown_connections 2021-10-20T23:29:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 -- 172.21.15.12:0/877915697 wait complete. 2021-10-20T23:29:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 Processor -- start 2021-10-20T23:29:29.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 -- start start 2021-10-20T23:29:29.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.779+0000 7fef8a910700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 0x7fef84067090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8a910700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b0710 0x7fef84152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8a910700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef840b30d0 0x7fef84152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8a910700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef84152390 con 0x7fef840b0710 2021-10-20T23:29:29.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8a910700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef840658f0 con 0x7fef840b30d0 2021-10-20T23:29:29.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8a910700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef84065b90 con 0x7fef840ace70 2021-10-20T23:29:29.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8910d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b0710 0x7fef84152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8910d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b0710 0x7fef84152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45750/0 (socket says 172.21.15.12:45750) 2021-10-20T23:29:29.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8910d700 1 -- 172.21.15.12:0/3346059201 learned_addr learned my addr 172.21.15.12:0/3346059201 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:29.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8990e700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 0x7fef84067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8a10f700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef840b30d0 0x7fef84152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8910d700 1 -- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 msgr2=0x7fef84067090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8910d700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 0x7fef84067090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8910d700 1 -- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef840b30d0 msgr2=0x7fef84152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8910d700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef840b30d0 0x7fef84152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8910d700 1 -- 172.21.15.12:0/3346059201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7400d4d0 con 0x7fef840b0710 2021-10-20T23:29:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8910d700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b0710 0x7fef84152a90 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fef74002f70 tx=0x7fef74018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef72ffd700 1 -- 172.21.15.12:0/3346059201 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef74009070 con 0x7fef840b0710 2021-10-20T23:29:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef72ffd700 1 -- 172.21.15.12:0/3346059201 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7400a040 con 0x7fef840b0710 2021-10-20T23:29:29.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef84065e30 con 0x7fef840b0710 2021-10-20T23:29:29.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef72ffd700 1 -- 172.21.15.12:0/3346059201 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef74015dc0 con 0x7fef840b0710 2021-10-20T23:29:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef84063a70 con 0x7fef840b0710 2021-10-20T23:29:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef840aeb00 con 0x7fef840b0710 2021-10-20T23:29:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef72ffd700 1 -- 172.21.15.12:0/3346059201 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef74027450 con 0x7fef840b0710 2021-10-20T23:29:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.783+0000 7fef72ffd700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef64053580 0x7fef64055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.787+0000 7fef72ffd700 1 -- 172.21.15.12:0/3346059201 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fef7406cb70 con 0x7fef840b0710 2021-10-20T23:29:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.787+0000 7fef8990e700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef64053580 0x7fef64055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:29.818 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.787+0000 7fef8990e700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef64053580 0x7fef64055a40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fef8000d000 tx=0x7fef800079b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.791+0000 7fef72ffd700 1 -- 172.21.15.12:0/3346059201 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef74043ce0 con 0x7fef840b0710 2021-10-20T23:29:29.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:29.931+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fef84057350 con 0x7fef840b0710 2021-10-20T23:29:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.759+0000 7fef72ffd700 1 -- 172.21.15.12:0/3346059201 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v157) v1 ==== 97+0+0 (secure 0 0 0) 0x7fef74047300 con 0x7fef840b0710 2021-10-20T23:29:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef64053580 msgr2=0x7fef64055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef64053580 0x7fef64055a40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fef8000d000 tx=0x7fef800079b0).stop 2021-10-20T23:29:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b0710 msgr2=0x7fef84152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b0710 0x7fef84152a90 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fef74002f70 tx=0x7fef74018000).stop 2021-10-20T23:29:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 shutdown_connections 2021-10-20T23:29:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef64053580 0x7fef64055a40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef840b30d0 0x7fef84152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef840b0710 0x7fef84152a90 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 --2- 172.21.15.12:0/3346059201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef840ace70 0x7fef84067090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 >> 172.21.15.12:0/3346059201 conn(0x7fef84061140 msgr2=0x7fef84141400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 shutdown_connections 2021-10-20T23:29:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.763+0000 7fef8a910700 1 -- 172.21.15.12:0/3346059201 wait complete. 2021-10-20T23:29:30.778 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blacklist entries 2021-10-20T23:29:30.790 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-10-20T23:29:30.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-20T23:29:30.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f123759e700 1 Processor -- start 2021-10-20T23:29:30.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f123759e700 1 -- start start 2021-10-20T23:29:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f123759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12380b4060 0x7f1238061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:30.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f123759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1238142e60 0x7f1238143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:30.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f123759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380b5f50 con 0x7f12380b6290 2021-10-20T23:29:30.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f123759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12380b1f70 con 0x7f1238142e60 2021-10-20T23:29:30.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f123759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12380b2210 con 0x7f12380b4060 2021-10-20T23:29:30.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f1236d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1238142e60 0x7f1238143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:30.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f123659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f12380b6290 0x7f1238061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:51416/0 (socket says 172.21.15.12:51416) 2021-10-20T23:29:30.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f123659c700 1 -- 172.21.15.12:0/1333361344 learned_addr learned my addr 172.21.15.12:0/1333361344 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:30.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.891+0000 7f1235d9b700 1 --2- 172.21.15.12:0/1333361344 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12380b4060 0x7f1238061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:30.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123559a700 1 -- 172.21.15.12:0/1333361344 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626746539 0 0) 0x7f1228001110 con 0x7f12380b6290 2021-10-20T23:29:30.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123559a700 1 -- 172.21.15.12:0/1333361344 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f121c003260 con 0x7f12380b6290 2021-10-20T23:29:30.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f1236d9d700 1 -- 172.21.15.12:0/1333361344 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12380b4060 msgr2=0x7f1238061b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:30.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f1236d9d700 1 --2- 172.21.15.12:0/1333361344 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12380b4060 0x7f1238061b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:30.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f1236d9d700 1 -- 172.21.15.12:0/1333361344 >> v1:172.21.15.31:6789/0 conn(0x7f12380b6290 legacy=0x7f1238061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:30.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f1236d9d700 1 -- 172.21.15.12:0/1333361344 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380b24b0 con 0x7f1238142e60 2021-10-20T23:29:30.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f1236d9d700 1 --2- 172.21.15.12:0/1333361344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1238142e60 0x7f1238143310 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f12300032f0 tx=0x7f12300091d0).ready entity=mon.1 client_cookie=de255d68d59d2fb5 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:30.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123559a700 1 -- 172.21.15.12:0/1333361344 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f123000b600 con 0x7f1238142e60 2021-10-20T23:29:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123559a700 1 -- 172.21.15.12:0/1333361344 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123000b760 con 0x7f1238142e60 2021-10-20T23:29:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123559a700 1 -- 172.21.15.12:0/1333361344 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f123000b8d0 con 0x7f1238142e60 2021-10-20T23:29:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123759e700 1 -- 172.21.15.12:0/1333361344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1238142e60 msgr2=0x7f1238143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123759e700 1 --2- 172.21.15.12:0/1333361344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1238142e60 0x7f1238143310 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f12300032f0 tx=0x7f12300091d0).stop 2021-10-20T23:29:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123759e700 1 -- 172.21.15.12:0/1333361344 shutdown_connections 2021-10-20T23:29:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123759e700 1 --2- 172.21.15.12:0/1333361344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1238142e60 0x7f1238143310 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123759e700 1 --2- 172.21.15.12:0/1333361344 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12380b4060 0x7f1238061b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123759e700 1 -- 172.21.15.12:0/1333361344 >> 172.21.15.12:0/1333361344 conn(0x7f123805c490 msgr2=0x7f123805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123759e700 1 -- 172.21.15.12:0/1333361344 shutdown_connections 2021-10-20T23:29:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.895+0000 7f123759e700 1 -- 172.21.15.12:0/1333361344 wait complete. 2021-10-20T23:29:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123759e700 1 Processor -- start 2021-10-20T23:29:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123759e700 1 -- start start 2021-10-20T23:29:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12380b4060 0x7f12381402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12380b4060 0x7f12381402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12380b4060 0x7f12381402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45764/0 (socket says 172.21.15.12:45764) 2021-10-20T23:29:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12380b6290 0x7f12380b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123659c700 1 -- 172.21.15.12:0/911202857 learned_addr learned my addr 172.21.15.12:0/911202857 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123759e700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1238142e60 0x7f12380b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123813f9e0 con 0x7f12380b4060 2021-10-20T23:29:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12381534f0 con 0x7f12380b6290 2021-10-20T23:29:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.899+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123813fc10 con 0x7f1238142e60 2021-10-20T23:29:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f1235d9b700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12380b6290 0x7f12380b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f1236d9d700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1238142e60 0x7f12380b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f123659c700 1 -- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1238142e60 msgr2=0x7f12380b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f123659c700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1238142e60 0x7f12380b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f123659c700 1 -- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12380b6290 msgr2=0x7f12380b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f123659c700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12380b6290 0x7f12380b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f123659c700 1 -- 172.21.15.12:0/911202857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1230009470 con 0x7f12380b4060 2021-10-20T23:29:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f123659c700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12380b4060 0x7f12381402a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f12280012a0 tx=0x7f1228007940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f12277fe700 1 -- 172.21.15.12:0/911202857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f122800ce10 con 0x7f12380b4060 2021-10-20T23:29:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f12277fe700 1 -- 172.21.15.12:0/911202857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12280072e0 con 0x7f12380b4060 2021-10-20T23:29:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1238152fb0 con 0x7f12380b4060 2021-10-20T23:29:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f12277fe700 1 -- 172.21.15.12:0/911202857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1228005800 con 0x7f12380b4060 2021-10-20T23:29:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123813f650 con 0x7f12380b4060 2021-10-20T23:29:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123813d0a0 con 0x7f12380b4060 2021-10-20T23:29:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.903+0000 7f12277fe700 1 -- 172.21.15.12:0/911202857 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f122801a060 con 0x7f12380b4060 2021-10-20T23:29:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.907+0000 7f12277fe700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12140536a0 0x7f1214055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:30.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.907+0000 7f12277fe700 1 -- 172.21.15.12:0/911202857 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f122806ad60 con 0x7f12380b4060 2021-10-20T23:29:30.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.907+0000 7f1235d9b700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12140536a0 0x7f1214055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:30.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.907+0000 7f1235d9b700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12140536a0 0x7f1214055b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f122c00b000 tx=0x7f122c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:30.915+0000 7f12277fe700 1 -- 172.21.15.12:0/911202857 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f12280420a0 con 0x7f12380b4060 2021-10-20T23:29:31.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.083+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f12380b5f50 con 0x7f12380b4060 2021-10-20T23:29:31.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f12277fe700 1 -- 172.21.15.12:0/911202857 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v33) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f12380b5f50 con 0x7f12380b4060 2021-10-20T23:29:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:31.096 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:29:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2021-10-20T23:29:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2021-10-20T23:29:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhbDV7DRAA2vum9P1q8SdY5yniuUcq5Q==", 2021-10-20T23:29:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2021-10-20T23:29:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhG/+FFxAAmbqyw/PtbC9E4EJG4SRJpQ==", 2021-10-20T23:29:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2021-10-20T23:29:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhspSmExAAffKHpA/ZYADH3/wlRK3Lzw==", 2021-10-20T23:29:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2021-10-20T23:29:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDuo3BhwHhREhAAR2uB/Rww9W5YLs+M0kW8yA==", 2021-10-20T23:29:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2021-10-20T23:29:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwo3BheU2hNBAAe5D5UTAo3ST6tFtQW8a2lw==", 2021-10-20T23:29:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2021-10-20T23:29:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzo3Bh+DmZGBAArzmKVZQc8BDUVceCb/hYWQ==", 2021-10-20T23:29:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2021-10-20T23:29:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD1o3BhY2noOBAA+PGfeLIZLHfzb5exrS3bbg==", 2021-10-20T23:29:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2021-10-20T23:29:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD7o3Bh0tcmBhAAWOL8x1k4mwvn8Jlj+X4Y/Q==", 2021-10-20T23:29:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2021-10-20T23:29:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD9o3BhNki+KBAAehlTNGO9kNWADek1FtkZRw==", 2021-10-20T23:29:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2021-10-20T23:29:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAApHBhgYe3DhAAuFjJ+M+2uBzb72U3xWCeAw==", 2021-10-20T23:29:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2021-10-20T23:29:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQACpHBhoT8LLRAALUP4hQIWBQ7Bn8iENz2cMg==", 2021-10-20T23:29:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2021-10-20T23:29:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhB6kPHxAA+N9xv8mXp+YtUFLybqsSmg==", 2021-10-20T23:29:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:29:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:29:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2021-10-20T23:29:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhRh2KJBAAea6ZsIb0MS7hMMhTpY3F7A==", 2021-10-20T23:29:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2021-10-20T23:29:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2021-10-20T23:29:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-20T23:29:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2021-10-20T23:29:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDqo3BhV7wQKxAAhrOv1FlKMQ08phx5d91H/w==", 2021-10-20T23:29:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:29:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2021-10-20T23:29:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2021-10-20T23:29:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2021-10-20T23:29:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhAnW7ChAA/WagpHAEts3HExOxg6CdRg==", 2021-10-20T23:29:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:29:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:29:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2021-10-20T23:29:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDro3BhxLhBBhAAh0q6MxruX7EiUJ+zuFdplQ==", 2021-10-20T23:29:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2021-10-20T23:29:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2021-10-20T23:29:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2021-10-20T23:29:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2021-10-20T23:29:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:31.137 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:29:31.140 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12140536a0 msgr2=0x7f1214055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12140536a0 0x7f1214055b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f122c00b000 tx=0x7f122c006df0).stop 2021-10-20T23:29:31.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12380b4060 msgr2=0x7f12381402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12380b4060 0x7f12381402a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f12280012a0 tx=0x7f1228007940).stop 2021-10-20T23:29:31.141 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 shutdown_connections 2021-10-20T23:29:31.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f12140536a0 0x7f1214055b60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1238142e60 0x7f12380b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.142 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12380b6290 0x7f12380b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 --2- 172.21.15.12:0/911202857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12380b4060 0x7f12381402a0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 >> 172.21.15.12:0/911202857 conn(0x7f123805c490 msgr2=0x7f12380b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:31.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 shutdown_connections 2021-10-20T23:29:31.143 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.087+0000 7f123759e700 1 -- 172.21.15.12:0/911202857 wait complete. 2021-10-20T23:29:31.144 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:31.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a44b45700 1 Processor -- start 2021-10-20T23:29:31.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a44b45700 1 -- start start 2021-10-20T23:29:31.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a44b45700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a400b00e0 0x7f1a40142e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a44b45700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400ac6f0 0x7f1a40143360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a44b45700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a40067880 con 0x7f1a400b2580 2021-10-20T23:29:31.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a44b45700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a400ad5b0 con 0x7f1a400b00e0 2021-10-20T23:29:31.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a44b45700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40067b20 con 0x7f1a400ac6f0 2021-10-20T23:29:31.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a37fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a400b00e0 0x7f1a40142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a3f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1a400b2580 0x7f1a40140050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44368/0 (socket says 172.21.15.12:44368) 2021-10-20T23:29:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.239+0000 7f1a3f7fe700 1 -- 172.21.15.12:0/3597836634 learned_addr learned my addr 172.21.15.12:0/3597836634 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:31.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a3ffff700 1 --2- 172.21.15.12:0/3597836634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400ac6f0 0x7f1a40143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a37fff700 1 -- 172.21.15.12:0/3597836634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400ac6f0 msgr2=0x7f1a40143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:31.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a37fff700 1 --2- 172.21.15.12:0/3597836634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400ac6f0 0x7f1a40143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a37fff700 1 -- 172.21.15.12:0/3597836634 >> v1:172.21.15.12:6789/0 conn(0x7f1a400b2580 legacy=0x7f1a40140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a37fff700 1 -- 172.21.15.12:0/3597836634 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a40146fd0 con 0x7f1a400b00e0 2021-10-20T23:29:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a37fff700 1 --2- 172.21.15.12:0/3597836634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400b00e0 0x7f1a40142e70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f1a28002f70 tx=0x7f1a28006df0).ready entity=mon.0 client_cookie=a3c23160b5695c8f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:31.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a3effd700 1 -- 172.21.15.12:0/3597836634 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a2800d570 con 0x7f1a400b00e0 2021-10-20T23:29:31.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a3effd700 1 -- 172.21.15.12:0/3597836634 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a28000e90 con 0x7f1a400b00e0 2021-10-20T23:29:31.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a3effd700 1 -- 172.21.15.12:0/3597836634 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a2800d8c0 con 0x7f1a400b00e0 2021-10-20T23:29:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 -- 172.21.15.12:0/3597836634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400b00e0 msgr2=0x7f1a40142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 --2- 172.21.15.12:0/3597836634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400b00e0 0x7f1a40142e70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f1a28002f70 tx=0x7f1a28006df0).stop 2021-10-20T23:29:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 -- 172.21.15.12:0/3597836634 shutdown_connections 2021-10-20T23:29:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 --2- 172.21.15.12:0/3597836634 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400ac6f0 0x7f1a40143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 --2- 172.21.15.12:0/3597836634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400b00e0 0x7f1a40142e70 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 -- 172.21.15.12:0/3597836634 >> 172.21.15.12:0/3597836634 conn(0x7f1a40060180 msgr2=0x7f1a400b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:31.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 -- 172.21.15.12:0/3597836634 shutdown_connections 2021-10-20T23:29:31.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 -- 172.21.15.12:0/3597836634 wait complete. 2021-10-20T23:29:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 Processor -- start 2021-10-20T23:29:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 -- start start 2021-10-20T23:29:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a400ac6f0 0x7f1a40146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400b2580 0x7f1a40153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400a9140 0x7f1a40153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40156fd0 con 0x7f1a400a9140 2021-10-20T23:29:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40153a20 con 0x7f1a400ac6f0 2021-10-20T23:29:31.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a44b45700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40152be0 con 0x7f1a400b2580 2021-10-20T23:29:31.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a3ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400a9140 0x7f1a40153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a3ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400a9140 0x7f1a40153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45782/0 (socket says 172.21.15.12:45782) 2021-10-20T23:29:31.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.243+0000 7f1a3ffff700 1 -- 172.21.15.12:0/195299272 learned_addr learned my addr 172.21.15.12:0/195299272 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:31.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3f7fe700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a400ac6f0 0x7f1a40146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a37fff700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400b2580 0x7f1a40153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3ffff700 1 -- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400b2580 msgr2=0x7f1a40153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3ffff700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400b2580 0x7f1a40153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3ffff700 1 -- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a400ac6f0 msgr2=0x7f1a40146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3ffff700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a400ac6f0 0x7f1a40146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3ffff700 1 -- 172.21.15.12:0/195299272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2800b180 con 0x7f1a400a9140 2021-10-20T23:29:31.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3f7fe700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a400ac6f0 0x7f1a40146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:31.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3ffff700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400a9140 0x7f1a40153530 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f1a40153b60 tx=0x7f1a380091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:31.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3d7fa700 1 -- 172.21.15.12:0/195299272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a380095c0 con 0x7f1a400a9140 2021-10-20T23:29:31.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3d7fa700 1 -- 172.21.15.12:0/195299272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800c850 con 0x7f1a400a9140 2021-10-20T23:29:31.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a400a9940 con 0x7f1a400a9140 2021-10-20T23:29:31.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3d7fa700 1 -- 172.21.15.12:0/195299272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a3800cbb0 con 0x7f1a400a9140 2021-10-20T23:29:31.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a400a9e80 con 0x7f1a400a9140 2021-10-20T23:29:31.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a40152da0 con 0x7f1a400a9140 2021-10-20T23:29:31.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.247+0000 7f1a3d7fa700 1 -- 172.21.15.12:0/195299272 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a38022070 con 0x7f1a400a9140 2021-10-20T23:29:31.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.251+0000 7f1a3d7fa700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a24053610 0x7f1a24055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.251+0000 7f1a3d7fa700 1 -- 172.21.15.12:0/195299272 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f1a3806bd70 con 0x7f1a400a9140 2021-10-20T23:29:31.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.251+0000 7f1a3f7fe700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a24053610 0x7f1a24055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.251+0000 7f1a3f7fe700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a24053610 0x7f1a24055ad0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f1a3000b000 tx=0x7f1a30009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:31.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.255+0000 7f1a3d7fa700 1 -- 172.21.15.12:0/195299272 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a40152da0 con 0x7f1a400a9140 2021-10-20T23:29:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.383+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a40152da0 con 0x7f1a400a9140 2021-10-20T23:29:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.383+0000 7f1a3d7fa700 1 -- 172.21.15.12:0/195299272 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f1a40152da0 con 0x7f1a400a9140 2021-10-20T23:29:31.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:31.394 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":157,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:30.754351+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a24053610 msgr2=0x7f1a24055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a24053610 0x7f1a24055ad0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f1a3000b000 tx=0x7f1a30009040).stop 2021-10-20T23:29:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400a9140 msgr2=0x7f1a40153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400a9140 0x7f1a40153530 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f1a40153b60 tx=0x7f1a380091d0).stop 2021-10-20T23:29:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 shutdown_connections 2021-10-20T23:29:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f1a24053610 0x7f1a24055ad0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a400a9140 0x7f1a40153530 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a400b2580 0x7f1a40153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 --2- 172.21.15.12:0/195299272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a400ac6f0 0x7f1a40146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 >> 172.21.15.12:0/195299272 conn(0x7f1a40060180 msgr2=0x7f1a400b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 shutdown_connections 2021-10-20T23:29:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.387+0000 7f1a44b45700 1 -- 172.21.15.12:0/195299272 wait complete. 2021-10-20T23:29:31.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-20T23:29:31.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:29:31.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4237fff700 1 Processor -- start 2021-10-20T23:29:31.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4237fff700 1 -- start start 2021-10-20T23:29:31.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4237fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f42380b2580 0x7f423814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4237fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380a8ac0 0x7f423814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4237fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42380a70c0 con 0x7f42380b0010 2021-10-20T23:29:31.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4237fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42380a72f0 con 0x7f42380b2580 2021-10-20T23:29:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4237fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42380a7590 con 0x7f42380a8ac0 2021-10-20T23:29:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f42367fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f42380b0010 0x7f42380a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44382/0 (socket says 172.21.15.12:44382) 2021-10-20T23:29:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f42367fc700 1 -- 172.21.15.12:0/409888604 learned_addr learned my addr 172.21.15.12:0/409888604 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f42377fe700 1 --2- 172.21.15.12:0/409888604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380a8ac0 0x7f423814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4236ffd700 1 --2- 172.21.15.12:0/409888604 >> v2:172.21.15.31:3300/0 conn(0x7f42380b2580 0x7f423814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4235ffb700 1 -- 172.21.15.12:0/409888604 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887136357 0 0) 0x7f42380a70c0 con 0x7f42380b0010 2021-10-20T23:29:31.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4235ffb700 1 -- 172.21.15.12:0/409888604 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4218003260 con 0x7f42380b0010 2021-10-20T23:29:31.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f42377fe700 1 -- 172.21.15.12:0/409888604 >> v2:172.21.15.31:3300/0 conn(0x7f42380b2580 msgr2=0x7f423814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f42377fe700 1 --2- 172.21.15.12:0/409888604 >> v2:172.21.15.31:3300/0 conn(0x7f42380b2580 0x7f423814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f42377fe700 1 -- 172.21.15.12:0/409888604 >> v1:172.21.15.12:6789/0 conn(0x7f42380b0010 legacy=0x7f42380a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f42377fe700 1 -- 172.21.15.12:0/409888604 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42380a7830 con 0x7f42380a8ac0 2021-10-20T23:29:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f42377fe700 1 --2- 172.21.15.12:0/409888604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380a8ac0 0x7f423814b330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f4230002f70 tx=0x7f4230006df0).ready entity=mon.2 client_cookie=4e6c48fe14a86a76 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:31.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4235ffb700 1 -- 172.21.15.12:0/409888604 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423000d4a0 con 0x7f42380a8ac0 2021-10-20T23:29:31.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4235ffb700 1 -- 172.21.15.12:0/409888604 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4230000e90 con 0x7f42380a8ac0 2021-10-20T23:29:31.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.507+0000 7f4235ffb700 1 -- 172.21.15.12:0/409888604 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423000d7f0 con 0x7f42380a8ac0 2021-10-20T23:29:31.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 -- 172.21.15.12:0/409888604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380a8ac0 msgr2=0x7f423814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 --2- 172.21.15.12:0/409888604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380a8ac0 0x7f423814b330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f4230002f70 tx=0x7f4230006df0).stop 2021-10-20T23:29:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 -- 172.21.15.12:0/409888604 shutdown_connections 2021-10-20T23:29:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 --2- 172.21.15.12:0/409888604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380a8ac0 0x7f423814b330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 --2- 172.21.15.12:0/409888604 >> v2:172.21.15.31:3300/0 conn(0x7f42380b2580 0x7f423814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 -- 172.21.15.12:0/409888604 >> 172.21.15.12:0/409888604 conn(0x7f4238060180 msgr2=0x7f42380b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:31.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 -- 172.21.15.12:0/409888604 shutdown_connections 2021-10-20T23:29:31.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 -- 172.21.15.12:0/409888604 wait complete. 2021-10-20T23:29:31.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 Processor -- start 2021-10-20T23:29:31.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 -- start start 2021-10-20T23:29:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42380a8ac0 0x7f42380ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380b0010 0x7f42380abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42380b2580 0x7f42380ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42380649d0 con 0x7f42380b2580 2021-10-20T23:29:31.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4238064c70 con 0x7f42380a8ac0 2021-10-20T23:29:31.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4237fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4238064f10 con 0x7f42380b0010 2021-10-20T23:29:31.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42380b2580 0x7f42380ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42380b2580 0x7f42380ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45794/0 (socket says 172.21.15.12:45794) 2021-10-20T23:29:31.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42377fe700 1 -- 172.21.15.12:0/2910726294 learned_addr learned my addr 172.21.15.12:0/2910726294 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:31.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42367fc700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380b0010 0x7f42380abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f4236ffd700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42380a8ac0 0x7f42380ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42377fe700 1 -- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380b0010 msgr2=0x7f42380abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42377fe700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380b0010 0x7f42380abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42377fe700 1 -- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42380a8ac0 msgr2=0x7f42380ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42377fe700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42380a8ac0 0x7f42380ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42377fe700 1 -- 172.21.15.12:0/2910726294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423000b180 con 0x7f42380b2580 2021-10-20T23:29:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.511+0000 7f42377fe700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42380b2580 0x7f42380ac390 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f4230002f70 tx=0x7f4230014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:31.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f422ffff700 1 -- 172.21.15.12:0/2910726294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4230016070 con 0x7f42380b2580 2021-10-20T23:29:31.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f422ffff700 1 -- 172.21.15.12:0/2910726294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42300137d0 con 0x7f42380b2580 2021-10-20T23:29:31.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42380651b0 con 0x7f42380b2580 2021-10-20T23:29:31.534 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f422ffff700 1 -- 172.21.15.12:0/2910726294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4230013b30 con 0x7f42380b2580 2021-10-20T23:29:31.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42380636f0 con 0x7f42380b2580 2021-10-20T23:29:31.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4238063340 con 0x7f42380b2580 2021-10-20T23:29:31.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f422ffff700 1 -- 172.21.15.12:0/2910726294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4230025030 con 0x7f42380b2580 2021-10-20T23:29:31.535 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f422ffff700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f421c053580 0x7f421c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f422ffff700 1 -- 172.21.15.12:0/2910726294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f423006c4d0 con 0x7f42380b2580 2021-10-20T23:29:31.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f4236ffd700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f421c053580 0x7f421c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.515+0000 7f4236ffd700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f421c053580 0x7f421c055a40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f422000b000 tx=0x7f4220006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:31.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.519+0000 7f422ffff700 1 -- 172.21.15.12:0/2910726294 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4238063340 con 0x7f42380b2580 2021-10-20T23:29:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.647+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4238063340 con 0x7f42380b2580 2021-10-20T23:29:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.647+0000 7f422ffff700 1 -- 172.21.15.12:0/2910726294 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v157) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4230023020 con 0x7f42380b2580 2021-10-20T23:29:31.658 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:29:31.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f421c053580 msgr2=0x7f421c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f421c053580 0x7f421c055a40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f422000b000 tx=0x7f4220006df0).stop 2021-10-20T23:29:31.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42380b2580 msgr2=0x7f42380ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42380b2580 0x7f42380ac390 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f4230002f70 tx=0x7f4230014000).stop 2021-10-20T23:29:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 shutdown_connections 2021-10-20T23:29:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f421c053580 0x7f421c055a40 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42380b2580 0x7f42380ac390 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42380b0010 0x7f42380abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 --2- 172.21.15.12:0/2910726294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42380a8ac0 0x7f42380ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 >> 172.21.15.12:0/2910726294 conn(0x7f4238060180 msgr2=0x7f42381499d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 shutdown_connections 2021-10-20T23:29:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.651+0000 7f4237fff700 1 -- 172.21.15.12:0/2910726294 wait complete. 2021-10-20T23:29:31.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:29:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.763+0000 7f753b33a700 1 Processor -- start 2021-10-20T23:29:31.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.763+0000 7f753b33a700 1 -- start start 2021-10-20T23:29:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 0x7f75340affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340a77d0 con 0x7f75340b1ec0 2021-10-20T23:29:31.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340b0650 con 0x7f75340b22a0 2021-10-20T23:29:31.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b1740 con 0x7f75340b12d0 2021-10-20T23:29:31.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f75390d6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f75340b1ec0 0x7f75340a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44394/0 (socket says 172.21.15.12:44394) 2021-10-20T23:29:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f75390d6700 1 -- 172.21.15.12:0/2394160458 learned_addr learned my addr 172.21.15.12:0/2394160458 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f75388d5700 1 --2- 172.21.15.12:0/2394160458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 0x7f75340affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f752bfff700 1 -- 172.21.15.12:0/2394160458 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322855752 0 0) 0x7f75340a77d0 con 0x7f75340b1ec0 2021-10-20T23:29:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f752bfff700 1 -- 172.21.15.12:0/2394160458 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7518003260 con 0x7f75340b1ec0 2021-10-20T23:29:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f752bfff700 1 -- 172.21.15.12:0/2394160458 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146632844 0 0) 0x7f75340b0650 con 0x7f75340b22a0 2021-10-20T23:29:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f75388d5700 1 -- 172.21.15.12:0/2394160458 >> v1:172.21.15.31:6789/0 conn(0x7f75340b22a0 legacy=0x7f7534141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f75388d5700 1 -- 172.21.15.12:0/2394160458 >> v1:172.21.15.12:6789/0 conn(0x7f75340b1ec0 legacy=0x7f75340a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f75388d5700 1 -- 172.21.15.12:0/2394160458 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340b08f0 con 0x7f75340b12d0 2021-10-20T23:29:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f75388d5700 1 --2- 172.21.15.12:0/2394160458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 0x7f75340affb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f75300032f0 tx=0x7f75300091d0).ready entity=mon.2 client_cookie=e8397e830c5f5b35 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f752bfff700 1 -- 172.21.15.12:0/2394160458 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753000b6c0 con 0x7f75340b12d0 2021-10-20T23:29:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f752bfff700 1 -- 172.21.15.12:0/2394160458 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000b820 con 0x7f75340b12d0 2021-10-20T23:29:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f752bfff700 1 -- 172.21.15.12:0/2394160458 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753000b990 con 0x7f75340b12d0 2021-10-20T23:29:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 -- 172.21.15.12:0/2394160458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 msgr2=0x7f75340affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 --2- 172.21.15.12:0/2394160458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 0x7f75340affb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f75300032f0 tx=0x7f75300091d0).stop 2021-10-20T23:29:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 -- 172.21.15.12:0/2394160458 shutdown_connections 2021-10-20T23:29:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 --2- 172.21.15.12:0/2394160458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 0x7f75340affb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 -- 172.21.15.12:0/2394160458 >> 172.21.15.12:0/2394160458 conn(0x7f753405f6b0 msgr2=0x7f753405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 -- 172.21.15.12:0/2394160458 shutdown_connections 2021-10-20T23:29:31.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.767+0000 7f753b33a700 1 -- 172.21.15.12:0/2394160458 wait complete. 2021-10-20T23:29:31.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 Processor -- start 2021-10-20T23:29:31.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 -- start start 2021-10-20T23:29:31.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 0x7f75340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75340b1ec0 0x7f75340aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75340b22a0 0x7f7534156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75341466b0 con 0x7f75340b22a0 2021-10-20T23:29:31.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753414b130 con 0x7f75340b1ec0 2021-10-20T23:29:31.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75341468e0 con 0x7f75340b12d0 2021-10-20T23:29:31.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75398d7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75340b22a0 0x7f7534156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75398d7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75340b22a0 0x7f7534156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45810/0 (socket says 172.21.15.12:45810) 2021-10-20T23:29:31.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75398d7700 1 -- 172.21.15.12:0/4122349314 learned_addr learned my addr 172.21.15.12:0/4122349314 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:31.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75388d5700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75340b1ec0 0x7f75340aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75390d6700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 0x7f75340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75398d7700 1 -- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 msgr2=0x7f75340b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75398d7700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 0x7f75340b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75398d7700 1 -- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75340b1ec0 msgr2=0x7f75340aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75398d7700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75340b1ec0 0x7f75340aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75398d7700 1 -- 172.21.15.12:0/4122349314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530009470 con 0x7f75340b22a0 2021-10-20T23:29:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f75398d7700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75340b22a0 0x7f7534156e00 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f752c000bc0 tx=0x7f752c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f752a7fc700 1 -- 172.21.15.12:0/4122349314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f752c001d10 con 0x7f75340b22a0 2021-10-20T23:29:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f752a7fc700 1 -- 172.21.15.12:0/4122349314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c007030 con 0x7f75340b22a0 2021-10-20T23:29:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753415acd0 con 0x7f75340b22a0 2021-10-20T23:29:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f752a7fc700 1 -- 172.21.15.12:0/4122349314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f752c007390 con 0x7f75340b22a0 2021-10-20T23:29:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.771+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7534149ff0 con 0x7f75340b22a0 2021-10-20T23:29:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.775+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7534156a30 con 0x7f75340b22a0 2021-10-20T23:29:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.775+0000 7f752a7fc700 1 -- 172.21.15.12:0/4122349314 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f752c010030 con 0x7f75340b22a0 2021-10-20T23:29:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.775+0000 7f752a7fc700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f751c0534f0 0x7f751c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:31.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.775+0000 7f752a7fc700 1 -- 172.21.15.12:0/4122349314 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f752c06b240 con 0x7f75340b22a0 2021-10-20T23:29:31.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.775+0000 7f75390d6700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f751c0534f0 0x7f751c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.775+0000 7f75390d6700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f751c0534f0 0x7f751c0559b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f752400d000 tx=0x7f7524009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.783+0000 7f752a7fc700 1 -- 172.21.15.12:0/4122349314 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7534156a30 con 0x7f75340b22a0 2021-10-20T23:29:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.911+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7534156a30 con 0x7f75340b22a0 2021-10-20T23:29:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.911+0000 7f752a7fc700 1 -- 172.21.15.12:0/4122349314 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v157) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7534156a30 con 0x7f75340b22a0 2021-10-20T23:29:31.922 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f751c0534f0 msgr2=0x7f751c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f751c0534f0 0x7f751c0559b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f752400d000 tx=0x7f7524009040).stop 2021-10-20T23:29:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75340b22a0 msgr2=0x7f7534156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75340b22a0 0x7f7534156e00 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f752c000bc0 tx=0x7f752c007c10).stop 2021-10-20T23:29:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 shutdown_connections 2021-10-20T23:29:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f751c0534f0 0x7f751c0559b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75340b22a0 0x7f7534156e00 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75340b1ec0 0x7f75340aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 --2- 172.21.15.12:0/4122349314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f75340b12d0 0x7f75340b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 >> 172.21.15.12:0/4122349314 conn(0x7f753405f6b0 msgr2=0x7f753405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 shutdown_connections 2021-10-20T23:29:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:31.915+0000 7f753b33a700 1 -- 172.21.15.12:0/4122349314 wait complete. 2021-10-20T23:29:31.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-20T23:29:32.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.027+0000 7fe66d3fd700 1 Processor -- start 2021-10-20T23:29:32.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.027+0000 7fe66d3fd700 1 -- start start 2021-10-20T23:29:32.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.027+0000 7fe66d3fd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6680af3c0 0x7fe6680b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.027+0000 7fe66d3fd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6680601a0 0x7fe668144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.027+0000 7fe66d3fd700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6680aa4a0 con 0x7fe668144940 2021-10-20T23:29:32.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.027+0000 7fe66d3fd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6680b1450 con 0x7fe6680af3c0 2021-10-20T23:29:32.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.027+0000 7fe66d3fd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680af7a0 con 0x7fe6680601a0 2021-10-20T23:29:32.045 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66cbfc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe668144940 0x7fe6680a8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44412/0 (socket says 172.21.15.12:44412) 2021-10-20T23:29:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66cbfc700 1 -- 172.21.15.12:0/4230454539 learned_addr learned my addr 172.21.15.12:0/4230454539 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe65ffff700 1 --2- 172.21.15.12:0/4230454539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6680601a0 0x7fe668144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe667fff700 1 --2- 172.21.15.12:0/4230454539 >> v2:172.21.15.31:3300/0 conn(0x7fe6680af3c0 0x7fe6680b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe6677fe700 1 -- 172.21.15.12:0/4230454539 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578247052 0 0) 0x7fe6680aa4a0 con 0x7fe668144940 2021-10-20T23:29:32.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe6677fe700 1 -- 172.21.15.12:0/4230454539 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe648003260 con 0x7fe668144940 2021-10-20T23:29:32.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe65ffff700 1 -- 172.21.15.12:0/4230454539 >> v2:172.21.15.31:3300/0 conn(0x7fe6680af3c0 msgr2=0x7fe6680b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:32.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe65ffff700 1 --2- 172.21.15.12:0/4230454539 >> v2:172.21.15.31:3300/0 conn(0x7fe6680af3c0 0x7fe6680b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe65ffff700 1 -- 172.21.15.12:0/4230454539 >> v1:172.21.15.12:6789/0 conn(0x7fe668144940 legacy=0x7fe6680a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe65ffff700 1 -- 172.21.15.12:0/4230454539 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66805fb80 con 0x7fe6680601a0 2021-10-20T23:29:32.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe65ffff700 1 --2- 172.21.15.12:0/4230454539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6680601a0 0x7fe668144450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fe650002f70 tx=0x7fe650006df0).ready entity=mon.2 client_cookie=5bf9ba76e09c3057 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe6677fe700 1 -- 172.21.15.12:0/4230454539 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe65000d4a0 con 0x7fe6680601a0 2021-10-20T23:29:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe6677fe700 1 -- 172.21.15.12:0/4230454539 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650000e90 con 0x7fe6680601a0 2021-10-20T23:29:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe6677fe700 1 -- 172.21.15.12:0/4230454539 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe65000d7f0 con 0x7fe6680601a0 2021-10-20T23:29:32.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66d3fd700 1 -- 172.21.15.12:0/4230454539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6680601a0 msgr2=0x7fe668144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66d3fd700 1 --2- 172.21.15.12:0/4230454539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6680601a0 0x7fe668144450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fe650002f70 tx=0x7fe650006df0).stop 2021-10-20T23:29:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66d3fd700 1 -- 172.21.15.12:0/4230454539 shutdown_connections 2021-10-20T23:29:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66d3fd700 1 --2- 172.21.15.12:0/4230454539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6680601a0 0x7fe668144450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66d3fd700 1 --2- 172.21.15.12:0/4230454539 >> v2:172.21.15.31:3300/0 conn(0x7fe6680af3c0 0x7fe6680b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66d3fd700 1 -- 172.21.15.12:0/4230454539 >> 172.21.15.12:0/4230454539 conn(0x7fe668061140 msgr2=0x7fe668062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:32.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66d3fd700 1 -- 172.21.15.12:0/4230454539 shutdown_connections 2021-10-20T23:29:32.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.031+0000 7fe66d3fd700 1 -- 172.21.15.12:0/4230454539 wait complete. 2021-10-20T23:29:32.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 Processor -- start 2021-10-20T23:29:32.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 -- start start 2021-10-20T23:29:32.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6680601a0 0x7fe668143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6680af3c0 0x7fe6680a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe668144940 0x7fe6680a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66809f250 con 0x7fe6680601a0 2021-10-20T23:29:32.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66809f4f0 con 0x7fe6680af3c0 2021-10-20T23:29:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680a04a0 con 0x7fe668144940 2021-10-20T23:29:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe667fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6680601a0 0x7fe668143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe667fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6680601a0 0x7fe668143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45820/0 (socket says 172.21.15.12:45820) 2021-10-20T23:29:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe667fff700 1 -- 172.21.15.12:0/3663005369 learned_addr learned my addr 172.21.15.12:0/3663005369 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe65ffff700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6680af3c0 0x7fe6680a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66cbfc700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe668144940 0x7fe6680a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe667fff700 1 -- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe668144940 msgr2=0x7fe6680a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe667fff700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe668144940 0x7fe6680a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe667fff700 1 -- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6680af3c0 msgr2=0x7fe6680a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe667fff700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6680af3c0 0x7fe6680a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe667fff700 1 -- 172.21.15.12:0/3663005369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65000b180 con 0x7fe6680601a0 2021-10-20T23:29:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe667fff700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6680601a0 0x7fe668143530 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fe65800c000 tx=0x7fe658006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe665ffb700 1 -- 172.21.15.12:0/3663005369 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe658010780 con 0x7fe6680601a0 2021-10-20T23:29:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe665ffb700 1 -- 172.21.15.12:0/3663005369 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6580108e0 con 0x7fe6680601a0 2021-10-20T23:29:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66805f6b0 con 0x7fe6680601a0 2021-10-20T23:29:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe665ffb700 1 -- 172.21.15.12:0/3663005369 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe658010c40 con 0x7fe6680601a0 2021-10-20T23:29:32.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.035+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe668143da0 con 0x7fe6680601a0 2021-10-20T23:29:32.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.039+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66805f8e0 con 0x7fe6680601a0 2021-10-20T23:29:32.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.039+0000 7fe665ffb700 1 -- 172.21.15.12:0/3663005369 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe65801c460 con 0x7fe6680601a0 2021-10-20T23:29:32.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.039+0000 7fe665ffb700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe64c053610 0x7fe64c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.039+0000 7fe665ffb700 1 -- 172.21.15.12:0/3663005369 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fe65806bb90 con 0x7fe6680601a0 2021-10-20T23:29:32.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.039+0000 7fe65ffff700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe64c053610 0x7fe64c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.039+0000 7fe65ffff700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe64c053610 0x7fe64c055ad0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fe65001a000 tx=0x7fe650014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:32.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.043+0000 7fe665ffb700 1 -- 172.21.15.12:0/3663005369 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe658042dd0 con 0x7fe6680601a0 2021-10-20T23:29:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.171+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe668057350 con 0x7fe6680601a0 2021-10-20T23:29:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe665ffb700 1 -- 172.21.15.12:0/3663005369 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v157) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe6580463f0 con 0x7fe6680601a0 2021-10-20T23:29:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:32.184 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2021-10-20T23:29:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2021-10-20T23:29:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "device_health_metrics" 2021-10-20T23:29:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2021-10-20T23:29:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2021-10-20T23:29:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:32.186 INFO:teuthology.orchestra.run.smithi012.stdout:] 2021-10-20T23:29:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe64c053610 msgr2=0x7fe64c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe64c053610 0x7fe64c055ad0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fe65001a000 tx=0x7fe650014000).stop 2021-10-20T23:29:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6680601a0 msgr2=0x7fe668143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6680601a0 0x7fe668143530 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fe65800c000 tx=0x7fe658006df0).stop 2021-10-20T23:29:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 shutdown_connections 2021-10-20T23:29:32.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe64c053610 0x7fe64c055ad0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe668144940 0x7fe6680a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6680af3c0 0x7fe6680a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 --2- 172.21.15.12:0/3663005369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6680601a0 0x7fe668143530 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 >> 172.21.15.12:0/3663005369 conn(0x7fe668061140 msgr2=0x7fe6680aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:32.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 shutdown_connections 2021-10-20T23:29:32.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.175+0000 7fe66d3fd700 1 -- 172.21.15.12:0/3663005369 wait complete. 2021-10-20T23:29:32.197 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-20T23:29:32.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-20T23:29:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.291+0000 7fa895954700 1 Processor -- start 2021-10-20T23:29:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa895954700 1 -- start start 2021-10-20T23:29:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa895954700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8901435d0 0x7fa8900aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa895954700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa890140b00 0x7fa8900b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa895954700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8900abf80 con 0x7fa890061030 2021-10-20T23:29:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa895954700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa890140f80 con 0x7fa890140b00 2021-10-20T23:29:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa895954700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900ac1b0 con 0x7fa8901435d0 2021-10-20T23:29:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88e7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa890061030 0x7fa8901403f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44426/0 (socket says 172.21.15.12:44426) 2021-10-20T23:29:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88e7fc700 1 -- 172.21.15.12:0/1179633719 learned_addr learned my addr 172.21.15.12:0/1179633719 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88f7fe700 1 --2- 172.21.15.12:0/1179633719 >> v2:172.21.15.31:3300/0 conn(0x7fa890140b00 0x7fa8900b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88effd700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8901435d0 0x7fa8900aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184685914 0 0) 0x7fa8900abf80 con 0x7fa890061030 2021-10-20T23:29:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa874003260 con 0x7fa890061030 2021-10-20T23:29:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405737956 0 0) 0x7fa874003260 con 0x7fa890061030 2021-10-20T23:29:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8901435d0 msgr2=0x7fa8900aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8901435d0 0x7fa8900aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 >> v2:172.21.15.31:3300/0 conn(0x7fa890140b00 msgr2=0x7fa8900b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 --2- 172.21.15.12:0/1179633719 >> v2:172.21.15.31:3300/0 conn(0x7fa890140b00 0x7fa8900b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890143c80 con 0x7fa890061030 2021-10-20T23:29:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7fa8800019e0 con 0x7fa890061030 2021-10-20T23:29:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 >> v1:172.21.15.12:6789/0 conn(0x7fa890061030 legacy=0x7fa8901403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874003750 0x7fa874003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874004500 0x7fa874004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8901435d0 0x7fa874004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890140f80 con 0x7fa874004500 2021-10-20T23:29:32.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900ac1b0 con 0x7fa874003750 2021-10-20T23:29:32.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87400b750 con 0x7fa8901435d0 2021-10-20T23:29:32.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88e7fc700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874004500 0x7fa874004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88f7fe700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8901435d0 0x7fa874004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88effd700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874003750 0x7fa874003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88e7fc700 1 -- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8901435d0 msgr2=0x7fa874004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:32.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88e7fc700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8901435d0 0x7fa874004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88e7fc700 1 -- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874003750 msgr2=0x7fa874003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:32.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88e7fc700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874003750 0x7fa874003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88e7fc700 1 -- 172.21.15.12:0/1179633719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874003260 con 0x7fa874004500 2021-10-20T23:29:32.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88effd700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874003750 0x7fa874003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:32.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88e7fc700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874004500 0x7fa874004980 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fa8800016f0 tx=0x7fa8900addd0).ready entity=mon.0 client_cookie=9d60064020f73d1e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:32.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa88000cda0 con 0x7fa874004500 2021-10-20T23:29:32.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa880005990 con 0x7fa874004500 2021-10-20T23:29:32.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.295+0000 7fa88dffb700 1 -- 172.21.15.12:0/1179633719 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa880005cf0 con 0x7fa874004500 2021-10-20T23:29:32.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.299+0000 7fa895954700 1 -- 172.21.15.12:0/1179633719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874004500 msgr2=0x7fa874004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.299+0000 7fa895954700 1 --2- 172.21.15.12:0/1179633719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874004500 0x7fa874004980 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fa8800016f0 tx=0x7fa8900addd0).stop 2021-10-20T23:29:32.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.299+0000 7fa88f7fe700 1 -- 172.21.15.12:0/1179633719 reap_dead start 2021-10-20T23:29:32.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.299+0000 7fa895954700 1 -- 172.21.15.12:0/1179633719 shutdown_connections 2021-10-20T23:29:32.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.299+0000 7fa895954700 1 -- 172.21.15.12:0/1179633719 >> 172.21.15.12:0/1179633719 conn(0x7fa8900b5570 msgr2=0x7fa8900b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:32.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.299+0000 7fa895954700 1 -- 172.21.15.12:0/1179633719 shutdown_connections 2021-10-20T23:29:32.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.299+0000 7fa895954700 1 -- 172.21.15.12:0/1179633719 wait complete. 2021-10-20T23:29:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.299+0000 7fa895954700 1 Processor -- start 2021-10-20T23:29:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.299+0000 7fa895954700 1 -- start start 2021-10-20T23:29:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa895954700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874004500 0x7fa8901490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa895954700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa890145550 0x7fa8901459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa895954700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa890155ab0 0x7fa890155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa895954700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890145ec0 con 0x7fa890145550 2021-10-20T23:29:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa895954700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890146a40 con 0x7fa874004500 2021-10-20T23:29:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa895954700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa890144c50 con 0x7fa890155ab0 2021-10-20T23:29:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa890145550 0x7fa8901459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa890145550 0x7fa8901459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45842/0 (socket says 172.21.15.12:45842) 2021-10-20T23:29:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88e7fc700 1 -- 172.21.15.12:0/3781862740 learned_addr learned my addr 172.21.15.12:0/3781862740 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88effd700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874004500 0x7fa8901490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88f7fe700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa890155ab0 0x7fa890155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88e7fc700 1 -- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa890155ab0 msgr2=0x7fa890155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88e7fc700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa890155ab0 0x7fa890155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88e7fc700 1 -- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874004500 msgr2=0x7fa8901490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88e7fc700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874004500 0x7fa8901490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:32.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88e7fc700 1 -- 172.21.15.12:0/3781862740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890146c70 con 0x7fa890145550 2021-10-20T23:29:32.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa88e7fc700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa890145550 0x7fa8901459d0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fa8901488e0 tx=0x7fa880013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:32.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa87ffff700 1 -- 172.21.15.12:0/3781862740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa880001e50 con 0x7fa890145550 2021-10-20T23:29:32.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa87ffff700 1 -- 172.21.15.12:0/3781862740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000c980 con 0x7fa890145550 2021-10-20T23:29:32.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa890146f10 con 0x7fa890145550 2021-10-20T23:29:32.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa87ffff700 1 -- 172.21.15.12:0/3781862740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8800074d0 con 0x7fa890145550 2021-10-20T23:29:32.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.303+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa890147450 con 0x7fa890145550 2021-10-20T23:29:32.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.307+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa890147610 con 0x7fa890145550 2021-10-20T23:29:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.307+0000 7fa87ffff700 1 -- 172.21.15.12:0/3781862740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa880027070 con 0x7fa890145550 2021-10-20T23:29:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.307+0000 7fa87ffff700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa86c053610 0x7fa86c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.307+0000 7fa87ffff700 1 -- 172.21.15.12:0/3781862740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa88006bea0 con 0x7fa890145550 2021-10-20T23:29:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.307+0000 7fa88effd700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa86c053610 0x7fa86c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.307+0000 7fa88effd700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa86c053610 0x7fa86c055ad0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fa88400b000 tx=0x7fa884008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.311+0000 7fa87ffff700 1 -- 172.21.15.12:0/3781862740 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8800431e0 con 0x7fa890145550 2021-10-20T23:29:32.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:32.439+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fa890143f20 con 0x7fa890145550 2021-10-20T23:29:33.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.095+0000 7fa87ffff700 1 -- 172.21.15.12:0/3781862740 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v158) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa880046800 con 0x7fa890145550 2021-10-20T23:29:33.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa86c053610 msgr2=0x7fa86c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa86c053610 0x7fa86c055ad0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fa88400b000 tx=0x7fa884008040).stop 2021-10-20T23:29:33.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa890145550 msgr2=0x7fa8901459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.109 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa890145550 0x7fa8901459d0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fa8901488e0 tx=0x7fa880013000).stop 2021-10-20T23:29:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 shutdown_connections 2021-10-20T23:29:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa86c053610 0x7fa86c055ad0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa890155ab0 0x7fa890155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa890145550 0x7fa8901459d0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 --2- 172.21.15.12:0/3781862740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa874004500 0x7fa8901490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 >> 172.21.15.12:0/3781862740 conn(0x7fa8900b5570 msgr2=0x7fa890141f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 shutdown_connections 2021-10-20T23:29:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.099+0000 7fa895954700 1 -- 172.21.15.12:0/3781862740 wait complete. 2021-10-20T23:29:33.113 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2021-10-20T23:29:33.125 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-20T23:29:33.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.231+0000 7f16b7fff700 1 Processor -- start 2021-10-20T23:29:33.242 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.231+0000 7f16b7fff700 1 -- start start 2021-10-20T23:29:33.244 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.231+0000 7f16b7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b813e740 0x7f16b8141080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.231+0000 7f16b7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16b80b0ff0 0x7f16b8141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.231+0000 7f16b7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b80aaa90 con 0x7f16b80b2720 2021-10-20T23:29:33.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.231+0000 7f16b7fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b8140c90 con 0x7f16b80b0ff0 2021-10-20T23:29:33.245 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.231+0000 7f16b7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b80b2b00 con 0x7f16b813e740 2021-10-20T23:29:33.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.231+0000 7f16b6ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f16b80b2720 0x7f16b813e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44442/0 (socket says 172.21.15.12:44442) 2021-10-20T23:29:33.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.231+0000 7f16b6ffd700 1 -- 172.21.15.12:0/1524379657 learned_addr learned my addr 172.21.15.12:0/1524379657 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:33.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b77fe700 1 --2- 172.21.15.12:0/1524379657 >> v2:172.21.15.31:3300/0 conn(0x7f16b80b0ff0 0x7f16b8141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b67fc700 1 --2- 172.21.15.12:0/1524379657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b813e740 0x7f16b8141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.246 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b5ffb700 1 -- 172.21.15.12:0/1524379657 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774744413 0 0) 0x7f16ac001110 con 0x7f16b80b2720 2021-10-20T23:29:33.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b5ffb700 1 -- 172.21.15.12:0/1524379657 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f169c003260 con 0x7f16b80b2720 2021-10-20T23:29:33.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b77fe700 1 -- 172.21.15.12:0/1524379657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b813e740 msgr2=0x7f16b8141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:33.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b77fe700 1 --2- 172.21.15.12:0/1524379657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b813e740 0x7f16b8141080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.247 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b5ffb700 1 -- 172.21.15.12:0/1524379657 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832123944 0 0) 0x7f169c003260 con 0x7f16b80b2720 2021-10-20T23:29:33.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b77fe700 1 -- 172.21.15.12:0/1524379657 >> v1:172.21.15.12:6789/0 conn(0x7f16b80b2720 legacy=0x7f16b813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b77fe700 1 -- 172.21.15.12:0/1524379657 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80aa2b0 con 0x7f16b80b0ff0 2021-10-20T23:29:33.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b77fe700 1 --2- 172.21.15.12:0/1524379657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b80b0ff0 0x7f16b8141570 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f16ac001990 tx=0x7f16b00091d0).ready entity=mon.1 client_cookie=3bfaebd2bd37f21 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:33.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b5ffb700 1 -- 172.21.15.12:0/1524379657 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16ac0017f0 con 0x7f16b80b0ff0 2021-10-20T23:29:33.248 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b5ffb700 1 -- 172.21.15.12:0/1524379657 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b000f510 con 0x7f16b80b0ff0 2021-10-20T23:29:33.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b5ffb700 1 -- 172.21.15.12:0/1524379657 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b000f680 con 0x7f16b80b0ff0 2021-10-20T23:29:33.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b7fff700 1 -- 172.21.15.12:0/1524379657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b80b0ff0 msgr2=0x7f16b8141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b7fff700 1 --2- 172.21.15.12:0/1524379657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b80b0ff0 0x7f16b8141570 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f16ac001990 tx=0x7f16b00091d0).stop 2021-10-20T23:29:33.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b7fff700 1 -- 172.21.15.12:0/1524379657 shutdown_connections 2021-10-20T23:29:33.251 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b7fff700 1 --2- 172.21.15.12:0/1524379657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b80b0ff0 0x7f16b8141570 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b7fff700 1 --2- 172.21.15.12:0/1524379657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b813e740 0x7f16b8141080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b7fff700 1 -- 172.21.15.12:0/1524379657 >> 172.21.15.12:0/1524379657 conn(0x7f16b8060180 msgr2=0x7f16b80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:33.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b7fff700 1 -- 172.21.15.12:0/1524379657 shutdown_connections 2021-10-20T23:29:33.252 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.235+0000 7f16b7fff700 1 -- 172.21.15.12:0/1524379657 wait complete. 2021-10-20T23:29:33.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b7fff700 1 Processor -- start 2021-10-20T23:29:33.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b7fff700 1 -- start start 2021-10-20T23:29:33.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80b0ff0 0x7f16b8142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b80b2720 0x7f16b80ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.253 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16b8135500 0x7f16b80b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b80ae080 con 0x7f16b8135500 2021-10-20T23:29:33.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b80ac920 con 0x7f16b80b2720 2021-10-20T23:29:33.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b7fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b80ac400 con 0x7f16b80b0ff0 2021-10-20T23:29:33.254 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b6ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80b0ff0 0x7f16b8142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16b8135500 0x7f16b80b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16b8135500 0x7f16b80b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45858/0 (socket says 172.21.15.12:45858) 2021-10-20T23:29:33.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b6ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80b0ff0 0x7f16b8142850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51612/0 (socket says 172.21.15.12:51612) 2021-10-20T23:29:33.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b77fe700 1 -- 172.21.15.12:0/2832500915 learned_addr learned my addr 172.21.15.12:0/2832500915 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:33.255 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.239+0000 7f16b67fc700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b80b2720 0x7f16b80ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16b77fe700 1 -- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80b0ff0 msgr2=0x7f16b8142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16b77fe700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80b0ff0 0x7f16b8142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16b77fe700 1 -- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b80b2720 msgr2=0x7f16b80ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16b77fe700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b80b2720 0x7f16b80ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16b77fe700 1 -- 172.21.15.12:0/2832500915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b0009470 con 0x7f16b8135500 2021-10-20T23:29:33.258 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16b77fe700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16b8135500 0x7f16b80b4100 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f16ac001990 tx=0x7f16b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:33.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16a7fff700 1 -- 172.21.15.12:0/2832500915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b00032d0 con 0x7f16b8135500 2021-10-20T23:29:33.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16a7fff700 1 -- 172.21.15.12:0/2832500915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b0011b80 con 0x7f16b8135500 2021-10-20T23:29:33.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b8135f80 con 0x7f16b8135500 2021-10-20T23:29:33.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16a7fff700 1 -- 172.21.15.12:0/2832500915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b0021440 con 0x7f16b8135500 2021-10-20T23:29:33.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b80af080 con 0x7f16b8135500 2021-10-20T23:29:33.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.243+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b8135b30 con 0x7f16b8135500 2021-10-20T23:29:33.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.247+0000 7f16a7fff700 1 -- 172.21.15.12:0/2832500915 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f16b0027020 con 0x7f16b8135500 2021-10-20T23:29:33.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.247+0000 7f16a7fff700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16940536a0 0x7f1694055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.247+0000 7f16a7fff700 1 -- 172.21.15.12:0/2832500915 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f16b006cab0 con 0x7f16b8135500 2021-10-20T23:29:33.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.247+0000 7f16b6ffd700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16940536a0 0x7f1694055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.247+0000 7f16b6ffd700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16940536a0 0x7f1694055b60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f16ac00d000 tx=0x7f16ac000ed0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:33.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.255+0000 7f16a7fff700 1 -- 172.21.15.12:0/2832500915 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f16b00476b0 con 0x7f16b8135500 2021-10-20T23:29:33.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.383+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f16b8135b30 con 0x7f16b8135500 2021-10-20T23:29:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.759+0000 7f16a7fff700 1 -- 172.21.15.12:0/2832500915 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v159) v1 ==== 125+0+0 (secure 0 0 0) 0x7f16b8135b30 con 0x7f16b8135500 2021-10-20T23:29:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16940536a0 msgr2=0x7f1694055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16940536a0 0x7f1694055b60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f16ac00d000 tx=0x7f16ac000ed0).stop 2021-10-20T23:29:33.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16b8135500 msgr2=0x7f16b80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16b8135500 0x7f16b80b4100 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f16ac001990 tx=0x7f16b0016000).stop 2021-10-20T23:29:33.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 shutdown_connections 2021-10-20T23:29:33.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f16940536a0 0x7f1694055b60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16b8135500 0x7f16b80b4100 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b80b2720 0x7f16b80ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 --2- 172.21.15.12:0/2832500915 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80b0ff0 0x7f16b8142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 >> 172.21.15.12:0/2832500915 conn(0x7f16b8060180 msgr2=0x7f16b805ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:33.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.767+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 shutdown_connections 2021-10-20T23:29:33.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.771+0000 7f16b7fff700 1 -- 172.21.15.12:0/2832500915 wait complete. 2021-10-20T23:29:33.781 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2021-10-20T23:29:33.794 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-20T23:29:33.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.887+0000 7f49eeec1700 1 Processor -- start 2021-10-20T23:29:33.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.887+0000 7f49eeec1700 1 -- start start 2021-10-20T23:29:33.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e80b7370 0x7f49e80b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49e80b3060 0x7f49e813e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80b2380 con 0x7f49e813e710 2021-10-20T23:29:33.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e8144250 con 0x7f49e80b3060 2021-10-20T23:29:33.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b3570 con 0x7f49e80b7370 2021-10-20T23:29:33.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ed6be700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49e80b3060 0x7f49e813e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ed6be700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49e80b3060 0x7f49e813e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45862/0 (socket says 172.21.15.12:45862) 2021-10-20T23:29:33.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ed6be700 1 -- 172.21.15.12:0/1846300950 learned_addr learned my addr 172.21.15.12:0/1846300950 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:33.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ee6c0700 1 --1- 172.21.15.12:0/1846300950 >> v1:172.21.15.12:6789/0 conn(0x7f49e813e710 0x7f49e8064ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44456/0 (socket says 172.21.15.12:44456) 2021-10-20T23:29:33.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49edebf700 1 --2- 172.21.15.12:0/1846300950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e80b7370 0x7f49e80b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ed6be700 1 -- 172.21.15.12:0/1846300950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e80b7370 msgr2=0x7f49e80b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:33.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ed6be700 1 --2- 172.21.15.12:0/1846300950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e80b7370 0x7f49e80b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ed6be700 1 -- 172.21.15.12:0/1846300950 >> v1:172.21.15.12:6789/0 conn(0x7f49e813e710 legacy=0x7f49e8064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ed6be700 1 -- 172.21.15.12:0/1846300950 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80b25b0 con 0x7f49e80b3060 2021-10-20T23:29:33.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ecebd700 1 -- 172.21.15.12:0/1846300950 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675625614 0 0) 0x7f49e80b2380 con 0x7f49e813e710 2021-10-20T23:29:33.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ed6be700 1 --2- 172.21.15.12:0/1846300950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b3060 0x7f49e813e220 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f49e4002f70 tx=0x7f49e4006eb0).ready entity=mon.0 client_cookie=42c3ff5b1854ac63 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:33.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ecebd700 1 -- 172.21.15.12:0/1846300950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e400d570 con 0x7f49e80b3060 2021-10-20T23:29:33.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ecebd700 1 -- 172.21.15.12:0/1846300950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4000e90 con 0x7f49e80b3060 2021-10-20T23:29:33.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49ecebd700 1 -- 172.21.15.12:0/1846300950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e400d8c0 con 0x7f49e80b3060 2021-10-20T23:29:33.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 -- 172.21.15.12:0/1846300950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b3060 msgr2=0x7f49e813e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 --2- 172.21.15.12:0/1846300950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b3060 0x7f49e813e220 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f49e4002f70 tx=0x7f49e4006eb0).stop 2021-10-20T23:29:33.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 -- 172.21.15.12:0/1846300950 shutdown_connections 2021-10-20T23:29:33.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 --2- 172.21.15.12:0/1846300950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b3060 0x7f49e813e220 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 --2- 172.21.15.12:0/1846300950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e80b7370 0x7f49e80b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 -- 172.21.15.12:0/1846300950 >> 172.21.15.12:0/1846300950 conn(0x7f49e805f6b0 msgr2=0x7f49e805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:33.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 -- 172.21.15.12:0/1846300950 shutdown_connections 2021-10-20T23:29:33.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.891+0000 7f49eeec1700 1 -- 172.21.15.12:0/1846300950 wait complete. 2021-10-20T23:29:33.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49eeec1700 1 Processor -- start 2021-10-20T23:29:33.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49eeec1700 1 -- start start 2021-10-20T23:29:33.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49eeec1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49e80b3060 0x7f49e81434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49eeec1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b7370 0x7f49e813c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49eeec1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e813e710 0x7f49e813cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49eeec1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8150d30 con 0x7f49e80b7370 2021-10-20T23:29:33.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49eeec1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b1900 con 0x7f49e80b3060 2021-10-20T23:29:33.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49eeec1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b1ba0 con 0x7f49e813e710 2021-10-20T23:29:33.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49ed6be700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b7370 0x7f49e813c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49ed6be700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b7370 0x7f49e813c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45868/0 (socket says 172.21.15.12:45868) 2021-10-20T23:29:33.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49ed6be700 1 -- 172.21.15.12:0/1417584034 learned_addr learned my addr 172.21.15.12:0/1417584034 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:33.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49edebf700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49e80b3060 0x7f49e81434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.895+0000 7f49ee6c0700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e813e710 0x7f49e813cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49ed6be700 1 -- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e813e710 msgr2=0x7f49e813cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49ed6be700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e813e710 0x7f49e813cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49ed6be700 1 -- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49e80b3060 msgr2=0x7f49e81434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:33.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49ed6be700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49e80b3060 0x7f49e81434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:33.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49ed6be700 1 -- 172.21.15.12:0/1417584034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e400b1e0 con 0x7f49e80b7370 2021-10-20T23:29:33.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49ed6be700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b7370 0x7f49e813c5d0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f49e4002f70 tx=0x7f49e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:33.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49daffd700 1 -- 172.21.15.12:0/1417584034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e400d8f0 con 0x7f49e80b7370 2021-10-20T23:29:33.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49daffd700 1 -- 172.21.15.12:0/1417584034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4011ce0 con 0x7f49e80b7370 2021-10-20T23:29:33.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e80b1e40 con 0x7f49e80b7370 2021-10-20T23:29:33.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49daffd700 1 -- 172.21.15.12:0/1417584034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e401e650 con 0x7f49e80b7370 2021-10-20T23:29:33.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e80adb70 con 0x7f49e80b7370 2021-10-20T23:29:33.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e80b1fd0 con 0x7f49e80b7370 2021-10-20T23:29:33.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49daffd700 1 -- 172.21.15.12:0/1417584034 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f49e4025030 con 0x7f49e80b7370 2021-10-20T23:29:33.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49daffd700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49c80534f0 0x7f49c80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:33.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49daffd700 1 -- 172.21.15.12:0/1417584034 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f49e406cd30 con 0x7f49e80b7370 2021-10-20T23:29:33.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.899+0000 7f49edebf700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49c80534f0 0x7f49c80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:33.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.903+0000 7f49edebf700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49c80534f0 0x7f49c80559b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f49dc006000 tx=0x7f49dc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:33.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:33.907+0000 7f49daffd700 1 -- 172.21.15.12:0/1417584034 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f49e4043ca0 con 0x7f49e80b7370 2021-10-20T23:29:34.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.075+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f49e8057350 con 0x7f49e80b7370 2021-10-20T23:29:34.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.087+0000 7f49daffd700 1 -- 172.21.15.12:0/1417584034 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v83) v1 ==== 189+0+0 (secure 0 0 0) 0x7f49e4023070 con 0x7f49e80b7370 2021-10-20T23:29:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49c80534f0 msgr2=0x7f49c80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49c80534f0 0x7f49c80559b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f49dc006000 tx=0x7f49dc008040).stop 2021-10-20T23:29:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b7370 msgr2=0x7f49e813c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b7370 0x7f49e813c5d0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f49e4002f70 tx=0x7f49e4015000).stop 2021-10-20T23:29:34.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 shutdown_connections 2021-10-20T23:29:34.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f49c80534f0 0x7f49c80559b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49e813e710 0x7f49e813cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e80b7370 0x7f49e813c5d0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 --2- 172.21.15.12:0/1417584034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49e80b3060 0x7f49e81434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 >> 172.21.15.12:0/1417584034 conn(0x7f49e805f6b0 msgr2=0x7f49e813db10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 shutdown_connections 2021-10-20T23:29:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.091+0000 7f49eeec1700 1 -- 172.21.15.12:0/1417584034 wait complete. 2021-10-20T23:29:34.105 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 29 and data pool 30 2021-10-20T23:29:34.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:34.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.203+0000 7fc6776b9700 1 Processor -- start 2021-10-20T23:29:34.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.203+0000 7fc6776b9700 1 -- start start 2021-10-20T23:29:34.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc67013a0a0 0x7fc6700acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6700ad070 con 0x7fc670139cc0 2021-10-20T23:29:34.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc670060d40 con 0x7fc6700b21c0 2021-10-20T23:29:34.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6700b2730 con 0x7fc67013a0a0 2021-10-20T23:29:34.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc675455700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc670139cc0 0x7fc6701434f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44476/0 (socket says 172.21.15.12:44476) 2021-10-20T23:29:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc675455700 1 -- 172.21.15.12:0/1043129740 learned_addr learned my addr 172.21.15.12:0/1043129740 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc675c56700 1 --2- 172.21.15.12:0/1043129740 >> v2:172.21.15.31:3300/0 conn(0x7fc67013a0a0 0x7fc6700acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc65ffff700 1 -- 172.21.15.12:0/1043129740 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994910681 0 0) 0x7fc66c001490 con 0x7fc670139cc0 2021-10-20T23:29:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc65ffff700 1 -- 172.21.15.12:0/1043129740 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc658003260 con 0x7fc670139cc0 2021-10-20T23:29:34.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc65ffff700 1 -- 172.21.15.12:0/1043129740 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235289839 0 0) 0x7fc670060d40 con 0x7fc6700b21c0 2021-10-20T23:29:34.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc65ffff700 1 -- 172.21.15.12:0/1043129740 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc66c001490 con 0x7fc6700b21c0 2021-10-20T23:29:34.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc65ffff700 1 -- 172.21.15.12:0/1043129740 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098045792 0 0) 0x7fc658003260 con 0x7fc670139cc0 2021-10-20T23:29:34.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc675c56700 1 -- 172.21.15.12:0/1043129740 >> v1:172.21.15.31:6789/0 conn(0x7fc6700b21c0 legacy=0x7fc6700b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc675c56700 1 -- 172.21.15.12:0/1043129740 >> v1:172.21.15.12:6789/0 conn(0x7fc670139cc0 legacy=0x7fc6701434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc675c56700 1 -- 172.21.15.12:0/1043129740 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6700b6cd0 con 0x7fc67013a0a0 2021-10-20T23:29:34.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc675c56700 1 --2- 172.21.15.12:0/1043129740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc67013a0a0 0x7fc6700acb80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fc66c001d10 tx=0x7fc668006df0).ready entity=mon.1 client_cookie=f44669762455aacf server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:34.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc65ffff700 1 -- 172.21.15.12:0/1043129740 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66c001b70 con 0x7fc67013a0a0 2021-10-20T23:29:34.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc65ffff700 1 -- 172.21.15.12:0/1043129740 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc668000e90 con 0x7fc67013a0a0 2021-10-20T23:29:34.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc65ffff700 1 -- 172.21.15.12:0/1043129740 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc668012460 con 0x7fc67013a0a0 2021-10-20T23:29:34.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 -- 172.21.15.12:0/1043129740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc67013a0a0 msgr2=0x7fc6700acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 --2- 172.21.15.12:0/1043129740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc67013a0a0 0x7fc6700acb80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fc66c001d10 tx=0x7fc668006df0).stop 2021-10-20T23:29:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 -- 172.21.15.12:0/1043129740 shutdown_connections 2021-10-20T23:29:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 --2- 172.21.15.12:0/1043129740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc67013a0a0 0x7fc6700acb80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 -- 172.21.15.12:0/1043129740 >> 172.21.15.12:0/1043129740 conn(0x7fc6700b3480 msgr2=0x7fc6700b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 -- 172.21.15.12:0/1043129740 shutdown_connections 2021-10-20T23:29:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.207+0000 7fc6776b9700 1 -- 172.21.15.12:0/1043129740 wait complete. 2021-10-20T23:29:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 Processor -- start 2021-10-20T23:29:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 -- start start 2021-10-20T23:29:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6700b21c0 0x7fc670140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc670139cc0 0x7fc670138070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67013a0a0 0x7fc670138560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700ae280 con 0x7fc67013a0a0 2021-10-20T23:29:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6701546a0 con 0x7fc670139cc0 2021-10-20T23:29:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6701541a0 con 0x7fc6700b21c0 2021-10-20T23:29:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675c56700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67013a0a0 0x7fc670138560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc674c54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc670139cc0 0x7fc670138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675c56700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67013a0a0 0x7fc670138560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45892/0 (socket says 172.21.15.12:45892) 2021-10-20T23:29:34.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675c56700 1 -- 172.21.15.12:0/2039768890 learned_addr learned my addr 172.21.15.12:0/2039768890 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:34.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675455700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6700b21c0 0x7fc670140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675c56700 1 -- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6700b21c0 msgr2=0x7fc670140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675c56700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6700b21c0 0x7fc670140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675c56700 1 -- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc670139cc0 msgr2=0x7fc670138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675c56700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc670139cc0 0x7fc670138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675c56700 1 -- 172.21.15.12:0/2039768890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66800b180 con 0x7fc67013a0a0 2021-10-20T23:29:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc675c56700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67013a0a0 0x7fc670138560 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fc66c001d10 tx=0x7fc668014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc65e7fc700 1 -- 172.21.15.12:0/2039768890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66800d8a0 con 0x7fc67013a0a0 2021-10-20T23:29:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc65e7fc700 1 -- 172.21.15.12:0/2039768890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66800da00 con 0x7fc67013a0a0 2021-10-20T23:29:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6700ae4b0 con 0x7fc67013a0a0 2021-10-20T23:29:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc65e7fc700 1 -- 172.21.15.12:0/2039768890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66800dd60 con 0x7fc67013a0a0 2021-10-20T23:29:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.211+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc670140b30 con 0x7fc67013a0a0 2021-10-20T23:29:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.215+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc670138bf0 con 0x7fc67013a0a0 2021-10-20T23:29:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.215+0000 7fc65e7fc700 1 -- 172.21.15.12:0/2039768890 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc668025030 con 0x7fc67013a0a0 2021-10-20T23:29:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.215+0000 7fc65e7fc700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6500535b0 0x7fc650055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.215+0000 7fc65e7fc700 1 -- 172.21.15.12:0/2039768890 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc66806c660 con 0x7fc67013a0a0 2021-10-20T23:29:34.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.215+0000 7fc675455700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6500535b0 0x7fc650055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.238 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.215+0000 7fc675455700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6500535b0 0x7fc650055a70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fc66c00d000 tx=0x7fc66c001c70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:34.240 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.223+0000 7fc65e7fc700 1 -- 172.21.15.12:0/2039768890 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc668043720 con 0x7fc67013a0a0 2021-10-20T23:29:34.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.347+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6700adb10 con 0x7fc67013a0a0 2021-10-20T23:29:34.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc65e7fc700 1 -- 172.21.15.12:0/2039768890 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fc668023020 con 0x7fc67013a0a0 2021-10-20T23:29:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:34.362 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":161,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:34.080712+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:32.496339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:33.438412+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:34.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6500535b0 msgr2=0x7fc650055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc6776b9700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6500535b0 0x7fc650055a70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fc66c00d000 tx=0x7fc66c001c70).stop 2021-10-20T23:29:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67013a0a0 msgr2=0x7fc670138560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc6776b9700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67013a0a0 0x7fc670138560 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fc66c001d10 tx=0x7fc668014000).stop 2021-10-20T23:29:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 shutdown_connections 2021-10-20T23:29:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc6776b9700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc6500535b0 0x7fc650055a70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc6776b9700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67013a0a0 0x7fc670138560 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc6776b9700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc670139cc0 0x7fc670138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.351+0000 7fc6776b9700 1 --2- 172.21.15.12:0/2039768890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6700b21c0 0x7fc670140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.355+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 >> 172.21.15.12:0/2039768890 conn(0x7fc6700b3480 msgr2=0x7fc670139150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:34.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.355+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 shutdown_connections 2021-10-20T23:29:34.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.355+0000 7fc6776b9700 1 -- 172.21.15.12:0/2039768890 wait complete. 2021-10-20T23:29:34.375 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:34.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff171245700 1 Processor -- start 2021-10-20T23:29:34.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff171245700 1 -- start start 2021-10-20T23:29:34.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff171245700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff16c0a9c10 0x7ff16c1483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.482 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff171245700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16c0b33e0 con 0x7ff16c0b18f0 2021-10-20T23:29:34.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff171245700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16c0b0c70 con 0x7ff16c0b3000 2021-10-20T23:29:34.483 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff171245700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16c0b0f10 con 0x7ff16c0a9c10 2021-10-20T23:29:34.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff170a44700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff16c0a9c10 0x7ff16c1483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff16b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff16c0b18f0 0x7ff16c147ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44490/0 (socket says 172.21.15.12:44490) 2021-10-20T23:29:34.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff16b7fe700 1 -- 172.21.15.12:0/3505028009 learned_addr learned my addr 172.21.15.12:0/3505028009 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:34.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff170a44700 1 -- 172.21.15.12:0/3505028009 >> v1:172.21.15.31:6789/0 conn(0x7ff16c0b3000 legacy=0x7ff16c065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff16affd700 1 -- 172.21.15.12:0/3505028009 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380874065 0 0) 0x7ff16c0b33e0 con 0x7ff16c0b18f0 2021-10-20T23:29:34.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff170a44700 1 -- 172.21.15.12:0/3505028009 >> v1:172.21.15.12:6789/0 conn(0x7ff16c0b18f0 legacy=0x7ff16c147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff170a44700 1 -- 172.21.15.12:0/3505028009 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c0b11b0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff170a44700 1 --2- 172.21.15.12:0/3505028009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 0x7ff16c1483b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7ff1640032f0 tx=0x7ff1640091d0).ready entity=mon.0 client_cookie=105bd6c5b9737805 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:34.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff16affd700 1 -- 172.21.15.12:0/3505028009 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff164009ea0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff16affd700 1 -- 172.21.15.12:0/3505028009 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16400b8a0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.471+0000 7ff16affd700 1 -- 172.21.15.12:0/3505028009 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff16400ba10 con 0x7ff16c0a9c10 2021-10-20T23:29:34.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.475+0000 7ff171245700 1 -- 172.21.15.12:0/3505028009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 msgr2=0x7ff16c1483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.475+0000 7ff171245700 1 --2- 172.21.15.12:0/3505028009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 0x7ff16c1483b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7ff1640032f0 tx=0x7ff1640091d0).stop 2021-10-20T23:29:34.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.475+0000 7ff171245700 1 -- 172.21.15.12:0/3505028009 shutdown_connections 2021-10-20T23:29:34.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.475+0000 7ff171245700 1 --2- 172.21.15.12:0/3505028009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 0x7ff16c1483b0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.475+0000 7ff171245700 1 -- 172.21.15.12:0/3505028009 >> 172.21.15.12:0/3505028009 conn(0x7ff16c0636e0 msgr2=0x7ff16c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:34.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.475+0000 7ff171245700 1 -- 172.21.15.12:0/3505028009 shutdown_connections 2021-10-20T23:29:34.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.475+0000 7ff171245700 1 -- 172.21.15.12:0/3505028009 wait complete. 2021-10-20T23:29:34.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.475+0000 7ff171245700 1 Processor -- start 2021-10-20T23:29:34.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.475+0000 7ff171245700 1 -- start start 2021-10-20T23:29:34.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff171245700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 0x7ff16c149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff171245700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0b18f0 0x7ff16c156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff171245700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff16c0b3000 0x7ff16c156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff171245700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0b5d10 con 0x7ff16c0a9c10 2021-10-20T23:29:34.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff171245700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0ae550 con 0x7ff16c0b18f0 2021-10-20T23:29:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff171245700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0ae780 con 0x7ff16c0b3000 2021-10-20T23:29:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 0x7ff16c149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 0x7ff16c149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45902/0 (socket says 172.21.15.12:45902) 2021-10-20T23:29:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16bfff700 1 -- 172.21.15.12:0/2047358665 learned_addr learned my addr 172.21.15.12:0/2047358665 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff170a44700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff16c0b3000 0x7ff16c156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16b7fe700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0b18f0 0x7ff16c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16bfff700 1 -- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff16c0b3000 msgr2=0x7ff16c156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16bfff700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff16c0b3000 0x7ff16c156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16bfff700 1 -- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0b18f0 msgr2=0x7ff16c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16bfff700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0b18f0 0x7ff16c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16bfff700 1 -- 172.21.15.12:0/2047358665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff164009470 con 0x7ff16c0a9c10 2021-10-20T23:29:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff16bfff700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 0x7ff16c149c20 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7ff16c067e80 tx=0x7ff15c007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff1697fa700 1 -- 172.21.15.12:0/2047358665 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff15c013450 con 0x7ff16c0a9c10 2021-10-20T23:29:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff1697fa700 1 -- 172.21.15.12:0/2047358665 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c0135b0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16c0adbb0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff1697fa700 1 -- 172.21.15.12:0/2047358665 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff15c013910 con 0x7ff16c0a9c10 2021-10-20T23:29:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16c0ac8b0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.479+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16c057350 con 0x7ff16c0a9c10 2021-10-20T23:29:34.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.483+0000 7ff1697fa700 1 -- 172.21.15.12:0/2047358665 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff15c010070 con 0x7ff16c0a9c10 2021-10-20T23:29:34.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.483+0000 7ff1697fa700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1500536a0 0x7ff150055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.483+0000 7ff1697fa700 1 -- 172.21.15.12:0/2047358665 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff15c06b1b0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.483+0000 7ff16b7fe700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1500536a0 0x7ff150055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.483+0000 7ff16b7fe700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1500536a0 0x7ff150055b60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7ff15400d000 tx=0x7ff1540011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:34.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.491+0000 7ff1697fa700 1 -- 172.21.15.12:0/2047358665 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff15c0420a0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.626 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.615+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff16c0698e0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.615+0000 7ff1697fa700 1 -- 172.21.15.12:0/2047358665 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+16298 (secure 0 0 0) 0x7ff15c0456c0 con 0x7ff16c0a9c10 2021-10-20T23:29:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:34.629 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":161,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:34.080712+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:32.496339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:33.438412+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:34.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1500536a0 msgr2=0x7ff150055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1500536a0 0x7ff150055b60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7ff15400d000 tx=0x7ff1540011a0).stop 2021-10-20T23:29:34.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 msgr2=0x7ff16c149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 0x7ff16c149c20 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7ff16c067e80 tx=0x7ff15c007c20).stop 2021-10-20T23:29:34.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 shutdown_connections 2021-10-20T23:29:34.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ff1500536a0 0x7ff150055b60 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff16c0b3000 0x7ff16c156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0b18f0 0x7ff16c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 --2- 172.21.15.12:0/2047358665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff16c0a9c10 0x7ff16c149c20 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 >> 172.21.15.12:0/2047358665 conn(0x7ff16c0636e0 msgr2=0x7ff16c05f980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:34.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 shutdown_connections 2021-10-20T23:29:34.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.619+0000 7ff171245700 1 -- 172.21.15.12:0/2047358665 wait complete. 2021-10-20T23:29:34.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-20T23:29:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.747+0000 7fdb5dc42700 1 Processor -- start 2021-10-20T23:29:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.747+0000 7fdb5dc42700 1 -- start start 2021-10-20T23:29:34.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.747+0000 7fdb5dc42700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb580ad5c0 0x7fdb58061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.747+0000 7fdb5dc42700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580aecf0 con 0x7fdb58140440 2021-10-20T23:29:34.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.747+0000 7fdb5dc42700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580b6f20 con 0x7fdb58061320 2021-10-20T23:29:34.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.747+0000 7fdb5dc42700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb580aef20 con 0x7fdb580ad5c0 2021-10-20T23:29:34.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5d441700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdb58140440 0x7fdb58146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44508/0 (socket says 172.21.15.12:44508) 2021-10-20T23:29:34.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5d441700 1 -- 172.21.15.12:0/3138446588 learned_addr learned my addr 172.21.15.12:0/3138446588 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:34.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4ffff700 1 --2- 172.21.15.12:0/3138446588 >> v2:172.21.15.31:3300/0 conn(0x7fdb580ad5c0 0x7fdb58061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4f7fe700 1 -- 172.21.15.12:0/3138446588 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20252169 0 0) 0x7fdb580aecf0 con 0x7fdb58140440 2021-10-20T23:29:34.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4f7fe700 1 -- 172.21.15.12:0/3138446588 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb44003260 con 0x7fdb58140440 2021-10-20T23:29:34.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4ffff700 1 -- 172.21.15.12:0/3138446588 >> v1:172.21.15.31:6789/0 conn(0x7fdb58061320 legacy=0x7fdb580b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.763 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4ffff700 1 -- 172.21.15.12:0/3138446588 >> v1:172.21.15.12:6789/0 conn(0x7fdb58140440 legacy=0x7fdb58146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4ffff700 1 -- 172.21.15.12:0/3138446588 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580af1c0 con 0x7fdb580ad5c0 2021-10-20T23:29:34.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4ffff700 1 --2- 172.21.15.12:0/3138446588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 0x7fdb58061700 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fdb48002f70 tx=0x7fdb48006df0).ready entity=mon.1 client_cookie=6d1c8a98252d901a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:34.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4f7fe700 1 -- 172.21.15.12:0/3138446588 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb4800d610 con 0x7fdb580ad5c0 2021-10-20T23:29:34.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4f7fe700 1 -- 172.21.15.12:0/3138446588 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48000e90 con 0x7fdb580ad5c0 2021-10-20T23:29:34.764 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4f7fe700 1 -- 172.21.15.12:0/3138446588 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb4800d960 con 0x7fdb580ad5c0 2021-10-20T23:29:34.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 -- 172.21.15.12:0/3138446588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 msgr2=0x7fdb58061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 --2- 172.21.15.12:0/3138446588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 0x7fdb58061700 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fdb48002f70 tx=0x7fdb48006df0).stop 2021-10-20T23:29:34.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 -- 172.21.15.12:0/3138446588 shutdown_connections 2021-10-20T23:29:34.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 --2- 172.21.15.12:0/3138446588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 0x7fdb58061700 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 -- 172.21.15.12:0/3138446588 >> 172.21.15.12:0/3138446588 conn(0x7fdb58066de0 msgr2=0x7fdb580671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:34.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 -- 172.21.15.12:0/3138446588 shutdown_connections 2021-10-20T23:29:34.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 -- 172.21.15.12:0/3138446588 wait complete. 2021-10-20T23:29:34.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 Processor -- start 2021-10-20T23:29:34.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 -- start start 2021-10-20T23:29:34.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58061320 0x7fdb580b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 0x7fdb58156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb58140440 0x7fdb58156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580afd50 con 0x7fdb58061320 2021-10-20T23:29:34.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580b0c40 con 0x7fdb580ad5c0 2021-10-20T23:29:34.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5dc42700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580b0ee0 con 0x7fdb58140440 2021-10-20T23:29:34.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5cc40700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58061320 0x7fdb580b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5cc40700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58061320 0x7fdb580b8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45916/0 (socket says 172.21.15.12:45916) 2021-10-20T23:29:34.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb5cc40700 1 -- 172.21.15.12:0/2112185181 learned_addr learned my addr 172.21.15.12:0/2112185181 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:34.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.751+0000 7fdb4ffff700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 0x7fdb58156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5d441700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb58140440 0x7fdb58156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5cc40700 1 -- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb58140440 msgr2=0x7fdb58156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.778 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5cc40700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb58140440 0x7fdb58156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5cc40700 1 -- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 msgr2=0x7fdb58156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:34.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5cc40700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 0x7fdb58156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:34.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5cc40700 1 -- 172.21.15.12:0/2112185181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4800b180 con 0x7fdb58061320 2021-10-20T23:29:34.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb4ffff700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 0x7fdb58156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:34.779 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5d441700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb58140440 0x7fdb58156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:34.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5cc40700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58061320 0x7fdb580b8ac0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7fdb580af7e0 tx=0x7fdb54007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:34.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb4dffb700 1 -- 172.21.15.12:0/2112185181 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb54012400 con 0x7fdb58061320 2021-10-20T23:29:34.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb4dffb700 1 -- 172.21.15.12:0/2112185181 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54012560 con 0x7fdb58061320 2021-10-20T23:29:34.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58155cb0 con 0x7fdb58061320 2021-10-20T23:29:34.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb4dffb700 1 -- 172.21.15.12:0/2112185181 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb540128c0 con 0x7fdb58061320 2021-10-20T23:29:34.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5809f360 con 0x7fdb58061320 2021-10-20T23:29:34.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb580b10a0 con 0x7fdb58061320 2021-10-20T23:29:34.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.755+0000 7fdb4dffb700 1 -- 172.21.15.12:0/2112185181 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb54019030 con 0x7fdb58061320 2021-10-20T23:29:34.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.759+0000 7fdb4dffb700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb380536a0 0x7fdb38055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:34.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.759+0000 7fdb4dffb700 1 -- 172.21.15.12:0/2112185181 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdb5406ae90 con 0x7fdb58061320 2021-10-20T23:29:34.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.759+0000 7fdb4ffff700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb380536a0 0x7fdb38055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:34.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.759+0000 7fdb4ffff700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb380536a0 0x7fdb38055b60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fdb4801a000 tx=0x7fdb48014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:34.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.763+0000 7fdb4dffb700 1 -- 172.21.15.12:0/2112185181 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb54041e90 con 0x7fdb58061320 2021-10-20T23:29:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:34.927+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdb580af460 con 0x7fdb58061320 2021-10-20T23:29:35.124 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.115+0000 7fdb4dffb700 1 -- 172.21.15.12:0/2112185181 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdb540454b0 con 0x7fdb58061320 2021-10-20T23:29:35.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.115+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb380536a0 msgr2=0x7fdb38055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.115+0000 7fdb5dc42700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb380536a0 0x7fdb38055b60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fdb4801a000 tx=0x7fdb48014000).stop 2021-10-20T23:29:35.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.115+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58061320 msgr2=0x7fdb580b8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.128 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.115+0000 7fdb5dc42700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58061320 0x7fdb580b8ac0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7fdb580af7e0 tx=0x7fdb54007c50).stop 2021-10-20T23:29:35.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.119+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 shutdown_connections 2021-10-20T23:29:35.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.119+0000 7fdb5dc42700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fdb380536a0 0x7fdb38055b60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.119+0000 7fdb5dc42700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb58140440 0x7fdb58156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.119+0000 7fdb5dc42700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb580ad5c0 0x7fdb58156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.129 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.119+0000 7fdb5dc42700 1 --2- 172.21.15.12:0/2112185181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58061320 0x7fdb580b8ac0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.119+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 >> 172.21.15.12:0/2112185181 conn(0x7fdb58066de0 msgr2=0x7fdb581445b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:35.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.119+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 shutdown_connections 2021-10-20T23:29:35.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.119+0000 7fdb5dc42700 1 -- 172.21.15.12:0/2112185181 wait complete. 2021-10-20T23:29:35.145 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8711a1700 1 Processor -- start 2021-10-20T23:29:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8711a1700 1 -- start start 2021-10-20T23:29:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8711a1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0b0010 0x7fa86c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8711a1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa86c0afbd0 0x7fa86c0a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8711a1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86c0a70c0 con 0x7fa86c0b2580 2021-10-20T23:29:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8711a1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86c0a72f0 con 0x7fa86c0afbd0 2021-10-20T23:29:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8711a1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0a7590 con 0x7fa86c0b0010 2021-10-20T23:29:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8709a0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa86c0afbd0 0x7fa86c0a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8709a0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa86c0afbd0 0x7fa86c0a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45928/0 (socket says 172.21.15.12:45928) 2021-10-20T23:29:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8709a0700 1 -- 172.21.15.12:0/3859281170 learned_addr learned my addr 172.21.15.12:0/3859281170 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa86bfff700 1 --1- 172.21.15.12:0/3859281170 >> v1:172.21.15.12:6789/0 conn(0x7fa86c0b2580 0x7fa86c14ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44520/0 (socket says 172.21.15.12:44520) 2021-10-20T23:29:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa86b7fe700 1 --2- 172.21.15.12:0/3859281170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0b0010 0x7fa86c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8709a0700 1 -- 172.21.15.12:0/3859281170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0b0010 msgr2=0x7fa86c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8709a0700 1 --2- 172.21.15.12:0/3859281170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0b0010 0x7fa86c0a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8709a0700 1 -- 172.21.15.12:0/3859281170 >> v1:172.21.15.12:6789/0 conn(0x7fa86c0b2580 legacy=0x7fa86c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8709a0700 1 -- 172.21.15.12:0/3859281170 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c0a7830 con 0x7fa86c0afbd0 2021-10-20T23:29:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa8709a0700 1 --2- 172.21.15.12:0/3859281170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0afbd0 0x7fa86c0a88a0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fa864002f70 tx=0x7fa864006eb0).ready entity=mon.0 client_cookie=d97b8491928e3621 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa86affd700 1 -- 172.21.15.12:0/3859281170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86400d570 con 0x7fa86c0afbd0 2021-10-20T23:29:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa86affd700 1 -- 172.21.15.12:0/3859281170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864000e90 con 0x7fa86c0afbd0 2021-10-20T23:29:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.247+0000 7fa86affd700 1 -- 172.21.15.12:0/3859281170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86400d900 con 0x7fa86c0afbd0 2021-10-20T23:29:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 -- 172.21.15.12:0/3859281170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0afbd0 msgr2=0x7fa86c0a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 --2- 172.21.15.12:0/3859281170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0afbd0 0x7fa86c0a88a0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fa864002f70 tx=0x7fa864006eb0).stop 2021-10-20T23:29:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 -- 172.21.15.12:0/3859281170 shutdown_connections 2021-10-20T23:29:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 --2- 172.21.15.12:0/3859281170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0afbd0 0x7fa86c0a88a0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 --2- 172.21.15.12:0/3859281170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0b0010 0x7fa86c0a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 -- 172.21.15.12:0/3859281170 >> 172.21.15.12:0/3859281170 conn(0x7fa86c060180 msgr2=0x7fa86c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 -- 172.21.15.12:0/3859281170 shutdown_connections 2021-10-20T23:29:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 -- 172.21.15.12:0/3859281170 wait complete. 2021-10-20T23:29:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 Processor -- start 2021-10-20T23:29:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.251+0000 7fa8711a1700 1 -- start start 2021-10-20T23:29:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8711a1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0afbd0 0x7fa86c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8711a1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0b0010 0x7fa86c159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8711a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa86c0b2580 0x7fa86c14b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8711a1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0a93f0 con 0x7fa86c0b0010 2021-10-20T23:29:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8711a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c1574d0 con 0x7fa86c0b2580 2021-10-20T23:29:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8711a1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c15a250 con 0x7fa86c0afbd0 2021-10-20T23:29:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0b0010 0x7fa86c159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0b0010 0x7fa86c159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45932/0 (socket says 172.21.15.12:45932) 2021-10-20T23:29:35.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86b7fe700 1 -- 172.21.15.12:0/1738151040 learned_addr learned my addr 172.21.15.12:0/1738151040 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:35.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86bfff700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0afbd0 0x7fa86c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8709a0700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa86c0b2580 0x7fa86c14b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86b7fe700 1 -- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0afbd0 msgr2=0x7fa86c156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86b7fe700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0afbd0 0x7fa86c156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86b7fe700 1 -- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa86c0b2580 msgr2=0x7fa86c14b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86b7fe700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa86c0b2580 0x7fa86c14b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86b7fe700 1 -- 172.21.15.12:0/1738151040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86400b1e0 con 0x7fa86c0b0010 2021-10-20T23:29:35.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86bfff700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0afbd0 0x7fa86c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:35.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8709a0700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa86c0b2580 0x7fa86c14b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:35.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa86b7fe700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0b0010 0x7fa86c159d60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7fa85c00c000 tx=0x7fa85c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:35.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8697fa700 1 -- 172.21.15.12:0/1738151040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa85c00c850 con 0x7fa86c0b0010 2021-10-20T23:29:35.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8697fa700 1 -- 172.21.15.12:0/1738151040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c00c9b0 con 0x7fa86c0b0010 2021-10-20T23:29:35.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86c0a91e0 con 0x7fa86c0b0010 2021-10-20T23:29:35.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8697fa700 1 -- 172.21.15.12:0/1738151040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa85c00cd10 con 0x7fa86c0b0010 2021-10-20T23:29:35.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86c15a720 con 0x7fa86c0b0010 2021-10-20T23:29:35.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86c15a8e0 con 0x7fa86c0b0010 2021-10-20T23:29:35.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.255+0000 7fa8697fa700 1 -- 172.21.15.12:0/1738151040 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa85c022070 con 0x7fa86c0b0010 2021-10-20T23:29:35.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.259+0000 7fa8697fa700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa84c053610 0x7fa84c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.259+0000 7fa8697fa700 1 -- 172.21.15.12:0/1738151040 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa85c06c1c0 con 0x7fa86c0b0010 2021-10-20T23:29:35.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.259+0000 7fa86bfff700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa84c053610 0x7fa84c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.259+0000 7fa86bfff700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa84c053610 0x7fa84c055ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fa86000b000 tx=0x7fa860007100).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:35.277 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.263+0000 7fa8697fa700 1 -- 172.21.15.12:0/1738151040 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa85c0431c0 con 0x7fa86c0b0010 2021-10-20T23:29:35.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.427+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa86c057350 con 0x7fa86c0b0010 2021-10-20T23:29:35.437 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.427+0000 7fa8697fa700 1 -- 172.21.15.12:0/1738151040 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fa85c0467e0 con 0x7fa86c0b0010 2021-10-20T23:29:35.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:35.438 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":84,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2957698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2957698261},{"type":"v1","addr":"172.21.15.31:6835","nonce":2957698261}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83},{"gid":8763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/1391258740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1391258740},{"type":"v1","addr":"172.21.15.12:6833","nonce":1391258740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:34.081034+0000","modified":"2021-10-20T23:29:35.098091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1536487631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1536487631},{"type":"v1","addr":"172.21.15.12:6835","nonce":1536487631}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-20T23:29:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa84c053610 msgr2=0x7fa84c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa84c053610 0x7fa84c055ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fa86000b000 tx=0x7fa860007100).stop 2021-10-20T23:29:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0b0010 msgr2=0x7fa86c159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0b0010 0x7fa86c159d60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7fa85c00c000 tx=0x7fa85c0091d0).stop 2021-10-20T23:29:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 shutdown_connections 2021-10-20T23:29:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa84c053610 0x7fa84c055ad0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa86c0b2580 0x7fa86c14b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa86c0b0010 0x7fa86c159d60 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 --2- 172.21.15.12:0/1738151040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa86c0afbd0 0x7fa86c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 >> 172.21.15.12:0/1738151040 conn(0x7fa86c060180 msgr2=0x7fa86c146890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:35.442 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 shutdown_connections 2021-10-20T23:29:35.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.431+0000 7fa8711a1700 1 -- 172.21.15.12:0/1738151040 wait complete. 2021-10-20T23:29:35.443 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 84 2021-10-20T23:29:35.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9490e0e700 1 Processor -- start 2021-10-20T23:29:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9490e0e700 1 -- start start 2021-10-20T23:29:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9490e0e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b6580 0x7f948c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9490e0e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f948c0b43c0 0x7f948c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9490e0e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c1440b0 con 0x7f948c061d30 2021-10-20T23:29:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9490e0e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c0b6e50 con 0x7f948c0b43c0 2021-10-20T23:29:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9490e0e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c143b70 con 0x7f948c0b6580 2021-10-20T23:29:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f948ad9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f948c061d30 0x7f948c1466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44536/0 (socket says 172.21.15.12:44536) 2021-10-20T23:29:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f948ad9d700 1 -- 172.21.15.12:0/3439072364 learned_addr learned my addr 172.21.15.12:0/3439072364 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9489d9b700 1 --2- 172.21.15.12:0/3439072364 >> v2:172.21.15.31:3300/0 conn(0x7f948c0b43c0 0x7f948c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f948a59c700 1 --2- 172.21.15.12:0/3439072364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b6580 0x7f948c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f948959a700 1 -- 172.21.15.12:0/3439072364 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726104796 0 0) 0x7f948c1440b0 con 0x7f948c061d30 2021-10-20T23:29:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f948959a700 1 -- 172.21.15.12:0/3439072364 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f946c003260 con 0x7f948c061d30 2021-10-20T23:29:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9489d9b700 1 -- 172.21.15.12:0/3439072364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b6580 msgr2=0x7f948c0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9489d9b700 1 --2- 172.21.15.12:0/3439072364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b6580 0x7f948c0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9489d9b700 1 -- 172.21.15.12:0/3439072364 >> v1:172.21.15.12:6789/0 conn(0x7f948c061d30 legacy=0x7f948c1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9489d9b700 1 -- 172.21.15.12:0/3439072364 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c143e10 con 0x7f948c0b43c0 2021-10-20T23:29:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f948a59c700 1 --2- 172.21.15.12:0/3439072364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b6580 0x7f948c0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f9489d9b700 1 --2- 172.21.15.12:0/3439072364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948c0b43c0 0x7f948c0b6960 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f94840032f0 tx=0x7f94840091d0).ready entity=mon.1 client_cookie=96b4a9cf8320aa9c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f948959a700 1 -- 172.21.15.12:0/3439072364 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f948400b600 con 0x7f948c0b43c0 2021-10-20T23:29:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f948959a700 1 -- 172.21.15.12:0/3439072364 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948400b760 con 0x7f948c0b43c0 2021-10-20T23:29:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.551+0000 7f948959a700 1 -- 172.21.15.12:0/3439072364 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f948400b8d0 con 0x7f948c0b43c0 2021-10-20T23:29:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 -- 172.21.15.12:0/3439072364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948c0b43c0 msgr2=0x7f948c0b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 --2- 172.21.15.12:0/3439072364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948c0b43c0 0x7f948c0b6960 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f94840032f0 tx=0x7f94840091d0).stop 2021-10-20T23:29:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 -- 172.21.15.12:0/3439072364 shutdown_connections 2021-10-20T23:29:35.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 --2- 172.21.15.12:0/3439072364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948c0b43c0 0x7f948c0b6960 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 --2- 172.21.15.12:0/3439072364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b6580 0x7f948c0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 -- 172.21.15.12:0/3439072364 >> 172.21.15.12:0/3439072364 conn(0x7f948c05c490 msgr2=0x7f948c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 -- 172.21.15.12:0/3439072364 shutdown_connections 2021-10-20T23:29:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 -- 172.21.15.12:0/3439072364 wait complete. 2021-10-20T23:29:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 Processor -- start 2021-10-20T23:29:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.555+0000 7f9490e0e700 1 -- start start 2021-10-20T23:29:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f9490e0e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948c061d30 0x7f948c14a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f9490e0e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b43c0 0x7f948c0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f9490e0e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c0b6580 0x7f948c12a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f9490e0e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b3390 con 0x7f948c0b6580 2021-10-20T23:29:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f9490e0e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b2010 con 0x7f948c061d30 2021-10-20T23:29:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f9490e0e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c146580 con 0x7f948c0b43c0 2021-10-20T23:29:35.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c0b6580 0x7f948c12a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948c061d30 0x7f948c14a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c0b6580 0x7f948c12a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45948/0 (socket says 172.21.15.12:45948) 2021-10-20T23:29:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948ad9d700 1 -- 172.21.15.12:0/1256258027 learned_addr learned my addr 172.21.15.12:0/1256258027 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f9489d9b700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b43c0 0x7f948c0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948ad9d700 1 -- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b43c0 msgr2=0x7f948c0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948ad9d700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b43c0 0x7f948c0aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948ad9d700 1 -- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948c061d30 msgr2=0x7f948c14a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948ad9d700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948c061d30 0x7f948c14a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948ad9d700 1 -- 172.21.15.12:0/1256258027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947400b180 con 0x7f948c0b6580 2021-10-20T23:29:35.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f948ad9d700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c0b6580 0x7f948c12a7e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f947c001110 tx=0x7f947c007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:35.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f94837fe700 1 -- 172.21.15.12:0/1256258027 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947c00cd50 con 0x7f948c0b6580 2021-10-20T23:29:35.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f94837fe700 1 -- 172.21.15.12:0/1256258027 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c0070d0 con 0x7f948c0b6580 2021-10-20T23:29:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f94837fe700 1 -- 172.21.15.12:0/1256258027 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947c007430 con 0x7f948c0b6580 2021-10-20T23:29:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9484009470 con 0x7f948c0b6580 2021-10-20T23:29:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.559+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c0b35c0 con 0x7f948c0b6580 2021-10-20T23:29:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.563+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c1566f0 con 0x7f948c0b6580 2021-10-20T23:29:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.563+0000 7f94837fe700 1 -- 172.21.15.12:0/1256258027 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f947c010070 con 0x7f948c0b6580 2021-10-20T23:29:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.563+0000 7f94837fe700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9470053610 0x7f9470055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.563+0000 7f94837fe700 1 -- 172.21.15.12:0/1256258027 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f947c06aeb0 con 0x7f948c0b6580 2021-10-20T23:29:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.563+0000 7f948a59c700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9470053610 0x7f9470055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.563+0000 7f948a59c700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9470053610 0x7f9470055ad0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f947400b000 tx=0x7f9474006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:35.597 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.571+0000 7f94837fe700 1 -- 172.21.15.12:0/1256258027 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f947c041eb0 con 0x7f948c0b6580 2021-10-20T23:29:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.699+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f948c0615f0 con 0x7f948c0b6580 2021-10-20T23:29:35.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.699+0000 7f94837fe700 1 -- 172.21.15.12:0/1256258027 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f947c018070 con 0x7f948c0b6580 2021-10-20T23:29:35.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:35.712 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":162,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:35.096609+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:32.496339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:33.438412+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:35.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9470053610 msgr2=0x7f9470055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9470053610 0x7f9470055ad0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f947400b000 tx=0x7f9474006df0).stop 2021-10-20T23:29:35.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c0b6580 msgr2=0x7f948c12a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c0b6580 0x7f948c12a7e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f947c001110 tx=0x7f947c007a20).stop 2021-10-20T23:29:35.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 shutdown_connections 2021-10-20T23:29:35.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9470053610 0x7f9470055ad0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c0b6580 0x7f948c12a7e0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f948c0b43c0 0x7f948c0aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 --2- 172.21.15.12:0/1256258027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948c061d30 0x7f948c14a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 >> 172.21.15.12:0/1256258027 conn(0x7f948c05c490 msgr2=0x7f948c143160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:35.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 shutdown_connections 2021-10-20T23:29:35.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.703+0000 7f9490e0e700 1 -- 172.21.15.12:0/1256258027 wait complete. 2021-10-20T23:29:35.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:29:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e2b151700 1 Processor -- start 2021-10-20T23:29:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e2b151700 1 -- start start 2021-10-20T23:29:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e2b151700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e240b65c0 0x7f5e240b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e2b151700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e24060d70 0x7f5e241450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e2b151700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240ac5f0 0x7f5e24141000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e2b151700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e240aca80 con 0x7f5e24060d70 2021-10-20T23:29:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e2b151700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e240acc90 con 0x7f5e240b65c0 2021-10-20T23:29:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e2b151700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240ae560 con 0x7f5e240ac5f0 2021-10-20T23:29:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e23fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e24060d70 0x7f5e241450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e28eed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e240b65c0 0x7f5e240b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e296ee700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240ac5f0 0x7f5e24141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e23fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e24060d70 0x7f5e241450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45956/0 (socket says 172.21.15.12:45956) 2021-10-20T23:29:35.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e28eed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e240b65c0 0x7f5e240b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:60926/0 (socket says 172.21.15.12:60926) 2021-10-20T23:29:35.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e23fff700 1 -- 172.21.15.12:0/3706354190 learned_addr learned my addr 172.21.15.12:0/3706354190 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:35.842 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e23fff700 1 -- 172.21.15.12:0/3706354190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240ac5f0 msgr2=0x7f5e24141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:35.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e23fff700 1 --2- 172.21.15.12:0/3706354190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240ac5f0 0x7f5e24141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e23fff700 1 -- 172.21.15.12:0/3706354190 >> v2:172.21.15.31:3300/0 conn(0x7f5e240b65c0 msgr2=0x7f5e240b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:35.843 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e23fff700 1 --2- 172.21.15.12:0/3706354190 >> v2:172.21.15.31:3300/0 conn(0x7f5e240b65c0 0x7f5e240b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.827+0000 7f5e23fff700 1 -- 172.21.15.12:0/3706354190 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e241446e0 con 0x7f5e24060d70 2021-10-20T23:29:35.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e23fff700 1 --2- 172.21.15.12:0/3706354190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e24060d70 0x7f5e241450c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f5e18002f70 tx=0x7f5e18006eb0).ready entity=mon.0 client_cookie=9a5fd69baa8846fd server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:35.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e237fe700 1 -- 172.21.15.12:0/3706354190 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e1800d570 con 0x7f5e24060d70 2021-10-20T23:29:35.844 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e237fe700 1 -- 172.21.15.12:0/3706354190 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e18000e90 con 0x7f5e24060d70 2021-10-20T23:29:35.845 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e237fe700 1 -- 172.21.15.12:0/3706354190 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e1800d900 con 0x7f5e24060d70 2021-10-20T23:29:35.848 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 -- 172.21.15.12:0/3706354190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e24060d70 msgr2=0x7f5e241450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 --2- 172.21.15.12:0/3706354190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e24060d70 0x7f5e241450c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f5e18002f70 tx=0x7f5e18006eb0).stop 2021-10-20T23:29:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 -- 172.21.15.12:0/3706354190 shutdown_connections 2021-10-20T23:29:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 --2- 172.21.15.12:0/3706354190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240ac5f0 0x7f5e24141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 --2- 172.21.15.12:0/3706354190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e24060d70 0x7f5e241450c0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 --2- 172.21.15.12:0/3706354190 >> v2:172.21.15.31:3300/0 conn(0x7f5e240b65c0 0x7f5e240b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 -- 172.21.15.12:0/3706354190 >> 172.21.15.12:0/3706354190 conn(0x7f5e240b3480 msgr2=0x7f5e240b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 -- 172.21.15.12:0/3706354190 shutdown_connections 2021-10-20T23:29:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 -- 172.21.15.12:0/3706354190 wait complete. 2021-10-20T23:29:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 Processor -- start 2021-10-20T23:29:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.831+0000 7f5e2b151700 1 -- start start 2021-10-20T23:29:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e2b151700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e24060d70 0x7f5e24155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e2b151700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240ac5f0 0x7f5e24156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e2b151700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240b65c0 0x7f5e2413ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e2b151700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e241568b0 con 0x7f5e240ac5f0 2021-10-20T23:29:35.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e2b151700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2413b920 con 0x7f5e24060d70 2021-10-20T23:29:35.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e2b151700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e24156560 con 0x7f5e240b65c0 2021-10-20T23:29:35.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e23fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240ac5f0 0x7f5e24156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e28eed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e24060d70 0x7f5e24155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e296ee700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240b65c0 0x7f5e2413ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e23fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240ac5f0 0x7f5e24156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45960/0 (socket says 172.21.15.12:45960) 2021-10-20T23:29:35.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e23fff700 1 -- 172.21.15.12:0/1844728881 learned_addr learned my addr 172.21.15.12:0/1844728881 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:35.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e23fff700 1 -- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240b65c0 msgr2=0x7f5e2413ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e23fff700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240b65c0 0x7f5e2413ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e23fff700 1 -- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e24060d70 msgr2=0x7f5e24155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:35.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e23fff700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e24060d70 0x7f5e24155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:35.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e23fff700 1 -- 172.21.15.12:0/1844728881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1800b1e0 con 0x7f5e240ac5f0 2021-10-20T23:29:35.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e23fff700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240ac5f0 0x7f5e24156070 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f5e240abdc0 tx=0x7f5e18015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:35.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e21ffb700 1 -- 172.21.15.12:0/1844728881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e18011860 con 0x7f5e240ac5f0 2021-10-20T23:29:35.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e21ffb700 1 -- 172.21.15.12:0/1844728881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e180119c0 con 0x7f5e240ac5f0 2021-10-20T23:29:35.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e240ab5f0 con 0x7f5e240ac5f0 2021-10-20T23:29:35.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e21ffb700 1 -- 172.21.15.12:0/1844728881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e18011d20 con 0x7f5e240ac5f0 2021-10-20T23:29:35.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.835+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e240abaf0 con 0x7f5e240ac5f0 2021-10-20T23:29:35.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.839+0000 7f5e21ffb700 1 -- 172.21.15.12:0/1844728881 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5e18025030 con 0x7f5e240ac5f0 2021-10-20T23:29:35.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.839+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e24141e20 con 0x7f5e240ac5f0 2021-10-20T23:29:35.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.839+0000 7f5e21ffb700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e04053580 0x7f5e04055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:35.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.839+0000 7f5e21ffb700 1 -- 172.21.15.12:0/1844728881 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5e1806cc00 con 0x7f5e240ac5f0 2021-10-20T23:29:35.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.839+0000 7f5e28eed700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e04053580 0x7f5e04055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:35.858 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.839+0000 7f5e28eed700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e04053580 0x7f5e04055a40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f5e1400b000 tx=0x7f5e140091d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:35.859 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:35.847+0000 7f5e21ffb700 1 -- 172.21.15.12:0/1844728881 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5e18043af0 con 0x7f5e240ac5f0 2021-10-20T23:29:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.015+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5e24144980 con 0x7f5e240ac5f0 2021-10-20T23:29:36.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.023+0000 7f5e21ffb700 1 -- 172.21.15.12:0/1844728881 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5e18023020 con 0x7f5e240ac5f0 2021-10-20T23:29:36.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e04053580 msgr2=0x7f5e04055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e04053580 0x7f5e04055a40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f5e1400b000 tx=0x7f5e140091d0).stop 2021-10-20T23:29:36.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240ac5f0 msgr2=0x7f5e24156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240ac5f0 0x7f5e24156070 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f5e240abdc0 tx=0x7f5e18015000).stop 2021-10-20T23:29:36.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 shutdown_connections 2021-10-20T23:29:36.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5e04053580 0x7f5e04055a40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e240b65c0 0x7f5e2413ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e240ac5f0 0x7f5e24156070 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 --2- 172.21.15.12:0/1844728881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e24060d70 0x7f5e24155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 >> 172.21.15.12:0/1844728881 conn(0x7f5e240b3480 msgr2=0x7f5e24138a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:36.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 shutdown_connections 2021-10-20T23:29:36.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.027+0000 7f5e2b151700 1 -- 172.21.15.12:0/1844728881 wait complete. 2021-10-20T23:29:36.040 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2021-10-20T23:29:36.049 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-20T23:29:36.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd233c700 1 Processor -- start 2021-10-20T23:29:36.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd233c700 1 -- start start 2021-10-20T23:29:36.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd233c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efdcc0af2c0 0x7efdcc0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd233c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdcc0afda0 con 0x7efdcc0ad850 2021-10-20T23:29:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd233c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdcc05c610 con 0x7efdcc0ad320 2021-10-20T23:29:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd233c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdcc140800 con 0x7efdcc0af2c0 2021-10-20T23:29:36.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd133a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efdcc0af2c0 0x7efdcc0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd133a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efdcc0af2c0 0x7efdcc0af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45966/0 (socket says 172.21.15.12:45966) 2021-10-20T23:29:36.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd133a700 1 -- 172.21.15.12:0/1118823229 learned_addr learned my addr 172.21.15.12:0/1118823229 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:36.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd1b3b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efdcc0ad850 0x7efdcc0a8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44562/0 (socket says 172.21.15.12:44562) 2021-10-20T23:29:36.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd133a700 1 -- 172.21.15.12:0/1118823229 >> v1:172.21.15.31:6789/0 conn(0x7efdcc0ad320 legacy=0x7efdcc143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd133a700 1 -- 172.21.15.12:0/1118823229 >> v1:172.21.15.12:6789/0 conn(0x7efdcc0ad850 legacy=0x7efdcc0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdbbfff700 1 -- 172.21.15.12:0/1118823229 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707481859 0 0) 0x7efdcc0afda0 con 0x7efdcc0ad850 2021-10-20T23:29:36.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.159+0000 7efdd133a700 1 -- 172.21.15.12:0/1118823229 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc143860 con 0x7efdcc0af2c0 2021-10-20T23:29:36.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd133a700 1 --2- 172.21.15.12:0/1118823229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0af2c0 0x7efdcc0af6a0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7efdcc0ad770 tx=0x7efdc8009290).ready entity=mon.0 client_cookie=59c923a961656e31 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:36.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdbbfff700 1 -- 172.21.15.12:0/1118823229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdc800b860 con 0x7efdcc0af2c0 2021-10-20T23:29:36.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdbbfff700 1 -- 172.21.15.12:0/1118823229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800b9c0 con 0x7efdcc0af2c0 2021-10-20T23:29:36.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdbbfff700 1 -- 172.21.15.12:0/1118823229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdc800bb30 con 0x7efdcc0af2c0 2021-10-20T23:29:36.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd233c700 1 -- 172.21.15.12:0/1118823229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0af2c0 msgr2=0x7efdcc0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd233c700 1 --2- 172.21.15.12:0/1118823229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0af2c0 0x7efdcc0af6a0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7efdcc0ad770 tx=0x7efdc8009290).stop 2021-10-20T23:29:36.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd233c700 1 -- 172.21.15.12:0/1118823229 shutdown_connections 2021-10-20T23:29:36.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd233c700 1 --2- 172.21.15.12:0/1118823229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0af2c0 0x7efdcc0af6a0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd233c700 1 -- 172.21.15.12:0/1118823229 >> 172.21.15.12:0/1118823229 conn(0x7efdcc061140 msgr2=0x7efdcc062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:36.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd233c700 1 -- 172.21.15.12:0/1118823229 shutdown_connections 2021-10-20T23:29:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd233c700 1 -- 172.21.15.12:0/1118823229 wait complete. 2021-10-20T23:29:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd233c700 1 Processor -- start 2021-10-20T23:29:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.163+0000 7efdd233c700 1 -- start start 2021-10-20T23:29:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd233c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efdcc0ad320 0x7efdcc1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd233c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0ad850 0x7efdcc144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd233c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc0af2c0 0x7efdcc09e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd233c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0b3ed0 con 0x7efdcc0ad850 2021-10-20T23:29:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd233c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0b3c30 con 0x7efdcc0af2c0 2021-10-20T23:29:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd233c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc142c10 con 0x7efdcc0ad320 2021-10-20T23:29:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd0b39700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0ad850 0x7efdcc144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd0b39700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0ad850 0x7efdcc144800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45974/0 (socket says 172.21.15.12:45974) 2021-10-20T23:29:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd0b39700 1 -- 172.21.15.12:0/3446632350 learned_addr learned my addr 172.21.15.12:0/3446632350 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd133a700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efdcc0ad320 0x7efdcc1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd1b3b700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc0af2c0 0x7efdcc09e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd0b39700 1 -- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efdcc0ad320 msgr2=0x7efdcc1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd0b39700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efdcc0ad320 0x7efdcc1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd0b39700 1 -- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc0af2c0 msgr2=0x7efdcc09e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd0b39700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc0af2c0 0x7efdcc09e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd0b39700 1 -- 172.21.15.12:0/3446632350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc8009530 con 0x7efdcc0ad850 2021-10-20T23:29:36.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd0b39700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0ad850 0x7efdcc144800 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7efdcc0635f0 tx=0x7efdbc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:36.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdba7fc700 1 -- 172.21.15.12:0/3446632350 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdbc007030 con 0x7efdcc0ad850 2021-10-20T23:29:36.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdba7fc700 1 -- 172.21.15.12:0/3446632350 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc007190 con 0x7efdcc0ad850 2021-10-20T23:29:36.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc142eb0 con 0x7efdcc0ad850 2021-10-20T23:29:36.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdba7fc700 1 -- 172.21.15.12:0/3446632350 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdbc006510 con 0x7efdcc0ad850 2021-10-20T23:29:36.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.167+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc09eda0 con 0x7efdcc0ad850 2021-10-20T23:29:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.171+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdcc057350 con 0x7efdcc0ad850 2021-10-20T23:29:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.171+0000 7efdba7fc700 1 -- 172.21.15.12:0/3446632350 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efdbc010030 con 0x7efdcc0ad850 2021-10-20T23:29:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.171+0000 7efdba7fc700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efdac0536a0 0x7efdac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.171+0000 7efdba7fc700 1 -- 172.21.15.12:0/3446632350 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efdbc06b6c0 con 0x7efdcc0ad850 2021-10-20T23:29:36.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.171+0000 7efdd133a700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efdac0536a0 0x7efdac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.171+0000 7efdd133a700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efdac0536a0 0x7efdac055b60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7efdc801b000 tx=0x7efdc8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:36.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.175+0000 7efdba7fc700 1 -- 172.21.15.12:0/3446632350 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efdbc0425b0 con 0x7efdcc0ad850 2021-10-20T23:29:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.347+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7efdcc061990 con 0x7efdcc0ad850 2021-10-20T23:29:36.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdba7fc700 1 -- 172.21.15.12:0/3446632350 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7efdbc045bd0 con 0x7efdcc0ad850 2021-10-20T23:29:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efdac0536a0 msgr2=0x7efdac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efdac0536a0 0x7efdac055b60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7efdc801b000 tx=0x7efdc8016000).stop 2021-10-20T23:29:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0ad850 msgr2=0x7efdcc144800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0ad850 0x7efdcc144800 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7efdcc0635f0 tx=0x7efdbc007c10).stop 2021-10-20T23:29:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 shutdown_connections 2021-10-20T23:29:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7efdac0536a0 0x7efdac055b60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc0af2c0 0x7efdcc09e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc0ad850 0x7efdcc144800 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 --2- 172.21.15.12:0/3446632350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efdcc0ad320 0x7efdcc1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 >> 172.21.15.12:0/3446632350 conn(0x7efdcc061140 msgr2=0x7efdcc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 shutdown_connections 2021-10-20T23:29:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.355+0000 7efdd233c700 1 -- 172.21.15.12:0/3446632350 wait complete. 2021-10-20T23:29:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.1 2021-10-20T23:29:36.383 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.475+0000 7fb6df400700 1 Processor -- start 2021-10-20T23:29:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 -- start start 2021-10-20T23:29:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d81483a0 0x7fb6d80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6d80a70c0 0x7fb6d8144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d80b0350 con 0x7fb6d80b1db0 2021-10-20T23:29:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d80a90c0 con 0x7fb6d80a70c0 2021-10-20T23:29:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d80b05f0 con 0x7fb6d81483a0 2021-10-20T23:29:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dd99d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6d80a70c0 0x7fb6d8144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dd99d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6d80a70c0 0x7fb6d8144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:60956/0 (socket says 172.21.15.12:60956) 2021-10-20T23:29:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dd99d700 1 -- 172.21.15.12:0/266947752 learned_addr learned my addr 172.21.15.12:0/266947752 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dd19c700 1 --1- 172.21.15.12:0/266947752 >> v1:172.21.15.31:6789/0 conn(0x7fb6d80b1db0 0x7fb6d80b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:51638/0 (socket says 172.21.15.12:51638) 2021-10-20T23:29:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dc99b700 1 --2- 172.21.15.12:0/266947752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d81483a0 0x7fb6d80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dd99d700 1 -- 172.21.15.12:0/266947752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d81483a0 msgr2=0x7fb6d80b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dd99d700 1 --2- 172.21.15.12:0/266947752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d81483a0 0x7fb6d80b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dd99d700 1 -- 172.21.15.12:0/266947752 >> v1:172.21.15.31:6789/0 conn(0x7fb6d80b1db0 legacy=0x7fb6d80b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dd99d700 1 -- 172.21.15.12:0/266947752 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80b0890 con 0x7fb6d80a70c0 2021-10-20T23:29:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dc99b700 1 --2- 172.21.15.12:0/266947752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d81483a0 0x7fb6d80b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6dd99d700 1 --2- 172.21.15.12:0/266947752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6d80a70c0 0x7fb6d8144720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fb6d4002f70 tx=0x7fb6d4006eb0).ready entity=mon.1 client_cookie=f13e31200f215cd7 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6cffff700 1 -- 172.21.15.12:0/266947752 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d400d5c0 con 0x7fb6d80a70c0 2021-10-20T23:29:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6cffff700 1 -- 172.21.15.12:0/266947752 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d4000e90 con 0x7fb6d80a70c0 2021-10-20T23:29:36.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6cffff700 1 -- 172.21.15.12:0/266947752 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d400d950 con 0x7fb6d80a70c0 2021-10-20T23:29:36.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 -- 172.21.15.12:0/266947752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6d80a70c0 msgr2=0x7fb6d8144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 --2- 172.21.15.12:0/266947752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6d80a70c0 0x7fb6d8144720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fb6d4002f70 tx=0x7fb6d4006eb0).stop 2021-10-20T23:29:36.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 -- 172.21.15.12:0/266947752 shutdown_connections 2021-10-20T23:29:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 --2- 172.21.15.12:0/266947752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6d80a70c0 0x7fb6d8144720 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 --2- 172.21.15.12:0/266947752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d81483a0 0x7fb6d80b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 -- 172.21.15.12:0/266947752 >> 172.21.15.12:0/266947752 conn(0x7fb6d805f6b0 msgr2=0x7fb6d805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 -- 172.21.15.12:0/266947752 shutdown_connections 2021-10-20T23:29:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.479+0000 7fb6df400700 1 -- 172.21.15.12:0/266947752 wait complete. 2021-10-20T23:29:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 Processor -- start 2021-10-20T23:29:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 -- start start 2021-10-20T23:29:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6d80a70c0 0x7fb6d80abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d80b1db0 0x7fb6d80ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6d81483a0 0x7fb6d80ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d814ab40 con 0x7fb6d81483a0 2021-10-20T23:29:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d8149d40 con 0x7fb6d80a70c0 2021-10-20T23:29:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d8149fe0 con 0x7fb6d80b1db0 2021-10-20T23:29:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6d81483a0 0x7fb6d80ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6d81483a0 0x7fb6d80ab390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45990/0 (socket says 172.21.15.12:45990) 2021-10-20T23:29:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd99d700 1 -- 172.21.15.12:0/770413896 learned_addr learned my addr 172.21.15.12:0/770413896 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd19c700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6d80a70c0 0x7fb6d80abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dc99b700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d80b1db0 0x7fb6d80ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd99d700 1 -- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d80b1db0 msgr2=0x7fb6d80ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd99d700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d80b1db0 0x7fb6d80ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd99d700 1 -- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6d80a70c0 msgr2=0x7fb6d80abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd99d700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6d80a70c0 0x7fb6d80abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd99d700 1 -- 172.21.15.12:0/770413896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d400b1e0 con 0x7fb6d81483a0 2021-10-20T23:29:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6dd99d700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6d81483a0 0x7fb6d80ab390 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fb6d4002f70 tx=0x7fb6d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6ce7fc700 1 -- 172.21.15.12:0/770413896 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d4006be0 con 0x7fb6d81483a0 2021-10-20T23:29:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6ce7fc700 1 -- 172.21.15.12:0/770413896 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d400d940 con 0x7fb6d81483a0 2021-10-20T23:29:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d814b2a0 con 0x7fb6d81483a0 2021-10-20T23:29:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6ce7fc700 1 -- 172.21.15.12:0/770413896 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d4011e50 con 0x7fb6d81483a0 2021-10-20T23:29:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.483+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d80abaa0 con 0x7fb6d81483a0 2021-10-20T23:29:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.487+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d814a1e0 con 0x7fb6d81483a0 2021-10-20T23:29:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.487+0000 7fb6ce7fc700 1 -- 172.21.15.12:0/770413896 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6d4025030 con 0x7fb6d81483a0 2021-10-20T23:29:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.487+0000 7fb6ce7fc700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6c0053610 0x7fb6c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:36.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.487+0000 7fb6ce7fc700 1 -- 172.21.15.12:0/770413896 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb6d406cd10 con 0x7fb6d81483a0 2021-10-20T23:29:36.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.487+0000 7fb6dd19c700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6c0053610 0x7fb6c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:36.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.487+0000 7fb6dd19c700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6c0053610 0x7fb6c0055ad0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb6d000d000 tx=0x7fb6d0007ec0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:36.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.495+0000 7fb6ce7fc700 1 -- 172.21.15.12:0/770413896 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6d4072020 con 0x7fb6d81483a0 2021-10-20T23:29:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.659+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6d8057350 con 0x7fb6d81483a0 2021-10-20T23:29:36.670 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.659+0000 7fb6ce7fc700 1 -- 172.21.15.12:0/770413896 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fb6d4023090 con 0x7fb6d81483a0 2021-10-20T23:29:36.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:36.673 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":84,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2957698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2957698261},{"type":"v1","addr":"172.21.15.31:6835","nonce":2957698261}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83},{"gid":8763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/1391258740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1391258740},{"type":"v1","addr":"172.21.15.12:6833","nonce":1391258740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:34.081034+0000","modified":"2021-10-20T23:29:35.098091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1536487631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1536487631},{"type":"v1","addr":"172.21.15.12:6835","nonce":1536487631}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-20T23:29:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6c0053610 msgr2=0x7fb6c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6c0053610 0x7fb6c0055ad0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb6d000d000 tx=0x7fb6d0007ec0).stop 2021-10-20T23:29:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6d81483a0 msgr2=0x7fb6d80ab390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:36.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6d81483a0 0x7fb6d80ab390 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fb6d4002f70 tx=0x7fb6d4015000).stop 2021-10-20T23:29:36.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 shutdown_connections 2021-10-20T23:29:36.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6c0053610 0x7fb6c0055ad0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6d81483a0 0x7fb6d80ab390 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.675 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6d80b1db0 0x7fb6d80ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 --2- 172.21.15.12:0/770413896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6d80a70c0 0x7fb6d80abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:36.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 >> 172.21.15.12:0/770413896 conn(0x7fb6d805f6b0 msgr2=0x7fb6d80b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:36.676 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 shutdown_connections 2021-10-20T23:29:36.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:36.663+0000 7fb6df400700 1 -- 172.21.15.12:0/770413896 wait complete. 2021-10-20T23:29:36.677 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 84 2021-10-20T23:29:36.987 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:29:34.081034+0000', 'modified': '2021-10-20T23:29:35.098091+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'c', 'rank': 0, 'incarnation': 83, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1536487631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1536487631}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1536487631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:29:36.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:29:36.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:29:37.106 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8772,"want_state":"up:active","state":"up:active","rank_uptime":3.0037934669999999,"mdsmap_epoch":84,"osdmap_epoch":163,"osdmap_epoch_barrier":162,"uptime":7.3484445899999997} 2021-10-20T23:29:37.106 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8772, "mdsmap_epoch": 84, "osdmap_epoch": 163, "osdmap_epoch_barrier": 162, "rank_uptime": 3.003793467, "state": "up:active", "uptime": 7.34844459, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:29:37.107 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:37.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.203+0000 7f075b432700 1 Processor -- start 2021-10-20T23:29:37.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.203+0000 7f075b432700 1 -- start start 2021-10-20T23:29:37.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f075414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07540b0010 0x7f075414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07540a70c0 con 0x7f07540afbd0 2021-10-20T23:29:37.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07540a72f0 con 0x7f07540b0010 2021-10-20T23:29:37.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07540a7590 con 0x7f07540b2580 2021-10-20T23:29:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07540b0010 0x7f075414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07540b0010 0x7f075414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45994/0 (socket says 172.21.15.12:45994) 2021-10-20T23:29:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 -- 172.21.15.12:0/117472091 learned_addr learned my addr 172.21.15.12:0/117472091 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075a430700 1 --2- 172.21.15.12:0/117472091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f075414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 -- 172.21.15.12:0/117472091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 msgr2=0x7f075414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 --2- 172.21.15.12:0/117472091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f075414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 -- 172.21.15.12:0/117472091 >> v1:172.21.15.12:6789/0 conn(0x7f07540afbd0 legacy=0x7f07540a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 -- 172.21.15.12:0/117472091 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540a7830 con 0x7f07540b0010 2021-10-20T23:29:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075a430700 1 --2- 172.21.15.12:0/117472091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f075414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:29:37.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 --2- 172.21.15.12:0/117472091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 0x7f075414b330 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f07500032f0 tx=0x7f0750009290).ready entity=mon.0 client_cookie=63e540c6b06bfb97 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:37.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075942e700 1 -- 172.21.15.12:0/117472091 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075000b8a0 con 0x7f07540b0010 2021-10-20T23:29:37.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075942e700 1 -- 172.21.15.12:0/117472091 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075000ba00 con 0x7f07540b0010 2021-10-20T23:29:37.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075942e700 1 -- 172.21.15.12:0/117472091 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075000bb70 con 0x7f07540b0010 2021-10-20T23:29:37.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- 172.21.15.12:0/117472091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 msgr2=0x7f075414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 --2- 172.21.15.12:0/117472091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 0x7f075414b330 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f07500032f0 tx=0x7f0750009290).stop 2021-10-20T23:29:37.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- 172.21.15.12:0/117472091 shutdown_connections 2021-10-20T23:29:37.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 --2- 172.21.15.12:0/117472091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 0x7f075414b330 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 --2- 172.21.15.12:0/117472091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f075414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- 172.21.15.12:0/117472091 >> 172.21.15.12:0/117472091 conn(0x7f0754060180 msgr2=0x7f07540b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:37.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- 172.21.15.12:0/117472091 shutdown_connections 2021-10-20T23:29:37.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- 172.21.15.12:0/117472091 wait complete. 2021-10-20T23:29:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 Processor -- start 2021-10-20T23:29:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- start start 2021-10-20T23:29:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07540afbd0 0x7f075405bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 0x7f07540b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f07540b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540656b0 con 0x7f07540b0010 2021-10-20T23:29:37.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0754064d50 con 0x7f07540afbd0 2021-10-20T23:29:37.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f075b432700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0754064ff0 con 0x7f07540b2580 2021-10-20T23:29:37.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 0x7f07540b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 0x7f07540b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46000/0 (socket says 172.21.15.12:46000) 2021-10-20T23:29:37.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.207+0000 7f0759c2f700 1 -- 172.21.15.12:0/4036715234 learned_addr learned my addr 172.21.15.12:0/4036715234 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:37.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f075a430700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07540afbd0 0x7f075405bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f075ac31700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f07540b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f0759c2f700 1 -- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 msgr2=0x7f07540b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f0759c2f700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f07540b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f0759c2f700 1 -- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07540afbd0 msgr2=0x7f075405bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f0759c2f700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07540afbd0 0x7f075405bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f0759c2f700 1 -- 172.21.15.12:0/4036715234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0750009530 con 0x7f07540b0010 2021-10-20T23:29:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f075ac31700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f07540b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f075a430700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07540afbd0 0x7f075405bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f0759c2f700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 0x7f07540b41b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f07500032f0 tx=0x7f0750016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f07437fe700 1 -- 172.21.15.12:0/4036715234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0750021670 con 0x7f07540b0010 2021-10-20T23:29:37.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f07437fe700 1 -- 172.21.15.12:0/4036715234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500217d0 con 0x7f07540b0010 2021-10-20T23:29:37.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0754065290 con 0x7f07540b0010 2021-10-20T23:29:37.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f07437fe700 1 -- 172.21.15.12:0/4036715234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0750021b30 con 0x7f07540b0010 2021-10-20T23:29:37.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075405c6b0 con 0x7f07540b0010 2021-10-20T23:29:37.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0754057350 con 0x7f07540b0010 2021-10-20T23:29:37.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.211+0000 7f07437fe700 1 -- 172.21.15.12:0/4036715234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f075000f070 con 0x7f07540b0010 2021-10-20T23:29:37.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.215+0000 7f07437fe700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0734053610 0x7f0734055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.215+0000 7f07437fe700 1 -- 172.21.15.12:0/4036715234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f075006cfe0 con 0x7f07540b0010 2021-10-20T23:29:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.215+0000 7f075a430700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0734053610 0x7f0734055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.215+0000 7f075a430700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0734053610 0x7f0734055ad0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f074400b000 tx=0x7f0744008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.219+0000 7f07437fe700 1 -- 172.21.15.12:0/4036715234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0750043ff0 con 0x7f07540b0010 2021-10-20T23:29:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.347+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f075414c780 con 0x7f07540b0010 2021-10-20T23:29:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f07437fe700 1 -- 172.21.15.12:0/4036715234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f0750015070 con 0x7f07540b0010 2021-10-20T23:29:37.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:37.360 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":163,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:36.110591+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:32.496339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:33.438412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0734053610 msgr2=0x7f0734055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0734053610 0x7f0734055ad0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f074400b000 tx=0x7f0744008040).stop 2021-10-20T23:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 msgr2=0x7f07540b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 0x7f07540b41b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f07500032f0 tx=0x7f0750016000).stop 2021-10-20T23:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 shutdown_connections 2021-10-20T23:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0734053610 0x7f0734055ad0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07540b2580 0x7f07540b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07540b0010 0x7f07540b41b0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 --2- 172.21.15.12:0/4036715234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07540afbd0 0x7f075405bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 >> 172.21.15.12:0/4036715234 conn(0x7f0754060180 msgr2=0x7f0754148c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 shutdown_connections 2021-10-20T23:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.351+0000 7f075b432700 1 -- 172.21.15.12:0/4036715234 wait complete. 2021-10-20T23:29:37.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:29:32.496339+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:29:33.438412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:29:37.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:29:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.475+0000 7f8cfc21a700 1 Processor -- start 2021-10-20T23:29:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.475+0000 7f8cfc21a700 1 -- start start 2021-10-20T23:29:37.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8cf40b3590 0x7f8cf4141400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf40ad8f0 con 0x7f8cf40b31b0 2021-10-20T23:29:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf40aff00 con 0x7f8cf4145090 2021-10-20T23:29:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf4145560 con 0x7f8cf40b3590 2021-10-20T23:29:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf97b5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8cf40b3590 0x7f8cf4141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf97b5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8cf40b3590 0x7f8cf4141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46010/0 (socket says 172.21.15.12:46010) 2021-10-20T23:29:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf9fb6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8cf40b31b0 0x7f8cf413e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44602/0 (socket says 172.21.15.12:44602) 2021-10-20T23:29:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf97b5700 1 -- 172.21.15.12:0/4254027080 learned_addr learned my addr 172.21.15.12:0/4254027080 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf97b5700 1 -- 172.21.15.12:0/4254027080 >> v1:172.21.15.31:6789/0 conn(0x7f8cf4145090 legacy=0x7f8cf41418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf97b5700 1 -- 172.21.15.12:0/4254027080 >> v1:172.21.15.12:6789/0 conn(0x7f8cf40b31b0 legacy=0x7f8cf413e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf97b5700 1 -- 172.21.15.12:0/4254027080 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf40b0160 con 0x7f8cf40b3590 2021-10-20T23:29:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf97b5700 1 --2- 172.21.15.12:0/4254027080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf40b3590 0x7f8cf4141400 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f8cf4141190 tx=0x7f8ce8006eb0).ready entity=mon.0 client_cookie=cdf0f6a655e1e35d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:37.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf8fb4700 1 -- 172.21.15.12:0/4254027080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce800d660 con 0x7f8cf40b3590 2021-10-20T23:29:37.494 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf8fb4700 1 -- 172.21.15.12:0/4254027080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8000e90 con 0x7f8cf40b3590 2021-10-20T23:29:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cf8fb4700 1 -- 172.21.15.12:0/4254027080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce800d9f0 con 0x7f8cf40b3590 2021-10-20T23:29:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 -- 172.21.15.12:0/4254027080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf40b3590 msgr2=0x7f8cf4141400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 --2- 172.21.15.12:0/4254027080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf40b3590 0x7f8cf4141400 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f8cf4141190 tx=0x7f8ce8006eb0).stop 2021-10-20T23:29:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 -- 172.21.15.12:0/4254027080 shutdown_connections 2021-10-20T23:29:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 --2- 172.21.15.12:0/4254027080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf40b3590 0x7f8cf4141400 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 -- 172.21.15.12:0/4254027080 >> 172.21.15.12:0/4254027080 conn(0x7f8cf40607c0 msgr2=0x7f8cf4060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:37.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 -- 172.21.15.12:0/4254027080 shutdown_connections 2021-10-20T23:29:37.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.479+0000 7f8cfc21a700 1 -- 172.21.15.12:0/4254027080 wait complete. 2021-10-20T23:29:37.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfc21a700 1 Processor -- start 2021-10-20T23:29:37.497 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfc21a700 1 -- start start 2021-10-20T23:29:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfc21a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8cf40b31b0 0x7f8cf409ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfc21a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cf40b3590 0x7f8cf4065160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfc21a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf4145090 0x7f8cf4065650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfc21a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4063ec0 con 0x7f8cf4145090 2021-10-20T23:29:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfc21a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4064160 con 0x7f8cf40b3590 2021-10-20T23:29:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfc21a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4064400 con 0x7f8cf40b31b0 2021-10-20T23:29:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfa7b7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf4145090 0x7f8cf4065650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfa7b7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf4145090 0x7f8cf4065650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46018/0 (socket says 172.21.15.12:46018) 2021-10-20T23:29:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfa7b7700 1 -- 172.21.15.12:0/2310083721 learned_addr learned my addr 172.21.15.12:0/2310083721 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cf97b5700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cf40b3590 0x7f8cf4065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cf9fb6700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8cf40b31b0 0x7f8cf409ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfa7b7700 1 -- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8cf40b31b0 msgr2=0x7f8cf409ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfa7b7700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8cf40b31b0 0x7f8cf409ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfa7b7700 1 -- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cf40b3590 msgr2=0x7f8cf4065160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfa7b7700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cf40b3590 0x7f8cf4065160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfa7b7700 1 -- 172.21.15.12:0/2310083721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce800b1e0 con 0x7f8cf4145090 2021-10-20T23:29:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.483+0000 7f8cfa7b7700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf4145090 0x7f8cf4065650 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f8cf40b4210 tx=0x7f8cec007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8ce6ffd700 1 -- 172.21.15.12:0/2310083721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec00cea0 con 0x7f8cf4145090 2021-10-20T23:29:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8ce6ffd700 1 -- 172.21.15.12:0/2310083721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec006aa0 con 0x7f8cf4145090 2021-10-20T23:29:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf40646a0 con 0x7f8cf4145090 2021-10-20T23:29:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8ce6ffd700 1 -- 172.21.15.12:0/2310083721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec006e00 con 0x7f8cf4145090 2021-10-20T23:29:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf4063b40 con 0x7f8cf4145090 2021-10-20T23:29:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf4064830 con 0x7f8cf4145090 2021-10-20T23:29:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8ce6ffd700 1 -- 172.21.15.12:0/2310083721 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8cec010030 con 0x7f8cf4145090 2021-10-20T23:29:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8ce6ffd700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8cd4053610 0x7f8cd4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8ce6ffd700 1 -- 172.21.15.12:0/2310083721 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8cec06b830 con 0x7f8cf4145090 2021-10-20T23:29:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.487+0000 7f8cf9fb6700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8cd4053610 0x7f8cd4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.491+0000 7f8cf9fb6700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8cd4053610 0x7f8cd4055ad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f8cf000d000 tx=0x7f8cf0007b80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.495+0000 7f8ce6ffd700 1 -- 172.21.15.12:0/2310083721 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8cec042830 con 0x7f8cf4145090 2021-10-20T23:29:37.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.619+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8cf40b0400 con 0x7f8cf4145090 2021-10-20T23:29:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8ce6ffd700 1 -- 172.21.15.12:0/2310083721 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v163) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8cec045e50 con 0x7f8cf4145090 2021-10-20T23:29:37.632 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:29:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8cd4053610 msgr2=0x7f8cd4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8cd4053610 0x7f8cd4055ad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f8cf000d000 tx=0x7f8cf0007b80).stop 2021-10-20T23:29:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf4145090 msgr2=0x7f8cf4065650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf4145090 0x7f8cf4065650 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f8cf40b4210 tx=0x7f8cec007f70).stop 2021-10-20T23:29:37.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 shutdown_connections 2021-10-20T23:29:37.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8cd4053610 0x7f8cd4055ad0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf4145090 0x7f8cf4065650 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cf40b3590 0x7f8cf4065160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 --2- 172.21.15.12:0/2310083721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8cf40b31b0 0x7f8cf409ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 >> 172.21.15.12:0/2310083721 conn(0x7f8cf40607c0 msgr2=0x7f8cf413ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 shutdown_connections 2021-10-20T23:29:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.623+0000 7f8cfc21a700 1 -- 172.21.15.12:0/2310083721 wait complete. 2021-10-20T23:29:37.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:29:37.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:29:37.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:29:37.659 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:29:37.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:29:37.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 Processor -- start 2021-10-20T23:29:37.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 -- start start 2021-10-20T23:29:37.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 0x7f42d0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f42d0140440 0x7f42d01408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d00aecf0 con 0x7f42d00ad5c0 2021-10-20T23:29:37.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d00b6f20 con 0x7f42d0140440 2021-10-20T23:29:37.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00aef20 con 0x7f42d0061320 2021-10-20T23:29:37.756 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d6972700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f42d0140440 0x7f42d01408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d6972700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f42d0140440 0x7f42d01408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46026/0 (socket says 172.21.15.12:46026) 2021-10-20T23:29:37.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d6972700 1 -- 172.21.15.12:0/799880382 learned_addr learned my addr 172.21.15.12:0/799880382 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:37.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d6171700 1 --2- 172.21.15.12:0/799880382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 0x7f42d0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d6972700 1 -- 172.21.15.12:0/799880382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 msgr2=0x7f42d0061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:37.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d6972700 1 --2- 172.21.15.12:0/799880382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 0x7f42d0061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d6972700 1 -- 172.21.15.12:0/799880382 >> v1:172.21.15.31:6789/0 conn(0x7f42d00ad5c0 legacy=0x7f42d00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d6972700 1 -- 172.21.15.12:0/799880382 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d00af1c0 con 0x7f42d0140440 2021-10-20T23:29:37.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d6972700 1 --2- 172.21.15.12:0/799880382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d0140440 0x7f42d01408d0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f42c80032f0 tx=0x7f42c8009290).ready entity=mon.0 client_cookie=1c6922e3833edf0e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d516f700 1 -- 172.21.15.12:0/799880382 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c800b8a0 con 0x7f42d0140440 2021-10-20T23:29:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d516f700 1 -- 172.21.15.12:0/799880382 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c800ba00 con 0x7f42d0140440 2021-10-20T23:29:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d516f700 1 -- 172.21.15.12:0/799880382 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c800bb70 con 0x7f42d0140440 2021-10-20T23:29:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 -- 172.21.15.12:0/799880382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d0140440 msgr2=0x7f42d01408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 --2- 172.21.15.12:0/799880382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d0140440 0x7f42d01408d0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f42c80032f0 tx=0x7f42c8009290).stop 2021-10-20T23:29:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 -- 172.21.15.12:0/799880382 shutdown_connections 2021-10-20T23:29:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 --2- 172.21.15.12:0/799880382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d0140440 0x7f42d01408d0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 --2- 172.21.15.12:0/799880382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 0x7f42d0061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 -- 172.21.15.12:0/799880382 >> 172.21.15.12:0/799880382 conn(0x7f42d0066de0 msgr2=0x7f42d00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:37.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 -- 172.21.15.12:0/799880382 shutdown_connections 2021-10-20T23:29:37.762 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.743+0000 7f42d7173700 1 -- 172.21.15.12:0/799880382 wait complete. 2021-10-20T23:29:37.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 Processor -- start 2021-10-20T23:29:37.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 -- start start 2021-10-20T23:29:37.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 0x7f42d00b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d00ad5c0 0x7f42d0144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42d0140440 0x7f42d0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00aa920 con 0x7f42d00ad5c0 2021-10-20T23:29:37.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00b0de0 con 0x7f42d0140440 2021-10-20T23:29:37.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d0155910 con 0x7f42d0061320 2021-10-20T23:29:37.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d5970700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d00ad5c0 0x7f42d0144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d5970700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d00ad5c0 0x7f42d0144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46030/0 (socket says 172.21.15.12:46030) 2021-10-20T23:29:37.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d6972700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42d0140440 0x7f42d0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d5970700 1 -- 172.21.15.12:0/2153906636 learned_addr learned my addr 172.21.15.12:0/2153906636 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:37.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d6171700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 0x7f42d00b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d5970700 1 -- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 msgr2=0x7f42d00b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d5970700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 0x7f42d00b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d5970700 1 -- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42d0140440 msgr2=0x7f42d0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d5970700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42d0140440 0x7f42d0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d5970700 1 -- 172.21.15.12:0/2153906636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8009530 con 0x7f42d00ad5c0 2021-10-20T23:29:37.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d5970700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d00ad5c0 0x7f42d0144290 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f42d00b0f20 tx=0x7f42c4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:37.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42c37fe700 1 -- 172.21.15.12:0/2153906636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c4007030 con 0x7f42d00ad5c0 2021-10-20T23:29:37.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42c37fe700 1 -- 172.21.15.12:0/2153906636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4007190 con 0x7f42d00ad5c0 2021-10-20T23:29:37.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d00b1000 con 0x7f42d00ad5c0 2021-10-20T23:29:37.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42c37fe700 1 -- 172.21.15.12:0/2153906636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c4006510 con 0x7f42d00ad5c0 2021-10-20T23:29:37.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d0155b40 con 0x7f42d00ad5c0 2021-10-20T23:29:37.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.747+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d00af460 con 0x7f42d00ad5c0 2021-10-20T23:29:37.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.751+0000 7f42c37fe700 1 -- 172.21.15.12:0/2153906636 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f42c4010030 con 0x7f42d00ad5c0 2021-10-20T23:29:37.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.751+0000 7f42c37fe700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f42b0053610 0x7f42b0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:37.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.751+0000 7f42c37fe700 1 -- 172.21.15.12:0/2153906636 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f42c406bc70 con 0x7f42d00ad5c0 2021-10-20T23:29:37.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.751+0000 7f42d6171700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f42b0053610 0x7f42b0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:37.773 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.751+0000 7f42d6171700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f42b0053610 0x7f42b0055ad0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f42cc00b000 tx=0x7f42cc006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.755+0000 7f42c37fe700 1 -- 172.21.15.12:0/2153906636 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f42c4042b60 con 0x7f42d00ad5c0 2021-10-20T23:29:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.879+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42d0057350 con 0x7f42d00ad5c0 2021-10-20T23:29:37.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42c37fe700 1 -- 172.21.15.12:0/2153906636 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7f42c4046180 con 0x7f42d00ad5c0 2021-10-20T23:29:37.894 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:37.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f42b0053610 msgr2=0x7f42b0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f42b0053610 0x7f42b0055ad0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f42cc00b000 tx=0x7f42cc006df0).stop 2021-10-20T23:29:37.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d00ad5c0 msgr2=0x7f42d0144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:37.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d00ad5c0 0x7f42d0144290 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f42d00b0f20 tx=0x7f42c4007c10).stop 2021-10-20T23:29:37.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 shutdown_connections 2021-10-20T23:29:37.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f42b0053610 0x7f42b0055ad0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42d0140440 0x7f42d0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42d00ad5c0 0x7f42d0144290 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 --2- 172.21.15.12:0/2153906636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42d0061320 0x7f42d00b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 >> 172.21.15.12:0/2153906636 conn(0x7f42d0066de0 msgr2=0x7f42d00b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 shutdown_connections 2021-10-20T23:29:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:37.883+0000 7f42d7173700 1 -- 172.21.15.12:0/2153906636 wait complete. 2021-10-20T23:29:37.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:29:38.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe929aff700 1 Processor -- start 2021-10-20T23:29:38.020 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe929aff700 1 -- start start 2021-10-20T23:29:38.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe929aff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9240b6560 0x7fe9240b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe929aff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b5990 0x7fe9240b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe929aff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe924143f60 con 0x7fe92405fc00 2021-10-20T23:29:38.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe929aff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9240ba6b0 con 0x7fe9240b6560 2021-10-20T23:29:38.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe929aff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92405ffe0 con 0x7fe9240b5990 2021-10-20T23:29:38.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe91affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9240b6560 0x7fe9240b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe923fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b5990 0x7fe9240b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe91affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9240b6560 0x7fe9240b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46040/0 (socket says 172.21.15.12:46040) 2021-10-20T23:29:38.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe9237fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe92405fc00 0x7fe9240b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:51694/0 (socket says 172.21.15.12:51694) 2021-10-20T23:29:38.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe91affd700 1 -- 172.21.15.12:0/4221694131 learned_addr learned my addr 172.21.15.12:0/4221694131 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:38.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe923fff700 1 -- 172.21.15.12:0/4221694131 >> v2:172.21.15.12:3300/0 conn(0x7fe9240b6560 msgr2=0x7fe9240b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:38.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe923fff700 1 --2- 172.21.15.12:0/4221694131 >> v2:172.21.15.12:3300/0 conn(0x7fe9240b6560 0x7fe9240b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe923fff700 1 -- 172.21.15.12:0/4221694131 >> v1:172.21.15.31:6789/0 conn(0x7fe92405fc00 legacy=0x7fe9240b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe923fff700 1 -- 172.21.15.12:0/4221694131 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924143a50 con 0x7fe9240b5990 2021-10-20T23:29:38.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe923fff700 1 --2- 172.21.15.12:0/4221694131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b5990 0x7fe9240b4a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fe91c0032f0 tx=0x7fe91c0091d0).ready entity=mon.2 client_cookie=85b3b6359c3260a7 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:38.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe922ffd700 1 -- 172.21.15.12:0/4221694131 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c00b6c0 con 0x7fe9240b5990 2021-10-20T23:29:38.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe922ffd700 1 -- 172.21.15.12:0/4221694131 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c00b820 con 0x7fe9240b5990 2021-10-20T23:29:38.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.011+0000 7fe922ffd700 1 -- 172.21.15.12:0/4221694131 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c00b990 con 0x7fe9240b5990 2021-10-20T23:29:38.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 -- 172.21.15.12:0/4221694131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b5990 msgr2=0x7fe9240b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 --2- 172.21.15.12:0/4221694131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b5990 0x7fe9240b4a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fe91c0032f0 tx=0x7fe91c0091d0).stop 2021-10-20T23:29:38.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 -- 172.21.15.12:0/4221694131 shutdown_connections 2021-10-20T23:29:38.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 --2- 172.21.15.12:0/4221694131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b5990 0x7fe9240b4a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 --2- 172.21.15.12:0/4221694131 >> v2:172.21.15.12:3300/0 conn(0x7fe9240b6560 0x7fe9240b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 -- 172.21.15.12:0/4221694131 >> 172.21.15.12:0/4221694131 conn(0x7fe9240623a0 msgr2=0x7fe924066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:38.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 -- 172.21.15.12:0/4221694131 shutdown_connections 2021-10-20T23:29:38.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 -- 172.21.15.12:0/4221694131 wait complete. 2021-10-20T23:29:38.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 Processor -- start 2021-10-20T23:29:38.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 -- start start 2021-10-20T23:29:38.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92405fc00 0x7fe924142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9240b5990 0x7fe9241444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b6560 0x7fe924144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9241470d0 con 0x7fe92405fc00 2021-10-20T23:29:38.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240b02d0 con 0x7fe9240b5990 2021-10-20T23:29:38.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe929aff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240af460 con 0x7fe9240b6560 2021-10-20T23:29:38.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe9237fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92405fc00 0x7fe924142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe9237fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92405fc00 0x7fe924142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46042/0 (socket says 172.21.15.12:46042) 2021-10-20T23:29:38.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe9237fe700 1 -- 172.21.15.12:0/1613785159 learned_addr learned my addr 172.21.15.12:0/1613785159 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:38.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe923fff700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b6560 0x7fe924144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.015+0000 7fe91affd700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9240b5990 0x7fe9241444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9237fe700 1 -- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b6560 msgr2=0x7fe924144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9237fe700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b6560 0x7fe924144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9237fe700 1 -- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9240b5990 msgr2=0x7fe9241444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9237fe700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9240b5990 0x7fe9241444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9237fe700 1 -- 172.21.15.12:0/1613785159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c009470 con 0x7fe92405fc00 2021-10-20T23:29:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9237fe700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92405fc00 0x7fe924142180 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fe9240b19e0 tx=0x7fe914007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9217fa700 1 -- 172.21.15.12:0/1613785159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9140070d0 con 0x7fe92405fc00 2021-10-20T23:29:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9217fa700 1 -- 172.21.15.12:0/1613785159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe914007230 con 0x7fe92405fc00 2021-10-20T23:29:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9240b0500 con 0x7fe92405fc00 2021-10-20T23:29:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9217fa700 1 -- 172.21.15.12:0/1613785159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe914005550 con 0x7fe92405fc00 2021-10-20T23:29:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9240aeb50 con 0x7fe92405fc00 2021-10-20T23:29:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9240b4600 con 0x7fe92405fc00 2021-10-20T23:29:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9217fa700 1 -- 172.21.15.12:0/1613785159 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe914010070 con 0x7fe92405fc00 2021-10-20T23:29:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.019+0000 7fe9217fa700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe908053580 0x7fe908055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.023+0000 7fe9217fa700 1 -- 172.21.15.12:0/1613785159 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe91406b070 con 0x7fe92405fc00 2021-10-20T23:29:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.023+0000 7fe91affd700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe908053580 0x7fe908055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.023+0000 7fe91affd700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe908053580 0x7fe908055a40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fe90c008000 tx=0x7fe90c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.027+0000 7fe9217fa700 1 -- 172.21.15.12:0/1613785159 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9240b4600 con 0x7fe92405fc00 2021-10-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.155+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9240b4600 con 0x7fe92405fc00 2021-10-20T23:29:38.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.155+0000 7fe9217fa700 1 -- 172.21.15.12:0/1613785159 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe9240b4600 con 0x7fe92405fc00 2021-10-20T23:29:38.167 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe908053580 msgr2=0x7fe908055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe908053580 0x7fe908055a40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fe90c008000 tx=0x7fe90c008040).stop 2021-10-20T23:29:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92405fc00 msgr2=0x7fe924142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92405fc00 0x7fe924142180 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fe9240b19e0 tx=0x7fe914007c40).stop 2021-10-20T23:29:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 shutdown_connections 2021-10-20T23:29:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe908053580 0x7fe908055a40 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9240b6560 0x7fe924144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9240b5990 0x7fe9241444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 --2- 172.21.15.12:0/1613785159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92405fc00 0x7fe924142180 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 >> 172.21.15.12:0/1613785159 conn(0x7fe9240623a0 msgr2=0x7fe9240b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 shutdown_connections 2021-10-20T23:29:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.159+0000 7fe929aff700 1 -- 172.21.15.12:0/1613785159 wait complete. 2021-10-20T23:29:38.183 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:29:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.283+0000 7f8351840700 1 Processor -- start 2021-10-20T23:29:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.283+0000 7f8351840700 1 -- start start 2021-10-20T23:29:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 0x7f834c140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f834c0b4690 0x7f834c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834c143b60 con 0x7f834c146950 2021-10-20T23:29:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834c147510 con 0x7f834c0b4690 2021-10-20T23:29:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c143e00 con 0x7f834c0b4180 2021-10-20T23:29:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f834b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f834c0b4690 0x7f834c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f834b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f834c0b4690 0x7f834c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46054/0 (socket says 172.21.15.12:46054) 2021-10-20T23:29:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f834b7fe700 1 -- 172.21.15.12:0/3294294639 learned_addr learned my addr 172.21.15.12:0/3294294639 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f834a7fc700 1 --2- 172.21.15.12:0/3294294639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 0x7f834c140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f834b7fe700 1 -- 172.21.15.12:0/3294294639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 msgr2=0x7f834c140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f834b7fe700 1 --2- 172.21.15.12:0/3294294639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 0x7f834c140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f834b7fe700 1 -- 172.21.15.12:0/3294294639 >> v1:172.21.15.31:6789/0 conn(0x7f834c146950 legacy=0x7f834c140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f834b7fe700 1 -- 172.21.15.12:0/3294294639 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c0b0c90 con 0x7f834c0b4690 2021-10-20T23:29:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f834b7fe700 1 --2- 172.21.15.12:0/3294294639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 0x7f834c0b4ed0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f8344002f70 tx=0x7f8344006eb0).ready entity=mon.0 client_cookie=519ae35e59206f1f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8349ffb700 1 -- 172.21.15.12:0/3294294639 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f834400d570 con 0x7f834c0b4690 2021-10-20T23:29:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8349ffb700 1 -- 172.21.15.12:0/3294294639 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8344000e90 con 0x7f834c0b4690 2021-10-20T23:29:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8349ffb700 1 -- 172.21.15.12:0/3294294639 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f834400d900 con 0x7f834c0b4690 2021-10-20T23:29:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 -- 172.21.15.12:0/3294294639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 msgr2=0x7f834c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 --2- 172.21.15.12:0/3294294639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 0x7f834c0b4ed0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f8344002f70 tx=0x7f8344006eb0).stop 2021-10-20T23:29:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 -- 172.21.15.12:0/3294294639 shutdown_connections 2021-10-20T23:29:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 --2- 172.21.15.12:0/3294294639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 0x7f834c0b4ed0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 --2- 172.21.15.12:0/3294294639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 0x7f834c140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 -- 172.21.15.12:0/3294294639 >> 172.21.15.12:0/3294294639 conn(0x7f834c05c490 msgr2=0x7f834c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 -- 172.21.15.12:0/3294294639 shutdown_connections 2021-10-20T23:29:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.287+0000 7f8351840700 1 -- 172.21.15.12:0/3294294639 wait complete. 2021-10-20T23:29:38.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 Processor -- start 2021-10-20T23:29:38.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 -- start start 2021-10-20T23:29:38.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 0x7f834c13f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 0x7f834c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f834c146950 0x7f834c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c1501d0 con 0x7f834c0b4690 2021-10-20T23:29:38.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c156970 con 0x7f834c146950 2021-10-20T23:29:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c0aeaf0 con 0x7f834c0b4180 2021-10-20T23:29:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 0x7f834c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 0x7f834c155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46058/0 (socket says 172.21.15.12:46058) 2021-10-20T23:29:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834a7fc700 1 -- 172.21.15.12:0/3807243360 learned_addr learned my addr 172.21.15.12:0/3807243360 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834b7fe700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f834c146950 0x7f834c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834affd700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 0x7f834c13f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834a7fc700 1 -- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 msgr2=0x7f834c13f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834a7fc700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 0x7f834c13f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834a7fc700 1 -- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f834c146950 msgr2=0x7f834c156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834a7fc700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f834c146950 0x7f834c156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834a7fc700 1 -- 172.21.15.12:0/3807243360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834400b1e0 con 0x7f834c0b4690 2021-10-20T23:29:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f834a7fc700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 0x7f834c155f90 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f834c156ab0 tx=0x7f8334006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8343fff700 1 -- 172.21.15.12:0/3807243360 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8334010780 con 0x7f834c0b4690 2021-10-20T23:29:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8343fff700 1 -- 172.21.15.12:0/3807243360 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83340108e0 con 0x7f834c0b4690 2021-10-20T23:29:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834c0aed90 con 0x7f834c0b4690 2021-10-20T23:29:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8343fff700 1 -- 172.21.15.12:0/3807243360 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8334010c40 con 0x7f834c0b4690 2021-10-20T23:29:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.291+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834c155af0 con 0x7f834c0b4690 2021-10-20T23:29:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.295+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834c057350 con 0x7f834c0b4690 2021-10-20T23:29:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.295+0000 7f8343fff700 1 -- 172.21.15.12:0/3807243360 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f833401c460 con 0x7f834c0b4690 2021-10-20T23:29:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.295+0000 7f8343fff700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8330053580 0x7f8330055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.295+0000 7f8343fff700 1 -- 172.21.15.12:0/3807243360 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f833406be50 con 0x7f834c0b4690 2021-10-20T23:29:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.295+0000 7f834affd700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8330053580 0x7f8330055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.295+0000 7f834affd700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8330053580 0x7f8330055a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f833c00d000 tx=0x7f833c007ef0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:38.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.303+0000 7f8343fff700 1 -- 172.21.15.12:0/3807243360 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8334042df0 con 0x7f834c0b4690 2021-10-20T23:29:38.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.431+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f834c0ba620 con 0x7f834c0b4690 2021-10-20T23:29:38.440 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.431+0000 7f8343fff700 1 -- 172.21.15.12:0/3807243360 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v163) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8334046410 con 0x7f834c0b4690 2021-10-20T23:29:38.441 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8330053580 msgr2=0x7f8330055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8330053580 0x7f8330055a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f833c00d000 tx=0x7f833c007ef0).stop 2021-10-20T23:29:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 msgr2=0x7f834c155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 0x7f834c155f90 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f834c156ab0 tx=0x7f8334006df0).stop 2021-10-20T23:29:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 shutdown_connections 2021-10-20T23:29:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f8330053580 0x7f8330055a40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f834c146950 0x7f834c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c0b4690 0x7f834c155f90 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 --2- 172.21.15.12:0/3807243360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f834c0b4180 0x7f834c13f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 >> 172.21.15.12:0/3807243360 conn(0x7f834c05c490 msgr2=0x7f834c13b160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 shutdown_connections 2021-10-20T23:29:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.435+0000 7f8351840700 1 -- 172.21.15.12:0/3807243360 wait complete. 2021-10-20T23:29:38.460 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:29:38.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:38.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 Processor -- start 2021-10-20T23:29:38.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 -- start start 2021-10-20T23:29:38.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f836c066ff0 0x7f836c1438d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0ad030 0x7f836c143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c0673d0 con 0x7f836c0b06e0 2021-10-20T23:29:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c0affd0 con 0x7f836c066ff0 2021-10-20T23:29:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0b0270 con 0x7f836c0ad030 2021-10-20T23:29:38.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f837150d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f836c066ff0 0x7f836c1438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8371d0e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f836c0b06e0 0x7f836c0b0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44662/0 (socket says 172.21.15.12:44662) 2021-10-20T23:29:38.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8371d0e700 1 -- 172.21.15.12:0/3475578678 learned_addr learned my addr 172.21.15.12:0/3475578678 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:38.561 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8370d0c700 1 --2- 172.21.15.12:0/3475578678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0ad030 0x7f836c143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f837150d700 1 -- 172.21.15.12:0/3475578678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0ad030 msgr2=0x7f836c143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f837150d700 1 --2- 172.21.15.12:0/3475578678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0ad030 0x7f836c143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f837150d700 1 -- 172.21.15.12:0/3475578678 >> v1:172.21.15.12:6789/0 conn(0x7f836c0b06e0 legacy=0x7f836c0b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f835bfff700 1 -- 172.21.15.12:0/3475578678 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357928871 0 0) 0x7f836c0673d0 con 0x7f836c0b06e0 2021-10-20T23:29:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f837150d700 1 -- 172.21.15.12:0/3475578678 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0af3a0 con 0x7f836c066ff0 2021-10-20T23:29:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f837150d700 1 --2- 172.21.15.12:0/3475578678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 0x7f836c1438d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f83680032f0 tx=0x7f83680091d0).ready entity=mon.0 client_cookie=3d550926be445c7c server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f835bfff700 1 -- 172.21.15.12:0/3475578678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836800b6c0 con 0x7f836c066ff0 2021-10-20T23:29:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f835bfff700 1 -- 172.21.15.12:0/3475578678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836800b820 con 0x7f836c066ff0 2021-10-20T23:29:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f835bfff700 1 -- 172.21.15.12:0/3475578678 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836800b990 con 0x7f836c066ff0 2021-10-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 -- 172.21.15.12:0/3475578678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 msgr2=0x7f836c1438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 --2- 172.21.15.12:0/3475578678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 0x7f836c1438d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f83680032f0 tx=0x7f83680091d0).stop 2021-10-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 -- 172.21.15.12:0/3475578678 shutdown_connections 2021-10-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 --2- 172.21.15.12:0/3475578678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0ad030 0x7f836c143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 --2- 172.21.15.12:0/3475578678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 0x7f836c1438d0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 -- 172.21.15.12:0/3475578678 >> 172.21.15.12:0/3475578678 conn(0x7f836c05f6b0 msgr2=0x7f836c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:38.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 -- 172.21.15.12:0/3475578678 shutdown_connections 2021-10-20T23:29:38.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.547+0000 7f8373771700 1 -- 172.21.15.12:0/3475578678 wait complete. 2021-10-20T23:29:38.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 Processor -- start 2021-10-20T23:29:38.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 -- start start 2021-10-20T23:29:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 0x7f836c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0b06e0 0x7f836c13e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f836c13e980 0x7f836c0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0b3380 con 0x7f836c066ff0 2021-10-20T23:29:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c1535a0 con 0x7f836c13e980 2021-10-20T23:29:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0b4080 con 0x7f836c0b06e0 2021-10-20T23:29:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f837150d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 0x7f836c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f837150d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 0x7f836c1530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46070/0 (socket says 172.21.15.12:46070) 2021-10-20T23:29:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f837150d700 1 -- 172.21.15.12:0/1058106212 learned_addr learned my addr 172.21.15.12:0/1058106212 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8370d0c700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0b06e0 0x7f836c13e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8371d0e700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f836c13e980 0x7f836c0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f837150d700 1 -- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0b06e0 msgr2=0x7f836c13e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f837150d700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0b06e0 0x7f836c13e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f837150d700 1 -- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f836c13e980 msgr2=0x7f836c0a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f837150d700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f836c13e980 0x7f836c0a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f837150d700 1 -- 172.21.15.12:0/1058106212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368009470 con 0x7f836c066ff0 2021-10-20T23:29:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f837150d700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 0x7f836c1530b0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f836c140f90 tx=0x7f8368016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f835a7fc700 1 -- 172.21.15.12:0/1058106212 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836800b6c0 con 0x7f836c066ff0 2021-10-20T23:29:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f835a7fc700 1 -- 172.21.15.12:0/1058106212 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368021630 con 0x7f836c066ff0 2021-10-20T23:29:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c0b4320 con 0x7f836c066ff0 2021-10-20T23:29:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f835a7fc700 1 -- 172.21.15.12:0/1058106212 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8368021990 con 0x7f836c066ff0 2021-10-20T23:29:38.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.551+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c0b4860 con 0x7f836c066ff0 2021-10-20T23:29:38.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.555+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c057350 con 0x7f836c066ff0 2021-10-20T23:29:38.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.555+0000 7f835a7fc700 1 -- 172.21.15.12:0/1058106212 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8368027020 con 0x7f836c066ff0 2021-10-20T23:29:38.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.555+0000 7f835a7fc700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f834c0536d0 0x7f834c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:38.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.555+0000 7f835a7fc700 1 -- 172.21.15.12:0/1058106212 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f836806ce50 con 0x7f836c066ff0 2021-10-20T23:29:38.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.555+0000 7f8370d0c700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f834c0536d0 0x7f834c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:38.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.555+0000 7f8370d0c700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f834c0536d0 0x7f834c055b90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f835c00b000 tx=0x7f835c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:38.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.563+0000 7f835a7fc700 1 -- 172.21.15.12:0/1058106212 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8368043e50 con 0x7f836c066ff0 2021-10-20T23:29:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.727+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f836c044650 con 0x7f836c066ff0 2021-10-20T23:29:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.727+0000 7f835a7fc700 1 -- 172.21.15.12:0/1058106212 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f8368015020 con 0x7f836c066ff0 2021-10-20T23:29:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:38.737 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":84,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2957698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2957698261},{"type":"v1","addr":"172.21.15.31:6835","nonce":2957698261}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83},{"gid":8763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/1391258740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1391258740},{"type":"v1","addr":"172.21.15.12:6833","nonce":1391258740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:34.081034+0000","modified":"2021-10-20T23:29:35.098091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1536487631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1536487631},{"type":"v1","addr":"172.21.15.12:6835","nonce":1536487631}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-20T23:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f834c0536d0 msgr2=0x7f834c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f834c0536d0 0x7f834c055b90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f835c00b000 tx=0x7f835c006df0).stop 2021-10-20T23:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 msgr2=0x7f836c1530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 0x7f836c1530b0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f836c140f90 tx=0x7f8368016000).stop 2021-10-20T23:29:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 shutdown_connections 2021-10-20T23:29:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f834c0536d0 0x7f834c055b90 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f836c13e980 0x7f836c0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f836c0b06e0 0x7f836c13e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 --2- 172.21.15.12:0/1058106212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f836c066ff0 0x7f836c1530b0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 >> 172.21.15.12:0/1058106212 conn(0x7f836c05f6b0 msgr2=0x7f836c141170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 shutdown_connections 2021-10-20T23:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:38.731+0000 7f8373771700 1 -- 172.21.15.12:0/1058106212 wait complete. 2021-10-20T23:29:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 84 2021-10-20T23:29:39.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:29:34.081034+0000', 'modified': '2021-10-20T23:29:35.098091+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'c', 'rank': 0, 'incarnation': 83, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1536487631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1536487631}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1536487631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:29:39.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:29:39.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:29:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8772,"want_state":"up:active","state":"up:active","rank_uptime":5.0780682669999999,"mdsmap_epoch":84,"osdmap_epoch":163,"osdmap_epoch_barrier":162,"uptime":9.4227340870000003} 2021-10-20T23:29:39.181 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8772, "mdsmap_epoch": 84, "osdmap_epoch": 163, "osdmap_epoch_barrier": 162, "rank_uptime": 5.078068267, "state": "up:active", "uptime": 9.422734087, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:29:39.182 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:29:39.182 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-20T23:29:39.183 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi119.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-20T23:29:39.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:39.183 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:39.192 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:29:39.250 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:39.251 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:39.263 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:39.265 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:39.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:39.266 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:29:39.273 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:29:39.274 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:39.321 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:29:39.337 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:39.338 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:39.347 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:39.348 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:39.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:39.349 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:29:39.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[15127]: starting ceph client2021-10-20T23:29:39.387+0000 7fabac386080 -1 init, newargv = 0x5565d6099a50 newargc=9 2021-10-20T23:29:39.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr: 2021-10-20T23:29:39.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[15127]: starting fuse 2021-10-20T23:29:40.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2021-10-20T23:29:40.521 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:40.521 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:40.579 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:40.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:40.628 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2021-10-20T23:29:40.637 INFO:teuthology.orchestra.run.smithi119.stdout:52 2021-10-20T23:29:40.637 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:29:40.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:40.638 DEBUG:teuthology.orchestra.run.smithi119:> sudo python3 -c ' 2021-10-20T23:29:40.639 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2021-10-20T23:29:40.639 DEBUG:teuthology.orchestra.run.smithi119:> import re 2021-10-20T23:29:40.640 DEBUG:teuthology.orchestra.run.smithi119:> import os 2021-10-20T23:29:40.640 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2021-10-20T23:29:40.640 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:29:40.641 DEBUG:teuthology.orchestra.run.smithi119:> def find_socket(client_name): 2021-10-20T23:29:40.641 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-20T23:29:40.642 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2021-10-20T23:29:40.642 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:29:40.643 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2021-10-20T23:29:40.643 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2021-10-20T23:29:40.643 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2021-10-20T23:29:40.644 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2021-10-20T23:29:40.644 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:29:40.644 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2021-10-20T23:29:40.645 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:29:40.645 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:29:40.646 DEBUG:teuthology.orchestra.run.smithi119:> return f 2021-10-20T23:29:40.646 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:29:40.646 DEBUG:teuthology.orchestra.run.smithi119:> 2021-10-20T23:29:40.647 DEBUG:teuthology.orchestra.run.smithi119:> print(find_socket("client.0")) 2021-10-20T23:29:40.647 DEBUG:teuthology.orchestra.run.smithi119:> ' 2021-10-20T23:29:40.693 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.15127.asok 2021-10-20T23:29:40.698 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15127.asok 2021-10-20T23:29:40.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:40.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15127.asok status 2021-10-20T23:29:40.834 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2021-10-20T23:29:40.834 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2021-10-20T23:29:40.834 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:29:40.835 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:29:40.835 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2021-10-20T23:29:40.835 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2021-10-20T23:29:40.835 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-20T23:29:40.836 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "15127", 2021-10-20T23:29:40.836 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2021-10-20T23:29:40.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:29:40.836 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2021-10-20T23:29:40.836 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2021-10-20T23:29:40.837 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 7628, 2021-10-20T23:29:40.837 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2021-10-20T23:29:40.837 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2021-10-20T23:29:40.837 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2021-10-20T23:29:40.837 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 7628 2021-10-20T23:29:40.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:29:40.838 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:29:40.838 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:29:40.838 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:29:40.839 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3368766658 2021-10-20T23:29:40.839 INFO:teuthology.orchestra.run.smithi119.stdout: } 2021-10-20T23:29:40.839 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:29:40.839 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2021-10-20T23:29:40.840 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2021-10-20T23:29:40.840 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2021-10-20T23:29:40.840 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3368766658 2021-10-20T23:29:40.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2021-10-20T23:29:40.840 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.7628 172.21.15.119:0/3368766658", 2021-10-20T23:29:40.841 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/3368766658", 2021-10-20T23:29:40.841 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2021-10-20T23:29:40.841 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 84, 2021-10-20T23:29:40.841 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 163, 2021-10-20T23:29:40.841 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:29:40.842 INFO:teuthology.orchestra.run.smithi119.stdout: "blacklisted": false, 2021-10-20T23:29:40.842 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2021-10-20T23:29:40.842 INFO:teuthology.orchestra.run.smithi119.stdout:} 2021-10-20T23:29:40.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:40.844 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:40.845 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:40.852 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2021-10-20T23:29:40.853 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-20T23:29:40.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:40.854 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:29:40.871 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-20T23:29:40.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.970+0000 7f015bfff700 1 Processor -- start 2021-10-20T23:29:40.983 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.970+0000 7f015bfff700 1 -- start start 2021-10-20T23:29:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c0b0ff0 0x7f015c141790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c0aaa90 con 0x7f015c13e740 2021-10-20T23:29:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c0b2b00 con 0x7f015c0b2720 2021-10-20T23:29:40.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c140c90 con 0x7f015c0b0ff0 2021-10-20T23:29:40.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015a7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f015c13e740 0x7f015c141080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44672/0 (socket says 172.21.15.12:44672) 2021-10-20T23:29:40.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015a7fc700 1 -- 172.21.15.12:0/1047746336 learned_addr learned my addr 172.21.15.12:0/1047746336 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:40.988 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015b7fe700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c0b0ff0 0x7f015c141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:40.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339199480 0 0) 0x7f014c001110 con 0x7f015c13e740 2021-10-20T23:29:40.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0140003260 con 0x7f015c13e740 2021-10-20T23:29:40.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798175696 0 0) 0x7f015c0b2b00 con 0x7f015c0b2720 2021-10-20T23:29:40.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f014c001110 con 0x7f015c0b2720 2021-10-20T23:29:40.989 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 964713930 0 0) 0x7f0140003260 con 0x7f015c13e740 2021-10-20T23:29:40.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c0b0ff0 msgr2=0x7f015c141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:40.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c0b0ff0 0x7f015c141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:40.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 >> v1:172.21.15.31:6789/0 conn(0x7f015c0b2720 legacy=0x7f015c13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:40.990 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c0aa2b0 con 0x7f015c13e740 2021-10-20T23:29:40.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f014c001810 con 0x7f015c13e740 2021-10-20T23:29:40.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 >> v1:172.21.15.12:6789/0 conn(0x7f015c13e740 legacy=0x7f015c141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:40.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f0140003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:40.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c0b0ff0 0x7f0140004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:40.991 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01400049f0 0x7f0140004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:40.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014000b780 con 0x7f0140003910 2021-10-20T23:29:40.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014000b8f0 con 0x7f01400049f0 2021-10-20T23:29:40.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014000bab0 con 0x7f015c0b0ff0 2021-10-20T23:29:40.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015affd700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f0140003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:40.992 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015a7fc700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c0b0ff0 0x7f0140004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:40.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015b7fe700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01400049f0 0x7f0140004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:40.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015affd700 1 -- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c0b0ff0 msgr2=0x7f0140004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:40.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015affd700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c0b0ff0 0x7f0140004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:40.993 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015affd700 1 -- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01400049f0 msgr2=0x7f0140004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015affd700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01400049f0 0x7f0140004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015affd700 1 -- 172.21.15.12:0/1047746336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140003260 con 0x7f0140003910 2021-10-20T23:29:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015b7fe700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01400049f0 0x7f0140004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015affd700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f0140003d10 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f0150001110 tx=0x7f0150007a00).ready entity=mon.0 client_cookie=b8a78bc91cf90db3 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0150007d10 con 0x7f0140003910 2021-10-20T23:29:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150007030 con 0x7f0140003910 2021-10-20T23:29:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f0159ffb700 1 -- 172.21.15.12:0/1047746336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0150007390 con 0x7f0140003910 2021-10-20T23:29:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 -- 172.21.15.12:0/1047746336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 msgr2=0x7f0140003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 --2- 172.21.15.12:0/1047746336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f0140003d10 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f0150001110 tx=0x7f0150007a00).stop 2021-10-20T23:29:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015b7fe700 1 -- 172.21.15.12:0/1047746336 reap_dead start 2021-10-20T23:29:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 -- 172.21.15.12:0/1047746336 shutdown_connections 2021-10-20T23:29:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 -- 172.21.15.12:0/1047746336 >> 172.21.15.12:0/1047746336 conn(0x7f015c060180 msgr2=0x7f015c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 -- 172.21.15.12:0/1047746336 shutdown_connections 2021-10-20T23:29:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.974+0000 7f015bfff700 1 -- 172.21.15.12:0/1047746336 wait complete. 2021-10-20T23:29:41.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 Processor -- start 2021-10-20T23:29:41.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 -- start start 2021-10-20T23:29:41.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f015c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.000 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c13f080 0x7f015c142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f015c13faa0 0x7f015c0a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c140ba0 con 0x7f0140003910 2021-10-20T23:29:41.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c13f600 con 0x7f015c13faa0 2021-10-20T23:29:41.001 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c152a00 con 0x7f015c13f080 2021-10-20T23:29:41.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f015c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f015c152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46090/0 (socket says 172.21.15.12:46090) 2021-10-20T23:29:41.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015affd700 1 -- 172.21.15.12:0/2081075627 learned_addr learned my addr 172.21.15.12:0/2081075627 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:41.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015b7fe700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f015c13faa0 0x7f015c0a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.002 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015a7fc700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c13f080 0x7f015c142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015affd700 1 -- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c13f080 msgr2=0x7f015c142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015affd700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c13f080 0x7f015c142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015affd700 1 -- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f015c13faa0 msgr2=0x7f015c0a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015affd700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f015c13faa0 0x7f015c0a7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.003 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015affd700 1 -- 172.21.15.12:0/2081075627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c142700 con 0x7f0140003910 2021-10-20T23:29:41.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015affd700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f015c152510 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f0150001110 tx=0x7f0150016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f014bfff700 1 -- 172.21.15.12:0/2081075627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015001e420 con 0x7f0140003910 2021-10-20T23:29:41.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f014bfff700 1 -- 172.21.15.12:0/2081075627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015001e580 con 0x7f0140003910 2021-10-20T23:29:41.004 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c144990 con 0x7f0140003910 2021-10-20T23:29:41.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f014bfff700 1 -- 172.21.15.12:0/2081075627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015001e8e0 con 0x7f0140003910 2021-10-20T23:29:41.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.978+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c140540 con 0x7f0140003910 2021-10-20T23:29:41.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.982+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c140a00 con 0x7f0140003910 2021-10-20T23:29:41.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.982+0000 7f014bfff700 1 -- 172.21.15.12:0/2081075627 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0150024020 con 0x7f0140003910 2021-10-20T23:29:41.005 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.982+0000 7f014bfff700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0138053580 0x7f0138055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.982+0000 7f014bfff700 1 -- 172.21.15.12:0/2081075627 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f015006c540 con 0x7f0140003910 2021-10-20T23:29:41.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.982+0000 7f015a7fc700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0138053580 0x7f0138055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.982+0000 7f015a7fc700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0138053580 0x7f0138055a40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f014c005000 tx=0x7f014c0076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:40.986+0000 7f014bfff700 1 -- 172.21.15.12:0/2081075627 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f015c140a00 con 0x7f0140003910 2021-10-20T23:29:41.125 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.114+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f015c140a00 con 0x7f0140003910 2021-10-20T23:29:41.127 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f014bfff700 1 -- 172.21.15.12:0/2081075627 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f015c140a00 con 0x7f0140003910 2021-10-20T23:29:41.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:41.128 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":163,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:36.110591+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-20T23:29:32.496339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-20T23:29:33.438412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-20T23:29:41.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0138053580 msgr2=0x7f0138055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0138053580 0x7f0138055a40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f014c005000 tx=0x7f014c0076c0).stop 2021-10-20T23:29:41.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 msgr2=0x7f015c152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.130 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f015c152510 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f0150001110 tx=0x7f0150016000).stop 2021-10-20T23:29:41.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 shutdown_connections 2021-10-20T23:29:41.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0138053580 0x7f0138055a40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f015c13faa0 0x7f015c0a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f015c13f080 0x7f015c142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.131 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 --2- 172.21.15.12:0/2081075627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0140003910 0x7f015c152510 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 >> 172.21.15.12:0/2081075627 conn(0x7f015c060180 msgr2=0x7f015c0b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:41.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 shutdown_connections 2021-10-20T23:29:41.132 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.118+0000 7f015bfff700 1 -- 172.21.15.12:0/2081075627 wait complete. 2021-10-20T23:29:41.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-20T23:19:40.017051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-20T23:19:48.281190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-20T23:29:32.496339+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-10-20T23:29:33.438412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-20T23:29:41.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-20T23:29:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e7315700 1 Processor -- start 2021-10-20T23:29:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e7315700 1 -- start start 2021-10-20T23:29:41.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e7315700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2e00b0010 0x7fa2e00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e7315700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2e00afbd0 0x7fa2e00a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e7315700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e00a70c0 con 0x7fa2e00b2580 2021-10-20T23:29:41.260 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e7315700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e00a72f0 con 0x7fa2e00afbd0 2021-10-20T23:29:41.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e7315700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e00a7590 con 0x7fa2e00b0010 2021-10-20T23:29:41.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e6b14700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2e00afbd0 0x7fa2e00a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e6b14700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2e00afbd0 0x7fa2e00a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46102/0 (socket says 172.21.15.12:46102) 2021-10-20T23:29:41.261 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e6b14700 1 -- 172.21.15.12:0/1216777479 learned_addr learned my addr 172.21.15.12:0/1216777479 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e5b12700 1 --2- 172.21.15.12:0/1216777479 >> v2:172.21.15.31:3300/0 conn(0x7fa2e00b0010 0x7fa2e00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e6b14700 1 -- 172.21.15.12:0/1216777479 >> v2:172.21.15.31:3300/0 conn(0x7fa2e00b0010 msgr2=0x7fa2e00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e6b14700 1 --2- 172.21.15.12:0/1216777479 >> v2:172.21.15.31:3300/0 conn(0x7fa2e00b0010 0x7fa2e00a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e6b14700 1 -- 172.21.15.12:0/1216777479 >> v1:172.21.15.31:6789/0 conn(0x7fa2e00b2580 legacy=0x7fa2e014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e6b14700 1 -- 172.21.15.12:0/1216777479 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00a7830 con 0x7fa2e00afbd0 2021-10-20T23:29:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.238+0000 7fa2e6b14700 1 --2- 172.21.15.12:0/1216777479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00afbd0 0x7fa2e00a88a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fa2d8002f70 tx=0x7fa2d8006eb0).ready entity=mon.0 client_cookie=495c426f6aaeea1 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e5311700 1 -- 172.21.15.12:0/1216777479 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d800d5c0 con 0x7fa2e00afbd0 2021-10-20T23:29:41.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e5311700 1 -- 172.21.15.12:0/1216777479 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8000e90 con 0x7fa2e00afbd0 2021-10-20T23:29:41.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e5311700 1 -- 172.21.15.12:0/1216777479 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d800d950 con 0x7fa2e00afbd0 2021-10-20T23:29:41.264 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 -- 172.21.15.12:0/1216777479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00afbd0 msgr2=0x7fa2e00a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 --2- 172.21.15.12:0/1216777479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00afbd0 0x7fa2e00a88a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fa2d8002f70 tx=0x7fa2d8006eb0).stop 2021-10-20T23:29:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 -- 172.21.15.12:0/1216777479 shutdown_connections 2021-10-20T23:29:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 --2- 172.21.15.12:0/1216777479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00afbd0 0x7fa2e00a88a0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 --2- 172.21.15.12:0/1216777479 >> v2:172.21.15.31:3300/0 conn(0x7fa2e00b0010 0x7fa2e00a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.266 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 -- 172.21.15.12:0/1216777479 >> 172.21.15.12:0/1216777479 conn(0x7fa2e0060180 msgr2=0x7fa2e00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:41.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 -- 172.21.15.12:0/1216777479 shutdown_connections 2021-10-20T23:29:41.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 -- 172.21.15.12:0/1216777479 wait complete. 2021-10-20T23:29:41.267 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 Processor -- start 2021-10-20T23:29:41.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.242+0000 7fa2e7315700 1 -- start start 2021-10-20T23:29:41.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e7315700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2e00afbd0 0x7fa2e00a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e7315700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00b0010 0x7fa2e01464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e7315700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2e00b2580 0x7fa2e0146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e7315700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00aabe0 con 0x7fa2e00b0010 2021-10-20T23:29:41.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e7315700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00aae80 con 0x7fa2e00afbd0 2021-10-20T23:29:41.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e7315700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00ab120 con 0x7fa2e00b2580 2021-10-20T23:29:41.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e5b12700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00b0010 0x7fa2e01464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.271 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e5b12700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00b0010 0x7fa2e01464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46106/0 (socket says 172.21.15.12:46106) 2021-10-20T23:29:41.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e5b12700 1 -- 172.21.15.12:0/3180381992 learned_addr learned my addr 172.21.15.12:0/3180381992 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:41.272 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e6313700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2e00afbd0 0x7fa2e00a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e6b14700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2e00b2580 0x7fa2e0146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e5b12700 1 -- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2e00b2580 msgr2=0x7fa2e0146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.273 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e5b12700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2e00b2580 0x7fa2e0146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e5b12700 1 -- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2e00afbd0 msgr2=0x7fa2e00a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.274 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e5b12700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2e00afbd0 0x7fa2e00a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e5b12700 1 -- 172.21.15.12:0/3180381992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d800b1e0 con 0x7fa2e00b0010 2021-10-20T23:29:41.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e5b12700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00b0010 0x7fa2e01464a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fa2dc00c000 tx=0x7fa2dc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2cf7fe700 1 -- 172.21.15.12:0/3180381992 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2dc00ee00 con 0x7fa2e00b0010 2021-10-20T23:29:41.275 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2cf7fe700 1 -- 172.21.15.12:0/3180381992 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc00c850 con 0x7fa2e00b0010 2021-10-20T23:29:41.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e00ab3c0 con 0x7fa2e00b0010 2021-10-20T23:29:41.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2cf7fe700 1 -- 172.21.15.12:0/3180381992 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2dc00cbb0 con 0x7fa2e00b0010 2021-10-20T23:29:41.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.246+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e0146e80 con 0x7fa2e00b0010 2021-10-20T23:29:41.276 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.250+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e00ab550 con 0x7fa2e00b0010 2021-10-20T23:29:41.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.250+0000 7fa2cf7fe700 1 -- 172.21.15.12:0/3180381992 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa2dc00cd10 con 0x7fa2e00b0010 2021-10-20T23:29:41.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.250+0000 7fa2cf7fe700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2c0053610 0x7fa2c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.250+0000 7fa2cf7fe700 1 -- 172.21.15.12:0/3180381992 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa2dc06bca0 con 0x7fa2e00b0010 2021-10-20T23:29:41.278 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.250+0000 7fa2e6313700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2c0053610 0x7fa2c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.250+0000 7fa2e6313700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2c0053610 0x7fa2c0055ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fa2d000d000 tx=0x7fa2d0007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.279 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.254+0000 7fa2cf7fe700 1 -- 172.21.15.12:0/3180381992 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2dc070070 con 0x7fa2e00b0010 2021-10-20T23:29:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.386+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa2e0057350 con 0x7fa2e00b0010 2021-10-20T23:29:41.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.386+0000 7fa2cf7fe700 1 -- 172.21.15.12:0/3180381992 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v163) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa2dc042ca0 con 0x7fa2e00b0010 2021-10-20T23:29:41.399 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2021-10-20T23:29:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2c0053610 msgr2=0x7fa2c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2c0053610 0x7fa2c0055ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fa2d000d000 tx=0x7fa2d0007b70).stop 2021-10-20T23:29:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00b0010 msgr2=0x7fa2e01464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00b0010 0x7fa2e01464a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fa2dc00c000 tx=0x7fa2dc0091d0).stop 2021-10-20T23:29:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 shutdown_connections 2021-10-20T23:29:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa2c0053610 0x7fa2c0055ad0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2e00b2580 0x7fa2e0146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e00b0010 0x7fa2e01464a0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 --2- 172.21.15.12:0/3180381992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2e00afbd0 0x7fa2e00a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 >> 172.21.15.12:0/3180381992 conn(0x7fa2e0060180 msgr2=0x7fa2e014cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:41.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 shutdown_connections 2021-10-20T23:29:41.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.390+0000 7fa2e7315700 1 -- 172.21.15.12:0/3180381992 wait complete. 2021-10-20T23:29:41.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-20T23:29:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.514+0000 7f743359e700 1 Processor -- start 2021-10-20T23:29:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.514+0000 7f743359e700 1 -- start start 2021-10-20T23:29:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.514+0000 7f743359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340b2580 0x7f743414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.514+0000 7f743359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74340b0010 0x7f743414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.514+0000 7f743359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74340a70c0 con 0x7f74340afbd0 2021-10-20T23:29:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.514+0000 7f743359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74340a72f0 con 0x7f74340b0010 2021-10-20T23:29:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.514+0000 7f743359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74340a7590 con 0x7f74340b2580 2021-10-20T23:29:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.514+0000 7f7431d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74340b0010 0x7f743414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f7431d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74340b0010 0x7f743414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46114/0 (socket says 172.21.15.12:46114) 2021-10-20T23:29:41.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f7431d9b700 1 -- 172.21.15.12:0/2892772247 learned_addr learned my addr 172.21.15.12:0/2892772247 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:41.540 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743259c700 1 --2- 172.21.15.12:0/2892772247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340b2580 0x7f743414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f7431d9b700 1 -- 172.21.15.12:0/2892772247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340b2580 msgr2=0x7f743414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:41.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f7431d9b700 1 --2- 172.21.15.12:0/2892772247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340b2580 0x7f743414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.541 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f7431d9b700 1 -- 172.21.15.12:0/2892772247 >> v1:172.21.15.31:6789/0 conn(0x7f74340afbd0 legacy=0x7f74340a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f7431d9b700 1 -- 172.21.15.12:0/2892772247 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74340a7830 con 0x7f74340b0010 2021-10-20T23:29:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f7431d9b700 1 --2- 172.21.15.12:0/2892772247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 0x7f743414b330 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f74240032f0 tx=0x7f7424009290).ready entity=mon.0 client_cookie=ed0d4b5cd36c252d server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743159a700 1 -- 172.21.15.12:0/2892772247 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f742400b8a0 con 0x7f74340b0010 2021-10-20T23:29:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743159a700 1 -- 172.21.15.12:0/2892772247 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742400ba00 con 0x7f74340b0010 2021-10-20T23:29:41.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743159a700 1 -- 172.21.15.12:0/2892772247 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f742400bb70 con 0x7f74340b0010 2021-10-20T23:29:41.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 -- 172.21.15.12:0/2892772247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 msgr2=0x7f743414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.544 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 --2- 172.21.15.12:0/2892772247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 0x7f743414b330 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f74240032f0 tx=0x7f7424009290).stop 2021-10-20T23:29:41.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 -- 172.21.15.12:0/2892772247 shutdown_connections 2021-10-20T23:29:41.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 --2- 172.21.15.12:0/2892772247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 0x7f743414b330 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 --2- 172.21.15.12:0/2892772247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340b2580 0x7f743414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.545 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 -- 172.21.15.12:0/2892772247 >> 172.21.15.12:0/2892772247 conn(0x7f7434060180 msgr2=0x7f74340b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:41.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 -- 172.21.15.12:0/2892772247 shutdown_connections 2021-10-20T23:29:41.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 -- 172.21.15.12:0/2892772247 wait complete. 2021-10-20T23:29:41.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 Processor -- start 2021-10-20T23:29:41.546 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.518+0000 7f743359e700 1 -- start start 2021-10-20T23:29:41.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340afbd0 0x7f74340b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 0x7f74340b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.547 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74340b2580 0x7f74340ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340b3790 con 0x7f74340b0010 2021-10-20T23:29:41.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340abf10 con 0x7f74340b2580 2021-10-20T23:29:41.548 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74340ac1b0 con 0x7f74340afbd0 2021-10-20T23:29:41.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f7431d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 0x7f74340b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.549 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f7431d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 0x7f74340b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46118/0 (socket says 172.21.15.12:46118) 2021-10-20T23:29:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f7431d9b700 1 -- 172.21.15.12:0/949290822 learned_addr learned my addr 172.21.15.12:0/949290822 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743259c700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340afbd0 0x7f74340b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f7432d9d700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74340b2580 0x7f74340ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743259c700 1 -- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74340b2580 msgr2=0x7f74340ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743259c700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74340b2580 0x7f74340ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743259c700 1 -- 172.21.15.12:0/949290822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 msgr2=0x7f74340b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743259c700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 0x7f74340b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743259c700 1 -- 172.21.15.12:0/949290822 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424009530 con 0x7f74340afbd0 2021-10-20T23:29:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f7431d9b700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 0x7f74340b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743259c700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340afbd0 0x7f74340b3160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f742800a000 tx=0x7f7428008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f74237fe700 1 -- 172.21.15.12:0/949290822 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74280106e0 con 0x7f74340afbd0 2021-10-20T23:29:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f74237fe700 1 -- 172.21.15.12:0/949290822 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428010840 con 0x7f74340afbd0 2021-10-20T23:29:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74340ac450 con 0x7f74340afbd0 2021-10-20T23:29:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f74237fe700 1 -- 172.21.15.12:0/949290822 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7428010ba0 con 0x7f74340afbd0 2021-10-20T23:29:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.522+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74340b3a70 con 0x7f74340afbd0 2021-10-20T23:29:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.526+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74340ac5e0 con 0x7f74340afbd0 2021-10-20T23:29:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.526+0000 7f74237fe700 1 -- 172.21.15.12:0/949290822 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f742801a030 con 0x7f74340afbd0 2021-10-20T23:29:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.526+0000 7f74237fe700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7410053640 0x7f7410055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.526+0000 7f74237fe700 1 -- 172.21.15.12:0/949290822 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f742806b5f0 con 0x7f74340afbd0 2021-10-20T23:29:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.526+0000 7f7431d9b700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7410053640 0x7f7410055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.526+0000 7f7431d9b700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7410053640 0x7f7410055b00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f742401b000 tx=0x7f7424016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.534+0000 7f74237fe700 1 -- 172.21.15.12:0/949290822 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7428042590 con 0x7f74340afbd0 2021-10-20T23:29:41.677 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.666+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7434057350 con 0x7f74340afbd0 2021-10-20T23:29:41.679 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.666+0000 7f74237fe700 1 -- 172.21.15.12:0/949290822 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7428045bb0 con 0x7f74340afbd0 2021-10-20T23:29:41.679 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:41.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7410053640 msgr2=0x7f7410055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.683 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7410053640 0x7f7410055b00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f742401b000 tx=0x7f7424016000).stop 2021-10-20T23:29:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340afbd0 msgr2=0x7f74340b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340afbd0 0x7f74340b3160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f742800a000 tx=0x7f7428008040).stop 2021-10-20T23:29:41.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 shutdown_connections 2021-10-20T23:29:41.685 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7410053640 0x7f7410055b00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74340b2580 0x7f74340ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.686 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74340b0010 0x7f74340b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 --2- 172.21.15.12:0/949290822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74340afbd0 0x7f74340b3160 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 >> 172.21.15.12:0/949290822 conn(0x7f7434060180 msgr2=0x7f7434149de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:41.687 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 shutdown_connections 2021-10-20T23:29:41.688 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.670+0000 7f743359e700 1 -- 172.21.15.12:0/949290822 wait complete. 2021-10-20T23:29:41.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-20T23:29:41.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.790+0000 7f8441c6f700 1 Processor -- start 2021-10-20T23:29:41.802 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.790+0000 7f8441c6f700 1 -- start start 2021-10-20T23:29:41.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.790+0000 7f8441c6f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f843c0b21b0 0x7f843c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.807 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.790+0000 7f8441c6f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c143c90 0x7f843c12c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.790+0000 7f8441c6f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c0b3c40 con 0x7f843c060d20 2021-10-20T23:29:41.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.790+0000 7f8441c6f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c063df0 con 0x7f843c0b21b0 2021-10-20T23:29:41.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.790+0000 7f8441c6f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0b2590 con 0x7f843c143c90 2021-10-20T23:29:41.808 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f843c060d20 0x7f843c0b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44720/0 (socket says 172.21.15.12:44720) 2021-10-20T23:29:41.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843bfff700 1 -- 172.21.15.12:0/1323250918 learned_addr learned my addr 172.21.15.12:0/1323250918 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:41.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8440c6d700 1 --2- 172.21.15.12:0/1323250918 >> v2:172.21.15.31:3300/0 conn(0x7f843c0b21b0 0x7f843c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f844146e700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c143c90 0x7f843c12c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906127542 0 0) 0x7f843c0b3c40 con 0x7f843c060d20 2021-10-20T23:29:41.809 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8428003260 con 0x7f843c060d20 2021-10-20T23:29:41.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 472102914 0 0) 0x7f8428003260 con 0x7f843c060d20 2021-10-20T23:29:41.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c143c90 msgr2=0x7f843c12c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:41.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c143c90 0x7f843c12c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.810 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 >> v2:172.21.15.31:3300/0 conn(0x7f843c0b21b0 msgr2=0x7f843c05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:41.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 --2- 172.21.15.12:0/1323250918 >> v2:172.21.15.31:3300/0 conn(0x7f843c0b21b0 0x7f843c05f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c0b2e30 con 0x7f843c060d20 2021-10-20T23:29:41.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f8430001660 con 0x7f843c060d20 2021-10-20T23:29:41.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8440c6d700 1 --2- 172.21.15.12:0/1323250918 >> v2:172.21.15.31:3300/0 conn(0x7f843c0b21b0 0x7f843c05f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:41.811 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 >> v1:172.21.15.12:6789/0 conn(0x7f843c060d20 legacy=0x7f843c0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c143c90 0x7f8428003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8428003c80 0x7f8428004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84280049f0 0x7f8428004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c063df0 con 0x7f84280049f0 2021-10-20T23:29:41.812 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0b2590 con 0x7f8428003c80 2021-10-20T23:29:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842800b750 con 0x7f843c143c90 2021-10-20T23:29:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8440c6d700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c143c90 0x7f8428003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843bfff700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8428003c80 0x7f8428004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f844146e700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84280049f0 0x7f8428004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8440c6d700 1 -- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8428003c80 msgr2=0x7f8428004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:41.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8440c6d700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8428003c80 0x7f8428004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8440c6d700 1 -- 172.21.15.12:0/1323250918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84280049f0 msgr2=0x7f8428004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:41.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8440c6d700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84280049f0 0x7f8428004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.814 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8440c6d700 1 -- 172.21.15.12:0/1323250918 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428003260 con 0x7f843c143c90 2021-10-20T23:29:41.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8440c6d700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c143c90 0x7f8428003750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f842c00c000 tx=0x7f842c006df0).ready entity=mon.2 client_cookie=70411798c1e5d89e server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f842c00e830 con 0x7f843c143c90 2021-10-20T23:29:41.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00e990 con 0x7f843c143c90 2021-10-20T23:29:41.815 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f843b7fe700 1 -- 172.21.15.12:0/1323250918 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f842c00ecf0 con 0x7f843c143c90 2021-10-20T23:29:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8441c6f700 1 -- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c143c90 msgr2=0x7f8428003750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8441c6f700 1 --2- 172.21.15.12:0/1323250918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c143c90 0x7f8428003750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f842c00c000 tx=0x7f842c006df0).stop 2021-10-20T23:29:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f844146e700 1 -- 172.21.15.12:0/1323250918 reap_dead start 2021-10-20T23:29:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8441c6f700 1 -- 172.21.15.12:0/1323250918 shutdown_connections 2021-10-20T23:29:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8441c6f700 1 -- 172.21.15.12:0/1323250918 >> 172.21.15.12:0/1323250918 conn(0x7f843c05c490 msgr2=0x7f843c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8441c6f700 1 -- 172.21.15.12:0/1323250918 shutdown_connections 2021-10-20T23:29:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.794+0000 7f8441c6f700 1 -- 172.21.15.12:0/1323250918 wait complete. 2021-10-20T23:29:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f8441c6f700 1 Processor -- start 2021-10-20T23:29:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f8441c6f700 1 -- start start 2021-10-20T23:29:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f8441c6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f843c143c90 0x7f843c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f8441c6f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843c144410 0x7f843c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f8441c6f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c152d30 0x7f843c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f8441c6f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c156730 con 0x7f843c144410 2021-10-20T23:29:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f8441c6f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c067160 con 0x7f843c143c90 2021-10-20T23:29:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f8441c6f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c066ec0 con 0x7f843c152d30 2021-10-20T23:29:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f843bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843c144410 0x7f843c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f843bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843c144410 0x7f843c152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46138/0 (socket says 172.21.15.12:46138) 2021-10-20T23:29:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.798+0000 7f843bfff700 1 -- 172.21.15.12:0/128854993 learned_addr learned my addr 172.21.15.12:0/128854993 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f8440c6d700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f843c143c90 0x7f843c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f844146e700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c152d30 0x7f843c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f843bfff700 1 -- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c152d30 msgr2=0x7f843c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f843bfff700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c152d30 0x7f843c1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f843bfff700 1 -- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f843c143c90 msgr2=0x7f843c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f843bfff700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f843c143c90 0x7f843c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f843bfff700 1 -- 172.21.15.12:0/128854993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c1474c0 con 0x7f843c144410 2021-10-20T23:29:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f843bfff700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843c144410 0x7f843c152840 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f8430001110 tx=0x7f8430001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f8439ffb700 1 -- 172.21.15.12:0/128854993 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84300116b0 con 0x7f843c144410 2021-10-20T23:29:41.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f8439ffb700 1 -- 172.21.15.12:0/128854993 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430011810 con 0x7f843c144410 2021-10-20T23:29:41.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c144920 con 0x7f843c144410 2021-10-20T23:29:41.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f8439ffb700 1 -- 172.21.15.12:0/128854993 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8430011b70 con 0x7f843c144410 2021-10-20T23:29:41.825 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c065480 con 0x7f843c144410 2021-10-20T23:29:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c156a70 con 0x7f843c144410 2021-10-20T23:29:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.802+0000 7f8439ffb700 1 -- 172.21.15.12:0/128854993 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f843001b030 con 0x7f843c144410 2021-10-20T23:29:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.806+0000 7f8439ffb700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f841c0534f0 0x7f841c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.806+0000 7f8439ffb700 1 -- 172.21.15.12:0/128854993 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f843006b630 con 0x7f843c144410 2021-10-20T23:29:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.806+0000 7f8440c6d700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f841c0534f0 0x7f841c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.806+0000 7f8440c6d700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f841c0534f0 0x7f841c0559b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f842c01e000 tx=0x7f842c019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.810+0000 7f8439ffb700 1 -- 172.21.15.12:0/128854993 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8430042630 con 0x7f843c144410 2021-10-20T23:29:41.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.934+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f843c156550 con 0x7f843c144410 2021-10-20T23:29:41.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8439ffb700 1 -- 172.21.15.12:0/128854993 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8430019070 con 0x7f843c144410 2021-10-20T23:29:41.948 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f841c0534f0 msgr2=0x7f841c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f841c0534f0 0x7f841c0559b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f842c01e000 tx=0x7f842c019000).stop 2021-10-20T23:29:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843c144410 msgr2=0x7f843c152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843c144410 0x7f843c152840 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f8430001110 tx=0x7f8430001e50).stop 2021-10-20T23:29:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 shutdown_connections 2021-10-20T23:29:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f841c0534f0 0x7f841c0559b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f843c152d30 0x7f843c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843c144410 0x7f843c152840 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 --2- 172.21.15.12:0/128854993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f843c143c90 0x7f843c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:41.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 >> 172.21.15.12:0/128854993 conn(0x7f843c05c490 msgr2=0x7f843c0b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:41.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 shutdown_connections 2021-10-20T23:29:41.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:41.938+0000 7f8441c6f700 1 -- 172.21.15.12:0/128854993 wait complete. 2021-10-20T23:29:41.963 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-20T23:29:42.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd556988700 1 Processor -- start 2021-10-20T23:29:42.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd556988700 1 -- start start 2021-10-20T23:29:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd556988700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 0x7fd5500b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd556988700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5500b06c0 0x7fd5500aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd556988700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5500b1c60 con 0x7fd5500ac260 2021-10-20T23:29:42.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd556988700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5500a9d40 con 0x7fd5500b06c0 2021-10-20T23:29:42.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd556988700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500b2940 con 0x7fd5500a9960 2021-10-20T23:29:42.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd54f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd5500ac260 0x7fd5500aec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44742/0 (socket says 172.21.15.12:44742) 2021-10-20T23:29:42.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd54f7fe700 1 -- 172.21.15.12:0/1619816469 learned_addr learned my addr 172.21.15.12:0/1619816469 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:42.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd554f25700 1 --2- 172.21.15.12:0/1619816469 >> v2:172.21.15.31:3300/0 conn(0x7fd5500b06c0 0x7fd5500aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd54ffff700 1 --2- 172.21.15.12:0/1619816469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 0x7fd5500b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd54effd700 1 -- 172.21.15.12:0/1619816469 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111481171 0 0) 0x7fd544001110 con 0x7fd5500ac260 2021-10-20T23:29:42.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd54effd700 1 -- 172.21.15.12:0/1619816469 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd53c003260 con 0x7fd5500ac260 2021-10-20T23:29:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd554f25700 1 -- 172.21.15.12:0/1619816469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 msgr2=0x7fd5500b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd554f25700 1 --2- 172.21.15.12:0/1619816469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 0x7fd5500b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd554f25700 1 -- 172.21.15.12:0/1619816469 >> v1:172.21.15.12:6789/0 conn(0x7fd5500ac260 legacy=0x7fd5500aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd554f25700 1 -- 172.21.15.12:0/1619816469 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5500b00c0 con 0x7fd5500b06c0 2021-10-20T23:29:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd554f25700 1 --2- 172.21.15.12:0/1619816469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5500b06c0 0x7fd5500aafa0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fd5480032f0 tx=0x7fd5480091d0).ready entity=mon.1 client_cookie=971e18cb1565723b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd54effd700 1 -- 172.21.15.12:0/1619816469 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54800b600 con 0x7fd5500b06c0 2021-10-20T23:29:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd54effd700 1 -- 172.21.15.12:0/1619816469 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54800b760 con 0x7fd5500b06c0 2021-10-20T23:29:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.062+0000 7fd54effd700 1 -- 172.21.15.12:0/1619816469 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54800b8d0 con 0x7fd5500b06c0 2021-10-20T23:29:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 -- 172.21.15.12:0/1619816469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5500b06c0 msgr2=0x7fd5500aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 --2- 172.21.15.12:0/1619816469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5500b06c0 0x7fd5500aafa0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fd5480032f0 tx=0x7fd5480091d0).stop 2021-10-20T23:29:42.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 -- 172.21.15.12:0/1619816469 shutdown_connections 2021-10-20T23:29:42.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 --2- 172.21.15.12:0/1619816469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5500b06c0 0x7fd5500aafa0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 --2- 172.21.15.12:0/1619816469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 0x7fd5500b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 -- 172.21.15.12:0/1619816469 >> 172.21.15.12:0/1619816469 conn(0x7fd55005f6b0 msgr2=0x7fd55005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:42.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 -- 172.21.15.12:0/1619816469 shutdown_connections 2021-10-20T23:29:42.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 -- 172.21.15.12:0/1619816469 wait complete. 2021-10-20T23:29:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 Processor -- start 2021-10-20T23:29:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 -- start start 2021-10-20T23:29:42.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 0x7fd5500b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5500ac260 0x7fd550150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5500b06c0 0x7fd550150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500649f0 con 0x7fd5500ac260 2021-10-20T23:29:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550154840 con 0x7fd5500b06c0 2021-10-20T23:29:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd556988700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd550064780 con 0x7fd5500a9960 2021-10-20T23:29:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd54f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5500ac260 0x7fd550150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd54ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 0x7fd5500b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd54f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5500ac260 0x7fd550150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46152/0 (socket says 172.21.15.12:46152) 2021-10-20T23:29:42.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd54f7fe700 1 -- 172.21.15.12:0/3005430925 learned_addr learned my addr 172.21.15.12:0/3005430925 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:42.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.066+0000 7fd554f25700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5500b06c0 0x7fd550150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54ffff700 1 -- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5500b06c0 msgr2=0x7fd550150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54ffff700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5500b06c0 0x7fd550150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54ffff700 1 -- 172.21.15.12:0/3005430925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5500ac260 msgr2=0x7fd550150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54ffff700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5500ac260 0x7fd550150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54ffff700 1 -- 172.21.15.12:0/3005430925 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd548009470 con 0x7fd5500a9960 2021-10-20T23:29:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54f7fe700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5500ac260 0x7fd550150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54ffff700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 0x7fd5500b5190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fd54000c000 tx=0x7fd540006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54d7fa700 1 -- 172.21.15.12:0/3005430925 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd540010780 con 0x7fd5500a9960 2021-10-20T23:29:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54d7fa700 1 -- 172.21.15.12:0/3005430925 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5400108e0 con 0x7fd5500a9960 2021-10-20T23:29:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd550154a30 con 0x7fd5500a9960 2021-10-20T23:29:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54d7fa700 1 -- 172.21.15.12:0/3005430925 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd540010c40 con 0x7fd5500a9960 2021-10-20T23:29:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5500b5680 con 0x7fd5500a9960 2021-10-20T23:29:42.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd550057350 con 0x7fd5500a9960 2021-10-20T23:29:42.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54d7fa700 1 -- 172.21.15.12:0/3005430925 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd54001c460 con 0x7fd5500a9960 2021-10-20T23:29:42.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54d7fa700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5300534f0 0x7fd5300559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.070+0000 7fd54d7fa700 1 -- 172.21.15.12:0/3005430925 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd54006bd80 con 0x7fd5500a9960 2021-10-20T23:29:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.074+0000 7fd54f7fe700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5300534f0 0x7fd5300559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.074+0000 7fd54f7fe700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5300534f0 0x7fd5300559b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fd54400d000 tx=0x7fd544000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.078+0000 7fd54d7fa700 1 -- 172.21.15.12:0/3005430925 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd540042c80 con 0x7fd5500a9960 2021-10-20T23:29:42.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.210+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd550067ca0 con 0x7fd5500a9960 2021-10-20T23:29:42.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.210+0000 7fd54d7fa700 1 -- 172.21.15.12:0/3005430925 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v163) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd54006d070 con 0x7fd5500a9960 2021-10-20T23:29:42.223 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2021-10-20T23:29:42.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5300534f0 msgr2=0x7fd5300559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5300534f0 0x7fd5300559b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fd54400d000 tx=0x7fd544000bc0).stop 2021-10-20T23:29:42.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 msgr2=0x7fd5500b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 0x7fd5500b5190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fd54000c000 tx=0x7fd540006df0).stop 2021-10-20T23:29:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 shutdown_connections 2021-10-20T23:29:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd5300534f0 0x7fd5300559b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5500b06c0 0x7fd550150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5500ac260 0x7fd550150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 --2- 172.21.15.12:0/3005430925 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5500a9960 0x7fd5500b5190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 >> 172.21.15.12:0/3005430925 conn(0x7fd55005f6b0 msgr2=0x7fd550141af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:42.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 shutdown_connections 2021-10-20T23:29:42.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.214+0000 7fd556988700 1 -- 172.21.15.12:0/3005430925 wait complete. 2021-10-20T23:29:42.241 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-20T23:29:42.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 Processor -- start 2021-10-20T23:29:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 -- start start 2021-10-20T23:29:42.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40b10b0 0x7fb6a40b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6a40aeec0 0x7fb6a40b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a40b1de0 con 0x7fb6a405d760 2021-10-20T23:29:42.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a41434a0 con 0x7fb6a40aeec0 2021-10-20T23:29:42.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40af630 con 0x7fb6a40b10b0 2021-10-20T23:29:42.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a93ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6a40aeec0 0x7fb6a40b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a8bfe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40b10b0 0x7fb6a40b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb6a405d760 0x7fb6a40ae7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:51816/0 (socket says 172.21.15.12:51816) 2021-10-20T23:29:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a93ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6a40aeec0 0x7fb6a40b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46162/0 (socket says 172.21.15.12:46162) 2021-10-20T23:29:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a3fff700 1 -- 172.21.15.12:0/3407513843 learned_addr learned my addr 172.21.15.12:0/3407513843 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a37fe700 1 -- 172.21.15.12:0/3407513843 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303694995 0 0) 0x7fb6a40b1de0 con 0x7fb6a405d760 2021-10-20T23:29:42.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a37fe700 1 -- 172.21.15.12:0/3407513843 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb690003260 con 0x7fb6a405d760 2021-10-20T23:29:42.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a93ff700 1 -- 172.21.15.12:0/3407513843 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40b10b0 msgr2=0x7fb6a40b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:42.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a93ff700 1 --2- 172.21.15.12:0/3407513843 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40b10b0 0x7fb6a40b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a93ff700 1 -- 172.21.15.12:0/3407513843 >> v1:172.21.15.31:6789/0 conn(0x7fb6a405d760 legacy=0x7fb6a40ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a93ff700 1 -- 172.21.15.12:0/3407513843 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40af8d0 con 0x7fb6a40aeec0 2021-10-20T23:29:42.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a8bfe700 1 --2- 172.21.15.12:0/3407513843 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40b10b0 0x7fb6a40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:42.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a93ff700 1 --2- 172.21.15.12:0/3407513843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40aeec0 0x7fb6a40b03a0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fb6a41435e0 tx=0x7fb69c00b470).ready entity=mon.0 client_cookie=97d36c2a1379296b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:42.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a37fe700 1 -- 172.21.15.12:0/3407513843 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb69c00dd30 con 0x7fb6a40aeec0 2021-10-20T23:29:42.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a37fe700 1 -- 172.21.15.12:0/3407513843 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c00de90 con 0x7fb6a40aeec0 2021-10-20T23:29:42.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a37fe700 1 -- 172.21.15.12:0/3407513843 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb69c010660 con 0x7fb6a40aeec0 2021-10-20T23:29:42.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 -- 172.21.15.12:0/3407513843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40aeec0 msgr2=0x7fb6a40b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 --2- 172.21.15.12:0/3407513843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40aeec0 0x7fb6a40b03a0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fb6a41435e0 tx=0x7fb69c00b470).stop 2021-10-20T23:29:42.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 -- 172.21.15.12:0/3407513843 shutdown_connections 2021-10-20T23:29:42.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 --2- 172.21.15.12:0/3407513843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a40aeec0 0x7fb6a40b03a0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 --2- 172.21.15.12:0/3407513843 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40b10b0 0x7fb6a40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 -- 172.21.15.12:0/3407513843 >> 172.21.15.12:0/3407513843 conn(0x7fb6a405c490 msgr2=0x7fb6a405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:42.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 -- 172.21.15.12:0/3407513843 shutdown_connections 2021-10-20T23:29:42.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.338+0000 7fb6a9c00700 1 -- 172.21.15.12:0/3407513843 wait complete. 2021-10-20T23:29:42.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 Processor -- start 2021-10-20T23:29:42.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 -- start start 2021-10-20T23:29:42.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a405d760 0x7fb6a40a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40aeec0 0x7fb6a409ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6a40b10b0 0x7fb6a409ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a41565d0 con 0x7fb6a405d760 2021-10-20T23:29:42.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40ab800 con 0x7fb6a40b10b0 2021-10-20T23:29:42.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40ab560 con 0x7fb6a40aeec0 2021-10-20T23:29:42.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a8bfe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a405d760 0x7fb6a40a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a8bfe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a405d760 0x7fb6a40a1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46164/0 (socket says 172.21.15.12:46164) 2021-10-20T23:29:42.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a8bfe700 1 -- 172.21.15.12:0/2055646302 learned_addr learned my addr 172.21.15.12:0/2055646302 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:42.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a3fff700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40aeec0 0x7fb6a409ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a93ff700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6a40b10b0 0x7fb6a409ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a8bfe700 1 -- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40aeec0 msgr2=0x7fb6a409ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a8bfe700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40aeec0 0x7fb6a409ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a8bfe700 1 -- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6a40b10b0 msgr2=0x7fb6a409ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a8bfe700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6a40b10b0 0x7fb6a409ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a8bfe700 1 -- 172.21.15.12:0/2055646302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69800b180 con 0x7fb6a405d760 2021-10-20T23:29:42.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a93ff700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6a40b10b0 0x7fb6a409ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:29:42.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a8bfe700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a405d760 0x7fb6a40a1130 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fb69800c000 tx=0x7fb698006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:42.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a1ffb700 1 -- 172.21.15.12:0/2055646302 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb69800c860 con 0x7fb6a405d760 2021-10-20T23:29:42.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a1ffb700 1 -- 172.21.15.12:0/2055646302 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69800c9c0 con 0x7fb6a405d760 2021-10-20T23:29:42.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c00b710 con 0x7fb6a405d760 2021-10-20T23:29:42.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a1ffb700 1 -- 172.21.15.12:0/2055646302 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb69800cd20 con 0x7fb6a405d760 2021-10-20T23:29:42.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.342+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a40ab1b0 con 0x7fb6a405d760 2021-10-20T23:29:42.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.346+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a40b2000 con 0x7fb6a405d760 2021-10-20T23:29:42.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.346+0000 7fb6a1ffb700 1 -- 172.21.15.12:0/2055646302 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb69801c460 con 0x7fb6a405d760 2021-10-20T23:29:42.366 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.346+0000 7fb6a1ffb700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6840535b0 0x7fb684055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:42.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.346+0000 7fb6a1ffb700 1 -- 172.21.15.12:0/2055646302 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb69806c1b0 con 0x7fb6a405d760 2021-10-20T23:29:42.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.346+0000 7fb6a3fff700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6840535b0 0x7fb684055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:42.367 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.346+0000 7fb6a3fff700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6840535b0 0x7fb684055a70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fb69400b000 tx=0x7fb694009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:42.368 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.350+0000 7fb6a1ffb700 1 -- 172.21.15.12:0/2055646302 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb698043040 con 0x7fb6a405d760 2021-10-20T23:29:42.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.514+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6a4057350 con 0x7fb6a405d760 2021-10-20T23:29:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a1ffb700 1 -- 172.21.15.12:0/2055646302 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fb698046660 con 0x7fb6a405d760 2021-10-20T23:29:42.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:42.529 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":84,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2957698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2957698261},{"type":"v1","addr":"172.21.15.31:6835","nonce":2957698261}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83},{"gid":8763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/1391258740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1391258740},{"type":"v1","addr":"172.21.15.12:6833","nonce":1391258740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:34.081034+0000","modified":"2021-10-20T23:29:35.098091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1536487631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1536487631},{"type":"v1","addr":"172.21.15.12:6835","nonce":1536487631}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-20T23:29:42.530 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6840535b0 msgr2=0x7fb684055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6840535b0 0x7fb684055a70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fb69400b000 tx=0x7fb694009040).stop 2021-10-20T23:29:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a405d760 msgr2=0x7fb6a40a1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a405d760 0x7fb6a40a1130 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fb69800c000 tx=0x7fb698006df0).stop 2021-10-20T23:29:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 shutdown_connections 2021-10-20T23:29:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb6840535b0 0x7fb684055a70 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6a40b10b0 0x7fb6a409ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6a40aeec0 0x7fb6a409ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 --2- 172.21.15.12:0/2055646302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a405d760 0x7fb6a40a1130 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 >> 172.21.15.12:0/2055646302 conn(0x7fb6a405c490 msgr2=0x7fb6a4141210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 shutdown_connections 2021-10-20T23:29:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:42.518+0000 7fb6a9c00700 1 -- 172.21.15.12:0/2055646302 wait complete. 2021-10-20T23:29:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 84 2021-10-20T23:29:42.845 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-20T23:29:34.081034+0000', 'modified': '2021-10-20T23:29:35.098091+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'c', 'rank': 0, 'incarnation': 83, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1536487631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 1536487631}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1536487631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-20T23:29:42.846 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-20T23:29:42.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-10-20T23:29:42.964 INFO:teuthology.orchestra.run.smithi012.stdout:{"cluster_fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","whoami":0,"id":8772,"want_state":"up:active","state":"up:active","rank_uptime":8.8614827439999999,"mdsmap_epoch":84,"osdmap_epoch":163,"osdmap_epoch_barrier":162,"uptime":13.206150686000001} 2021-10-20T23:29:42.964 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", "id": 8772, "mdsmap_epoch": 84, "osdmap_epoch": 163, "osdmap_epoch_barrier": 162, "rank_uptime": 8.861482744, "state": "up:active", "uptime": 13.206150686, "want_state": "up:active", "whoami": 0 } 2021-10-20T23:29:42.965 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-20T23:29:42.966 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-20T23:29:42.967 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-20T23:29:42.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:42.967 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:42.978 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:29:42.994 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:42.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:43.049 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:43.049 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:43.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:43.051 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:29:43.057 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-20T23:29:43.058 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:43.060 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:29:43.077 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:43.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:43.132 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:43.134 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:43.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:43.136 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:29:43.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-10-20T23:29:43.134+0000 7f1262fc8080 -1 init, newargv = 0x55f1979e1ba0 newargc=9ceph-fuse[ 2021-10-20T23:29:43.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:14654]: starting ceph client 2021-10-20T23:29:43.147 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14654]: starting fuse 2021-10-20T23:29:44.245 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-10-20T23:29:44.264 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-20T23:29:44.265 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-20T23:29:44.323 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-20T23:29:44.324 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-20T23:29:44.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:44.325 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-10-20T23:29:44.330 INFO:teuthology.orchestra.run.smithi136.stdout:52 2021-10-20T23:29:44.330 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-20T23:29:44.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:44.331 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-10-20T23:29:44.332 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-10-20T23:29:44.333 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-10-20T23:29:44.333 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-10-20T23:29:44.333 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-10-20T23:29:44.334 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:29:44.334 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-10-20T23:29:44.335 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-20T23:29:44.335 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-10-20T23:29:44.336 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:29:44.336 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-10-20T23:29:44.337 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-10-20T23:29:44.337 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-10-20T23:29:44.338 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-10-20T23:29:44.338 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:29:44.338 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-10-20T23:29:44.339 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-20T23:29:44.339 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-20T23:29:44.340 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-10-20T23:29:44.340 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-20T23:29:44.341 DEBUG:teuthology.orchestra.run.smithi136:> 2021-10-20T23:29:44.341 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-10-20T23:29:44.342 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-10-20T23:29:44.387 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.14654.asok 2021-10-20T23:29:44.391 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14654.asok 2021-10-20T23:29:44.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:44.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14654.asok status 2021-10-20T23:29:44.531 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-10-20T23:29:44.531 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-10-20T23:29:44.531 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-20T23:29:44.532 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-20T23:29:44.532 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-10-20T23:29:44.532 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-10-20T23:29:44.532 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-20T23:29:44.532 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "14654", 2021-10-20T23:29:44.533 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-10-20T23:29:44.533 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:29:44.534 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-10-20T23:29:44.534 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-10-20T23:29:44.534 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 8815, 2021-10-20T23:29:44.534 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-10-20T23:29:44.535 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-10-20T23:29:44.535 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-10-20T23:29:44.535 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 8815 2021-10-20T23:29:44.535 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:29:44.535 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:29:44.536 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:29:44.536 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:29:44.536 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1139326319 2021-10-20T23:29:44.536 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-10-20T23:29:44.536 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:29:44.537 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-10-20T23:29:44.537 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-10-20T23:29:44.537 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-10-20T23:29:44.537 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1139326319 2021-10-20T23:29:44.537 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-10-20T23:29:44.538 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.8815 172.21.15.136:0/1139326319", 2021-10-20T23:29:44.538 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/1139326319", 2021-10-20T23:29:44.538 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-10-20T23:29:44.539 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 84, 2021-10-20T23:29:44.539 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 163, 2021-10-20T23:29:44.540 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-10-20T23:29:44.540 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-10-20T23:29:44.540 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-10-20T23:29:44.540 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-10-20T23:29:44.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:44.543 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:44.543 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:44.551 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:29:44.552 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:29:44.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:44.553 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:44.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:44.572 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:44.573 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:44.581 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:29:44.582 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:29:44.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:44.583 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:44.584 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:44.630 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-10-20T23:29:44.631 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-20T23:29:44.632 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-10-20T23:29:44.632 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-20T23:29:44.633 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:44.648 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[14654]: fuse finished with error 0 and tester_r 0 2021-10-20T23:29:44.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:29:44.651 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:29:44.651 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:44.659 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-10-20T23:29:44.660 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-20T23:29:44.661 INFO:teuthology.orchestra.run:waiting for 900 2021-10-20T23:29:44.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-20T23:29:44.732 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-20T23:29:44.739 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-20T23:29:44.740 DEBUG:teuthology.orchestra.run.smithi119:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-10-20T23:29:44.760 INFO:teuthology.orchestra.run.smithi119.stdout: File: "." 2021-10-20T23:29:44.760 INFO:teuthology.orchestra.run.smithi119.stdout: ID: 0 Namelen: 255 Type: fuseblk 2021-10-20T23:29:44.762 INFO:teuthology.orchestra.run.smithi119.stdout:Block size: 4194304 Fundamental block size: 4194304 2021-10-20T23:29:44.762 INFO:teuthology.orchestra.run.smithi119.stdout:Blocks: Total: 86526 Free: 86526 Available: 86526 2021-10-20T23:29:44.762 INFO:teuthology.orchestra.run.smithi119.stdout:Inodes: Total: 1 Free: 0 2021-10-20T23:29:44.764 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-20T23:29:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.866+0000 7fdde6e1b700 1 Processor -- start 2021-10-20T23:29:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.866+0000 7fdde6e1b700 1 -- start start 2021-10-20T23:29:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.866+0000 7fdde6e1b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b76b0 0x7fdde0060a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.866+0000 7fdde6e1b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdde00b27a0 0x7fdde0060f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.866+0000 7fdde6e1b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde0067050 con 0x7fdde0146590 2021-10-20T23:29:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.866+0000 7fdde6e1b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde00653b0 con 0x7fdde00b27a0 2021-10-20T23:29:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.866+0000 7fdde6e1b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00b7a90 con 0x7fdde00b76b0 2021-10-20T23:29:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde5618700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdde00b27a0 0x7fdde0060f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde5e19700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b76b0 0x7fdde0060a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde5618700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdde00b27a0 0x7fdde0060f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:32914/0 (socket says 172.21.15.12:32914) 2021-10-20T23:29:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde5618700 1 -- 172.21.15.12:0/3923117365 learned_addr learned my addr 172.21.15.12:0/3923117365 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde661a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdde0146590 0x7fdde01469e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:51834/0 (socket says 172.21.15.12:51834) 2021-10-20T23:29:44.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde5618700 1 -- 172.21.15.12:0/3923117365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b76b0 msgr2=0x7fdde0060a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:44.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde5618700 1 --2- 172.21.15.12:0/3923117365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b76b0 0x7fdde0060a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:44.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde5618700 1 -- 172.21.15.12:0/3923117365 >> v1:172.21.15.31:6789/0 conn(0x7fdde0146590 legacy=0x7fdde01469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:44.885 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde5618700 1 -- 172.21.15.12:0/3923117365 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0066b50 con 0x7fdde00b27a0 2021-10-20T23:29:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde5618700 1 --2- 172.21.15.12:0/3923117365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde00b27a0 0x7fdde0060f40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fdddc0032f0 tx=0x7fdddc009290).ready entity=mon.1 client_cookie=82fcb4622d5c9c3b server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde4e17700 1 -- 172.21.15.12:0/3923117365 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdddc00b8a0 con 0x7fdde00b27a0 2021-10-20T23:29:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde4e17700 1 -- 172.21.15.12:0/3923117365 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc00ba00 con 0x7fdde00b27a0 2021-10-20T23:29:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde4e17700 1 -- 172.21.15.12:0/3923117365 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdddc00bb70 con 0x7fdde00b27a0 2021-10-20T23:29:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde6e1b700 1 -- 172.21.15.12:0/3923117365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde00b27a0 msgr2=0x7fdde0060f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde6e1b700 1 --2- 172.21.15.12:0/3923117365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde00b27a0 0x7fdde0060f40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fdddc0032f0 tx=0x7fdddc009290).stop 2021-10-20T23:29:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde6e1b700 1 -- 172.21.15.12:0/3923117365 shutdown_connections 2021-10-20T23:29:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde6e1b700 1 --2- 172.21.15.12:0/3923117365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde00b27a0 0x7fdde0060f40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde6e1b700 1 --2- 172.21.15.12:0/3923117365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b76b0 0x7fdde0060a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde6e1b700 1 -- 172.21.15.12:0/3923117365 >> 172.21.15.12:0/3923117365 conn(0x7fdde005f6b0 msgr2=0x7fdde005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde6e1b700 1 -- 172.21.15.12:0/3923117365 shutdown_connections 2021-10-20T23:29:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.870+0000 7fdde6e1b700 1 -- 172.21.15.12:0/3923117365 wait complete. 2021-10-20T23:29:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 Processor -- start 2021-10-20T23:29:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 -- start start 2021-10-20T23:29:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b27a0 0x7fdde00ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde00b76b0 0x7fdde00aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde0146590 0x7fdde00b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00af2a0 con 0x7fdde00b76b0 2021-10-20T23:29:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00b0940 con 0x7fdde0146590 2021-10-20T23:29:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00aed60 con 0x7fdde00b27a0 2021-10-20T23:29:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5618700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde00b76b0 0x7fdde00aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5618700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde00b76b0 0x7fdde00aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46182/0 (socket says 172.21.15.12:46182) 2021-10-20T23:29:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5618700 1 -- 172.21.15.12:0/1315618541 learned_addr learned my addr 172.21.15.12:0/1315618541 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5e19700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b27a0 0x7fdde00ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde661a700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde0146590 0x7fdde00b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5618700 1 -- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b27a0 msgr2=0x7fdde00ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5618700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b27a0 0x7fdde00ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5618700 1 -- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde0146590 msgr2=0x7fdde00b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5618700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde0146590 0x7fdde00b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5618700 1 -- 172.21.15.12:0/1315618541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc009530 con 0x7fdde00b76b0 2021-10-20T23:29:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde5618700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde00b76b0 0x7fdde00aff60 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fdddc0032f0 tx=0x7fdddc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fddceffd700 1 -- 172.21.15.12:0/1315618541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdddc00b8a0 con 0x7fdde00b76b0 2021-10-20T23:29:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fddceffd700 1 -- 172.21.15.12:0/1315618541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc021440 con 0x7fdde00b76b0 2021-10-20T23:29:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde00af000 con 0x7fdde00b76b0 2021-10-20T23:29:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fddceffd700 1 -- 172.21.15.12:0/1315618541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdddc0217a0 con 0x7fdde00b76b0 2021-10-20T23:29:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.874+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde01559c0 con 0x7fdde00b76b0 2021-10-20T23:29:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.878+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde0057350 con 0x7fdde00b76b0 2021-10-20T23:29:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.878+0000 7fddceffd700 1 -- 172.21.15.12:0/1315618541 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdddc027020 con 0x7fdde00b76b0 2021-10-20T23:29:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.878+0000 7fddceffd700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddc00535d0 0x7fddc0055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:44.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.878+0000 7fddceffd700 1 -- 172.21.15.12:0/1315618541 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdddc06cff0 con 0x7fdde00b76b0 2021-10-20T23:29:44.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.878+0000 7fdde5e19700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddc00535d0 0x7fddc0055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:44.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.878+0000 7fdde5e19700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddc00535d0 0x7fddc0055a90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fddd0006000 tx=0x7fddd0006d90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:44.886+0000 7fddceffd700 1 -- 172.21.15.12:0/1315618541 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdddc044010 con 0x7fdde00b76b0 2021-10-20T23:29:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.014+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fdde00601a0 con 0x7fdde00b76b0 2021-10-20T23:29:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.014+0000 7fddceffd700 1 -- 172.21.15.12:0/1315618541 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v163) v1 ==== 81+0+34051 (secure 0 0 0) 0x7fdddc015070 con 0x7fdde00b76b0 2021-10-20T23:29:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:45.028 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-20T23:29:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 163, 2021-10-20T23:29:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "e54e6890-5274-4a86-a9de-861e39b4bc51", 2021-10-20T23:29:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2021-10-20T23:19:37.018397+0000", 2021-10-20T23:29:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2021-10-20T23:29:36.110591+0000", 2021-10-20T23:29:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:29:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2021-10-20T23:19:43.973697+0000", 2021-10-20T23:29:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-20T23:29:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5799936, 2021-10-20T23:29:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2021-10-20T23:29:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2021-10-20T23:29:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2021-10-20T23:29:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2021-10-20T23:29:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2021-10-20T23:29:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2021-10-20T23:29:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2021-10-20T23:29:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-20T23:29:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-20T23:29:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2021-10-20T23:29:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 30, 2021-10-20T23:29:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2021-10-20T23:29:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "jewel", 2021-10-20T23:29:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2021-10-20T23:29:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "octopus", 2021-10-20T23:29:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2021-10-20T23:29:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2021-10-20T23:29:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "device_health_metrics", 2021-10-20T23:29:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:40.017051+0000", 2021-10-20T23:29:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2021-10-20T23:29:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2021-10-20T23:29:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2021-10-20T23:29:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2021-10-20T23:29:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2021-10-20T23:29:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "16", 2021-10-20T23:29:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:29:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2021-10-20T23:29:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_devicehealth": {} 2021-10-20T23:29:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2021-10-20T23:29:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2021-10-20T23:29:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:19:48.281190+0000", 2021-10-20T23:29:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:29:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:29:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:29:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:29:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:29:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "19", 2021-10-20T23:29:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:29:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2021-10-20T23:29:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 29, 2021-10-20T23:29:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_metadata", 2021-10-20T23:29:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:29:32.496339+0000", 2021-10-20T23:29:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:29:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:29:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:29:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:29:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:29:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "161", 2021-10-20T23:29:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2021-10-20T23:29:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_bias": 4, 2021-10-20T23:29:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 16, 2021-10-20T23:29:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_priority": 5 2021-10-20T23:29:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:29:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": "cephfs" 2021-10-20T23:29:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 30, 2021-10-20T23:29:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "cephfs_data", 2021-10-20T23:29:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2021-10-20T23:29:33.438412+0000", 2021-10-20T23:29:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2021-10-20T23:29:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2021-10-20T23:29:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2021-10-20T23:29:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2021-10-20T23:29:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2021-10-20T23:29:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2021-10-20T23:29:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2021-10-20T23:29:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2021-10-20T23:29:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2021-10-20T23:29:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2021-10-20T23:29:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2021-10-20T23:29:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2021-10-20T23:29:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2021-10-20T23:29:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2021-10-20T23:29:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2021-10-20T23:29:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2021-10-20T23:29:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2021-10-20T23:29:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2021-10-20T23:29:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2021-10-20T23:29:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2021-10-20T23:29:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "163", 2021-10-20T23:29:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2021-10-20T23:29:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-20T23:29:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2021-10-20T23:29:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2021-10-20T23:29:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2021-10-20T23:29:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2021-10-20T23:29:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2021-10-20T23:29:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2021-10-20T23:29:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2021-10-20T23:29:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2021-10-20T23:29:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2021-10-20T23:29:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2021-10-20T23:29:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2021-10-20T23:29:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2021-10-20T23:29:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2021-10-20T23:29:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2021-10-20T23:29:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2021-10-20T23:29:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2021-10-20T23:29:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-20T23:29:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-20T23:29:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-20T23:29:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2021-10-20T23:29:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2021-10-20T23:29:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2021-10-20T23:29:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2021-10-20T23:29:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2021-10-20T23:29:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2021-10-20T23:29:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2021-10-20T23:29:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2021-10-20T23:29:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2021-10-20T23:29:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2021-10-20T23:29:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2021-10-20T23:29:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2021-10-20T23:29:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2021-10-20T23:29:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2021-10-20T23:29:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2021-10-20T23:29:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2021-10-20T23:29:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2021-10-20T23:29:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2021-10-20T23:29:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs": { 2021-10-20T23:29:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "data": "cephfs" 2021-10-20T23:29:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2021-10-20T23:29:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:29:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "55fdd305-1085-4e58-afe8-69a6e5889a50", 2021-10-20T23:29:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 159, 2021-10-20T23:29:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2021-10-20T23:29:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2021-10-20T23:29:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2021-10-20T23:29:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2021-10-20T23:29:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2021-10-20T23:29:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2021-10-20T23:29:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2021-10-20T23:29:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2021-10-20T23:29:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14574 2021-10-20T23:29:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/14574", 2021-10-20T23:29:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/14574", 2021-10-20T23:29:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/14574", 2021-10-20T23:29:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/14574", 2021-10-20T23:29:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:29:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "46781b1a-7c1f-4b28-b7f4-95f1ac9cb292", 2021-10-20T23:29:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 158, 2021-10-20T23:29:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2021-10-20T23:29:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2021-10-20T23:29:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2021-10-20T23:29:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2021-10-20T23:29:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2021-10-20T23:29:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2021-10-20T23:29:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2021-10-20T23:29:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2021-10-20T23:29:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14575 2021-10-20T23:29:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/14575", 2021-10-20T23:29:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/14575", 2021-10-20T23:29:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/14575", 2021-10-20T23:29:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/14575", 2021-10-20T23:29:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:29:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "2575330a-a36d-475d-ab15-08d6384ed089", 2021-10-20T23:29:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 159, 2021-10-20T23:29:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2021-10-20T23:29:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2021-10-20T23:29:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2021-10-20T23:29:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2021-10-20T23:29:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2021-10-20T23:29:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2021-10-20T23:29:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2021-10-20T23:29:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2021-10-20T23:29:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14573 2021-10-20T23:29:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/14573", 2021-10-20T23:29:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/14573", 2021-10-20T23:29:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/14573", 2021-10-20T23:29:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/14573", 2021-10-20T23:29:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:29:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e76967d4-67cc-435f-8c7b-b6e53e98ded9", 2021-10-20T23:29:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 159, 2021-10-20T23:29:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2021-10-20T23:29:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2021-10-20T23:29:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2021-10-20T23:29:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2021-10-20T23:29:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2021-10-20T23:29:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2021-10-20T23:29:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2021-10-20T23:29:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2021-10-20T23:29:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14572 2021-10-20T23:29:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/14572", 2021-10-20T23:29:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/14572", 2021-10-20T23:29:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/14572", 2021-10-20T23:29:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/14572", 2021-10-20T23:29:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:29:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b4da75a6-08bb-4741-aa9c-ccbf8ccff189", 2021-10-20T23:29:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 158, 2021-10-20T23:29:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6810", 2021-10-20T23:29:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6811", 2021-10-20T23:29:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6812", 2021-10-20T23:29:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6813", 2021-10-20T23:29:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6816", 2021-10-20T23:29:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6817", 2021-10-20T23:29:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6814", 2021-10-20T23:29:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6815", 2021-10-20T23:29:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14820 2021-10-20T23:29:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6811/14820", 2021-10-20T23:29:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6813/14820", 2021-10-20T23:29:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6817/14820", 2021-10-20T23:29:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6815/14820", 2021-10-20T23:29:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:29:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "44da5aeb-adb6-4f57-a07f-e7cd5528bd11", 2021-10-20T23:29:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 161, 2021-10-20T23:29:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6802", 2021-10-20T23:29:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6803", 2021-10-20T23:29:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6804", 2021-10-20T23:29:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6805", 2021-10-20T23:29:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6808", 2021-10-20T23:29:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6809", 2021-10-20T23:29:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6806", 2021-10-20T23:29:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6807", 2021-10-20T23:29:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14819 2021-10-20T23:29:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6803/14819", 2021-10-20T23:29:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6805/14819", 2021-10-20T23:29:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6809/14819", 2021-10-20T23:29:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6807/14819", 2021-10-20T23:29:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:29:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "b74da8f7-c44a-4ec6-afbf-41cba5c861dc", 2021-10-20T23:29:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 159, 2021-10-20T23:29:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6826", 2021-10-20T23:29:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6827", 2021-10-20T23:29:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6828", 2021-10-20T23:29:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6829", 2021-10-20T23:29:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6832", 2021-10-20T23:29:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6833", 2021-10-20T23:29:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6830", 2021-10-20T23:29:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6831", 2021-10-20T23:29:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14822 2021-10-20T23:29:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6827/14822", 2021-10-20T23:29:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6829/14822", 2021-10-20T23:29:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6833/14822", 2021-10-20T23:29:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6831/14822", 2021-10-20T23:29:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:29:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5", 2021-10-20T23:29:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2021-10-20T23:29:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2021-10-20T23:29:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2021-10-20T23:29:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2021-10-20T23:29:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2021-10-20T23:29:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2021-10-20T23:29:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 14, 2021-10-20T23:29:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 159, 2021-10-20T23:29:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2021-10-20T23:29:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2021-10-20T23:29:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2021-10-20T23:29:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6818", 2021-10-20T23:29:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6819", 2021-10-20T23:29:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2021-10-20T23:29:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6820", 2021-10-20T23:29:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6821", 2021-10-20T23:29:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2021-10-20T23:29:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6824", 2021-10-20T23:29:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6825", 2021-10-20T23:29:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2021-10-20T23:29:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2021-10-20T23:29:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2021-10-20T23:29:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6822", 2021-10-20T23:29:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2021-10-20T23:29:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.31:6823", 2021-10-20T23:29:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 14835 2021-10-20T23:29:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.31:6819/14835", 2021-10-20T23:29:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.31:6821/14835", 2021-10-20T23:29:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.31:6825/14835", 2021-10-20T23:29:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.31:6823/14835", 2021-10-20T23:29:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2021-10-20T23:29:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2021-10-20T23:29:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2021-10-20T23:29:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2021-10-20T23:29:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2021-10-20T23:29:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2021-10-20T23:29:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.186771+0000", 2021-10-20T23:29:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2021-10-20T23:29:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.707192+0000", 2021-10-20T23:29:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2021-10-20T23:29:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.529367+0000", 2021-10-20T23:29:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2021-10-20T23:29:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.495415+0000", 2021-10-20T23:29:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2021-10-20T23:29:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.610503+0000", 2021-10-20T23:29:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2021-10-20T23:29:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.454201+0000", 2021-10-20T23:29:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2021-10-20T23:29:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.727408+0000", 2021-10-20T23:29:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2021-10-20T23:29:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2021-10-20T23:29:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2021-10-20T23:29:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2021-10-20T23:29:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2021-10-20T23:29:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540138292840890367, 2021-10-20T23:29:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2021-10-20T23:29:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2021-10-20T23:19:42.678045+0000", 2021-10-20T23:29:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2021-10-20T23:29:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2021-10-20T23:29:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2021-10-20T23:29:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2021-10-20T23:29:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2021-10-20T23:29:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2021-10-20T23:29:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "blacklist": {}, 2021-10-20T23:29:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2021-10-20T23:29:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_data": { 2021-10-20T23:29:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-device-class": "", 2021-10-20T23:29:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:29:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-root": "default", 2021-10-20T23:29:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "jerasure-per-chunk-alignment": "false", 2021-10-20T23:29:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:29:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "2", 2021-10-20T23:29:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:29:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:29:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van", 2021-10-20T23:29:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "w": "8" 2021-10-20T23:29:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2021-10-20T23:29:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2021-10-20T23:29:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2021-10-20T23:29:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2021-10-20T23:29:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2021-10-20T23:29:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "ruleset-failure-domain": "osd", 2021-10-20T23:29:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2021-10-20T23:29:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: } 2021-10-20T23:29:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2021-10-20T23:29:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2021-10-20T23:29:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2021-10-20T23:29:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2021-10-20T23:29:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2021-10-20T23:29:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {} 2021-10-20T23:29:45.266 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-20T23:29:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddc00535d0 msgr2=0x7fddc0055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddc00535d0 0x7fddc0055a90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fddd0006000 tx=0x7fddd0006d90).stop 2021-10-20T23:29:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde00b76b0 msgr2=0x7fdde00aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde00b76b0 0x7fdde00aff60 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fdddc0032f0 tx=0x7fdddc016000).stop 2021-10-20T23:29:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 shutdown_connections 2021-10-20T23:29:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fddc00535d0 0x7fddc0055a90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde0146590 0x7fdde00b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde00b76b0 0x7fdde00aff60 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 --2- 172.21.15.12:0/1315618541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdde00b27a0 0x7fdde00ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 >> 172.21.15.12:0/1315618541 conn(0x7fdde005f6b0 msgr2=0x7fdde005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 shutdown_connections 2021-10-20T23:29:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.018+0000 7fdde6e1b700 1 -- 172.21.15.12:0/1315618541 wait complete. 2021-10-20T23:29:45.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:45.384 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f87fa700 1 Processor -- start 2021-10-20T23:29:45.385 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f87fa700 1 -- start start 2021-10-20T23:29:45.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f87fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 0x7fa8f00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.387 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f87fa700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8f00a70c0 0x7fa8f0144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f87fa700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f00b0350 con 0x7fa8f01483a0 2021-10-20T23:29:45.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f87fa700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f00a90c0 con 0x7fa8f00a70c0 2021-10-20T23:29:45.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f87fa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00b05f0 con 0x7fa8f00b1db0 2021-10-20T23:29:45.388 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f5d95700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa8f01483a0 0x7fa8f00b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44782/0 (socket says 172.21.15.12:44782) 2021-10-20T23:29:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f5d95700 1 -- 172.21.15.12:0/819309982 learned_addr learned my addr 172.21.15.12:0/819309982 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f6d97700 1 --2- 172.21.15.12:0/819309982 >> v2:172.21.15.12:3300/0 conn(0x7fa8f00a70c0 0x7fa8f0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f6596700 1 --2- 172.21.15.12:0/819309982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 0x7fa8f00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f5594700 1 -- 172.21.15.12:0/819309982 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418342510 0 0) 0x7fa8f00b0350 con 0x7fa8f01483a0 2021-10-20T23:29:45.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f5594700 1 -- 172.21.15.12:0/819309982 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d8003260 con 0x7fa8f01483a0 2021-10-20T23:29:45.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f6d97700 1 -- 172.21.15.12:0/819309982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 msgr2=0x7fa8f00b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:45.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f6d97700 1 --2- 172.21.15.12:0/819309982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 0x7fa8f00b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f6d97700 1 -- 172.21.15.12:0/819309982 >> v1:172.21.15.12:6789/0 conn(0x7fa8f01483a0 legacy=0x7fa8f00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.390 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f5594700 1 -- 172.21.15.12:0/819309982 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2751235764 0 0) 0x7fa8d8003260 con 0x7fa8f01483a0 2021-10-20T23:29:45.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f6d97700 1 -- 172.21.15.12:0/819309982 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f00b0890 con 0x7fa8f00a70c0 2021-10-20T23:29:45.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f6596700 1 --2- 172.21.15.12:0/819309982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 0x7fa8f00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:45.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f6d97700 1 --2- 172.21.15.12:0/819309982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 0x7fa8f0144720 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fa8e8001b80 tx=0x7fa8e0006df0).ready entity=mon.0 client_cookie=9f01c2af5d2483e0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:45.391 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f5594700 1 -- 172.21.15.12:0/819309982 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e80019e0 con 0x7fa8f00a70c0 2021-10-20T23:29:45.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f5594700 1 -- 172.21.15.12:0/819309982 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e0000e90 con 0x7fa8f00a70c0 2021-10-20T23:29:45.392 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.374+0000 7fa8f5594700 1 -- 172.21.15.12:0/819309982 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e000d4a0 con 0x7fa8f00a70c0 2021-10-20T23:29:45.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 -- 172.21.15.12:0/819309982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 msgr2=0x7fa8f0144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 --2- 172.21.15.12:0/819309982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 0x7fa8f0144720 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fa8e8001b80 tx=0x7fa8e0006df0).stop 2021-10-20T23:29:45.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 -- 172.21.15.12:0/819309982 shutdown_connections 2021-10-20T23:29:45.396 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 --2- 172.21.15.12:0/819309982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 0x7fa8f0144720 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 --2- 172.21.15.12:0/819309982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 0x7fa8f00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 -- 172.21.15.12:0/819309982 >> 172.21.15.12:0/819309982 conn(0x7fa8f005f6b0 msgr2=0x7fa8f005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:45.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 -- 172.21.15.12:0/819309982 shutdown_connections 2021-10-20T23:29:45.397 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 -- 172.21.15.12:0/819309982 wait complete. 2021-10-20T23:29:45.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 Processor -- start 2021-10-20T23:29:45.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 -- start start 2021-10-20T23:29:45.398 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 0x7fa8f00a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 0x7fa8f0066c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8f01483a0 0x7fa8f0067150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00ab2d0 con 0x7fa8f00a70c0 2021-10-20T23:29:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00ab570 con 0x7fa8f01483a0 2021-10-20T23:29:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f87fa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00ab810 con 0x7fa8f00b1db0 2021-10-20T23:29:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f6596700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 0x7fa8f00a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f6596700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 0x7fa8f00a97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46192/0 (socket says 172.21.15.12:46192) 2021-10-20T23:29:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f6596700 1 -- 172.21.15.12:0/3516460710 learned_addr learned my addr 172.21.15.12:0/3516460710 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f6d97700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8f01483a0 0x7fa8f0067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.378+0000 7fa8f5d95700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 0x7fa8f0066c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8f6596700 1 -- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 msgr2=0x7fa8f0066c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8f6596700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 0x7fa8f0066c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8f6596700 1 -- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8f01483a0 msgr2=0x7fa8f0067150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.401 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8f6596700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8f01483a0 0x7fa8f0067150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8f6596700 1 -- 172.21.15.12:0/3516460710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e000b180 con 0x7fa8f00a70c0 2021-10-20T23:29:45.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8f6596700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 0x7fa8f00a97c0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fa8ec006940 tx=0x7fa8ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:45.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8df7fe700 1 -- 172.21.15.12:0/3516460710 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8ec011780 con 0x7fa8f00a70c0 2021-10-20T23:29:45.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8df7fe700 1 -- 172.21.15.12:0/3516460710 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0118e0 con 0x7fa8f00a70c0 2021-10-20T23:29:45.402 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f00abab0 con 0x7fa8f00a70c0 2021-10-20T23:29:45.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8df7fe700 1 -- 172.21.15.12:0/3516460710 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8ec011c40 con 0x7fa8f00a70c0 2021-10-20T23:29:45.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f00aaf50 con 0x7fa8f00a70c0 2021-10-20T23:29:45.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f0057350 con 0x7fa8f00a70c0 2021-10-20T23:29:45.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8df7fe700 1 -- 172.21.15.12:0/3516460710 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa8ec012420 con 0x7fa8f00a70c0 2021-10-20T23:29:45.403 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.382+0000 7fa8df7fe700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8d00536d0 0x7fa8d0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.386+0000 7fa8df7fe700 1 -- 172.21.15.12:0/3516460710 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa8ec06b880 con 0x7fa8f00a70c0 2021-10-20T23:29:45.404 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.386+0000 7fa8f5d95700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8d00536d0 0x7fa8d0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.386+0000 7fa8f5d95700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8d00536d0 0x7fa8d0055b90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fa8e800d000 tx=0x7fa8e8002000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:45.405 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.390+0000 7fa8df7fe700 1 -- 172.21.15.12:0/3516460710 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8ec042820 con 0x7fa8f00a70c0 2021-10-20T23:29:45.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.558+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8f0044650 con 0x7fa8f00a70c0 2021-10-20T23:29:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8df7fe700 1 -- 172.21.15.12:0/3516460710 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fa8ec045e40 con 0x7fa8f00a70c0 2021-10-20T23:29:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:45.572 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":84,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2957698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2957698261},{"type":"v1","addr":"172.21.15.31:6835","nonce":2957698261}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83},{"gid":8763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/1391258740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1391258740},{"type":"v1","addr":"172.21.15.12:6833","nonce":1391258740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:34.081034+0000","modified":"2021-10-20T23:29:35.098091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1536487631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1536487631},{"type":"v1","addr":"172.21.15.12:6835","nonce":1536487631}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-20T23:29:45.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8d00536d0 msgr2=0x7fa8d0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8d00536d0 0x7fa8d0055b90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fa8e800d000 tx=0x7fa8e8002000).stop 2021-10-20T23:29:45.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 msgr2=0x7fa8f00a97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 0x7fa8f00a97c0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fa8ec006940 tx=0x7fa8ec008040).stop 2021-10-20T23:29:45.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 shutdown_connections 2021-10-20T23:29:45.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fa8d00536d0 0x7fa8d0055b90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8f01483a0 0x7fa8f0067150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8f00b1db0 0x7fa8f0066c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 --2- 172.21.15.12:0/3516460710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f00a70c0 0x7fa8f00a97c0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 >> 172.21.15.12:0/3516460710 conn(0x7fa8f005f6b0 msgr2=0x7fa8f00acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 shutdown_connections 2021-10-20T23:29:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.562+0000 7fa8f87fa700 1 -- 172.21.15.12:0/3516460710 wait complete. 2021-10-20T23:29:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 84 2021-10-20T23:29:45.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-20T23:29:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cb0e55700 1 Processor -- start 2021-10-20T23:29:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cb0e55700 1 -- start start 2021-10-20T23:29:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cb0e55700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6cac0b2580 0x7f6cac14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cb0e55700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b0010 0x7f6cac14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.706 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cb0e55700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6cac0afbd0 0x7f6cac0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cb0e55700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac0a70c0 con 0x7f6cac0afbd0 2021-10-20T23:29:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cb0e55700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac0a72f0 con 0x7f6cac0b2580 2021-10-20T23:29:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cb0e55700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0a7590 con 0x7f6cac0b0010 2021-10-20T23:29:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cabfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6cac0afbd0 0x7f6cac0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cabfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6cac0afbd0 0x7f6cac0a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46204/0 (socket says 172.21.15.12:46204) 2021-10-20T23:29:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cabfff700 1 -- 172.21.15.12:0/2918758585 learned_addr learned my addr 172.21.15.12:0/2918758585 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6caaffd700 1 --2- 172.21.15.12:0/2918758585 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b0010 0x7f6cac14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cab7fe700 1 --2- 172.21.15.12:0/2918758585 >> v2:172.21.15.31:3300/0 conn(0x7f6cac0b2580 0x7f6cac14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cabfff700 1 -- 172.21.15.12:0/2918758585 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b0010 msgr2=0x7f6cac14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cabfff700 1 --2- 172.21.15.12:0/2918758585 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b0010 0x7f6cac14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cabfff700 1 -- 172.21.15.12:0/2918758585 >> v2:172.21.15.31:3300/0 conn(0x7f6cac0b2580 msgr2=0x7f6cac14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cabfff700 1 --2- 172.21.15.12:0/2918758585 >> v2:172.21.15.31:3300/0 conn(0x7f6cac0b2580 0x7f6cac14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cabfff700 1 -- 172.21.15.12:0/2918758585 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac0a7830 con 0x7f6cac0afbd0 2021-10-20T23:29:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6cabfff700 1 --2- 172.21.15.12:0/2918758585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 0x7f6cac0a83b0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f6c9c002f70 tx=0x7f6c9c006eb0).ready entity=mon.0 client_cookie=29f0818b31d0417f server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6caa7fc700 1 -- 172.21.15.12:0/2918758585 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c9c00d570 con 0x7f6cac0afbd0 2021-10-20T23:29:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6caa7fc700 1 -- 172.21.15.12:0/2918758585 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c000e90 con 0x7f6cac0afbd0 2021-10-20T23:29:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.678+0000 7f6caa7fc700 1 -- 172.21.15.12:0/2918758585 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c9c00d900 con 0x7f6cac0afbd0 2021-10-20T23:29:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2918758585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 msgr2=0x7f6cac0a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2918758585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 0x7f6cac0a83b0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f6c9c002f70 tx=0x7f6c9c006eb0).stop 2021-10-20T23:29:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2918758585 shutdown_connections 2021-10-20T23:29:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2918758585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 0x7f6cac0a83b0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2918758585 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b0010 0x7f6cac14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2918758585 >> v2:172.21.15.31:3300/0 conn(0x7f6cac0b2580 0x7f6cac14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2918758585 >> 172.21.15.12:0/2918758585 conn(0x7f6cac060180 msgr2=0x7f6cac0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2918758585 shutdown_connections 2021-10-20T23:29:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2918758585 wait complete. 2021-10-20T23:29:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 Processor -- start 2021-10-20T23:29:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 -- start start 2021-10-20T23:29:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 0x7f6cac143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cac0b0010 0x7f6cac0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b2580 0x7f6cac0b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0aaab0 con 0x7f6cac0afbd0 2021-10-20T23:29:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0a9140 con 0x7f6cac0b0010 2021-10-20T23:29:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cb0e55700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0a9be0 con 0x7f6cac0b2580 2021-10-20T23:29:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 0x7f6cac143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 0x7f6cac143e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46206/0 (socket says 172.21.15.12:46206) 2021-10-20T23:29:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cab7fe700 1 -- 172.21.15.12:0/2736176426 learned_addr learned my addr 172.21.15.12:0/2736176426 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cabfff700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b2580 0x7f6cac0b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6caaffd700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cac0b0010 0x7f6cac0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cab7fe700 1 -- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b2580 msgr2=0x7f6cac0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cab7fe700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b2580 0x7f6cac0b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cab7fe700 1 -- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cac0b0010 msgr2=0x7f6cac0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cab7fe700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cac0b0010 0x7f6cac0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cab7fe700 1 -- 172.21.15.12:0/2736176426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c00b1e0 con 0x7f6cac0afbd0 2021-10-20T23:29:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6caaffd700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cac0b0010 0x7f6cac0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-20T23:29:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.682+0000 7f6cab7fe700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 0x7f6cac143e80 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f6ca400c000 tx=0x7f6ca40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6ca8ff9700 1 -- 172.21.15.12:0/2736176426 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca400c850 con 0x7f6cac0afbd0 2021-10-20T23:29:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6ca8ff9700 1 -- 172.21.15.12:0/2736176426 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca400c9b0 con 0x7f6cac0afbd0 2021-10-20T23:29:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac0b3ed0 con 0x7f6cac0afbd0 2021-10-20T23:29:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6ca8ff9700 1 -- 172.21.15.12:0/2736176426 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca400cd10 con 0x7f6cac0afbd0 2021-10-20T23:29:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac0ac1b0 con 0x7f6cac0afbd0 2021-10-20T23:29:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac0a9da0 con 0x7f6cac0afbd0 2021-10-20T23:29:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6ca8ff9700 1 -- 172.21.15.12:0/2736176426 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ca4022070 con 0x7f6cac0afbd0 2021-10-20T23:29:45.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6ca8ff9700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c8c0536a0 0x7f6c8c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:45.734 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6ca8ff9700 1 -- 172.21.15.12:0/2736176426 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6ca406c1a0 con 0x7f6cac0afbd0 2021-10-20T23:29:45.735 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.686+0000 7f6caaffd700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c8c0536a0 0x7f6c8c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:45.738 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.690+0000 7f6caaffd700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c8c0536a0 0x7f6c8c055b60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f6ca000b000 tx=0x7f6ca0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:45.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.694+0000 7f6ca8ff9700 1 -- 172.21.15.12:0/2736176426 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ca40431a0 con 0x7f6cac0afbd0 2021-10-20T23:29:45.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:45.850+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6cac057350 con 0x7f6cac0afbd0 2021-10-20T23:29:46.178 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-20T23:29:46.166+0000 7f549fd90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-20T23:29:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.170+0000 7f6ca8ff9700 1 -- 172.21.15.12:0/2736176426 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6ca40467c0 con 0x7f6cac0afbd0 2021-10-20T23:29:46.189 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c8c0536a0 msgr2=0x7f6c8c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c8c0536a0 0x7f6c8c055b60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f6ca000b000 tx=0x7f6ca0008040).stop 2021-10-20T23:29:46.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 msgr2=0x7f6cac143e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 0x7f6cac143e80 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f6ca400c000 tx=0x7f6ca40091d0).stop 2021-10-20T23:29:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 shutdown_connections 2021-10-20T23:29:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f6c8c0536a0 0x7f6c8c055b60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cac0b2580 0x7f6cac0b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cac0b0010 0x7f6cac0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 --2- 172.21.15.12:0/2736176426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cac0afbd0 0x7f6cac143e80 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.174+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 >> 172.21.15.12:0/2736176426 conn(0x7f6cac060180 msgr2=0x7f6cac144ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.178+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 shutdown_connections 2021-10-20T23:29:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.178+0000 7f6cb0e55700 1 -- 172.21.15.12:0/2736176426 wait complete. 2021-10-20T23:29:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-20T23:29:46.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-20T23:29:46.211 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2021-10-20T23:29:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.306+0000 7f9be5dcb700 1 Processor -- start 2021-10-20T23:29:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.306+0000 7f9be5dcb700 1 -- start start 2021-10-20T23:29:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9be00af2c0 0x7f9be00af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be00ad320 0x7f9be0143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9be0143640 0x7f9be00a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be00afda0 con 0x7f9be0143640 2021-10-20T23:29:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be005c610 con 0x7f9be00af2c0 2021-10-20T23:29:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0140800 con 0x7f9be00ad320 2021-10-20T23:29:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be55ca700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9be0143640 0x7f9be00a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be4dc9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9be00af2c0 0x7f9be00af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be55ca700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9be0143640 0x7f9be00a8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46230/0 (socket says 172.21.15.12:46230) 2021-10-20T23:29:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be55ca700 1 -- 172.21.15.12:0/1751386578 learned_addr learned my addr 172.21.15.12:0/1751386578 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9bd7fff700 1 --2- 172.21.15.12:0/1751386578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be00ad320 0x7f9be0143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be4dc9700 1 -- 172.21.15.12:0/1751386578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be00ad320 msgr2=0x7f9be0143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be4dc9700 1 --2- 172.21.15.12:0/1751386578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be00ad320 0x7f9be0143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be4dc9700 1 -- 172.21.15.12:0/1751386578 >> v2:172.21.15.12:3300/0 conn(0x7f9be0143640 msgr2=0x7f9be00a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:46.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be4dc9700 1 --2- 172.21.15.12:0/1751386578 >> v2:172.21.15.12:3300/0 conn(0x7f9be0143640 0x7f9be00a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be4dc9700 1 -- 172.21.15.12:0/1751386578 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be00ad850 con 0x7f9be00af2c0 2021-10-20T23:29:46.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be55ca700 1 --2- 172.21.15.12:0/1751386578 >> v2:172.21.15.12:3300/0 conn(0x7f9be0143640 0x7f9be00a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-20T23:29:46.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be4dc9700 1 --2- 172.21.15.12:0/1751386578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be00af2c0 0x7f9be00af6a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f9be013fc30 tx=0x7f9bdc006df0).ready entity=mon.1 client_cookie=50cc0564c1bd97ac server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:46.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9bd77fe700 1 -- 172.21.15.12:0/1751386578 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc00d4a0 con 0x7f9be00af2c0 2021-10-20T23:29:46.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9bd77fe700 1 -- 172.21.15.12:0/1751386578 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc000e90 con 0x7f9be00af2c0 2021-10-20T23:29:46.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9bd77fe700 1 -- 172.21.15.12:0/1751386578 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc00d7f0 con 0x7f9be00af2c0 2021-10-20T23:29:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 -- 172.21.15.12:0/1751386578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be00af2c0 msgr2=0x7f9be00af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/1751386578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be00af2c0 0x7f9be00af6a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f9be013fc30 tx=0x7f9bdc006df0).stop 2021-10-20T23:29:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 -- 172.21.15.12:0/1751386578 shutdown_connections 2021-10-20T23:29:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/1751386578 >> v2:172.21.15.12:3300/0 conn(0x7f9be0143640 0x7f9be00a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/1751386578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be00ad320 0x7f9be0143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/1751386578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be00af2c0 0x7f9be00af6a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 -- 172.21.15.12:0/1751386578 >> 172.21.15.12:0/1751386578 conn(0x7f9be0061140 msgr2=0x7f9be0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 -- 172.21.15.12:0/1751386578 shutdown_connections 2021-10-20T23:29:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.310+0000 7f9be5dcb700 1 -- 172.21.15.12:0/1751386578 wait complete. 2021-10-20T23:29:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 Processor -- start 2021-10-20T23:29:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 -- start start 2021-10-20T23:29:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00ad320 0x7f9be005f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be00af2c0 0x7f9be00b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be0143640 0x7f9be0155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be009ecd0 con 0x7f9be00ad320 2021-10-20T23:29:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00ac950 con 0x7f9be00af2c0 2021-10-20T23:29:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be009ea30 con 0x7f9be0143640 2021-10-20T23:29:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be4dc9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00ad320 0x7f9be005f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be4dc9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00ad320 0x7f9be005f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46232/0 (socket says 172.21.15.12:46232) 2021-10-20T23:29:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be4dc9700 1 -- 172.21.15.12:0/4250454650 learned_addr learned my addr 172.21.15.12:0/4250454650 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be55ca700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be0143640 0x7f9be0155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9bd7fff700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be00af2c0 0x7f9be00b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be4dc9700 1 -- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be0143640 msgr2=0x7f9be0155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be4dc9700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be0143640 0x7f9be0155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be4dc9700 1 -- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be00af2c0 msgr2=0x7f9be00b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be4dc9700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be00af2c0 0x7f9be00b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be4dc9700 1 -- 172.21.15.12:0/4250454650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd8009530 con 0x7f9be00ad320 2021-10-20T23:29:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be4dc9700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00ad320 0x7f9be005f9f0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f9be013fc30 tx=0x7f9bdc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9bd5ffb700 1 -- 172.21.15.12:0/4250454650 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc013e30 con 0x7f9be00ad320 2021-10-20T23:29:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9bd5ffb700 1 -- 172.21.15.12:0/4250454650 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc002f70 con 0x7f9be00ad320 2021-10-20T23:29:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9bd5ffb700 1 -- 172.21.15.12:0/4250454650 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc01e5f0 con 0x7f9be00ad320 2021-10-20T23:29:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bdc00b180 con 0x7f9be00ad320 2021-10-20T23:29:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.314+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be00a9950 con 0x7f9be00ad320 2021-10-20T23:29:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.318+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be0057350 con 0x7f9be00ad320 2021-10-20T23:29:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.318+0000 7f9bd5ffb700 1 -- 172.21.15.12:0/4250454650 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9bdc025030 con 0x7f9be00ad320 2021-10-20T23:29:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.318+0000 7f9bd5ffb700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bc00534f0 0x7f9bc00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.318+0000 7f9bd5ffb700 1 -- 172.21.15.12:0/4250454650 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f9bdc06ca60 con 0x7f9be00ad320 2021-10-20T23:29:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.318+0000 7f9bd7fff700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bc00534f0 0x7f9bc00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.318+0000 7f9bd7fff700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bc00534f0 0x7f9bc00559b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f9bd000b000 tx=0x7f9bd0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.322+0000 7f9bd5ffb700 1 -- 172.21.15.12:0/4250454650 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9bdc043a30 con 0x7f9be00ad320 2021-10-20T23:29:46.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.494+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9be0061990 con 0x7f9be00ad320 2021-10-20T23:29:46.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.494+0000 7f9bd5ffb700 1 -- 172.21.15.12:0/4250454650 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f9bdc023870 con 0x7f9be00ad320 2021-10-20T23:29:46.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-20T23:29:46.505 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/2957698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2957698261},{"type":"v1","addr":"172.21.15.31:6835","nonce":2957698261}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83},{"gid":8763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.12:6833/1391258740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1391258740},{"type":"v1","addr":"172.21.15.12:6833","nonce":1391258740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":83}],"filesystems":[{"mdsmap":{"epoch":85,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-20T23:29:34.081034+0000","modified":"2021-10-20T23:29:46.167867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":164,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-20T23:29:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bc00534f0 msgr2=0x7f9bc00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bc00534f0 0x7f9bc00559b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f9bd000b000 tx=0x7f9bd0006df0).stop 2021-10-20T23:29:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00ad320 msgr2=0x7f9be005f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00ad320 0x7f9be005f9f0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f9be013fc30 tx=0x7f9bdc014000).stop 2021-10-20T23:29:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 shutdown_connections 2021-10-20T23:29:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f9bc00534f0 0x7f9bc00559b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9be0143640 0x7f9be0155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be00af2c0 0x7f9be00b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 --2- 172.21.15.12:0/4250454650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00ad320 0x7f9be005f9f0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 >> 172.21.15.12:0/4250454650 conn(0x7f9be0061140 msgr2=0x7f9be00a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:46.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 shutdown_connections 2021-10-20T23:29:46.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.498+0000 7f9be5dcb700 1 -- 172.21.15.12:0/4250454650 wait complete. 2021-10-20T23:29:46.514 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 85 2021-10-20T23:29:46.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-20T23:29:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2bfff700 1 Processor -- start 2021-10-20T23:29:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2bfff700 1 -- start start 2021-10-20T23:29:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a2c0b76b0 0x7f3a2c060a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b27a0 0x7f3a2c060f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c067050 con 0x7f3a2c146590 2021-10-20T23:29:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2bfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0653b0 con 0x7f3a2c0b76b0 2021-10-20T23:29:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0b7a90 con 0x7f3a2c0b27a0 2021-10-20T23:29:46.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3a2c146590 0x7f3a2c1469e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44836/0 (socket says 172.21.15.12:44836) 2021-10-20T23:29:46.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2b7fe700 1 -- 172.21.15.12:0/1335502462 learned_addr learned my addr 172.21.15.12:0/1335502462 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:46.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2affd700 1 --2- 172.21.15.12:0/1335502462 >> v2:172.21.15.31:3300/0 conn(0x7f3a2c0b76b0 0x7f3a2c060a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2a7fc700 1 --2- 172.21.15.12:0/1335502462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b27a0 0x7f3a2c060f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a29ffb700 1 -- 172.21.15.12:0/1335502462 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302519286 0 0) 0x7f3a2c067050 con 0x7f3a2c146590 2021-10-20T23:29:46.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a29ffb700 1 -- 172.21.15.12:0/1335502462 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a10003260 con 0x7f3a2c146590 2021-10-20T23:29:46.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2affd700 1 -- 172.21.15.12:0/1335502462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b27a0 msgr2=0x7f3a2c060f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:46.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.630+0000 7f3a2affd700 1 --2- 172.21.15.12:0/1335502462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b27a0 0x7f3a2c060f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2affd700 1 -- 172.21.15.12:0/1335502462 >> v1:172.21.15.12:6789/0 conn(0x7f3a2c146590 legacy=0x7f3a2c1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2affd700 1 -- 172.21.15.12:0/1335502462 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c066b50 con 0x7f3a2c0b76b0 2021-10-20T23:29:46.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2affd700 1 --2- 172.21.15.12:0/1335502462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b76b0 0x7f3a2c060a50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f3a1c002f70 tx=0x7f3a1c006d90).ready entity=mon.1 client_cookie=9c0d95ce8f9864ce server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:46.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a29ffb700 1 -- 172.21.15.12:0/1335502462 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c00e590 con 0x7f3a2c0b76b0 2021-10-20T23:29:46.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a29ffb700 1 -- 172.21.15.12:0/1335502462 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c000e90 con 0x7f3a2c0b76b0 2021-10-20T23:29:46.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a29ffb700 1 -- 172.21.15.12:0/1335502462 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c00e8e0 con 0x7f3a2c0b76b0 2021-10-20T23:29:46.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 -- 172.21.15.12:0/1335502462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b76b0 msgr2=0x7f3a2c060a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 --2- 172.21.15.12:0/1335502462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b76b0 0x7f3a2c060a50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f3a1c002f70 tx=0x7f3a1c006d90).stop 2021-10-20T23:29:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 -- 172.21.15.12:0/1335502462 shutdown_connections 2021-10-20T23:29:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 --2- 172.21.15.12:0/1335502462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b27a0 0x7f3a2c060f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 --2- 172.21.15.12:0/1335502462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b76b0 0x7f3a2c060a50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 -- 172.21.15.12:0/1335502462 >> 172.21.15.12:0/1335502462 conn(0x7f3a2c05f6b0 msgr2=0x7f3a2c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 -- 172.21.15.12:0/1335502462 shutdown_connections 2021-10-20T23:29:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 -- 172.21.15.12:0/1335502462 wait complete. 2021-10-20T23:29:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 Processor -- start 2021-10-20T23:29:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 -- start start 2021-10-20T23:29:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b27a0 0x7f3a2c0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b76b0 0x7f3a2c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a2c146590 0x7f3a2c155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0b0cb0 con 0x7f3a2c146590 2021-10-20T23:29:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0af370 con 0x7f3a2c0b27a0 2021-10-20T23:29:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0ae580 con 0x7f3a2c0b76b0 2021-10-20T23:29:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a2c146590 0x7f3a2c155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a2c146590 0x7f3a2c155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46250/0 (socket says 172.21.15.12:46250) 2021-10-20T23:29:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.634+0000 7f3a2b7fe700 1 -- 172.21.15.12:0/367984278 learned_addr learned my addr 172.21.15.12:0/367984278 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2a7fc700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b76b0 0x7f3a2c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2affd700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b27a0 0x7f3a2c0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2b7fe700 1 -- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b76b0 msgr2=0x7f3a2c155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2b7fe700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b76b0 0x7f3a2c155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2b7fe700 1 -- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b27a0 msgr2=0x7f3a2c0afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2b7fe700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b27a0 0x7f3a2c0afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2b7fe700 1 -- 172.21.15.12:0/367984278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c00b120 con 0x7f3a2c146590 2021-10-20T23:29:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2a7fc700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b76b0 0x7f3a2c155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2affd700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b27a0 0x7f3a2c0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2b7fe700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a2c146590 0x7f3a2c155af0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f3a2c0ae2b0 tx=0x7f3a24007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a1bfff700 1 -- 172.21.15.12:0/367984278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a24005ba0 con 0x7f3a2c146590 2021-10-20T23:29:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a1bfff700 1 -- 172.21.15.12:0/367984278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24005d00 con 0x7f3a2c146590 2021-10-20T23:29:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c0adfe0 con 0x7f3a2c146590 2021-10-20T23:29:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a1bfff700 1 -- 172.21.15.12:0/367984278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a240072c0 con 0x7f3a2c146590 2021-10-20T23:29:46.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c0a3b80 con 0x7f3a2c146590 2021-10-20T23:29:46.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a1bfff700 1 -- 172.21.15.12:0/367984278 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a2401a060 con 0x7f3a2c146590 2021-10-20T23:29:46.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c057350 con 0x7f3a2c146590 2021-10-20T23:29:46.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a1bfff700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3a08053610 0x7f3a08055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:46.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.638+0000 7f3a1bfff700 1 -- 172.21.15.12:0/367984278 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f3a2406b5a0 con 0x7f3a2c146590 2021-10-20T23:29:46.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.642+0000 7f3a2affd700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3a08053610 0x7f3a08055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:46.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.642+0000 7f3a2affd700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3a08053610 0x7f3a08055ad0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f3a1c018000 tx=0x7f3a1c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:46.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.646+0000 7f3a1bfff700 1 -- 172.21.15.12:0/367984278 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a24042550 con 0x7f3a2c146590 2021-10-20T23:29:46.821 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:46.806+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3a2c0601a0 con 0x7f3a2c146590 2021-10-20T23:29:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.182+0000 7f3a1bfff700 1 -- 172.21.15.12:0/367984278 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3a24018020 con 0x7f3a2c146590 2021-10-20T23:29:47.197 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3a08053610 msgr2=0x7f3a08055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:47.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3a08053610 0x7f3a08055ad0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f3a1c018000 tx=0x7f3a1c014000).stop 2021-10-20T23:29:47.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a2c146590 msgr2=0x7f3a2c155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:47.198 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a2c146590 0x7f3a2c155af0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f3a2c0ae2b0 tx=0x7f3a24007e00).stop 2021-10-20T23:29:47.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 shutdown_connections 2021-10-20T23:29:47.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3a08053610 0x7f3a08055ad0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:47.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a2c146590 0x7f3a2c155af0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:47.199 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a2c0b76b0 0x7f3a2c155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:47.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 --2- 172.21.15.12:0/367984278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a2c0b27a0 0x7f3a2c0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:47.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 >> 172.21.15.12:0/367984278 conn(0x7f3a2c05f6b0 msgr2=0x7f3a2c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:47.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 shutdown_connections 2021-10-20T23:29:47.200 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.186+0000 7f3a2bfff700 1 -- 172.21.15.12:0/367984278 wait complete. 2021-10-20T23:29:47.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-20T23:29:47.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.318+0000 7f7396365700 1 Processor -- start 2021-10-20T23:29:47.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.318+0000 7f7396365700 1 -- start start 2021-10-20T23:29:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f73900b1a30 0x7f73900669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7390140cb0 0x7f739013e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739005f750 con 0x7f73900665f0 2021-10-20T23:29:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73900b14a0 con 0x7f7390140cb0 2021-10-20T23:29:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739005f980 con 0x7f73900b1a30 2021-10-20T23:29:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7395363700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f73900665f0 0x7f739005fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44850/0 (socket says 172.21.15.12:44850) 2021-10-20T23:29:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7395363700 1 -- 172.21.15.12:0/1525814063 learned_addr learned my addr 172.21.15.12:0/1525814063 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7395b64700 1 --2- 172.21.15.12:0/1525814063 >> v2:172.21.15.12:3300/0 conn(0x7f7390140cb0 0x7f739013e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7394b62700 1 --2- 172.21.15.12:0/1525814063 >> v2:172.21.15.31:3300/0 conn(0x7f73900b1a30 0x7f73900669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f737ffff700 1 -- 172.21.15.12:0/1525814063 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884516064 0 0) 0x7f739005f750 con 0x7f73900665f0 2021-10-20T23:29:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f737ffff700 1 -- 172.21.15.12:0/1525814063 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7378003260 con 0x7f73900665f0 2021-10-20T23:29:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7395b64700 1 -- 172.21.15.12:0/1525814063 >> v2:172.21.15.31:3300/0 conn(0x7f73900b1a30 msgr2=0x7f73900669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7395b64700 1 --2- 172.21.15.12:0/1525814063 >> v2:172.21.15.31:3300/0 conn(0x7f73900b1a30 0x7f73900669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7395b64700 1 -- 172.21.15.12:0/1525814063 >> v1:172.21.15.12:6789/0 conn(0x7f73900665f0 legacy=0x7f739005fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7395b64700 1 -- 172.21.15.12:0/1525814063 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73900b1740 con 0x7f7390140cb0 2021-10-20T23:29:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7394b62700 1 --2- 172.21.15.12:0/1525814063 >> v2:172.21.15.31:3300/0 conn(0x7f73900b1a30 0x7f73900669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7395b64700 1 --2- 172.21.15.12:0/1525814063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7390140cb0 0x7f739013e120 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f73880032f0 tx=0x7f73880091d0).ready entity=mon.0 client_cookie=97c586ec73266d16 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f737ffff700 1 -- 172.21.15.12:0/1525814063 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f738800b680 con 0x7f7390140cb0 2021-10-20T23:29:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f737ffff700 1 -- 172.21.15.12:0/1525814063 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738800b7e0 con 0x7f7390140cb0 2021-10-20T23:29:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f737ffff700 1 -- 172.21.15.12:0/1525814063 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f738800b950 con 0x7f7390140cb0 2021-10-20T23:29:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 -- 172.21.15.12:0/1525814063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7390140cb0 msgr2=0x7f739013e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 --2- 172.21.15.12:0/1525814063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7390140cb0 0x7f739013e120 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f73880032f0 tx=0x7f73880091d0).stop 2021-10-20T23:29:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 -- 172.21.15.12:0/1525814063 shutdown_connections 2021-10-20T23:29:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 --2- 172.21.15.12:0/1525814063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7390140cb0 0x7f739013e120 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 --2- 172.21.15.12:0/1525814063 >> v2:172.21.15.31:3300/0 conn(0x7f73900b1a30 0x7f73900669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 -- 172.21.15.12:0/1525814063 >> 172.21.15.12:0/1525814063 conn(0x7f73900636e0 msgr2=0x7f7390063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.322+0000 7f7396365700 1 -- 172.21.15.12:0/1525814063 shutdown_connections 2021-10-20T23:29:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 -- 172.21.15.12:0/1525814063 wait complete. 2021-10-20T23:29:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 Processor -- start 2021-10-20T23:29:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 -- start start 2021-10-20T23:29:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73900665f0 0x7f73900b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73900b1a30 0x7f73900ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7390140cb0 0x7f73901420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390065770 con 0x7f73900b1a30 2021-10-20T23:29:47.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390065a10 con 0x7f7390140cb0 2021-10-20T23:29:47.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7390065f90 con 0x7f73900665f0 2021-10-20T23:29:47.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7394b62700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73900b1a30 0x7f73900ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:47.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7395b64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7390140cb0 0x7f73901420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:47.346 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7395363700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73900665f0 0x7f73900b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7394b62700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73900b1a30 0x7f73900ae7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46264/0 (socket says 172.21.15.12:46264) 2021-10-20T23:29:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7394b62700 1 -- 172.21.15.12:0/224096834 learned_addr learned my addr 172.21.15.12:0/224096834 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:47.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7394b62700 1 -- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73900665f0 msgr2=0x7f73900b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:47.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7394b62700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73900665f0 0x7f73900b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:47.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7394b62700 1 -- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7390140cb0 msgr2=0x7f73901420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:47.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7394b62700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7390140cb0 0x7f73901420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:47.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7394b62700 1 -- 172.21.15.12:0/224096834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388009470 con 0x7f73900b1a30 2021-10-20T23:29:47.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7394b62700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73900b1a30 0x7f73900ae7d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f7380006940 tx=0x7f7380008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:47.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f737e7fc700 1 -- 172.21.15.12:0/224096834 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7380011780 con 0x7f73900b1a30 2021-10-20T23:29:47.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f737e7fc700 1 -- 172.21.15.12:0/224096834 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800118e0 con 0x7f73900b1a30 2021-10-20T23:29:47.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f737e7fc700 1 -- 172.21.15.12:0/224096834 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7380011c40 con 0x7f73900b1a30 2021-10-20T23:29:47.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7390066230 con 0x7f73900b1a30 2021-10-20T23:29:47.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.326+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73901425d0 con 0x7f73900b1a30 2021-10-20T23:29:47.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.330+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73900b1120 con 0x7f73900b1a30 2021-10-20T23:29:47.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.330+0000 7f737e7fc700 1 -- 172.21.15.12:0/224096834 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f738001c460 con 0x7f73900b1a30 2021-10-20T23:29:47.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.330+0000 7f737e7fc700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73700536a0 0x7f7370055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:47.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.330+0000 7f737e7fc700 1 -- 172.21.15.12:0/224096834 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f738006bf60 con 0x7f73900b1a30 2021-10-20T23:29:47.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.330+0000 7f7395363700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73700536a0 0x7f7370055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:47.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.330+0000 7f7395363700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73700536a0 0x7f7370055b60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f738c00d000 tx=0x7f738c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:47.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.338+0000 7f737e7fc700 1 -- 172.21.15.12:0/224096834 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7380042e10 con 0x7f73900b1a30 2021-10-20T23:29:47.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:47.458+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7390057350 con 0x7f73900b1a30 2021-10-20T23:29:48.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.202+0000 7f737e7fc700 1 -- 172.21.15.12:0/224096834 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v165) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7380046430 con 0x7f73900b1a30 2021-10-20T23:29:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73700536a0 msgr2=0x7f7370055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73700536a0 0x7f7370055b60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f738c00d000 tx=0x7f738c009040).stop 2021-10-20T23:29:48.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73900b1a30 msgr2=0x7f73900ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:48.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73900b1a30 0x7f73900ae7d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f7380006940 tx=0x7f7380008040).stop 2021-10-20T23:29:48.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 shutdown_connections 2021-10-20T23:29:48.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f73700536a0 0x7f7370055b60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:48.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7390140cb0 0x7f73901420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:48.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73900b1a30 0x7f73900ae7d0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:48.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 --2- 172.21.15.12:0/224096834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73900665f0 0x7f73900b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:48.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 >> 172.21.15.12:0/224096834 conn(0x7f73900636e0 msgr2=0x7f73900b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 shutdown_connections 2021-10-20T23:29:48.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.206+0000 7f7396365700 1 -- 172.21.15.12:0/224096834 wait complete. 2021-10-20T23:29:48.228 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2021-10-20T23:29:48.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-20T23:29:48.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 Processor -- start 2021-10-20T23:29:48.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 -- start start 2021-10-20T23:29:48.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fef400b3040 0x7fef40065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:48.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef400a9c10 0x7fef400607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:48.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef40066ea0 con 0x7fef40143320 2021-10-20T23:29:48.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400648e0 con 0x7fef400a9c10 2021-10-20T23:29:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef40061dd0 con 0x7fef400b3040 2021-10-20T23:29:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef400a9c10 0x7fef400607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3ed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fef40143320 0x7fef40143770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44868/0 (socket says 172.21.15.12:44868) 2021-10-20T23:29:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef400a9c10 0x7fef400607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46274/0 (socket says 172.21.15.12:46274) 2021-10-20T23:29:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3ed9d700 1 -- 172.21.15.12:0/3360719350 learned_addr learned my addr 172.21.15.12:0/3360719350 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-20T23:29:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3e59c700 1 --2- 172.21.15.12:0/3360719350 >> v2:172.21.15.31:3300/0 conn(0x7fef400b3040 0x7fef40065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3dd9b700 1 -- 172.21.15.12:0/3360719350 >> v2:172.21.15.31:3300/0 conn(0x7fef400b3040 msgr2=0x7fef40065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-20T23:29:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3dd9b700 1 --2- 172.21.15.12:0/3360719350 >> v2:172.21.15.31:3300/0 conn(0x7fef400b3040 0x7fef40065e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3d59a700 1 -- 172.21.15.12:0/3360719350 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841795624 0 0) 0x7fef40066ea0 con 0x7fef40143320 2021-10-20T23:29:48.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3dd9b700 1 -- 172.21.15.12:0/3360719350 >> v1:172.21.15.12:6789/0 conn(0x7fef40143320 legacy=0x7fef40143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:48.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3dd9b700 1 -- 172.21.15.12:0/3360719350 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400b3420 con 0x7fef400a9c10 2021-10-20T23:29:48.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3e59c700 1 --2- 172.21.15.12:0/3360719350 >> v2:172.21.15.31:3300/0 conn(0x7fef400b3040 0x7fef40065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:48.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3dd9b700 1 --2- 172.21.15.12:0/3360719350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400a9c10 0x7fef400607c0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fef34002f70 tx=0x7fef34006df0).ready entity=mon.0 client_cookie=90c4b3e800ee191a server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:48.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3d59a700 1 -- 172.21.15.12:0/3360719350 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef3400d5c0 con 0x7fef400a9c10 2021-10-20T23:29:48.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3d59a700 1 -- 172.21.15.12:0/3360719350 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34000e90 con 0x7fef400a9c10 2021-10-20T23:29:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3d59a700 1 -- 172.21.15.12:0/3360719350 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef3400d910 con 0x7fef400a9c10 2021-10-20T23:29:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 -- 172.21.15.12:0/3360719350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400a9c10 msgr2=0x7fef400607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 --2- 172.21.15.12:0/3360719350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400a9c10 0x7fef400607c0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fef34002f70 tx=0x7fef34006df0).stop 2021-10-20T23:29:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 -- 172.21.15.12:0/3360719350 shutdown_connections 2021-10-20T23:29:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 --2- 172.21.15.12:0/3360719350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400a9c10 0x7fef400607c0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 --2- 172.21.15.12:0/3360719350 >> v2:172.21.15.31:3300/0 conn(0x7fef400b3040 0x7fef40065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 -- 172.21.15.12:0/3360719350 >> 172.21.15.12:0/3360719350 conn(0x7fef400636e0 msgr2=0x7fef40063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:48.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 -- 172.21.15.12:0/3360719350 shutdown_connections 2021-10-20T23:29:48.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.342+0000 7fef3f59e700 1 -- 172.21.15.12:0/3360719350 wait complete. 2021-10-20T23:29:48.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 Processor -- start 2021-10-20T23:29:48.365 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 -- start start 2021-10-20T23:29:48.370 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef400a9c10 0x7fef400b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:48.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400b3040 0x7fef400b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:48.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef40143320 0x7fef4013da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:48.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef401352d0 con 0x7fef400b3040 2021-10-20T23:29:48.371 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4013ca00 con 0x7fef400a9c10 2021-10-20T23:29:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef40141aa0 con 0x7fef40143320 2021-10-20T23:29:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400b3040 0x7fef400b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400b3040 0x7fef400b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46280/0 (socket says 172.21.15.12:46280) 2021-10-20T23:29:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3dd9b700 1 -- 172.21.15.12:0/422128234 learned_addr learned my addr 172.21.15.12:0/422128234 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-20T23:29:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3e59c700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef400a9c10 0x7fef400b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3ed9d700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef40143320 0x7fef4013da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3dd9b700 1 -- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef40143320 msgr2=0x7fef4013da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3dd9b700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef40143320 0x7fef4013da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3dd9b700 1 -- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef400a9c10 msgr2=0x7fef400b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3dd9b700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef400a9c10 0x7fef400b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3dd9b700 1 -- 172.21.15.12:0/422128234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3400b180 con 0x7fef400b3040 2021-10-20T23:29:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3e59c700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef400a9c10 0x7fef400b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-20T23:29:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3dd9b700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400b3040 0x7fef400b5960 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fef4013cf50 tx=0x7fef34014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef2f7fe700 1 -- 172.21.15.12:0/422128234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef34016070 con 0x7fef400b3040 2021-10-20T23:29:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef2f7fe700 1 -- 172.21.15.12:0/422128234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3400de40 con 0x7fef400b3040 2021-10-20T23:29:48.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef2f7fe700 1 -- 172.21.15.12:0/422128234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef34013e50 con 0x7fef400b3040 2021-10-20T23:29:48.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef401421a0 con 0x7fef400b3040 2021-10-20T23:29:48.376 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.346+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef400b4100 con 0x7fef400b3040 2021-10-20T23:29:48.378 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.350+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef400b44e0 con 0x7fef400b3040 2021-10-20T23:29:48.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.350+0000 7fef2f7fe700 1 -- 172.21.15.12:0/422128234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef3400f030 con 0x7fef400b3040 2021-10-20T23:29:48.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.350+0000 7fef2f7fe700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef1c053640 0x7fef1c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-20T23:29:48.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.350+0000 7fef2f7fe700 1 -- 172.21.15.12:0/422128234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fef3406c660 con 0x7fef400b3040 2021-10-20T23:29:48.379 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.350+0000 7fef3e59c700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef1c053640 0x7fef1c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-20T23:29:48.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.350+0000 7fef3e59c700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef1c053640 0x7fef1c055b00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fef3000c000 tx=0x7fef30008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-20T23:29:48.380 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.354+0000 7fef2f7fe700 1 -- 172.21.15.12:0/422128234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef34043630 con 0x7fef400b3040 2021-10-20T23:29:48.492 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:48.482+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef40066960 con 0x7fef400b3040 2021-10-20T23:29:49.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.206+0000 7fef2f7fe700 1 -- 172.21.15.12:0/422128234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v166) v1 ==== 173+0+0 (secure 0 0 0) 0x7fef34023020 con 0x7fef400b3040 2021-10-20T23:29:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.210+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef1c053640 msgr2=0x7fef1c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.210+0000 7fef3f59e700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef1c053640 0x7fef1c055b00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fef3000c000 tx=0x7fef30008040).stop 2021-10-20T23:29:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.210+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400b3040 msgr2=0x7fef400b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-20T23:29:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.210+0000 7fef3f59e700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400b3040 0x7fef400b5960 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fef4013cf50 tx=0x7fef34014000).stop 2021-10-20T23:29:49.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.214+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 shutdown_connections 2021-10-20T23:29:49.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.214+0000 7fef3f59e700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fef1c053640 0x7fef1c055b00 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:49.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.214+0000 7fef3f59e700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef40143320 0x7fef4013da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:49.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.214+0000 7fef3f59e700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400b3040 0x7fef400b5960 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.214+0000 7fef3f59e700 1 --2- 172.21.15.12:0/422128234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef400a9c10 0x7fef400b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-20T23:29:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.214+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 >> 172.21.15.12:0/422128234 conn(0x7fef400636e0 msgr2=0x7fef401439e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-20T23:29:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.214+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 shutdown_connections 2021-10-20T23:29:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-20T23:29:49.214+0000 7fef3f59e700 1 -- 172.21.15.12:0/422128234 wait complete. 2021-10-20T23:29:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2021-10-20T23:29:49.239 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-10-20T23:29:49.239 DEBUG:teuthology.orchestra.run.smithi119:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-10-20T23:30:07.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:30:07.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:30:07.891 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:30:07.894 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:30:19.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:30:19.345 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:30:19.345 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:30:37.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:30:37.952 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:30:37.957 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:30:37.961 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:30:49.247 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-20T23:30:49.254 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-10-20T23:31:08.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:31:08.017 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:31:08.020 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:31:08.023 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:31:38.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:31:38.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:31:38.082 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:31:38.085 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:32:08.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:32:08.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:32:08.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:32:08.184 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:32:38.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:32:38.286 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:32:38.288 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:32:38.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:33:08.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:33:08.343 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:33:08.345 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:33:08.348 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:33:38.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:33:38.408 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:33:38.417 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:33:38.420 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:34:08.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:34:08.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:34:08.480 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:34:08.482 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:34:38.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:34:38.539 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:34:38.544 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:34:38.546 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:35:08.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:35:08.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:35:08.604 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:35:08.607 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:35:38.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:35:38.695 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:35:38.697 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:35:38.700 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:36:08.785 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:36:08.788 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:36:08.794 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:36:08.797 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:36:38.889 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:36:38.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:36:38.895 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:36:38.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:37:08.963 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:37:08.968 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:37:08.971 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:37:08.974 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:37:39.045 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:37:39.048 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:37:39.051 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:37:39.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:38:09.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:38:09.116 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:38:09.119 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:38:09.122 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:38:39.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:38:39.228 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:38:39.230 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:38:39.233 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:39:09.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:39:09.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:39:09.318 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:39:09.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:39:39.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:39:39.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:39:39.384 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:39:39.386 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:40:09.437 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:40:09.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:40:09.443 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:40:09.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:40:39.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:40:39.616 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:40:39.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:40:39.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:41:09.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:41:09.693 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:41:09.695 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:41:09.698 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:41:39.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:41:39.777 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:41:39.780 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:41:39.783 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:42:09.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:42:09.846 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:42:09.849 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:42:09.852 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:42:39.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:42:39.941 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:42:39.944 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:42:39.947 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:43:10.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:43:10.035 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:43:10.038 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:43:10.041 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:43:40.096 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:43:40.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:43:40.103 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:43:40.105 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:44:10.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:44:10.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:44:10.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:44:10.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:44:40.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:44:40.253 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:44:40.256 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:44:40.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:45:10.313 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:45:10.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:45:10.319 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:45:10.321 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:45:19.350 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-20T23:45:19.351 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-10-20T23:45:19.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-20T23:45:19.354 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-20T23:45:19.355 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:45:19.377 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:45:19.398 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:45:19.420 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-20T23:45:19.443 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-20T23:45:19.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-20T23:45:19.444 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-20T23:45:19.444 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-20T23:45:40.386 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:45:40.389 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:45:40.393 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:45:40.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:46:10.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:46:10.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:46:10.480 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:46:10.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:46:40.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:46:40.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:46:40.568 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:46:40.571 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:47:10.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:47:10.659 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:47:10.668 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:47:10.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:47:40.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:47:40.769 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:47:40.771 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:47:40.774 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:48:10.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:48:10.864 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:48:10.866 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:48:10.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:48:40.940 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:48:40.943 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:48:40.946 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:48:40.950 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:49:11.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:49:11.014 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:49:11.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:49:11.020 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:49:41.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:49:41.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:49:41.076 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:49:41.079 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:50:11.161 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:50:11.164 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:50:11.167 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:50:11.169 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:50:41.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:50:41.347 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:50:41.349 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:50:41.352 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:51:11.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:51:11.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:51:11.409 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:51:11.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:51:41.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:51:41.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:51:41.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:51:41.492 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:52:11.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:52:11.554 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:52:11.557 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:52:11.560 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:52:41.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:52:41.637 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:52:41.640 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:52:41.642 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:53:11.700 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:53:11.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:53:11.706 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:53:11.708 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:53:41.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:53:41.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:53:41.774 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:53:41.776 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:54:11.849 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:54:11.853 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:54:11.856 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:54:11.859 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:54:41.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:54:41.926 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:54:41.928 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:54:41.931 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:55:12.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:55:12.013 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:55:12.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:55:12.020 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:55:42.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:55:42.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:55:42.094 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:55:42.097 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:56:12.148 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:56:12.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:56:12.154 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:56:12.157 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:56:42.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:56:42.215 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:56:42.217 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:56:42.220 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:57:12.286 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:57:12.291 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:57:12.294 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:57:12.296 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:57:42.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:57:42.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:57:42.382 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:57:42.385 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:58:12.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:58:12.448 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:58:12.450 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:58:12.453 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:58:42.539 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:58:42.544 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:58:42.549 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:58:42.552 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:59:12.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:59:12.605 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:59:12.608 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:59:12.611 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:59:42.670 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:59:42.677 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:59:42.686 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-20T23:59:42.689 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:00:01.327 INFO:tasks.ceph.mgr.y.smithi012.stderr:2021-10-21T00:00:01.306+0000 7f57b5dec700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 35310) UID: 0 2021-10-21T00:00:01.328 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-21T00:00:01.306+0000 7f54a3d98700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 35310) UID: 0 2021-10-21T00:00:01.329 INFO:tasks.ceph.osd.2.smithi012.stderr:2021-10-21T00:00:01.306+0000 7ff88cb91700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 35310) UID: 0 2021-10-21T00:00:01.329 INFO:tasks.ceph.osd.3.smithi012.stderr:2021-10-21T00:00:01.306+0000 7fc8a0c62700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 35310) UID: 0 2021-10-21T00:00:01.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2021-10-21T00:00:01.306+0000 7fbceb5af700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 35310) UID: 0 2021-10-21T00:00:01.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2021-10-21T00:00:01.306+0000 7f4edc092700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 35310) UID: 0 2021-10-21T00:00:01.332 INFO:tasks.ceph.mds.c.smithi012.stderr:2021-10-21T00:00:01.306+0000 7ff631eea700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 35310) UID: 0 2021-10-21T00:00:01.333 INFO:tasks.ceph.mds.a.smithi012.stderr:2021-10-21T00:00:01.306+0000 7feb65196700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 35310) UID: 0 2021-10-21T00:00:01.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2021-10-21T00:00:01.338+0000 7fbceb5af700 -1 received signal: Hangup from (PID: 35311) UID: 0 2021-10-21T00:00:01.358 INFO:tasks.ceph.mgr.y.smithi012.stderr:2021-10-21T00:00:01.338+0000 7f57b5dec700 -1 received signal: Hangup from (PID: 35311) UID: 0 2021-10-21T00:00:01.359 INFO:tasks.ceph.mds.c.smithi012.stderr:2021-10-21T00:00:01.338+0000 7ff631eea700 -1 received signal: Hangup from (PID: 35311) UID: 0 2021-10-21T00:00:01.359 INFO:tasks.ceph.osd.3.smithi012.stderr:2021-10-21T00:00:01.338+0000 7fc8a0c62700 -1 received signal: Hangup from (PID: 35311) UID: 0 2021-10-21T00:00:01.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2021-10-21T00:00:01.338+0000 7f4edc092700 -1 received signal: Hangup from (PID: 35311) UID: 0 2021-10-21T00:00:01.360 INFO:tasks.ceph.osd.2.smithi012.stderr:2021-10-21T00:00:01.338+0000 7ff88cb91700 -1 received signal: Hangup from (PID: 35311) UID: 0 2021-10-21T00:00:01.361 INFO:tasks.ceph.mds.a.smithi012.stderr:2021-10-21T00:00:01.338+0000 7feb65196700 -1 received signal: Hangup from (PID: 35311) UID: 0 2021-10-21T00:00:01.361 INFO:tasks.ceph.mon.a.smithi012.stderr:2021-10-21T00:00:01.338+0000 7f54a3d98700 -1 received signal: Hangup from (PID: 35311) UID: 0 2021-10-21T00:00:09.141 INFO:tasks.ceph.mon.b.smithi031.stderr:2021-10-21T00:00:09.134+0000 7f147c8fd700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 16296) UID: 0 2021-10-21T00:00:09.144 INFO:tasks.ceph.mon.c.smithi031.stderr:2021-10-21T00:00:09.134+0000 7f6207d60700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 16296) UID: 0 2021-10-21T00:00:09.145 INFO:tasks.ceph.osd.5.smithi031.stderr:2021-10-21T00:00:09.134+0000 7f12e3a94700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 16296) UID: 0 2021-10-21T00:00:09.146 INFO:tasks.ceph.osd.4.smithi031.stderr:2021-10-21T00:00:09.134+0000 7fa31908e700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 16296) UID: 0 2021-10-21T00:00:09.147 INFO:tasks.ceph.osd.6.smithi031.stderr:2021-10-21T00:00:09.134+0000 7fa9fe691700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 16296) UID: 0 2021-10-21T00:00:09.147 INFO:tasks.ceph.osd.7.smithi031.stderr:2021-10-21T00:00:09.134+0000 7f310c58b700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 16296) UID: 0 2021-10-21T00:00:09.148 INFO:tasks.ceph.mgr.x.smithi031.stderr:2021-10-21T00:00:09.134+0000 7fc45b675700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 16296) UID: 0 2021-10-21T00:00:09.149 INFO:tasks.ceph.mds.b.smithi031.stderr:2021-10-21T00:00:09.134+0000 7f39a465c700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 16296) UID: 0 2021-10-21T00:00:09.209 INFO:tasks.ceph.osd.6.smithi031.stderr:2021-10-21T00:00:09.170+0000 7fa9fe691700 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror (PID: 16297) UID: 0 2021-10-21T00:00:09.210 INFO:tasks.ceph.mon.b.smithi031.stderr:2021-10-21T00:00:09.170+0000 7f147c8fd700 -1 received signal: Hangup from (PID: 16297) UID: 0 2021-10-21T00:00:09.211 INFO:tasks.ceph.mon.c.smithi031.stderr:2021-10-21T00:00:09.170+0000 7f6207d60700 -1 received signal: Hangup from (PID: 16297) UID: 0 2021-10-21T00:00:09.211 INFO:tasks.ceph.osd.5.smithi031.stderr:2021-10-21T00:00:09.170+0000 7f12e3a94700 -1 received signal: Hangup from (PID: 16297) UID: 0 2021-10-21T00:00:09.212 INFO:tasks.ceph.mgr.x.smithi031.stderr:2021-10-21T00:00:09.170+0000 7fc45b675700 -1 received signal: Hangup from (PID: 16297) UID: 0 2021-10-21T00:00:09.213 INFO:tasks.ceph.osd.4.smithi031.stderr:2021-10-21T00:00:09.170+0000 7fa31908e700 -1 received signal: Hangup from (PID: 16297) UID: 0 2021-10-21T00:00:09.213 INFO:tasks.ceph.osd.7.smithi031.stderr:2021-10-21T00:00:09.170+0000 7f310c58b700 -1 received signal: Hangup from (PID: 16297) UID: 0 2021-10-21T00:00:09.214 INFO:tasks.ceph.mds.b.smithi031.stderr:2021-10-21T00:00:09.170+0000 7f39a465c700 -1 Fail to read '/proc/16297/cmdline' error = (3) No such process 2021-10-21T00:00:09.215 INFO:tasks.ceph.mds.b.smithi031.stderr:2021-10-21T00:00:09.170+0000 7f39a465c700 -1 received signal: Hangup from (PID: 16297) UID: 0 2021-10-21T00:00:12.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:00:12.757 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:00:12.764 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:00:12.768 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:00:19.465 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:00:19.467 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-10-21T00:00:19.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:00:19.474 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2021-10-21T00:00:19.475 INFO:tasks.cephfs_test_runner:ERROR 2021-10-21T00:00:19.476 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.476 INFO:tasks.cephfs_test_runner:====================================================================== 2021-10-21T00:00:19.477 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:00:19.477 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:00:19.477 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:00:19.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-10-21T00:00:19.478 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-10-21T00:00:19.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-10-21T00:00:19.480 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-10-21T00:00:19.480 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-10-21T00:00:19.480 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.481 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-10-21T00:00:19.481 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.481 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:00:19.482 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-10-21T00:00:19.482 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-10-21T00:00:19.483 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-10-21T00:00:19.483 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-10-21T00:00:19.483 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-10-21T00:00:19.484 INFO:tasks.cephfs_test_runner: proc.wait() 2021-10-21T00:00:19.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait 2021-10-21T00:00:19.484 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-10-21T00:00:19.484 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-10-21T00:00:19.485 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-10-21T00:00:19.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-10-21T00:00:19.486 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-10-21T00:00:19.486 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-10-21T00:00:19.486 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-10-21T00:00:19.486 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-10-21T00:00:19.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-10-21T00:00:19.487 INFO:tasks.cephfs_test_runner: for line in f: 2021-10-21T00:00:19.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-10-21T00:00:19.488 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-10-21T00:00:19.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-10-21T00:00:19.488 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-10-21T00:00:19.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-10-21T00:00:19.489 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-10-21T00:00:19.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-10-21T00:00:19.489 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-10-21T00:00:19.490 INFO:tasks.cephfs_test_runner:socket.timeout 2021-10-21T00:00:19.490 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.490 INFO:tasks.cephfs_test_runner:====================================================================== 2021-10-21T00:00:19.491 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:00:19.491 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:00:19.491 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:00:19.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-10-21T00:00:19.492 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-10-21T00:00:19.492 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-10-21T00:00:19.492 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-10-21T00:00:19.497 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-10-21T00:00:19.497 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.497 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-10-21T00:00:19.498 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.498 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:00:19.498 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-10-21T00:00:19.499 INFO:tasks.cephfs_test_runner: m.teardown() 2021-10-21T00:00:19.499 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-10-21T00:00:19.499 INFO:tasks.cephfs_test_runner: self.umount() 2021-10-21T00:00:19.500 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-10-21T00:00:19.500 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-10-21T00:00:19.500 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-10-21T00:00:19.500 INFO:tasks.cephfs_test_runner: proc.wait() 2021-10-21T00:00:19.501 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait 2021-10-21T00:00:19.501 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-10-21T00:00:19.501 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-10-21T00:00:19.502 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-10-21T00:00:19.502 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-10-21T00:00:19.502 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-10-21T00:00:19.503 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-10-21T00:00:19.503 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-10-21T00:00:19.503 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-10-21T00:00:19.503 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-10-21T00:00:19.504 INFO:tasks.cephfs_test_runner: for line in f: 2021-10-21T00:00:19.504 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-10-21T00:00:19.504 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-10-21T00:00:19.505 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-10-21T00:00:19.505 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-10-21T00:00:19.505 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-10-21T00:00:19.505 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-10-21T00:00:19.506 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-10-21T00:00:19.506 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-10-21T00:00:19.515 INFO:tasks.cephfs_test_runner:socket.timeout 2021-10-21T00:00:19.515 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.515 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:00:19.517 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2398.108s 2021-10-21T00:00:19.517 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.517 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2021-10-21T00:00:19.517 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.518 INFO:tasks.cephfs_test_runner:====================================================================== 2021-10-21T00:00:19.518 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:00:19.518 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:00:19.519 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:00:19.519 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-10-21T00:00:19.519 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-10-21T00:00:19.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-10-21T00:00:19.520 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-10-21T00:00:19.520 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-10-21T00:00:19.520 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.521 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-10-21T00:00:19.521 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.521 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:00:19.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-10-21T00:00:19.522 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-10-21T00:00:19.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-10-21T00:00:19.523 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-10-21T00:00:19.523 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-10-21T00:00:19.524 INFO:tasks.cephfs_test_runner: proc.wait() 2021-10-21T00:00:19.524 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait 2021-10-21T00:00:19.525 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-10-21T00:00:19.525 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-10-21T00:00:19.526 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-10-21T00:00:19.526 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-10-21T00:00:19.527 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-10-21T00:00:19.527 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-10-21T00:00:19.527 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-10-21T00:00:19.527 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-10-21T00:00:19.528 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-10-21T00:00:19.528 INFO:tasks.cephfs_test_runner: for line in f: 2021-10-21T00:00:19.528 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-10-21T00:00:19.529 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-10-21T00:00:19.529 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-10-21T00:00:19.529 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-10-21T00:00:19.529 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-10-21T00:00:19.530 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-10-21T00:00:19.530 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-10-21T00:00:19.530 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-10-21T00:00:19.531 INFO:tasks.cephfs_test_runner:socket.timeout 2021-10-21T00:00:19.531 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.531 INFO:tasks.cephfs_test_runner:====================================================================== 2021-10-21T00:00:19.531 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:00:19.532 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:00:19.532 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:00:19.532 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-10-21T00:00:19.533 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-10-21T00:00:19.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-10-21T00:00:19.534 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-10-21T00:00:19.534 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-10-21T00:00:19.535 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.535 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-10-21T00:00:19.536 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.536 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:00:19.537 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-10-21T00:00:19.537 INFO:tasks.cephfs_test_runner: m.teardown() 2021-10-21T00:00:19.537 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-10-21T00:00:19.538 INFO:tasks.cephfs_test_runner: self.umount() 2021-10-21T00:00:19.538 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-10-21T00:00:19.538 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-10-21T00:00:19.539 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-10-21T00:00:19.539 INFO:tasks.cephfs_test_runner: proc.wait() 2021-10-21T00:00:19.539 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait 2021-10-21T00:00:19.540 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-10-21T00:00:19.540 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-10-21T00:00:19.540 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-10-21T00:00:19.541 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-10-21T00:00:19.541 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-10-21T00:00:19.541 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-10-21T00:00:19.542 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-10-21T00:00:19.542 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-10-21T00:00:19.542 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-10-21T00:00:19.543 INFO:tasks.cephfs_test_runner: for line in f: 2021-10-21T00:00:19.543 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-10-21T00:00:19.543 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-10-21T00:00:19.543 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-10-21T00:00:19.544 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-10-21T00:00:19.544 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-10-21T00:00:19.545 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-10-21T00:00:19.546 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-10-21T00:00:19.546 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-10-21T00:00:19.546 INFO:tasks.cephfs_test_runner:socket.timeout 2021-10-21T00:00:19.546 INFO:tasks.cephfs_test_runner: 2021-10-21T00:00:19.547 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:00:19.735 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=19ef252457aa4ddf889b6edabf7c2577 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:00:19.738 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-10-21T00:00:19.771 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-10-21T00:00:19.796 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-10-21T00:00:19.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:00:19.800 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:00:19.800 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:00:42.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:00:42.867 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:00:42.877 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:00:42.891 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:01:12.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:01:12.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:01:12.951 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:01:12.955 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:01:43.110 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:01:43.116 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:01:43.128 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:01:43.133 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:13.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:13.214 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:13.218 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:13.222 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:43.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:43.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:43.308 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:43.325 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:13.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:13.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:13.391 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:13.396 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:43.455 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:43.459 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:43.462 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:43.465 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:13.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:13.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:13.529 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:13.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:43.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:43.629 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:43.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:43.635 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:13.712 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:13.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:13.718 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:13.721 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:43.791 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:43.795 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:43.798 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:43.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:13.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:13.864 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:13.867 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:13.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:43.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:43.934 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:43.938 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:43.942 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:13.999 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:14.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:14.005 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:14.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:44.085 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:44.090 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:44.094 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:44.097 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:14.163 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:14.167 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:14.169 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:14.172 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:44.226 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:44.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:44.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:44.236 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:14.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:14.298 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:14.301 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:14.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:44.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:44.387 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:44.390 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:44.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:14.462 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:14.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:14.468 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:14.475 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:44.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:44.537 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:44.540 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:44.543 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:14.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:14.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:14.605 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:14.608 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:44.697 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:44.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:44.703 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:44.706 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:14.776 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:14.781 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:14.784 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:14.786 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:44.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:44.857 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:44.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:44.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:14.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:14.928 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:14.933 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:14.937 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:44.996 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:45.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:45.005 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:45.009 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:15.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:15.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:15.192 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:15.199 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:45.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:45.263 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:45.266 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:45.269 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:15.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:15.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:15.336 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:15.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:19.812 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Connection timed out 2021-10-21T00:15:19.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:15:19.815 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-10-21T00:15:19.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:15:19.816 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:15:19.817 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:15:45.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:45.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:45.404 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:45.409 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:15.462 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:15.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:15.468 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:15.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:45.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:45.533 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:45.536 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:45.546 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:15.715 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:15.721 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:15.726 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:15.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:45.834 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:45.838 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:45.841 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:45.844 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:15.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:15.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:15.912 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:15.914 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:45.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:45.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:45.980 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:45.984 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:16.043 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:16.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:16.050 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:16.053 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:46.114 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:46.117 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:46.120 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:46.123 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:16.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:16.196 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:16.199 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:16.202 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:46.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:46.267 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:46.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:46.272 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:16.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:16.358 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:16.362 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:16.365 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:46.423 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:46.427 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:46.429 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:46.432 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:16.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:16.502 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:16.505 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:16.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:46.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:46.601 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:46.604 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:46.607 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:16.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:16.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:16.691 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:16.695 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:46.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:46.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:46.764 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:46.767 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:16.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:16.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:16.844 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:16.849 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:46.949 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:46.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:46.957 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:46.961 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:17.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:17.026 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:17.029 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:17.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:47.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:47.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:47.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:47.096 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:17.157 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:17.160 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:17.164 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:17.167 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:47.225 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:47.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:47.232 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:47.236 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:17.309 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:17.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:17.316 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:17.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:47.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:47.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:47.441 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:47.444 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:17.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:17.517 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:17.520 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:17.524 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:47.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:47.590 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:47.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:47.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:17.658 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:17.663 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:17.669 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:17.673 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:47.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:47.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:47.735 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:47.739 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:17.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:17.808 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:17.810 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:17.813 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:19.821 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:30:19.838 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-10-21T00:30:19.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:30:19.870 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:30:19.890 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-10-21T00:30:19.899 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-10-21T00:30:19.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:30:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3286ae5700 1 Processor -- start 2021-10-21T00:30:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3286ae5700 1 -- start start 2021-10-21T00:30:20.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3286ae5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f32801483a0 0x7f32800b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3286ae5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32800a70c0 0x7f3280144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3286ae5700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32800b0350 con 0x7f32800b1db0 2021-10-21T00:30:20.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3286ae5700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32800a90c0 con 0x7f32800a70c0 2021-10-21T00:30:20.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3286ae5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32800b05f0 con 0x7f32801483a0 2021-10-21T00:30:20.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3285082700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32800a70c0 0x7f3280144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3285082700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32800a70c0 0x7f3280144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46352/0 (socket says 172.21.15.12:46352) 2021-10-21T00:30:20.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3285082700 1 -- 172.21.15.12:0/23522443 learned_addr learned my addr 172.21.15.12:0/23522443 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:20.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f327ffff700 1 --2- 172.21.15.12:0/23522443 >> v2:172.21.15.31:3300/0 conn(0x7f32801483a0 0x7f32800b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3285082700 1 -- 172.21.15.12:0/23522443 >> v2:172.21.15.31:3300/0 conn(0x7f32801483a0 msgr2=0x7f32800b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:20.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3285082700 1 --2- 172.21.15.12:0/23522443 >> v2:172.21.15.31:3300/0 conn(0x7f32801483a0 0x7f32800b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3285082700 1 -- 172.21.15.12:0/23522443 >> v1:172.21.15.12:6789/0 conn(0x7f32800b1db0 legacy=0x7f32800b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3285082700 1 -- 172.21.15.12:0/23522443 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32800b0890 con 0x7f32800a70c0 2021-10-21T00:30:20.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3285082700 1 --2- 172.21.15.12:0/23522443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800a70c0 0x7f3280144720 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f3280147730 tx=0x7f3278009290).ready entity=mon.0 client_cookie=41cb2334f7bd54c2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:20.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f327f7fe700 1 -- 172.21.15.12:0/23522443 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f327800b860 con 0x7f32800a70c0 2021-10-21T00:30:20.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f327f7fe700 1 -- 172.21.15.12:0/23522443 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327800b9c0 con 0x7f32800a70c0 2021-10-21T00:30:20.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f327f7fe700 1 -- 172.21.15.12:0/23522443 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f327800bb30 con 0x7f32800a70c0 2021-10-21T00:30:20.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3286ae5700 1 -- 172.21.15.12:0/23522443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800a70c0 msgr2=0x7f3280144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.013+0000 7f3286ae5700 1 --2- 172.21.15.12:0/23522443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800a70c0 0x7f3280144720 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f3280147730 tx=0x7f3278009290).stop 2021-10-21T00:30:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 -- 172.21.15.12:0/23522443 shutdown_connections 2021-10-21T00:30:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 --2- 172.21.15.12:0/23522443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800a70c0 0x7f3280144720 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 --2- 172.21.15.12:0/23522443 >> v2:172.21.15.31:3300/0 conn(0x7f32801483a0 0x7f32800b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 -- 172.21.15.12:0/23522443 >> 172.21.15.12:0/23522443 conn(0x7f328005f6b0 msgr2=0x7f328005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:20.043 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 -- 172.21.15.12:0/23522443 shutdown_connections 2021-10-21T00:30:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 -- 172.21.15.12:0/23522443 wait complete. 2021-10-21T00:30:20.048 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 Processor -- start 2021-10-21T00:30:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 -- start start 2021-10-21T00:30:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32800a70c0 0x7f3280149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800b1db0 0x7f328014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32801483a0 0x7f32800aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328014af50 con 0x7f32800b1db0 2021-10-21T00:30:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800a9440 con 0x7f32800a70c0 2021-10-21T00:30:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3286ae5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328014a0f0 con 0x7f32801483a0 2021-10-21T00:30:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f327ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800b1db0 0x7f328014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3284881700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32800a70c0 0x7f3280149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f327ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800b1db0 0x7f328014b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46356/0 (socket says 172.21.15.12:46356) 2021-10-21T00:30:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f327ffff700 1 -- 172.21.15.12:0/3458777240 learned_addr learned my addr 172.21.15.12:0/3458777240 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f3285082700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32801483a0 0x7f32800aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f327ffff700 1 -- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32801483a0 msgr2=0x7f32800aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f327ffff700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32801483a0 0x7f32800aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f327ffff700 1 -- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32800a70c0 msgr2=0x7f3280149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f327ffff700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32800a70c0 0x7f3280149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.017+0000 7f327ffff700 1 -- 172.21.15.12:0/3458777240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278009530 con 0x7f32800b1db0 2021-10-21T00:30:20.054 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.021+0000 7f327ffff700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800b1db0 0x7f328014b480 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f326800a000 tx=0x7f3268008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.021+0000 7f327dffb700 1 -- 172.21.15.12:0/3458777240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3268011780 con 0x7f32800b1db0 2021-10-21T00:30:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.021+0000 7f327dffb700 1 -- 172.21.15.12:0/3458777240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32680118e0 con 0x7f32800b1db0 2021-10-21T00:30:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.021+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328014b180 con 0x7f32800b1db0 2021-10-21T00:30:20.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.021+0000 7f327dffb700 1 -- 172.21.15.12:0/3458777240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3268011c40 con 0x7f32800b1db0 2021-10-21T00:30:20.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.021+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328014a4b0 con 0x7f32800b1db0 2021-10-21T00:30:20.056 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.021+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32800b0b30 con 0x7f32800b1db0 2021-10-21T00:30:20.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.021+0000 7f327dffb700 1 -- 172.21.15.12:0/3458777240 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3268012420 con 0x7f32800b1db0 2021-10-21T00:30:20.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.025+0000 7f327dffb700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3264053640 0x7f3264055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.057 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.025+0000 7f327dffb700 1 -- 172.21.15.12:0/3458777240 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f326806b4b0 con 0x7f32800b1db0 2021-10-21T00:30:20.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.025+0000 7f3284881700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3264053640 0x7f3264055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.025+0000 7f3284881700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3264053640 0x7f3264055b00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f327000d000 tx=0x7f3270009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:20.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.029+0000 7f327dffb700 1 -- 172.21.15.12:0/3458777240 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3268042730 con 0x7f32800b1db0 2021-10-21T00:30:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.157+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3280057350 con 0x7f32800b1db0 2021-10-21T00:30:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.157+0000 7f327dffb700 1 -- 172.21.15.12:0/3458777240 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+13553 (secure 0 0 0) 0x7f326800de60 con 0x7f32800b1db0 2021-10-21T00:30:20.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-21T00:30:20.173 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":166,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:49.201504+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.12:6835/1536487631":"2021-10-21T23:29:45.856431+0000","172.21.15.12:6834/1536487631":"2021-10-21T23:29:45.856431+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:30:20.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3264053640 msgr2=0x7f3264055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3264053640 0x7f3264055b00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f327000d000 tx=0x7f3270009040).stop 2021-10-21T00:30:20.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800b1db0 msgr2=0x7f328014b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800b1db0 0x7f328014b480 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f326800a000 tx=0x7f3268008040).stop 2021-10-21T00:30:20.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 shutdown_connections 2021-10-21T00:30:20.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3264053640 0x7f3264055b00 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32801483a0 0x7f32800aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32800b1db0 0x7f328014b480 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 --2- 172.21.15.12:0/3458777240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32800a70c0 0x7f3280149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 >> 172.21.15.12:0/3458777240 conn(0x7f328005f6b0 msgr2=0x7f3280147770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:20.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 shutdown_connections 2021-10-21T00:30:20.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.161+0000 7f3286ae5700 1 -- 172.21.15.12:0/3458777240 wait complete. 2021-10-21T00:30:20.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-21T00:30:20.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.277+0000 7faa7bfff700 1 Processor -- start 2021-10-21T00:30:20.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.277+0000 7faa7bfff700 1 -- start start 2021-10-21T00:30:20.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa7c0b3000 0x7faa7c0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b18f0 0x7faa7c065510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c0b33e0 con 0x7faa7c0a9c10 2021-10-21T00:30:20.295 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c0b27f0 con 0x7faa7c0b3000 2021-10-21T00:30:20.298 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c0b0c70 con 0x7faa7c0b18f0 2021-10-21T00:30:20.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa7c0b3000 0x7faa7c0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa7c0b3000 0x7faa7c0b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46362/0 (socket says 172.21.15.12:46362) 2021-10-21T00:30:20.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7affd700 1 -- 172.21.15.12:0/77968844 learned_addr learned my addr 172.21.15.12:0/77968844 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:20.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa73fff700 1 --2- 172.21.15.12:0/77968844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b18f0 0x7faa7c065510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7affd700 1 -- 172.21.15.12:0/77968844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b18f0 msgr2=0x7faa7c065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:20.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7affd700 1 --2- 172.21.15.12:0/77968844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b18f0 0x7faa7c065510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7affd700 1 -- 172.21.15.12:0/77968844 >> v1:172.21.15.31:6789/0 conn(0x7faa7c0a9c10 legacy=0x7faa7c147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7affd700 1 -- 172.21.15.12:0/77968844 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c0b0f10 con 0x7faa7c0b3000 2021-10-21T00:30:20.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7affd700 1 --2- 172.21.15.12:0/77968844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0b3000 0x7faa7c0b2300 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7faa6c002f70 tx=0x7faa6c006eb0).ready entity=mon.0 client_cookie=554a7295c0293f8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:20.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7a7fc700 1 -- 172.21.15.12:0/77968844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c00d5c0 con 0x7faa7c0b3000 2021-10-21T00:30:20.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7a7fc700 1 -- 172.21.15.12:0/77968844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c000e90 con 0x7faa7c0b3000 2021-10-21T00:30:20.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7a7fc700 1 -- 172.21.15.12:0/77968844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c00d950 con 0x7faa7c0b3000 2021-10-21T00:30:20.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 -- 172.21.15.12:0/77968844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0b3000 msgr2=0x7faa7c0b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 --2- 172.21.15.12:0/77968844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0b3000 0x7faa7c0b2300 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7faa6c002f70 tx=0x7faa6c006eb0).stop 2021-10-21T00:30:20.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 -- 172.21.15.12:0/77968844 shutdown_connections 2021-10-21T00:30:20.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 --2- 172.21.15.12:0/77968844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b18f0 0x7faa7c065510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 --2- 172.21.15.12:0/77968844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0b3000 0x7faa7c0b2300 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 -- 172.21.15.12:0/77968844 >> 172.21.15.12:0/77968844 conn(0x7faa7c0636e0 msgr2=0x7faa7c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:20.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 -- 172.21.15.12:0/77968844 shutdown_connections 2021-10-21T00:30:20.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.281+0000 7faa7bfff700 1 -- 172.21.15.12:0/77968844 wait complete. 2021-10-21T00:30:20.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 Processor -- start 2021-10-21T00:30:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 -- start start 2021-10-21T00:30:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0a9c10 0x7faa7c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7c0b18f0 0x7faa7c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b3000 0x7faa7c0abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c0ad9a0 con 0x7faa7c0a9c10 2021-10-21T00:30:20.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c0ad740 con 0x7faa7c0b18f0 2021-10-21T00:30:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c0acda0 con 0x7faa7c0b3000 2021-10-21T00:30:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0a9c10 0x7faa7c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0a9c10 0x7faa7c159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46368/0 (socket says 172.21.15.12:46368) 2021-10-21T00:30:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7affd700 1 -- 172.21.15.12:0/2779762999 learned_addr learned my addr 172.21.15.12:0/2779762999 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa73fff700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7c0b18f0 0x7faa7c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7b7fe700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b3000 0x7faa7c0abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7affd700 1 -- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b3000 msgr2=0x7faa7c0abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7affd700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b3000 0x7faa7c0abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7affd700 1 -- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7c0b18f0 msgr2=0x7faa7c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7affd700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7c0b18f0 0x7faa7c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7affd700 1 -- 172.21.15.12:0/2779762999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c00b1e0 con 0x7faa7c0a9c10 2021-10-21T00:30:20.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7affd700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0a9c10 0x7faa7c159ea0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7faa6c002f70 tx=0x7faa6c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:20.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa78ff9700 1 -- 172.21.15.12:0/2779762999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c0119d0 con 0x7faa7c0a9c10 2021-10-21T00:30:20.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa78ff9700 1 -- 172.21.15.12:0/2779762999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c011b30 con 0x7faa7c0a9c10 2021-10-21T00:30:20.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c15a4e0 con 0x7faa7c0a9c10 2021-10-21T00:30:20.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa78ff9700 1 -- 172.21.15.12:0/2779762999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c011e90 con 0x7faa7c0a9c10 2021-10-21T00:30:20.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.285+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c0ac110 con 0x7faa7c0a9c10 2021-10-21T00:30:20.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.289+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c15a980 con 0x7faa7c0a9c10 2021-10-21T00:30:20.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.289+0000 7faa78ff9700 1 -- 172.21.15.12:0/2779762999 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa6c025030 con 0x7faa7c0a9c10 2021-10-21T00:30:20.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.289+0000 7faa78ff9700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa60053610 0x7faa60055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.289+0000 7faa78ff9700 1 -- 172.21.15.12:0/2779762999 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7faa6c06cb80 con 0x7faa7c0a9c10 2021-10-21T00:30:20.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.289+0000 7faa73fff700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa60053610 0x7faa60055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.289+0000 7faa73fff700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa60053610 0x7faa60055ad0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7faa6400c000 tx=0x7faa64008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:20.322 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.297+0000 7faa78ff9700 1 -- 172.21.15.12:0/2779762999 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa7c15a980 con 0x7faa7c0a9c10 2021-10-21T00:30:20.432 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.421+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa7c15a980 con 0x7faa60053610 2021-10-21T00:30:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa78ff9700 1 -- 172.21.15.12:0/2779762999 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68704 (secure 0 0 0) 0x7faa7c15a980 con 0x7faa60053610 2021-10-21T00:30:20.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-21T00:30:20.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa60053610 msgr2=0x7faa60055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.443 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa60053610 0x7faa60055ad0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7faa6400c000 tx=0x7faa64008040).stop 2021-10-21T00:30:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0a9c10 msgr2=0x7faa7c159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0a9c10 0x7faa7c159ea0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7faa6c002f70 tx=0x7faa6c015000).stop 2021-10-21T00:30:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 shutdown_connections 2021-10-21T00:30:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7faa60053610 0x7faa60055ad0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa7c0b3000 0x7faa7c0abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7c0b18f0 0x7faa7c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 --2- 172.21.15.12:0/2779762999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c0a9c10 0x7faa7c159ea0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 >> 172.21.15.12:0/2779762999 conn(0x7faa7c0636e0 msgr2=0x7faa7c0b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:20.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 shutdown_connections 2021-10-21T00:30:20.447 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.429+0000 7faa7bfff700 1 -- 172.21.15.12:0/2779762999 wait complete. 2021-10-21T00:30:20.447 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2021-10-21T00:30:20.457 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":2276,"stamp":"2021-10-21T00:30:19.154625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8405152,"kb_used_data":16480,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569568,"statfs":{"total":773094113280,"available":764487237632,"internally_reserved":8589934592,"allocated":16875520,"data_stored":8249624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003339"},"pg_stats":[{"pgid":"1.0","version":"166'4","reported_seq":149,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:09:47.957296+0000","last_change":"2021-10-20T23:19:45.232100+0000","last_active":"2021-10-21T00:09:47.957296+0000","last_peered":"2021-10-21T00:09:47.957296+0000","last_clean":"2021-10-21T00:09:47.957296+0000","last_became_active":"2021-10-20T23:19:45.231374+0000","last_became_peered":"2021-10-20T23:19:45.231374+0000","last_unstale":"2021-10-21T00:09:47.957296+0000","last_undegraded":"2021-10-21T00:09:47.957296+0000","last_fullsized":"2021-10-21T00:09:47.957296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:40.954153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:40.954153+0000","last_clean_scrub_stamp":"2021-10-20T23:19:40.954153+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":144,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:48.214644+0000","last_change":"2021-10-20T23:19:50.050604+0000","last_active":"2021-10-20T23:29:48.214644+0000","last_peered":"2021-10-20T23:29:48.214644+0000","last_clean":"2021-10-20T23:29:48.214644+0000","last_became_active":"2021-10-20T23:19:50.050295+0000","last_became_peered":"2021-10-20T23:19:50.050295+0000","last_unstale":"2021-10-20T23:29:48.214644+0000","last_undegraded":"2021-10-20T23:29:48.214644+0000","last_fullsized":"2021-10-20T23:29:48.214644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:49.172828+0000","last_change":"2021-10-20T23:19:50.051597+0000","last_active":"2021-10-20T23:29:49.172828+0000","last_peered":"2021-10-20T23:29:49.172828+0000","last_clean":"2021-10-20T23:29:49.172828+0000","last_became_active":"2021-10-20T23:19:50.051189+0000","last_became_peered":"2021-10-20T23:19:50.051189+0000","last_unstale":"2021-10-20T23:29:49.172828+0000","last_undegraded":"2021-10-20T23:29:49.172828+0000","last_fullsized":"2021-10-20T23:29:49.172828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:48.335650+0000","last_change":"2021-10-20T23:19:50.050317+0000","last_active":"2021-10-20T23:29:48.335650+0000","last_peered":"2021-10-20T23:29:48.335650+0000","last_clean":"2021-10-20T23:29:48.335650+0000","last_became_active":"2021-10-20T23:19:50.049970+0000","last_became_peered":"2021-10-20T23:19:50.049970+0000","last_unstale":"2021-10-20T23:29:48.335650+0000","last_undegraded":"2021-10-20T23:29:48.335650+0000","last_fullsized":"2021-10-20T23:29:48.335650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":144,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:48.214369+0000","last_change":"2021-10-20T23:19:50.052800+0000","last_active":"2021-10-20T23:29:48.214369+0000","last_peered":"2021-10-20T23:29:48.214369+0000","last_clean":"2021-10-20T23:29:48.214369+0000","last_became_active":"2021-10-20T23:19:50.052290+0000","last_became_peered":"2021-10-20T23:19:50.052290+0000","last_unstale":"2021-10-20T23:29:48.214369+0000","last_undegraded":"2021-10-20T23:29:48.214369+0000","last_fullsized":"2021-10-20T23:29:48.214369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":147,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:48.205482+0000","last_change":"2021-10-20T23:19:50.196425+0000","last_active":"2021-10-20T23:29:48.205482+0000","last_peered":"2021-10-20T23:29:48.205482+0000","last_clean":"2021-10-20T23:29:48.205482+0000","last_became_active":"2021-10-20T23:19:50.195815+0000","last_became_peered":"2021-10-20T23:19:50.195815+0000","last_unstale":"2021-10-20T23:29:48.205482+0000","last_undegraded":"2021-10-20T23:29:48.205482+0000","last_fullsized":"2021-10-20T23:29:48.205482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:49.173223+0000","last_change":"2021-10-20T23:19:50.200005+0000","last_active":"2021-10-20T23:29:49.173223+0000","last_peered":"2021-10-20T23:29:49.173223+0000","last_clean":"2021-10-20T23:29:49.173223+0000","last_became_active":"2021-10-20T23:19:50.198735+0000","last_became_peered":"2021-10-20T23:19:50.198735+0000","last_unstale":"2021-10-20T23:29:49.173223+0000","last_undegraded":"2021-10-20T23:29:49.173223+0000","last_fullsized":"2021-10-20T23:29:49.173223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":147,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:48.205607+0000","last_change":"2021-10-20T23:19:50.047617+0000","last_active":"2021-10-20T23:29:48.205607+0000","last_peered":"2021-10-20T23:29:48.205607+0000","last_clean":"2021-10-20T23:29:48.205607+0000","last_became_active":"2021-10-20T23:19:50.046787+0000","last_became_peered":"2021-10-20T23:19:50.046787+0000","last_unstale":"2021-10-20T23:29:48.205607+0000","last_undegraded":"2021-10-20T23:29:48.205607+0000","last_fullsized":"2021-10-20T23:29:48.205607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:49.175278+0000","last_change":"2021-10-20T23:19:50.049986+0000","last_active":"2021-10-20T23:29:49.175278+0000","last_peered":"2021-10-20T23:29:49.175278+0000","last_clean":"2021-10-20T23:29:49.175278+0000","last_became_active":"2021-10-20T23:19:50.049434+0000","last_became_peered":"2021-10-20T23:19:50.049434+0000","last_unstale":"2021-10-20T23:29:49.175278+0000","last_undegraded":"2021-10-20T23:29:49.175278+0000","last_fullsized":"2021-10-20T23:29:49.175278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542993,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81799999999999995,"15min":0.81299999999999994},"min":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.51700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.27},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50700000000000001},"max":{"1min":1.0920000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0429999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.137,"5min":1.1919999999999999,"15min":1.2589999999999999},"last":1.1739999999999999}]},{"osd":2,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.87},"min":{"1min":0.62,"5min":0.61699999999999999,"15min":0.59399999999999997},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.325},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.85599999999999998,"15min":0.84699999999999998},"min":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58199999999999996},"max":{"1min":1.073,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.05}]},{"osd":3,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82899999999999996,"15min":0.82599999999999996},"min":{"1min":0.65200000000000002,"5min":0.65100000000000002,"15min":0.56000000000000005},"max":{"1min":1.115,"5min":1.119,"15min":1.1220000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.93200000000000005,"15min":0.93300000000000005},"min":{"1min":0.71699999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1379999999999999,"5min":1.1619999999999999,"15min":1.3620000000000001},"last":1.028}]},{"osd":4,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86799999999999999,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0409999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88200000000000001,"15min":0.88300000000000001},"min":{"1min":0.71199999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.032,"5min":1.1279999999999999,"15min":1.216},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.53600000000000003},"max":{"1min":1.109,"5min":1.258,"15min":1.4419999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.97899999999999998,"15min":0.96399999999999997},"min":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.58799999999999997},"max":{"1min":1.167,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.1240000000000001}]},{"osd":6,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.81200000000000006,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.165,"5min":1.381,"15min":1.4450000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.97899999999999998,"15min":0.96699999999999997},"min":{"1min":0.82799999999999996,"5min":0.70399999999999996,"15min":0.66300000000000003},"max":{"1min":1.2629999999999999,"5min":1.288,"15min":1.3220000000000001},"last":0.99099999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542993,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79900000000000004,"15min":0.80300000000000005},"min":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0029999999999999,"5min":1.1379999999999999,"15min":1.268},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81100000000000005,"15min":0.82499999999999996},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.093,"5min":1.179,"15min":1.179},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.85799999999999998,"15min":0.84399999999999997},"min":{"1min":0.67100000000000004,"5min":0.59899999999999998,"15min":0.54600000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84099999999999997,"15min":0.83299999999999996},"min":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0980000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"max":{"1min":1.0880000000000001,"5min":1.2030000000000001,"15min":1.2070000000000001},"last":1.077}]},{"osd":3,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.65600000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.081,"5min":1.1919999999999999,"15min":1.222},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.61399999999999999},"max":{"1min":1.125,"5min":1.1619999999999999,"15min":1.3660000000000001},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.80600000000000005,"15min":0.82899999999999996},"min":{"1min":0.64400000000000002,"5min":0.54200000000000004,"15min":0.47299999999999998},"max":{"1min":1.0700000000000001,"5min":1.264,"15min":1.264},"last":1.004},{"interface":"front","average":{"1min":0.872,"5min":0.88400000000000001,"15min":0.90200000000000002},"min":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.115,"5min":1.1859999999999999,"15min":1.3029999999999999},"last":1.0289999999999999}]},{"osd":5,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88400000000000001,"15min":0.876},"min":{"1min":0.67700000000000005,"5min":0.60899999999999999,"15min":0.56499999999999995},"max":{"1min":1.089,"5min":1.236,"15min":1.4430000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.67800000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.234,"15min":1.2769999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95399999999999996,"15min":0.97199999999999998},"min":{"1min":0.70299999999999996,"5min":0.64900000000000002,"15min":0.629},"max":{"1min":1.1519999999999999,"5min":1.335,"15min":1.335},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.016,"5min":1.0149999999999999,"15min":1.006},"min":{"1min":0.80200000000000005,"5min":0.71599999999999997,"15min":0.64200000000000002},"max":{"1min":1.1819999999999999,"5min":1.365,"15min":1.5},"last":0.99299999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542992,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:14 2021","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.52500000000000002,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":1.006,"15min":1.1599999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":1.034,"5min":1.081,"15min":1.2729999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Oct 21 00:29:14 2021","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.85799999999999998},"min":{"1min":0.623,"5min":0.52600000000000002,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.1539999999999999,"15min":1.2330000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.66300000000000003,"5min":0.65700000000000003,"15min":0.58099999999999996},"max":{"1min":1.0009999999999999,"5min":1.1279999999999999,"15min":1.3240000000000001},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Oct 21 00:29:14 2021","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.91600000000000004,"15min":0.92200000000000004},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.5449999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84799999999999998},"min":{"1min":0.625,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.095,"5min":1.212,"15min":1.224},"last":1.02}]},{"osd":3,"last update":"Thu Oct 21 00:29:14 2021","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.84999999999999998,"15min":0.84299999999999997},"min":{"1min":0.64300000000000002,"5min":0.60399999999999998,"15min":0.55100000000000005},"max":{"1min":1.0980000000000001,"5min":1.1000000000000001,"15min":1.151},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.94999999999999996,"15min":0.95299999999999996},"min":{"1min":0.78900000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1399999999999999,"5min":1.2030000000000001,"15min":1.5860000000000001},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Oct 21 00:29:14 2021","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51300000000000001},"max":{"1min":1.044,"5min":1.1319999999999999,"15min":1.25},"last":1.107},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.367},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:29:14 2021","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.874,"15min":0.879},"min":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.1040000000000001,"5min":1.381,"15min":1.4490000000000001},"last":0.998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.90400000000000003,"15min":0.90600000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1319999999999999,"5min":1.145,"15min":1.325},"last":1.071}]},{"osd":7,"last update":"Thu Oct 21 00:29:14 2021","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":0.93899999999999995},"min":{"1min":0.66600000000000004,"5min":0.65800000000000003,"15min":0.58699999999999997},"max":{"1min":1.169,"5min":1.248,"15min":1.3260000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0169999999999999,"15min":1.02},"min":{"1min":0.69999999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.175,"5min":1.47,"15min":1.625},"last":1.056}]}]},{"osd":4,"up_from":14,"seq":60129542992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.81399999999999995,"15min":0.80500000000000005},"min":{"1min":0.59399999999999997,"5min":0.51400000000000001,"15min":0.48199999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1439999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.82699999999999996,"15min":0.82599999999999996},"min":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.92900000000000005}]},{"osd":1,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.55700000000000005},"max":{"1min":1.095,"5min":1.0980000000000001,"15min":1.196},"last":1.089},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.88300000000000001,"15min":0.86799999999999999},"min":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.256},"last":1.044}]},{"osd":2,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.048,"5min":1.0900000000000001,"15min":1.24},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.58599999999999997},"max":{"1min":1.05,"5min":1.123,"15min":1.2330000000000001},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.56699999999999995},"max":{"1min":1.034,"5min":1.127,"15min":1.2589999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.87,"5min":0.88600000000000001,"15min":0.89200000000000002},"min":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.61399999999999999},"max":{"1min":1.147,"5min":1.226,"15min":1.345},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85399999999999998,"15min":0.86099999999999999},"min":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0840000000000001,"5min":1.1859999999999999,"15min":1.2350000000000001},"last":1.167},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.90400000000000003,"15min":0.88600000000000001},"min":{"1min":0.73399999999999999,"5min":0.59099999999999997,"15min":0.57399999999999995},"max":{"1min":1.111,"5min":1.256,"15min":1.3380000000000001},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.91900000000000004,"15min":0.91000000000000003},"min":{"1min":0.78300000000000003,"5min":0.60099999999999998,"15min":0.59499999999999997},"max":{"1min":1.2410000000000001,"5min":1.288,"15min":1.4370000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.024,"5min":0.99399999999999999,"15min":0.99299999999999999},"min":{"1min":0.79600000000000004,"5min":0.67800000000000005,"15min":0.58899999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.3220000000000001},"last":1.1319999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.749,"5min":0.69999999999999996,"15min":0.65900000000000003},"max":{"1min":1.2549999999999999,"5min":1.3220000000000001,"15min":1.4399999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0169999999999999,"15min":1.032},"min":{"1min":0.71499999999999997,"5min":0.59399999999999997,"15min":0.56699999999999995},"max":{"1min":1.2789999999999999,"5min":1.349,"15min":1.516},"last":1.109}]}]},{"osd":3,"up_from":14,"seq":60129542993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.41999999999999998},"max":{"1min":0.81399999999999995,"5min":0.96799999999999997,"15min":1.1100000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.49299999999999999,"5min":0.48199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94799999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.437},"max":{"1min":0.81699999999999995,"5min":1.0680000000000001,"15min":1.1599999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70499999999999996,"15min":0.69199999999999995},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":0.92000000000000004,"5min":1.054,"15min":1.054},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.501},"max":{"1min":0.81799999999999995,"5min":0.97499999999999998,"15min":1.4259999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.752},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.502},"max":{"1min":1.004,"5min":1.004,"15min":1.177},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86899999999999999,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.002,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.71699999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":0.97499999999999998,"5min":1.27,"15min":1.27},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.90200000000000002,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.069,"5min":1.224,"15min":1.5760000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.97099999999999997,"15min":0.97899999999999998},"min":{"1min":0.77800000000000002,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0720000000000001,"5min":1.381,"15min":1.381},"last":1.038}]},{"osd":6,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.94399999999999995,"15min":0.95599999999999996},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.67400000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.70999999999999996,"5min":0.67900000000000005,"15min":0.64700000000000002},"max":{"1min":1.1719999999999999,"5min":1.3400000000000001,"15min":1.5309999999999999},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.69299999999999995},"max":{"1min":1.1100000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.105},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0169999999999999,"15min":1.03},"min":{"1min":0.80000000000000004,"5min":0.72999999999999998,"15min":0.71799999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.3220000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542993,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:16 2021","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.88900000000000001,"15min":1.069},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.54100000000000004},"max":{"1min":0.81399999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.91300000000000003}]},{"osd":1,"last update":"Thu Oct 21 00:29:16 2021","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.46200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0720000000000001,"15min":1.109},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.749},"min":{"1min":0.627,"5min":0.56000000000000005,"15min":0.498},"max":{"1min":1.0049999999999999,"5min":1.0269999999999999,"15min":1.2569999999999999},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Oct 21 00:29:16 2021","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.45400000000000001},"max":{"1min":0.76700000000000002,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.099},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Oct 21 00:29:16 2021","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.90300000000000002,"15min":0.89900000000000002},"min":{"1min":0.747,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.04,"5min":1.1879999999999999,"15min":1.228},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90300000000000002,"15min":0.90400000000000003},"min":{"1min":0.68999999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1639999999999999,"5min":1.1759999999999999,"15min":1.2150000000000001},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Oct 21 00:29:16 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85899999999999999,"15min":0.84899999999999998},"min":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.59199999999999997},"max":{"1min":1.0700000000000001,"5min":1.1850000000000001,"15min":1.28},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.94499999999999995,"15min":0.93400000000000005},"min":{"1min":0.72999999999999998,"5min":0.69599999999999995,"15min":0.63200000000000001},"max":{"1min":1.1679999999999999,"5min":1.216,"15min":1.2350000000000001},"last":0.879}]},{"osd":6,"last update":"Thu Oct 21 00:29:16 2021","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.95599999999999996,"15min":0.93600000000000005},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.66100000000000003},"max":{"1min":1.0580000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.72199999999999998,"5min":0.69599999999999995,"15min":0.68600000000000005},"max":{"1min":1.0780000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:29:16 2021","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":0.97899999999999998},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.69799999999999995},"max":{"1min":1.117,"5min":1.3280000000000001,"15min":1.403},"last":1.3},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98899999999999999,"15min":0.97399999999999998},"min":{"1min":0.74299999999999999,"5min":0.73299999999999998,"15min":0.68000000000000005},"max":{"1min":1.1950000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.0109999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542993,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.47099999999999997,"5min":0.42099999999999999,"15min":0.41999999999999998},"max":{"1min":0.95899999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.432},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.1990000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.33300000000000002},"max":{"1min":0.71399999999999997,"5min":0.88900000000000001,"15min":1.2589999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.71199999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.42699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.147},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.56999999999999995},"max":{"1min":1.004,"5min":1.113,"15min":1.1659999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.68600000000000005,"5min":0.56200000000000006,"15min":0.499},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.1200000000000001},"last":0.62}]},{"osd":4,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.2789999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.90300000000000002,"15min":0.90600000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.175,"5min":1.296,"15min":1.321},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.85099999999999998,"15min":0.84899999999999998},"min":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.59299999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.306},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97299999999999998,"15min":0.95399999999999996},"min":{"1min":0.73699999999999999,"5min":0.66900000000000004,"15min":0.58999999999999997},"max":{"1min":1.492,"5min":1.5389999999999999,"15min":1.5429999999999999},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.97299999999999998,"15min":0.95699999999999996},"min":{"1min":0.83799999999999997,"5min":0.69199999999999995,"15min":0.627},"max":{"1min":1.262,"5min":1.262,"15min":1.4370000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":0.96899999999999997},"min":{"1min":0.63900000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.2509999999999999,"5min":1.3089999999999999,"15min":1.391},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0509999999999999,"15min":1.0309999999999999},"min":{"1min":0.81200000000000006,"5min":0.68600000000000005,"15min":0.68100000000000005},"max":{"1min":1.4199999999999999,"5min":1.486,"15min":1.486},"last":0.879},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0109999999999999,"15min":1.0189999999999999},"min":{"1min":0.874,"5min":0.71199999999999997,"15min":0.68100000000000005},"max":{"1min":1.2010000000000001,"5min":1.468,"15min":1.482},"last":0.70299999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542994,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.41899999999999998,"15min":0.39300000000000002},"max":{"1min":0.84499999999999997,"5min":0.90800000000000003,"15min":1.0009999999999999},"last":0.502},{"interface":"front","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.71199999999999997},"min":{"1min":0.64200000000000002,"5min":0.56299999999999994,"15min":0.44500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0109999999999999,"15min":1.0149999999999999},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.89500000000000002,"5min":1.0589999999999999,"15min":1.0640000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.46500000000000002},"max":{"1min":0.91800000000000004,"5min":1.0840000000000001,"15min":1.159},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.65200000000000002},"min":{"1min":0.48999999999999999,"5min":0.47199999999999998,"15min":0.40000000000000002},"max":{"1min":1.046,"5min":1.0940000000000001,"15min":1.1759999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.60399999999999998,"5min":0.50700000000000001,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.1120000000000001,"15min":1.1399999999999999},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.72899999999999998,"5min":0.67500000000000004,"15min":0.626},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.3759999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.85599999999999998,"15min":0.85899999999999999},"min":{"1min":0.71599999999999997,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.1120000000000001,"5min":1.119,"15min":1.325},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86099999999999999,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.65700000000000003,"15min":0.64300000000000002},"max":{"1min":1.0229999999999999,"5min":1.1080000000000001,"15min":1.4370000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.94499999999999995},"min":{"1min":0.71499999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.181,"5min":1.4350000000000001,"15min":1.4930000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97699999999999998,"15min":0.98499999999999999},"min":{"1min":0.80300000000000005,"5min":0.74199999999999999,"15min":0.67600000000000005},"max":{"1min":1.2370000000000001,"5min":1.3779999999999999,"15min":1.571},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.98499999999999999,"15min":0.98999999999999999},"min":{"1min":0.83299999999999996,"5min":0.74199999999999999,"15min":0.65100000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.401},"last":1.1379999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.98199999999999998,"15min":0.996},"min":{"1min":0.90700000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.48},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.97399999999999998,"15min":0.97899999999999998},"min":{"1min":0.82399999999999995,"5min":0.76600000000000001,"15min":0.73999999999999999},"max":{"1min":1.157,"5min":1.26,"15min":1.498},"last":0.88300000000000001}]}]}]}} 2021-10-21T00:30:20.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:30:20.563 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.549+0000 7f3b12c0e700 1 Processor -- start 2021-10-21T00:30:20.564 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.549+0000 7f3b12c0e700 1 -- start start 2021-10-21T00:30:20.565 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b12c0e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 0x7f3b0c142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b12c0e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3b0c0b30d0 0x7f3b0c143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b12c0e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3b0c0ace70 0x7f3b0c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b12c0e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c0b0af0 con 0x7f3b0c0ace70 2021-10-21T00:30:20.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b12c0e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c0ae680 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b12c0e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0ae920 con 0x7f3b0c0b0710 2021-10-21T00:30:20.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b1240d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3b0c0ace70 0x7f3b0c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b11c0c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 0x7f3b0c142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b1240d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3b0c0ace70 0x7f3b0c05f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46380/0 (socket says 172.21.15.12:46380) 2021-10-21T00:30:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b1140b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3b0c0b30d0 0x7f3b0c143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b1240d700 1 -- 172.21.15.12:0/1750202933 learned_addr learned my addr 172.21.15.12:0/1750202933 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:20.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b11c0c700 1 -- 172.21.15.12:0/1750202933 >> v2:172.21.15.31:3300/0 conn(0x7f3b0c0b30d0 msgr2=0x7f3b0c143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:20.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b11c0c700 1 --2- 172.21.15.12:0/1750202933 >> v2:172.21.15.31:3300/0 conn(0x7f3b0c0b30d0 0x7f3b0c143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b11c0c700 1 -- 172.21.15.12:0/1750202933 >> v2:172.21.15.12:3300/0 conn(0x7f3b0c0ace70 msgr2=0x7f3b0c05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b11c0c700 1 --2- 172.21.15.12:0/1750202933 >> v2:172.21.15.12:3300/0 conn(0x7f3b0c0ace70 0x7f3b0c05f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b11c0c700 1 -- 172.21.15.12:0/1750202933 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c0aebc0 con 0x7f3b0c0b0710 2021-10-21T00:30:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b1240d700 1 --2- 172.21.15.12:0/1750202933 >> v2:172.21.15.12:3300/0 conn(0x7f3b0c0ace70 0x7f3b0c05f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:30:20.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b11c0c700 1 --2- 172.21.15.12:0/1750202933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 0x7f3b0c142d20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f3b08002f70 tx=0x7f3b08006e80).ready entity=mon.2 client_cookie=d46bef38a2a07a36 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:20.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b10c0a700 1 -- 172.21.15.12:0/1750202933 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b08014070 con 0x7f3b0c0b0710 2021-10-21T00:30:20.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b10c0a700 1 -- 172.21.15.12:0/1750202933 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08000e90 con 0x7f3b0c0b0710 2021-10-21T00:30:20.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.553+0000 7f3b10c0a700 1 -- 172.21.15.12:0/1750202933 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b080107f0 con 0x7f3b0c0b0710 2021-10-21T00:30:20.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1750202933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 msgr2=0x7f3b0c142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1750202933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 0x7f3b0c142d20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f3b08002f70 tx=0x7f3b08006e80).stop 2021-10-21T00:30:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1750202933 shutdown_connections 2021-10-21T00:30:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1750202933 >> v2:172.21.15.12:3300/0 conn(0x7f3b0c0ace70 0x7f3b0c05f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1750202933 >> v2:172.21.15.31:3300/0 conn(0x7f3b0c0b30d0 0x7f3b0c143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1750202933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 0x7f3b0c142d20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1750202933 >> 172.21.15.12:0/1750202933 conn(0x7f3b0c061140 msgr2=0x7f3b0c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1750202933 shutdown_connections 2021-10-21T00:30:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1750202933 wait complete. 2021-10-21T00:30:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 Processor -- start 2021-10-21T00:30:20.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 -- start start 2021-10-21T00:30:20.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0c0ace70 0x7f3b0c142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 0x7f3b0c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b0c0b30d0 0x7f3b0c153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c065930 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c066000 con 0x7f3b0c0ace70 2021-10-21T00:30:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b12c0e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c067150 con 0x7f3b0c0b0710 2021-10-21T00:30:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b1240d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b0c0b30d0 0x7f3b0c153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b11c0c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0c0ace70 0x7f3b0c142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.584 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b1240d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b0c0b30d0 0x7f3b0c153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46386/0 (socket says 172.21.15.12:46386) 2021-10-21T00:30:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b1140b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 0x7f3b0c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.557+0000 7f3b1240d700 1 -- 172.21.15.12:0/1159864360 learned_addr learned my addr 172.21.15.12:0/1159864360 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b1240d700 1 -- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 msgr2=0x7f3b0c153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b1240d700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 0x7f3b0c153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b1240d700 1 -- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0c0ace70 msgr2=0x7f3b0c142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b1240d700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0c0ace70 0x7f3b0c142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b1240d700 1 -- 172.21.15.12:0/1159864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04009530 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b11c0c700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0c0ace70 0x7f3b0c142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:30:20.587 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b1240d700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b0c0b30d0 0x7f3b0c153b60 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f3b0400c000 tx=0x7f3b04009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:20.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3afaffd700 1 -- 172.21.15.12:0/1159864360 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0400c850 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3afaffd700 1 -- 172.21.15.12:0/1159864360 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400c9b0 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.588 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0800c310 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3afaffd700 1 -- 172.21.15.12:0/1159864360 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0400cd10 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c067690 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c065d00 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3afaffd700 1 -- 172.21.15.12:0/1159864360 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3b04022070 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3afaffd700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3aec0534f0 0x7f3aec0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3afaffd700 1 -- 172.21.15.12:0/1159864360 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f3b0406bf30 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.561+0000 7f3b11c0c700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3aec0534f0 0x7f3aec0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.565+0000 7f3b11c0c700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3aec0534f0 0x7f3aec0559b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f3b0801c000 tx=0x7f3b0c0a9420).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.569+0000 7f3afaffd700 1 -- 172.21.15.12:0/1159864360 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3b04043210 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.697+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b0c057350 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.697+0000 7f3afaffd700 1 -- 172.21.15.12:0/1159864360 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+13553 (secure 0 0 0) 0x7f3b04016030 con 0x7f3b0c0b30d0 2021-10-21T00:30:20.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-21T00:30:20.711 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":166,"fsid":"e54e6890-5274-4a86-a9de-861e39b4bc51","created":"2021-10-20T23:19:37.018397+0000","modified":"2021-10-20T23:29:49.201504+0000","last_up_change":"2021-10-20T23:19:43.973697+0000","last_in_change":"2021-10-20T23:19:43.973697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-20T23:19:40.017051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-20T23:19:48.281190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55fdd305-1085-4e58-afe8-69a6e5889a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":14574},{"type":"v1","addr":"172.21.15.12:6817","nonce":14574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":14574},{"type":"v1","addr":"172.21.15.12:6819","nonce":14574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":14574},{"type":"v1","addr":"172.21.15.12:6823","nonce":14574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":14574},{"type":"v1","addr":"172.21.15.12:6821","nonce":14574}]},"public_addr":"172.21.15.12:6817/14574","cluster_addr":"172.21.15.12:6819/14574","heartbeat_back_addr":"172.21.15.12:6823/14574","heartbeat_front_addr":"172.21.15.12:6821/14574","state":["exists","up"]},{"osd":1,"uuid":"46781b1a-7c1f-4b28-b7f4-95f1ac9cb292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":14575},{"type":"v1","addr":"172.21.15.12:6825","nonce":14575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":14575},{"type":"v1","addr":"172.21.15.12:6827","nonce":14575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":14575},{"type":"v1","addr":"172.21.15.12:6831","nonce":14575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":14575},{"type":"v1","addr":"172.21.15.12:6829","nonce":14575}]},"public_addr":"172.21.15.12:6825/14575","cluster_addr":"172.21.15.12:6827/14575","heartbeat_back_addr":"172.21.15.12:6831/14575","heartbeat_front_addr":"172.21.15.12:6829/14575","state":["exists","up"]},{"osd":2,"uuid":"2575330a-a36d-475d-ab15-08d6384ed089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":14573},{"type":"v1","addr":"172.21.15.12:6809","nonce":14573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":14573},{"type":"v1","addr":"172.21.15.12:6811","nonce":14573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":14573},{"type":"v1","addr":"172.21.15.12:6815","nonce":14573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":14573},{"type":"v1","addr":"172.21.15.12:6813","nonce":14573}]},"public_addr":"172.21.15.12:6809/14573","cluster_addr":"172.21.15.12:6811/14573","heartbeat_back_addr":"172.21.15.12:6815/14573","heartbeat_front_addr":"172.21.15.12:6813/14573","state":["exists","up"]},{"osd":3,"uuid":"e76967d4-67cc-435f-8c7b-b6e53e98ded9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":14572},{"type":"v1","addr":"172.21.15.12:6801","nonce":14572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":14572},{"type":"v1","addr":"172.21.15.12:6803","nonce":14572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":14572},{"type":"v1","addr":"172.21.15.12:6807","nonce":14572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":14572},{"type":"v1","addr":"172.21.15.12:6805","nonce":14572}]},"public_addr":"172.21.15.12:6801/14572","cluster_addr":"172.21.15.12:6803/14572","heartbeat_back_addr":"172.21.15.12:6807/14572","heartbeat_front_addr":"172.21.15.12:6805/14572","state":["exists","up"]},{"osd":4,"uuid":"b4da75a6-08bb-4741-aa9c-ccbf8ccff189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":14820},{"type":"v1","addr":"172.21.15.31:6811","nonce":14820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":14820},{"type":"v1","addr":"172.21.15.31:6813","nonce":14820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":14820},{"type":"v1","addr":"172.21.15.31:6817","nonce":14820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":14820},{"type":"v1","addr":"172.21.15.31:6815","nonce":14820}]},"public_addr":"172.21.15.31:6811/14820","cluster_addr":"172.21.15.31:6813/14820","heartbeat_back_addr":"172.21.15.31:6817/14820","heartbeat_front_addr":"172.21.15.31:6815/14820","state":["exists","up"]},{"osd":5,"uuid":"44da5aeb-adb6-4f57-a07f-e7cd5528bd11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":14819},{"type":"v1","addr":"172.21.15.31:6803","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":14819},{"type":"v1","addr":"172.21.15.31:6805","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":14819},{"type":"v1","addr":"172.21.15.31:6809","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":14819},{"type":"v1","addr":"172.21.15.31:6807","nonce":14819}]},"public_addr":"172.21.15.31:6803/14819","cluster_addr":"172.21.15.31:6805/14819","heartbeat_back_addr":"172.21.15.31:6809/14819","heartbeat_front_addr":"172.21.15.31:6807/14819","state":["exists","up"]},{"osd":6,"uuid":"b74da8f7-c44a-4ec6-afbf-41cba5c861dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":14822},{"type":"v1","addr":"172.21.15.31:6827","nonce":14822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":14822},{"type":"v1","addr":"172.21.15.31:6829","nonce":14822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":14822},{"type":"v1","addr":"172.21.15.31:6833","nonce":14822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":14822},{"type":"v1","addr":"172.21.15.31:6831","nonce":14822}]},"public_addr":"172.21.15.31:6827/14822","cluster_addr":"172.21.15.31:6829/14822","heartbeat_back_addr":"172.21.15.31:6833/14822","heartbeat_front_addr":"172.21.15.31:6831/14822","state":["exists","up"]},{"osd":7,"uuid":"871fe79c-ebd6-4f14-8db0-dcbb9a18c0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":14835},{"type":"v1","addr":"172.21.15.31:6819","nonce":14835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":14835},{"type":"v1","addr":"172.21.15.31:6821","nonce":14835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":14835},{"type":"v1","addr":"172.21.15.31:6825","nonce":14835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":14835},{"type":"v1","addr":"172.21.15.31:6823","nonce":14835}]},"public_addr":"172.21.15.31:6819/14835","cluster_addr":"172.21.15.31:6821/14835","heartbeat_back_addr":"172.21.15.31:6825/14835","heartbeat_front_addr":"172.21.15.31:6823/14835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.186771+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.707192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.529367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.495415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.610503+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.454201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.727408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-20T23:19:42.678045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.12:6835/1536487631":"2021-10-21T23:29:45.856431+0000","172.21.15.12:6834/1536487631":"2021-10-21T23:29:45.856431+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:30:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3aec0534f0 msgr2=0x7f3aec0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3aec0534f0 0x7f3aec0559b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f3b0801c000 tx=0x7f3b0c0a9420).stop 2021-10-21T00:30:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b0c0b30d0 msgr2=0x7f3b0c153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b0c0b30d0 0x7f3b0c153b60 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f3b0400c000 tx=0x7f3b04009290).stop 2021-10-21T00:30:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 shutdown_connections 2021-10-21T00:30:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3aec0534f0 0x7f3aec0559b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b0c0b30d0 0x7f3b0c153b60 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b0c0b0710 0x7f3b0c153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 --2- 172.21.15.12:0/1159864360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0c0ace70 0x7f3b0c142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:20.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 >> 172.21.15.12:0/1159864360 conn(0x7f3b0c061140 msgr2=0x7f3b0c140670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:20.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 shutdown_connections 2021-10-21T00:30:20.721 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:20.701+0000 7f3b12c0e700 1 -- 172.21.15.12:0/1159864360 wait complete. 2021-10-21T00:30:21.726 INFO:tasks.ceph:Scrubbing osd.0 2021-10-21T00:30:21.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:30:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f302d612700 1 Processor -- start 2021-10-21T00:30:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f302d612700 1 -- start start 2021-10-21T00:30:21.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f302d612700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30280b34a0 0x7f3028143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:21.852 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f302d612700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f30280a9f40 0x7f30280af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:21.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f302d612700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30280b3880 con 0x7f30280af560 2021-10-21T00:30:21.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f302d612700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3028144260 con 0x7f30280a9f40 2021-10-21T00:30:21.853 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f302d612700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280af9f0 con 0x7f30280b34a0 2021-10-21T00:30:21.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f30267fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f30280a9f40 0x7f30280af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:21.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f30277fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f30280af560 0x7f302805f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44988/0 (socket says 172.21.15.12:44988) 2021-10-21T00:30:21.854 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f30277fe700 1 -- 172.21.15.12:0/2023863932 learned_addr learned my addr 172.21.15.12:0/2023863932 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-21T00:30:21.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f3026ffd700 1 --2- 172.21.15.12:0/2023863932 >> v2:172.21.15.31:3300/0 conn(0x7f30280b34a0 0x7f3028143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:21.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f30267fc700 1 -- 172.21.15.12:0/2023863932 >> v2:172.21.15.31:3300/0 conn(0x7f30280b34a0 msgr2=0x7f3028143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:21.855 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f30267fc700 1 --2- 172.21.15.12:0/2023863932 >> v2:172.21.15.31:3300/0 conn(0x7f30280b34a0 0x7f3028143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:21.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f30267fc700 1 -- 172.21.15.12:0/2023863932 >> v1:172.21.15.12:6789/0 conn(0x7f30280af560 legacy=0x7f302805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:21.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.837+0000 7f30267fc700 1 -- 172.21.15.12:0/2023863932 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30281469b0 con 0x7f30280a9f40 2021-10-21T00:30:21.856 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f30267fc700 1 --2- 172.21.15.12:0/2023863932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280a9f40 0x7f30280af070 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f3010002f70 tx=0x7f3010006df0).ready entity=mon.0 client_cookie=697c6cf929beee5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:21.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f3025ffb700 1 -- 172.21.15.12:0/2023863932 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f301000d5c0 con 0x7f30280a9f40 2021-10-21T00:30:21.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f3025ffb700 1 -- 172.21.15.12:0/2023863932 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3010000e90 con 0x7f30280a9f40 2021-10-21T00:30:21.857 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f3025ffb700 1 -- 172.21.15.12:0/2023863932 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f301000d910 con 0x7f30280a9f40 2021-10-21T00:30:21.860 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f302d612700 1 -- 172.21.15.12:0/2023863932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280a9f40 msgr2=0x7f30280af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:21.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f302d612700 1 --2- 172.21.15.12:0/2023863932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280a9f40 0x7f30280af070 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f3010002f70 tx=0x7f3010006df0).stop 2021-10-21T00:30:21.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f302d612700 1 -- 172.21.15.12:0/2023863932 shutdown_connections 2021-10-21T00:30:21.861 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f302d612700 1 --2- 172.21.15.12:0/2023863932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280a9f40 0x7f30280af070 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:21.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f302d612700 1 --2- 172.21.15.12:0/2023863932 >> v2:172.21.15.31:3300/0 conn(0x7f30280b34a0 0x7f3028143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:21.862 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f302d612700 1 -- 172.21.15.12:0/2023863932 >> 172.21.15.12:0/2023863932 conn(0x7f30280607c0 msgr2=0x7f3028060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:21.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f302d612700 1 -- 172.21.15.12:0/2023863932 shutdown_connections 2021-10-21T00:30:21.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.841+0000 7f302d612700 1 -- 172.21.15.12:0/2023863932 wait complete. 2021-10-21T00:30:21.863 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f302d612700 1 Processor -- start 2021-10-21T00:30:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f302d612700 1 -- start start 2021-10-21T00:30:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f302d612700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30280a9f40 0x7f30281418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f302d612700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280af560 0x7f30281445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f302d612700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30280b34a0 0x7f3028144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f302d612700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302813f710 con 0x7f30280af560 2021-10-21T00:30:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f302d612700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3028156ca0 con 0x7f30280b34a0 2021-10-21T00:30:21.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f302d612700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3028156a00 con 0x7f30280a9f40 2021-10-21T00:30:21.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30267fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280af560 0x7f30281445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:21.866 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30267fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280af560 0x7f30281445a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46398/0 (socket says 172.21.15.12:46398) 2021-10-21T00:30:21.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30267fc700 1 -- 172.21.15.12:0/1802366512 learned_addr learned my addr 172.21.15.12:0/1802366512 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:21.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f3026ffd700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30280a9f40 0x7f30281418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:21.867 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30277fe700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30280b34a0 0x7f3028144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:21.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30267fc700 1 -- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30280a9f40 msgr2=0x7f30281418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:21.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30267fc700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30280a9f40 0x7f30281418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:21.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30267fc700 1 -- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30280b34a0 msgr2=0x7f3028144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:21.868 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30267fc700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30280b34a0 0x7f3028144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:21.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30267fc700 1 -- 172.21.15.12:0/1802366512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301000b180 con 0x7f30280af560 2021-10-21T00:30:21.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30277fe700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30280b34a0 0x7f3028144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:30:21.869 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.845+0000 7f30267fc700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280af560 0x7f30281445a0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f3010002f70 tx=0x7f3010014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:21.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f301ffff700 1 -- 172.21.15.12:0/1802366512 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3010013e90 con 0x7f30280af560 2021-10-21T00:30:21.870 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f301ffff700 1 -- 172.21.15.12:0/1802366512 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301001e400 con 0x7f30280af560 2021-10-21T00:30:21.871 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3028141190 con 0x7f30280af560 2021-10-21T00:30:21.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f301ffff700 1 -- 172.21.15.12:0/1802366512 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f301001e760 con 0x7f30280af560 2021-10-21T00:30:21.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3028141dc0 con 0x7f30280af560 2021-10-21T00:30:21.872 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3028141630 con 0x7f30280af560 2021-10-21T00:30:21.874 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f301ffff700 1 -- 172.21.15.12:0/1802366512 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3010025030 con 0x7f30280af560 2021-10-21T00:30:21.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f301ffff700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f300c053610 0x7f300c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:21.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f301ffff700 1 -- 172.21.15.12:0/1802366512 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f301006c570 con 0x7f30280af560 2021-10-21T00:30:21.875 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f301ffff700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7f300c05a230 0x7f300c05c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:21.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f301ffff700 1 -- 172.21.15.12:0/1802366512 --> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f300c05cc10 con 0x7f300c05a230 2021-10-21T00:30:21.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f301ffff700 1 -- 172.21.15.12:0/1802366512 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) v2 ==== 24+0+0 (secure 0 0 0) 0x7f301006ebe0 con 0x7f30280af560 2021-10-21T00:30:21.876 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f3026ffd700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f300c053610 0x7f300c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:21.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f30277fe700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7f300c05a230 0x7f300c05c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:21.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.849+0000 7f30277fe700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7f300c05a230 0x7f300c05c650 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:21.877 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.853+0000 7f3026ffd700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f300c053610 0x7f300c055ad0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f301800d000 tx=0x7f3018008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:21.878 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.853+0000 7f301ffff700 1 -- 172.21.15.12:0/1802366512 <== osd.0 v2:172.21.15.12:6816/14574 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f300c05cc10 con 0x7f300c05a230 2021-10-21T00:30:21.883 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.869+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 --> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3028146c50 con 0x7f300c05a230 2021-10-21T00:30:21.884 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f301ffff700 1 -- 172.21.15.12:0/1802366512 <== osd.0 v2:172.21.15.12:6816/14574 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3028146c50 con 0x7f300c05a230 2021-10-21T00:30:21.884 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-21T00:30:21.885 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:30:21.885 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-21T00:30:21.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7f300c05a230 msgr2=0x7f300c05c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:21.886 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.12:6816/14574,v1:172.21.15.12:6817/14574] conn(0x7f300c05a230 0x7f300c05c650 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:21.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f300c053610 msgr2=0x7f300c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:21.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f300c053610 0x7f300c055ad0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f301800d000 tx=0x7f3018008040).stop 2021-10-21T00:30:21.887 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280af560 msgr2=0x7f30281445a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:21.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 --2- 172.21.15.12:0/1802366512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30280af560 0x7f30281445a0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f3010002f70 tx=0x7f3010014000).stop 2021-10-21T00:30:21.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f30277fe700 1 -- 172.21.15.12:0/1802366512 reap_dead start 2021-10-21T00:30:21.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 shutdown_connections 2021-10-21T00:30:21.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 >> 172.21.15.12:0/1802366512 conn(0x7f30280607c0 msgr2=0x7f3028140080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:21.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 shutdown_connections 2021-10-21T00:30:21.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.873+0000 7f302d612700 1 -- 172.21.15.12:0/1802366512 wait complete. 2021-10-21T00:30:21.897 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-10-21T00:30:22.006 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.993+0000 7f07a7129700 1 Processor -- start 2021-10-21T00:30:22.007 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.993+0000 7f07a7129700 1 -- start start 2021-10-21T00:30:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00b1db0 0x7f07a00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07a00a70c0 0x7f07a0144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00b0350 con 0x7f07a01483a0 2021-10-21T00:30:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a00a90c0 con 0x7f07a00a70c0 2021-10-21T00:30:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00b05f0 con 0x7f07a00b1db0 2021-10-21T00:30:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a56c6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07a00a70c0 0x7f07a0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.012 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a56c6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07a00a70c0 0x7f07a0144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46410/0 (socket says 172.21.15.12:46410) 2021-10-21T00:30:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a56c6700 1 -- 172.21.15.12:0/1454392666 learned_addr learned my addr 172.21.15.12:0/1454392666 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f079ffff700 1 --1- 172.21.15.12:0/1454392666 >> v1:172.21.15.31:6789/0 conn(0x7f07a01483a0 0x7f07a00b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:52064/0 (socket says 172.21.15.12:52064) 2021-10-21T00:30:22.013 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a4ec5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00b1db0 0x7f07a00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f079f7fe700 1 -- 172.21.15.12:0/1454392666 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148399351 0 0) 0x7f07a00b0350 con 0x7f07a01483a0 2021-10-21T00:30:22.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f079f7fe700 1 -- 172.21.15.12:0/1454392666 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f078c003260 con 0x7f07a01483a0 2021-10-21T00:30:22.014 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a56c6700 1 -- 172.21.15.12:0/1454392666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00b1db0 msgr2=0x7f07a00b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:22.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a56c6700 1 --2- 172.21.15.12:0/1454392666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00b1db0 0x7f07a00b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.015 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a56c6700 1 -- 172.21.15.12:0/1454392666 >> v1:172.21.15.31:6789/0 conn(0x7f07a01483a0 legacy=0x7f07a00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a56c6700 1 -- 172.21.15.12:0/1454392666 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a00b0890 con 0x7f07a00a70c0 2021-10-21T00:30:22.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a56c6700 1 --2- 172.21.15.12:0/1454392666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a00a70c0 0x7f07a0144720 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f07980032f0 tx=0x7f0798009290).ready entity=mon.0 client_cookie=417e58d495fbb4b4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f079f7fe700 1 -- 172.21.15.12:0/1454392666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f079800b6c0 con 0x7f07a00a70c0 2021-10-21T00:30:22.016 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f079f7fe700 1 -- 172.21.15.12:0/1454392666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800b820 con 0x7f07a00a70c0 2021-10-21T00:30:22.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f079f7fe700 1 -- 172.21.15.12:0/1454392666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f079800b990 con 0x7f07a00a70c0 2021-10-21T00:30:22.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 -- 172.21.15.12:0/1454392666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a00a70c0 msgr2=0x7f07a0144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.017 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 --2- 172.21.15.12:0/1454392666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a00a70c0 0x7f07a0144720 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f07980032f0 tx=0x7f0798009290).stop 2021-10-21T00:30:22.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 -- 172.21.15.12:0/1454392666 shutdown_connections 2021-10-21T00:30:22.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 --2- 172.21.15.12:0/1454392666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a00a70c0 0x7f07a0144720 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.018 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 --2- 172.21.15.12:0/1454392666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00b1db0 0x7f07a00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 -- 172.21.15.12:0/1454392666 >> 172.21.15.12:0/1454392666 conn(0x7f07a005f6b0 msgr2=0x7f07a005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:22.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 -- 172.21.15.12:0/1454392666 shutdown_connections 2021-10-21T00:30:22.019 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:21.997+0000 7f07a7129700 1 -- 172.21.15.12:0/1454392666 wait complete. 2021-10-21T00:30:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a7129700 1 Processor -- start 2021-10-21T00:30:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a7129700 1 -- start start 2021-10-21T00:30:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a7129700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00a70c0 0x7f07a01423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a7129700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b1db0 0x7f07a014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a7129700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a01483a0 0x7f07a013d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.026 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a7129700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a014a6d0 con 0x7f07a01483a0 2021-10-21T00:30:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a7129700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a014b8c0 con 0x7f07a00b1db0 2021-10-21T00:30:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a7129700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a014a8c0 con 0x7f07a00a70c0 2021-10-21T00:30:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a56c6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a01483a0 0x7f07a013d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f079ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b1db0 0x7f07a014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a4ec5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00a70c0 0x7f07a01423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.029 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f079ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b1db0 0x7f07a014b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:33154/0 (socket says 172.21.15.12:33154) 2021-10-21T00:30:22.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f079ffff700 1 -- 172.21.15.12:0/982240592 learned_addr learned my addr 172.21.15.12:0/982240592 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:22.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a56c6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a01483a0 0x7f07a013d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46416/0 (socket says 172.21.15.12:46416) 2021-10-21T00:30:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a56c6700 1 -- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00a70c0 msgr2=0x7f07a01423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a56c6700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00a70c0 0x7f07a01423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a56c6700 1 -- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b1db0 msgr2=0x7f07a014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.032 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a56c6700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b1db0 0x7f07a014b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a56c6700 1 -- 172.21.15.12:0/982240592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0798009530 con 0x7f07a01483a0 2021-10-21T00:30:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a56c6700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a01483a0 0x7f07a013d870 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f07980032f0 tx=0x7f0798016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f079dffb700 1 -- 172.21.15.12:0/982240592 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f079800b990 con 0x7f07a01483a0 2021-10-21T00:30:22.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f079dffb700 1 -- 172.21.15.12:0/982240592 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0798021630 con 0x7f07a01483a0 2021-10-21T00:30:22.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.001+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a014ab60 con 0x7f07a01483a0 2021-10-21T00:30:22.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.005+0000 7f079dffb700 1 -- 172.21.15.12:0/982240592 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0798006b60 con 0x7f07a01483a0 2021-10-21T00:30:22.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.005+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a013e830 con 0x7f07a01483a0 2021-10-21T00:30:22.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.005+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a0057350 con 0x7f07a01483a0 2021-10-21T00:30:22.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.005+0000 7f079dffb700 1 -- 172.21.15.12:0/982240592 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0798027020 con 0x7f07a01483a0 2021-10-21T00:30:22.038 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.005+0000 7f079dffb700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0780053640 0x7f0780055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.039 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.005+0000 7f079dffb700 1 -- 172.21.15.12:0/982240592 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f079806ca80 con 0x7f07a01483a0 2021-10-21T00:30:22.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.005+0000 7f07a4ec5700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0780053640 0x7f0780055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.040 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.009+0000 7f07a4ec5700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0780053640 0x7f0780055b00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f079400b000 tx=0x7f0794006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.017+0000 7f079dffb700 1 -- 172.21.15.12:0/982240592 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0798043d60 con 0x7f07a01483a0 2021-10-21T00:30:22.156 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.145+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f07a0044650 con 0x7f0780053640 2021-10-21T00:30:22.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.145+0000 7f079dffb700 1 -- 172.21.15.12:0/982240592 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f07a0044650 con 0x7f0780053640 2021-10-21T00:30:22.160 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0780053640 msgr2=0x7f0780055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0780053640 0x7f0780055b00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f079400b000 tx=0x7f0794006df0).stop 2021-10-21T00:30:22.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a01483a0 msgr2=0x7f07a013d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.161 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a01483a0 0x7f07a013d870 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f07980032f0 tx=0x7f0798016000).stop 2021-10-21T00:30:22.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 shutdown_connections 2021-10-21T00:30:22.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0780053640 0x7f0780055b00 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a01483a0 0x7f07a013d870 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b1db0 0x7f07a014b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 --2- 172.21.15.12:0/982240592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07a00a70c0 0x7f07a01423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 >> 172.21.15.12:0/982240592 conn(0x7f07a005f6b0 msgr2=0x7f07a0146e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:22.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 shutdown_connections 2021-10-21T00:30:22.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.149+0000 7f07a7129700 1 -- 172.21.15.12:0/982240592 wait complete. 2021-10-21T00:30:22.165 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2021-10-21T00:30:22.175 INFO:tasks.ceph:Scrubbing osd.1 2021-10-21T00:30:22.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:30:22.286 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.273+0000 7fd9e8b50700 1 Processor -- start 2021-10-21T00:30:22.287 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.273+0000 7fd9e8b50700 1 -- start start 2021-10-21T00:30:22.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.273+0000 7fd9e8b50700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd9e4061320 0x7fd9e4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.273+0000 7fd9e8b50700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4140440 0x7fd9e41408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.289 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.273+0000 7fd9e8b50700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e40aecf0 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.273+0000 7fd9e8b50700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e40b6f20 con 0x7fd9e4061320 2021-10-21T00:30:22.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.273+0000 7fd9e8b50700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40aef20 con 0x7fd9e4140440 2021-10-21T00:30:22.290 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4140440 0x7fd9e41408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd9e4061320 0x7fd9e4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4140440 0x7fd9e41408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:52182/0 (socket says 172.21.15.12:52182) 2021-10-21T00:30:22.291 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e3fff700 1 -- 172.21.15.12:0/1560761471 learned_addr learned my addr 172.21.15.12:0/1560761471 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e2ffd700 1 --1- 172.21.15.12:0/1560761471 >> v1:172.21.15.31:6789/0 conn(0x7fd9e40ad5c0 0x7fd9e40b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:52080/0 (socket says 172.21.15.12:52080) 2021-10-21T00:30:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e3fff700 1 -- 172.21.15.12:0/1560761471 >> v2:172.21.15.31:3300/0 conn(0x7fd9e4061320 msgr2=0x7fd9e4061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:22.292 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e3fff700 1 --2- 172.21.15.12:0/1560761471 >> v2:172.21.15.31:3300/0 conn(0x7fd9e4061320 0x7fd9e4061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e3fff700 1 -- 172.21.15.12:0/1560761471 >> v1:172.21.15.31:6789/0 conn(0x7fd9e40ad5c0 legacy=0x7fd9e40b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e3fff700 1 -- 172.21.15.12:0/1560761471 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40af1c0 con 0x7fd9e4140440 2021-10-21T00:30:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e3fff700 1 --2- 172.21.15.12:0/1560761471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4140440 0x7fd9e41408d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd9e40aeba0 tx=0x7fd9dc009290).ready entity=mon.2 client_cookie=3b15caa83b018e1d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e27fc700 1 -- 172.21.15.12:0/1560761471 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9dc00b860 con 0x7fd9e4140440 2021-10-21T00:30:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e27fc700 1 -- 172.21.15.12:0/1560761471 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00b9c0 con 0x7fd9e4140440 2021-10-21T00:30:22.294 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e27fc700 1 -- 172.21.15.12:0/1560761471 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9dc00bb30 con 0x7fd9e4140440 2021-10-21T00:30:22.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1560761471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4140440 msgr2=0x7fd9e41408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.299 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e8b50700 1 --2- 172.21.15.12:0/1560761471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4140440 0x7fd9e41408d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd9e40aeba0 tx=0x7fd9dc009290).stop 2021-10-21T00:30:22.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1560761471 shutdown_connections 2021-10-21T00:30:22.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e8b50700 1 --2- 172.21.15.12:0/1560761471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4140440 0x7fd9e41408d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.300 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e8b50700 1 --2- 172.21.15.12:0/1560761471 >> v2:172.21.15.31:3300/0 conn(0x7fd9e4061320 0x7fd9e4061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1560761471 >> 172.21.15.12:0/1560761471 conn(0x7fd9e4066de0 msgr2=0x7fd9e40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1560761471 shutdown_connections 2021-10-21T00:30:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.277+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1560761471 wait complete. 2021-10-21T00:30:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 Processor -- start 2021-10-21T00:30:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 -- start start 2021-10-21T00:30:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4061320 0x7fd9e409ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e40ad5c0 0x7fd9e409ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4140440 0x7fd9e4152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40b15f0 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40b2040 con 0x7fd9e4140440 2021-10-21T00:30:22.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40b1820 con 0x7fd9e4061320 2021-10-21T00:30:22.304 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e40ad5c0 0x7fd9e409ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e40ad5c0 0x7fd9e409ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46428/0 (socket says 172.21.15.12:46428) 2021-10-21T00:30:22.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e2ffd700 1 -- 172.21.15.12:0/1831568340 learned_addr learned my addr 172.21.15.12:0/1831568340 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:22.305 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e37fe700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4061320 0x7fd9e409ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e3fff700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4140440 0x7fd9e4152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e2ffd700 1 -- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4061320 msgr2=0x7fd9e409ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.306 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e2ffd700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4061320 0x7fd9e409ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e2ffd700 1 -- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4140440 msgr2=0x7fd9e4152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e2ffd700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4140440 0x7fd9e4152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.307 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e2ffd700 1 -- 172.21.15.12:0/1831568340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc009530 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e37fe700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4061320 0x7fd9e409ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:30:22.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e2ffd700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e40ad5c0 0x7fd9e409ef40 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fd9e40af7e0 tx=0x7fd9d4007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e0ff9700 1 -- 172.21.15.12:0/1831568340 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d40070d0 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e0ff9700 1 -- 172.21.15.12:0/1831568340 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4007230 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e0ff9700 1 -- 172.21.15.12:0/1831568340 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d4005740 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e40b22c0 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.281+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e405c5e0 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9e40b2ba0 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e0ff9700 1 -- 172.21.15.12:0/1831568340 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd9d4010070 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e0ff9700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9c80534f0 0x7fd9c80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e0ff9700 1 -- 172.21.15.12:0/1831568340 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fd9d406ac70 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e0ff9700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7fd9c805a320 0x7fd9c805c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e0ff9700 1 -- 172.21.15.12:0/1831568340 --> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9c805cda0 con 0x7fd9c805a320 2021-10-21T00:30:22.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e0ff9700 1 -- 172.21.15.12:0/1831568340 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9d406f030 con 0x7fd9e40ad5c0 2021-10-21T00:30:22.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e37fe700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9c80534f0 0x7fd9c80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e3fff700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7fd9c805a320 0x7fd9c805c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e3fff700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7fd9c805a320 0x7fd9c805c740 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e37fe700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9c80534f0 0x7fd9c80559b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fd9cc00b000 tx=0x7fd9cc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.285+0000 7fd9e0ff9700 1 -- 172.21.15.12:0/1831568340 <== osd.1 v2:172.21.15.12:6824/14575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fd9c805cda0 con 0x7fd9c805a320 2021-10-21T00:30:22.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 --> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd9e4152a30 con 0x7fd9c805a320 2021-10-21T00:30:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e0ff9700 1 -- 172.21.15.12:0/1831568340 <== osd.1 v2:172.21.15.12:6824/14575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd9e4152a30 con 0x7fd9c805a320 2021-10-21T00:30:22.320 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-21T00:30:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:30:22.321 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-21T00:30:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7fd9c805a320 msgr2=0x7fd9c805c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.12:6824/14575,v1:172.21.15.12:6825/14575] conn(0x7fd9c805a320 0x7fd9c805c740 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9c80534f0 msgr2=0x7fd9c80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fd9c80534f0 0x7fd9c80559b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fd9cc00b000 tx=0x7fd9cc008040).stop 2021-10-21T00:30:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e40ad5c0 msgr2=0x7fd9e409ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 --2- 172.21.15.12:0/1831568340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e40ad5c0 0x7fd9e409ef40 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fd9e40af7e0 tx=0x7fd9d4007ba0).stop 2021-10-21T00:30:22.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e3fff700 1 -- 172.21.15.12:0/1831568340 reap_dead start 2021-10-21T00:30:22.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 shutdown_connections 2021-10-21T00:30:22.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 >> 172.21.15.12:0/1831568340 conn(0x7fd9e4066de0 msgr2=0x7fd9e41436a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 shutdown_connections 2021-10-21T00:30:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.309+0000 7fd9e8b50700 1 -- 172.21.15.12:0/1831568340 wait complete. 2021-10-21T00:30:22.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-10-21T00:30:22.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe4543bf700 1 Processor -- start 2021-10-21T00:30:22.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe4543bf700 1 -- start start 2021-10-21T00:30:22.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe4543bf700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe44c0b2200 0x7fe44c0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe4543bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c0affd0 0x7fe44c0ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe4543bf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe44c1416a0 0x7fe44c141af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe4543bf700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c0ac7e0 con 0x7fe44c0b2200 2021-10-21T00:30:22.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe4543bf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c145250 con 0x7fe44c1416a0 2021-10-21T00:30:22.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe4543bf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1454f0 con 0x7fe44c0affd0 2021-10-21T00:30:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe45215b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe44c0b2200 0x7fe44c0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe45215b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe44c0b2200 0x7fe44c0abe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46440/0 (socket says 172.21.15.12:46440) 2021-10-21T00:30:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe45195a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c0affd0 0x7fe44c0ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe45215b700 1 -- 172.21.15.12:0/3755981 learned_addr learned my addr 172.21.15.12:0/3755981 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:22.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.433+0000 7fe45295c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe44c1416a0 0x7fe44c141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe45215b700 1 -- 172.21.15.12:0/3755981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c0affd0 msgr2=0x7fe44c0ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:22.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe45215b700 1 --2- 172.21.15.12:0/3755981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c0affd0 0x7fe44c0ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe45215b700 1 -- 172.21.15.12:0/3755981 >> v2:172.21.15.31:3300/0 conn(0x7fe44c1416a0 msgr2=0x7fe44c141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:22.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe45215b700 1 --2- 172.21.15.12:0/3755981 >> v2:172.21.15.31:3300/0 conn(0x7fe44c1416a0 0x7fe44c141af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.453 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe45215b700 1 -- 172.21.15.12:0/3755981 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c141200 con 0x7fe44c0b2200 2021-10-21T00:30:22.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe45295c700 1 --2- 172.21.15.12:0/3755981 >> v2:172.21.15.31:3300/0 conn(0x7fe44c1416a0 0x7fe44c141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:30:22.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe45215b700 1 --2- 172.21.15.12:0/3755981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 0x7fe44c0abe00 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7fe448002f70 tx=0x7fe448006eb0).ready entity=mon.0 client_cookie=cd67092b997d4c41 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.454 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe451159700 1 -- 172.21.15.12:0/3755981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe44800d570 con 0x7fe44c0b2200 2021-10-21T00:30:22.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe451159700 1 -- 172.21.15.12:0/3755981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe448000e90 con 0x7fe44c0b2200 2021-10-21T00:30:22.455 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe451159700 1 -- 172.21.15.12:0/3755981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe44800d900 con 0x7fe44c0b2200 2021-10-21T00:30:22.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 -- 172.21.15.12:0/3755981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 msgr2=0x7fe44c0abe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.456 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3755981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 0x7fe44c0abe00 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7fe448002f70 tx=0x7fe448006eb0).stop 2021-10-21T00:30:22.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 -- 172.21.15.12:0/3755981 shutdown_connections 2021-10-21T00:30:22.460 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3755981 >> v2:172.21.15.31:3300/0 conn(0x7fe44c1416a0 0x7fe44c141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3755981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c0affd0 0x7fe44c0ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3755981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 0x7fe44c0abe00 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.461 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 -- 172.21.15.12:0/3755981 >> 172.21.15.12:0/3755981 conn(0x7fe44c05f6b0 msgr2=0x7fe44c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:22.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 -- 172.21.15.12:0/3755981 shutdown_connections 2021-10-21T00:30:22.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 -- 172.21.15.12:0/3755981 wait complete. 2021-10-21T00:30:22.462 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.437+0000 7fe4543bf700 1 Processor -- start 2021-10-21T00:30:22.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe4543bf700 1 -- start start 2021-10-21T00:30:22.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe4543bf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe44c0affd0 0x7fe44c13bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.463 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe4543bf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 0x7fe44c13d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe4543bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c1416a0 0x7fe44c13d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe4543bf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c143b90 con 0x7fe44c0b2200 2021-10-21T00:30:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe4543bf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1438f0 con 0x7fe44c0affd0 2021-10-21T00:30:22.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe4543bf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c13e0c0 con 0x7fe44c1416a0 2021-10-21T00:30:22.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45195a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 0x7fe44c13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.465 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45195a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 0x7fe44c13d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46444/0 (socket says 172.21.15.12:46444) 2021-10-21T00:30:22.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45195a700 1 -- 172.21.15.12:0/3077806914 learned_addr learned my addr 172.21.15.12:0/3077806914 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:22.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45215b700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe44c0affd0 0x7fe44c13bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.466 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45295c700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c1416a0 0x7fe44c13d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45195a700 1 -- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c1416a0 msgr2=0x7fe44c13d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45195a700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c1416a0 0x7fe44c13d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.467 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45195a700 1 -- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe44c0affd0 msgr2=0x7fe44c13bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45195a700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe44c0affd0 0x7fe44c13bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45195a700 1 -- 172.21.15.12:0/3077806914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444009470 con 0x7fe44c0b2200 2021-10-21T00:30:22.468 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe45195a700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 0x7fe44c13d2b0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7fe43c00c000 tx=0x7fe43c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe43b7fe700 1 -- 172.21.15.12:0/3077806914 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe43c010780 con 0x7fe44c0b2200 2021-10-21T00:30:22.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe43b7fe700 1 -- 172.21.15.12:0/3077806914 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c0108e0 con 0x7fe44c0b2200 2021-10-21T00:30:22.469 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44800b1e0 con 0x7fe44c0b2200 2021-10-21T00:30:22.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe43b7fe700 1 -- 172.21.15.12:0/3077806914 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe43c010c40 con 0x7fe44c0b2200 2021-10-21T00:30:22.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.441+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c0b4f90 con 0x7fe44c0b2200 2021-10-21T00:30:22.470 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.445+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44c1436c0 con 0x7fe44c0b2200 2021-10-21T00:30:22.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.445+0000 7fe43b7fe700 1 -- 172.21.15.12:0/3077806914 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe43c01c460 con 0x7fe44c0b2200 2021-10-21T00:30:22.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.445+0000 7fe43b7fe700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe42c0534f0 0x7fe42c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.445+0000 7fe43b7fe700 1 -- 172.21.15.12:0/3077806914 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe43c06bcd0 con 0x7fe44c0b2200 2021-10-21T00:30:22.471 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.445+0000 7fe45215b700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe42c0534f0 0x7fe42c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.445+0000 7fe45215b700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe42c0534f0 0x7fe42c0559b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fe44801c000 tx=0x7fe448015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.472 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.453+0000 7fe43b7fe700 1 -- 172.21.15.12:0/3077806914 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe43c042dc0 con 0x7fe44c0b2200 2021-10-21T00:30:22.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.581+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe44c13e560 con 0x7fe42c0534f0 2021-10-21T00:30:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.581+0000 7fe43b7fe700 1 -- 172.21.15.12:0/3077806914 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe44800db70 con 0x7fe42c0534f0 2021-10-21T00:30:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.581+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe42c0534f0 msgr2=0x7fe42c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.581+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe42c0534f0 0x7fe42c0559b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fe44801c000 tx=0x7fe448015000).stop 2021-10-21T00:30:22.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.581+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 msgr2=0x7fe44c13d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.581+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 0x7fe44c13d2b0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7fe43c00c000 tx=0x7fe43c006df0).stop 2021-10-21T00:30:22.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.585+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 shutdown_connections 2021-10-21T00:30:22.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.585+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fe42c0534f0 0x7fe42c0559b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.585+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe44c1416a0 0x7fe44c13d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.585+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe44c0b2200 0x7fe44c13d2b0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.585+0000 7fe4543bf700 1 --2- 172.21.15.12:0/3077806914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe44c0affd0 0x7fe44c13bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.585+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 >> 172.21.15.12:0/3077806914 conn(0x7fe44c05f6b0 msgr2=0x7fe44c0aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:22.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.585+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 shutdown_connections 2021-10-21T00:30:22.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.585+0000 7fe4543bf700 1 -- 172.21.15.12:0/3077806914 wait complete. 2021-10-21T00:30:22.602 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2021-10-21T00:30:22.607 INFO:tasks.ceph:Scrubbing osd.2 2021-10-21T00:30:22.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:30:22.719 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.705+0000 7f3825987700 1 Processor -- start 2021-10-21T00:30:22.720 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f3825987700 1 -- start start 2021-10-21T00:30:22.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f3825987700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38200b2580 0x7f38200abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f3825987700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38200b1260 0x7f38200ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.724 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f3825987700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 0x7f38200afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f3825987700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38200add80 con 0x7f38200b1260 2021-10-21T00:30:22.725 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f3825987700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38200ae020 con 0x7f38200b2580 2021-10-21T00:30:22.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f3825987700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38200a9390 con 0x7f38200b1790 2021-10-21T00:30:22.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38200b1260 0x7f38200ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.726 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38200b1260 0x7f38200ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46450/0 (socket says 172.21.15.12:46450) 2021-10-21T00:30:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381ffff700 1 -- 172.21.15.12:0/843938112 learned_addr learned my addr 172.21.15.12:0/843938112 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f3825186700 1 --2- 172.21.15.12:0/843938112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 0x7f38200afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f3824985700 1 --2- 172.21.15.12:0/843938112 >> v2:172.21.15.31:3300/0 conn(0x7f38200b2580 0x7f38200abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381ffff700 1 -- 172.21.15.12:0/843938112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 msgr2=0x7f38200afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:22.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381ffff700 1 --2- 172.21.15.12:0/843938112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 0x7f38200afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.728 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381ffff700 1 -- 172.21.15.12:0/843938112 >> v2:172.21.15.31:3300/0 conn(0x7f38200b2580 msgr2=0x7f38200abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:22.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381ffff700 1 --2- 172.21.15.12:0/843938112 >> v2:172.21.15.31:3300/0 conn(0x7f38200b2580 0x7f38200abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381ffff700 1 -- 172.21.15.12:0/843938112 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200a9830 con 0x7f38200b1260 2021-10-21T00:30:22.729 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381ffff700 1 --2- 172.21.15.12:0/843938112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 0x7f38200ac000 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f380c002f70 tx=0x7f380c006eb0).ready entity=mon.0 client_cookie=2ef67130af293cfd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381f7fe700 1 -- 172.21.15.12:0/843938112 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f380c00d570 con 0x7f38200b1260 2021-10-21T00:30:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381f7fe700 1 -- 172.21.15.12:0/843938112 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c000e90 con 0x7f38200b1260 2021-10-21T00:30:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.709+0000 7f381f7fe700 1 -- 172.21.15.12:0/843938112 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f380c00d900 con 0x7f38200b1260 2021-10-21T00:30:22.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 -- 172.21.15.12:0/843938112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 msgr2=0x7f38200ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 --2- 172.21.15.12:0/843938112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 0x7f38200ac000 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f380c002f70 tx=0x7f380c006eb0).stop 2021-10-21T00:30:22.731 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 -- 172.21.15.12:0/843938112 shutdown_connections 2021-10-21T00:30:22.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 --2- 172.21.15.12:0/843938112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 0x7f38200afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 --2- 172.21.15.12:0/843938112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 0x7f38200ac000 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 --2- 172.21.15.12:0/843938112 >> v2:172.21.15.31:3300/0 conn(0x7f38200b2580 0x7f38200abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.732 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 -- 172.21.15.12:0/843938112 >> 172.21.15.12:0/843938112 conn(0x7f3820060180 msgr2=0x7f38200b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 -- 172.21.15.12:0/843938112 shutdown_connections 2021-10-21T00:30:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 -- 172.21.15.12:0/843938112 wait complete. 2021-10-21T00:30:22.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 Processor -- start 2021-10-21T00:30:22.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 -- start start 2021-10-21T00:30:22.739 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 0x7f38200647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 0x7f382014ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38200b2580 0x7f382014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.740 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200662d0 con 0x7f38200b1260 2021-10-21T00:30:22.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820063fb0 con 0x7f38200b2580 2021-10-21T00:30:22.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.713+0000 7f3825987700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3820063d10 con 0x7f38200b1790 2021-10-21T00:30:22.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f3824985700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 0x7f38200647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.741 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 0x7f382014ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f3824985700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 0x7f38200647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46456/0 (socket says 172.21.15.12:46456) 2021-10-21T00:30:22.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f3824985700 1 -- 172.21.15.12:0/1018712169 learned_addr learned my addr 172.21.15.12:0/1018712169 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:22.742 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f3825186700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38200b2580 0x7f382014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381ffff700 1 -- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38200b2580 msgr2=0x7f382014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381ffff700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38200b2580 0x7f382014f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.743 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381ffff700 1 -- 172.21.15.12:0/1018712169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 msgr2=0x7f38200647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381ffff700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 0x7f38200647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381ffff700 1 -- 172.21.15.12:0/1018712169 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c00b1e0 con 0x7f38200b1790 2021-10-21T00:30:22.744 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f3824985700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38200b1260 0x7f38200647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:30:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381ffff700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 0x7f382014ed30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f380c002f70 tx=0x7f380c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381dffb700 1 -- 172.21.15.12:0/1018712169 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f380c011610 con 0x7f38200b1790 2021-10-21T00:30:22.745 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381dffb700 1 -- 172.21.15.12:0/1018712169 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c011770 con 0x7f38200b1790 2021-10-21T00:30:22.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f381dffb700 1 -- 172.21.15.12:0/1018712169 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f380c011ad0 con 0x7f38200b1790 2021-10-21T00:30:22.746 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3820066c00 con 0x7f38200b1790 2021-10-21T00:30:22.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38200ac090 con 0x7f38200b1790 2021-10-21T00:30:22.747 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.717+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38200670a0 con 0x7f38200b1790 2021-10-21T00:30:22.748 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f381dffb700 1 -- 172.21.15.12:0/1018712169 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f380c01a040 con 0x7f38200b1790 2021-10-21T00:30:22.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f381dffb700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3800053580 0x7f3800055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.749 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f381dffb700 1 -- 172.21.15.12:0/1018712169 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f380c06d0d0 con 0x7f38200b1790 2021-10-21T00:30:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f3824985700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3800053580 0x7f3800055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f381dffb700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7f380005a310 0x7f380005c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f381dffb700 1 -- 172.21.15.12:0/1018712169 --> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f380005cd90 con 0x7f380005a310 2021-10-21T00:30:22.751 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f381dffb700 1 -- 172.21.15.12:0/1018712169 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=166) v2 ==== 24+0+0 (secure 0 0 0) 0x7f380c06d4b0 con 0x7f38200b1790 2021-10-21T00:30:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f3825186700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7f380005a310 0x7f380005c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f3825186700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7f380005a310 0x7f380005c730 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.721+0000 7f3824985700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3800053580 0x7f3800055a40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f381400b000 tx=0x7f3814006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.725+0000 7f381dffb700 1 -- 172.21.15.12:0/1018712169 <== osd.2 v2:172.21.15.12:6808/14573 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f380005cd90 con 0x7f380005a310 2021-10-21T00:30:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.741+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 --> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3820067580 con 0x7f380005a310 2021-10-21T00:30:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.741+0000 7f381dffb700 1 -- 172.21.15.12:0/1018712169 <== osd.2 v2:172.21.15.12:6808/14573 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3820067580 con 0x7f380005a310 2021-10-21T00:30:22.755 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-21T00:30:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:30:22.756 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-21T00:30:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7f380005a310 msgr2=0x7f380005c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.12:6808/14573,v1:172.21.15.12:6809/14573] conn(0x7f380005a310 0x7f380005c730 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3800053580 msgr2=0x7f3800055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f3800053580 0x7f3800055a40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f381400b000 tx=0x7f3814006df0).stop 2021-10-21T00:30:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 msgr2=0x7f382014ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 --2- 172.21.15.12:0/1018712169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38200b1790 0x7f382014ed30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f380c002f70 tx=0x7f380c015000).stop 2021-10-21T00:30:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825186700 1 -- 172.21.15.12:0/1018712169 reap_dead start 2021-10-21T00:30:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 shutdown_connections 2021-10-21T00:30:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 >> 172.21.15.12:0/1018712169 conn(0x7f3820060180 msgr2=0x7f3820144260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 shutdown_connections 2021-10-21T00:30:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.745+0000 7f3825987700 1 -- 172.21.15.12:0/1018712169 wait complete. 2021-10-21T00:30:22.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-10-21T00:30:22.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.873+0000 7fb84af3a700 1 Processor -- start 2021-10-21T00:30:22.888 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.873+0000 7fb84af3a700 1 -- start start 2021-10-21T00:30:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844144000 0x7fb84414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8440aabb0 con 0x7fb844067300 2021-10-21T00:30:22.889 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8440604e0 con 0x7fb844060100 2021-10-21T00:30:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb844066ea0 con 0x7fb844144000 2021-10-21T00:30:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb843fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb844067300 0x7fb8441438f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45062/0 (socket says 172.21.15.12:45062) 2021-10-21T00:30:22.890 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb843fff700 1 -- 172.21.15.12:0/2631934311 learned_addr learned my addr 172.21.15.12:0/2631934311 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-21T00:30:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8494d7700 1 --2- 172.21.15.12:0/2631934311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844144000 0x7fb84414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8437fe700 1 -- 172.21.15.12:0/2631934311 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697498635 0 0) 0x7fb8440aabb0 con 0x7fb844067300 2021-10-21T00:30:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8437fe700 1 -- 172.21.15.12:0/2631934311 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb828003260 con 0x7fb844067300 2021-10-21T00:30:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8437fe700 1 -- 172.21.15.12:0/2631934311 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508549560 0 0) 0x7fb8440604e0 con 0x7fb844060100 2021-10-21T00:30:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8437fe700 1 -- 172.21.15.12:0/2631934311 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8440aabb0 con 0x7fb844060100 2021-10-21T00:30:22.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8494d7700 1 -- 172.21.15.12:0/2631934311 >> v1:172.21.15.31:6789/0 conn(0x7fb844060100 legacy=0x7fb8440b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8494d7700 1 -- 172.21.15.12:0/2631934311 >> v1:172.21.15.12:6789/0 conn(0x7fb844067300 legacy=0x7fb8441438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.900 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8494d7700 1 -- 172.21.15.12:0/2631934311 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440b33b0 con 0x7fb844144000 2021-10-21T00:30:22.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8494d7700 1 --2- 172.21.15.12:0/2631934311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844144000 0x7fb84414c860 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb83c0032f0 tx=0x7fb83c0091d0).ready entity=mon.2 client_cookie=89a5cbb4a12c9869 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.901 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8437fe700 1 -- 172.21.15.12:0/2631934311 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb83c00b640 con 0x7fb844144000 2021-10-21T00:30:22.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8437fe700 1 -- 172.21.15.12:0/2631934311 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c00b7a0 con 0x7fb844144000 2021-10-21T00:30:22.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb8437fe700 1 -- 172.21.15.12:0/2631934311 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb83c00b910 con 0x7fb844144000 2021-10-21T00:30:22.902 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 -- 172.21.15.12:0/2631934311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844144000 msgr2=0x7fb84414c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 --2- 172.21.15.12:0/2631934311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844144000 0x7fb84414c860 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb83c0032f0 tx=0x7fb83c0091d0).stop 2021-10-21T00:30:22.903 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 -- 172.21.15.12:0/2631934311 shutdown_connections 2021-10-21T00:30:22.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 --2- 172.21.15.12:0/2631934311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844144000 0x7fb84414c860 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 -- 172.21.15.12:0/2631934311 >> 172.21.15.12:0/2631934311 conn(0x7fb84405cf30 msgr2=0x7fb84405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:22.904 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 -- 172.21.15.12:0/2631934311 shutdown_connections 2021-10-21T00:30:22.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.877+0000 7fb84af3a700 1 -- 172.21.15.12:0/2631934311 wait complete. 2021-10-21T00:30:22.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 Processor -- start 2021-10-21T00:30:22.905 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 -- start start 2021-10-21T00:30:22.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844060100 0x7fb844064a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb844067300 0x7fb8440ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.906 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb844144000 0x7fb8440ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb844152670 con 0x7fb844067300 2021-10-21T00:30:22.907 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440abe80 con 0x7fb844144000 2021-10-21T00:30:22.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb844152860 con 0x7fb844060100 2021-10-21T00:30:22.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb843fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb844067300 0x7fb8440ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.908 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb843fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb844067300 0x7fb8440ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46474/0 (socket says 172.21.15.12:46474) 2021-10-21T00:30:22.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb843fff700 1 -- 172.21.15.12:0/3228236071 learned_addr learned my addr 172.21.15.12:0/3228236071 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:22.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb8494d7700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb844144000 0x7fb8440ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.909 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb848cd6700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844060100 0x7fb844064a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb843fff700 1 -- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844060100 msgr2=0x7fb844064a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb843fff700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844060100 0x7fb844064a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.910 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb843fff700 1 -- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb844144000 msgr2=0x7fb8440ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:22.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb843fff700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb844144000 0x7fb8440ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:22.911 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb843fff700 1 -- 172.21.15.12:0/3228236071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009470 con 0x7fb844067300 2021-10-21T00:30:22.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb843fff700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb844067300 0x7fb8440ab4a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fb830001110 tx=0x7fb830007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb841ffb700 1 -- 172.21.15.12:0/3228236071 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8300070d0 con 0x7fb844067300 2021-10-21T00:30:22.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb841ffb700 1 -- 172.21.15.12:0/3228236071 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830007230 con 0x7fb844067300 2021-10-21T00:30:22.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb844152b00 con 0x7fb844067300 2021-10-21T00:30:22.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb841ffb700 1 -- 172.21.15.12:0/3228236071 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb830005610 con 0x7fb844067300 2021-10-21T00:30:22.913 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.881+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb844064f00 con 0x7fb844067300 2021-10-21T00:30:22.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.885+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb844057350 con 0x7fb844067300 2021-10-21T00:30:22.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.885+0000 7fb841ffb700 1 -- 172.21.15.12:0/3228236071 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb83001a070 con 0x7fb844067300 2021-10-21T00:30:22.914 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.885+0000 7fb841ffb700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb8240536a0 0x7fb824055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:22.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.885+0000 7fb841ffb700 1 -- 172.21.15.12:0/3228236071 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb83006aac0 con 0x7fb844067300 2021-10-21T00:30:22.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.885+0000 7fb848cd6700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb8240536a0 0x7fb824055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:22.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.885+0000 7fb848cd6700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb8240536a0 0x7fb824055b60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fb83800d000 tx=0x7fb838007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:22.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:22.889+0000 7fb841ffb700 1 -- 172.21.15.12:0/3228236071 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb830041c90 con 0x7fb844067300 2021-10-21T00:30:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.017+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb844152c90 con 0x7fb8240536a0 2021-10-21T00:30:23.031 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb841ffb700 1 -- 172.21.15.12:0/3228236071 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb844152c90 con 0x7fb8240536a0 2021-10-21T00:30:23.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb8240536a0 msgr2=0x7fb824055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.033 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb8240536a0 0x7fb824055b60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fb83800d000 tx=0x7fb838007a20).stop 2021-10-21T00:30:23.034 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb844067300 msgr2=0x7fb8440ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb844067300 0x7fb8440ab4a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fb830001110 tx=0x7fb830007aa0).stop 2021-10-21T00:30:23.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 shutdown_connections 2021-10-21T00:30:23.035 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fb8240536a0 0x7fb824055b60 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb844144000 0x7fb8440ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb844067300 0x7fb8440ab4a0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.036 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 --2- 172.21.15.12:0/3228236071 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb844060100 0x7fb844064a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 >> 172.21.15.12:0/3228236071 conn(0x7fb84405cf30 msgr2=0x7fb8440b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:23.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 shutdown_connections 2021-10-21T00:30:23.037 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.021+0000 7fb84af3a700 1 -- 172.21.15.12:0/3228236071 wait complete. 2021-10-21T00:30:23.038 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2021-10-21T00:30:23.045 INFO:tasks.ceph:Scrubbing osd.3 2021-10-21T00:30:23.045 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:30:23.157 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c72e3700 1 Processor -- start 2021-10-21T00:30:23.158 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c72e3700 1 -- start start 2021-10-21T00:30:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c72e3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f64c00b0b80 0x7f64c0146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c72e3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64c00b03d0 0x7f64c01401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c72e3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c00b1140 con 0x7f64c00a9190 2021-10-21T00:30:23.163 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c72e3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c00a9570 con 0x7f64c00b0b80 2021-10-21T00:30:23.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c72e3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c00b1370 con 0x7f64c00b03d0 2021-10-21T00:30:23.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c62e1700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f64c00a9190 0x7f64c0146550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45074/0 (socket says 172.21.15.12:45074) 2021-10-21T00:30:23.164 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c62e1700 1 -- 172.21.15.12:0/2914490760 learned_addr learned my addr 172.21.15.12:0/2914490760 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-21T00:30:23.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c5ae0700 1 --2- 172.21.15.12:0/2914490760 >> v2:172.21.15.12:3300/0 conn(0x7f64c00b0b80 0x7f64c0146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c6ae2700 1 --2- 172.21.15.12:0/2914490760 >> v2:172.21.15.31:3300/0 conn(0x7f64c00b03d0 0x7f64c01401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.165 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c5ae0700 1 -- 172.21.15.12:0/2914490760 >> v2:172.21.15.31:3300/0 conn(0x7f64c00b03d0 msgr2=0x7f64c01401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c5ae0700 1 --2- 172.21.15.12:0/2914490760 >> v2:172.21.15.31:3300/0 conn(0x7f64c00b03d0 0x7f64c01401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c5ae0700 1 -- 172.21.15.12:0/2914490760 >> v1:172.21.15.12:6789/0 conn(0x7f64c00a9190 legacy=0x7f64c0146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c5ae0700 1 -- 172.21.15.12:0/2914490760 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c00b1610 con 0x7f64c00b0b80 2021-10-21T00:30:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c5ae0700 1 --2- 172.21.15.12:0/2914490760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 0x7f64c0146c60 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f64b0002f70 tx=0x7f64b0006df0).ready entity=mon.0 client_cookie=c886dd6a7a4cde77 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.145+0000 7f64c52df700 1 -- 172.21.15.12:0/2914490760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64b000d570 con 0x7f64c00b0b80 2021-10-21T00:30:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c52df700 1 -- 172.21.15.12:0/2914490760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b0000e90 con 0x7f64c00b0b80 2021-10-21T00:30:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c52df700 1 -- 172.21.15.12:0/2914490760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64b000d8c0 con 0x7f64c00b0b80 2021-10-21T00:30:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 -- 172.21.15.12:0/2914490760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 msgr2=0x7f64c0146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 --2- 172.21.15.12:0/2914490760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 0x7f64c0146c60 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f64b0002f70 tx=0x7f64b0006df0).stop 2021-10-21T00:30:23.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 -- 172.21.15.12:0/2914490760 shutdown_connections 2021-10-21T00:30:23.169 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 --2- 172.21.15.12:0/2914490760 >> v2:172.21.15.31:3300/0 conn(0x7f64c00b03d0 0x7f64c01401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 --2- 172.21.15.12:0/2914490760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 0x7f64c0146c60 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 -- 172.21.15.12:0/2914490760 >> 172.21.15.12:0/2914490760 conn(0x7f64c0061140 msgr2=0x7f64c0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:23.170 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 -- 172.21.15.12:0/2914490760 shutdown_connections 2021-10-21T00:30:23.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 -- 172.21.15.12:0/2914490760 wait complete. 2021-10-21T00:30:23.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 Processor -- start 2021-10-21T00:30:23.171 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.149+0000 7f64c72e3700 1 -- start start 2021-10-21T00:30:23.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c72e3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64c00a9190 0x7f64c0141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.175 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c72e3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64c00b03d0 0x7f64c013dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c72e3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 0x7f64c00a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c72e3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c0139ad0 con 0x7f64c00b0b80 2021-10-21T00:30:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c72e3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c013f250 con 0x7f64c00b03d0 2021-10-21T00:30:23.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c72e3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c013fb10 con 0x7f64c00a9190 2021-10-21T00:30:23.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c6ae2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 0x7f64c00a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.177 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c6ae2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 0x7f64c00a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46490/0 (socket says 172.21.15.12:46490) 2021-10-21T00:30:23.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c6ae2700 1 -- 172.21.15.12:0/3697593125 learned_addr learned my addr 172.21.15.12:0/3697593125 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:23.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c5ae0700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64c00b03d0 0x7f64c013dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.178 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c62e1700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64c00a9190 0x7f64c0141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c6ae2700 1 -- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64c00a9190 msgr2=0x7f64c0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c6ae2700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64c00a9190 0x7f64c0141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.179 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c6ae2700 1 -- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64c00b03d0 msgr2=0x7f64c013dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.180 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c6ae2700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64c00b03d0 0x7f64c013dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c6ae2700 1 -- 172.21.15.12:0/3697593125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b000b180 con 0x7f64c00b0b80 2021-10-21T00:30:23.181 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c62e1700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64c00a9190 0x7f64c0141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:30:23.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c6ae2700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 0x7f64c00a9840 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f64b800c000 tx=0x7f64b8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64bf7fe700 1 -- 172.21.15.12:0/3697593125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64b8010780 con 0x7f64c00b0b80 2021-10-21T00:30:23.182 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64bf7fe700 1 -- 172.21.15.12:0/3697593125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b80108e0 con 0x7f64c00b0b80 2021-10-21T00:30:23.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c013f480 con 0x7f64c00b0b80 2021-10-21T00:30:23.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64bf7fe700 1 -- 172.21.15.12:0/3697593125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64b8010c40 con 0x7f64c00b0b80 2021-10-21T00:30:23.183 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c00a9d30 con 0x7f64c00b0b80 2021-10-21T00:30:23.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64c0057350 con 0x7f64c00b0b80 2021-10-21T00:30:23.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.153+0000 7f64bf7fe700 1 -- 172.21.15.12:0/3697593125 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f64b801c460 con 0x7f64c00b0b80 2021-10-21T00:30:23.184 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64bf7fe700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64a4053610 0x7f64a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64bf7fe700 1 -- 172.21.15.12:0/3697593125 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f64b806bb30 con 0x7f64c00b0b80 2021-10-21T00:30:23.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64bf7fe700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f64a405a3a0 0x7f64a405c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.185 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64bf7fe700 1 -- 172.21.15.12:0/3697593125 --> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64a405cd80 con 0x7f64a405a3a0 2021-10-21T00:30:23.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64bf7fe700 1 -- 172.21.15.12:0/3697593125 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64b8042db0 con 0x7f64c00b0b80 2021-10-21T00:30:23.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64c62e1700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64a4053610 0x7f64a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.186 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64c5ae0700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f64a405a3a0 0x7f64a405c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64c5ae0700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f64a405a3a0 0x7f64a405c7c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64c62e1700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64a4053610 0x7f64a4055ad0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f64a8008000 tx=0x7f64a8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.187 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.157+0000 7f64bf7fe700 1 -- 172.21.15.12:0/3697593125 <== osd.3 v2:172.21.15.12:6800/14572 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f64a405cd80 con 0x7f64a405a3a0 2021-10-21T00:30:23.188 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 --> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f64c0147430 con 0x7f64a405a3a0 2021-10-21T00:30:23.190 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64bf7fe700 1 -- 172.21.15.12:0/3697593125 <== osd.3 v2:172.21.15.12:6800/14572 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f64c0147430 con 0x7f64a405a3a0 2021-10-21T00:30:23.190 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-21T00:30:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:30:23.191 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-21T00:30:23.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f64a405a3a0 msgr2=0x7f64a405c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.12:6800/14572,v1:172.21.15.12:6801/14572] conn(0x7f64a405a3a0 0x7f64a405c7c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.193 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64a4053610 msgr2=0x7f64a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f64a4053610 0x7f64a4055ad0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f64a8008000 tx=0x7f64a8009040).stop 2021-10-21T00:30:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 msgr2=0x7f64c00a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 --2- 172.21.15.12:0/3697593125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64c00b0b80 0x7f64c00a9840 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f64b800c000 tx=0x7f64b8006df0).stop 2021-10-21T00:30:23.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c6ae2700 1 -- 172.21.15.12:0/3697593125 reap_dead start 2021-10-21T00:30:23.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 shutdown_connections 2021-10-21T00:30:23.195 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 >> 172.21.15.12:0/3697593125 conn(0x7f64c0061140 msgr2=0x7f64c00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 shutdown_connections 2021-10-21T00:30:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.177+0000 7f64c72e3700 1 -- 172.21.15.12:0/3697593125 wait complete. 2021-10-21T00:30:23.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-10-21T00:30:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 Processor -- start 2021-10-21T00:30:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 -- start start 2021-10-21T00:30:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b6380 0x7f92fc13d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f92fc0b0cd0 0x7f92fc13d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc13daf0 con 0x7f92fc064370 2021-10-21T00:30:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc066960 con 0x7f92fc0b0cd0 2021-10-21T00:30:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc066c00 con 0x7f92fc0b6380 2021-10-21T00:30:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92fb59e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f92fc064370 0x7f92fc060830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45094/0 (socket says 172.21.15.12:45094) 2021-10-21T00:30:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92fb59e700 1 -- 172.21.15.12:0/3022816030 learned_addr learned my addr 172.21.15.12:0/3022816030 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-21T00:30:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92fa59c700 1 --2- 172.21.15.12:0/3022816030 >> v2:172.21.15.31:3300/0 conn(0x7f92fc0b0cd0 0x7f92fc13d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92fad9d700 1 --2- 172.21.15.12:0/3022816030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b6380 0x7f92fc13d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92f9d9b700 1 -- 172.21.15.12:0/3022816030 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283038682 0 0) 0x7f92fc13daf0 con 0x7f92fc064370 2021-10-21T00:30:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92f9d9b700 1 -- 172.21.15.12:0/3022816030 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92dc003260 con 0x7f92fc064370 2021-10-21T00:30:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92fa59c700 1 -- 172.21.15.12:0/3022816030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b6380 msgr2=0x7f92fc13d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:23.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92fa59c700 1 --2- 172.21.15.12:0/3022816030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b6380 0x7f92fc13d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92fa59c700 1 -- 172.21.15.12:0/3022816030 >> v1:172.21.15.12:6789/0 conn(0x7f92fc064370 legacy=0x7f92fc060830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.317 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92fa59c700 1 -- 172.21.15.12:0/3022816030 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc066ea0 con 0x7f92fc0b0cd0 2021-10-21T00:30:23.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92fa59c700 1 --2- 172.21.15.12:0/3022816030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92fc0b0cd0 0x7f92fc13d600 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f92f40032f0 tx=0x7f92f40091d0).ready entity=mon.1 client_cookie=79b54fecf6512698 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92f9d9b700 1 -- 172.21.15.12:0/3022816030 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92f400b600 con 0x7f92fc0b0cd0 2021-10-21T00:30:23.318 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92f9d9b700 1 -- 172.21.15.12:0/3022816030 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f400b760 con 0x7f92fc0b0cd0 2021-10-21T00:30:23.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f92f9d9b700 1 -- 172.21.15.12:0/3022816030 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92f400b8d0 con 0x7f92fc0b0cd0 2021-10-21T00:30:23.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 -- 172.21.15.12:0/3022816030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92fc0b0cd0 msgr2=0x7f92fc13d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.319 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 --2- 172.21.15.12:0/3022816030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92fc0b0cd0 0x7f92fc13d600 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f92f40032f0 tx=0x7f92f40091d0).stop 2021-10-21T00:30:23.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 -- 172.21.15.12:0/3022816030 shutdown_connections 2021-10-21T00:30:23.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 --2- 172.21.15.12:0/3022816030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92fc0b0cd0 0x7f92fc13d600 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.320 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 --2- 172.21.15.12:0/3022816030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b6380 0x7f92fc13d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 -- 172.21.15.12:0/3022816030 >> 172.21.15.12:0/3022816030 conn(0x7f92fc063670 msgr2=0x7f92fc063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:23.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 -- 172.21.15.12:0/3022816030 shutdown_connections 2021-10-21T00:30:23.321 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.297+0000 7f930081c700 1 -- 172.21.15.12:0/3022816030 wait complete. 2021-10-21T00:30:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f930081c700 1 Processor -- start 2021-10-21T00:30:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f930081c700 1 -- start start 2021-10-21T00:30:23.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f930081c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92fc064370 0x7f92fc0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f930081c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b0cd0 0x7f92fc1411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.326 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f930081c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92fc0b6380 0x7f92fc141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f930081c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc150230 con 0x7f92fc064370 2021-10-21T00:30:23.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f930081c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc1504d0 con 0x7f92fc0b6380 2021-10-21T00:30:23.327 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f930081c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc150770 con 0x7f92fc0b0cd0 2021-10-21T00:30:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92fc064370 0x7f92fc0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92fc064370 0x7f92fc0b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46502/0 (socket says 172.21.15.12:46502) 2021-10-21T00:30:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fad9d700 1 -- 172.21.15.12:0/418278428 learned_addr learned my addr 172.21.15.12:0/418278428 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fa59c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b0cd0 0x7f92fc1411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fb59e700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92fc0b6380 0x7f92fc141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fad9d700 1 -- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b0cd0 msgr2=0x7f92fc1411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fad9d700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b0cd0 0x7f92fc1411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fad9d700 1 -- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92fc0b6380 msgr2=0x7f92fc141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fad9d700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92fc0b6380 0x7f92fc141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fad9d700 1 -- 172.21.15.12:0/418278428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4009470 con 0x7f92fc064370 2021-10-21T00:30:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fa59c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b0cd0 0x7f92fc1411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:30:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92fad9d700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92fc064370 0x7f92fc0b2230 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f92e400c000 tx=0x7f92e4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92f3fff700 1 -- 172.21.15.12:0/418278428 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92e4011750 con 0x7f92fc064370 2021-10-21T00:30:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f92f3fff700 1 -- 172.21.15.12:0/418278428 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e40118b0 con 0x7f92fc064370 2021-10-21T00:30:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.301+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc14ff20 con 0x7f92fc064370 2021-10-21T00:30:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.305+0000 7f92f3fff700 1 -- 172.21.15.12:0/418278428 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92e4011c10 con 0x7f92fc064370 2021-10-21T00:30:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.305+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc143fb0 con 0x7f92fc064370 2021-10-21T00:30:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.305+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc150930 con 0x7f92fc064370 2021-10-21T00:30:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.305+0000 7f92f3fff700 1 -- 172.21.15.12:0/418278428 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f92e4011d70 con 0x7f92fc064370 2021-10-21T00:30:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.305+0000 7f92f3fff700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92e00535b0 0x7f92e0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.305+0000 7f92f3fff700 1 -- 172.21.15.12:0/418278428 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f92e406bba0 con 0x7f92fc064370 2021-10-21T00:30:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.305+0000 7f92fa59c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92e00535b0 0x7f92e0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.305+0000 7f92fa59c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92e00535b0 0x7f92e0055a70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f92f401b000 tx=0x7f92f4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.313+0000 7f92f3fff700 1 -- 172.21.15.12:0/418278428 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92e4042e80 con 0x7f92fc064370 2021-10-21T00:30:23.445 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.433+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f92fc143ce0 con 0x7f92e00535b0 2021-10-21T00:30:23.446 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.433+0000 7f92f3fff700 1 -- 172.21.15.12:0/418278428 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f92fc143ce0 con 0x7f92e00535b0 2021-10-21T00:30:23.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92e00535b0 msgr2=0x7f92e0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.448 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92e00535b0 0x7f92e0055a70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f92f401b000 tx=0x7f92f4016000).stop 2021-10-21T00:30:23.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92fc064370 msgr2=0x7f92fc0b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92fc064370 0x7f92fc0b2230 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f92e400c000 tx=0x7f92e4006df0).stop 2021-10-21T00:30:23.449 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 shutdown_connections 2021-10-21T00:30:23.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f92e00535b0 0x7f92e0055a70 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92fc0b6380 0x7f92fc141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.450 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc0b0cd0 0x7f92fc1411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 --2- 172.21.15.12:0/418278428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92fc064370 0x7f92fc0b2230 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 >> 172.21.15.12:0/418278428 conn(0x7f92fc063670 msgr2=0x7f92fc13ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 shutdown_connections 2021-10-21T00:30:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.437+0000 7f930081c700 1 -- 172.21.15.12:0/418278428 wait complete. 2021-10-21T00:30:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2021-10-21T00:30:23.460 INFO:tasks.ceph:Scrubbing osd.4 2021-10-21T00:30:23.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:30:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.553+0000 7f11b15f7700 1 Processor -- start 2021-10-21T00:30:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.553+0000 7f11b15f7700 1 -- start start 2021-10-21T00:30:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f11ac0b3040 0x7f11ac065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac0a9c10 0x7f11ac0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac066ea0 con 0x7f11ac143320 2021-10-21T00:30:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac0648e0 con 0x7f11ac0b3040 2021-10-21T00:30:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac061dd0 con 0x7f11ac0a9c10 2021-10-21T00:30:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11abfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f11ac0b3040 0x7f11ac065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b0df6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f11ac143320 0x7f11ac1437b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45106/0 (socket says 172.21.15.12:45106) 2021-10-21T00:30:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b0df6700 1 -- 172.21.15.12:0/382795905 learned_addr learned my addr 172.21.15.12:0/382795905 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-21T00:30:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11abfff700 1 --2- 172.21.15.12:0/382795905 >> v2:172.21.15.12:3300/0 conn(0x7f11ac0b3040 0x7f11ac065e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46510/0 (socket says 172.21.15.12:46510) 2021-10-21T00:30:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11ab7fe700 1 --2- 172.21.15.12:0/382795905 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac0a9c10 0x7f11ac0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11abfff700 1 -- 172.21.15.12:0/382795905 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac0a9c10 msgr2=0x7f11ac0607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11abfff700 1 --2- 172.21.15.12:0/382795905 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac0a9c10 0x7f11ac0607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11abfff700 1 -- 172.21.15.12:0/382795905 >> v1:172.21.15.12:6789/0 conn(0x7f11ac143320 legacy=0x7f11ac1437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11abfff700 1 -- 172.21.15.12:0/382795905 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac0b3420 con 0x7f11ac0b3040 2021-10-21T00:30:23.577 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11ab7fe700 1 --2- 172.21.15.12:0/382795905 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac0a9c10 0x7f11ac0607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:30:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11abfff700 1 --2- 172.21.15.12:0/382795905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 0x7f11ac065e90 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f119c002f70 tx=0x7f119c006df0).ready entity=mon.0 client_cookie=e7c79e7aa5d03ecb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11aaffd700 1 -- 172.21.15.12:0/382795905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f119c00d570 con 0x7f11ac0b3040 2021-10-21T00:30:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11aaffd700 1 -- 172.21.15.12:0/382795905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c000e90 con 0x7f11ac0b3040 2021-10-21T00:30:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11aaffd700 1 -- 172.21.15.12:0/382795905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f119c00d900 con 0x7f11ac0b3040 2021-10-21T00:30:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 -- 172.21.15.12:0/382795905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 msgr2=0x7f11ac065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 --2- 172.21.15.12:0/382795905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 0x7f11ac065e90 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f119c002f70 tx=0x7f119c006df0).stop 2021-10-21T00:30:23.580 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 -- 172.21.15.12:0/382795905 shutdown_connections 2021-10-21T00:30:23.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 --2- 172.21.15.12:0/382795905 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac0a9c10 0x7f11ac0607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 --2- 172.21.15.12:0/382795905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 0x7f11ac065e90 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.581 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 -- 172.21.15.12:0/382795905 >> 172.21.15.12:0/382795905 conn(0x7f11ac0636e0 msgr2=0x7f11ac063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:23.582 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 -- 172.21.15.12:0/382795905 shutdown_connections 2021-10-21T00:30:23.583 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.557+0000 7f11b15f7700 1 -- 172.21.15.12:0/382795905 wait complete. 2021-10-21T00:30:23.589 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.561+0000 7f11b15f7700 1 Processor -- start 2021-10-21T00:30:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.561+0000 7f11b15f7700 1 -- start start 2021-10-21T00:30:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.561+0000 7f11b15f7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11ac0a9c10 0x7f11ac0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.561+0000 7f11b15f7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 0x7f11ac1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.561+0000 7f11b15f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac143320 0x7f11ac141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.561+0000 7f11b15f7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac13fa70 con 0x7f11ac0b3040 2021-10-21T00:30:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.561+0000 7f11b15f7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac13b820 con 0x7f11ac0a9c10 2021-10-21T00:30:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.561+0000 7f11b15f7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac155ec0 con 0x7f11ac143320 2021-10-21T00:30:23.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11ab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 0x7f11ac1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11ab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 0x7f11ac1565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46518/0 (socket says 172.21.15.12:46518) 2021-10-21T00:30:23.594 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11abfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11ac0a9c10 0x7f11ac0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11ab7fe700 1 -- 172.21.15.12:0/1334132135 learned_addr learned my addr 172.21.15.12:0/1334132135 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11b0df6700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac143320 0x7f11ac141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11ab7fe700 1 -- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac143320 msgr2=0x7f11ac141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11ab7fe700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11ac143320 0x7f11ac141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11ab7fe700 1 -- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11ac0a9c10 msgr2=0x7f11ac0af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11ab7fe700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11ac0a9c10 0x7f11ac0af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11ab7fe700 1 -- 172.21.15.12:0/1334132135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c00b180 con 0x7f11ac0b3040 2021-10-21T00:30:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11ab7fe700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 0x7f11ac1565c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f11a0006940 tx=0x7f11a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11a97fa700 1 -- 172.21.15.12:0/1334132135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11a0011780 con 0x7f11ac0b3040 2021-10-21T00:30:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11a97fa700 1 -- 172.21.15.12:0/1334132135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a00118e0 con 0x7f11ac0b3040 2021-10-21T00:30:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ac0aea80 con 0x7f11ac0b3040 2021-10-21T00:30:23.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11a97fa700 1 -- 172.21.15.12:0/1334132135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11a0011c40 con 0x7f11ac0b3040 2021-10-21T00:30:23.604 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ac142b70 con 0x7f11ac0b3040 2021-10-21T00:30:23.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11ac148210 con 0x7f11ac0b3040 2021-10-21T00:30:23.605 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.565+0000 7f11a97fa700 1 -- 172.21.15.12:0/1334132135 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f11a001c460 con 0x7f11ac0b3040 2021-10-21T00:30:23.607 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11a97fa700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f118c0536a0 0x7f118c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11a97fa700 1 -- 172.21.15.12:0/1334132135 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f11a006b7b0 con 0x7f11ac0b3040 2021-10-21T00:30:23.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11a97fa700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f118c05a430 0x7f118c05c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.608 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11a97fa700 1 -- 172.21.15.12:0/1334132135 --> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f118c05ce10 con 0x7f118c05a430 2021-10-21T00:30:23.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11a97fa700 1 -- 172.21.15.12:0/1334132135 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11a0070240 con 0x7f11ac0b3040 2021-10-21T00:30:23.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11abfff700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f118c0536a0 0x7f118c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.609 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11b0df6700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f118c05a430 0x7f118c05c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.610 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11abfff700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f118c0536a0 0x7f118c055b60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f119c01a000 tx=0x7f119c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11b0df6700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f118c05a430 0x7f118c05c850 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.611 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.569+0000 7f11a97fa700 1 -- 172.21.15.12:0/1334132135 <== osd.4 v2:172.21.15.31:6810/14820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f118c05ce10 con 0x7f118c05a430 2021-10-21T00:30:23.613 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 --> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f11ac156320 con 0x7f118c05a430 2021-10-21T00:30:23.615 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11a97fa700 1 -- 172.21.15.12:0/1334132135 <== osd.4 v2:172.21.15.31:6810/14820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f11a4001d80 con 0x7f118c05a430 2021-10-21T00:30:23.617 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-21T00:30:23.617 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:30:23.617 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-21T00:30:23.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f118c05a430 msgr2=0x7f118c05c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6810/14820,v1:172.21.15.31:6811/14820] conn(0x7f118c05a430 0x7f118c05c850 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f118c0536a0 msgr2=0x7f118c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f118c0536a0 0x7f118c055b60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f119c01a000 tx=0x7f119c014000).stop 2021-10-21T00:30:23.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 msgr2=0x7f11ac1565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 --2- 172.21.15.12:0/1334132135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11ac0b3040 0x7f11ac1565c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f11a0006940 tx=0x7f11a0008040).stop 2021-10-21T00:30:23.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b0df6700 1 -- 172.21.15.12:0/1334132135 reap_dead start 2021-10-21T00:30:23.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 shutdown_connections 2021-10-21T00:30:23.645 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 >> 172.21.15.12:0/1334132135 conn(0x7f11ac0636e0 msgr2=0x7f11ac05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:23.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 shutdown_connections 2021-10-21T00:30:23.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.585+0000 7f11b15f7700 1 -- 172.21.15.12:0/1334132135 wait complete. 2021-10-21T00:30:23.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-10-21T00:30:23.765 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.753+0000 7ffb7734f700 1 Processor -- start 2021-10-21T00:30:23.766 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.753+0000 7ffb7734f700 1 -- start start 2021-10-21T00:30:23.768 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.753+0000 7ffb7734f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b1db0 0x7ffb700b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.753+0000 7ffb7734f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700b0350 con 0x7ffb700a70c0 2021-10-21T00:30:23.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.753+0000 7ffb7734f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700b05f0 con 0x7ffb701483a0 2021-10-21T00:30:23.769 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.753+0000 7ffb7734f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700a90c0 con 0x7ffb700b1db0 2021-10-21T00:30:23.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.753+0000 7ffb758ec700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffb700a70c0 0x7ffb70144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45124/0 (socket says 172.21.15.12:45124) 2021-10-21T00:30:23.770 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.753+0000 7ffb758ec700 1 -- 172.21.15.12:0/2630539383 learned_addr learned my addr 172.21.15.12:0/2630539383 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-21T00:30:23.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.753+0000 7ffb750eb700 1 --2- 172.21.15.12:0/2630539383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b1db0 0x7ffb700b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb6ffff700 1 -- 172.21.15.12:0/2630539383 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369701897 0 0) 0x7ffb700b0350 con 0x7ffb700a70c0 2021-10-21T00:30:23.771 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb6ffff700 1 -- 172.21.15.12:0/2630539383 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c003260 con 0x7ffb700a70c0 2021-10-21T00:30:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb6ffff700 1 -- 172.21.15.12:0/2630539383 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494192678 0 0) 0x7ffb700b05f0 con 0x7ffb701483a0 2021-10-21T00:30:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb6ffff700 1 -- 172.21.15.12:0/2630539383 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb700b0350 con 0x7ffb701483a0 2021-10-21T00:30:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb750eb700 1 -- 172.21.15.12:0/2630539383 >> v1:172.21.15.31:6789/0 conn(0x7ffb701483a0 legacy=0x7ffb700b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb750eb700 1 -- 172.21.15.12:0/2630539383 >> v1:172.21.15.12:6789/0 conn(0x7ffb700a70c0 legacy=0x7ffb70144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.775 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb750eb700 1 -- 172.21.15.12:0/2630539383 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700b0890 con 0x7ffb700b1db0 2021-10-21T00:30:23.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb750eb700 1 --2- 172.21.15.12:0/2630539383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b1db0 0x7ffb700b0fd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ffb64002f70 tx=0x7ffb64006df0).ready entity=mon.2 client_cookie=3624cc807b49997b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb6ffff700 1 -- 172.21.15.12:0/2630539383 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6400d5c0 con 0x7ffb700b1db0 2021-10-21T00:30:23.776 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb6ffff700 1 -- 172.21.15.12:0/2630539383 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb64000e90 con 0x7ffb700b1db0 2021-10-21T00:30:23.777 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb6ffff700 1 -- 172.21.15.12:0/2630539383 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6400d910 con 0x7ffb700b1db0 2021-10-21T00:30:23.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb7734f700 1 -- 172.21.15.12:0/2630539383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b1db0 msgr2=0x7ffb700b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb7734f700 1 --2- 172.21.15.12:0/2630539383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b1db0 0x7ffb700b0fd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ffb64002f70 tx=0x7ffb64006df0).stop 2021-10-21T00:30:23.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb7734f700 1 -- 172.21.15.12:0/2630539383 shutdown_connections 2021-10-21T00:30:23.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb7734f700 1 --2- 172.21.15.12:0/2630539383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700b1db0 0x7ffb700b0fd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb7734f700 1 -- 172.21.15.12:0/2630539383 >> 172.21.15.12:0/2630539383 conn(0x7ffb7005f6b0 msgr2=0x7ffb7005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:23.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb7734f700 1 -- 172.21.15.12:0/2630539383 shutdown_connections 2021-10-21T00:30:23.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.757+0000 7ffb7734f700 1 -- 172.21.15.12:0/2630539383 wait complete. 2021-10-21T00:30:23.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb7734f700 1 Processor -- start 2021-10-21T00:30:23.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb7734f700 1 -- start start 2021-10-21T00:30:23.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb7734f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700a70c0 0x7ffb70156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb7734f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b1db0 0x7ffb701404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb7734f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb701483a0 0x7ffb7015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb7734f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700ae3c0 con 0x7ffb701483a0 2021-10-21T00:30:23.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb7734f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700ad740 con 0x7ffb700b1db0 2021-10-21T00:30:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb7734f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700ad9e0 con 0x7ffb700a70c0 2021-10-21T00:30:23.791 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb758ec700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb701483a0 0x7ffb7015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb758ec700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb701483a0 0x7ffb7015a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46534/0 (socket says 172.21.15.12:46534) 2021-10-21T00:30:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb758ec700 1 -- 172.21.15.12:0/1132214095 learned_addr learned my addr 172.21.15.12:0/1132214095 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:23.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb750eb700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700a70c0 0x7ffb70156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.793 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb748ea700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b1db0 0x7ffb701404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb758ec700 1 -- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700a70c0 msgr2=0x7ffb70156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.794 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb758ec700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700a70c0 0x7ffb70156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb758ec700 1 -- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b1db0 msgr2=0x7ffb701404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb758ec700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b1db0 0x7ffb701404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.796 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb758ec700 1 -- 172.21.15.12:0/1132214095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6400b180 con 0x7ffb701483a0 2021-10-21T00:30:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb748ea700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b1db0 0x7ffb701404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:30:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.761+0000 7ffb758ec700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb701483a0 0x7ffb7015a140 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7ffb68001110 tx=0x7ffb68007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb6e7fc700 1 -- 172.21.15.12:0/1132214095 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb680070d0 con 0x7ffb701483a0 2021-10-21T00:30:23.798 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb6e7fc700 1 -- 172.21.15.12:0/1132214095 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68007230 con 0x7ffb701483a0 2021-10-21T00:30:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb700adc80 con 0x7ffb701483a0 2021-10-21T00:30:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb6e7fc700 1 -- 172.21.15.12:0/1132214095 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb68005610 con 0x7ffb701483a0 2021-10-21T00:30:23.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb700ad3c0 con 0x7ffb701483a0 2021-10-21T00:30:23.800 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb70057350 con 0x7ffb701483a0 2021-10-21T00:30:23.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb6e7fc700 1 -- 172.21.15.12:0/1132214095 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb6801a060 con 0x7ffb701483a0 2021-10-21T00:30:23.801 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb6e7fc700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb50053610 0x7ffb50055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:23.803 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb6e7fc700 1 -- 172.21.15.12:0/1132214095 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ffb6806afd0 con 0x7ffb701483a0 2021-10-21T00:30:23.805 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.765+0000 7ffb750eb700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb50053610 0x7ffb50055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:23.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.769+0000 7ffb750eb700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb50053610 0x7ffb50055ad0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ffb64018000 tx=0x7ffb64014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:23.806 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.773+0000 7ffb6e7fc700 1 -- 172.21.15.12:0/1132214095 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb680422b0 con 0x7ffb701483a0 2021-10-21T00:30:23.915 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb700ae120 con 0x7ffb50053610 2021-10-21T00:30:23.916 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb6e7fc700 1 -- 172.21.15.12:0/1132214095 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffb6400d650 con 0x7ffb50053610 2021-10-21T00:30:23.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb50053610 msgr2=0x7ffb50055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb50053610 0x7ffb50055ad0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ffb64018000 tx=0x7ffb64014000).stop 2021-10-21T00:30:23.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb701483a0 msgr2=0x7ffb7015a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:23.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb701483a0 0x7ffb7015a140 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7ffb68001110 tx=0x7ffb68007a80).stop 2021-10-21T00:30:23.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 shutdown_connections 2021-10-21T00:30:23.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7ffb50053610 0x7ffb50055ad0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb701483a0 0x7ffb7015a140 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb700b1db0 0x7ffb701404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 --2- 172.21.15.12:0/1132214095 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb700a70c0 0x7ffb70156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:23.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.905+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 >> 172.21.15.12:0/1132214095 conn(0x7ffb7005f6b0 msgr2=0x7ffb700b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:23.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.909+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 shutdown_connections 2021-10-21T00:30:23.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:23.909+0000 7ffb7734f700 1 -- 172.21.15.12:0/1132214095 wait complete. 2021-10-21T00:30:23.927 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 4 to deep-scrub 2021-10-21T00:30:23.931 INFO:tasks.ceph:Scrubbing osd.5 2021-10-21T00:30:23.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:30:24.050 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.037+0000 7f034ad86700 1 Processor -- start 2021-10-21T00:30:24.053 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.037+0000 7f034ad86700 1 -- start start 2021-10-21T00:30:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.037+0000 7f034ad86700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f03440b3040 0x7f0344065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.037+0000 7f034ad86700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03440a9c10 0x7f03440607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.037+0000 7f034ad86700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0344066ea0 con 0x7f0344143320 2021-10-21T00:30:24.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.037+0000 7f034ad86700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03440648e0 con 0x7f03440b3040 2021-10-21T00:30:24.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.037+0000 7f034ad86700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0344061dd0 con 0x7f03440a9c10 2021-10-21T00:30:24.060 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349d84700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f03440b3040 0x7f0344065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349583700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03440a9c10 0x7f03440607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349583700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03440a9c10 0x7f03440607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:33282/0 (socket says 172.21.15.12:33282) 2021-10-21T00:30:24.061 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349d84700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f03440b3040 0x7f0344065e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46542/0 (socket says 172.21.15.12:46542) 2021-10-21T00:30:24.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349583700 1 -- 172.21.15.12:0/84800265 learned_addr learned my addr 172.21.15.12:0/84800265 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:24.062 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349583700 1 -- 172.21.15.12:0/84800265 >> v2:172.21.15.12:3300/0 conn(0x7f03440b3040 msgr2=0x7f0344065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:24.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349583700 1 --2- 172.21.15.12:0/84800265 >> v2:172.21.15.12:3300/0 conn(0x7f03440b3040 0x7f0344065e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349583700 1 -- 172.21.15.12:0/84800265 >> v1:172.21.15.31:6789/0 conn(0x7f0344143320 legacy=0x7f0344143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0348d82700 1 -- 172.21.15.12:0/84800265 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887504214 0 0) 0x7f0344066ea0 con 0x7f0344143320 2021-10-21T00:30:24.063 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349583700 1 -- 172.21.15.12:0/84800265 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03440b3420 con 0x7f03440a9c10 2021-10-21T00:30:24.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349d84700 1 --2- 172.21.15.12:0/84800265 >> v2:172.21.15.12:3300/0 conn(0x7f03440b3040 0x7f0344065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:30:24.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0349583700 1 --2- 172.21.15.12:0/84800265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9c10 0x7f03440607c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f0340002f70 tx=0x7f0340006eb0).ready entity=mon.1 client_cookie=b126cec9110b6401 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.064 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0348d82700 1 -- 172.21.15.12:0/84800265 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f034000d5c0 con 0x7f03440a9c10 2021-10-21T00:30:24.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0348d82700 1 -- 172.21.15.12:0/84800265 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0340000e90 con 0x7f03440a9c10 2021-10-21T00:30:24.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f0348d82700 1 -- 172.21.15.12:0/84800265 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f034000d910 con 0x7f03440a9c10 2021-10-21T00:30:24.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f034ad86700 1 -- 172.21.15.12:0/84800265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9c10 msgr2=0x7f03440607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f034ad86700 1 --2- 172.21.15.12:0/84800265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9c10 0x7f03440607c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f0340002f70 tx=0x7f0340006eb0).stop 2021-10-21T00:30:24.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f034ad86700 1 -- 172.21.15.12:0/84800265 shutdown_connections 2021-10-21T00:30:24.066 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f034ad86700 1 --2- 172.21.15.12:0/84800265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9c10 0x7f03440607c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f034ad86700 1 --2- 172.21.15.12:0/84800265 >> v2:172.21.15.12:3300/0 conn(0x7f03440b3040 0x7f0344065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f034ad86700 1 -- 172.21.15.12:0/84800265 >> 172.21.15.12:0/84800265 conn(0x7f03440636e0 msgr2=0x7f0344063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f034ad86700 1 -- 172.21.15.12:0/84800265 shutdown_connections 2021-10-21T00:30:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.041+0000 7f034ad86700 1 -- 172.21.15.12:0/84800265 wait complete. 2021-10-21T00:30:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 Processor -- start 2021-10-21T00:30:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 -- start start 2021-10-21T00:30:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9c10 0x7f03441426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b3040 0x7f03440b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0344143320 0x7f03440b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03441315e0 con 0x7f03440b3040 2021-10-21T00:30:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b4730 con 0x7f03440a9c10 2021-10-21T00:30:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b49f0 con 0x7f0344143320 2021-10-21T00:30:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349583700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b3040 0x7f03440b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349583700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b3040 0x7f03440b5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46546/0 (socket says 172.21.15.12:46546) 2021-10-21T00:30:24.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349583700 1 -- 172.21.15.12:0/1722161372 learned_addr learned my addr 172.21.15.12:0/1722161372 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:24.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349d84700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9c10 0x7f03441426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034a585700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0344143320 0x7f03440b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349583700 1 -- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0344143320 msgr2=0x7f03440b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349583700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0344143320 0x7f03440b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349583700 1 -- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9c10 msgr2=0x7f03441426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.073 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349583700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03440a9c10 0x7f03441426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349583700 1 -- 172.21.15.12:0/1722161372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033400b180 con 0x7f03440b3040 2021-10-21T00:30:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f0349583700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b3040 0x7f03440b5570 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f0340002f70 tx=0x7f0340015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f033affd700 1 -- 172.21.15.12:0/1722161372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0340011950 con 0x7f03440b3040 2021-10-21T00:30:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f033affd700 1 -- 172.21.15.12:0/1722161372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0340011ab0 con 0x7f03440b3040 2021-10-21T00:30:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034000b1e0 con 0x7f03440b3040 2021-10-21T00:30:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f033affd700 1 -- 172.21.15.12:0/1722161372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0340011e10 con 0x7f03440b3040 2021-10-21T00:30:24.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03440b4f30 con 0x7f03440b3040 2021-10-21T00:30:24.076 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.045+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03440b50f0 con 0x7f03440b3040 2021-10-21T00:30:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f033affd700 1 -- 172.21.15.12:0/1722161372 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0340025030 con 0x7f03440b3040 2021-10-21T00:30:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f033affd700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240534f0 0x7f03240559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f033affd700 1 -- 172.21.15.12:0/1722161372 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f034006cfa0 con 0x7f03440b3040 2021-10-21T00:30:24.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f033affd700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7f032405a320 0x7f032405c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.079 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f033affd700 1 -- 172.21.15.12:0/1722161372 --> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f032405cda0 con 0x7f032405a320 2021-10-21T00:30:24.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f033affd700 1 -- 172.21.15.12:0/1722161372 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) v2 ==== 24+0+0 (secure 0 0 0) 0x7f034006d380 con 0x7f03440b3040 2021-10-21T00:30:24.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f0349d84700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240534f0 0x7f03240559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f034a585700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7f032405a320 0x7f032405c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f0349d84700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240534f0 0x7f03240559b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f033400b000 tx=0x7f0334008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.049+0000 7f034a585700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7f032405a320 0x7f032405c740 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.053+0000 7f033affd700 1 -- 172.21.15.12:0/1722161372 <== osd.5 v2:172.21.15.31:6802/14819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f032405cda0 con 0x7f032405a320 2021-10-21T00:30:24.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.069+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 --> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0344133440 con 0x7f032405a320 2021-10-21T00:30:24.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.069+0000 7f033affd700 1 -- 172.21.15.12:0/1722161372 <== osd.5 v2:172.21.15.31:6802/14819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0344133440 con 0x7f032405a320 2021-10-21T00:30:24.083 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-21T00:30:24.084 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:30:24.084 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-21T00:30:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7f032405a320 msgr2=0x7f032405c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6802/14819,v1:172.21.15.31:6803/14819] conn(0x7f032405a320 0x7f032405c740 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240534f0 msgr2=0x7f03240559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f03240534f0 0x7f03240559b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f033400b000 tx=0x7f0334008040).stop 2021-10-21T00:30:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b3040 msgr2=0x7f03440b5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 --2- 172.21.15.12:0/1722161372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03440b3040 0x7f03440b5570 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f0340002f70 tx=0x7f0340015000).stop 2021-10-21T00:30:24.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034a585700 1 -- 172.21.15.12:0/1722161372 reap_dead start 2021-10-21T00:30:24.087 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 shutdown_connections 2021-10-21T00:30:24.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 >> 172.21.15.12:0/1722161372 conn(0x7f03440636e0 msgr2=0x7f03440b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 shutdown_connections 2021-10-21T00:30:24.088 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.073+0000 7f034ad86700 1 -- 172.21.15.12:0/1722161372 wait complete. 2021-10-21T00:30:24.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-10-21T00:30:24.208 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 Processor -- start 2021-10-21T00:30:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 -- start start 2021-10-21T00:30:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48a80b0710 0x7f48a8142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48a80b30d0 0x7f48a8143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80ace70 0x7f48a805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a80b0af0 con 0x7f48a80b0710 2021-10-21T00:30:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a80ae680 con 0x7f48a80b30d0 2021-10-21T00:30:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80ae920 con 0x7f48a80ace70 2021-10-21T00:30:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48a80b0710 0x7f48a8142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48a80b0710 0x7f48a8142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46556/0 (socket says 172.21.15.12:46556) 2021-10-21T00:30:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a659c700 1 -- 172.21.15.12:0/3156364018 learned_addr learned my addr 172.21.15.12:0/3156364018 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a5d9b700 1 --2- 172.21.15.12:0/3156364018 >> v2:172.21.15.31:3300/0 conn(0x7f48a80b30d0 0x7f48a8143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a6d9d700 1 --2- 172.21.15.12:0/3156364018 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80ace70 0x7f48a805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a659c700 1 -- 172.21.15.12:0/3156364018 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80ace70 msgr2=0x7f48a805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a659c700 1 --2- 172.21.15.12:0/3156364018 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80ace70 0x7f48a805f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a659c700 1 -- 172.21.15.12:0/3156364018 >> v2:172.21.15.31:3300/0 conn(0x7f48a80b30d0 msgr2=0x7f48a8143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a659c700 1 --2- 172.21.15.12:0/3156364018 >> v2:172.21.15.31:3300/0 conn(0x7f48a80b30d0 0x7f48a8143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a659c700 1 -- 172.21.15.12:0/3156364018 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80aebc0 con 0x7f48a80b0710 2021-10-21T00:30:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a6d9d700 1 --2- 172.21.15.12:0/3156364018 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80ace70 0x7f48a805f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:30:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a659c700 1 --2- 172.21.15.12:0/3156364018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 0x7f48a8142d20 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f4890002f70 tx=0x7f4890006eb0).ready entity=mon.0 client_cookie=6e652c992f12e8b5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a559a700 1 -- 172.21.15.12:0/3156364018 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489000d570 con 0x7f48a80b0710 2021-10-21T00:30:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a559a700 1 -- 172.21.15.12:0/3156364018 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890000e90 con 0x7f48a80b0710 2021-10-21T00:30:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a559a700 1 -- 172.21.15.12:0/3156364018 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489000d900 con 0x7f48a80b0710 2021-10-21T00:30:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 -- 172.21.15.12:0/3156364018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 msgr2=0x7f48a8142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 --2- 172.21.15.12:0/3156364018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 0x7f48a8142d20 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f4890002f70 tx=0x7f4890006eb0).stop 2021-10-21T00:30:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 -- 172.21.15.12:0/3156364018 shutdown_connections 2021-10-21T00:30:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 --2- 172.21.15.12:0/3156364018 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80ace70 0x7f48a805f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 --2- 172.21.15.12:0/3156364018 >> v2:172.21.15.31:3300/0 conn(0x7f48a80b30d0 0x7f48a8143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 --2- 172.21.15.12:0/3156364018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 0x7f48a8142d20 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.197+0000 7f48a759e700 1 -- 172.21.15.12:0/3156364018 >> 172.21.15.12:0/3156364018 conn(0x7f48a8061140 msgr2=0x7f48a8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 -- 172.21.15.12:0/3156364018 shutdown_connections 2021-10-21T00:30:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 -- 172.21.15.12:0/3156364018 wait complete. 2021-10-21T00:30:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 Processor -- start 2021-10-21T00:30:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 -- start start 2021-10-21T00:30:24.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48a80ace70 0x7f48a8066ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 0x7f48a8141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80b30d0 0x7f48a8153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80663e0 con 0x7f48a80b0710 2021-10-21T00:30:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8067530 con 0x7f48a80ace70 2021-10-21T00:30:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a759e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80677d0 con 0x7f48a80b30d0 2021-10-21T00:30:24.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 0x7f48a8141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 0x7f48a8141190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46564/0 (socket says 172.21.15.12:46564) 2021-10-21T00:30:24.227 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a5d9b700 1 -- 172.21.15.12:0/3261777888 learned_addr learned my addr 172.21.15.12:0/3261777888 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a659c700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48a80ace70 0x7f48a8066ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a6d9d700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80b30d0 0x7f48a8153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a5d9b700 1 -- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80b30d0 msgr2=0x7f48a8153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a5d9b700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80b30d0 0x7f48a8153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a5d9b700 1 -- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48a80ace70 msgr2=0x7f48a8066ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a5d9b700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48a80ace70 0x7f48a8066ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.229 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a5d9b700 1 -- 172.21.15.12:0/3261777888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489000b1e0 con 0x7f48a80b0710 2021-10-21T00:30:24.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.201+0000 7f48a5d9b700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 0x7f48a8141190 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f48a0003430 tx=0x7f48a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f489f7fe700 1 -- 172.21.15.12:0/3261777888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a000f710 con 0x7f48a80b0710 2021-10-21T00:30:24.230 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f489f7fe700 1 -- 172.21.15.12:0/3261777888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a000f870 con 0x7f48a80b0710 2021-10-21T00:30:24.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a8066640 con 0x7f48a80b0710 2021-10-21T00:30:24.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f489f7fe700 1 -- 172.21.15.12:0/3261777888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a000fbd0 con 0x7f48a80b0710 2021-10-21T00:30:24.231 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a8153e50 con 0x7f48a80b0710 2021-10-21T00:30:24.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a80667d0 con 0x7f48a80b0710 2021-10-21T00:30:24.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f489f7fe700 1 -- 172.21.15.12:0/3261777888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f48a001a030 con 0x7f48a80b0710 2021-10-21T00:30:24.232 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f489f7fe700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f488c053610 0x7f488c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f489f7fe700 1 -- 172.21.15.12:0/3261777888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f48a006b600 con 0x7f48a80b0710 2021-10-21T00:30:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f48a659c700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f488c053610 0x7f488c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.205+0000 7f48a659c700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f488c053610 0x7f488c055ad0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f489001c000 tx=0x7f4890015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.234 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.209+0000 7f489f7fe700 1 -- 172.21.15.12:0/3261777888 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f48a0042990 con 0x7f48a80b0710 2021-10-21T00:30:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.337+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f48a8057350 con 0x7f488c053610 2021-10-21T00:30:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.337+0000 7f489f7fe700 1 -- 172.21.15.12:0/3261777888 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f48a8057350 con 0x7f488c053610 2021-10-21T00:30:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f488c053610 msgr2=0x7f488c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f488c053610 0x7f488c055ad0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f489001c000 tx=0x7f4890015000).stop 2021-10-21T00:30:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 msgr2=0x7f48a8141190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 0x7f48a8141190 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f48a0003430 tx=0x7f48a0008040).stop 2021-10-21T00:30:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 shutdown_connections 2021-10-21T00:30:24.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f488c053610 0x7f488c055ad0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48a80b30d0 0x7f48a8153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48a80b0710 0x7f48a8141190 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 --2- 172.21.15.12:0/3261777888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48a80ace70 0x7f48a8066ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 >> 172.21.15.12:0/3261777888 conn(0x7f48a8061140 msgr2=0x7f48a8142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 shutdown_connections 2021-10-21T00:30:24.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.341+0000 7f48a759e700 1 -- 172.21.15.12:0/3261777888 wait complete. 2021-10-21T00:30:24.357 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 5 to deep-scrub 2021-10-21T00:30:24.368 INFO:tasks.ceph:Scrubbing osd.6 2021-10-21T00:30:24.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:30:24.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.473+0000 7f7cf359e700 1 Processor -- start 2021-10-21T00:30:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.473+0000 7f7cf359e700 1 -- start start 2021-10-21T00:30:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cf40ad5c0 0x7f7cf4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf4140440 0x7f7cf41408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40aecf0 con 0x7f7cf4061320 2021-10-21T00:30:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40b6f20 con 0x7f7cf40ad5c0 2021-10-21T00:30:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40aef20 con 0x7f7cf4140440 2021-10-21T00:30:24.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf1d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cf40ad5c0 0x7f7cf4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.503 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf1d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cf40ad5c0 0x7f7cf4061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46572/0 (socket says 172.21.15.12:46572) 2021-10-21T00:30:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf1d9b700 1 -- 172.21.15.12:0/377845445 learned_addr learned my addr 172.21.15.12:0/377845445 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf2d9d700 1 --2- 172.21.15.12:0/377845445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf4140440 0x7f7cf41408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf1d9b700 1 -- 172.21.15.12:0/377845445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf4140440 msgr2=0x7f7cf41408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf1d9b700 1 --2- 172.21.15.12:0/377845445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf4140440 0x7f7cf41408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf1d9b700 1 -- 172.21.15.12:0/377845445 >> v1:172.21.15.31:6789/0 conn(0x7f7cf4061320 legacy=0x7f7cf40b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf1d9b700 1 -- 172.21.15.12:0/377845445 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40af1c0 con 0x7f7cf40ad5c0 2021-10-21T00:30:24.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf1d9b700 1 --2- 172.21.15.12:0/377845445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf40ad5c0 0x7f7cf4061700 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f7ce4002f70 tx=0x7f7ce4006eb0).ready entity=mon.0 client_cookie=74fe0f44d3427932 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf159a700 1 -- 172.21.15.12:0/377845445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ce400d570 con 0x7f7cf40ad5c0 2021-10-21T00:30:24.506 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf159a700 1 -- 172.21.15.12:0/377845445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce4000e90 con 0x7f7cf40ad5c0 2021-10-21T00:30:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf159a700 1 -- 172.21.15.12:0/377845445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ce400d900 con 0x7f7cf40ad5c0 2021-10-21T00:30:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 -- 172.21.15.12:0/377845445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf40ad5c0 msgr2=0x7f7cf4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 --2- 172.21.15.12:0/377845445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf40ad5c0 0x7f7cf4061700 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f7ce4002f70 tx=0x7f7ce4006eb0).stop 2021-10-21T00:30:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 -- 172.21.15.12:0/377845445 shutdown_connections 2021-10-21T00:30:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 --2- 172.21.15.12:0/377845445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf4140440 0x7f7cf41408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 --2- 172.21.15.12:0/377845445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf40ad5c0 0x7f7cf4061700 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 -- 172.21.15.12:0/377845445 >> 172.21.15.12:0/377845445 conn(0x7f7cf4066de0 msgr2=0x7f7cf40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 -- 172.21.15.12:0/377845445 shutdown_connections 2021-10-21T00:30:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.477+0000 7f7cf359e700 1 -- 172.21.15.12:0/377845445 wait complete. 2021-10-21T00:30:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 Processor -- start 2021-10-21T00:30:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 -- start start 2021-10-21T00:30:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf4061320 0x7f7cf405cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf40ad5c0 0x7f7cf40b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf4140440 0x7f7cf40b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4067740 con 0x7f7cf4140440 2021-10-21T00:30:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40acea0 con 0x7f7cf40ad5c0 2021-10-21T00:30:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4156460 con 0x7f7cf4061320 2021-10-21T00:30:24.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf4140440 0x7f7cf40b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf4140440 0x7f7cf40b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46576/0 (socket says 172.21.15.12:46576) 2021-10-21T00:30:24.513 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf2d9d700 1 -- 172.21.15.12:0/3646298521 learned_addr learned my addr 172.21.15.12:0/3646298521 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:24.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf259c700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf4061320 0x7f7cf405cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf1d9b700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf40ad5c0 0x7f7cf40b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.514 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf2d9d700 1 -- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf4061320 msgr2=0x7f7cf405cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf2d9d700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf4061320 0x7f7cf405cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf2d9d700 1 -- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf40ad5c0 msgr2=0x7f7cf40b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.515 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf2d9d700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf40ad5c0 0x7f7cf40b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf2d9d700 1 -- 172.21.15.12:0/3646298521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce400b1e0 con 0x7f7cf4140440 2021-10-21T00:30:24.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf2d9d700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf4140440 0x7f7cf40b0fe0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f7cec006e00 tx=0x7f7cec0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.516 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7ceb7fe700 1 -- 172.21.15.12:0/3646298521 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cec012600 con 0x7f7cf4140440 2021-10-21T00:30:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7ceb7fe700 1 -- 172.21.15.12:0/3646298521 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec012760 con 0x7f7cf4140440 2021-10-21T00:30:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf4152500 con 0x7f7cf4140440 2021-10-21T00:30:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7ceb7fe700 1 -- 172.21.15.12:0/3646298521 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cec012ac0 con 0x7f7cf4140440 2021-10-21T00:30:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.481+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf4156690 con 0x7f7cf4140440 2021-10-21T00:30:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7cf40b1670 con 0x7f7cf4140440 2021-10-21T00:30:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7ceb7fe700 1 -- 172.21.15.12:0/3646298521 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7cec022070 con 0x7f7cf4140440 2021-10-21T00:30:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7ceb7fe700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7cd8053640 0x7f7cd8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7ceb7fe700 1 -- 172.21.15.12:0/3646298521 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f7cec06bd60 con 0x7f7cf4140440 2021-10-21T00:30:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7ceb7fe700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f7cd805a3d0 0x7f7cd805c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7ceb7fe700 1 -- 172.21.15.12:0/3646298521 --> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7cd805cdb0 con 0x7f7cd805a3d0 2021-10-21T00:30:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7ceb7fe700 1 -- 172.21.15.12:0/3646298521 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cec06e3d0 con 0x7f7cf4140440 2021-10-21T00:30:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7cf259c700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7cd8053640 0x7f7cd8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7cf1d9b700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f7cd805a3d0 0x7f7cd805c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.485+0000 7f7cf259c700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7cd8053640 0x7f7cd8055b00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f7cdc00d000 tx=0x7f7cdc007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.489+0000 7f7cf1d9b700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f7cd805a3d0 0x7f7cd805c7f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.489+0000 7f7ceb7fe700 1 -- 172.21.15.12:0/3646298521 <== osd.6 v2:172.21.15.31:6826/14822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f7cd805cdb0 con 0x7f7cd805a3d0 2021-10-21T00:30:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 --> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7cf40b3f20 con 0x7f7cd805a3d0 2021-10-21T00:30:24.523 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7ceb7fe700 1 -- 172.21.15.12:0/3646298521 <== osd.6 v2:172.21.15.31:6826/14822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7cf40b3f20 con 0x7f7cd805a3d0 2021-10-21T00:30:24.524 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-21T00:30:24.524 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:30:24.524 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-21T00:30:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f7cd805a3d0 msgr2=0x7f7cd805c7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6826/14822,v1:172.21.15.31:6827/14822] conn(0x7f7cd805a3d0 0x7f7cd805c7f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7cd8053640 msgr2=0x7f7cd8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.526 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f7cd8053640 0x7f7cd8055b00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f7cdc00d000 tx=0x7f7cdc007b90).stop 2021-10-21T00:30:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf4140440 msgr2=0x7f7cf40b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 --2- 172.21.15.12:0/3646298521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cf4140440 0x7f7cf40b0fe0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f7cec006e00 tx=0x7f7cec0091d0).stop 2021-10-21T00:30:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf2d9d700 1 -- 172.21.15.12:0/3646298521 reap_dead start 2021-10-21T00:30:24.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 shutdown_connections 2021-10-21T00:30:24.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 >> 172.21.15.12:0/3646298521 conn(0x7f7cf4066de0 msgr2=0x7f7cf40b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.528 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 shutdown_connections 2021-10-21T00:30:24.529 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.505+0000 7f7cf359e700 1 -- 172.21.15.12:0/3646298521 wait complete. 2021-10-21T00:30:24.530 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-10-21T00:30:24.637 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.625+0000 7f5860dc4700 1 Processor -- start 2021-10-21T00:30:24.638 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.625+0000 7f5860dc4700 1 -- start start 2021-10-21T00:30:24.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.625+0000 7f5860dc4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f585c0b4060 0x7f585c061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.625+0000 7f5860dc4700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0b5f50 con 0x7f585c142e60 2021-10-21T00:30:24.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.625+0000 7f5860dc4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0b1f70 con 0x7f585c0b6290 2021-10-21T00:30:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.625+0000 7f5860dc4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c0b2210 con 0x7f585c0b4060 2021-10-21T00:30:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f585c142e60 0x7f585c1432f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45182/0 (socket says 172.21.15.12:45182) 2021-10-21T00:30:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585bfff700 1 -- 172.21.15.12:0/4197734565 learned_addr learned my addr 172.21.15.12:0/4197734565 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-21T00:30:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585affd700 1 --2- 172.21.15.12:0/4197734565 >> v2:172.21.15.31:3300/0 conn(0x7f585c0b4060 0x7f585c061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585a7fc700 1 -- 172.21.15.12:0/4197734565 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616482293 0 0) 0x7f5854001490 con 0x7f585c142e60 2021-10-21T00:30:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585a7fc700 1 -- 172.21.15.12:0/4197734565 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f583c003260 con 0x7f585c142e60 2021-10-21T00:30:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585affd700 1 -- 172.21.15.12:0/4197734565 >> v1:172.21.15.31:6789/0 conn(0x7f585c0b6290 legacy=0x7f585c061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585affd700 1 -- 172.21.15.12:0/4197734565 >> v1:172.21.15.12:6789/0 conn(0x7f585c142e60 legacy=0x7f585c1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585a7fc700 1 -- 172.21.15.12:0/4197734565 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2876489217 0 0) 0x7f583c003260 con 0x7f585c142e60 2021-10-21T00:30:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585affd700 1 -- 172.21.15.12:0/4197734565 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0b24b0 con 0x7f585c0b4060 2021-10-21T00:30:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585affd700 1 --2- 172.21.15.12:0/4197734565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c0b4060 0x7f585c061b80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f5854001d30 tx=0x7f584c006df0).ready entity=mon.1 client_cookie=89af5bf488c10b0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585a7fc700 1 -- 172.21.15.12:0/4197734565 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5854001b90 con 0x7f585c0b4060 2021-10-21T00:30:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585a7fc700 1 -- 172.21.15.12:0/4197734565 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c000e90 con 0x7f585c0b4060 2021-10-21T00:30:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f585a7fc700 1 -- 172.21.15.12:0/4197734565 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584c00d4f0 con 0x7f585c0b4060 2021-10-21T00:30:24.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f5860dc4700 1 -- 172.21.15.12:0/4197734565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c0b4060 msgr2=0x7f585c061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f5860dc4700 1 --2- 172.21.15.12:0/4197734565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c0b4060 0x7f585c061b80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f5854001d30 tx=0x7f584c006df0).stop 2021-10-21T00:30:24.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f5860dc4700 1 -- 172.21.15.12:0/4197734565 shutdown_connections 2021-10-21T00:30:24.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f5860dc4700 1 --2- 172.21.15.12:0/4197734565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c0b4060 0x7f585c061b80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f5860dc4700 1 -- 172.21.15.12:0/4197734565 >> 172.21.15.12:0/4197734565 conn(0x7f585c05c490 msgr2=0x7f585c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f5860dc4700 1 -- 172.21.15.12:0/4197734565 shutdown_connections 2021-10-21T00:30:24.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.629+0000 7f5860dc4700 1 -- 172.21.15.12:0/4197734565 wait complete. 2021-10-21T00:30:24.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f5860dc4700 1 Processor -- start 2021-10-21T00:30:24.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f5860dc4700 1 -- start start 2021-10-21T00:30:24.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f5860dc4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c0b4060 0x7f585c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f5860dc4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f585c0b6290 0x7f585c145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.657 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f5860dc4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f585c142e60 0x7f585c0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f5860dc4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c146480 con 0x7f585c0b6290 2021-10-21T00:30:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f5860dc4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0b0940 con 0x7f585c0b4060 2021-10-21T00:30:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f5860dc4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0ad870 con 0x7f585c142e60 2021-10-21T00:30:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f585affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f585c0b6290 0x7f585c145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f585affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f585c0b6290 0x7f585c145f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46592/0 (socket says 172.21.15.12:46592) 2021-10-21T00:30:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f585affd700 1 -- 172.21.15.12:0/353033657 learned_addr learned my addr 172.21.15.12:0/353033657 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f585bfff700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f585c142e60 0x7f585c0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.633+0000 7f585b7fe700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c0b4060 0x7f585c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f585affd700 1 -- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f585c142e60 msgr2=0x7f585c0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f585affd700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f585c142e60 0x7f585c0adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f585affd700 1 -- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c0b4060 msgr2=0x7f585c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f585affd700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c0b4060 0x7f585c0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f585affd700 1 -- 172.21.15.12:0/353033657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c00b180 con 0x7f585c0b6290 2021-10-21T00:30:24.662 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f585bfff700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f585c142e60 0x7f585c0adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:30:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f585affd700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f585c0b6290 0x7f585c145f90 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f5854001d30 tx=0x7f584c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f5858ff9700 1 -- 172.21.15.12:0/353033657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584c016070 con 0x7f585c0b6290 2021-10-21T00:30:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f5858ff9700 1 -- 172.21.15.12:0/353033657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c002f50 con 0x7f585c0b6290 2021-10-21T00:30:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c0aff60 con 0x7f585c0b6290 2021-10-21T00:30:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f5858ff9700 1 -- 172.21.15.12:0/353033657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584c00d4f0 con 0x7f585c0b6290 2021-10-21T00:30:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c0b04a0 con 0x7f585c0b6290 2021-10-21T00:30:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c0b0660 con 0x7f585c0b6290 2021-10-21T00:30:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f5858ff9700 1 -- 172.21.15.12:0/353033657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f584c025030 con 0x7f585c0b6290 2021-10-21T00:30:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f5858ff9700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5840053640 0x7f5840055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.637+0000 7f5858ff9700 1 -- 172.21.15.12:0/353033657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f584c06c770 con 0x7f585c0b6290 2021-10-21T00:30:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.641+0000 7f585b7fe700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5840053640 0x7f5840055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.641+0000 7f585b7fe700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5840053640 0x7f5840055b00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f584400d000 tx=0x7f5844009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.668 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.645+0000 7f5858ff9700 1 -- 172.21.15.12:0/353033657 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f584c043940 con 0x7f585c0b6290 2021-10-21T00:30:24.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.769+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f585c0b2750 con 0x7f5840053640 2021-10-21T00:30:24.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.769+0000 7f5858ff9700 1 -- 172.21.15.12:0/353033657 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f585c0b2750 con 0x7f5840053640 2021-10-21T00:30:24.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5840053640 msgr2=0x7f5840055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5840053640 0x7f5840055b00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f584400d000 tx=0x7f5844009040).stop 2021-10-21T00:30:24.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f585c0b6290 msgr2=0x7f585c145f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f585c0b6290 0x7f585c145f90 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f5854001d30 tx=0x7f584c014000).stop 2021-10-21T00:30:24.786 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 shutdown_connections 2021-10-21T00:30:24.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f5840053640 0x7f5840055b00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f585c142e60 0x7f585c0adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.787 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f585c0b6290 0x7f585c145f90 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 --2- 172.21.15.12:0/353033657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c0b4060 0x7f585c0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 >> 172.21.15.12:0/353033657 conn(0x7f585c05c490 msgr2=0x7f585c141120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.788 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 shutdown_connections 2021-10-21T00:30:24.789 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.773+0000 7f5860dc4700 1 -- 172.21.15.12:0/353033657 wait complete. 2021-10-21T00:30:24.789 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 6 to deep-scrub 2021-10-21T00:30:24.796 INFO:tasks.ceph:Scrubbing osd.7 2021-10-21T00:30:24.797 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:30:24.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d47fff700 1 Processor -- start 2021-10-21T00:30:24.917 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d47fff700 1 -- start start 2021-10-21T00:30:24.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d480b6290 0x7f0d48061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d47fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480b5f50 con 0x7f0d480b4060 2021-10-21T00:30:24.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d47fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480b1f70 con 0x7f0d48142e60 2021-10-21T00:30:24.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d47fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480b2210 con 0x7f0d480b6290 2021-10-21T00:30:24.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d467fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0d480b4060 0x7f0d48061960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45194/0 (socket says 172.21.15.12:45194) 2021-10-21T00:30:24.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d467fc700 1 -- 172.21.15.12:0/2867471996 learned_addr learned my addr 172.21.15.12:0/2867471996 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-21T00:30:24.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d46ffd700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d480b6290 0x7f0d48061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345829134 0 0) 0x7f0d30001110 con 0x7f0d480b4060 2021-10-21T00:30:24.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.905+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d28003260 con 0x7f0d480b4060 2021-10-21T00:30:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412569542 0 0) 0x7f0d480b1f70 con 0x7f0d48142e60 2021-10-21T00:30:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d30001110 con 0x7f0d48142e60 2021-10-21T00:30:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 962130418 0 0) 0x7f0d28003260 con 0x7f0d480b4060 2021-10-21T00:30:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d480b6290 msgr2=0x7f0d48061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d480b6290 0x7f0d48061470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 >> v1:172.21.15.31:6789/0 conn(0x7f0d48142e60 legacy=0x7f0d48143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480b24b0 con 0x7f0d480b4060 2021-10-21T00:30:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 299188030 0 0) 0x7f0d300017f0 con 0x7f0d480b4060 2021-10-21T00:30:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 >> v1:172.21.15.12:6789/0 conn(0x7f0d480b4060 legacy=0x7f0d48061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d28003910 0x7f0d28003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d480b6290 0x7f0d28004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d280049f0 0x7f0d28004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480b2210 con 0x7f0d28003910 2021-10-21T00:30:24.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2800b780 con 0x7f0d280049f0 2021-10-21T00:30:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d46ffd700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d28003910 0x7f0d28003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2800b940 con 0x7f0d480b6290 2021-10-21T00:30:24.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d477fe700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d280049f0 0x7f0d28004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d467fc700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d480b6290 0x7f0d28004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d46ffd700 1 -- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d480b6290 msgr2=0x7f0d28004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d46ffd700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d480b6290 0x7f0d28004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d46ffd700 1 -- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d280049f0 msgr2=0x7f0d28004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d46ffd700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d280049f0 0x7f0d28004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d46ffd700 1 -- 172.21.15.12:0/2867471996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d28003260 con 0x7f0d28003910 2021-10-21T00:30:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d477fe700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d280049f0 0x7f0d28004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:30:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d467fc700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d480b6290 0x7f0d28004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:30:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d46ffd700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d28003910 0x7f0d28003d10 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f0d3800c000 tx=0x7f0d38006df0).ready entity=mon.0 client_cookie=11fd351ec5608c11 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d3800e830 con 0x7f0d28003910 2021-10-21T00:30:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3800e990 con 0x7f0d28003910 2021-10-21T00:30:24.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d45ffb700 1 -- 172.21.15.12:0/2867471996 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d3800ecf0 con 0x7f0d28003910 2021-10-21T00:30:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d47fff700 1 -- 172.21.15.12:0/2867471996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d28003910 msgr2=0x7f0d28003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d47fff700 1 --2- 172.21.15.12:0/2867471996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d28003910 0x7f0d28003d10 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f0d3800c000 tx=0x7f0d38006df0).stop 2021-10-21T00:30:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d477fe700 1 -- 172.21.15.12:0/2867471996 reap_dead start 2021-10-21T00:30:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d47fff700 1 -- 172.21.15.12:0/2867471996 shutdown_connections 2021-10-21T00:30:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d47fff700 1 -- 172.21.15.12:0/2867471996 >> 172.21.15.12:0/2867471996 conn(0x7f0d4805c490 msgr2=0x7f0d4805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d47fff700 1 -- 172.21.15.12:0/2867471996 shutdown_connections 2021-10-21T00:30:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.909+0000 7f0d47fff700 1 -- 172.21.15.12:0/2867471996 wait complete. 2021-10-21T00:30:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 Processor -- start 2021-10-21T00:30:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 -- start start 2021-10-21T00:30:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d28003910 0x7f0d4813e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d480af870 0x7f0d4813e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d481561b0 0x7f0d48156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480ada00 con 0x7f0d481561b0 2021-10-21T00:30:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480af130 con 0x7f0d480af870 2021-10-21T00:30:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480af3d0 con 0x7f0d28003910 2021-10-21T00:30:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d481561b0 0x7f0d48156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d481561b0 0x7f0d48156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46614/0 (socket says 172.21.15.12:46614) 2021-10-21T00:30:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d477fe700 1 -- 172.21.15.12:0/335005441 learned_addr learned my addr 172.21.15.12:0/335005441 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d467fc700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d480af870 0x7f0d4813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d46ffd700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d28003910 0x7f0d4813e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d477fe700 1 -- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d28003910 msgr2=0x7f0d4813e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d477fe700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d28003910 0x7f0d4813e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d477fe700 1 -- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d480af870 msgr2=0x7f0d4813e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d477fe700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d480af870 0x7f0d4813e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d477fe700 1 -- 172.21.15.12:0/335005441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48140730 con 0x7f0d481561b0 2021-10-21T00:30:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d467fc700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d480af870 0x7f0d4813e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:30:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d46ffd700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d28003910 0x7f0d4813e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:30:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d477fe700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d481561b0 0x7f0d48156630 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f0d300019d0 tx=0x7f0d40009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d3ffff700 1 -- 172.21.15.12:0/335005441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d4000de90 con 0x7f0d481561b0 2021-10-21T00:30:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d3ffff700 1 -- 172.21.15.12:0/335005441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d400032e0 con 0x7f0d481561b0 2021-10-21T00:30:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d480ad5d0 con 0x7f0d481561b0 2021-10-21T00:30:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d3ffff700 1 -- 172.21.15.12:0/335005441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d400016e0 con 0x7f0d481561b0 2021-10-21T00:30:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.913+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4812b970 con 0x7f0d481561b0 2021-10-21T00:30:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d480aefb0 con 0x7f0d481561b0 2021-10-21T00:30:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d3ffff700 1 -- 172.21.15.12:0/335005441 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d4001b060 con 0x7f0d481561b0 2021-10-21T00:30:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d3ffff700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0d2c0536d0 0x7f0d2c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d3ffff700 1 -- 172.21.15.12:0/335005441 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f0d4006b1e0 con 0x7f0d481561b0 2021-10-21T00:30:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d3ffff700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f0d2c05a460 0x7f0d2c05c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d3ffff700 1 -- 172.21.15.12:0/335005441 --> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d2c05ce40 con 0x7f0d2c05a460 2021-10-21T00:30:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d3ffff700 1 -- 172.21.15.12:0/335005441 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d4006d700 con 0x7f0d481561b0 2021-10-21T00:30:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d46ffd700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0d2c0536d0 0x7f0d2c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d467fc700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f0d2c05a460 0x7f0d2c05c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d46ffd700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0d2c0536d0 0x7f0d2c055b90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f0d3801c000 tx=0x7f0d38019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.917+0000 7f0d467fc700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f0d2c05a460 0x7f0d2c05c880 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.921+0000 7f0d3ffff700 1 -- 172.21.15.12:0/335005441 <== osd.7 v2:172.21.15.31:6818/14835 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f0d2c05ce40 con 0x7f0d2c05a460 2021-10-21T00:30:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 --> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0d480b2750 con 0x7f0d2c05a460 2021-10-21T00:30:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d3ffff700 1 -- 172.21.15.12:0/335005441 <== osd.7 v2:172.21.15.31:6818/14835 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0d480b2750 con 0x7f0d2c05a460 2021-10-21T00:30:24.960 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2021-10-21T00:30:24.961 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:30:24.962 INFO:teuthology.orchestra.run.smithi012.stdout:} 2021-10-21T00:30:24.963 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f0d2c05a460 msgr2=0x7f0d2c05c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6818/14835,v1:172.21.15.31:6819/14835] conn(0x7f0d2c05a460 0x7f0d2c05c880 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:24.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0d2c0536d0 msgr2=0x7f0d2c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.964 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7f0d2c0536d0 0x7f0d2c055b90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f0d3801c000 tx=0x7f0d38019000).stop 2021-10-21T00:30:24.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d481561b0 msgr2=0x7f0d48156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:24.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 --2- 172.21.15.12:0/335005441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d481561b0 0x7f0d48156630 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f0d300019d0 tx=0x7f0d40009040).stop 2021-10-21T00:30:24.965 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d477fe700 1 -- 172.21.15.12:0/335005441 reap_dead start 2021-10-21T00:30:24.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 shutdown_connections 2021-10-21T00:30:24.966 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 >> 172.21.15.12:0/335005441 conn(0x7f0d4805c490 msgr2=0x7f0d48143310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:24.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 shutdown_connections 2021-10-21T00:30:24.967 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:24.937+0000 7f0d47fff700 1 -- 172.21.15.12:0/335005441 wait complete. 2021-10-21T00:30:24.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-10-21T00:30:25.077 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.065+0000 7fbf42e63700 1 Processor -- start 2021-10-21T00:30:25.078 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.065+0000 7fbf42e63700 1 -- start start 2021-10-21T00:30:25.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.065+0000 7fbf42e63700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf3c14b7c0 0x7fbf3c14dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.080 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.065+0000 7fbf42e63700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3c0b5f50 con 0x7fbf3c0b6290 2021-10-21T00:30:25.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.065+0000 7fbf42e63700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3c0b1f70 con 0x7fbf3c0b4060 2021-10-21T00:30:25.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.065+0000 7fbf42e63700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3c0b2210 con 0x7fbf3c14b7c0 2021-10-21T00:30:25.081 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.065+0000 7fbf42662700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf3c14b7c0 0x7fbf3c14dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.065+0000 7fbf41e61700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbf3c0b6290 0x7fbf3c061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45216/0 (socket says 172.21.15.12:45216) 2021-10-21T00:30:25.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.065+0000 7fbf41e61700 1 -- 172.21.15.12:0/930164216 learned_addr learned my addr 172.21.15.12:0/930164216 (peer_addr_for_me v1:172.21.15.12:0/0) 2021-10-21T00:30:25.082 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42662700 1 -- 172.21.15.12:0/930164216 >> v1:172.21.15.31:6789/0 conn(0x7fbf3c0b4060 legacy=0x7fbf3c061b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42662700 1 -- 172.21.15.12:0/930164216 >> v1:172.21.15.12:6789/0 conn(0x7fbf3c0b6290 legacy=0x7fbf3c061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf40e5f700 1 -- 172.21.15.12:0/930164216 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240250788 0 0) 0x7fbf2c001110 con 0x7fbf3c0b6290 2021-10-21T00:30:25.083 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42662700 1 -- 172.21.15.12:0/930164216 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c0b24b0 con 0x7fbf3c14b7c0 2021-10-21T00:30:25.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42662700 1 --2- 172.21.15.12:0/930164216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c14b7c0 0x7fbf3c14dbb0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fbf340032f0 tx=0x7fbf340091d0).ready entity=mon.0 client_cookie=694d5c59069ff0fc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:25.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf40e5f700 1 -- 172.21.15.12:0/930164216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf34009ea0 con 0x7fbf3c14b7c0 2021-10-21T00:30:25.084 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf40e5f700 1 -- 172.21.15.12:0/930164216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3400b8a0 con 0x7fbf3c14b7c0 2021-10-21T00:30:25.085 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf40e5f700 1 -- 172.21.15.12:0/930164216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3400ba10 con 0x7fbf3c14b7c0 2021-10-21T00:30:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42e63700 1 -- 172.21.15.12:0/930164216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c14b7c0 msgr2=0x7fbf3c14dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42e63700 1 --2- 172.21.15.12:0/930164216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c14b7c0 0x7fbf3c14dbb0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fbf340032f0 tx=0x7fbf340091d0).stop 2021-10-21T00:30:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42e63700 1 -- 172.21.15.12:0/930164216 shutdown_connections 2021-10-21T00:30:25.092 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42e63700 1 --2- 172.21.15.12:0/930164216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c14b7c0 0x7fbf3c14dbb0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42e63700 1 -- 172.21.15.12:0/930164216 >> 172.21.15.12:0/930164216 conn(0x7fbf3c05c490 msgr2=0x7fbf3c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:25.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42e63700 1 -- 172.21.15.12:0/930164216 shutdown_connections 2021-10-21T00:30:25.093 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42e63700 1 -- 172.21.15.12:0/930164216 wait complete. 2021-10-21T00:30:25.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42e63700 1 Processor -- start 2021-10-21T00:30:25.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.069+0000 7fbf42e63700 1 -- start start 2021-10-21T00:30:25.094 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42e63700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf3c0b4060 0x7fbf3c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.095 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42e63700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c0b6290 0x7fbf3c13f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42e63700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf3c14b7c0 0x7fbf3c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42e63700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c14a330 con 0x7fbf3c0b6290 2021-10-21T00:30:25.096 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42e63700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c1402d0 con 0x7fbf3c0b4060 2021-10-21T00:30:25.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42e63700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c13f490 con 0x7fbf3c14b7c0 2021-10-21T00:30:25.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41660700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c0b6290 0x7fbf3c13f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.097 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41660700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c0b6290 0x7fbf3c13f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46628/0 (socket says 172.21.15.12:46628) 2021-10-21T00:30:25.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41660700 1 -- 172.21.15.12:0/1746574098 learned_addr learned my addr 172.21.15.12:0/1746574098 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:25.098 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41e61700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf3c0b4060 0x7fbf3c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42662700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf3c14b7c0 0x7fbf3c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41660700 1 -- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf3c14b7c0 msgr2=0x7fbf3c155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41660700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf3c14b7c0 0x7fbf3c155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.099 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41660700 1 -- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf3c0b4060 msgr2=0x7fbf3c0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41660700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf3c0b4060 0x7fbf3c0afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41660700 1 -- 172.21.15.12:0/1746574098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf34009470 con 0x7fbf3c0b6290 2021-10-21T00:30:25.100 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf41660700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c0b6290 0x7fbf3c13f820 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7fbf3c060190 tx=0x7fbf30007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:25.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf3affd700 1 -- 172.21.15.12:0/1746574098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf30012400 con 0x7fbf3c0b6290 2021-10-21T00:30:25.101 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf3affd700 1 -- 172.21.15.12:0/1746574098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30012560 con 0x7fbf3c0b6290 2021-10-21T00:30:25.102 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3c153510 con 0x7fbf3c0b6290 2021-10-21T00:30:25.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf3affd700 1 -- 172.21.15.12:0/1746574098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf300128c0 con 0x7fbf3c0b6290 2021-10-21T00:30:25.103 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3c1448c0 con 0x7fbf3c0b6290 2021-10-21T00:30:25.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.073+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3c0b3dd0 con 0x7fbf3c0b6290 2021-10-21T00:30:25.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.077+0000 7fbf3affd700 1 -- 172.21.15.12:0/1746574098 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf30019030 con 0x7fbf3c0b6290 2021-10-21T00:30:25.104 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.077+0000 7fbf3affd700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf1c0536d0 0x7fbf1c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.077+0000 7fbf3affd700 1 -- 172.21.15.12:0/1746574098 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fbf3006aa60 con 0x7fbf3c0b6290 2021-10-21T00:30:25.105 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.077+0000 7fbf41e61700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf1c0536d0 0x7fbf1c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.077+0000 7fbf41e61700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf1c0536d0 0x7fbf1c055b90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fbf2c00d000 tx=0x7fbf2c007840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:25.106 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.081+0000 7fbf3affd700 1 -- 172.21.15.12:0/1746574098 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf30041d40 con 0x7fbf3c0b6290 2021-10-21T00:30:25.218 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.205+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf3c140460 con 0x7fbf1c0536d0 2021-10-21T00:30:25.219 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.205+0000 7fbf3affd700 1 -- 172.21.15.12:0/1746574098 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf3c140460 con 0x7fbf1c0536d0 2021-10-21T00:30:25.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf1c0536d0 msgr2=0x7fbf1c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.221 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf1c0536d0 0x7fbf1c055b90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fbf2c00d000 tx=0x7fbf2c007840).stop 2021-10-21T00:30:25.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c0b6290 msgr2=0x7fbf3c13f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c0b6290 0x7fbf3c13f820 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7fbf3c060190 tx=0x7fbf30007c20).stop 2021-10-21T00:30:25.222 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 shutdown_connections 2021-10-21T00:30:25.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fbf1c0536d0 0x7fbf1c055b90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf3c14b7c0 0x7fbf3c155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.223 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf3c0b6290 0x7fbf3c13f820 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 --2- 172.21.15.12:0/1746574098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf3c0b4060 0x7fbf3c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 >> 172.21.15.12:0/1746574098 conn(0x7fbf3c05c490 msgr2=0x7fbf3c146bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:25.224 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 shutdown_connections 2021-10-21T00:30:25.225 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.209+0000 7fbf42e63700 1 -- 172.21.15.12:0/1746574098 wait complete. 2021-10-21T00:30:25.225 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 7 to deep-scrub 2021-10-21T00:30:25.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-21T00:30:25.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.317+0000 7fc678dde700 1 Processor -- start 2021-10-21T00:30:25.331 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.317+0000 7fc678dde700 1 -- start start 2021-10-21T00:30:25.335 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 0x7fc6740b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6740b3060 0x7fc67413e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.336 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6740b2380 con 0x7fc67413e710 2021-10-21T00:30:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc674144250 con 0x7fc6740b3060 2021-10-21T00:30:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6740b3570 con 0x7fc6740b7370 2021-10-21T00:30:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc66bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6740b3060 0x7fc67413e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc66bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6740b3060 0x7fc67413e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46634/0 (socket says 172.21.15.12:46634) 2021-10-21T00:30:25.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc66bfff700 1 -- 172.21.15.12:0/3568023235 learned_addr learned my addr 172.21.15.12:0/3568023235 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:25.338 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc66bfff700 1 -- 172.21.15.12:0/3568023235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 msgr2=0x7fc6740b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:25.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc6737fe700 1 --2- 172.21.15.12:0/3568023235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 0x7fc6740b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.339 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc66bfff700 1 --2- 172.21.15.12:0/3568023235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 0x7fc6740b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc66bfff700 1 -- 172.21.15.12:0/3568023235 >> v1:172.21.15.31:6789/0 conn(0x7fc67413e710 legacy=0x7fc674064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc66bfff700 1 -- 172.21.15.12:0/3568023235 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6740b25b0 con 0x7fc6740b3060 2021-10-21T00:30:25.340 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc6737fe700 1 --2- 172.21.15.12:0/3568023235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 0x7fc6740b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:30:25.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc66bfff700 1 --2- 172.21.15.12:0/3568023235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6740b3060 0x7fc67413e220 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7fc664002f70 tx=0x7fc664006eb0).ready entity=mon.0 client_cookie=b6745d4549604eef server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:25.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc672ffd700 1 -- 172.21.15.12:0/3568023235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66400d5c0 con 0x7fc6740b3060 2021-10-21T00:30:25.341 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc672ffd700 1 -- 172.21.15.12:0/3568023235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc664000e90 con 0x7fc6740b3060 2021-10-21T00:30:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc672ffd700 1 -- 172.21.15.12:0/3568023235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66400d950 con 0x7fc6740b3060 2021-10-21T00:30:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 -- 172.21.15.12:0/3568023235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6740b3060 msgr2=0x7fc67413e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 --2- 172.21.15.12:0/3568023235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6740b3060 0x7fc67413e220 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7fc664002f70 tx=0x7fc664006eb0).stop 2021-10-21T00:30:25.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 -- 172.21.15.12:0/3568023235 shutdown_connections 2021-10-21T00:30:25.343 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 --2- 172.21.15.12:0/3568023235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6740b3060 0x7fc67413e220 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 --2- 172.21.15.12:0/3568023235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 0x7fc6740b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 -- 172.21.15.12:0/3568023235 >> 172.21.15.12:0/3568023235 conn(0x7fc67405f6b0 msgr2=0x7fc67405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:25.344 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 -- 172.21.15.12:0/3568023235 shutdown_connections 2021-10-21T00:30:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.321+0000 7fc678dde700 1 -- 172.21.15.12:0/3568023235 wait complete. 2021-10-21T00:30:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc678dde700 1 Processor -- start 2021-10-21T00:30:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc678dde700 1 -- start start 2021-10-21T00:30:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc678dde700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6740b3060 0x7fc674153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc678dde700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 0x7fc6740ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc678dde700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67413e710 0x7fc6740ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc678dde700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc674140660 con 0x7fc67413e710 2021-10-21T00:30:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc678dde700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc674153bf0 con 0x7fc6740b3060 2021-10-21T00:30:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc678dde700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6741413b0 con 0x7fc6740b7370 2021-10-21T00:30:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc673fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67413e710 0x7fc6740ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc6737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6740b3060 0x7fc674153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc6737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6740b3060 0x7fc674153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:33382/0 (socket says 172.21.15.12:33382) 2021-10-21T00:30:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc6737fe700 1 -- 172.21.15.12:0/1605157967 learned_addr learned my addr 172.21.15.12:0/1605157967 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc66bfff700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 0x7fc6740ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc673fff700 1 -- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 msgr2=0x7fc6740ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc673fff700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 0x7fc6740ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc673fff700 1 -- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6740b3060 msgr2=0x7fc674153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc673fff700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6740b3060 0x7fc674153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.325+0000 7fc673fff700 1 -- 172.21.15.12:0/1605157967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66400b1e0 con 0x7fc67413e710 2021-10-21T00:30:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc673fff700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67413e710 0x7fc6740ac7b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fc6740b4fa0 tx=0x7fc66c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc6717fa700 1 -- 172.21.15.12:0/1605157967 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66c00ce10 con 0x7fc67413e710 2021-10-21T00:30:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc6717fa700 1 -- 172.21.15.12:0/1605157967 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c006aa0 con 0x7fc67413e710 2021-10-21T00:30:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc674141650 con 0x7fc67413e710 2021-10-21T00:30:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc6717fa700 1 -- 172.21.15.12:0/1605157967 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66c006e00 con 0x7fc67413e710 2021-10-21T00:30:25.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67413efc0 con 0x7fc67413e710 2021-10-21T00:30:25.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc674057350 con 0x7fc67413e710 2021-10-21T00:30:25.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc6717fa700 1 -- 172.21.15.12:0/1605157967 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc66c010030 con 0x7fc67413e710 2021-10-21T00:30:25.361 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc6717fa700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc658053580 0x7fc658055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc6717fa700 1 -- 172.21.15.12:0/1605157967 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc66c06b500 con 0x7fc67413e710 2021-10-21T00:30:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc6737fe700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc658053580 0x7fc658055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.329+0000 7fc6737fe700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc658053580 0x7fc658055a40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fc65c00d000 tx=0x7fc65c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.337+0000 7fc6717fa700 1 -- 172.21.15.12:0/1605157967 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc66c042780 con 0x7fc67413e710 2021-10-21T00:30:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.461+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc674153d80 con 0x7fc658053580 2021-10-21T00:30:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.469+0000 7fc6717fa700 1 -- 172.21.15.12:0/1605157967 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68746 (secure 0 0 0) 0x7fc65c000e90 con 0x7fc658053580 2021-10-21T00:30:25.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-21T00:30:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc658053580 msgr2=0x7fc658055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc658053580 0x7fc658055a40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fc65c00d000 tx=0x7fc65c008040).stop 2021-10-21T00:30:25.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67413e710 msgr2=0x7fc6740ac7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:25.485 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67413e710 0x7fc6740ac7b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fc6740b4fa0 tx=0x7fc66c007f10).stop 2021-10-21T00:30:25.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 shutdown_connections 2021-10-21T00:30:25.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc658053580 0x7fc658055a40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.486 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc67413e710 0x7fc6740ac7b0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6740b7370 0x7fc6740ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 --2- 172.21.15.12:0/1605157967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6740b3060 0x7fc674153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:25.487 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 >> 172.21.15.12:0/1605157967 conn(0x7fc67405f6b0 msgr2=0x7fc6740b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:25.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 shutdown_connections 2021-10-21T00:30:25.488 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:25.473+0000 7fc678dde700 1 -- 172.21.15.12:0/1605157967 wait complete. 2021-10-21T00:30:25.489 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2021-10-21T00:30:25.497 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":2279,"stamp":"2021-10-21T00:30:25.156214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8405152,"kb_used_data":16480,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569568,"statfs":{"total":773094113280,"available":764487237632,"internally_reserved":8589934592,"allocated":16875520,"data_stored":8249624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003322"},"pg_stats":[{"pgid":"1.0","version":"166'4","reported_seq":149,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:09:47.957296+0000","last_change":"2021-10-20T23:19:45.232100+0000","last_active":"2021-10-21T00:09:47.957296+0000","last_peered":"2021-10-21T00:09:47.957296+0000","last_clean":"2021-10-21T00:09:47.957296+0000","last_became_active":"2021-10-20T23:19:45.231374+0000","last_became_peered":"2021-10-20T23:19:45.231374+0000","last_unstale":"2021-10-21T00:09:47.957296+0000","last_undegraded":"2021-10-21T00:09:47.957296+0000","last_fullsized":"2021-10-21T00:09:47.957296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:40.954153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:40.954153+0000","last_clean_scrub_stamp":"2021-10-20T23:19:40.954153+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":144,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:48.214644+0000","last_change":"2021-10-20T23:19:50.050604+0000","last_active":"2021-10-20T23:29:48.214644+0000","last_peered":"2021-10-20T23:29:48.214644+0000","last_clean":"2021-10-20T23:29:48.214644+0000","last_became_active":"2021-10-20T23:19:50.050295+0000","last_became_peered":"2021-10-20T23:19:50.050295+0000","last_unstale":"2021-10-20T23:29:48.214644+0000","last_undegraded":"2021-10-20T23:29:48.214644+0000","last_fullsized":"2021-10-20T23:29:48.214644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:49.172828+0000","last_change":"2021-10-20T23:19:50.051597+0000","last_active":"2021-10-20T23:29:49.172828+0000","last_peered":"2021-10-20T23:29:49.172828+0000","last_clean":"2021-10-20T23:29:49.172828+0000","last_became_active":"2021-10-20T23:19:50.051189+0000","last_became_peered":"2021-10-20T23:19:50.051189+0000","last_unstale":"2021-10-20T23:29:49.172828+0000","last_undegraded":"2021-10-20T23:29:49.172828+0000","last_fullsized":"2021-10-20T23:29:49.172828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:48.335650+0000","last_change":"2021-10-20T23:19:50.050317+0000","last_active":"2021-10-20T23:29:48.335650+0000","last_peered":"2021-10-20T23:29:48.335650+0000","last_clean":"2021-10-20T23:29:48.335650+0000","last_became_active":"2021-10-20T23:19:50.049970+0000","last_became_peered":"2021-10-20T23:19:50.049970+0000","last_unstale":"2021-10-20T23:29:48.335650+0000","last_undegraded":"2021-10-20T23:29:48.335650+0000","last_fullsized":"2021-10-20T23:29:48.335650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":144,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:48.214369+0000","last_change":"2021-10-20T23:19:50.052800+0000","last_active":"2021-10-20T23:29:48.214369+0000","last_peered":"2021-10-20T23:29:48.214369+0000","last_clean":"2021-10-20T23:29:48.214369+0000","last_became_active":"2021-10-20T23:19:50.052290+0000","last_became_peered":"2021-10-20T23:19:50.052290+0000","last_unstale":"2021-10-20T23:29:48.214369+0000","last_undegraded":"2021-10-20T23:29:48.214369+0000","last_fullsized":"2021-10-20T23:29:48.214369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":150,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:22.599383+0000","last_change":"2021-10-21T00:30:22.599624+0000","last_active":"2021-10-21T00:30:22.599383+0000","last_peered":"2021-10-21T00:30:22.599383+0000","last_clean":"2021-10-21T00:30:22.599383+0000","last_became_active":"2021-10-20T23:19:50.195815+0000","last_became_peered":"2021-10-20T23:19:50.195815+0000","last_unstale":"2021-10-21T00:30:22.599383+0000","last_undegraded":"2021-10-21T00:30:22.599383+0000","last_fullsized":"2021-10-21T00:30:22.599383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:22.599382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:22.599382+0000","last_clean_scrub_stamp":"2021-10-21T00:30:22.599382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:49.173223+0000","last_change":"2021-10-20T23:19:50.200005+0000","last_active":"2021-10-20T23:29:49.173223+0000","last_peered":"2021-10-20T23:29:49.173223+0000","last_clean":"2021-10-20T23:29:49.173223+0000","last_became_active":"2021-10-20T23:19:50.198735+0000","last_became_peered":"2021-10-20T23:19:50.198735+0000","last_unstale":"2021-10-20T23:29:49.173223+0000","last_undegraded":"2021-10-20T23:29:49.173223+0000","last_fullsized":"2021-10-20T23:29:49.173223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:23.573652+0000","last_change":"2021-10-21T00:30:23.573763+0000","last_active":"2021-10-21T00:30:23.573652+0000","last_peered":"2021-10-21T00:30:23.573652+0000","last_clean":"2021-10-21T00:30:23.573652+0000","last_became_active":"2021-10-20T23:19:50.046787+0000","last_became_peered":"2021-10-20T23:19:50.046787+0000","last_unstale":"2021-10-21T00:30:23.573652+0000","last_undegraded":"2021-10-21T00:30:23.573652+0000","last_fullsized":"2021-10-21T00:30:23.573652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:23.573651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:23.573651+0000","last_clean_scrub_stamp":"2021-10-21T00:30:23.573651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":165,"state":"active+clean","last_fresh":"2021-10-20T23:29:49.175278+0000","last_change":"2021-10-20T23:19:50.049986+0000","last_active":"2021-10-20T23:29:49.175278+0000","last_peered":"2021-10-20T23:29:49.175278+0000","last_clean":"2021-10-20T23:29:49.175278+0000","last_became_active":"2021-10-20T23:19:50.049434+0000","last_became_peered":"2021-10-20T23:19:50.049434+0000","last_unstale":"2021-10-20T23:29:49.175278+0000","last_undegraded":"2021-10-20T23:29:49.175278+0000","last_fullsized":"2021-10-20T23:29:49.175278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-20T23:19:49.012161+0000","last_clean_scrub_stamp":"2021-10-20T23:19:49.012161+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542994,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81799999999999995,"15min":0.81299999999999994},"min":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.51700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.27},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50700000000000001},"max":{"1min":1.0920000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0429999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.137,"5min":1.1919999999999999,"15min":1.2589999999999999},"last":0.753}]},{"osd":2,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.87},"min":{"1min":0.62,"5min":0.61699999999999999,"15min":0.59399999999999997},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.325},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.85599999999999998,"15min":0.84699999999999998},"min":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58199999999999996},"max":{"1min":1.073,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.84399999999999997}]},{"osd":3,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82899999999999996,"15min":0.82599999999999996},"min":{"1min":0.65200000000000002,"5min":0.65100000000000002,"15min":0.56000000000000005},"max":{"1min":1.115,"5min":1.119,"15min":1.1220000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.93200000000000005,"15min":0.93300000000000005},"min":{"1min":0.71699999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1379999999999999,"5min":1.1619999999999999,"15min":1.3620000000000001},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86799999999999999,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0409999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88200000000000001,"15min":0.88300000000000001},"min":{"1min":0.71199999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.032,"5min":1.1279999999999999,"15min":1.216},"last":0.879}]},{"osd":5,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.53600000000000003},"max":{"1min":1.109,"5min":1.258,"15min":1.4419999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.97899999999999998,"15min":0.96399999999999997},"min":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.58799999999999997},"max":{"1min":1.167,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.81200000000000006,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.165,"5min":1.381,"15min":1.4450000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.97899999999999998,"15min":0.96699999999999997},"min":{"1min":0.82799999999999996,"5min":0.70399999999999996,"15min":0.66300000000000003},"max":{"1min":1.2629999999999999,"5min":1.288,"15min":1.3220000000000001},"last":0.94999999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79900000000000004,"15min":0.80300000000000005},"min":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0029999999999999,"5min":1.1379999999999999,"15min":1.268},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81100000000000005,"15min":0.82499999999999996},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.093,"5min":1.179,"15min":1.179},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.85799999999999998,"15min":0.84399999999999997},"min":{"1min":0.67100000000000004,"5min":0.59899999999999998,"15min":0.54600000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.89200000000000002}]},{"osd":2,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84099999999999997,"15min":0.83299999999999996},"min":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0980000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.5},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"max":{"1min":1.0880000000000001,"5min":1.2030000000000001,"15min":1.2070000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.65600000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.081,"5min":1.1919999999999999,"15min":1.222},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.61399999999999999},"max":{"1min":1.125,"5min":1.1619999999999999,"15min":1.3660000000000001},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.80600000000000005,"15min":0.82899999999999996},"min":{"1min":0.64400000000000002,"5min":0.54200000000000004,"15min":0.47299999999999998},"max":{"1min":1.0700000000000001,"5min":1.264,"15min":1.264},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.88400000000000001,"15min":0.90200000000000002},"min":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.115,"5min":1.1859999999999999,"15min":1.3029999999999999},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88400000000000001,"15min":0.876},"min":{"1min":0.67700000000000005,"5min":0.60899999999999999,"15min":0.56499999999999995},"max":{"1min":1.089,"5min":1.236,"15min":1.4430000000000001},"last":0.752},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.67800000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.234,"15min":1.2769999999999999},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95399999999999996,"15min":0.97199999999999998},"min":{"1min":0.70299999999999996,"5min":0.64900000000000002,"15min":0.629},"max":{"1min":1.1519999999999999,"5min":1.335,"15min":1.335},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.0149999999999999,"15min":1.006},"min":{"1min":0.80200000000000005,"5min":0.71599999999999997,"15min":0.64200000000000002},"max":{"1min":1.1819999999999999,"5min":1.365,"15min":1.5},"last":0.92800000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.98999999999999999,"15min":1.1080000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77300000000000002,"15min":0.76100000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.48599999999999999},"max":{"1min":0.97099999999999997,"5min":1.081,"15min":1.2729999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86699999999999999,"15min":0.85699999999999998},"min":{"1min":0.75,"5min":0.52600000000000002,"15min":0.47799999999999998},"max":{"1min":1.0149999999999999,"5min":1.1539999999999999,"15min":1.2330000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.86199999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.58099999999999996},"max":{"1min":1.1220000000000001,"5min":1.1279999999999999,"15min":1.3240000000000001},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90300000000000002,"15min":0.91800000000000004},"min":{"1min":0.68200000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.016,"5min":1.1930000000000001,"15min":1.5449999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.74099999999999999,"5min":0.60899999999999999,"15min":0.55900000000000005},"max":{"1min":1.02,"5min":1.212,"15min":1.224},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84399999999999997,"15min":0.83799999999999997},"min":{"1min":0.624,"5min":0.60399999999999998,"15min":0.60199999999999998},"max":{"1min":1.03,"5min":1.1000000000000001,"15min":1.1359999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95499999999999996,"15min":0.94999999999999996},"min":{"1min":0.79100000000000004,"5min":0.65600000000000003,"15min":0.63500000000000001},"max":{"1min":1.0780000000000001,"5min":1.2030000000000001,"15min":1.5860000000000001},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81299999999999994,"15min":0.79800000000000004},"min":{"1min":0.52600000000000002,"5min":0.51600000000000001,"15min":0.51300000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.25},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.99199999999999999,"15min":0.98699999999999999},"min":{"1min":0.68100000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.367},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.878,"15min":0.879},"min":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4490000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":0.90100000000000002},"min":{"1min":0.629,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.071,"5min":1.145,"15min":1.325},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.95999999999999996,"15min":0.93500000000000005},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.58699999999999997},"max":{"1min":1.163,"5min":1.248,"15min":1.3260000000000001},"last":0.745},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.02},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.625},"last":0.96799999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.81399999999999995,"15min":0.80500000000000005},"min":{"1min":0.59399999999999997,"5min":0.51400000000000001,"15min":0.48199999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1439999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.82699999999999996,"15min":0.82599999999999996},"min":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.55700000000000005},"max":{"1min":1.095,"5min":1.0980000000000001,"15min":1.196},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.88300000000000001,"15min":0.86799999999999999},"min":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.256},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.048,"5min":1.0900000000000001,"15min":1.24},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.58599999999999997},"max":{"1min":1.05,"5min":1.123,"15min":1.2330000000000001},"last":0.874}]},{"osd":3,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.56699999999999995},"max":{"1min":1.034,"5min":1.127,"15min":1.2589999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.88600000000000001,"15min":0.89200000000000002},"min":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.61399999999999999},"max":{"1min":1.147,"5min":1.226,"15min":1.345},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85399999999999998,"15min":0.86099999999999999},"min":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0840000000000001,"5min":1.1859999999999999,"15min":1.2350000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.90400000000000003,"15min":0.88600000000000001},"min":{"1min":0.73399999999999999,"5min":0.59099999999999997,"15min":0.57399999999999995},"max":{"1min":1.111,"5min":1.256,"15min":1.3380000000000001},"last":1.1499999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.91900000000000004,"15min":0.91000000000000003},"min":{"1min":0.78300000000000003,"5min":0.60099999999999998,"15min":0.59499999999999997},"max":{"1min":1.2410000000000001,"5min":1.288,"15min":1.4370000000000001},"last":1.014},{"interface":"front","average":{"1min":1.024,"5min":0.99399999999999999,"15min":0.99299999999999999},"min":{"1min":0.79600000000000004,"5min":0.67800000000000005,"15min":0.58899999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.3220000000000001},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.749,"5min":0.69999999999999996,"15min":0.65900000000000003},"max":{"1min":1.2549999999999999,"5min":1.3220000000000001,"15min":1.4399999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0169999999999999,"15min":1.032},"min":{"1min":0.71499999999999997,"5min":0.59399999999999997,"15min":0.56699999999999995},"max":{"1min":1.2789999999999999,"5min":1.349,"15min":1.516},"last":1.0680000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.41999999999999998},"max":{"1min":0.81399999999999995,"5min":0.96799999999999997,"15min":1.1100000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.49299999999999999,"5min":0.48199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94799999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.437},"max":{"1min":0.81699999999999995,"5min":1.0680000000000001,"15min":1.1599999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70499999999999996,"15min":0.69199999999999995},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":0.92000000000000004,"5min":1.054,"15min":1.054},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.501},"max":{"1min":0.81799999999999995,"5min":0.97499999999999998,"15min":1.4259999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.752},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.502},"max":{"1min":1.004,"5min":1.004,"15min":1.177},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86899999999999999,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.002,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.71699999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":0.97499999999999998,"5min":1.27,"15min":1.27},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.90200000000000002,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.069,"5min":1.224,"15min":1.5760000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.97099999999999997,"15min":0.97899999999999998},"min":{"1min":0.77800000000000002,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0720000000000001,"5min":1.381,"15min":1.381},"last":1.0329999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.94399999999999995,"15min":0.95599999999999996},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.67400000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.70999999999999996,"5min":0.67900000000000005,"15min":0.64700000000000002},"max":{"1min":1.1719999999999999,"5min":1.3400000000000001,"15min":1.5309999999999999},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.69299999999999995},"max":{"1min":1.1100000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.125},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0169999999999999,"15min":1.03},"min":{"1min":0.80000000000000004,"5min":0.72999999999999998,"15min":0.71799999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.83999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.625,"15min":0.60599999999999998},"min":{"1min":0.46899999999999997,"5min":0.41599999999999998,"15min":0.40500000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.069},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.54900000000000004},"max":{"1min":0.91300000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71199999999999997,"15min":0.70299999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46200000000000002},"max":{"1min":0.96799999999999997,"5min":1.0720000000000001,"15min":1.109},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.746},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.498},"max":{"1min":0.94299999999999995,"5min":1.0269999999999999,"15min":1.169},"last":0.625}]},{"osd":3,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.45400000000000001},"max":{"1min":0.73999999999999999,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.72599999999999998},"min":{"1min":0.55600000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.099},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.91200000000000003,"15min":0.89700000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1659999999999999,"5min":1.1879999999999999,"15min":1.228},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.72699999999999998,"5min":0.68999999999999995,"15min":0.66800000000000004},"max":{"1min":1.103,"5min":1.1639999999999999,"15min":1.1759999999999999},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.84899999999999998},"min":{"1min":0.68300000000000005,"5min":0.66400000000000003,"15min":0.65500000000000003},"max":{"1min":1.0820000000000001,"5min":1.1850000000000001,"15min":1.28},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95399999999999996,"15min":0.93300000000000005},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.63200000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.93700000000000006},"min":{"1min":0.75900000000000001,"5min":0.69599999999999995,"15min":0.66100000000000003},"max":{"1min":1.232,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.755,"5min":0.69599999999999995,"15min":0.68600000000000005},"max":{"1min":1.1499999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.872}]},{"osd":7,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.99299999999999999,"15min":0.97699999999999998},"min":{"1min":0.82699999999999996,"5min":0.77800000000000002,"15min":0.69799999999999995},"max":{"1min":1.3,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.996,"15min":0.97399999999999998},"min":{"1min":0.76300000000000001,"5min":0.73299999999999998,"15min":0.68000000000000005},"max":{"1min":1.208,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.82799999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542994,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.47099999999999997,"5min":0.42099999999999999,"15min":0.41999999999999998},"max":{"1min":0.95899999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.1990000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.33300000000000002},"max":{"1min":0.71399999999999997,"5min":0.88900000000000001,"15min":1.2589999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.71199999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.42699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.147},"last":0.83899999999999997}]},{"osd":3,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.56999999999999995},"max":{"1min":1.004,"5min":1.113,"15min":1.1659999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.68600000000000005,"5min":0.56200000000000006,"15min":0.499},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.1200000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.2789999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.90300000000000002,"15min":0.90600000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.175,"5min":1.296,"15min":1.321},"last":0.627}]},{"osd":5,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.85099999999999998,"15min":0.84899999999999998},"min":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.59299999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.306},"last":0.751},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97299999999999998,"15min":0.95399999999999996},"min":{"1min":0.73699999999999999,"5min":0.66900000000000004,"15min":0.58999999999999997},"max":{"1min":1.492,"5min":1.5389999999999999,"15min":1.5429999999999999},"last":0.88}]},{"osd":6,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.97299999999999998,"15min":0.95699999999999996},"min":{"1min":0.83799999999999997,"5min":0.69199999999999995,"15min":0.627},"max":{"1min":1.262,"5min":1.262,"15min":1.4370000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":0.96899999999999997},"min":{"1min":0.63900000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.2509999999999999,"5min":1.3089999999999999,"15min":1.391},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0509999999999999,"15min":1.0309999999999999},"min":{"1min":0.81200000000000006,"5min":0.68600000000000005,"15min":0.68100000000000005},"max":{"1min":1.4199999999999999,"5min":1.486,"15min":1.486},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0109999999999999,"15min":1.0189999999999999},"min":{"1min":0.874,"5min":0.71199999999999997,"15min":0.68100000000000005},"max":{"1min":1.2010000000000001,"5min":1.468,"15min":1.482},"last":0.92100000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542995,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.41899999999999998,"15min":0.39300000000000002},"max":{"1min":0.84499999999999997,"5min":0.90800000000000003,"15min":1.0009999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.71199999999999997},"min":{"1min":0.64200000000000002,"5min":0.56299999999999994,"15min":0.44500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0109999999999999,"15min":1.0149999999999999},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.89500000000000002,"5min":1.0589999999999999,"15min":1.0640000000000001},"last":0.496},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.46500000000000002},"max":{"1min":0.91800000000000004,"5min":1.0840000000000001,"15min":1.159},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.65200000000000002},"min":{"1min":0.48999999999999999,"5min":0.47199999999999998,"15min":0.40000000000000002},"max":{"1min":1.046,"5min":1.0940000000000001,"15min":1.1759999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.60399999999999998,"5min":0.50700000000000001,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.1120000000000001,"15min":1.1399999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.72899999999999998,"5min":0.67500000000000004,"15min":0.626},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.3759999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.85599999999999998,"15min":0.85899999999999999},"min":{"1min":0.71599999999999997,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.1120000000000001,"5min":1.119,"15min":1.325},"last":0.91100000000000003}]},{"osd":5,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86099999999999999,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.65700000000000003,"15min":0.64300000000000002},"max":{"1min":1.0229999999999999,"5min":1.1080000000000001,"15min":1.4370000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.94499999999999995},"min":{"1min":0.71499999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.181,"5min":1.4350000000000001,"15min":1.4930000000000001},"last":1.077}]},{"osd":6,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97699999999999998,"15min":0.98499999999999999},"min":{"1min":0.80300000000000005,"5min":0.74199999999999999,"15min":0.67600000000000005},"max":{"1min":1.2370000000000001,"5min":1.3779999999999999,"15min":1.571},"last":1.014},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.98499999999999999,"15min":0.98999999999999999},"min":{"1min":0.83299999999999996,"5min":0.74199999999999999,"15min":0.65100000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.401},"last":0.877}]},{"osd":7,"last update":"Thu Oct 21 00:29:34 2021","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.98199999999999998,"15min":0.996},"min":{"1min":0.90700000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.48},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.97399999999999998,"15min":0.97899999999999998},"min":{"1min":0.82399999999999995,"5min":0.76600000000000001,"15min":0.73999999999999999},"max":{"1min":1.157,"5min":1.26,"15min":1.498},"last":1.0009999999999999}]}]}]}} 2021-10-21T00:30:25.504 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-10-20T23:19:40.954153+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=20, tm_hour=23, tm_min=19, tm_sec=40, tm_wday=2, tm_yday=293, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:30:25.504 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-10-20T23:19:49.012161+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=20, tm_hour=23, tm_min=19, tm_sec=49, tm_wday=2, tm_yday=293, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:30:25.505 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-10-20T23:19:49.012161+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=20, tm_hour=23, tm_min=19, tm_sec=49, tm_wday=2, tm_yday=293, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:30:25.506 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-10-20T23:19:49.012161+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=20, tm_hour=23, tm_min=19, tm_sec=49, tm_wday=2, tm_yday=293, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:30:25.507 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-10-20T23:19:49.012161+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=20, tm_hour=23, tm_min=19, tm_sec=49, tm_wday=2, tm_yday=293, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:30:25.508 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-10-20T23:19:49.012161+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=20, tm_hour=23, tm_min=19, tm_sec=49, tm_wday=2, tm_yday=293, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:30:25.508 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-10-20T23:19:49.012161+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=20, tm_hour=23, tm_min=19, tm_sec=49, tm_wday=2, tm_yday=293, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:30:25.509 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-10-21T00:30:45.511 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-21T00:30:45.627 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.613+0000 7fc8bd98e700 1 Processor -- start 2021-10-21T00:30:45.628 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.613+0000 7fc8bd98e700 1 -- start start 2021-10-21T00:30:45.629 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8b80b2200 0x7fc8b80abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 0x7fc8b80ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80ac7e0 con 0x7fc8b81416a0 2021-10-21T00:30:45.630 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b8145250 con 0x7fc8b80b2200 2021-10-21T00:30:45.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b81454f0 con 0x7fc8b80affd0 2021-10-21T00:30:45.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8b80b2200 0x7fc8b80abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.631 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8b80b2200 0x7fc8b80abe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46648/0 (socket says 172.21.15.12:46648) 2021-10-21T00:30:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b6ffd700 1 -- 172.21.15.12:0/31969513 learned_addr learned my addr 172.21.15.12:0/31969513 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b67fc700 1 --2- 172.21.15.12:0/31969513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 0x7fc8b80ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b6ffd700 1 -- 172.21.15.12:0/31969513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 msgr2=0x7fc8b80ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:45.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b6ffd700 1 --2- 172.21.15.12:0/31969513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 0x7fc8b80ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b6ffd700 1 -- 172.21.15.12:0/31969513 >> v1:172.21.15.31:6789/0 conn(0x7fc8b81416a0 legacy=0x7fc8b8141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:45.633 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b6ffd700 1 -- 172.21.15.12:0/31969513 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8141200 con 0x7fc8b80b2200 2021-10-21T00:30:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b67fc700 1 --2- 172.21.15.12:0/31969513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 0x7fc8b80ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:30:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b6ffd700 1 --2- 172.21.15.12:0/31969513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 0x7fc8b80abe00 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7fc8b80afc90 tx=0x7fc8b0009290).ready entity=mon.0 client_cookie=41ad5c4cb2591d94 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b5ffb700 1 -- 172.21.15.12:0/31969513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8b000b830 con 0x7fc8b80b2200 2021-10-21T00:30:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b5ffb700 1 -- 172.21.15.12:0/31969513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b000b990 con 0x7fc8b80b2200 2021-10-21T00:30:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8b5ffb700 1 -- 172.21.15.12:0/31969513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8b000bb00 con 0x7fc8b80b2200 2021-10-21T00:30:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 -- 172.21.15.12:0/31969513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 msgr2=0x7fc8b80abe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 --2- 172.21.15.12:0/31969513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 0x7fc8b80abe00 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7fc8b80afc90 tx=0x7fc8b0009290).stop 2021-10-21T00:30:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 -- 172.21.15.12:0/31969513 shutdown_connections 2021-10-21T00:30:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 --2- 172.21.15.12:0/31969513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 0x7fc8b80ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 --2- 172.21.15.12:0/31969513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 0x7fc8b80abe00 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 -- 172.21.15.12:0/31969513 >> 172.21.15.12:0/31969513 conn(0x7fc8b805f6b0 msgr2=0x7fc8b805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 -- 172.21.15.12:0/31969513 shutdown_connections 2021-10-21T00:30:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.617+0000 7fc8bd98e700 1 -- 172.21.15.12:0/31969513 wait complete. 2021-10-21T00:30:45.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.621+0000 7fc8bd98e700 1 Processor -- start 2021-10-21T00:30:45.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.621+0000 7fc8bd98e700 1 -- start start 2021-10-21T00:30:45.644 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.621+0000 7fc8bd98e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 0x7fc8b8153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.621+0000 7fc8bd98e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 0x7fc8b813d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.621+0000 7fc8bd98e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8b81416a0 0x7fc8b8138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.621+0000 7fc8bd98e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b8154650 con 0x7fc8b80b2200 2021-10-21T00:30:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.621+0000 7fc8bd98e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b81548f0 con 0x7fc8b81416a0 2021-10-21T00:30:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.621+0000 7fc8bd98e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b813d180 con 0x7fc8b80affd0 2021-10-21T00:30:45.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 0x7fc8b813d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 0x7fc8b813d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46656/0 (socket says 172.21.15.12:46656) 2021-10-21T00:30:45.648 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b67fc700 1 -- 172.21.15.12:0/3563905148 learned_addr learned my addr 172.21.15.12:0/3563905148 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:45.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b6ffd700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 0x7fc8b8153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b77fe700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8b81416a0 0x7fc8b8138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.649 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b67fc700 1 -- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 msgr2=0x7fc8b8153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:45.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b67fc700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 0x7fc8b8153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b67fc700 1 -- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8b81416a0 msgr2=0x7fc8b8138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:45.650 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b67fc700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8b81416a0 0x7fc8b8138430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b67fc700 1 -- 172.21.15.12:0/3563905148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0009530 con 0x7fc8b80b2200 2021-10-21T00:30:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8b67fc700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 0x7fc8b813d670 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fc8a0007000 tx=0x7fc8a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8affff700 1 -- 172.21.15.12:0/3563905148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8a0010580 con 0x7fc8b80b2200 2021-10-21T00:30:45.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8affff700 1 -- 172.21.15.12:0/3563905148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a00106e0 con 0x7fc8b80b2200 2021-10-21T00:30:45.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b8154300 con 0x7fc8b80b2200 2021-10-21T00:30:45.652 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8affff700 1 -- 172.21.15.12:0/3563905148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8a0010a40 con 0x7fc8b80b2200 2021-10-21T00:30:45.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b813be90 con 0x7fc8b80b2200 2021-10-21T00:30:45.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8affff700 1 -- 172.21.15.12:0/3563905148 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc8a0010ba0 con 0x7fc8b80b2200 2021-10-21T00:30:45.653 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b8057350 con 0x7fc8b80b2200 2021-10-21T00:30:45.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8affff700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc89c0534f0 0x7fc89c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.625+0000 7fc8affff700 1 -- 172.21.15.12:0/3563905148 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc8a006b8a0 con 0x7fc8b80b2200 2021-10-21T00:30:45.654 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.629+0000 7fc8b6ffd700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc89c0534f0 0x7fc89c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.655 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.629+0000 7fc8b6ffd700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc89c0534f0 0x7fc89c0559b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fc8b001b000 tx=0x7fc8b0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:45.656 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.633+0000 7fc8affff700 1 -- 172.21.15.12:0/3563905148 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc8a0042a80 con 0x7fc8b80b2200 2021-10-21T00:30:45.767 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.753+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 --> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8b813d3a0 con 0x7fc89c0534f0 2021-10-21T00:30:45.774 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.761+0000 7fc8affff700 1 -- 172.21.15.12:0/3563905148 <== mgr.4105 v2:172.21.15.31:6800/14444 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68694 (secure 0 0 0) 0x7fc8b813d3a0 con 0x7fc89c0534f0 2021-10-21T00:30:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2021-10-21T00:30:45.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc89c0534f0 msgr2=0x7fc89c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:45.780 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc89c0534f0 0x7fc89c0559b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fc8b001b000 tx=0x7fc8b0016000).stop 2021-10-21T00:30:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 msgr2=0x7fc8b813d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 0x7fc8b813d670 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fc8a0007000 tx=0x7fc8a0008040).stop 2021-10-21T00:30:45.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 shutdown_connections 2021-10-21T00:30:45.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc89c0534f0 0x7fc89c0559b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.782 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8b81416a0 0x7fc8b8138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8b80b2200 0x7fc8b813d670 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.783 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 --2- 172.21.15.12:0/3563905148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8b80affd0 0x7fc8b8153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 >> 172.21.15.12:0/3563905148 conn(0x7fc8b805f6b0 msgr2=0x7fc8b8139cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:45.784 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 shutdown_connections 2021-10-21T00:30:45.785 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.765+0000 7fc8bd98e700 1 -- 172.21.15.12:0/3563905148 wait complete. 2021-10-21T00:30:45.785 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2021-10-21T00:30:45.794 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":2289,"stamp":"2021-10-21T00:30:45.161815+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8405152,"kb_used_data":16480,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569568,"statfs":{"total":773094113280,"available":764487237632,"internally_reserved":8589934592,"allocated":16875520,"data_stored":8249624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003412"},"pg_stats":[{"pgid":"1.0","version":"166'6","reported_seq":154,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:26.118125+0000","last_change":"2021-10-21T00:30:26.118376+0000","last_active":"2021-10-21T00:30:26.118125+0000","last_peered":"2021-10-21T00:30:26.118125+0000","last_clean":"2021-10-21T00:30:26.118125+0000","last_became_active":"2021-10-20T23:19:45.231374+0000","last_became_peered":"2021-10-20T23:19:45.231374+0000","last_unstale":"2021-10-21T00:30:26.118125+0000","last_undegraded":"2021-10-21T00:30:26.118125+0000","last_fullsized":"2021-10-21T00:30:26.118125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'6","last_scrub_stamp":"2021-10-21T00:30:26.118124+0000","last_deep_scrub":"166'6","last_deep_scrub_stamp":"2021-10-21T00:30:26.118124+0000","last_clean_scrub_stamp":"2021-10-21T00:30:26.118124+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19376,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":147,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:32.477968+0000","last_change":"2021-10-21T00:30:32.478198+0000","last_active":"2021-10-21T00:30:32.477968+0000","last_peered":"2021-10-21T00:30:32.477968+0000","last_clean":"2021-10-21T00:30:32.477968+0000","last_became_active":"2021-10-20T23:19:50.050295+0000","last_became_peered":"2021-10-20T23:19:50.050295+0000","last_unstale":"2021-10-21T00:30:32.477968+0000","last_undegraded":"2021-10-21T00:30:32.477968+0000","last_fullsized":"2021-10-21T00:30:32.477968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:32.477967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:32.477967+0000","last_clean_scrub_stamp":"2021-10-21T00:30:32.477967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:29.090015+0000","last_change":"2021-10-21T00:30:29.090248+0000","last_active":"2021-10-21T00:30:29.090015+0000","last_peered":"2021-10-21T00:30:29.090015+0000","last_clean":"2021-10-21T00:30:29.090015+0000","last_became_active":"2021-10-20T23:19:50.051189+0000","last_became_peered":"2021-10-20T23:19:50.051189+0000","last_unstale":"2021-10-21T00:30:29.090015+0000","last_undegraded":"2021-10-21T00:30:29.090015+0000","last_fullsized":"2021-10-21T00:30:29.090015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:29.090014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:29.090014+0000","last_clean_scrub_stamp":"2021-10-21T00:30:29.090014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:25.665371+0000","last_change":"2021-10-21T00:30:25.665518+0000","last_active":"2021-10-21T00:30:25.665371+0000","last_peered":"2021-10-21T00:30:25.665371+0000","last_clean":"2021-10-21T00:30:25.665371+0000","last_became_active":"2021-10-20T23:19:50.049970+0000","last_became_peered":"2021-10-20T23:19:50.049970+0000","last_unstale":"2021-10-21T00:30:25.665371+0000","last_undegraded":"2021-10-21T00:30:25.665371+0000","last_fullsized":"2021-10-21T00:30:25.665371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:25.665371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:25.665371+0000","last_clean_scrub_stamp":"2021-10-21T00:30:25.665371+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":147,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:28.582057+0000","last_change":"2021-10-21T00:30:28.582256+0000","last_active":"2021-10-21T00:30:28.582057+0000","last_peered":"2021-10-21T00:30:28.582057+0000","last_clean":"2021-10-21T00:30:28.582057+0000","last_became_active":"2021-10-20T23:19:50.052290+0000","last_became_peered":"2021-10-20T23:19:50.052290+0000","last_unstale":"2021-10-21T00:30:28.582057+0000","last_undegraded":"2021-10-21T00:30:28.582057+0000","last_fullsized":"2021-10-21T00:30:28.582057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:28.582056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:28.582056+0000","last_clean_scrub_stamp":"2021-10-21T00:30:28.582056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":150,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:22.599383+0000","last_change":"2021-10-21T00:30:22.599624+0000","last_active":"2021-10-21T00:30:22.599383+0000","last_peered":"2021-10-21T00:30:22.599383+0000","last_clean":"2021-10-21T00:30:22.599383+0000","last_became_active":"2021-10-20T23:19:50.195815+0000","last_became_peered":"2021-10-20T23:19:50.195815+0000","last_unstale":"2021-10-21T00:30:22.599383+0000","last_undegraded":"2021-10-21T00:30:22.599383+0000","last_fullsized":"2021-10-21T00:30:22.599383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:22.599382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:22.599382+0000","last_clean_scrub_stamp":"2021-10-21T00:30:22.599382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:34.190275+0000","last_change":"2021-10-21T00:30:34.190361+0000","last_active":"2021-10-21T00:30:34.190275+0000","last_peered":"2021-10-21T00:30:34.190275+0000","last_clean":"2021-10-21T00:30:34.190275+0000","last_became_active":"2021-10-20T23:19:50.198735+0000","last_became_peered":"2021-10-20T23:19:50.198735+0000","last_unstale":"2021-10-21T00:30:34.190275+0000","last_undegraded":"2021-10-21T00:30:34.190275+0000","last_fullsized":"2021-10-21T00:30:34.190275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:34.190275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:34.190275+0000","last_clean_scrub_stamp":"2021-10-21T00:30:34.190275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:23.573652+0000","last_change":"2021-10-21T00:30:23.573763+0000","last_active":"2021-10-21T00:30:23.573652+0000","last_peered":"2021-10-21T00:30:23.573652+0000","last_clean":"2021-10-21T00:30:23.573652+0000","last_became_active":"2021-10-20T23:19:50.046787+0000","last_became_peered":"2021-10-20T23:19:50.046787+0000","last_unstale":"2021-10-21T00:30:23.573652+0000","last_undegraded":"2021-10-21T00:30:23.573652+0000","last_fullsized":"2021-10-21T00:30:23.573652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:23.573651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:23.573651+0000","last_clean_scrub_stamp":"2021-10-21T00:30:23.573651+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-10-21T00:30:24.815233+0000","last_change":"2021-10-21T00:30:24.815323+0000","last_active":"2021-10-21T00:30:24.815233+0000","last_peered":"2021-10-21T00:30:24.815233+0000","last_clean":"2021-10-21T00:30:24.815233+0000","last_became_active":"2021-10-20T23:19:50.049434+0000","last_became_peered":"2021-10-20T23:19:50.049434+0000","last_unstale":"2021-10-21T00:30:24.815233+0000","last_undegraded":"2021-10-21T00:30:24.815233+0000","last_fullsized":"2021-10-21T00:30:24.815233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:30:24.815233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:30:24.815233+0000","last_clean_scrub_stamp":"2021-10-21T00:30:24.815233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542998,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81799999999999995,"15min":0.81299999999999994},"min":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.51700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.27},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50700000000000001},"max":{"1min":1.0920000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0429999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.137,"5min":1.1919999999999999,"15min":1.2589999999999999},"last":0.93600000000000005}]},{"osd":2,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.87},"min":{"1min":0.62,"5min":0.61699999999999999,"15min":0.59399999999999997},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.325},"last":0.996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.85599999999999998,"15min":0.84699999999999998},"min":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58199999999999996},"max":{"1min":1.073,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82899999999999996,"15min":0.82599999999999996},"min":{"1min":0.65200000000000002,"5min":0.65100000000000002,"15min":0.56000000000000005},"max":{"1min":1.115,"5min":1.119,"15min":1.1220000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.93200000000000005,"15min":0.93300000000000005},"min":{"1min":0.71699999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1379999999999999,"5min":1.1619999999999999,"15min":1.3620000000000001},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86799999999999999,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0409999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88200000000000001,"15min":0.88300000000000001},"min":{"1min":0.71199999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.032,"5min":1.1279999999999999,"15min":1.216},"last":1.024}]},{"osd":5,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.53600000000000003},"max":{"1min":1.109,"5min":1.258,"15min":1.4419999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.97899999999999998,"15min":0.96399999999999997},"min":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.58799999999999997},"max":{"1min":1.167,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Oct 21 00:29:46 2021","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.81200000000000006,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.165,"5min":1.381,"15min":1.4450000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.97899999999999998,"15min":0.96699999999999997},"min":{"1min":0.82799999999999996,"5min":0.70399999999999996,"15min":0.66300000000000003},"max":{"1min":1.2629999999999999,"5min":1.288,"15min":1.3220000000000001},"last":0.88400000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542998,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79900000000000004,"15min":0.80300000000000005},"min":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0029999999999999,"5min":1.1379999999999999,"15min":1.268},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81100000000000005,"15min":0.82499999999999996},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.093,"5min":1.179,"15min":1.179},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.875},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.85799999999999998,"15min":0.84399999999999997},"min":{"1min":0.67100000000000004,"5min":0.59899999999999998,"15min":0.54600000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84099999999999997,"15min":0.83299999999999996},"min":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0980000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"max":{"1min":1.0880000000000001,"5min":1.2030000000000001,"15min":1.2070000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.65600000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.081,"5min":1.1919999999999999,"15min":1.222},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.61399999999999999},"max":{"1min":1.125,"5min":1.1619999999999999,"15min":1.3660000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.80600000000000005,"15min":0.82899999999999996},"min":{"1min":0.64400000000000002,"5min":0.54200000000000004,"15min":0.47299999999999998},"max":{"1min":1.0700000000000001,"5min":1.264,"15min":1.264},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.872,"5min":0.88400000000000001,"15min":0.90200000000000002},"min":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.115,"5min":1.1859999999999999,"15min":1.3029999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88400000000000001,"15min":0.876},"min":{"1min":0.67700000000000005,"5min":0.60899999999999999,"15min":0.56499999999999995},"max":{"1min":1.089,"5min":1.236,"15min":1.4430000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.67800000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.234,"15min":1.2769999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Oct 21 00:29:58 2021","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95399999999999996,"15min":0.97199999999999998},"min":{"1min":0.70299999999999996,"5min":0.64900000000000002,"15min":0.629},"max":{"1min":1.1519999999999999,"5min":1.335,"15min":1.335},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.016,"5min":1.0149999999999999,"15min":1.006},"min":{"1min":0.80200000000000005,"5min":0.71599999999999997,"15min":0.64200000000000002},"max":{"1min":1.1819999999999999,"5min":1.365,"15min":1.5},"last":0.81100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542998,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.503},"max":{"1min":0.94599999999999995,"5min":0.98999999999999999,"15min":1.1080000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77300000000000002,"15min":0.76100000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.48599999999999999},"max":{"1min":0.97099999999999997,"5min":1.081,"15min":1.2729999999999999},"last":0.89500000000000002}]},{"osd":1,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86699999999999999,"15min":0.85699999999999998},"min":{"1min":0.75,"5min":0.52600000000000002,"15min":0.47799999999999998},"max":{"1min":1.0149999999999999,"5min":1.1539999999999999,"15min":1.2330000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.86199999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.58099999999999996},"max":{"1min":1.1220000000000001,"5min":1.1279999999999999,"15min":1.3240000000000001},"last":0.92300000000000004}]},{"osd":2,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90300000000000002,"15min":0.91800000000000004},"min":{"1min":0.68200000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.016,"5min":1.1930000000000001,"15min":1.5449999999999999},"last":1.022},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.74099999999999999,"5min":0.60899999999999999,"15min":0.55900000000000005},"max":{"1min":1.02,"5min":1.212,"15min":1.224},"last":0.95299999999999996}]},{"osd":3,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84399999999999997,"15min":0.83799999999999997},"min":{"1min":0.624,"5min":0.60399999999999998,"15min":0.60199999999999998},"max":{"1min":1.03,"5min":1.1000000000000001,"15min":1.1359999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95499999999999996,"15min":0.94999999999999996},"min":{"1min":0.79100000000000004,"5min":0.65600000000000003,"15min":0.63500000000000001},"max":{"1min":1.0780000000000001,"5min":1.2030000000000001,"15min":1.5860000000000001},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81299999999999994,"15min":0.79800000000000004},"min":{"1min":0.52600000000000002,"5min":0.51600000000000001,"15min":0.51300000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.25},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.99199999999999999,"15min":0.98699999999999999},"min":{"1min":0.68100000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.367},"last":1.159}]},{"osd":6,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.878,"15min":0.879},"min":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4490000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":0.90100000000000002},"min":{"1min":0.629,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.071,"5min":1.145,"15min":1.325},"last":0.995}]},{"osd":7,"last update":"Thu Oct 21 00:30:17 2021","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.95999999999999996,"15min":0.93500000000000005},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.58699999999999997},"max":{"1min":1.163,"5min":1.248,"15min":1.3260000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.02},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.625},"last":1.2170000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.81399999999999995,"15min":0.80500000000000005},"min":{"1min":0.59399999999999997,"5min":0.51400000000000001,"15min":0.48199999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1439999999999999},"last":0.755},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.82699999999999996,"15min":0.82599999999999996},"min":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.97299999999999998}]},{"osd":1,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.55700000000000005},"max":{"1min":1.095,"5min":1.0980000000000001,"15min":1.196},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.88300000000000001,"15min":0.86799999999999999},"min":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.256},"last":1.145}]},{"osd":2,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.048,"5min":1.0900000000000001,"15min":1.24},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.58599999999999997},"max":{"1min":1.05,"5min":1.123,"15min":1.2330000000000001},"last":1.0940000000000001}]},{"osd":3,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.56699999999999995},"max":{"1min":1.034,"5min":1.127,"15min":1.2589999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.87,"5min":0.88600000000000001,"15min":0.89200000000000002},"min":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.61399999999999999},"max":{"1min":1.147,"5min":1.226,"15min":1.345},"last":1.024}]},{"osd":5,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85399999999999998,"15min":0.86099999999999999},"min":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0840000000000001,"5min":1.1859999999999999,"15min":1.2350000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.90400000000000003,"15min":0.88600000000000001},"min":{"1min":0.73399999999999999,"5min":0.59099999999999997,"15min":0.57399999999999995},"max":{"1min":1.111,"5min":1.256,"15min":1.3380000000000001},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.91900000000000004,"15min":0.91000000000000003},"min":{"1min":0.78300000000000003,"5min":0.60099999999999998,"15min":0.59499999999999997},"max":{"1min":1.2410000000000001,"5min":1.288,"15min":1.4370000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.024,"5min":0.99399999999999999,"15min":0.99299999999999999},"min":{"1min":0.79600000000000004,"5min":0.67800000000000005,"15min":0.58899999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.3220000000000001},"last":1.1890000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:29:59 2021","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.749,"5min":0.69999999999999996,"15min":0.65900000000000003},"max":{"1min":1.2549999999999999,"5min":1.3220000000000001,"15min":1.4399999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0169999999999999,"15min":1.032},"min":{"1min":0.71499999999999997,"5min":0.59399999999999997,"15min":0.56699999999999995},"max":{"1min":1.2789999999999999,"5min":1.349,"15min":1.516},"last":0.93700000000000006}]}]},{"osd":3,"up_from":14,"seq":60129542998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.41999999999999998},"max":{"1min":0.81399999999999995,"5min":0.96799999999999997,"15min":1.1100000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.49299999999999999,"5min":0.48199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94799999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.437},"max":{"1min":0.81699999999999995,"5min":1.0680000000000001,"15min":1.1599999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70499999999999996,"15min":0.69199999999999995},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":0.92000000000000004,"5min":1.054,"15min":1.054},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.501},"max":{"1min":0.81799999999999995,"5min":0.97499999999999998,"15min":1.4259999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.752},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.502},"max":{"1min":1.004,"5min":1.004,"15min":1.177},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86899999999999999,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.002,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.71699999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":0.97499999999999998,"5min":1.27,"15min":1.27},"last":0.874}]},{"osd":5,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.90200000000000002,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.069,"5min":1.224,"15min":1.5760000000000001},"last":1.286},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.97099999999999997,"15min":0.97899999999999998},"min":{"1min":0.77800000000000002,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0720000000000001,"5min":1.381,"15min":1.381},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.94399999999999995,"15min":0.95599999999999996},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.67400000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.70999999999999996,"5min":0.67900000000000005,"15min":0.64700000000000002},"max":{"1min":1.1719999999999999,"5min":1.3400000000000001,"15min":1.5309999999999999},"last":1.2050000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:30:16 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.69299999999999995},"max":{"1min":1.1100000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0169999999999999,"15min":1.03},"min":{"1min":0.80000000000000004,"5min":0.72999999999999998,"15min":0.71799999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0589999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542998,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.625,"15min":0.60599999999999998},"min":{"1min":0.46899999999999997,"5min":0.41599999999999998,"15min":0.40500000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.069},"last":0.439},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.54900000000000004},"max":{"1min":0.91300000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71199999999999997,"15min":0.70299999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46200000000000002},"max":{"1min":0.96799999999999997,"5min":1.0720000000000001,"15min":1.109},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.746},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.498},"max":{"1min":0.94299999999999995,"5min":1.0269999999999999,"15min":1.169},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.45400000000000001},"max":{"1min":0.73999999999999999,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.72599999999999998},"min":{"1min":0.55600000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.099},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.91200000000000003,"15min":0.89700000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1659999999999999,"5min":1.1879999999999999,"15min":1.228},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.72699999999999998,"5min":0.68999999999999995,"15min":0.66800000000000004},"max":{"1min":1.103,"5min":1.1639999999999999,"15min":1.1759999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.84899999999999998},"min":{"1min":0.68300000000000005,"5min":0.66400000000000003,"15min":0.65500000000000003},"max":{"1min":1.0820000000000001,"5min":1.1850000000000001,"15min":1.28},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95399999999999996,"15min":0.93300000000000005},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.63200000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.93700000000000006},"min":{"1min":0.75900000000000001,"5min":0.69599999999999995,"15min":0.66100000000000003},"max":{"1min":1.232,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.755,"5min":0.69599999999999995,"15min":0.68600000000000005},"max":{"1min":1.1499999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Oct 21 00:30:19 2021","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.99299999999999999,"15min":0.97699999999999998},"min":{"1min":0.82699999999999996,"5min":0.77800000000000002,"15min":0.69799999999999995},"max":{"1min":1.3,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.996,"15min":0.97399999999999998},"min":{"1min":0.76300000000000001,"5min":0.73299999999999998,"15min":0.68000000000000005},"max":{"1min":1.208,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.73599999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542998,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:30:38 2021","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.621,"15min":0.64900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.1990000000000001},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Oct 21 00:30:38 2021","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.47099999999999997,"5min":0.44800000000000001,"15min":0.33300000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.2589999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.42699999999999999},"max":{"1min":0.90900000000000003,"5min":1.0449999999999999,"15min":1.147},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Oct 21 00:30:38 2021","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81899999999999995,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.60399999999999998,"15min":0.56999999999999995},"max":{"1min":1.079,"5min":1.113,"15min":1.1659999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.62,"5min":0.56200000000000006,"15min":0.499},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.1200000000000001},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Oct 21 00:30:38 2021","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.70699999999999996,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.627,"5min":0.502,"15min":0.502},"max":{"1min":1.1100000000000001,"5min":1.296,"15min":1.321},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Oct 21 00:30:38 2021","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85799999999999998,"15min":0.84999999999999998},"min":{"1min":0.73199999999999998,"5min":0.61899999999999999,"15min":0.59299999999999997},"max":{"1min":1.1839999999999999,"5min":1.292,"15min":1.306},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96899999999999997,"15min":0.95299999999999996},"min":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.58999999999999997},"max":{"1min":1.1259999999999999,"5min":1.5389999999999999,"15min":1.5429999999999999},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Oct 21 00:30:38 2021","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.95499999999999996,"15min":0.95099999999999996},"min":{"1min":0.73199999999999998,"5min":0.69199999999999995,"15min":0.627},"max":{"1min":1.276,"5min":1.276,"15min":1.4370000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96999999999999997,"15min":0.96699999999999997},"min":{"1min":0.79400000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.389},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Oct 21 00:30:38 2021","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0429999999999999,"15min":1.0269999999999999},"min":{"1min":0.76900000000000002,"5min":0.68600000000000005,"15min":0.68100000000000005},"max":{"1min":1.0820000000000001,"5min":1.486,"15min":1.486},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1,"15min":1.014},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.68100000000000005},"max":{"1min":1.2170000000000001,"5min":1.468,"15min":1.482},"last":0.879}]}]},{"osd":0,"up_from":14,"seq":60129542999,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050644,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321196,"statfs":{"total":96636764160,"available":95560904704,"internally_reserved":1073741824,"allocated":2109440,"data_stored":1031203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 21 00:30:36 2021","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60599999999999998,"15min":0.61699999999999999},"min":{"1min":0.46500000000000002,"5min":0.41899999999999998,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":0.90800000000000003,"15min":1.0009999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72899999999999998,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93000000000000005,"5min":1.002,"15min":1.0149999999999999},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Oct 21 00:30:36 2021","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46200000000000002},"max":{"1min":0.79900000000000004,"5min":1.0589999999999999,"15min":1.0640000000000001},"last":1.071},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66900000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.80000000000000004,"5min":0.94799999999999995,"15min":1.159},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Oct 21 00:30:36 2021","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.48899999999999999,"5min":0.47199999999999998,"15min":0.40000000000000002},"max":{"1min":0.95899999999999996,"5min":1.0940000000000001,"15min":1.1759999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.56000000000000005,"5min":0.50700000000000001,"15min":0.45500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0820000000000001,"15min":1.1399999999999999},"last":0.751}]},{"osd":4,"last update":"Thu Oct 21 00:30:36 2021","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88600000000000001,"15min":0.88900000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0449999999999999,"5min":1.2470000000000001,"15min":1.3759999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.59199999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.325},"last":1.004}]},{"osd":5,"last update":"Thu Oct 21 00:30:36 2021","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84599999999999997,"15min":0.86599999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.64300000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93999999999999995,"15min":0.94199999999999995},"min":{"1min":0.75800000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1499999999999999,"5min":1.4350000000000001,"15min":1.4930000000000001},"last":1.137}]},{"osd":6,"last update":"Thu Oct 21 00:30:36 2021","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.97799999999999998,"15min":0.98099999999999998},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.67600000000000005},"max":{"1min":1.204,"5min":1.3779999999999999,"15min":1.571},"last":1.286},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98599999999999999,"15min":0.98699999999999999},"min":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.65100000000000002},"max":{"1min":1.1950000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:30:36 2021","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98799999999999999,"15min":0.995},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1870000000000001,"5min":1.343,"15min":1.4199999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":0.97699999999999998},"min":{"1min":0.79300000000000004,"5min":0.79000000000000004,"15min":0.73999999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.498},"last":1.113}]}]}]}} 2021-10-21T00:30:45.800 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-10-21T00:30:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 Processor -- start 2021-10-21T00:30:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 -- start start 2021-10-21T00:30:45.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b29a0 0x7fc5200b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.918 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc5200b59f0 0x7fc5200ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc52013ff70 0x7fc5200b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200aeb30 con 0x7fc5200b59f0 2021-10-21T00:30:45.919 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200ae890 con 0x7fc52013ff70 2021-10-21T00:30:45.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52013f830 con 0x7fc5200b29a0 2021-10-21T00:30:45.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc5200b59f0 0x7fc5200ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.920 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc5200b59f0 0x7fc5200ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46662/0 (socket says 172.21.15.12:46662) 2021-10-21T00:30:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51effd700 1 -- 172.21.15.12:0/1646141638 learned_addr learned my addr 172.21.15.12:0/1646141638 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51ffff700 1 --2- 172.21.15.12:0/1646141638 >> v2:172.21.15.31:3300/0 conn(0x7fc52013ff70 0x7fc5200b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51f7fe700 1 --2- 172.21.15.12:0/1646141638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b29a0 0x7fc5200b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51effd700 1 -- 172.21.15.12:0/1646141638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b29a0 msgr2=0x7fc5200b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:45.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51effd700 1 --2- 172.21.15.12:0/1646141638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b29a0 0x7fc5200b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.922 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51effd700 1 -- 172.21.15.12:0/1646141638 >> v2:172.21.15.31:3300/0 conn(0x7fc52013ff70 msgr2=0x7fc5200b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:30:45.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51effd700 1 --2- 172.21.15.12:0/1646141638 >> v2:172.21.15.31:3300/0 conn(0x7fc52013ff70 0x7fc5200b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51effd700 1 -- 172.21.15.12:0/1646141638 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52013fad0 con 0x7fc5200b59f0 2021-10-21T00:30:45.923 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51effd700 1 --2- 172.21.15.12:0/1646141638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b59f0 0x7fc5200ae030 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fc514002f70 tx=0x7fc514006e40).ready entity=mon.0 client_cookie=18f2cb5b743ef631 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51e7fc700 1 -- 172.21.15.12:0/1646141638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc51400bcf0 con 0x7fc5200b59f0 2021-10-21T00:30:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51e7fc700 1 -- 172.21.15.12:0/1646141638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc514000e90 con 0x7fc5200b59f0 2021-10-21T00:30:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc51e7fc700 1 -- 172.21.15.12:0/1646141638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5140155e0 con 0x7fc5200b59f0 2021-10-21T00:30:45.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 -- 172.21.15.12:0/1646141638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b59f0 msgr2=0x7fc5200ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:45.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.901+0000 7fc525deb700 1 --2- 172.21.15.12:0/1646141638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b59f0 0x7fc5200ae030 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fc514002f70 tx=0x7fc514006e40).stop 2021-10-21T00:30:45.925 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 -- 172.21.15.12:0/1646141638 shutdown_connections 2021-10-21T00:30:45.926 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 --2- 172.21.15.12:0/1646141638 >> v2:172.21.15.31:3300/0 conn(0x7fc52013ff70 0x7fc5200b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.927 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 --2- 172.21.15.12:0/1646141638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b59f0 0x7fc5200ae030 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 --2- 172.21.15.12:0/1646141638 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b29a0 0x7fc5200b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 -- 172.21.15.12:0/1646141638 >> 172.21.15.12:0/1646141638 conn(0x7fc52006a110 msgr2=0x7fc52005cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:45.929 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 -- 172.21.15.12:0/1646141638 shutdown_connections 2021-10-21T00:30:45.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 -- 172.21.15.12:0/1646141638 wait complete. 2021-10-21T00:30:45.930 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 Processor -- start 2021-10-21T00:30:45.931 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 -- start start 2021-10-21T00:30:45.936 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b29a0 0x7fc52013bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b59f0 0x7fc52014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc52013ff70 0x7fc5200664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52014f0f0 con 0x7fc5200b29a0 2021-10-21T00:30:45.939 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52013b160 con 0x7fc52013ff70 2021-10-21T00:30:45.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc525deb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc520063af0 con 0x7fc5200b59f0 2021-10-21T00:30:45.940 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc51f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b29a0 0x7fc52013bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.941 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc51f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b29a0 0x7fc52013bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46668/0 (socket says 172.21.15.12:46668) 2021-10-21T00:30:45.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc51f7fe700 1 -- 172.21.15.12:0/3157686802 learned_addr learned my addr 172.21.15.12:0/3157686802 (peer_addr_for_me v2:172.21.15.12:0/0) 2021-10-21T00:30:45.942 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc51effd700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b59f0 0x7fc52014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.943 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.905+0000 7fc51ffff700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc52013ff70 0x7fc5200664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51f7fe700 1 -- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b59f0 msgr2=0x7fc52014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:45.944 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51f7fe700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b59f0 0x7fc52014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51f7fe700 1 -- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc52013ff70 msgr2=0x7fc5200664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:45.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51f7fe700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc52013ff70 0x7fc5200664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:45.945 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51f7fe700 1 -- 172.21.15.12:0/3157686802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51400d4d0 con 0x7fc5200b29a0 2021-10-21T00:30:45.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51effd700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b59f0 0x7fc52014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:30:45.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51ffff700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc52013ff70 0x7fc5200664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:30:45.946 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51f7fe700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b29a0 0x7fc52013bdc0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fc5100030b0 tx=0x7fc510008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:45.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51cff9700 1 -- 172.21.15.12:0/3157686802 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc510011780 con 0x7fc5200b29a0 2021-10-21T00:30:45.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51cff9700 1 -- 172.21.15.12:0/3157686802 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5100118e0 con 0x7fc5200b29a0 2021-10-21T00:30:45.947 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc520063d90 con 0x7fc5200b29a0 2021-10-21T00:30:45.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51cff9700 1 -- 172.21.15.12:0/3157686802 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc510011c40 con 0x7fc5200b29a0 2021-10-21T00:30:45.948 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5201422b0 con 0x7fc5200b29a0 2021-10-21T00:30:45.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc520140a20 con 0x7fc5200b29a0 2021-10-21T00:30:45.949 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51cff9700 1 -- 172.21.15.12:0/3157686802 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc51001c460 con 0x7fc5200b29a0 2021-10-21T00:30:45.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51cff9700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc500053520 0x7fc5000559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:30:45.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.909+0000 7fc51cff9700 1 -- 172.21.15.12:0/3157686802 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc51006bc80 con 0x7fc5200b29a0 2021-10-21T00:30:45.950 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.913+0000 7fc51effd700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc500053520 0x7fc5000559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:30:45.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.913+0000 7fc51effd700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc500053520 0x7fc5000559e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fc514019000 tx=0x7fc514018000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:30:45.951 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:45.921+0000 7fc51cff9700 1 -- 172.21.15.12:0/3157686802 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc510042f00 con 0x7fc5200b29a0 2021-10-21T00:30:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.045+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc5200b2d80 con 0x7fc5200b29a0 2021-10-21T00:30:46.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.053+0000 7fc51cff9700 1 -- 172.21.15.12:0/3157686802 <== mon.0 v2:172.21.15.12:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc510042f00 con 0x7fc5200b29a0 2021-10-21T00:30:46.065 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.053+0000 7fc51cff9700 1 -- 172.21.15.12:0/3157686802 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc510046520 con 0x7fc5200b29a0 2021-10-21T00:30:46.068 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc500053520 msgr2=0x7fc5000559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc500053520 0x7fc5000559e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fc514019000 tx=0x7fc514018000).stop 2021-10-21T00:30:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b29a0 msgr2=0x7fc52013bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:30:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b29a0 0x7fc52013bdc0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fc5100030b0 tx=0x7fc510008040).stop 2021-10-21T00:30:46.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 shutdown_connections 2021-10-21T00:30:46.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:6800/14444,v1:172.21.15.31:6801/14444] conn(0x7fc500053520 0x7fc5000559e0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:46.070 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc52013ff70 0x7fc5200664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:46.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5200b59f0 0x7fc52014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:46.071 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 --2- 172.21.15.12:0/3157686802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5200b29a0 0x7fc52013bdc0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:30:46.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 >> 172.21.15.12:0/3157686802 conn(0x7fc52006a110 msgr2=0x7fc52005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:30:46.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 shutdown_connections 2021-10-21T00:30:46.072 INFO:teuthology.orchestra.run.smithi012.stderr:2021-10-21T00:30:46.057+0000 7fc525deb700 1 -- 172.21.15.12:0/3157686802 wait complete. 2021-10-21T00:30:46.080 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:30:46.084 INFO:teuthology.misc:Shutting down mds daemons... 2021-10-21T00:30:46.085 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:30:46.086 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.101 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:30:46.102 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-10-21T00:30:46.102 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.119 INFO:tasks.ceph.mds.c:Stopped 2021-10-21T00:30:46.120 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:30:46.121 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.137 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:30:46.138 INFO:teuthology.misc:Shutting down osd daemons... 2021-10-21T00:30:46.139 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-10-21T00:30:46.139 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.195 INFO:tasks.ceph.osd.0:Stopped 2021-10-21T00:30:46.197 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-10-21T00:30:46.202 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.266 INFO:tasks.ceph.osd.1:Stopped 2021-10-21T00:30:46.267 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-10-21T00:30:46.268 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.342 INFO:tasks.ceph.osd.2:Stopped 2021-10-21T00:30:46.344 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-10-21T00:30:46.344 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.406 INFO:tasks.ceph.osd.3:Stopped 2021-10-21T00:30:46.407 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-10-21T00:30:46.408 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.498 INFO:tasks.ceph.osd.4:Stopped 2021-10-21T00:30:46.500 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-10-21T00:30:46.500 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.565 INFO:tasks.ceph.osd.5:Stopped 2021-10-21T00:30:46.566 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-10-21T00:30:46.567 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.642 INFO:tasks.ceph.osd.6:Stopped 2021-10-21T00:30:46.644 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-10-21T00:30:46.644 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.733 INFO:tasks.ceph.osd.7:Stopped 2021-10-21T00:30:46.734 INFO:teuthology.misc:Shutting down mgr daemons... 2021-10-21T00:30:46.735 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-10-21T00:30:46.735 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.761 INFO:tasks.ceph.mgr.y:Stopped 2021-10-21T00:30:46.762 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-10-21T00:30:46.763 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.792 INFO:tasks.ceph.mgr.x:Stopped 2021-10-21T00:30:46.793 INFO:teuthology.misc:Shutting down mon daemons... 2021-10-21T00:30:46.794 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-10-21T00:30:46.794 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.823 INFO:tasks.ceph.mon.a:Stopped 2021-10-21T00:30:46.824 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-10-21T00:30:46.825 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.856 INFO:tasks.ceph.mon.b:Stopped 2021-10-21T00:30:46.857 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-10-21T00:30:46.859 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:30:46.883 INFO:tasks.ceph.mon.c:Stopped 2021-10-21T00:30:46.884 INFO:tasks.ceph:Checking cluster log for badness... 2021-10-21T00:30:46.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2021-10-21T00:30:46.908 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2021-10-21T00:30:46.909 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-10-21T00:30:47.097 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2021-10-21T00:30:47.098 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-10-21T00:30:47.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2021-10-21T00:30:47.337 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-10-21T00:30:47.537 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2021-10-21T00:30:47.538 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-10-21T00:30:47.761 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi031.front.sepia.ceph.com 2021-10-21T00:30:47.762 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-10-21T00:30:47.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:47.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:47.876 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:47.879 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:48.006 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi031.front.sepia.ceph.com 2021-10-21T00:30:48.007 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-10-21T00:30:48.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi031.front.sepia.ceph.com 2021-10-21T00:30:48.226 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-10-21T00:30:48.858 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi031.front.sepia.ceph.com 2021-10-21T00:30:48.859 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-10-21T00:30:49.059 INFO:tasks.ceph:Archiving mon data... 2021-10-21T00:30:49.061 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/data/mon.a.tgz 2021-10-21T00:30:49.062 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2021-10-21T00:30:49.070 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.QQzq2iB3iF 2021-10-21T00:30:49.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QQzq2iB3iF 2021-10-21T00:30:49.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.QQzq2iB3iF 2021-10-21T00:30:49.291 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.QQzq2iB3iF is 466KB 2021-10-21T00:30:49.363 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.QQzq2iB3iF 2021-10-21T00:30:49.371 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/data/mon.b.tgz 2021-10-21T00:30:49.372 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-21T00:30:49.380 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.QS7wC9hxxU 2021-10-21T00:30:49.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.QS7wC9hxxU 2021-10-21T00:30:49.603 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.QS7wC9hxxU 2021-10-21T00:30:49.818 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.QS7wC9hxxU is 585KB 2021-10-21T00:30:49.884 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.QS7wC9hxxU 2021-10-21T00:30:49.891 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/data/mon.c.tgz 2021-10-21T00:30:49.892 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2021-10-21T00:30:49.900 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.3iPNKZ1gPF 2021-10-21T00:30:49.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3iPNKZ1gPF 2021-10-21T00:30:50.165 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.3iPNKZ1gPF 2021-10-21T00:30:50.184 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.3iPNKZ1gPF is 585KB 2021-10-21T00:30:50.260 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.3iPNKZ1gPF 2021-10-21T00:30:50.268 INFO:tasks.ceph:Cleaning ceph cluster... 2021-10-21T00:30:50.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-10-21T00:30:50.272 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-10-21T00:30:50.275 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-10-21T00:30:50.278 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-10-21T00:30:50.296 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-10-21T00:30:50.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-10-21T00:30:50.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-10-21T00:30:50.329 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-10-21T00:30:50.335 DEBUG:teuthology.orchestra.run.smithi119:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-10-21T00:30:50.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-10-21T00:30:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-10-21T00:30:50.375 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-10-21T00:30:50.379 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-10-21T00:30:50.390 INFO:tasks.ceph:Archiving crash dumps... 2021-10-21T00:30:50.394 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi012/crash 2021-10-21T00:30:50.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-10-21T00:30:50.417 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi031/crash 2021-10-21T00:30:50.419 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-10-21T00:30:50.443 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi119/crash 2021-10-21T00:30:50.445 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-10-21T00:30:50.466 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi136/crash 2021-10-21T00:30:50.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-10-21T00:30:50.492 INFO:tasks.ceph:Shutting down logrotate 2021-10-21T00:30:50.493 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:50.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:50.505 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:50.509 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:50.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:50.597 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:50.616 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:50.634 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:50.650 INFO:tasks.ceph:Compressing logs... 2021-10-21T00:30:50.651 DEBUG:teuthology.orchestra.run.smithi012:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:30:50.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:30:50.658 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:30:50.661 DEBUG:teuthology.orchestra.run.smithi136:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:30:54.331 INFO:tasks.ceph:Archiving logs... 2021-10-21T00:30:54.333 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi012/log 2021-10-21T00:30:54.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/log/ceph -- . 2021-10-21T00:30:58.121 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi031/log 2021-10-21T00:30:58.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/log/ceph -- . 2021-10-21T00:31:00.976 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi119/log 2021-10-21T00:31:00.978 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/log/ceph -- . 2021-10-21T00:31:01.427 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi136/log 2021-10-21T00:31:01.430 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/log/ceph -- . 2021-10-21T00:31:01.470 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-10-21T00:31:01.481 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:31:01.484 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-10-21T00:31:01.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-10-21T00:31:01.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-10-21T00:31:01.491 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-10-21T00:31:01.494 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-10-21T00:31:01.615 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-10-21T00:31:01.625 INFO:teuthology.task.clock:Checking final clock skew... 2021-10-21T00:31:01.626 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:31:01.652 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:31:01.652 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2021-10-21T00:31:01.653 INFO:teuthology.orchestra.run.smithi012.stdout:-hv01.front.sepi 216.240.36.24 3 u 62 128 377 0.179 18.208 2.973 2021-10-21T00:31:01.654 INFO:teuthology.orchestra.run.smithi012.stdout:*hv02.front.sepi 163.237.218.18 2 u 124 128 377 0.150 8.428 2.044 2021-10-21T00:31:01.655 INFO:teuthology.orchestra.run.smithi012.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 128 377 0.173 11.843 2.284 2021-10-21T00:31:01.657 INFO:teuthology.orchestra.run.smithi012.stdout:+hv04.front.sepi 96.245.170.99 3 u 79 128 377 0.131 10.235 2.401 2021-10-21T00:31:01.658 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:31:01.684 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:31:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2021-10-21T00:31:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:-hv01.front.sepi 216.240.36.24 3 u 13 64 377 0.084 11.677 0.125 2021-10-21T00:31:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:*hv02.front.sepi 163.237.218.18 2 u 11 64 377 0.083 0.205 0.096 2021-10-21T00:31:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.086 2.214 0.251 2021-10-21T00:31:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:+hv04.front.sepi 96.245.170.99 3 u 13 64 377 0.074 -0.075 0.142 2021-10-21T00:31:01.689 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:31:01.714 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:31:01.715 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2021-10-21T00:31:01.715 INFO:teuthology.orchestra.run.smithi119.stdout:-hv01.front.sepi 216.240.36.24 3 u 61 128 377 0.109 12.730 0.438 2021-10-21T00:31:01.716 INFO:teuthology.orchestra.run.smithi119.stdout:*hv02.front.sepi 163.237.218.18 2 u 55 128 377 0.144 2.009 0.922 2021-10-21T00:31:01.716 INFO:teuthology.orchestra.run.smithi119.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 128 377 0.169 2.901 0.150 2021-10-21T00:31:01.716 INFO:teuthology.orchestra.run.smithi119.stdout:+hv04.front.sepi 96.245.170.99 3 u 50 128 377 0.152 0.723 0.538 2021-10-21T00:31:01.718 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:31:01.744 INFO:teuthology.orchestra.run.smithi136.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:31:01.745 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================== 2021-10-21T00:31:01.746 INFO:teuthology.orchestra.run.smithi136.stdout:-hv01.front.sepi 216.240.36.24 3 u 25 256 377 0.172 15.981 0.408 2021-10-21T00:31:01.746 INFO:teuthology.orchestra.run.smithi136.stdout:*hv02.front.sepi 163.237.218.18 2 u 45 256 377 0.152 4.380 0.533 2021-10-21T00:31:01.746 INFO:teuthology.orchestra.run.smithi136.stdout:+hv03.front.sepi 74.6.168.72 3 u 93 128 377 0.166 6.783 0.605 2021-10-21T00:31:01.747 INFO:teuthology.orchestra.run.smithi136.stdout:+hv04.front.sepi 96.245.170.99 3 u 132 128 377 0.135 4.281 0.549 2021-10-21T00:31:01.748 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-10-21T00:31:01.763 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-10-21T00:31:01.763 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-10-21T00:31:01.784 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-10-21T00:31:01.811 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-10-21T00:31:01.824 INFO:teuthology.task.internal:Duration was 4696.210559 seconds 2021-10-21T00:31:01.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-10-21T00:31:01.837 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-10-21T00:31:01.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-10-21T00:31:01.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-10-21T00:31:01.844 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-10-21T00:31:01.848 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-10-21T00:31:01.899 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-10-21T00:31:01.900 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2021-10-21T00:31:01.901 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-10-21T00:31:01.913 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2021-10-21T00:31:01.915 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-10-21T00:31:01.932 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2021-10-21T00:31:01.934 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-10-21T00:31:01.951 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2021-10-21T00:31:01.952 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-10-21T00:31:01.968 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-10-21T00:31:01.969 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:31:01.972 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:31:01.976 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:31:01.996 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:31:02.030 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-10-21T00:31:02.043 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-10-21T00:31:02.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-10-21T00:31:02.063 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-10-21T00:31:02.080 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-10-21T00:31:02.099 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-10-21T00:31:02.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-10-21T00:31:02.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:31:02.131 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:31:02.133 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:31:02.144 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2021-10-21T00:31:02.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:31:02.147 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2021-10-21T00:31:02.157 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2021-10-21T00:31:02.161 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2021-10-21T00:31:02.178 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:31:02.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:31:02.190 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:31:02.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:31:02.197 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:31:02.203 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:31:02.204 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:31:02.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:31:02.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-10-21T00:31:02.227 INFO:teuthology.task.internal:Transferring archived files... 2021-10-21T00:31:02.228 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi012 2021-10-21T00:31:02.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-10-21T00:31:02.258 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi031 2021-10-21T00:31:02.259 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-10-21T00:31:02.287 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi119 2021-10-21T00:31:02.288 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-10-21T00:31:02.317 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453002/remote/smithi136 2021-10-21T00:31:02.318 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-10-21T00:31:02.349 INFO:teuthology.task.internal:Removing archive directory... 2021-10-21T00:31:02.349 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2021-10-21T00:31:02.353 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2021-10-21T00:31:02.356 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2021-10-21T00:31:02.359 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2021-10-21T00:31:02.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-10-21T00:31:02.386 INFO:teuthology.task.internal:Not uploading archives. 2021-10-21T00:31:02.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-10-21T00:31:02.535 INFO:teuthology.task.internal:Tidying up after the test... 2021-10-21T00:31:02.536 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-10-21T00:31:02.540 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-10-21T00:31:02.542 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-10-21T00:31:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: 655395 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 21 00:31 /home/ubuntu/cephtest 2021-10-21T00:31:02.547 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-10-21T00:31:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: 655393 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 21 00:31 /home/ubuntu/cephtest 2021-10-21T00:31:02.556 INFO:teuthology.orchestra.run.smithi136.stdout: 655395 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 21 00:31 /home/ubuntu/cephtest 2021-10-21T11:06:15.976 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-10-21T11:06:16.013 DEBUG:teuthology.task.console_log:Killing console logger for smithi012 2021-10-21T11:06:16.016 DEBUG:teuthology.task.console_log:Killing console logger for smithi031 2021-10-21T11:06:16.017 DEBUG:teuthology.task.console_log:Killing console logger for smithi119 2021-10-21T11:06:16.018 DEBUG:teuthology.task.console_log:Killing console logger for smithi136 2021-10-21T11:06:16.019 DEBUG:teuthology.exit:Finished running handlers